[2025-10-13T17:00:02.028993] [INFO ] [MAIN ] Using last completed trading day: 2025-10-13 [2025-10-13T17:00:02.206628] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-13T17:00:02.206825] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-13T17:00:02.510685] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-13T17:00:02.512086] [WARN ] [STATE ] State set to: RUNNING [2025-10-13T17:00:02.512173] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-13T17:00:02.512223] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-13T17:00:02.512549] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-13T17:00:02.512611] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-13T17:00:03.434615] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-13T17:00:03.434769] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-13T17:00:03.434962] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-13T17:00:03.435448] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-13T17:00:03.435517] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-13T17:00:03.435561] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-13T17:00:03.435617] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-13T17:00:03.435683] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-13T17:00:03.435766] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-13T17:00:03.436129] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-13T17:00:03.436163] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-13T17:00:03.436318] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-13T17:00:03.436349] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-13T17:00:03.436379] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-13T17:00:03.436408] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-13T17:00:03.443188] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PHD.csv (symbol PHD no longer active). [2025-10-13T17:00:03.458505] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JEQ.csv (symbol JEQ no longer active). [2025-10-13T17:00:03.460121] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-13T17:00:03.466236] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/PHD.csv (symbol PHD no longer active). [2025-10-13T17:00:03.480404] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/JEQ.csv (symbol JEQ no longer active). [2025-10-13T17:00:03.482000] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-10-13T17:00:03.482054] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-13T17:00:03.482086] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-13T17:00:03.482113] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-13T17:00:03.482163] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-13T17:00:03.482498] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-13T17:00:03.482530] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-13T17:00:03.482559] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-13T17:00:03.482586] [INFO ] [MAIN ] Running in parallel mode [2025-10-13T17:00:03.482761] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-13T17:00:04.206478] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.200505] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.206882] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-13T17:00:04.204689] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.225467] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-13T17:00:04.242467] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-13T17:00:04.246742] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-13T17:00:04.246983] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-13T17:00:04.248487] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-13T17:00:04.247125] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-13T17:00:04.248232] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.249537] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-13T17:00:04.249756] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-13T17:00:04.249689] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-13T17:00:04.256492] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-13T17:00:04.256921] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-13T17:00:04.908383] [DEBUG] [LOCAL ] A: Loaded 51489 existing records from primary storage. [2025-10-13T17:00:04.907177] [DEBUG] [LOCAL ] AA: Loaded 54400 existing records from primary storage. [2025-10-13T17:00:04.951029] [INFO ] [MAIN ] AA: Loaded 54400 existing records. [2025-10-13T17:00:04.956378] [INFO ] [MAIN ] A: Loaded 51489 existing records. [2025-10-13T17:00:05.081941] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:05.202986] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:05.217798] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-13T17:00:05.263298] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-13T17:00:05.488496] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:05.495572] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-13T17:00:05.495505] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:05.495712] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-13T17:00:05.495943] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-13T17:00:05.496084] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-13T17:00:05.496696] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-13T17:00:05.496773] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-13T17:00:05.528623] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-13T17:00:05.566530] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-13T17:00:05.699234] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:00:05.702979] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-13T17:00:05.724418] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:00:05.753841] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-13T17:00:05.759100] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:00:05.793870] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-13T17:00:05.831230] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-13T17:00:05.896937] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-13T17:00:05.933328] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-13T17:00:05.938577] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 37m 1s. Rate: 24.4 symbols/min [2025-10-13T17:00:06.226914] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T17:00:06.242706] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-13T17:00:06.321142] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:06.366983] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-13T17:00:06.441086] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:06.465925] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:06.463872] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-13T17:00:06.526850] [DEBUG] [LOCAL ] AAP: Loaded 52653 existing records from primary storage. [2025-10-13T17:00:06.527168] [INFO ] [MAIN ] AAP: Loaded 52653 existing records. [2025-10-13T17:00:06.705949] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T17:00:06.705845] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:06.707023] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-13T17:00:06.707865] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-13T17:00:06.707923] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-13T17:00:06.708449] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-13T17:00:06.708535] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-13T17:00:07.055995] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:07.056309] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-13T17:00:07.105035] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-13T17:00:07.105949] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-13T17:00:07.451638] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T17:00:07.452523] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-13T17:00:07.804427] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-13T17:00:07.805481] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-13T17:00:08.044611] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:00:08.055339] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-13T17:00:08.067474] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T17:00:08.068395] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-13T17:00:08.115790] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:00:08.125506] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-13T17:00:08.410253] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T17:00:08.411153] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-13T17:00:08.716782] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-13T17:00:08.718218] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-13T17:00:09.051589] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T17:00:09.067975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-13T17:00:09.121438] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T17:00:09.126479] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-13T17:00:09.424719] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-13T17:00:09.426874] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-13T17:00:09.577336] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:00:09.587426] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-13T17:00:09.816916] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T17:00:09.817622] [INFO ] [REMOTE ] AAM: Full fetch complete (940 records). [2025-10-13T17:00:09.817720] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-13T17:00:10.019076] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-13T17:00:10.019359] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:10.019431] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:10.019484] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-13T17:00:10.019542] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-13T17:00:10.019578] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-13T17:00:10.019619] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-13T17:00:10.019719] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.5s. Estimated remaining: 2h 9m 3s. Rate: 18.4 symbols/min [2025-10-13T17:00:10.202740] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:10.232444] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T17:00:10.243238] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-13T17:00:10.272345] [DEBUG] [LOCAL ] AAT: Loaded 30722 existing records from primary storage. [2025-10-13T17:00:10.272604] [INFO ] [MAIN ] AAT: Loaded 30722 existing records. [2025-10-13T17:00:10.461690] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:10.461976] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-13T17:00:10.462038] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-13T17:00:10.462410] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-13T17:00:10.462466] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-13T17:00:10.823314] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:10.823727] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-13T17:00:10.851097] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:00:10.861222] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-13T17:00:11.166201] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:00:11.175609] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-13T17:00:11.637790] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:00:11.643519] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-13T17:00:12.411343] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T17:00:12.422449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-13T17:00:12.467723] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T17:00:12.473437] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-13T17:00:12.625357] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:00:12.635337] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-13T17:00:13.449347] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-13T17:00:13.463041] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-13T17:00:14.292227] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T17:00:14.298417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-13T17:00:14.380392] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:00:14.391614] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-13T17:00:14.420409] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:00:14.431863] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-13T17:00:15.038816] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:00:15.049908] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-13T17:00:15.171814] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T17:00:15.178373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-13T17:00:15.941112] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:00:15.953715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-13T17:00:16.317723] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:00:16.329683] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-13T17:00:16.743066] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:00:16.750996] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-13T17:00:16.915703] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T17:00:16.926562] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-13T17:00:17.957426] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T17:00:17.969053] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-13T17:00:18.098461] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T17:00:18.110255] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-13T17:00:18.154458] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T17:00:18.161016] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-13T17:00:18.490393] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:00:18.500430] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-13T17:00:19.423316] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:00:19.422845] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T17:00:19.440586] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-13T17:00:19.440905] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-13T17:00:19.879881] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T17:00:19.891727] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-13T17:00:20.105529] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T17:00:20.117374] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-13T17:00:20.907049] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:00:20.915585] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-13T17:00:21.390464] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T17:00:21.404867] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-13T17:00:21.884459] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:00:21.899130] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-13T17:00:21.944902] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T17:00:21.956156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-13T17:00:21.994165] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:00:22.000623] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-13T17:00:23.076072] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:00:23.084152] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-13T17:00:23.116217] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T17:00:23.130287] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-13T17:00:23.387719] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T17:00:23.414813] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-13T17:00:23.427043] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:00:23.437952] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-13T17:00:24.424132] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:00:24.427528] [INFO ] [REMOTE ] AAT: Full fetch complete (42491 records). [2025-10-13T17:00:24.427615] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-13T17:00:24.428246] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:00:24.428334] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:24.428376] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:24.428414] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-13T17:00:24.428475] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-13T17:00:24.428510] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-13T17:00:24.428694] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-10-13T17:00:24.429374] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 14.4s. Estimated remaining: 4h 35m 34s. Rate: 8.6 symbols/min [2025-10-13T17:00:24.604740] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:24.605081] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-13T17:00:24.605168] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-13T17:00:24.605279] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-13T17:00:24.605323] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-13T17:00:24.605390] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-13T17:00:24.605462] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-13T17:00:25.007397] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:25.004198] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:00:25.017701] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-13T17:00:25.031549] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:00:25.037189] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-13T17:00:25.037626] [INFO ] [REMOTE ] A: Full fetch complete (72802 records). [2025-10-13T17:00:25.038525] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-13T17:00:25.040814] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:00:25.041228] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:25.041299] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:25.041366] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-13T17:00:25.041428] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-13T17:00:25.041463] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-13T17:00:25.041600] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-13T17:00:25.042168] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. A took 21.6s. Estimated remaining: 3h 32m 38s. Rate: 11.1 symbols/min [2025-10-13T17:00:25.193510] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:00:25.265382] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-13T17:00:25.267762] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:25.269180] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-13T17:00:25.269232] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-13T17:00:25.269367] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-13T17:00:25.269410] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-13T17:00:25.269452] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-13T17:00:25.269485] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-13T17:00:25.293046] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:00:25.332788] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-13T17:00:25.348327] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:00:25.365242] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-13T17:00:25.384637] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:00:25.387280] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-13T17:00:25.387850] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-13T17:00:25.393442] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-13T17:00:25.398714] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-13T17:00:25.409057] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 1.0s. Estimated remaining: 2h 52m 56s. Rate: 13.7 symbols/min [2025-10-13T17:00:25.792130] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:25.826042] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:25.826569] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-13T17:00:25.880762] [DEBUG] [LOCAL ] ABBV: Loaded 54466 existing records from primary storage. [2025-10-13T17:00:25.881097] [INFO ] [MAIN ] ABBV: Loaded 54466 existing records. [2025-10-13T17:00:26.053091] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:26.053326] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-13T17:00:26.053382] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-13T17:00:26.054815] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-13T17:00:26.054875] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-13T17:00:26.408124] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:26.408513] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-13T17:00:26.449187] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:00:26.455416] [INFO ] [REMOTE ] AAP: Full fetch complete (75038 records). [2025-10-13T17:00:26.455542] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-13T17:00:26.838165] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-13T17:00:26.838259] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-13T17:00:26.839260] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-13T17:00:26.839347] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-13T17:00:26.842000] [DEBUG] [LOCAL ] AAP: Trimmed 75038 records to 51899 (keeping 200 days of data) [2025-10-13T17:00:27.207074] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:00:27.217507] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-13T17:00:27.222429] [DEBUG] [LOCAL ] AAP: Primary data saved (51899 records). [2025-10-13T17:00:27.222753] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-13T17:00:27.223351] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAP took 21.2s. Estimated remaining: 2h 35m 58s. Rate: 15.2 symbols/min [2025-10-13T17:00:27.398576] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:27.413712] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-13T17:00:27.420202] [INFO ] [REMOTE ] AA: Full fetch complete (77552 records). [2025-10-13T17:00:27.420330] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-13T17:00:27.706939] [DEBUG] [LOCAL ] ABCB: Loaded 30965 existing records from primary storage. [2025-10-13T17:00:27.723592] [INFO ] [MAIN ] ABCB: Loaded 30965 existing records. [2025-10-13T17:00:28.009602] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-13T17:00:28.031362] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-13T17:00:28.031250] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:28.033407] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-13T17:00:28.033695] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-13T17:00:28.033307] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-13T17:00:28.033925] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-13T17:00:28.034382] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-13T17:00:28.034463] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-13T17:00:28.117685] [DEBUG] [LOCAL ] AA: Trimmed 77552 records to 53621 (keeping 200 days of data) [2025-10-13T17:00:28.628361] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:28.632584] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-13T17:00:28.750162] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:00:28.752210] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-13T17:00:28.770808] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-13T17:00:28.775992] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-13T17:00:28.793608] [DEBUG] [LOCAL ] AA: Primary data saved (53621 records). [2025-10-13T17:00:28.793737] [INFO ] [MAIN ] AA: Full history saved. [2025-10-13T17:00:28.794049] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 25.3s. Estimated remaining: 2h 22m 28s. Rate: 16.6 symbols/min [2025-10-13T17:00:28.962341] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:29.011544] [DEBUG] [LOCAL ] ABEV: Loaded 54056 existing records from primary storage. [2025-10-13T17:00:29.011946] [INFO ] [MAIN ] ABEV: Loaded 54056 existing records. [2025-10-13T17:00:29.185420] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:29.185679] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-13T17:00:29.185736] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-13T17:00:29.186165] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-13T17:00:29.186221] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-13T17:00:29.584519] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:29.584945] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-13T17:00:29.881228] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:00:29.887162] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-13T17:00:30.114312] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:00:30.122868] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-13T17:00:30.868120] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T17:00:30.896152] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-13T17:00:30.898287] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:00:30.904976] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-13T17:00:31.223079] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T17:00:31.235716] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-13T17:00:31.756166] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:00:31.765804] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-13T17:00:32.209144] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T17:00:32.215322] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-13T17:00:32.783972] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:00:32.795874] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-13T17:00:32.866373] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:00:32.877405] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-13T17:00:33.302450] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:00:33.311196] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-13T17:00:33.558233] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T17:00:33.565470] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-13T17:00:34.324978] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:00:34.331235] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-13T17:00:34.657447] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T17:00:34.667320] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-13T17:00:34.767261] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:00:34.778430] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-13T17:00:34.973777] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:00:34.981813] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-13T17:00:35.186032] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T17:00:35.190771] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-13T17:00:36.187213] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T17:00:36.193881] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-13T17:00:36.234810] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:00:36.245988] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-13T17:00:36.260093] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:00:36.265838] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-13T17:00:37.130555] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T17:00:37.145172] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-13T17:00:37.266026] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:00:37.271716] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-13T17:00:37.443544] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:00:37.450165] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-13T17:00:38.222599] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:00:38.234327] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-13T17:00:38.589870] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:00:38.597308] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-13T17:00:38.626757] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:00:38.632979] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-13T17:00:39.108885] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:00:39.120168] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-13T17:00:39.467684] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T17:00:39.474247] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-13T17:00:39.672367] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:00:39.675109] [INFO ] [REMOTE ] AB: Full fetch complete (44613 records). [2025-10-13T17:00:39.675196] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-13T17:00:40.057119] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-13T17:00:40.057222] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-13T17:00:40.057694] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-13T17:00:40.057773] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-13T17:00:40.085733] [DEBUG] [LOCAL ] AB: Trimmed 44613 records to 25789 (keeping 200 days of data) [2025-10-13T17:00:40.087487] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:00:40.189573] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-13T17:00:40.256522] [DEBUG] [LOCAL ] AB: Primary data saved (25789 records). [2025-10-13T17:00:40.256688] [INFO ] [MAIN ] AB: Full history saved. [2025-10-13T17:00:40.256780] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.2s. Estimated remaining: 3h 1m 2s. Rate: 13.1 symbols/min [2025-10-13T17:00:40.421489] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:40.439736] [DEBUG] [LOCAL ] ABG: Loaded 18707 existing records from primary storage. [2025-10-13T17:00:40.440007] [INFO ] [MAIN ] ABG: Loaded 18707 existing records. [2025-10-13T17:00:40.617529] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:40.617764] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-13T17:00:40.617816] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-13T17:00:40.618027] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-13T17:00:40.618083] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-13T17:00:40.981166] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:40.981710] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-13T17:00:41.001265] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:00:41.008889] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-13T17:00:41.038442] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T17:00:41.049831] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-13T17:00:41.738941] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T17:00:41.742526] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-13T17:00:42.284163] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T17:00:42.294851] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-13T17:00:42.477615] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:00:42.481227] [INFO ] [REMOTE ] ABCB: Full fetch complete (44647 records). [2025-10-13T17:00:42.481318] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-13T17:00:42.878625] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-13T17:00:42.879355] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-13T17:00:42.880258] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-13T17:00:42.880672] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-13T17:00:42.892902] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T17:00:42.897837] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-13T17:00:42.899405] [DEBUG] [LOCAL ] ABCB: Trimmed 44647 records to 30598 (keeping 200 days of data) [2025-10-13T17:00:43.032708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T17:00:43.055385] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-13T17:00:43.148204] [DEBUG] [LOCAL ] ABCB: Primary data saved (30598 records). [2025-10-13T17:00:43.148393] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-13T17:00:43.148486] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.9s. Estimated remaining: 2h 53m 30s. Rate: 13.6 symbols/min [2025-10-13T17:00:43.325110] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:43.354964] [DEBUG] [LOCAL ] ABM: Loaded 32404 existing records from primary storage. [2025-10-13T17:00:43.355242] [INFO ] [MAIN ] ABM: Loaded 32404 existing records. [2025-10-13T17:00:43.529713] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:43.529911] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-13T17:00:43.529990] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-13T17:00:43.530449] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-13T17:00:43.530508] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-13T17:00:43.889434] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:43.890120] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-13T17:00:44.084295] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:00:44.081046] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:00:44.101270] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-13T17:00:44.103079] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-13T17:00:44.848291] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T17:00:44.854391] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-13T17:00:45.123838] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:00:45.150342] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-13T17:00:45.150868] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T17:00:45.157110] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-13T17:00:45.948466] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:00:45.960903] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-13T17:00:46.008942] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T17:00:46.015855] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-13T17:00:46.153157] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:00:46.159347] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-13T17:00:46.816752] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:00:46.822539] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-13T17:00:47.152722] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T17:00:47.156351] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-13T17:00:47.202895] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T17:00:47.214811] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-13T17:00:47.535625] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:00:47.548202] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-13T17:00:47.845526] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:00:47.849569] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-13T17:00:47.918095] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:00:47.924813] [INFO ] [REMOTE ] ABBV: Full fetch complete (77722 records). [2025-10-13T17:00:47.925034] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-13T17:00:48.373203] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-13T17:00:48.373409] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-13T17:00:48.374180] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-13T17:00:48.374313] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-13T17:00:48.404893] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:00:48.405058] [DEBUG] [LOCAL ] ABBV: Trimmed 77722 records to 53686 (keeping 200 days of data) [2025-10-13T17:00:48.413683] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-13T17:00:48.750865] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-10-13T17:00:48.751034] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-13T17:00:48.751119] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 23.3s. Estimated remaining: 2h 58m 8s. Rate: 13.3 symbols/min [2025-10-13T17:00:48.927016] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:48.940291] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:00:48.945301] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-13T17:00:48.993942] [DEBUG] [LOCAL ] ABR: Loaded 52712 existing records from primary storage. [2025-10-13T17:00:48.994263] [INFO ] [MAIN ] ABR: Loaded 52712 existing records. [2025-10-13T17:00:49.169236] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:49.169567] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-13T17:00:49.169635] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-13T17:00:49.170314] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-13T17:00:49.170372] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-13T17:00:49.516014] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:00:49.566124] [INFO ] [REMOTE ] ABEV: Full fetch complete (77216 records). [2025-10-13T17:00:49.567590] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-13T17:00:49.595805] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:49.654628] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-13T17:00:49.993995] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-13T17:00:49.994359] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-13T17:00:49.995548] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-13T17:00:49.995833] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-13T17:00:50.016500] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:00:50.025253] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-13T17:00:50.025524] [DEBUG] [LOCAL ] ABEV: Trimmed 77216 records to 53279 (keeping 200 days of data) [2025-10-13T17:00:50.040136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T17:00:50.100528] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-13T17:00:50.357161] [DEBUG] [LOCAL ] ABEV: Primary data saved (53279 records). [2025-10-13T17:00:50.357364] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-13T17:00:50.358741] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 21.6s. Estimated remaining: 2h 47m 37s. Rate: 14.1 symbols/min [2025-10-13T17:00:50.533776] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:50.534032] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-13T17:00:50.534072] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-13T17:00:50.534198] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-13T17:00:50.534240] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-13T17:00:50.534281] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-13T17:00:50.534315] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-13T17:00:50.907896] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:50.909198] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-13T17:00:50.927557] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:00:50.931981] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-13T17:00:51.289798] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T17:00:51.295841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-13T17:00:51.631506] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:00:51.641931] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-13T17:00:51.647955] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:00:51.649985] [INFO ] [REMOTE ] ABG: Full fetch complete (26602 records). [2025-10-13T17:00:51.650070] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-13T17:00:52.034102] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-13T17:00:52.034210] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-13T17:00:52.034637] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-13T17:00:52.034733] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-13T17:00:52.035550] [DEBUG] [LOCAL ] ABG: Trimmed 26602 records to 18555 (keeping 200 days of data) [2025-10-13T17:00:52.148254] [DEBUG] [LOCAL ] ABG: Primary data saved (18555 records). [2025-10-13T17:00:52.148461] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-13T17:00:52.148568] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 11.9s. Estimated remaining: 2h 39m 27s. Rate: 14.8 symbols/min [2025-10-13T17:00:52.346206] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:52.346541] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-13T17:00:52.346621] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-13T17:00:52.346944] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-13T17:00:52.347007] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-13T17:00:52.347154] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-13T17:00:52.347221] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-13T17:00:52.618724] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:00:52.677224] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-13T17:00:52.788913] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:52.789483] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-13T17:00:52.860943] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:00:52.872329] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-13T17:00:53.328354] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:00:53.338480] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-13T17:00:53.666044] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T17:00:53.673263] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-13T17:00:53.936085] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T17:00:53.940905] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-13T17:00:54.756347] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:00:54.767363] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-13T17:00:54.810563] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T17:00:54.818481] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-13T17:00:54.939725] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:00:54.949782] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-13T17:00:55.066536] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:00:55.071715] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-13T17:00:55.920617] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:00:55.925749] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-13T17:00:56.431110] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:00:56.442117] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-13T17:00:56.595348] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T17:00:56.607591] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-13T17:00:56.861239] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:00:56.869547] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-13T17:00:56.905996] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:00:56.917229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-13T17:00:57.703554] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:00:57.713306] [INFO ] [REMOTE ] ABM: Full fetch complete (44792 records). [2025-10-13T17:00:57.714152] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-13T17:00:58.101114] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-13T17:00:58.101721] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-13T17:00:58.102281] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-13T17:00:58.102600] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-13T17:00:58.104371] [DEBUG] [LOCAL ] ABM: Trimmed 44792 records to 32067 (keeping 200 days of data) [2025-10-13T17:00:58.218885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:00:58.230877] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-13T17:00:58.276074] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:00:58.290301] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-13T17:00:58.372163] [DEBUG] [LOCAL ] ABM: Primary data saved (32067 records). [2025-10-13T17:00:58.372321] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-13T17:00:58.372404] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.2s. Estimated remaining: 2h 45m 56s. Rate: 14.2 symbols/min [2025-10-13T17:00:58.538512] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:58.571430] [DEBUG] [LOCAL ] ACCO: Loaded 37612 existing records from primary storage. [2025-10-13T17:00:58.571732] [INFO ] [MAIN ] ACCO: Loaded 37612 existing records. [2025-10-13T17:00:58.751267] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:58.751516] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-13T17:00:58.751565] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-13T17:00:58.752157] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-13T17:00:58.752217] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-13T17:00:59.106149] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:59.106739] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-13T17:00:59.141426] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-13T17:00:59.153917] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-13T17:00:59.228592] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T17:00:59.234030] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-13T17:00:59.965121] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:00:59.978408] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-13T17:01:00.289738] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T17:01:00.417923] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-13T17:01:00.765450] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:01:01.224520] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-13T17:01:01.230936] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:01:01.270091] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T17:01:01.774143] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:01:02.017970] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-13T17:01:02.237260] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:01:02.817954] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-13T17:01:03.617922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-13T17:01:04.039920] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:01:04.141534] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-13T17:01:04.417934] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-13T17:01:05.217902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-13T17:01:05.565154] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T17:01:06.017927] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-13T17:01:06.479856] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:01:06.562470] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T17:01:06.817947] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-13T17:01:07.623068] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-13T17:01:07.639412] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:01:07.873306] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:01:08.417906] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-13T17:01:08.437065] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:01:09.217937] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-13T17:01:09.954479] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:01:10.017940] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-13T17:01:10.033928] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T17:01:10.036496] [INFO ] [REMOTE ] ACA: Full fetch complete (34093 records). [2025-10-13T17:01:10.036578] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-13T17:01:10.468047] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-13T17:01:10.468194] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-13T17:01:10.468694] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-13T17:01:10.468762] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-13T17:01:10.470206] [DEBUG] [LOCAL ] ACA: Trimmed 34093 records to 23039 (keeping 200 days of data) [2025-10-13T17:01:10.618034] [DEBUG] [LOCAL ] ACA: Primary data saved (23039 records). [2025-10-13T17:01:10.618167] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-13T17:01:10.618242] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 18.5s. Estimated remaining: 3h 8m 23s. Rate: 12.5 symbols/min [2025-10-13T17:01:10.786606] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:10.813298] [DEBUG] [LOCAL ] ACEL: Loaded 27037 existing records from primary storage. [2025-10-13T17:01:10.813550] [INFO ] [MAIN ] ACEL: Loaded 27037 existing records. [2025-10-13T17:01:10.824888] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-13T17:01:10.994597] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:10.994811] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-13T17:01:10.994867] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-13T17:01:10.995133] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-13T17:01:10.995190] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-13T17:01:11.362586] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:11.435612] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:01:11.617950] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-13T17:01:12.417926] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-13T17:01:13.012962] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-13T17:01:13.046141] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:01:13.217916] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-13T17:01:14.017985] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-13T17:01:14.448944] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T17:01:14.817936] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-13T17:01:14.867384] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:01:15.548712] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T17:01:15.617888] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-13T17:01:16.417975] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-13T17:01:16.518337] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:01:17.057358] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:01:17.218001] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-13T17:01:18.017952] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-13T17:01:18.274313] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T17:01:18.279781] [INFO ] [REMOTE ] ABR: Full fetch complete (75229 records). [2025-10-13T17:01:18.279910] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-13T17:01:18.708340] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-13T17:01:18.709129] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-13T17:01:18.709949] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-13T17:01:18.710773] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T17:01:18.711054] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-13T17:01:18.731542] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:01:18.737093] [INFO ] [REMOTE ] ABT: Full fetch complete (77208 records). [2025-10-13T17:01:18.737206] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-13T17:01:18.737302] [DEBUG] [LOCAL ] ABR: Trimmed 75229 records to 51970 (keeping 200 days of data) [2025-10-13T17:01:18.738439] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:18.738606] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:18.738690] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:18.738747] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-13T17:01:18.738804] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-13T17:01:18.738841] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-13T17:01:18.738879] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-10-13T17:01:18.738936] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 28.4s. Estimated remaining: 3h 17m 0s. Rate: 12.0 symbols/min [2025-10-13T17:01:18.823063] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-13T17:01:19.127539] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:19.254298] [DEBUG] [LOCAL ] ABR: Primary data saved (51970 records). [2025-10-13T17:01:19.254689] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-13T17:01:19.254831] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 30.5s. Estimated remaining: 3h 5m 53s. Rate: 12.7 symbols/min [2025-10-13T17:01:19.401773] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-13T17:01:19.417713] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-10-13T17:01:19.567266] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:19.625600] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-13T17:01:19.673710] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:19.675255] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-13T17:01:19.675320] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-13T17:01:19.675741] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-13T17:01:19.675806] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-13T17:01:19.970286] [DEBUG] [LOCAL ] ACI: Loaded 54033 existing records from primary storage. [2025-10-13T17:01:20.009631] [INFO ] [MAIN ] ACI: Loaded 54033 existing records. [2025-10-13T17:01:20.171901] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:20.265757] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:01:20.314706] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:20.314990] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-13T17:01:20.315041] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-13T17:01:20.315527] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-13T17:01:20.315586] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-13T17:01:20.423101] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-13T17:01:20.754861] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:20.941601] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:01:20.945030] [INFO ] [REMOTE ] ACCO: Full fetch complete (53704 records). [2025-10-13T17:01:20.945114] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-13T17:01:20.945707] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:20.945811] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:20.945869] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:20.945949] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-13T17:01:20.946024] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-13T17:01:20.946061] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-13T17:01:20.946268] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-13T17:01:20.946359] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 22.6s. Estimated remaining: 2h 58m 46s. Rate: 13.2 symbols/min [2025-10-13T17:01:21.120935] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:21.162950] [DEBUG] [LOCAL ] ACM: Loaded 43640 existing records from primary storage. [2025-10-13T17:01:21.163249] [INFO ] [MAIN ] ACM: Loaded 43640 existing records. [2025-10-13T17:01:21.227868] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-13T17:01:21.357977] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:21.358252] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-13T17:01:21.358329] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-13T17:01:21.359248] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-13T17:01:21.359307] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-13T17:01:21.739528] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:22.017972] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-13T17:01:22.366598] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:01:22.817931] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-13T17:01:23.314223] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:01:23.350288] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-13T17:01:23.617893] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-13T17:01:23.789103] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T17:01:24.417928] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-13T17:01:25.217889] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-13T17:01:25.688437] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:01:26.017924] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-13T17:01:26.183583] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-13T17:01:26.751916] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:01:26.817894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-13T17:01:27.427446] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:01:27.617906] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-13T17:01:28.417942] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-13T17:01:28.550521] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:01:29.217925] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-13T17:01:29.872199] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:01:30.017900] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-13T17:01:30.061819] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-13T17:01:30.656775] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:01:30.817960] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-13T17:01:31.617894] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-13T17:01:31.696917] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:01:32.417929] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-13T17:01:32.917597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:01:33.217899] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-13T17:01:33.545767] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-13T17:01:34.017920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-13T17:01:34.151628] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:01:34.242279] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:01:34.817935] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-13T17:01:35.445548] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T17:01:35.617896] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-13T17:01:36.003741] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:01:36.417920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-13T17:01:37.217916] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-13T17:01:38.017905] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-13T17:01:38.078934] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-13T17:01:38.154454] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:01:38.389469] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:01:38.817905] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-13T17:01:39.369217] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:01:39.617904] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-13T17:01:40.417894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-13T17:01:40.566702] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T17:01:41.152826] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T17:01:41.217890] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-13T17:01:42.017899] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-13T17:01:42.342742] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:01:42.817925] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-13T17:01:43.509162] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:01:43.617913] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-13T17:01:43.671028] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-13T17:01:44.349245] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T17:01:44.417882] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-13T17:01:44.592366] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T17:01:44.594974] [INFO ] [REMOTE ] ACEL: Full fetch complete (38534 records). [2025-10-13T17:01:44.595050] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-13T17:01:44.595639] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:44.595763] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:44.595806] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:44.595843] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-13T17:01:44.595897] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-13T17:01:44.595930] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-13T17:01:44.596081] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-13T17:01:44.596168] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 34.0s. Estimated remaining: 3h 40m 18s. Rate: 10.7 symbols/min [2025-10-13T17:01:44.766134] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:44.819738] [DEBUG] [LOCAL ] ACN: Loaded 54208 existing records from primary storage. [2025-10-13T17:01:44.820063] [INFO ] [MAIN ] ACN: Loaded 54208 existing records. [2025-10-13T17:01:45.016638] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:45.017094] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-13T17:01:45.017185] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-13T17:01:45.017725] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-13T17:01:45.017784] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-13T17:01:45.222980] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-13T17:01:45.410452] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:46.017934] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-13T17:01:46.169776] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T17:01:46.817915] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-13T17:01:47.617897] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-13T17:01:47.737994] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:01:47.958011] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-13T17:01:48.387635] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:01:48.417876] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-13T17:01:49.217909] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-13T17:01:49.326997] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:01:50.017912] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-13T17:01:50.187231] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:01:50.817936] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-13T17:01:51.617924] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-13T17:01:51.657768] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:01:51.715803] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-13T17:01:52.417906] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-13T17:01:52.711917] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:01:53.217919] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-13T17:01:53.301131] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T17:01:53.855186] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:01:54.017897] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-13T17:01:54.817970] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-13T17:01:54.910584] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:01:55.525409] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:01:55.530930] [INFO ] [REMOTE ] ACM: Full fetch complete (62795 records). [2025-10-13T17:01:55.531154] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-13T17:01:55.623140] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-13T17:01:55.925204] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-13T17:01:55.925292] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-13T17:01:55.925881] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-13T17:01:55.925945] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-13T17:01:55.927276] [DEBUG] [LOCAL ] ACM: Trimmed 62795 records to 43041 (keeping 200 days of data) [2025-10-13T17:01:56.195411] [DEBUG] [LOCAL ] ACM: Primary data saved (43041 records). [2025-10-13T17:01:56.195544] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-13T17:01:56.195624] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 35.2s. Estimated remaining: 3h 52m 33s. Rate: 10.1 symbols/min [2025-10-13T17:01:56.363978] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:56.393662] [DEBUG] [LOCAL ] ACP: Loaded 31455 existing records from primary storage. [2025-10-13T17:01:56.393940] [INFO ] [MAIN ] ACP: Loaded 31455 existing records. [2025-10-13T17:01:56.424694] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-13T17:01:56.572445] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:56.572699] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-13T17:01:56.572757] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-13T17:01:56.573282] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-13T17:01:56.573339] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-13T17:01:56.927575] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:57.217913] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-13T17:01:57.418973] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T17:01:57.424428] [INFO ] [REMOTE ] ACI: Full fetch complete (77049 records). [2025-10-13T17:01:57.424547] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-13T17:01:57.757742] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-13T17:01:57.862766] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-13T17:01:57.862846] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-13T17:01:57.863521] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-13T17:01:57.863561] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-13T17:01:57.865104] [DEBUG] [LOCAL ] ACI: Trimmed 77049 records to 53274 (keeping 200 days of data) [2025-10-13T17:01:58.038136] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-13T17:01:58.211574] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:01:58.231960] [DEBUG] [LOCAL ] ACI: Primary data saved (53274 records). [2025-10-13T17:01:58.232115] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-13T17:01:58.232204] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 39.0s. Estimated remaining: 3h 44m 49s. Rate: 10.5 symbols/min [2025-10-13T17:01:58.415436] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:58.422191] [DEBUG] [LOCAL ] ACR: Loaded 5659 existing records from primary storage. [2025-10-13T17:01:58.422373] [INFO ] [MAIN ] ACR: Loaded 5659 existing records. [2025-10-13T17:01:58.602445] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:58.602696] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-13T17:01:58.602754] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-13T17:01:58.602966] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-13T17:01:58.603021] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-13T17:01:58.832193] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-13T17:01:58.960400] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:58.982557] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:01:59.617989] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-13T17:02:00.417954] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-13T17:02:00.791911] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-13T17:02:00.797477] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-13T17:02:00.797587] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-13T17:02:01.103569] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:02:01.238086] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-13T17:02:01.237570] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-13T17:02:01.239221] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-13T17:02:01.240077] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-13T17:02:01.240280] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-13T17:02:01.296212] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:02:01.297270] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-13T17:02:01.308292] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T17:02:01.638524] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-13T17:02:01.638703] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-13T17:02:01.638799] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 42.9s. Estimated remaining: 3h 40m 22s. Rate: 10.7 symbols/min [2025-10-13T17:02:01.810468] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:01.846318] [DEBUG] [LOCAL ] ACRE: Loaded 34101 existing records from primary storage. [2025-10-13T17:02:01.846686] [INFO ] [MAIN ] ACRE: Loaded 34101 existing records. [2025-10-13T17:02:01.956098] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:02:02.031743] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-13T17:02:02.037377] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:02.038475] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-13T17:02:02.038621] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-13T17:02:02.039497] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-13T17:02:02.039596] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-13T17:02:02.388759] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:02.817931] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-13T17:02:03.617890] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-13T17:02:04.051054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:02:04.430109] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-13T17:02:04.432918] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:02:04.793827] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:02:05.217969] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-13T17:02:06.017044] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T17:02:06.027139] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-13T17:02:06.638023] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:02:06.660538] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:02:06.817977] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-13T17:02:07.617932] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-13T17:02:08.084537] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:02:08.417471] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T17:02:08.420345] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-13T17:02:09.217943] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-13T17:02:10.017907] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-13T17:02:10.417322] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T17:02:10.573570] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T17:02:10.659141] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:02:10.817928] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-13T17:02:11.617973] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-13T17:02:11.976631] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T17:02:12.417922] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-13T17:02:13.043000] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T17:02:13.217935] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-13T17:02:13.278934] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:02:14.017931] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-13T17:02:14.688625] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:02:14.817966] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-13T17:02:15.617920] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-13T17:02:15.749809] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:02:16.235681] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:02:16.417982] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-13T17:02:16.697312] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:02:17.217939] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-13T17:02:18.017940] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-13T17:02:18.411113] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:02:18.604373] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T17:02:18.817952] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-13T17:02:19.301489] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:02:19.617918] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-13T17:02:19.905842] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T17:02:20.417942] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-13T17:02:21.108462] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:02:21.217924] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-13T17:02:22.017938] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-13T17:02:22.305002] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T17:02:22.310491] [INFO ] [REMOTE ] ACN: Full fetch complete (77155 records). [2025-10-13T17:02:22.310597] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-13T17:02:22.688490] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:02:22.750425] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-13T17:02:22.750539] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-13T17:02:22.751359] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-13T17:02:22.752082] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-13T17:02:22.753818] [DEBUG] [LOCAL ] ACN: Trimmed 77155 records to 53429 (keeping 200 days of data) [2025-10-13T17:02:22.818368] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-13T17:02:23.107399] [DEBUG] [LOCAL ] ACN: Primary data saved (53429 records). [2025-10-13T17:02:23.107548] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-13T17:02:23.108587] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 38.5s. Estimated remaining: 4h 8m 28s. Rate: 9.5 symbols/min [2025-10-13T17:02:23.285921] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:23.303624] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:02:23.317215] [DEBUG] [LOCAL ] ACV: Loaded 7819 existing records from primary storage. [2025-10-13T17:02:23.317454] [INFO ] [MAIN ] ACV: Loaded 7819 existing records. [2025-10-13T17:02:23.495231] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:23.495447] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-13T17:02:23.495494] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-13T17:02:23.495668] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-13T17:02:23.495726] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-13T17:02:23.623176] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-13T17:02:23.886420] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:24.250130] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:02:24.417932] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-13T17:02:24.968984] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:02:24.996397] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T17:02:25.217934] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-13T17:02:26.017931] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-13T17:02:26.436124] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:02:26.817949] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-13T17:02:27.058331] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:02:27.061691] [INFO ] [REMOTE ] ACP: Full fetch complete (46553 records). [2025-10-13T17:02:27.061801] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-13T17:02:27.428638] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-13T17:02:27.428745] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-13T17:02:27.429205] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-13T17:02:27.429245] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-13T17:02:27.430228] [DEBUG] [LOCAL ] ACP: Trimmed 46553 records to 30940 (keeping 200 days of data) [2025-10-13T17:02:27.610539] [DEBUG] [LOCAL ] ACP: Primary data saved (30940 records). [2025-10-13T17:02:27.610787] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-13T17:02:27.610894] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 31.4s. Estimated remaining: 4h 5m 14s. Rate: 9.6 symbols/min [2025-10-13T17:02:27.623153] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-13T17:02:27.800970] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:27.847897] [DEBUG] [LOCAL ] ACVA: Loaded 49962 existing records from primary storage. [2025-10-13T17:02:27.848208] [INFO ] [MAIN ] ACVA: Loaded 49962 existing records. [2025-10-13T17:02:28.032969] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:28.033184] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-13T17:02:28.033229] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-13T17:02:28.034281] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-13T17:02:28.034342] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-13T17:02:28.152995] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T17:02:28.154319] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:02:28.219540] [INFO ] [REMOTE ] ACRE: Full fetch complete (49922 records). [2025-10-13T17:02:28.235516] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-13T17:02:28.419505] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-13T17:02:28.596412] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:28.818064] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-13T17:02:28.818152] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-13T17:02:28.818689] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-13T17:02:28.818754] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-13T17:02:28.819824] [DEBUG] [LOCAL ] ACRE: Trimmed 49922 records to 33602 (keeping 200 days of data) [2025-10-13T17:02:29.010619] [DEBUG] [LOCAL ] ACRE: Primary data saved (33602 records). [2025-10-13T17:02:29.010781] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-13T17:02:29.010867] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACRE took 27.4s. Estimated remaining: 3h 57m 11s. Rate: 9.9 symbols/min [2025-10-13T17:02:29.164996] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T17:02:29.182632] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:29.184120] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-13T17:02:29.184192] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-13T17:02:29.184544] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-13T17:02:29.184594] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-13T17:02:29.184637] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-13T17:02:29.184712] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-13T17:02:29.222991] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-13T17:02:29.533952] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:30.017917] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-13T17:02:30.684467] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T17:02:30.685873] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T17:02:30.686952] [INFO ] [REMOTE ] ACR: Full fetch complete (8506 records). [2025-10-13T17:02:30.696492] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-13T17:02:30.696982] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:02:30.697064] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:02:30.697113] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:02:30.697193] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-13T17:02:30.697273] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-13T17:02:30.697310] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-13T17:02:30.697425] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-13T17:02:30.697492] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACR took 32.5s. Estimated remaining: 3h 50m 15s. Rate: 10.2 symbols/min [2025-10-13T17:02:30.823012] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-13T17:02:30.870590] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:30.918498] [DEBUG] [LOCAL ] ADC: Loaded 46856 existing records from primary storage. [2025-10-13T17:02:30.918820] [INFO ] [MAIN ] ADC: Loaded 46856 existing records. [2025-10-13T17:02:31.120989] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:31.121194] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-13T17:02:31.121239] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-13T17:02:31.121489] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-13T17:02:31.121527] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-13T17:02:31.469814] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:02:31.484951] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:31.617916] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-13T17:02:32.321898] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:02:32.417904] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-13T17:02:33.217931] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-13T17:02:33.821917] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:02:34.017916] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-13T17:02:34.269602] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:02:34.269998] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-13T17:02:34.270085] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:02:34.270132] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-13T17:02:34.270193] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:02:34.270279] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-13T17:02:34.270345] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-13T17:02:34.270380] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-13T17:02:34.270419] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-13T17:02:34.270465] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. AD took 5.3s. Estimated remaining: 3h 46m 40s. Rate: 10.3 symbols/min [2025-10-13T17:02:34.440382] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:34.472871] [DEBUG] [LOCAL ] ADCT: Loaded 35703 existing records from primary storage. [2025-10-13T17:02:34.473139] [INFO ] [MAIN ] ADCT: Loaded 35703 existing records. [2025-10-13T17:02:34.656094] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:34.656328] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-13T17:02:34.656374] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-13T17:02:34.656875] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-13T17:02:34.656935] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-13T17:02:34.818389] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-13T17:02:35.011334] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:02:35.058638] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:35.488334] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T17:02:35.617922] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-13T17:02:36.417928] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-13T17:02:37.217902] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-13T17:02:37.488981] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T17:02:37.630620] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T17:02:37.843733] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:02:38.017931] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-13T17:02:38.769579] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T17:02:38.817933] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-13T17:02:39.578921] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:02:39.617919] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-13T17:02:40.417927] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-13T17:02:41.045335] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:02:41.217922] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-13T17:02:41.797357] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:02:42.017955] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-13T17:02:42.744871] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:02:42.817953] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-13T17:02:42.914389] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T17:02:43.617937] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-13T17:02:44.417918] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-13T17:02:44.627811] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T17:02:45.115149] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:02:45.130420] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:02:45.217958] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-13T17:02:46.017960] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-13T17:02:46.501191] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:02:46.585758] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:02:46.818019] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-13T17:02:47.422396] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:02:47.617955] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-13T17:02:48.417967] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-13T17:02:48.669113] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T17:02:49.217955] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-13T17:02:49.978106] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T17:02:50.017921] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-13T17:02:50.131295] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:02:50.741234] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:02:50.743355] [INFO ] [REMOTE ] ACV: Full fetch complete (10357 records). [2025-10-13T17:02:50.743424] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-13T17:02:50.823125] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-13T17:02:51.124810] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-13T17:02:51.124917] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-13T17:02:51.125188] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-13T17:02:51.125229] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-13T17:02:51.125767] [DEBUG] [LOCAL ] ACV: Trimmed 10357 records to 7678 (keeping 200 days of data) [2025-10-13T17:02:51.174945] [DEBUG] [LOCAL ] ACV: Primary data saved (7678 records). [2025-10-13T17:02:51.175138] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-13T17:02:51.175242] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 28.1s. Estimated remaining: 4h 2m 38s. Rate: 9.7 symbols/min [2025-10-13T17:02:51.351314] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:51.412939] [DEBUG] [LOCAL ] ADM: Loaded 54168 existing records from primary storage. [2025-10-13T17:02:51.413459] [INFO ] [MAIN ] ADM: Loaded 54168 existing records. [2025-10-13T17:02:51.606839] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:51.607154] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-13T17:02:51.607207] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-13T17:02:51.608327] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-13T17:02:51.608389] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-13T17:02:51.623188] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-13T17:02:51.982508] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:52.417972] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-13T17:02:52.547547] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:02:53.190134] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T17:02:53.217895] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-13T17:02:53.740624] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T17:02:54.017927] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-13T17:02:54.580819] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:02:54.817931] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-13T17:02:55.572012] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:02:55.617904] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-13T17:02:56.417957] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-13T17:02:56.509250] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:02:57.188376] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T17:02:57.217905] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-13T17:02:58.017928] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-13T17:02:58.229860] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:02:58.681268] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:02:58.817935] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-13T17:02:59.497145] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:02:59.617908] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-13T17:03:00.137149] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:03:00.417995] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-13T17:03:01.124493] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:03:01.217975] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-13T17:03:02.017956] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-13T17:03:02.257932] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:03:02.765428] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:03:02.817914] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-13T17:03:03.421376] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:03:03.617959] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-13T17:03:04.195960] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T17:03:04.202265] [INFO ] [REMOTE ] ADCT: Full fetch complete (51383 records). [2025-10-13T17:03:04.202510] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-13T17:03:04.418702] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-13T17:03:04.726303] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-13T17:03:04.726536] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-13T17:03:04.727621] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-13T17:03:04.727734] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-13T17:03:04.729941] [DEBUG] [LOCAL ] ADCT: Trimmed 51383 records to 35218 (keeping 200 days of data) [2025-10-13T17:03:04.962230] [DEBUG] [LOCAL ] ADCT: Primary data saved (35218 records). [2025-10-13T17:03:04.962486] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-13T17:03:04.962964] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADCT took 30.7s. Estimated remaining: 4h 13m 6s. Rate: 9.3 symbols/min [2025-10-13T17:03:05.128314] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:03:05.198961] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:05.226503] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-13T17:03:05.248543] [DEBUG] [LOCAL ] ADNT: Loaded 47843 existing records from primary storage. [2025-10-13T17:03:05.249004] [INFO ] [MAIN ] ADNT: Loaded 47843 existing records. [2025-10-13T17:03:05.437462] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:05.437921] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-13T17:03:05.438068] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-13T17:03:05.439285] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-13T17:03:05.439346] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-13T17:03:05.818040] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:06.017946] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-13T17:03:06.141522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:03:06.821415] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-13T17:03:06.826308] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:03:07.476929] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:03:07.618031] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-13T17:03:08.240589] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:03:08.245814] [INFO ] [REMOTE ] ACVA: Full fetch complete (70590 records). [2025-10-13T17:03:08.245915] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-13T17:03:08.421395] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-13T17:03:08.638864] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-13T17:03:08.638936] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-13T17:03:08.639547] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-13T17:03:08.639588] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-13T17:03:08.640913] [DEBUG] [LOCAL ] ACVA: Trimmed 70590 records to 49302 (keeping 200 days of data) [2025-10-13T17:03:08.938890] [DEBUG] [LOCAL ] ACVA: Primary data saved (49302 records). [2025-10-13T17:03:08.939018] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-13T17:03:08.940183] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ACVA took 41.3s. Estimated remaining: 4h 9m 37s. Rate: 9.4 symbols/min [2025-10-13T17:03:09.110351] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:09.161334] [DEBUG] [LOCAL ] ADT: Loaded 54223 existing records from primary storage. [2025-10-13T17:03:09.161705] [INFO ] [MAIN ] ADT: Loaded 54223 existing records. [2025-10-13T17:03:09.224539] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-13T17:03:09.350629] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:09.351085] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-13T17:03:09.351270] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-13T17:03:09.352617] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-13T17:03:09.352720] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-13T17:03:09.674956] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T17:03:09.759745] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:10.017932] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-13T17:03:10.076169] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:03:10.080695] [INFO ] [REMOTE ] ADC: Full fetch complete (65844 records). [2025-10-13T17:03:10.080850] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-13T17:03:10.081629] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:03:10.081741] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:03:10.081785] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:03:10.081848] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-13T17:03:10.081910] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-13T17:03:10.081947] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-13T17:03:10.082126] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-13T17:03:10.082245] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADC took 39.4s. Estimated remaining: 4h 2m 41s. Rate: 9.6 symbols/min [2025-10-13T17:03:10.247845] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:10.278798] [DEBUG] [LOCAL ] ADX: Loaded 28006 existing records from primary storage. [2025-10-13T17:03:10.279170] [INFO ] [MAIN ] ADX: Loaded 28006 existing records. [2025-10-13T17:03:10.485025] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:10.485456] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-13T17:03:10.485534] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-13T17:03:10.486449] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-13T17:03:10.486520] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-13T17:03:10.822378] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-13T17:03:10.881519] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:10.919509] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:03:11.617905] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-13T17:03:11.833590] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:03:12.417941] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-13T17:03:12.522625] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:03:13.033823] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:03:13.217922] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-13T17:03:14.017899] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-13T17:03:14.280749] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:03:14.658315] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:03:14.817974] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-13T17:03:15.628623] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-13T17:03:15.656462] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:03:16.048226] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:03:16.417936] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-13T17:03:17.217932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-13T17:03:17.372931] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:03:17.493344] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T17:03:18.010447] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:03:18.017879] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-13T17:03:18.817930] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-13T17:03:18.997045] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:03:19.617962] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-13T17:03:20.417906] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-13T17:03:20.680509] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:03:20.759905] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:03:21.217942] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-13T17:03:22.017918] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-13T17:03:22.162328] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:03:22.817932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-13T17:03:22.982598] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:03:23.621909] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-13T17:03:23.627612] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:03:24.200158] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:03:24.417923] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-13T17:03:25.217947] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-13T17:03:25.369445] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:03:26.017919] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-13T17:03:26.282728] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T17:03:26.817933] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-13T17:03:26.856215] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T17:03:27.617938] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-13T17:03:27.874914] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:03:28.417901] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-13T17:03:28.487278] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:03:28.836613] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:03:28.979946] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:03:28.985233] [INFO ] [REMOTE ] ADM: Full fetch complete (77266 records). [2025-10-13T17:03:28.985334] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-13T17:03:29.223158] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-13T17:03:29.380325] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-13T17:03:29.380404] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-13T17:03:29.381157] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-13T17:03:29.381222] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-13T17:03:29.382684] [DEBUG] [LOCAL ] ADM: Trimmed 77266 records to 53394 (keeping 200 days of data) [2025-10-13T17:03:29.719149] [DEBUG] [LOCAL ] ADM: Primary data saved (53394 records). [2025-10-13T17:03:29.719298] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-13T17:03:29.720205] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 38.5s. Estimated remaining: 4h 19m 28s. Rate: 9.0 symbols/min [2025-10-13T17:03:29.888402] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:29.939087] [DEBUG] [LOCAL ] AEE: Loaded 50867 existing records from primary storage. [2025-10-13T17:03:29.939384] [INFO ] [MAIN ] AEE: Loaded 50867 existing records. [2025-10-13T17:03:30.027613] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-13T17:03:30.123749] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:30.123960] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-13T17:03:30.124010] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-13T17:03:30.125050] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-13T17:03:30.125112] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-13T17:03:30.494054] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:30.817902] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-13T17:03:31.072534] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:03:31.467458] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:03:31.617914] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-13T17:03:32.353426] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:03:32.417935] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-13T17:03:32.920725] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:03:33.217926] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-13T17:03:34.017939] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-13T17:03:34.481866] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T17:03:34.817905] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-13T17:03:34.959405] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:03:35.033843] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T17:03:35.617915] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-13T17:03:36.429194] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-13T17:03:36.435309] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:03:37.174679] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:03:37.217880] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-13T17:03:37.832318] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T17:03:38.017958] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-13T17:03:38.817916] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-13T17:03:38.894543] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:03:39.618013] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-13T17:03:39.785943] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:03:39.851808] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T17:03:40.417941] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-13T17:03:41.217923] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-13T17:03:41.220530] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:03:42.012371] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:03:42.022208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-13T17:03:42.817893] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-13T17:03:42.967828] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:03:42.973322] [INFO ] [REMOTE ] ADT: Full fetch complete (77191 records). [2025-10-13T17:03:42.973483] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-13T17:03:43.282459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:03:43.328025] [INFO ] [REMOTE ] ADX: Full fetch complete (41850 records). [2025-10-13T17:03:43.342324] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-13T17:03:43.424883] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-13T17:03:43.456626] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-13T17:03:43.462523] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-13T17:03:43.473121] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-13T17:03:43.511174] [DEBUG] [LOCAL ] ADT: Trimmed 77191 records to 53446 (keeping 200 days of data) [2025-10-13T17:03:43.625928] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-13T17:03:43.945585] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-13T17:03:43.954073] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-13T17:03:43.954890] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-13T17:03:43.981094] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-13T17:03:44.003060] [DEBUG] [LOCAL ] ADX: Trimmed 41850 records to 27695 (keeping 200 days of data) [2025-10-13T17:03:44.266664] [DEBUG] [LOCAL ] ADT: Primary data saved (53446 records). [2025-10-13T17:03:44.267416] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-13T17:03:44.274288] [DEBUG] [LOCAL ] ADX: Primary data saved (27695 records). [2025-10-13T17:03:44.275793] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADT took 35.3s. Estimated remaining: 4h 28m 59s. Rate: 8.7 symbols/min [2025-10-13T17:03:44.276106] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-13T17:03:44.290092] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 34.2s. Estimated remaining: 4h 20m 44s. Rate: 9.0 symbols/min [2025-10-13T17:03:44.632937] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:44.713620] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:44.756451] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:03:44.771544] [DEBUG] [LOCAL ] AEFC: Loaded 8507 existing records from primary storage. [2025-10-13T17:03:44.772592] [INFO ] [MAIN ] AEFC: Loaded 8507 existing records. [2025-10-13T17:03:44.809711] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-13T17:03:44.990897] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:44.991254] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-13T17:03:44.991343] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-13T17:03:44.993301] [DEBUG] [LOCAL ] AEG: Loaded 50280 existing records from primary storage. [2025-10-13T17:03:44.993810] [INFO ] [MAIN ] AEG: Loaded 50280 existing records. [2025-10-13T17:03:45.025845] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-13T17:03:45.069732] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-13T17:03:45.308761] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:45.319316] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-13T17:03:45.329696] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-13T17:03:45.357688] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-13T17:03:45.370290] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-13T17:03:45.769760] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:45.789299] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-13T17:03:46.017929] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:46.021030] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-13T17:03:46.023395] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T17:03:46.201928] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:03:46.817907] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-13T17:03:46.884802] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:03:47.617904] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-13T17:03:47.682316] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:03:48.237315] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:03:48.242324] [INFO ] [REMOTE ] ADNT: Full fetch complete (67647 records). [2025-10-13T17:03:48.242458] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-13T17:03:48.243432] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:03:48.243547] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:03:48.243623] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:03:48.243738] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-13T17:03:48.243841] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-13T17:03:48.243905] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-13T17:03:48.244085] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-13T17:03:48.244205] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADNT took 43.3s. Estimated remaining: 4h 17m 29s. Rate: 9.1 symbols/min [2025-10-13T17:03:48.420554] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-13T17:03:48.443635] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:48.505445] [DEBUG] [LOCAL ] AEM: Loaded 54245 existing records from primary storage. [2025-10-13T17:03:48.505899] [INFO ] [MAIN ] AEM: Loaded 54245 existing records. [2025-10-13T17:03:48.681931] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:48.682128] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-13T17:03:48.682175] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-13T17:03:48.682882] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-13T17:03:48.682939] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-13T17:03:49.040108] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:49.078158] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:03:49.217947] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-13T17:03:50.017922] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-13T17:03:50.171065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:03:50.646973] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:03:50.817912] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-13T17:03:51.311309] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T17:03:51.617900] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-13T17:03:51.970012] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:03:52.417927] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-13T17:03:53.045030] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:03:53.217933] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-13T17:03:53.806530] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T17:03:54.001425] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:03:54.017877] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-13T17:03:54.817930] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-13T17:03:55.587577] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T17:03:55.617912] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-13T17:03:55.688013] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:03:56.418017] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-13T17:03:57.218011] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-13T17:03:57.285500] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:03:57.833391] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:03:58.017927] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-13T17:03:58.817941] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-13T17:03:58.988809] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:03:59.348222] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T17:03:59.617948] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-13T17:04:00.331266] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T17:04:00.417960] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-13T17:04:01.217922] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-13T17:04:01.361168] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:04:02.017901] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-13T17:04:02.156429] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T17:04:02.181149] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:04:02.186624] [INFO ] [REMOTE ] AEE: Full fetch complete (72742 records). [2025-10-13T17:04:02.186819] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-13T17:04:02.568294] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-13T17:04:02.568378] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-13T17:04:02.569056] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-13T17:04:02.569120] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-13T17:04:02.570497] [DEBUG] [LOCAL ] AEE: Trimmed 72742 records to 50188 (keeping 200 days of data) [2025-10-13T17:04:02.839242] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-13T17:04:02.874091] [DEBUG] [LOCAL ] AEE: Primary data saved (50188 records). [2025-10-13T17:04:02.874198] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-13T17:04:02.875104] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 33.2s. Estimated remaining: 4h 26m 18s. Rate: 8.8 symbols/min [2025-10-13T17:04:03.041062] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:03.098143] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-13T17:04:03.098476] [INFO ] [MAIN ] AEO: Loaded 54343 existing records. [2025-10-13T17:04:03.272976] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:03.273195] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-13T17:04:03.273243] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-13T17:04:03.273536] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-13T17:04:03.273591] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-13T17:04:03.624097] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:03.624257] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-13T17:04:03.672552] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:04:04.103257] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T17:04:04.418000] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-13T17:04:05.224361] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-13T17:04:05.242251] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:04:06.017975] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-13T17:04:06.266452] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:04:06.688393] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:04:06.817889] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-13T17:04:06.883161] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:04:07.617918] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-13T17:04:08.417972] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-13T17:04:08.847155] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:04:09.169270] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:04:09.217974] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-13T17:04:09.538480] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T17:04:09.822756] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:04:10.018013] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-13T17:04:10.539703] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T17:04:10.817910] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-13T17:04:11.617930] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-13T17:04:12.417952] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-13T17:04:12.419551] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T17:04:13.217897] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-13T17:04:13.568122] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T17:04:14.017955] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-13T17:04:14.221132] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:04:14.661255] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T17:04:14.677127] [INFO ] [REMOTE ] AEFC: Full fetch complete (11891 records). [2025-10-13T17:04:14.691913] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:04:14.690890] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-13T17:04:14.822986] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-13T17:04:15.053420] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-13T17:04:15.053555] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-13T17:04:15.053776] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-13T17:04:15.053839] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-13T17:04:15.054290] [DEBUG] [LOCAL ] AEFC: Trimmed 11891 records to 8389 (keeping 200 days of data) [2025-10-13T17:04:15.111598] [DEBUG] [LOCAL ] AEFC: Primary data saved (8389 records). [2025-10-13T17:04:15.111772] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-13T17:04:15.111862] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 30.8s. Estimated remaining: 4h 32m 1s. Rate: 8.6 symbols/min [2025-10-13T17:04:15.278196] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:15.326860] [DEBUG] [LOCAL ] AER: Loaded 48916 existing records from primary storage. [2025-10-13T17:04:15.327195] [INFO ] [MAIN ] AER: Loaded 48916 existing records. [2025-10-13T17:04:15.503875] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:15.504068] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-13T17:04:15.504114] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-13T17:04:15.505178] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-13T17:04:15.505237] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-13T17:04:15.623073] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-13T17:04:15.855061] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:16.417895] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-13T17:04:16.502595] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T17:04:16.509380] [INFO ] [REMOTE ] AEG: Full fetch complete (69933 records). [2025-10-13T17:04:16.509516] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-13T17:04:16.510423] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:04:16.510531] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:04:16.510601] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:04:16.510719] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-13T17:04:16.510806] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-13T17:04:16.510851] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-13T17:04:16.511035] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-13T17:04:16.511125] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.2s. Estimated remaining: 4h 26m 1s. Rate: 8.8 symbols/min [2025-10-13T17:04:17.217988] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-13T17:04:17.561124] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:04:17.933755] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:04:18.017889] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-13T17:04:18.817918] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-13T17:04:19.380852] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T17:04:19.472732] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:04:19.618018] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-13T17:04:20.252717] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T17:04:20.417939] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-13T17:04:21.145817] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:04:21.217938] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-13T17:04:22.017904] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-13T17:04:22.383956] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:04:22.817903] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-13T17:04:23.047181] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:04:23.617935] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-13T17:04:23.902539] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T17:04:24.317516] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T17:04:24.417969] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-13T17:04:25.218008] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-13T17:04:25.289245] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:04:26.017956] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-13T17:04:26.328308] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T17:04:26.817957] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-13T17:04:27.329095] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T17:04:27.378452] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:04:27.617931] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-13T17:04:28.417993] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-13T17:04:28.802001] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T17:04:29.217924] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-13T17:04:29.717216] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T17:04:29.723400] [INFO ] [REMOTE ] AEM: Full fetch complete (77201 records). [2025-10-13T17:04:29.723578] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-13T17:04:30.141860] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-13T17:04:30.141988] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-13T17:04:30.142748] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-13T17:04:30.142836] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-13T17:04:30.144614] [DEBUG] [LOCAL ] AEM: Trimmed 77201 records to 53478 (keeping 200 days of data) [2025-10-13T17:04:30.270070] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:04:30.282569] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-13T17:04:30.543825] [DEBUG] [LOCAL ] AEM: Primary data saved (53478 records). [2025-10-13T17:04:30.544033] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-13T17:04:30.544140] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 42.3s. Estimated remaining: 4h 33m 16s. Rate: 8.5 symbols/min [2025-10-13T17:04:31.153682] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T17:04:31.164766] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-13T17:04:31.972299] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T17:04:31.983156] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-13T17:04:32.851549] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:04:32.856534] [INFO ] [REMOTE ] AEO: Full fetch complete (77066 records). [2025-10-13T17:04:32.856716] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-13T17:04:32.857587] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:04:32.857704] [FATAL] [MAIN ] AEO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:04:32.857772] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:04:32.857848] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-13T17:04:32.857912] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-13T17:04:32.857949] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-10-13T17:04:32.858087] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-10-13T17:04:32.858691] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 30.0s. Estimated remaining: 4h 28m 27s. Rate: 8.7 symbols/min [2025-10-13T17:04:33.247572] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:04:33.257937] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-13T17:04:34.936994] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:04:34.947789] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-13T17:04:36.596037] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:04:36.603269] [INFO ] [REMOTE ] AER: Full fetch complete (69573 records). [2025-10-13T17:04:36.603463] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-13T17:04:37.033789] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-13T17:04:37.033901] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-13T17:04:37.034766] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-13T17:04:37.034835] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-13T17:04:37.037225] [DEBUG] [LOCAL ] AER: Trimmed 69573 records to 48213 (keeping 200 days of data) [2025-10-13T17:04:37.367420] [DEBUG] [LOCAL ] AER: Primary data saved (48213 records). [2025-10-13T17:04:37.367794] [INFO ] [MAIN ] AER: Full history saved. [2025-10-13T17:04:37.368853] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 22.3s. Estimated remaining: 4h 26m 1s. Rate: 8.8 symbols/min [2025-10-13T17:04:38.047571] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.023163] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.109758] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-13T17:04:38.126577] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.144930] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-13T17:04:38.148832] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-13T17:04:38.149056] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-13T17:04:38.147722] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.149329] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-13T17:04:38.150061] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-13T17:04:38.278393] [DEBUG] [LOCAL ] AFB: Loaded 11547 existing records from primary storage. [2025-10-13T17:04:38.285092] [INFO ] [MAIN ] AFB: Loaded 11547 existing records. [2025-10-13T17:04:38.451184] [DEBUG] [LOCAL ] AESI: Loaded 50320 existing records from primary storage. [2025-10-13T17:04:38.536779] [INFO ] [MAIN ] AESI: Loaded 50320 existing records. [2025-10-13T17:04:38.754166] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:38.813764] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-13T17:04:38.849401] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-13T17:04:38.849221] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-10-13T17:04:38.875989] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-13T17:04:38.901401] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-13T17:04:38.942403] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-10-13T17:04:39.106849] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:39.166275] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-13T17:04:39.238866] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:39.340196] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-13T17:04:39.388742] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-13T17:04:39.428172] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-13T17:04:39.463248] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-13T17:04:39.520111] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:04:39.594799] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-13T17:04:39.594977] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:04:39.595053] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-13T17:04:39.595118] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:04:39.595190] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-13T17:04:39.595255] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-13T17:04:39.595293] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-13T17:04:39.595331] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-13T17:04:39.595380] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.2s. Estimated remaining: 4h 21m 31s. Rate: 8.9 symbols/min [2025-10-13T17:04:39.685955] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:39.691785] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-13T17:04:39.715857] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-13T17:04:39.848855] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-13T17:04:39.879332] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-13T17:04:39.990146] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.037156] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-13T17:04:40.128363] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:40.528626] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.558200] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-13T17:04:40.590630] [DEBUG] [LOCAL ] AFG: Loaded 32729 existing records from primary storage. [2025-10-13T17:04:40.603691] [INFO ] [MAIN ] AFG: Loaded 32729 existing records. [2025-10-13T17:04:40.840066] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.864188] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-13T17:04:40.908941] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:40.909664] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-13T17:04:40.909790] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-13T17:04:40.910128] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-13T17:04:40.910186] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-13T17:04:41.018351] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T17:04:41.032423] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-13T17:04:41.272396] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:41.272798] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-13T17:04:41.933170] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:04:41.936518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-13T17:04:41.996830] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:04:42.007711] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-13T17:04:42.577827] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:04:42.580550] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-13T17:04:42.660843] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:04:42.667532] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-13T17:04:42.810517] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:04:42.821823] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-13T17:04:43.172386] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T17:04:43.181726] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-13T17:04:43.423704] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:04:43.446229] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T17:04:43.617949] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-13T17:04:44.417966] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-13T17:04:44.559084] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:04:44.791477] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T17:04:44.994013] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:04:45.217925] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-13T17:04:45.310632] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:04:46.017954] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-13T17:04:46.809082] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:04:46.819771] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-13T17:04:47.224907] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:04:47.617952] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-13T17:04:48.327539] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:04:48.417913] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-13T17:04:48.489773] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T17:04:49.217946] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-13T17:04:49.682510] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:04:50.018016] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-13T17:04:50.818023] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-13T17:04:50.904490] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:04:51.618019] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-13T17:04:51.748414] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:04:51.942809] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:04:52.417974] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-13T17:04:52.667701] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:04:53.217933] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-13T17:04:53.311730] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T17:04:54.017984] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-13T17:04:54.319163] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:04:54.817966] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-13T17:04:55.617941] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-13T17:04:56.093939] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-13T17:04:56.252258] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:04:56.361622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:04:56.417929] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-13T17:04:57.217971] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-13T17:04:57.521449] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T17:04:57.804959] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:04:58.018007] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-13T17:04:58.817977] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-13T17:04:59.582617] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T17:04:59.584690] [INFO ] [REMOTE ] AFB: Full fetch complete (16517 records). [2025-10-13T17:04:59.584766] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-13T17:04:59.623141] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-13T17:04:59.983515] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-13T17:04:59.983807] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-13T17:04:59.984246] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-13T17:04:59.984337] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-13T17:04:59.985308] [DEBUG] [LOCAL ] AFB: Trimmed 16517 records to 11281 (keeping 200 days of data) [2025-10-13T17:05:00.057193] [DEBUG] [LOCAL ] AFB: Primary data saved (11281 records). [2025-10-13T17:05:00.057392] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-13T17:05:00.057495] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 22.7s. Estimated remaining: 4h 34m 6s. Rate: 8.5 symbols/min [2025-10-13T17:05:00.253212] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-13T17:05:00.290890] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:00.296759] [DEBUG] [LOCAL ] AFGB: Loaded 2330 existing records from primary storage. [2025-10-13T17:05:00.297066] [INFO ] [MAIN ] AFGB: Loaded 2330 existing records. [2025-10-13T17:05:00.423199] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-13T17:05:00.487763] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:00.488053] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-13T17:05:00.488105] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-13T17:05:00.488302] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-13T17:05:00.488362] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-13T17:05:00.871246] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:01.184579] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:05:01.217892] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-13T17:05:02.017906] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-13T17:05:02.441403] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-13T17:05:02.465568] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:05:02.470510] [INFO ] [REMOTE ] AFG: Full fetch complete (46130 records). [2025-10-13T17:05:02.470720] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-13T17:05:02.471622] [FATAL] [VALIDATOR ] AFG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:05:02.471739] [FATAL] [MAIN ] AFG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:05:02.471784] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:05:02.471832] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-13T17:05:02.471904] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-13T17:05:02.471946] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-13T17:05:02.472140] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-13T17:05:02.472256] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFG took 22.9s. Estimated remaining: 4h 29m 47s. Rate: 8.6 symbols/min [2025-10-13T17:05:02.687044] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:02.692067] [DEBUG] [LOCAL ] AFGC: Loaded 2568 existing records from primary storage. [2025-10-13T17:05:02.692306] [INFO ] [MAIN ] AFGC: Loaded 2568 existing records. [2025-10-13T17:05:02.823252] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-13T17:05:02.910227] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:02.910537] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-13T17:05:02.910615] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-13T17:05:02.910831] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-13T17:05:02.910882] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-13T17:05:03.317709] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:03.617956] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-13T17:05:03.971715] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:05:04.186625] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:05:04.417983] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-13T17:05:04.824014] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T17:05:04.862455] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T17:05:05.217923] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-13T17:05:05.643323] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:05:06.017993] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-13T17:05:06.817979] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-13T17:05:07.339725] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T17:05:07.617931] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-13T17:05:08.231757] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:05:08.234394] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:05:08.417936] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-13T17:05:08.926966] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T17:05:09.218015] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-13T17:05:09.629824] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T17:05:10.017936] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-13T17:05:10.817930] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-13T17:05:11.509884] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:05:11.617922] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-13T17:05:12.417927] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-13T17:05:12.725966] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T17:05:12.785383] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-13T17:05:12.913033] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:05:13.217962] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-13T17:05:13.785394] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:05:14.017969] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-13T17:05:14.542903] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T17:05:14.817925] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-13T17:05:15.285553] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:05:15.617921] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-13T17:05:16.417966] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-13T17:05:17.217909] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-13T17:05:17.312877] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:05:17.626984] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-13T17:05:18.017941] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-13T17:05:18.387156] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:05:18.394237] [INFO ] [REMOTE ] AES: Full fetch complete (77720 records). [2025-10-13T17:05:18.394489] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-13T17:05:18.572794] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T17:05:18.598757] [INFO ] [REMOTE ] AFGB: Full fetch complete (3597 records). [2025-10-13T17:05:18.664487] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-13T17:05:18.819081] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-13T17:05:18.936787] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-13T17:05:18.942252] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-13T17:05:18.948256] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-13T17:05:18.969015] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-13T17:05:19.003460] [DEBUG] [LOCAL ] AES: Trimmed 77720 records to 53669 (keeping 200 days of data) [2025-10-13T17:05:19.301611] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-13T17:05:19.302681] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-13T17:05:19.302848] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-13T17:05:19.302935] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-13T17:05:19.303705] [DEBUG] [LOCAL ] AFGB: Trimmed 3597 records to 2291 (keeping 200 days of data) [2025-10-13T17:05:19.324525] [DEBUG] [LOCAL ] AFGB: Primary data saved (2291 records). [2025-10-13T17:05:19.324689] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-13T17:05:19.324821] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 19.3s. Estimated remaining: 4h 38m 24s. Rate: 8.4 symbols/min [2025-10-13T17:05:19.512507] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:19.524477] [DEBUG] [LOCAL ] AFGD: Loaded 1816 existing records from primary storage. [2025-10-13T17:05:19.525624] [INFO ] [MAIN ] AFGD: Loaded 1816 existing records. [2025-10-13T17:05:19.626888] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-13T17:05:19.835983] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:19.843495] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-13T17:05:19.846613] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-13T17:05:19.848626] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-13T17:05:19.848765] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-13T17:05:20.343849] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T17:05:20.387282] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:20.393465] [DEBUG] [LOCAL ] AES: Primary data saved (53669 records). [2025-10-13T17:05:20.393948] [INFO ] [MAIN ] AES: Full history saved. [2025-10-13T17:05:20.394633] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 43.0s. Estimated remaining: 4h 33m 1s. Rate: 8.5 symbols/min [2025-10-13T17:05:20.427517] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-13T17:05:20.593007] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:05:20.622830] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:20.629191] [DEBUG] [LOCAL ] AFGE: Loaded 2444 existing records from primary storage. [2025-10-13T17:05:20.629497] [INFO ] [MAIN ] AFGE: Loaded 2444 existing records. [2025-10-13T17:05:20.814126] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:20.814663] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-13T17:05:20.814731] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-13T17:05:20.814971] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-13T17:05:20.815030] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-13T17:05:21.114709] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:05:21.201499] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:21.217922] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-13T17:05:22.017929] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-13T17:05:22.418584] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T17:05:22.817944] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-13T17:05:22.940940] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:05:22.946186] [INFO ] [REMOTE ] AESI: Full fetch complete (70844 records). [2025-10-13T17:05:22.946291] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-13T17:05:23.283586] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T17:05:23.331186] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-13T17:05:23.331248] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-13T17:05:23.331912] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-13T17:05:23.331979] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-13T17:05:23.333305] [DEBUG] [LOCAL ] AESI: Trimmed 70844 records to 49713 (keeping 200 days of data) [2025-10-13T17:05:23.621498] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-13T17:05:23.621299] [DEBUG] [LOCAL ] AESI: Primary data saved (49713 records). [2025-10-13T17:05:23.621817] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-13T17:05:23.623447] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AESI took 46.3s. Estimated remaining: 4h 29m 41s. Rate: 8.6 symbols/min [2025-10-13T17:05:23.791552] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:23.841487] [DEBUG] [LOCAL ] AFL: Loaded 53938 existing records from primary storage. [2025-10-13T17:05:23.841838] [INFO ] [MAIN ] AFL: Loaded 53938 existing records. [2025-10-13T17:05:24.014008] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:24.014227] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-13T17:05:24.014281] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-13T17:05:24.014601] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-13T17:05:24.014697] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-13T17:05:24.268568] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:05:24.376144] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:24.417934] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-13T17:05:24.873063] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:05:25.217924] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-13T17:05:25.789771] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:05:26.017923] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-13T17:05:26.474615] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T17:05:26.817926] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-13T17:05:27.199327] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T17:05:27.617921] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-13T17:05:28.094590] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T17:05:28.417933] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-13T17:05:28.858713] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T17:05:29.217924] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-13T17:05:29.574370] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T17:05:30.017917] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-13T17:05:30.817918] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-13T17:05:31.378974] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:05:31.617896] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-13T17:05:31.719912] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:05:31.976150] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T17:05:32.417921] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-13T17:05:32.838313] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T17:05:33.217953] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-13T17:05:33.677177] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T17:05:34.017919] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-13T17:05:34.817993] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-13T17:05:35.279789] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T17:05:35.557764] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:05:35.617892] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-13T17:05:36.417940] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-13T17:05:36.897250] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T17:05:37.014637] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:05:37.217972] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-13T17:05:37.660025] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T17:05:38.017972] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-13T17:05:38.489670] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T17:05:38.817991] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-13T17:05:39.226581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T17:05:39.617979] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-13T17:05:39.969142] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T17:05:39.970082] [INFO ] [REMOTE ] AFGD: Full fetch complete (3047 records). [2025-10-13T17:05:39.970207] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-13T17:05:40.363389] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-13T17:05:40.363564] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-13T17:05:40.363755] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-13T17:05:40.363824] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-13T17:05:40.364177] [DEBUG] [LOCAL ] AFGD: Trimmed 3047 records to 1795 (keeping 200 days of data) [2025-10-13T17:05:40.376766] [DEBUG] [LOCAL ] AFGD: Primary data saved (1795 records). [2025-10-13T17:05:40.376849] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-13T17:05:40.376929] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 21.1s. Estimated remaining: 4h 37m 38s. Rate: 8.4 symbols/min [2025-10-13T17:05:40.423084] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-13T17:05:40.550536] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:40.609458] [DEBUG] [LOCAL ] AG: Loaded 54422 existing records from primary storage. [2025-10-13T17:05:40.609917] [INFO ] [MAIN ] AG: Loaded 54422 existing records. [2025-10-13T17:05:40.792608] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:40.792880] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-13T17:05:40.792926] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-13T17:05:40.793448] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-13T17:05:40.793505] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-13T17:05:40.983346] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:05:41.176722] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:41.217895] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-13T17:05:42.017983] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-13T17:05:42.818013] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-13T17:05:43.284967] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:05:43.303546] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:05:43.617911] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-13T17:05:44.010303] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:05:44.054453] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:05:44.417946] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-13T17:05:45.217965] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-13T17:05:45.962663] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:05:46.017943] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-13T17:05:46.817935] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-13T17:05:47.059072] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T17:05:47.206743] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T17:05:47.617896] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-13T17:05:47.803839] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T17:05:48.109606] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:05:48.417937] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-13T17:05:49.217939] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-13T17:05:49.880310] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T17:05:50.017919] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-13T17:05:50.288168] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:05:50.382257] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T17:05:50.817981] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-13T17:05:51.617926] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-13T17:05:52.020465] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T17:05:52.021228] [INFO ] [REMOTE ] AFGC: Full fetch complete (3670 records). [2025-10-13T17:05:52.021293] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-13T17:05:52.389558] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-13T17:05:52.389743] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-13T17:05:52.389923] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-13T17:05:52.390150] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-13T17:05:52.390814] [DEBUG] [LOCAL ] AFGC: Trimmed 3670 records to 2526 (keeping 200 days of data) [2025-10-13T17:05:52.406591] [DEBUG] [LOCAL ] AFGC: Primary data saved (2526 records). [2025-10-13T17:05:52.406712] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-13T17:05:52.406796] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 49.9s. Estimated remaining: 4h 41m 26s. Rate: 8.3 symbols/min [2025-10-13T17:05:52.423708] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-13T17:05:52.546830] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:05:52.631368] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:52.673111] [DEBUG] [LOCAL ] AGCO: Loaded 42959 existing records from primary storage. [2025-10-13T17:05:52.673380] [INFO ] [MAIN ] AGCO: Loaded 42959 existing records. [2025-10-13T17:05:52.851570] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:52.851829] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-13T17:05:52.851878] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-13T17:05:52.852296] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-13T17:05:52.852355] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-13T17:05:53.000320] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T17:05:53.056963] [INFO ] [REMOTE ] AFGE: Full fetch complete (3453 records). [2025-10-13T17:05:53.105363] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-13T17:05:53.218162] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-13T17:05:53.392979] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:53.615052] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-13T17:05:53.615126] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-13T17:05:53.615243] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-13T17:05:53.615283] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-13T17:05:53.615623] [DEBUG] [LOCAL ] AFGE: Trimmed 3453 records to 2404 (keeping 200 days of data) [2025-10-13T17:05:53.630634] [DEBUG] [LOCAL ] AFGE: Primary data saved (2404 records). [2025-10-13T17:05:53.630735] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-13T17:05:53.630808] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 33.2s. Estimated remaining: 4h 36m 33s. Rate: 8.4 symbols/min [2025-10-13T17:05:53.801790] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:53.801971] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-13T17:05:53.802009] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-13T17:05:53.802118] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-13T17:05:53.802159] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-13T17:05:53.802200] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-13T17:05:53.802231] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-13T17:05:54.023020] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-13T17:05:54.175451] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:54.817930] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-13T17:05:55.142521] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T17:05:55.617982] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-13T17:05:55.790212] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:05:56.277248] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-13T17:05:56.417916] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-13T17:05:57.217924] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-13T17:05:57.392681] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T17:05:58.017911] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-13T17:05:58.451549] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T17:05:58.684798] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T17:05:58.817962] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-13T17:05:59.617903] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-13T17:05:59.865759] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T17:05:59.890909] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:06:00.417928] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-13T17:06:01.016037] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:06:01.042952] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:06:01.217923] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-13T17:06:02.017984] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-13T17:06:02.817946] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-13T17:06:02.868543] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T17:06:03.617889] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-13T17:06:03.629482] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:06:03.869111] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:06:03.874923] [INFO ] [REMOTE ] AFL: Full fetch complete (76908 records). [2025-10-13T17:06:03.875099] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-13T17:06:04.274011] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-13T17:06:04.274141] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-13T17:06:04.274893] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-13T17:06:04.274959] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-13T17:06:04.276487] [DEBUG] [LOCAL ] AFL: Trimmed 76908 records to 53185 (keeping 200 days of data) [2025-10-13T17:06:04.460102] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-13T17:06:04.608157] [DEBUG] [LOCAL ] AFL: Primary data saved (53185 records). [2025-10-13T17:06:04.608293] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-13T17:06:04.608374] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 41.0s. Estimated remaining: 4h 39m 23s. Rate: 8.3 symbols/min [2025-10-13T17:06:04.780766] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:04.833531] [DEBUG] [LOCAL ] AGI: Loaded 54200 existing records from primary storage. [2025-10-13T17:06:04.834056] [INFO ] [MAIN ] AGI: Loaded 54200 existing records. [2025-10-13T17:06:05.033616] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:05.033971] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-13T17:06:05.034125] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-13T17:06:05.034674] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-13T17:06:05.034741] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-13T17:06:05.227876] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-13T17:06:05.375835] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:06:05.514445] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:06.017931] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-13T17:06:06.317024] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:06:06.366165] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:06:06.817958] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-13T17:06:07.617947] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-13T17:06:07.818403] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:06:08.417954] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-13T17:06:08.662947] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:06:08.949368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T17:06:09.217967] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-13T17:06:10.017953] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-13T17:06:10.077734] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:06:10.594052] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:06:10.817945] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-13T17:06:11.617979] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-13T17:06:11.658742] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:06:12.201607] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T17:06:12.417992] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-13T17:06:13.217970] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-13T17:06:13.325676] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:06:14.017905] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-13T17:06:14.376419] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:06:14.442421] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T17:06:14.817975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-13T17:06:15.617900] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-13T17:06:15.775166] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:06:16.417900] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-13T17:06:16.463465] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:06:17.217943] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-13T17:06:17.543713] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T17:06:17.771639] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-13T17:06:18.017946] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-13T17:06:18.715607] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:06:18.779428] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T17:06:18.817897] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-13T17:06:19.497883] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:06:19.617922] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-13T17:06:20.417912] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-13T17:06:20.720322] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T17:06:21.217942] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-13T17:06:22.017931] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-13T17:06:22.817900] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-13T17:06:22.841350] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-13T17:06:22.847247] [INFO ] [REMOTE ] AG: Full fetch complete (77619 records). [2025-10-13T17:06:22.847374] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-13T17:06:23.001683] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T17:06:23.105427] [INFO ] [REMOTE ] AGD: Full fetch complete (26258 records). [2025-10-13T17:06:23.130373] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-13T17:06:23.444462] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-13T17:06:23.531268] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-13T17:06:23.551605] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-13T17:06:23.604906] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-13T17:06:23.633174] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-13T17:06:23.633103] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-13T17:06:23.703851] [DEBUG] [LOCAL ] AG: Trimmed 77619 records to 53643 (keeping 200 days of data) [2025-10-13T17:06:23.731435] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-13T17:06:23.731524] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-13T17:06:23.731852] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-13T17:06:23.731912] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-13T17:06:23.732738] [DEBUG] [LOCAL ] AGD: Trimmed 26258 records to 19042 (keeping 200 days of data) [2025-10-13T17:06:23.965351] [DEBUG] [LOCAL ] AGD: Primary data saved (19042 records). [2025-10-13T17:06:23.967071] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-13T17:06:23.967457] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 30.3s. Estimated remaining: 4h 48m 28s. Rate: 8.0 symbols/min [2025-10-13T17:06:24.148671] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:24.319761] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:06:24.332880] [DEBUG] [LOCAL ] AGL: Loaded 53272 existing records from primary storage. [2025-10-13T17:06:24.335824] [INFO ] [MAIN ] AGL: Loaded 53272 existing records. [2025-10-13T17:06:24.422446] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-13T17:06:24.628420] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:24.629598] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-13T17:06:24.630041] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-13T17:06:24.631038] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-13T17:06:24.632590] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-13T17:06:24.755148] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-13T17:06:24.775435] [INFO ] [MAIN ] AG: Full history saved. [2025-10-13T17:06:24.776382] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 44.4s. Estimated remaining: 4h 43m 24s. Rate: 8.2 symbols/min [2025-10-13T17:06:25.040957] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:25.212174] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-13T17:06:25.231363] [INFO ] [MAIN ] AGM: Loaded 10669 existing records. [2025-10-13T17:06:25.313347] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:25.332418] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-13T17:06:25.459020] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:25.460072] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-13T17:06:25.460123] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-13T17:06:25.460267] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-13T17:06:25.460305] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-13T17:06:25.791504] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T17:06:25.892042] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:06:25.897909] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:25.903069] [INFO ] [REMOTE ] AGCO: Full fetch complete (61614 records). [2025-10-13T17:06:25.903190] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-13T17:06:26.023010] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-13T17:06:26.285029] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-13T17:06:26.285115] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-13T17:06:26.285733] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-13T17:06:26.285796] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-13T17:06:26.287041] [DEBUG] [LOCAL ] AGCO: Trimmed 61614 records to 42483 (keeping 200 days of data) [2025-10-13T17:06:26.544164] [DEBUG] [LOCAL ] AGCO: Primary data saved (42483 records). [2025-10-13T17:06:26.544296] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-13T17:06:26.544370] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 34.1s. Estimated remaining: 4h 39m 14s. Rate: 8.3 symbols/min [2025-10-13T17:06:26.709052] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:26.735784] [DEBUG] [LOCAL ] AGO: Loaded 28322 existing records from primary storage. [2025-10-13T17:06:26.736059] [INFO ] [MAIN ] AGO: Loaded 28322 existing records. [2025-10-13T17:06:26.824404] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-13T17:06:26.913796] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:26.914054] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-13T17:06:26.914102] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-13T17:06:26.914453] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-13T17:06:26.914516] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-13T17:06:27.265611] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:06:27.308297] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:27.558937] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T17:06:27.628875] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-13T17:06:27.655763] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:06:28.199167] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:06:28.417926] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-13T17:06:29.050584] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:06:29.217903] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-13T17:06:29.932915] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T17:06:30.017891] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-13T17:06:30.814828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T17:06:30.817870] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-13T17:06:31.391403] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T17:06:31.617899] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-13T17:06:32.417928] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-13T17:06:33.217932] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-13T17:06:33.527968] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T17:06:33.627282] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T17:06:34.017971] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-13T17:06:34.817917] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-13T17:06:34.950321] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:06:34.990675] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:06:35.617914] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-13T17:06:36.230056] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T17:06:36.417944] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-13T17:06:37.057507] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:06:37.217949] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-13T17:06:37.567294] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:06:38.017925] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-13T17:06:38.817908] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-13T17:06:38.857741] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T17:06:38.889223] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:06:39.617921] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-13T17:06:40.417911] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-13T17:06:40.511027] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:06:41.229149] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-13T17:06:41.258303] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T17:06:41.704539] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:06:42.017929] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-13T17:06:42.785720] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:06:42.817889] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-13T17:06:43.454425] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:06:43.617931] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-13T17:06:44.414600] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:06:44.424779] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-13T17:06:44.443837] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T17:06:45.217976] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-13T17:06:45.927665] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T17:06:46.017950] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-13T17:06:46.430315] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-13T17:06:46.436370] [INFO ] [REMOTE ] AGI: Full fetch complete (76961 records). [2025-10-13T17:06:46.436571] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-13T17:06:46.827887] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-13T17:06:46.854549] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-13T17:06:46.854808] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-13T17:06:46.855824] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-13T17:06:46.855907] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-13T17:06:46.858497] [DEBUG] [LOCAL ] AGI: Trimmed 76961 records to 53423 (keeping 200 days of data) [2025-10-13T17:06:47.198049] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-13T17:06:47.198247] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-13T17:06:47.198349] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 42.6s. Estimated remaining: 4h 48m 42s. Rate: 8.0 symbols/min [2025-10-13T17:06:47.378702] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:47.414718] [DEBUG] [LOCAL ] AGRO: Loaded 33809 existing records from primary storage. [2025-10-13T17:06:47.415088] [INFO ] [MAIN ] AGRO: Loaded 33809 existing records. [2025-10-13T17:06:47.610625] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:47.611209] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-13T17:06:47.611351] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-13T17:06:47.611994] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-13T17:06:47.612057] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-13T17:06:47.643978] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-13T17:06:47.899555] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:06:48.028379] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:48.314114] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T17:06:48.417945] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-13T17:06:48.528772] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:06:48.530864] [INFO ] [REMOTE ] AGM: Full fetch complete (13194 records). [2025-10-13T17:06:48.530964] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-13T17:06:48.933723] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-13T17:06:48.933857] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-13T17:06:48.934110] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-13T17:06:48.934153] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-13T17:06:48.934710] [DEBUG] [LOCAL ] AGM: Trimmed 13194 records to 10647 (keeping 200 days of data) [2025-10-13T17:06:49.003825] [DEBUG] [LOCAL ] AGM: Primary data saved (10647 records). [2025-10-13T17:06:49.003973] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-13T17:06:49.004064] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 24.2s. Estimated remaining: 4h 44m 36s. Rate: 8.1 symbols/min [2025-10-13T17:06:49.179513] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:49.219792] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-13T17:06:49.222487] [DEBUG] [LOCAL ] AGX: Loaded 33549 existing records from primary storage. [2025-10-13T17:06:49.223015] [INFO ] [MAIN ] AGX: Loaded 33549 existing records. [2025-10-13T17:06:49.429436] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:49.429861] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-13T17:06:49.429916] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-13T17:06:49.430261] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-13T17:06:49.430337] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-13T17:06:49.860854] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:49.934183] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:06:50.017903] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-13T17:06:50.744303] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:06:50.818013] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-13T17:06:50.993668] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:06:51.618056] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-13T17:06:52.417900] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-13T17:06:52.704731] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:06:53.136577] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:06:53.217938] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-13T17:06:53.494768] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:06:54.017922] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-13T17:06:54.668920] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:06:54.817993] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-13T17:06:55.424286] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:06:55.617952] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-13T17:06:56.220668] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:06:56.417955] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-13T17:06:57.217934] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-13T17:06:57.312686] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:06:57.318208] [INFO ] [REMOTE ] AGL: Full fetch complete (75634 records). [2025-10-13T17:06:57.318331] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-13T17:06:57.784024] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-13T17:06:57.784136] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-13T17:06:57.785016] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-13T17:06:57.785263] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-13T17:06:57.804896] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:06:57.813120] [DEBUG] [LOCAL ] AGL: Trimmed 75634 records to 52552 (keeping 200 days of data) [2025-10-13T17:06:58.020981] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-13T17:06:58.109231] [DEBUG] [LOCAL ] AGL: Primary data saved (52552 records). [2025-10-13T17:06:58.109375] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-13T17:06:58.109468] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 34.1s. Estimated remaining: 4h 45m 40s. Rate: 8.1 symbols/min [2025-10-13T17:06:58.283943] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:58.321634] [DEBUG] [LOCAL ] AHH: Loaded 41288 existing records from primary storage. [2025-10-13T17:06:58.321975] [INFO ] [MAIN ] AHH: Loaded 41288 existing records. [2025-10-13T17:06:58.525537] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:58.525839] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-13T17:06:58.525905] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-13T17:06:58.544136] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-13T17:06:58.544330] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-13T17:06:58.619207] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:06:58.823140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-13T17:06:58.928771] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:59.038495] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:06:59.617908] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-13T17:06:59.759400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:07:00.417991] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-13T17:07:01.134071] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:07:01.217993] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-13T17:07:01.663912] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:07:01.667220] [INFO ] [REMOTE ] AGO: Full fetch complete (39348 records). [2025-10-13T17:07:01.670551] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-13T17:07:01.671899] [FATAL] [VALIDATOR ] AGO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:07:01.671991] [FATAL] [MAIN ] AGO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:07:01.672040] [WARN ] [MAIN ] AGO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:07:01.672128] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-13T17:07:01.672227] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-13T17:07:01.672293] [INFO ] [LOCAL ] AGO: Starting deletion of derivative data. [2025-10-13T17:07:01.672823] [DEBUG] [LOCAL ] AGO: Deleted derivative data file. [2025-10-13T17:07:01.673831] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 35.1s. Estimated remaining: 4h 42m 57s. Rate: 8.2 symbols/min [2025-10-13T17:07:01.868897] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:01.869140] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-13T17:07:01.869180] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-13T17:07:01.869351] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-13T17:07:01.869393] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-13T17:07:01.869434] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-13T17:07:01.869466] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-13T17:07:02.025885] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-13T17:07:02.279599] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:02.591283] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:07:02.817991] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-13T17:07:03.536133] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:07:03.617963] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-13T17:07:03.818524] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:07:03.818988] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-13T17:07:03.819102] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:07:03.819163] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-13T17:07:03.819244] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:07:03.819330] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-13T17:07:03.819411] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-13T17:07:03.819454] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-13T17:07:03.819497] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-13T17:07:03.819551] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 2.1s. Estimated remaining: 4h 39m 23s. Rate: 8.3 symbols/min [2025-10-13T17:07:04.018543] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:04.071999] [DEBUG] [LOCAL ] AHR: Loaded 49812 existing records from primary storage. [2025-10-13T17:07:04.072422] [INFO ] [MAIN ] AHR: Loaded 49812 existing records. [2025-10-13T17:07:04.254246] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:04.254789] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-13T17:07:04.254857] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-13T17:07:04.255413] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-13T17:07:04.255580] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-13T17:07:04.418427] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-13T17:07:04.643852] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:04.649664] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:07:05.217926] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-13T17:07:05.892351] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:07:06.017969] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-13T17:07:06.817917] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-13T17:07:06.926563] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T17:07:07.187121] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T17:07:07.617990] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-13T17:07:08.253100] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:07:08.417958] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-13T17:07:09.227155] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-13T17:07:09.255157] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:07:09.810333] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:07:10.017912] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-13T17:07:10.711257] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:07:10.817902] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-13T17:07:11.618031] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-13T17:07:11.698310] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:07:12.320736] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:07:12.417976] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-13T17:07:12.738897] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:07:13.217943] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-13T17:07:13.757919] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:07:14.017938] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-13T17:07:14.116281] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T17:07:14.817907] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-13T17:07:15.617961] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-13T17:07:15.776085] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:07:15.986269] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:07:16.417933] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-13T17:07:17.011237] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:07:17.217957] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-13T17:07:18.017978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-13T17:07:18.157618] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:07:18.276699] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:07:18.817955] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-13T17:07:19.617961] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-13T17:07:19.930720] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T17:07:20.417902] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-13T17:07:20.634350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:07:21.165848] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:07:21.217909] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-13T17:07:21.568539] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:07:21.572380] [INFO ] [REMOTE ] AGRO: Full fetch complete (49100 records). [2025-10-13T17:07:21.572475] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-13T17:07:21.975248] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-13T17:07:21.975327] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-13T17:07:21.975835] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-13T17:07:21.975897] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-13T17:07:21.977010] [DEBUG] [LOCAL ] AGRO: Trimmed 49100 records to 33364 (keeping 200 days of data) [2025-10-13T17:07:22.025114] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-13T17:07:22.173476] [DEBUG] [LOCAL ] AGRO: Primary data saved (33364 records). [2025-10-13T17:07:22.173732] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-13T17:07:22.173823] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 35.0s. Estimated remaining: 4h 46m 31s. Rate: 8.1 symbols/min [2025-10-13T17:07:22.348490] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:22.379932] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:07:22.385835] [DEBUG] [LOCAL ] AHT: Loaded 6364 existing records from primary storage. [2025-10-13T17:07:22.394421] [INFO ] [MAIN ] AHT: Loaded 6364 existing records. [2025-10-13T17:07:22.582526] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:22.582804] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-13T17:07:22.582857] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-13T17:07:22.583056] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-13T17:07:22.583114] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-13T17:07:22.830158] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-13T17:07:22.965058] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:23.364726] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T17:07:23.617943] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-13T17:07:24.239408] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:07:24.417921] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-13T17:07:25.109281] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T17:07:25.217934] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-13T17:07:25.830090] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:07:26.017934] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-13T17:07:26.771419] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:07:26.817957] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-13T17:07:27.617917] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-13T17:07:27.709346] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:07:27.754575] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:07:28.417952] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-13T17:07:28.870317] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:07:28.873914] [INFO ] [REMOTE ] AGX: Full fetch complete (48660 records). [2025-10-13T17:07:28.874026] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-13T17:07:29.027203] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:07:29.223080] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-13T17:07:29.294630] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-13T17:07:29.294753] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-13T17:07:29.295337] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-13T17:07:29.295400] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-13T17:07:29.296409] [DEBUG] [LOCAL ] AGX: Trimmed 48660 records to 33020 (keeping 200 days of data) [2025-10-13T17:07:29.496362] [DEBUG] [LOCAL ] AGX: Primary data saved (33020 records). [2025-10-13T17:07:29.496490] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-13T17:07:29.497587] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 40.5s. Estimated remaining: 4h 46m 19s. Rate: 8.1 symbols/min [2025-10-13T17:07:29.664461] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:29.664689] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-13T17:07:29.664763] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-13T17:07:29.664875] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-13T17:07:29.664916] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-13T17:07:29.664957] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-13T17:07:29.664998] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-13T17:07:30.024791] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:30.019455] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-13T17:07:30.032142] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:07:30.817923] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-13T17:07:31.617901] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-13T17:07:31.681403] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:07:31.685605] [INFO ] [REMOTE ] AHH: Full fetch complete (59734 records). [2025-10-13T17:07:31.685755] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-13T17:07:32.069623] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-13T17:07:32.069746] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-13T17:07:32.070385] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-13T17:07:32.070433] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-13T17:07:32.071881] [DEBUG] [LOCAL ] AHH: Trimmed 59734 records to 40607 (keeping 200 days of data) [2025-10-13T17:07:32.308250] [DEBUG] [LOCAL ] AHH: Primary data saved (40607 records). [2025-10-13T17:07:32.308658] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-13T17:07:32.308766] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 34.2s. Estimated remaining: 4h 43m 17s. Rate: 8.2 symbols/min [2025-10-13T17:07:32.423104] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-13T17:07:32.484612] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:32.539211] [DEBUG] [LOCAL ] AIG: Loaded 54250 existing records from primary storage. [2025-10-13T17:07:32.539634] [INFO ] [MAIN ] AIG: Loaded 54250 existing records. [2025-10-13T17:07:32.718736] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:32.719005] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-13T17:07:32.719054] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-13T17:07:32.719933] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-13T17:07:32.719995] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-13T17:07:33.038989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T17:07:33.122902] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:33.199896] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:07:33.217888] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-13T17:07:33.479972] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-13T17:07:34.017930] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-13T17:07:34.828736] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-13T17:07:34.835311] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:07:35.475323] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:07:35.617923] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-13T17:07:36.237905] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-13T17:07:36.417967] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-13T17:07:37.204171] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:07:37.217896] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-13T17:07:38.017969] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-13T17:07:38.682597] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T17:07:38.692915] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:07:38.817944] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-13T17:07:38.984473] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:07:39.413838] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:07:39.617960] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-13T17:07:40.409527] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T17:07:40.417873] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-13T17:07:41.145465] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:07:41.217941] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-13T17:07:42.017913] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-13T17:07:42.818019] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-13T17:07:42.878115] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:07:43.556396] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T17:07:43.617966] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-13T17:07:44.121785] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:07:44.178829] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:07:44.181119] [INFO ] [REMOTE ] AHT: Full fetch complete (9208 records). [2025-10-13T17:07:44.181310] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-13T17:07:44.423206] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-13T17:07:44.765009] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-13T17:07:44.765144] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-13T17:07:44.765575] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-13T17:07:44.765673] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-13T17:07:44.766408] [DEBUG] [LOCAL ] AHT: Trimmed 9208 records to 6328 (keeping 200 days of data) [2025-10-13T17:07:44.804432] [DEBUG] [LOCAL ] AHT: Primary data saved (6328 records). [2025-10-13T17:07:44.804622] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-13T17:07:44.804760] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 22.6s. Estimated remaining: 4h 46m 21s. Rate: 8.1 symbols/min [2025-10-13T17:07:44.996949] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:44.997180] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-13T17:07:44.997275] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-13T17:07:44.997403] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-13T17:07:44.997452] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-13T17:07:44.997496] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-13T17:07:44.997529] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-13T17:07:45.223202] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-13T17:07:45.376236] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:46.017979] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-13T17:07:46.205906] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:07:46.206368] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-13T17:07:46.206467] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:07:46.206520] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-13T17:07:46.206558] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:07:46.206600] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-13T17:07:46.206692] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-13T17:07:46.206754] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-13T17:07:46.206801] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-13T17:07:46.206857] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 1.4s. Estimated remaining: 4h 42m 32s. Rate: 8.2 symbols/min [2025-10-13T17:07:46.394233] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:46.423814] [DEBUG] [LOCAL ] AIN: Loaded 24875 existing records from primary storage. [2025-10-13T17:07:46.424203] [INFO ] [MAIN ] AIN: Loaded 24875 existing records. [2025-10-13T17:07:46.624326] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:46.625056] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-13T17:07:46.625135] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-13T17:07:46.637559] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-13T17:07:46.656458] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-13T17:07:46.695209] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T17:07:46.834009] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-13T17:07:47.079625] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:47.140664] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T17:07:47.618004] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-13T17:07:48.417995] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-13T17:07:48.928179] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T17:07:49.217988] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-13T17:07:49.418122] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:07:49.444959] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:07:50.017996] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-13T17:07:50.817953] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-13T17:07:51.091107] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:07:51.328573] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T17:07:51.617952] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-13T17:07:52.417953] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-13T17:07:52.560730] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T17:07:52.567212] [INFO ] [REMOTE ] AHR: Full fetch complete (70665 records). [2025-10-13T17:07:52.567516] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-13T17:07:52.998879] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-13T17:07:52.999013] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-13T17:07:53.000040] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-13T17:07:53.000153] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-13T17:07:53.002362] [DEBUG] [LOCAL ] AHR: Trimmed 70665 records to 49096 (keeping 200 days of data) [2025-10-13T17:07:53.234143] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-13T17:07:53.340003] [DEBUG] [LOCAL ] AHR: Primary data saved (49096 records). [2025-10-13T17:07:53.340195] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-13T17:07:53.341372] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHR took 49.5s. Estimated remaining: 4h 42m 17s. Rate: 8.2 symbols/min [2025-10-13T17:07:53.504274] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:07:53.558751] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:53.558971] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-13T17:07:53.559009] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-13T17:07:53.559151] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-13T17:07:53.559194] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-13T17:07:53.559236] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-13T17:07:53.559270] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-13T17:07:53.950012] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:54.030058] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-13T17:07:54.037726] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-13T17:07:54.817941] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-13T17:07:55.062428] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:07:55.212314] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:07:55.617996] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-13T17:07:56.417917] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-13T17:07:56.824183] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:07:57.217919] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-13T17:07:57.412470] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-13T17:07:58.017904] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-13T17:07:58.191558] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T17:07:58.229733] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T17:07:58.817917] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-13T17:07:59.250770] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:07:59.617953] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-13T17:08:00.417939] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-13T17:08:00.522723] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:08:00.637686] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:08:01.217966] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-13T17:08:01.823724] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:08:02.017961] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-13T17:08:02.711682] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T17:08:02.818006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-13T17:08:03.548156] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T17:08:03.617901] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-13T17:08:03.820211] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:08:04.417979] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-13T17:08:05.217975] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-13T17:08:05.674027] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:08:06.017939] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-13T17:08:06.111888] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-13T17:08:06.118497] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-13T17:08:06.118713] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-13T17:08:06.534963] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-13T17:08:06.535170] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-13T17:08:06.536049] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-13T17:08:06.536117] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-13T17:08:06.538219] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53759 (keeping 200 days of data) [2025-10-13T17:08:06.810960] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:08:06.824288] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-13T17:08:06.921549] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:08:06.951331] [DEBUG] [LOCAL ] AI: Primary data saved (53759 records). [2025-10-13T17:08:06.951536] [INFO ] [MAIN ] AI: Full history saved. [2025-10-13T17:08:06.951631] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AI took 37.5s. Estimated remaining: 4h 45m 52s. Rate: 8.1 symbols/min [2025-10-13T17:08:07.136990] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:07.166961] [DEBUG] [LOCAL ] AIR: Loaded 29366 existing records from primary storage. [2025-10-13T17:08:07.167303] [INFO ] [MAIN ] AIR: Loaded 29366 existing records. [2025-10-13T17:08:07.364424] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:07.364750] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-13T17:08:07.364808] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-13T17:08:07.365264] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-13T17:08:07.365324] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-13T17:08:07.626225] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-13T17:08:07.768060] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:07.853483] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:08:08.417954] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-13T17:08:08.459227] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:08:09.217942] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-13T17:08:09.510324] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:08:10.017930] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-13T17:08:10.049760] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:08:10.817946] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-13T17:08:11.589762] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T17:08:11.617890] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-13T17:08:11.769317] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:08:12.122150] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T17:08:12.417964] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-13T17:08:13.217975] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-13T17:08:13.232578] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:08:14.017969] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-13T17:08:14.361944] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:08:14.817942] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-13T17:08:14.898734] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:08:14.900946] [INFO ] [REMOTE ] AIO: Full fetch complete (20119 records). [2025-10-13T17:08:14.901020] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-13T17:08:15.299729] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-13T17:08:15.299844] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-13T17:08:15.300279] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-13T17:08:15.300323] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-13T17:08:15.301093] [DEBUG] [LOCAL ] AIO: Trimmed 20119 records to 13409 (keeping 200 days of data) [2025-10-13T17:08:15.385702] [DEBUG] [LOCAL ] AIO: Primary data saved (13409 records). [2025-10-13T17:08:15.385895] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-13T17:08:15.385987] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 22.0s. Estimated remaining: 4h 46m 19s. Rate: 8.1 symbols/min [2025-10-13T17:08:15.560289] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:15.593293] [DEBUG] [LOCAL ] AIT: Loaded 27469 existing records from primary storage. [2025-10-13T17:08:15.593685] [INFO ] [MAIN ] AIT: Loaded 27469 existing records. [2025-10-13T17:08:15.625297] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-13T17:08:15.781937] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:15.782166] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-13T17:08:15.782249] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-13T17:08:15.782562] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-13T17:08:15.782621] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-13T17:08:16.144093] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:16.445443] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-13T17:08:16.472494] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:08:16.512513] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T17:08:17.217951] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-13T17:08:17.713491] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:08:18.017977] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-13T17:08:18.465413] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T17:08:18.487691] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T17:08:18.493763] [INFO ] [REMOTE ] AIG: Full fetch complete (77385 records). [2025-10-13T17:08:18.493933] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-13T17:08:18.823085] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-13T17:08:18.914982] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-13T17:08:18.915185] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-13T17:08:18.916207] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-13T17:08:18.916682] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-13T17:08:18.919426] [DEBUG] [LOCAL ] AIG: Trimmed 77385 records to 53474 (keeping 200 days of data) [2025-10-13T17:08:19.275384] [DEBUG] [LOCAL ] AIG: Primary data saved (53474 records). [2025-10-13T17:08:19.275552] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-13T17:08:19.275717] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIG took 47.0s. Estimated remaining: 4h 44m 9s. Rate: 8.1 symbols/min [2025-10-13T17:08:19.455300] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:19.491901] [DEBUG] [LOCAL ] AIV: Loaded 41565 existing records from primary storage. [2025-10-13T17:08:19.492192] [INFO ] [MAIN ] AIV: Loaded 41565 existing records. [2025-10-13T17:08:19.623140] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-13T17:08:19.694963] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:19.695218] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-13T17:08:19.695268] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-13T17:08:19.695600] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-13T17:08:19.695700] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-13T17:08:20.085418] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:20.246168] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:08:20.417942] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-13T17:08:20.793822] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:08:21.217931] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-13T17:08:21.561787] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:08:22.017945] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-13T17:08:22.299783] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-13T17:08:22.302795] [INFO ] [REMOTE ] AIN: Full fetch complete (33500 records). [2025-10-13T17:08:22.302870] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-13T17:08:22.668308] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-13T17:08:22.668385] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-13T17:08:22.668811] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-13T17:08:22.668873] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-13T17:08:22.669748] [DEBUG] [LOCAL ] AIN: Trimmed 33500 records to 24485 (keeping 200 days of data) [2025-10-13T17:08:22.819316] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-13T17:08:22.826890] [DEBUG] [LOCAL ] AIN: Primary data saved (24485 records). [2025-10-13T17:08:22.827033] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-13T17:08:22.827119] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIN took 36.6s. Estimated remaining: 4h 41m 52s. Rate: 8.2 symbols/min [2025-10-13T17:08:23.004383] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:23.035437] [DEBUG] [LOCAL ] AIZ: Loaded 30023 existing records from primary storage. [2025-10-13T17:08:23.035725] [INFO ] [MAIN ] AIZ: Loaded 30023 existing records. [2025-10-13T17:08:23.220149] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:23.220624] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-13T17:08:23.220782] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-13T17:08:23.221373] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-13T17:08:23.221468] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-13T17:08:23.337054] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:08:23.609217] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:23.617888] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-13T17:08:23.783440] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:08:24.417930] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-13T17:08:25.013603] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:08:25.217956] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-13T17:08:25.357209] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T17:08:26.017955] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-13T17:08:26.728135] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:08:26.817928] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-13T17:08:27.368490] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T17:08:27.617949] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-13T17:08:28.085701] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:08:28.417936] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-13T17:08:28.989246] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:08:29.217940] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-13T17:08:29.760077] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T17:08:30.017971] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-13T17:08:30.580910] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:08:30.817972] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-13T17:08:31.397280] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:08:31.617982] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-13T17:08:32.255627] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T17:08:32.417890] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-13T17:08:33.013689] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:08:33.217899] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-13T17:08:33.662822] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:08:34.017926] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-13T17:08:34.661437] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:08:34.817919] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-13T17:08:34.936423] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T17:08:35.617933] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-13T17:08:36.373399] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:08:36.417953] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-13T17:08:36.818632] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:08:37.217987] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-13T17:08:37.860110] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:08:38.017966] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-13T17:08:38.731736] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:08:38.817909] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-13T17:08:39.310249] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:08:39.617911] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-13T17:08:40.083498] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T17:08:40.418028] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-13T17:08:40.788784] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:08:41.217942] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-13T17:08:41.785110] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:08:42.017908] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-13T17:08:42.288239] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:08:42.290923] [INFO ] [REMOTE ] AIT: Full fetch complete (39052 records). [2025-10-13T17:08:42.291013] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-13T17:08:42.706892] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-13T17:08:42.706970] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-13T17:08:42.707383] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-13T17:08:42.707442] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-13T17:08:42.708285] [DEBUG] [LOCAL ] AIT: Trimmed 39052 records to 27046 (keeping 200 days of data) [2025-10-13T17:08:42.822679] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-13T17:08:42.881973] [DEBUG] [LOCAL ] AIT: Primary data saved (27046 records). [2025-10-13T17:08:42.882132] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-13T17:08:42.882214] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 27.5s. Estimated remaining: 4h 48m 48s. Rate: 8.0 symbols/min [2025-10-13T17:08:43.058157] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:43.064407] [DEBUG] [LOCAL ] AIZN: Loaded 4172 existing records from primary storage. [2025-10-13T17:08:43.064583] [INFO ] [MAIN ] AIZN: Loaded 4172 existing records. [2025-10-13T17:08:43.250823] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:43.251268] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-13T17:08:43.251342] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-13T17:08:43.251631] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-13T17:08:43.251786] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-13T17:08:43.380943] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:08:43.633921] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-13T17:08:43.638995] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:43.859169] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:08:44.417916] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-13T17:08:44.642173] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T17:08:45.217932] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-13T17:08:45.700319] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:08:46.017963] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-13T17:08:46.817956] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-13T17:08:46.840967] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:08:46.845488] [INFO ] [REMOTE ] AIR: Full fetch complete (39934 records). [2025-10-13T17:08:46.845585] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-13T17:08:47.237352] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-13T17:08:47.237480] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-13T17:08:47.238010] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-13T17:08:47.238106] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-13T17:08:47.246434] [DEBUG] [LOCAL ] AIR: Trimmed 39934 records to 29044 (keeping 200 days of data) [2025-10-13T17:08:47.261761] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:08:47.442303] [DEBUG] [LOCAL ] AIR: Primary data saved (29044 records). [2025-10-13T17:08:47.442474] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-13T17:08:47.442564] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 40.5s. Estimated remaining: 4h 47m 3s. Rate: 8.0 symbols/min [2025-10-13T17:08:47.615378] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:47.617927] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-13T17:08:47.663148] [DEBUG] [LOCAL ] AJG: Loaded 47279 existing records from primary storage. [2025-10-13T17:08:47.663462] [INFO ] [MAIN ] AJG: Loaded 47279 existing records. [2025-10-13T17:08:47.841667] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:47.841877] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-13T17:08:47.841923] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-13T17:08:47.842356] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-13T17:08:47.842412] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-13T17:08:48.204778] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:48.223581] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:08:48.239008] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:08:48.417942] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-13T17:08:49.217947] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-13T17:08:50.026076] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-13T17:08:50.045463] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:08:50.476328] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T17:08:50.631516] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:08:50.817897] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-13T17:08:51.280385] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:08:51.617909] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-13T17:08:52.417959] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-13T17:08:53.036854] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T17:08:53.217942] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-13T17:08:53.305252] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:08:54.017920] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-13T17:08:54.421975] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:08:54.425227] [INFO ] [REMOTE ] AIZ: Full fetch complete (42765 records). [2025-10-13T17:08:54.425372] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-13T17:08:54.825272] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-13T17:08:54.828310] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-13T17:08:54.829231] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-13T17:08:54.829916] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-13T17:08:54.829987] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-13T17:08:54.831375] [DEBUG] [LOCAL ] AIZ: Trimmed 42765 records to 29610 (keeping 200 days of data) [2025-10-13T17:08:55.027906] [DEBUG] [LOCAL ] AIZ: Primary data saved (29610 records). [2025-10-13T17:08:55.028098] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-13T17:08:55.028198] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIZ took 32.2s. Estimated remaining: 4h 46m 59s. Rate: 8.0 symbols/min [2025-10-13T17:08:55.205866] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:55.206213] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-13T17:08:55.206264] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-13T17:08:55.206387] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-13T17:08:55.206431] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-13T17:08:55.206474] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-13T17:08:55.206508] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-13T17:08:55.489693] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T17:08:55.609523] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:55.617915] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-13T17:08:55.727118] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T17:08:56.417956] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-13T17:08:57.202805] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T17:08:57.217879] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-13T17:08:58.002826] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:08:58.017936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-13T17:08:58.439585] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T17:08:58.445025] [INFO ] [REMOTE ] AIV: Full fetch complete (60102 records). [2025-10-13T17:08:58.445173] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-13T17:08:58.825795] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-13T17:08:58.848334] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-13T17:08:58.848456] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-13T17:08:58.849325] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-13T17:08:58.849437] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-13T17:08:58.851514] [DEBUG] [LOCAL ] AIV: Trimmed 60102 records to 41190 (keeping 200 days of data) [2025-10-13T17:08:59.095231] [DEBUG] [LOCAL ] AIV: Primary data saved (41190 records). [2025-10-13T17:08:59.095411] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-13T17:08:59.095512] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIV took 39.8s. Estimated remaining: 4h 45m 2s. Rate: 8.1 symbols/min [2025-10-13T17:08:59.280074] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:59.328173] [DEBUG] [LOCAL ] AKR: Loaded 46485 existing records from primary storage. [2025-10-13T17:08:59.328699] [INFO ] [MAIN ] AKR: Loaded 46485 existing records. [2025-10-13T17:08:59.400269] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:08:59.529871] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:59.530168] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-13T17:08:59.530221] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-13T17:08:59.530895] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-13T17:08:59.530956] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-13T17:08:59.623027] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-13T17:08:59.907681] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:59.942120] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:09:00.134846] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:09:00.417985] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-13T17:09:01.218003] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-13T17:09:01.662587] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T17:09:02.018305] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-13T17:09:02.029288] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:09:02.642052] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:09:02.817988] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-13T17:09:03.617933] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-13T17:09:04.381306] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T17:09:04.420073] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-13T17:09:04.426584] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:09:05.217972] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-13T17:09:05.658507] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T17:09:06.017951] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-13T17:09:06.144147] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:09:06.684144] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:09:06.817936] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-13T17:09:07.617958] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-13T17:09:08.125112] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T17:09:08.164908] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T17:09:08.417973] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-13T17:09:09.217962] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-13T17:09:09.725342] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:09:10.017929] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-13T17:09:10.817907] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-13T17:09:10.936033] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T17:09:11.303156] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:09:11.346816] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T17:09:11.617936] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-13T17:09:12.239494] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T17:09:12.417913] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-13T17:09:12.855024] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T17:09:13.217957] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-13T17:09:14.017936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-13T17:09:14.767167] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:09:14.817889] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-13T17:09:15.617952] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-13T17:09:15.698515] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:09:16.186347] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:09:16.417913] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-13T17:09:16.571506] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:09:17.217956] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-13T17:09:18.017905] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-13T17:09:18.066096] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:09:18.358589] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T17:09:18.727674] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:09:18.817969] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-13T17:09:19.617959] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-13T17:09:20.400008] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:09:20.417987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-13T17:09:20.726223] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-13T17:09:21.217902] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-13T17:09:21.336983] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:09:22.017949] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-13T17:09:22.306357] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-13T17:09:22.817933] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-13T17:09:22.854705] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:09:23.408209] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T17:09:23.410287] [INFO ] [REMOTE ] AIZN: Full fetch complete (5927 records). [2025-10-13T17:09:23.410508] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-13T17:09:23.626471] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-13T17:09:23.793043] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-13T17:09:23.793127] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-13T17:09:23.793344] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-13T17:09:23.793438] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-13T17:09:23.793858] [DEBUG] [LOCAL ] AIZN: Trimmed 5927 records to 4085 (keeping 200 days of data) [2025-10-13T17:09:23.817944] [DEBUG] [LOCAL ] AIZN: Primary data saved (4085 records). [2025-10-13T17:09:23.818028] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-13T17:09:23.818106] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 40.9s. Estimated remaining: 4h 53m 59s. Rate: 7.8 symbols/min [2025-10-13T17:09:23.980788] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:24.020890] [DEBUG] [LOCAL ] AL: Loaded 45184 existing records from primary storage. [2025-10-13T17:09:24.021197] [INFO ] [MAIN ] AL: Loaded 45184 existing records. [2025-10-13T17:09:24.191790] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:24.192070] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-13T17:09:24.192116] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-13T17:09:24.192534] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-13T17:09:24.192590] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-13T17:09:24.427593] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-13T17:09:24.547466] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:25.028953] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T17:09:25.030140] [INFO ] [REMOTE ] AKA: Full fetch complete (2423 records). [2025-10-13T17:09:25.030222] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-13T17:09:25.220988] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-13T17:09:25.228346] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T17:09:25.229738] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:09:25.229834] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:09:25.229891] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-13T17:09:25.229948] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-13T17:09:25.230035] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-13T17:09:25.230089] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-13T17:09:25.230170] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 30.2s. Estimated remaining: 4h 50m 37s. Rate: 7.9 symbols/min [2025-10-13T17:09:25.415796] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:25.447345] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T17:09:25.522890] [DEBUG] [LOCAL ] ALB: Loaded 54068 existing records from primary storage. [2025-10-13T17:09:25.523363] [INFO ] [MAIN ] ALB: Loaded 54068 existing records. [2025-10-13T17:09:25.720041] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:25.720309] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-13T17:09:25.720359] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-13T17:09:25.721429] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-13T17:09:25.721492] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-13T17:09:26.023210] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-13T17:09:26.094925] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:26.817929] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-13T17:09:27.099967] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:09:27.617899] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-13T17:09:27.664937] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:09:27.672863] [INFO ] [REMOTE ] AJG: Full fetch complete (68971 records). [2025-10-13T17:09:27.672977] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-13T17:09:28.055210] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-13T17:09:28.055349] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-13T17:09:28.056058] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-13T17:09:28.056120] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-13T17:09:28.057437] [DEBUG] [LOCAL ] AJG: Trimmed 68971 records to 46567 (keeping 200 days of data) [2025-10-13T17:09:28.324146] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:09:28.337083] [INFO ] [REMOTE ] AKR: Full fetch complete (65234 records). [2025-10-13T17:09:28.338532] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-13T17:09:28.419035] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-13T17:09:28.832448] [DEBUG] [LOCAL ] AJG: Primary data saved (46567 records). [2025-10-13T17:09:28.833567] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-13T17:09:28.835244] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 41.4s. Estimated remaining: 4h 48m 27s. Rate: 8.0 symbols/min [2025-10-13T17:09:29.096969] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-13T17:09:29.139782] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-13T17:09:29.141923] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-13T17:09:29.158199] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-13T17:09:29.227562] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:29.229133] [DEBUG] [LOCAL ] AKR: Trimmed 65234 records to 46010 (keeping 200 days of data) [2025-10-13T17:09:29.263748] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:09:29.374555] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-13T17:09:29.496933] [DEBUG] [LOCAL ] ALC: Loaded 51798 existing records from primary storage. [2025-10-13T17:09:29.498542] [INFO ] [MAIN ] ALC: Loaded 51798 existing records. [2025-10-13T17:09:29.842477] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:29.856775] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-13T17:09:29.859208] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-13T17:09:29.863308] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-13T17:09:29.863393] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-13T17:09:30.041405] [DEBUG] [LOCAL ] AKR: Primary data saved (46010 records). [2025-10-13T17:09:30.052059] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-13T17:09:30.072160] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKR took 31.0s. Estimated remaining: 4h 45m 10s. Rate: 8.0 symbols/min [2025-10-13T17:09:30.479776] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:30.482772] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-13T17:09:30.505834] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:30.570849] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T17:09:30.585528] [DEBUG] [LOCAL ] ALE: Loaded 31823 existing records from primary storage. [2025-10-13T17:09:30.586069] [INFO ] [MAIN ] ALE: Loaded 31823 existing records. [2025-10-13T17:09:30.775939] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:09:30.795341] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:30.803360] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-13T17:09:30.803433] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-13T17:09:30.804052] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-13T17:09:30.804111] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-13T17:09:30.824412] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-13T17:09:31.160692] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:31.617982] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-13T17:09:32.164175] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:09:32.417983] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-13T17:09:32.722530] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:09:32.944537] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-13T17:09:33.217984] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-13T17:09:33.614393] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:09:34.017990] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-13T17:09:34.519128] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:09:34.817964] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-13T17:09:35.618001] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-13T17:09:35.835309] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T17:09:35.866847] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:09:36.418023] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-13T17:09:37.149928] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:09:37.217907] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-13T17:09:38.017912] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-13T17:09:38.357151] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:09:38.675743] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:09:38.817936] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-13T17:09:39.453290] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T17:09:39.617934] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-13T17:09:40.027132] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T17:09:40.417941] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-13T17:09:40.768917] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:09:41.217932] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-13T17:09:42.017911] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-13T17:09:42.107713] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:09:42.518229] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T17:09:42.817936] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-13T17:09:43.625246] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-13T17:09:43.645296] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T17:09:44.415526] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:09:44.423956] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-13T17:09:45.217936] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-13T17:09:45.632006] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T17:09:45.805551] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T17:09:46.017907] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-13T17:09:46.249075] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:09:46.817978] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-13T17:09:47.628164] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-13T17:09:47.634613] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:09:48.185458] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:09:48.417902] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-13T17:09:49.217945] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-13T17:09:49.283852] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:09:49.579516] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:09:50.017974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-13T17:09:50.714060] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:09:50.817940] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-13T17:09:51.005125] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:09:51.617932] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-13T17:09:52.415145] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:09:52.424965] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-13T17:09:52.636872] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:09:53.217937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-13T17:09:53.972171] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:09:54.017883] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-13T17:09:54.597135] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T17:09:54.817927] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-13T17:09:55.617973] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-13T17:09:56.269530] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-13T17:09:56.417883] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-13T17:09:56.696752] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T17:09:57.102764] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:09:57.108284] [INFO ] [REMOTE ] AL: Full fetch complete (63003 records). [2025-10-13T17:09:57.108470] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-13T17:09:57.223090] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-13T17:09:57.541551] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-13T17:09:57.541709] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-13T17:09:57.542667] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-13T17:09:57.542747] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-13T17:09:57.544951] [DEBUG] [LOCAL ] AL: Trimmed 63003 records to 44615 (keeping 200 days of data) [2025-10-13T17:09:57.863604] [DEBUG] [LOCAL ] AL: Primary data saved (44615 records). [2025-10-13T17:09:57.863838] [INFO ] [MAIN ] AL: Full history saved. [2025-10-13T17:09:57.864755] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 34.0s. Estimated remaining: 4h 55m 8s. Rate: 7.8 symbols/min [2025-10-13T17:09:58.017973] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-13T17:09:58.392764] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T17:09:58.764746] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:09:58.817886] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-13T17:09:59.617905] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-13T17:09:59.844030] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T17:09:59.978925] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:09:59.982907] [INFO ] [REMOTE ] ALE: Full fetch complete (43529 records). [2025-10-13T17:09:59.982985] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-13T17:10:00.359835] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-13T17:10:00.359911] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-13T17:10:00.360374] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-13T17:10:00.360436] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-13T17:10:00.361346] [DEBUG] [LOCAL ] ALE: Trimmed 43529 records to 31630 (keeping 200 days of data) [2025-10-13T17:10:00.425473] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-13T17:10:00.553216] [DEBUG] [LOCAL ] ALE: Primary data saved (31630 records). [2025-10-13T17:10:00.553381] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-13T17:10:00.553465] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALE took 30.5s. Estimated remaining: 4h 52m 32s. Rate: 7.8 symbols/min [2025-10-13T17:10:01.538572] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:10:01.549683] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-13T17:10:02.192090] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T17:10:02.199581] [INFO ] [REMOTE ] ALC: Full fetch complete (72882 records). [2025-10-13T17:10:02.199875] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-13T17:10:02.201079] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:02.201221] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:02.201281] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:02.201369] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-13T17:10:02.201458] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-13T17:10:02.201509] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-13T17:10:02.201756] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-13T17:10:02.202914] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 33.4s. Estimated remaining: 4h 49m 30s. Rate: 7.9 symbols/min [2025-10-13T17:10:04.010831] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-13T17:10:04.016573] [INFO ] [REMOTE ] ALB: Full fetch complete (76512 records). [2025-10-13T17:10:04.016870] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-13T17:10:04.017949] [FATAL] [VALIDATOR ] ALB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:04.018097] [FATAL] [MAIN ] ALB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:04.018153] [WARN ] [MAIN ] ALB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:04.018223] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-13T17:10:04.018293] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-13T17:10:04.018328] [INFO ] [LOCAL ] ALB: Starting deletion of derivative data. [2025-10-13T17:10:04.018479] [DEBUG] [LOCAL ] ALB: Deleted derivative data file. [2025-10-13T17:10:04.018588] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALB took 38.8s. Estimated remaining: 4h 46m 38s. Rate: 8.0 symbols/min [2025-10-13T17:10:04.605784] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.765353] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.810475] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.832818] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.835447] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-13T17:10:04.836407] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-13T17:10:04.836620] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-13T17:10:04.836715] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-13T17:10:04.836794] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-13T17:10:04.838204] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-13T17:10:04.960674] [DEBUG] [LOCAL ] ALG: Loaded 9947 existing records from primary storage. [2025-10-13T17:10:04.971573] [INFO ] [MAIN ] ALG: Loaded 9947 existing records. [2025-10-13T17:10:05.090140] [DEBUG] [LOCAL ] ALEX: Loaded 31679 existing records from primary storage. [2025-10-13T17:10:05.126178] [INFO ] [MAIN ] ALEX: Loaded 31679 existing records. [2025-10-13T17:10:05.453088] [DEBUG] [LOCAL ] ALIT: Loaded 53554 existing records from primary storage. [2025-10-13T17:10:05.537596] [INFO ] [MAIN ] ALIT: Loaded 53554 existing records. [2025-10-13T17:10:05.558895] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.660169] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-13T17:10:05.727418] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-13T17:10:05.802860] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-13T17:10:05.789196] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.809087] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:05.809419] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-13T17:10:05.809330] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-13T17:10:05.820600] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-13T17:10:05.826150] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-13T17:10:05.954934] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.934476] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-13T17:10:05.968476] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-13T17:10:06.033532] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-13T17:10:06.074776] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-13T17:10:06.096207] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-13T17:10:06.096323] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-13T17:10:06.137975] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:10:06.182533] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-13T17:10:06.236377] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:10:06.272042] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-13T17:10:06.327396] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:10:06.438547] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-13T17:10:06.483750] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-13T17:10:06.581813] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-13T17:10:06.662482] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-13T17:10:06.701792] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALH took 2.7s. Estimated remaining: 4h 44m 14s. Rate: 8.1 symbols/min [2025-10-13T17:10:06.945219] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:06.934912] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:06.968803] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-13T17:10:06.974162] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-13T17:10:07.182205] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:07.180510] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:07.183244] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-13T17:10:07.237005] [DEBUG] [LOCAL ] ALK: Loaded 53837 existing records from primary storage. [2025-10-13T17:10:07.237316] [INFO ] [MAIN ] ALK: Loaded 53837 existing records. [2025-10-13T17:10:07.418150] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:07.418375] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-13T17:10:07.418422] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-13T17:10:07.418876] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-13T17:10:07.418933] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-13T17:10:07.802270] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:07.802617] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-13T17:10:08.155205] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T17:10:08.158130] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-13T17:10:08.542863] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:10:08.550802] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-13T17:10:08.753672] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:10:08.764720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-13T17:10:08.871993] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T17:10:08.875378] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-13T17:10:09.245965] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:10:09.256790] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-13T17:10:09.410158] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T17:10:09.738189] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T17:10:10.017907] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-13T17:10:10.340135] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:10:10.796202] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:10:10.821271] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-13T17:10:10.825132] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:10:11.617938] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-13T17:10:12.417944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-13T17:10:12.535260] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:10:12.609076] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:10:13.217928] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-13T17:10:13.689623] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:10:14.017941] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-13T17:10:14.699517] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:10:14.795193] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:10:14.817880] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-13T17:10:15.530256] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:10:15.617916] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-13T17:10:16.417975] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-13T17:10:17.136064] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:10:17.217936] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-13T17:10:17.997459] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:10:18.017885] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-13T17:10:18.226262] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:10:18.817894] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-13T17:10:19.617910] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-13T17:10:19.655573] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:10:19.808346] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:10:20.417923] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-13T17:10:20.565993] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:10:21.217928] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-13T17:10:21.659592] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:10:21.827351] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T17:10:22.017921] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-13T17:10:22.817944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-13T17:10:23.617916] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-13T17:10:23.705021] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T17:10:24.112021] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T17:10:24.417969] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-13T17:10:25.217898] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-13T17:10:25.278293] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:10:26.017911] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-13T17:10:26.224887] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T17:10:26.514263] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:10:26.644437] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:10:26.817917] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-13T17:10:27.617942] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-13T17:10:28.347947] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:10:28.388234] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T17:10:28.417886] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-13T17:10:29.217989] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-13T17:10:30.017941] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-13T17:10:30.253424] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T17:10:30.258760] [INFO ] [REMOTE ] ALK: Full fetch complete (76835 records). [2025-10-13T17:10:30.258880] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-13T17:10:30.650104] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T17:10:30.673660] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-13T17:10:30.673795] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-13T17:10:30.681873] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-13T17:10:30.681997] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-13T17:10:30.684588] [DEBUG] [LOCAL ] ALK: Trimmed 76835 records to 53061 (keeping 200 days of data) [2025-10-13T17:10:30.849801] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-13T17:10:30.891989] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:10:30.897080] [INFO ] [REMOTE ] ALG: Full fetch complete (15423 records). [2025-10-13T17:10:30.904732] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-13T17:10:31.350464] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-13T17:10:31.368512] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-13T17:10:31.370165] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-13T17:10:31.370516] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-13T17:10:31.374397] [DEBUG] [LOCAL ] ALG: Trimmed 15423 records to 9742 (keeping 200 days of data) [2025-10-13T17:10:31.451375] [DEBUG] [LOCAL ] ALK: Primary data saved (53061 records). [2025-10-13T17:10:31.452945] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-13T17:10:31.453066] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALK took 24.7s. Estimated remaining: 4h 52m 10s. Rate: 7.8 symbols/min [2025-10-13T17:10:31.581631] [DEBUG] [LOCAL ] ALG: Primary data saved (9742 records). [2025-10-13T17:10:31.599469] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-13T17:10:31.605757] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALG took 27.6s. Estimated remaining: 4h 48m 35s. Rate: 7.9 symbols/min [2025-10-13T17:10:31.633327] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-13T17:10:31.638455] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:31.812294] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:31.853600] [DEBUG] [LOCAL ] ALL: Loaded 50524 existing records from primary storage. [2025-10-13T17:10:31.853978] [INFO ] [MAIN ] ALL: Loaded 50524 existing records. [2025-10-13T17:10:32.045874] [DEBUG] [LOCAL ] ALLE: Loaded 44999 existing records from primary storage. [2025-10-13T17:10:32.062770] [INFO ] [MAIN ] ALLE: Loaded 44999 existing records. [2025-10-13T17:10:32.066483] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:32.121700] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-13T17:10:32.130802] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-13T17:10:32.142201] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-13T17:10:32.142295] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-13T17:10:32.387321] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:32.398195] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-13T17:10:32.413199] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-13T17:10:32.452953] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-13T17:10:32.480551] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T17:10:32.480812] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-13T17:10:32.570571] [INFO ] [REMOTE ] ALEX: Full fetch complete (44367 records). [2025-10-13T17:10:32.597321] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-13T17:10:32.679046] [FATAL] [VALIDATOR ] ALEX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:32.690898] [FATAL] [MAIN ] ALEX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:32.701305] [WARN ] [MAIN ] ALEX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:32.744356] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-13T17:10:32.777864] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-10-13T17:10:32.822595] [INFO ] [LOCAL ] ALEX: Starting deletion of derivative data. [2025-10-13T17:10:32.822499] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:32.852855] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-13T17:10:32.909484] [DEBUG] [LOCAL ] ALEX: Deleted derivative data file. [2025-10-13T17:10:32.947405] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALEX took 28.9s. Estimated remaining: 4h 45m 38s. Rate: 8.0 symbols/min [2025-10-13T17:10:33.153396] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:33.230444] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-13T17:10:33.234035] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:33.304315] [DEBUG] [LOCAL ] ALLY: Loaded 54004 existing records from primary storage. [2025-10-13T17:10:33.304824] [INFO ] [MAIN ] ALLY: Loaded 54004 existing records. [2025-10-13T17:10:33.553565] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:33.575556] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-13T17:10:33.575729] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-13T17:10:33.579081] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:10:33.579199] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-13T17:10:33.590984] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-13T17:10:33.969878] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:34.017932] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-13T17:10:34.663502] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:10:34.817901] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-13T17:10:34.855435] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:10:35.617902] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-13T17:10:35.713513] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T17:10:36.417975] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-13T17:10:36.587252] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:10:37.217923] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-13T17:10:37.494466] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:10:37.647346] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:10:38.017928] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-13T17:10:38.611875] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:10:38.817934] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-13T17:10:39.617948] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-13T17:10:39.774375] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T17:10:40.399060] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:10:40.417892] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-13T17:10:41.162486] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:10:41.218017] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-13T17:10:42.023006] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-13T17:10:42.035135] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:10:42.693605] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T17:10:42.817933] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-13T17:10:43.291264] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:10:43.617981] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-13T17:10:44.417950] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-13T17:10:44.532362] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:10:45.162708] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:10:45.217932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-13T17:10:46.017906] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-13T17:10:46.276953] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T17:10:46.703744] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:10:46.817954] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-13T17:10:47.617923] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-13T17:10:47.755935] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:10:48.417910] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-13T17:10:48.570800] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:10:49.217955] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-13T17:10:49.451555] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T17:10:49.932226] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:10:50.017932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-13T17:10:50.817926] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-13T17:10:50.894724] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:10:51.617973] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-13T17:10:51.758235] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:10:52.068183] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:10:52.417900] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-13T17:10:53.217938] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-13T17:10:53.310374] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:10:53.734733] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:10:54.017951] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-13T17:10:54.817933] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-13T17:10:54.878491] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:10:55.617942] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-13T17:10:55.792854] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T17:10:55.798463] [INFO ] [REMOTE ] ALIT: Full fetch complete (76446 records). [2025-10-13T17:10:55.798623] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-13T17:10:56.200526] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-13T17:10:56.200631] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-13T17:10:56.201398] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-13T17:10:56.201468] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-13T17:10:56.203136] [DEBUG] [LOCAL ] ALIT: Trimmed 76446 records to 52786 (keeping 200 days of data) [2025-10-13T17:10:56.314411] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:10:56.436601] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-13T17:10:56.542276] [DEBUG] [LOCAL ] ALIT: Primary data saved (52786 records). [2025-10-13T17:10:56.542572] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-13T17:10:56.542693] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALIT took 52.5s. Estimated remaining: 4h 52m 43s. Rate: 7.8 symbols/min [2025-10-13T17:10:56.708150] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:56.746116] [DEBUG] [LOCAL ] ALSN: Loaded 44031 existing records from primary storage. [2025-10-13T17:10:56.746439] [INFO ] [MAIN ] ALSN: Loaded 44031 existing records. [2025-10-13T17:10:56.930828] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:56.931163] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-13T17:10:56.931213] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-13T17:10:56.932287] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-13T17:10:56.932349] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-13T17:10:57.223103] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-13T17:10:57.292912] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:57.349662] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:10:58.017962] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-13T17:10:58.200077] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:10:58.592914] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:10:58.817978] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-13T17:10:59.617940] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-13T17:10:59.728186] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T17:11:00.417916] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-13T17:11:00.447404] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:11:01.217927] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-13T17:11:01.498024] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:11:01.734081] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:11:02.017936] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-13T17:11:02.817928] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-13T17:11:02.912200] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:11:03.444118] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T17:11:03.617923] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-13T17:11:04.125523] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:11:04.417920] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-13T17:11:05.060682] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:11:05.066262] [INFO ] [REMOTE ] ALLY: Full fetch complete (76954 records). [2025-10-13T17:11:05.066363] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-13T17:11:05.242263] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-13T17:11:05.465678] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-13T17:11:05.465779] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-13T17:11:05.466507] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-13T17:11:05.466549] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-13T17:11:05.468160] [DEBUG] [LOCAL ] ALLY: Trimmed 76954 records to 53223 (keeping 200 days of data) [2025-10-13T17:11:05.785035] [DEBUG] [LOCAL ] ALLY: Primary data saved (53223 records). [2025-10-13T17:11:05.785195] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-13T17:11:05.785291] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLY took 32.8s. Estimated remaining: 4h 53m 17s. Rate: 7.8 symbols/min [2025-10-13T17:11:05.965744] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:05.988131] [DEBUG] [LOCAL ] ALTG: Loaded 23947 existing records from primary storage. [2025-10-13T17:11:05.988405] [INFO ] [MAIN ] ALTG: Loaded 23947 existing records. [2025-10-13T17:11:06.020435] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-13T17:11:06.192252] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:06.201571] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-13T17:11:06.201892] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-13T17:11:06.203262] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T17:11:06.203327] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-13T17:11:06.203520] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-13T17:11:06.591440] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:06.618549] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T17:11:06.623049] [INFO ] [REMOTE ] ALLE: Full fetch complete (64582 records). [2025-10-13T17:11:06.623225] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-13T17:11:06.829121] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-13T17:11:07.041393] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-13T17:11:07.041477] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-13T17:11:07.042148] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-13T17:11:07.042228] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-13T17:11:07.043607] [DEBUG] [LOCAL ] ALLE: Trimmed 64582 records to 44301 (keeping 200 days of data) [2025-10-13T17:11:07.321054] [DEBUG] [LOCAL ] ALLE: Primary data saved (44301 records). [2025-10-13T17:11:07.321209] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-13T17:11:07.321309] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLE took 35.7s. Estimated remaining: 4h 50m 28s. Rate: 7.9 symbols/min [2025-10-13T17:11:07.488294] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:07.499674] [DEBUG] [LOCAL ] ALUR: Loaded 10535 existing records from primary storage. [2025-10-13T17:11:07.499897] [INFO ] [MAIN ] ALUR: Loaded 10535 existing records. [2025-10-13T17:11:07.623083] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-13T17:11:07.680175] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:07.680778] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-13T17:11:07.680857] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-13T17:11:07.681046] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-13T17:11:07.681093] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-13T17:11:08.010547] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T17:11:08.076948] [INFO ] [REMOTE ] ALL: Full fetch complete (72246 records). [2025-10-13T17:11:08.082266] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:08.082498] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-13T17:11:08.172385] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:11:08.432593] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-13T17:11:08.489002] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-13T17:11:08.489079] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-13T17:11:08.489783] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-13T17:11:08.489846] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-13T17:11:08.491253] [DEBUG] [LOCAL ] ALL: Trimmed 72246 records to 49796 (keeping 200 days of data) [2025-10-13T17:11:08.794350] [DEBUG] [LOCAL ] ALL: Primary data saved (49796 records). [2025-10-13T17:11:08.794483] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-13T17:11:08.795752] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALL took 37.3s. Estimated remaining: 4h 47m 40s. Rate: 7.9 symbols/min [2025-10-13T17:11:08.986064] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:09.030409] [DEBUG] [LOCAL ] ALV: Loaded 42734 existing records from primary storage. [2025-10-13T17:11:09.030745] [INFO ] [MAIN ] ALV: Loaded 42734 existing records. [2025-10-13T17:11:09.216261] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:09.216534] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-13T17:11:09.216875] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-13T17:11:09.217336] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-13T17:11:09.217436] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-13T17:11:09.240477] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-13T17:11:09.518935] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T17:11:09.566288] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:11:09.645554] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:10.017949] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-13T17:11:10.730105] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:11:10.817893] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-13T17:11:11.037682] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:11:11.617928] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-13T17:11:12.048427] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:11:12.417939] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-13T17:11:12.960317] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:11:13.217917] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-13T17:11:13.925891] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:11:14.017914] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-13T17:11:14.610074] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:11:14.817927] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-13T17:11:15.186774] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T17:11:15.617927] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-13T17:11:16.417934] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-13T17:11:16.456210] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:11:16.640486] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:11:17.217933] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-13T17:11:17.551859] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T17:11:18.017938] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-13T17:11:18.674639] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:11:18.817947] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-13T17:11:19.221418] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T17:11:19.617907] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-13T17:11:20.121004] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:11:20.160186] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T17:11:20.417914] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-13T17:11:21.217918] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-13T17:11:21.634488] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:11:22.017911] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-13T17:11:22.400365] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:11:22.817928] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-13T17:11:23.309398] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:11:23.617909] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-13T17:11:23.645063] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:11:24.209371] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T17:11:24.417967] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-13T17:11:25.217896] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-13T17:11:25.379496] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:11:26.017931] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-13T17:11:26.687158] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T17:11:26.804032] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:11:26.817890] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-13T17:11:27.617935] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-13T17:11:28.111378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:11:28.116217] [INFO ] [REMOTE ] ALSN: Full fetch complete (62250 records). [2025-10-13T17:11:28.116318] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-13T17:11:28.423006] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-13T17:11:28.503239] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-13T17:11:28.503445] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-13T17:11:28.504093] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-13T17:11:28.504154] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-13T17:11:28.505360] [DEBUG] [LOCAL ] ALSN: Trimmed 62250 records to 43420 (keeping 200 days of data) [2025-10-13T17:11:28.731636] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:11:28.787811] [DEBUG] [LOCAL ] ALSN: Primary data saved (43420 records). [2025-10-13T17:11:28.787948] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-13T17:11:28.788028] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALSN took 32.2s. Estimated remaining: 4h 52m 52s. Rate: 7.8 symbols/min [2025-10-13T17:11:28.963316] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:28.971553] [DEBUG] [LOCAL ] ALX: Loaded 6768 existing records from primary storage. [2025-10-13T17:11:28.971799] [INFO ] [MAIN ] ALX: Loaded 6768 existing records. [2025-10-13T17:11:29.145213] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:29.145441] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-13T17:11:29.145485] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-13T17:11:29.145714] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-13T17:11:29.145770] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-13T17:11:29.223068] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-13T17:11:29.490686] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:29.907799] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:11:30.017906] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-13T17:11:30.213119] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:11:30.644685] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T17:11:30.817980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-13T17:11:31.617964] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-13T17:11:31.637877] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T17:11:31.639401] [INFO ] [REMOTE ] ALUR: Full fetch complete (19732 records). [2025-10-13T17:11:31.639507] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-13T17:11:32.122737] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-13T17:11:32.122918] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-13T17:11:32.123510] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-13T17:11:32.123585] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-13T17:11:32.124736] [DEBUG] [LOCAL ] ALUR: Trimmed 19732 records to 9743 (keeping 200 days of data) [2025-10-13T17:11:32.171519] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:11:32.206389] [DEBUG] [LOCAL ] ALUR: Primary data saved (9743 records). [2025-10-13T17:11:32.206595] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-13T17:11:32.206878] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 24.9s. Estimated remaining: 4h 50m 55s. Rate: 7.8 symbols/min [2025-10-13T17:11:32.421565] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-13T17:11:32.421473] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:32.488001] [DEBUG] [LOCAL ] AM: Loaded 52754 existing records from primary storage. [2025-10-13T17:11:32.488497] [INFO ] [MAIN ] AM: Loaded 52754 existing records. [2025-10-13T17:11:32.739558] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:32.739901] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-13T17:11:32.740044] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-13T17:11:32.741155] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-13T17:11:32.741247] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-13T17:11:32.927096] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T17:11:33.227799] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-13T17:11:33.235753] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:34.017931] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-13T17:11:34.389626] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T17:11:34.511179] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T17:11:34.817954] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-13T17:11:35.617937] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-13T17:11:36.349151] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:11:36.374689] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T17:11:36.417911] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-13T17:11:37.217926] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-13T17:11:37.939795] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:11:38.017929] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-13T17:11:38.330084] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:11:38.469520] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T17:11:38.817937] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-13T17:11:39.617958] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-13T17:11:40.417918] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-13T17:11:40.480951] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:11:41.217995] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-13T17:11:41.413183] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:11:41.526472] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:11:41.529447] [INFO ] [REMOTE ] ALTG: Full fetch complete (33531 records). [2025-10-13T17:11:41.529581] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-13T17:11:41.911300] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-13T17:11:41.911384] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-13T17:11:41.911828] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-13T17:11:41.911891] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-13T17:11:41.912748] [DEBUG] [LOCAL ] ALTG: Trimmed 33531 records to 23514 (keeping 200 days of data) [2025-10-13T17:11:42.018094] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-13T17:11:42.043328] [DEBUG] [LOCAL ] ALTG: Primary data saved (23514 records). [2025-10-13T17:11:42.043466] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-13T17:11:42.043560] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALTG took 36.3s. Estimated remaining: 4h 51m 42s. Rate: 7.8 symbols/min [2025-10-13T17:11:42.248768] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:42.289733] [DEBUG] [LOCAL ] AMBC: Loaded 36913 existing records from primary storage. [2025-10-13T17:11:42.290130] [INFO ] [MAIN ] AMBC: Loaded 36913 existing records. [2025-10-13T17:11:42.474504] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:42.474818] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-13T17:11:42.474875] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-13T17:11:42.475257] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-13T17:11:42.475318] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-13T17:11:42.685772] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:11:42.822921] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-13T17:11:42.893830] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:42.927810] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:11:43.617909] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-13T17:11:43.788554] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T17:11:44.417942] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-13T17:11:44.777417] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:11:45.217973] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-13T17:11:46.017911] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-13T17:11:46.161824] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:11:46.292805] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:11:46.474071] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:11:46.817944] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-13T17:11:47.617969] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-13T17:11:48.172486] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T17:11:48.206785] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:11:48.417979] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-13T17:11:49.217976] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-13T17:11:49.935310] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:11:50.017891] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-13T17:11:50.709227] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:11:50.817958] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-13T17:11:51.623343] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-13T17:11:51.634268] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:11:52.424373] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-13T17:11:52.426877] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:11:52.819891] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:11:53.217926] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-13T17:11:53.856269] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T17:11:54.017979] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-13T17:11:54.663321] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:11:54.817905] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-13T17:11:54.926891] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T17:11:55.617977] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-13T17:11:56.066011] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:11:56.070381] [INFO ] [REMOTE ] ALV: Full fetch complete (61754 records). [2025-10-13T17:11:56.070495] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-13T17:11:56.421465] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-13T17:11:56.459408] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:11:56.465355] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-13T17:11:56.465535] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-13T17:11:56.465694] [INFO ] [REMOTE ] ALX: Full fetch complete (7649 records). [2025-10-13T17:11:56.466635] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-13T17:11:56.466806] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-13T17:11:56.466919] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-13T17:11:56.559809] [DEBUG] [LOCAL ] ALV: Trimmed 61754 records to 42115 (keeping 200 days of data) [2025-10-13T17:11:57.033971] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-13T17:11:57.060180] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-13T17:11:57.060990] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-13T17:11:57.061111] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-13T17:11:57.077418] [DEBUG] [LOCAL ] ALX: Trimmed 7649 records to 6822 (keeping 200 days of data) [2025-10-13T17:11:57.142727] [DEBUG] [LOCAL ] ALX: Primary data saved (6822 records). [2025-10-13T17:11:57.145958] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-13T17:11:57.152325] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 28.4s. Estimated remaining: 4h 54m 39s. Rate: 7.7 symbols/min [2025-10-13T17:11:57.223046] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-13T17:11:57.229506] [DEBUG] [LOCAL ] ALV: Primary data saved (42115 records). [2025-10-13T17:11:57.229749] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-13T17:11:57.239078] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. ALV took 48.4s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-13T17:11:57.470668] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:57.522114] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:57.522346] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-13T17:11:57.522494] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-13T17:11:57.522635] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-13T17:11:57.522718] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-13T17:11:57.522768] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-13T17:11:57.522802] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-13T17:11:57.843682] [DEBUG] [LOCAL ] AMBP: Loaded 45241 existing records from primary storage. [2025-10-13T17:11:57.844470] [INFO ] [MAIN ] AMBP: Loaded 45241 existing records. [2025-10-13T17:11:57.998482] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:58.021417] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-13T17:11:58.115160] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:58.115510] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-13T17:11:58.115702] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-13T17:11:58.126572] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-13T17:11:58.140719] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-13T17:11:58.166925] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:11:58.260985] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:11:58.264381] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-13T17:11:58.264553] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:11:58.264620] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-13T17:11:58.265071] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:11:58.275783] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-13T17:11:58.306235] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-13T17:11:58.311721] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-13T17:11:58.317721] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-13T17:11:58.344535] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 1.1s. Estimated remaining: 4h 48m 36s. Rate: 7.9 symbols/min [2025-10-13T17:11:58.701983] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:58.746428] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:58.770058] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:11:58.817957] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-13T17:11:58.835738] [DEBUG] [LOCAL ] AMC: Loaded 54541 existing records from primary storage. [2025-10-13T17:11:58.836109] [INFO ] [MAIN ] AMC: Loaded 54541 existing records. [2025-10-13T17:11:59.016154] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:59.016371] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-13T17:11:59.016417] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-13T17:11:59.017310] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-13T17:11:59.017367] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-13T17:11:59.366213] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:59.617925] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-13T17:12:00.417913] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-13T17:12:00.670690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:12:01.217924] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-13T17:12:02.017908] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-13T17:12:02.121117] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T17:12:02.316589] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-13T17:12:02.447638] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T17:12:02.817943] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-13T17:12:03.301873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:12:03.617952] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-13T17:12:04.417938] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-13T17:12:05.113731] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:12:05.154277] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T17:12:05.217901] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-13T17:12:06.017935] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-13T17:12:06.176338] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:12:06.817960] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-13T17:12:07.313091] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-13T17:12:07.421113] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:12:07.617926] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-13T17:12:08.417902] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-13T17:12:08.465098] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:12:08.989548] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:12:09.217923] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-13T17:12:10.017940] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-13T17:12:10.500366] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T17:12:10.504951] [INFO ] [REMOTE ] AMBC: Full fetch complete (51570 records). [2025-10-13T17:12:10.505038] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-13T17:12:10.820612] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-13T17:12:10.885711] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-13T17:12:10.885868] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-13T17:12:10.886611] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-13T17:12:10.886740] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-13T17:12:10.950301] [DEBUG] [LOCAL ] AMBC: Trimmed 51570 records to 36300 (keeping 200 days of data) [2025-10-13T17:12:10.952538] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-13T17:12:11.166178] [DEBUG] [LOCAL ] AMBC: Primary data saved (36300 records). [2025-10-13T17:12:11.166322] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-13T17:12:11.167143] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 29.1s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-13T17:12:11.343367] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:11.395098] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-13T17:12:11.395418] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-10-13T17:12:11.573796] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:11.574274] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-13T17:12:11.574513] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-13T17:12:11.576311] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-13T17:12:11.576379] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-13T17:12:11.621055] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-13T17:12:11.948675] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T17:12:12.016878] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:12.417904] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-13T17:12:12.574390] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T17:12:13.217965] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-13T17:12:13.899417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T17:12:14.019175] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-13T17:12:14.022116] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T17:12:14.697530] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:12:14.817922] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-13T17:12:15.617931] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-13T17:12:16.417955] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-13T17:12:16.503429] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-13T17:12:17.217928] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-13T17:12:17.275019] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:12:17.414034] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-13T17:12:17.419858] [INFO ] [REMOTE ] AM: Full fetch complete (75546 records). [2025-10-13T17:12:17.420045] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-13T17:12:17.832199] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-13T17:12:17.832369] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-13T17:12:17.833326] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-13T17:12:17.833396] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-13T17:12:17.836439] [DEBUG] [LOCAL ] AM: Trimmed 75546 records to 51957 (keeping 200 days of data) [2025-10-13T17:12:18.059431] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-13T17:12:18.101415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:12:18.234133] [DEBUG] [LOCAL ] AM: Primary data saved (51957 records). [2025-10-13T17:12:18.234347] [INFO ] [MAIN ] AM: Full history saved. [2025-10-13T17:12:18.234470] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AM took 46.0s. Estimated remaining: 4h 50m 12s. Rate: 7.8 symbols/min [2025-10-13T17:12:18.406105] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:18.458378] [DEBUG] [LOCAL ] AME: Loaded 49435 existing records from primary storage. [2025-10-13T17:12:18.458802] [INFO ] [MAIN ] AME: Loaded 49435 existing records. [2025-10-13T17:12:18.642260] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:18.642577] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-13T17:12:18.642629] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-13T17:12:18.643872] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-13T17:12:18.643931] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-13T17:12:18.820992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-13T17:12:19.015272] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:19.302918] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T17:12:19.349613] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:12:19.617929] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-13T17:12:20.352603] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:12:20.417992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-13T17:12:21.217972] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-13T17:12:21.920780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T17:12:21.981218] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:12:22.017953] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-13T17:12:22.385040] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:12:22.817997] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-13T17:12:23.584770] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T17:12:23.617913] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-13T17:12:24.169764] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T17:12:24.417943] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-13T17:12:25.217956] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-13T17:12:25.564795] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:12:26.017950] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-13T17:12:26.687304] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T17:12:26.764303] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:12:26.817903] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-13T17:12:27.618010] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-13T17:12:28.156365] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-13T17:12:28.417915] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-13T17:12:28.458762] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:12:29.217948] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-13T17:12:29.832856] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:12:29.894793] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T17:12:30.017955] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-13T17:12:30.598598] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:12:30.817925] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-13T17:12:31.617987] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-13T17:12:32.238551] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-13T17:12:32.244754] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-13T17:12:32.244902] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-13T17:12:32.419727] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-13T17:12:32.426768] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:12:32.719526] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-13T17:12:32.719681] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-13T17:12:32.720785] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-13T17:12:32.720885] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-13T17:12:32.723057] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 53762 (keeping 200 days of data) [2025-10-13T17:12:33.048234] [DEBUG] [LOCAL ] AMC: Primary data saved (53762 records). [2025-10-13T17:12:33.048585] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-13T17:12:33.048867] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 34.7s. Estimated remaining: 4h 52m 52s. Rate: 7.8 symbols/min [2025-10-13T17:12:33.227852] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-13T17:12:33.232447] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:33.263168] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:12:33.290293] [DEBUG] [LOCAL ] AMG: Loaded 20399 existing records from primary storage. [2025-10-13T17:12:33.290558] [INFO ] [MAIN ] AMG: Loaded 20399 existing records. [2025-10-13T17:12:33.476140] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:33.476380] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-13T17:12:33.476433] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-13T17:12:33.476940] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-13T17:12:33.477009] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-13T17:12:33.828838] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:34.017933] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-13T17:12:34.444795] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T17:12:34.659690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:12:34.664395] [INFO ] [REMOTE ] AMBP: Full fetch complete (65287 records). [2025-10-13T17:12:34.664568] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-13T17:12:34.823055] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-13T17:12:35.061116] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-13T17:12:35.061237] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-13T17:12:35.063586] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-13T17:12:35.063705] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-13T17:12:35.065589] [DEBUG] [LOCAL ] AMBP: Trimmed 65287 records to 44625 (keeping 200 days of data) [2025-10-13T17:12:35.340812] [DEBUG] [LOCAL ] AMBP: Primary data saved (44625 records). [2025-10-13T17:12:35.341026] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-13T17:12:35.341153] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMBP took 38.2s. Estimated remaining: 4h 50m 39s. Rate: 7.8 symbols/min [2025-10-13T17:12:35.525215] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:35.582295] [DEBUG] [LOCAL ] AMH: Loaded 52533 existing records from primary storage. [2025-10-13T17:12:35.582788] [INFO ] [MAIN ] AMH: Loaded 52533 existing records. [2025-10-13T17:12:35.627505] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-13T17:12:35.812699] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:35.813037] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-13T17:12:35.813452] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-13T17:12:35.816131] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-13T17:12:35.816049] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T17:12:35.816347] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-13T17:12:36.142459] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T17:12:36.228619] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:36.417939] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-13T17:12:37.217994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-13T17:12:37.424906] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:12:38.017919] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-13T17:12:38.093040] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:12:38.148892] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T17:12:38.817916] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-13T17:12:39.617937] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-13T17:12:39.740585] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T17:12:39.779742] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T17:12:40.417931] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-13T17:12:41.119064] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:12:41.217912] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-13T17:12:41.681237] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:12:42.017995] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-13T17:12:42.712828] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T17:12:42.817903] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-13T17:12:42.849806] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T17:12:43.617929] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-13T17:12:44.418019] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-13T17:12:44.696741] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:12:44.702387] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-13T17:12:44.702531] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-13T17:12:45.105425] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-13T17:12:45.105532] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-13T17:12:45.106318] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-13T17:12:45.106426] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-13T17:12:45.144808] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 53669 (keeping 200 days of data) [2025-10-13T17:12:45.147325] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:12:45.242685] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-13T17:12:45.473184] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-13T17:12:45.473324] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-13T17:12:45.474106] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMCR took 34.3s. Estimated remaining: 4h 51m 27s. Rate: 7.8 symbols/min [2025-10-13T17:12:45.647784] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:45.681213] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:12:45.731327] [DEBUG] [LOCAL ] AMN: Loaded 42328 existing records from primary storage. [2025-10-13T17:12:45.731787] [INFO ] [MAIN ] AMN: Loaded 42328 existing records. [2025-10-13T17:12:45.907002] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:45.907262] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-13T17:12:45.907308] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-13T17:12:45.907574] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-13T17:12:45.907630] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-13T17:12:46.023077] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-13T17:12:46.254118] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:46.817924] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-13T17:12:46.852497] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:12:47.617988] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-13T17:12:47.823178] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:12:48.011266] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:12:48.417983] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-13T17:12:49.217943] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-13T17:12:49.387205] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:12:49.832258] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:12:50.017970] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-13T17:12:50.817938] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-13T17:12:50.836613] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:12:50.986423] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T17:12:51.617946] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-13T17:12:52.417915] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-13T17:12:52.451516] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T17:12:52.572237] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:12:53.217922] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-13T17:12:54.017920] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-13T17:12:54.154034] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:12:54.615894] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:12:54.642336] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:12:54.817983] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-13T17:12:55.617976] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-13T17:12:56.423053] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-13T17:12:56.431883] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:12:56.438218] [INFO ] [REMOTE ] AME: Full fetch complete (69893 records). [2025-10-13T17:12:56.438401] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-13T17:12:56.846442] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-13T17:12:56.846532] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-13T17:12:56.847295] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-13T17:12:56.847387] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-13T17:12:56.849128] [DEBUG] [LOCAL ] AME: Trimmed 69893 records to 48705 (keeping 200 days of data) [2025-10-13T17:12:57.150946] [DEBUG] [LOCAL ] AME: Primary data saved (48705 records). [2025-10-13T17:12:57.151149] [INFO ] [MAIN ] AME: Full history saved. [2025-10-13T17:12:57.151452] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 38.9s. Estimated remaining: 4h 52m 50s. Rate: 7.8 symbols/min [2025-10-13T17:12:57.225067] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-13T17:12:57.336554] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:57.369666] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T17:12:57.408766] [DEBUG] [LOCAL ] AMP: Loaded 32366 existing records from primary storage. [2025-10-13T17:12:57.409074] [INFO ] [MAIN ] AMP: Loaded 32366 existing records. [2025-10-13T17:12:57.585940] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:57.586182] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-13T17:12:57.586242] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-13T17:12:57.586499] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-13T17:12:57.586557] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-13T17:12:57.947921] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:57.994851] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:12:58.017937] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-13T17:12:58.450957] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:12:58.817941] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-13T17:12:59.373373] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T17:12:59.617965] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-13T17:13:00.333585] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:13:00.417882] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-13T17:13:00.662862] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:13:00.665436] [INFO ] [REMOTE ] AMG: Full fetch complete (29526 records). [2025-10-13T17:13:00.665534] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-13T17:13:01.107962] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-13T17:13:01.108165] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-13T17:13:01.108689] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-13T17:13:01.108756] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-13T17:13:01.110272] [DEBUG] [LOCAL ] AMG: Trimmed 29526 records to 20121 (keeping 200 days of data) [2025-10-13T17:13:01.222843] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-13T17:13:01.259201] [DEBUG] [LOCAL ] AMG: Primary data saved (20121 records). [2025-10-13T17:13:01.259424] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-13T17:13:01.259624] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMG took 28.2s. Estimated remaining: 4h 51m 21s. Rate: 7.8 symbols/min [2025-10-13T17:13:01.465317] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:01.522475] [DEBUG] [LOCAL ] AMPX: Loaded 53098 existing records from primary storage. [2025-10-13T17:13:01.522967] [INFO ] [MAIN ] AMPX: Loaded 53098 existing records. [2025-10-13T17:13:01.714707] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:01.714966] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-13T17:13:01.715013] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-13T17:13:01.715518] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-13T17:13:01.715574] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-13T17:13:02.018528] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-13T17:13:02.094481] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:02.197323] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:13:02.668511] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T17:13:02.817943] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-13T17:13:03.553207] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:13:03.617938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-13T17:13:04.293858] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:13:04.417945] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-13T17:13:05.053040] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:13:05.217933] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-13T17:13:06.017922] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-13T17:13:06.236803] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T17:13:06.549951] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:13:06.817931] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-13T17:13:07.039168] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T17:13:07.617946] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-13T17:13:08.417932] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-13T17:13:08.790289] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:13:08.796852] [INFO ] [REMOTE ] AMH: Full fetch complete (74832 records). [2025-10-13T17:13:08.797040] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-13T17:13:09.126693] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:13:09.225217] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-13T17:13:09.270785] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-13T17:13:09.270937] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-13T17:13:09.271864] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-13T17:13:09.271933] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-13T17:13:09.274062] [DEBUG] [LOCAL ] AMH: Trimmed 74832 records to 51797 (keeping 200 days of data) [2025-10-13T17:13:09.623094] [DEBUG] [LOCAL ] AMH: Primary data saved (51797 records). [2025-10-13T17:13:09.623336] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-13T17:13:09.623469] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 34.3s. Estimated remaining: 4h 51m 28s. Rate: 7.8 symbols/min [2025-10-13T17:13:09.833810] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:09.874413] [DEBUG] [LOCAL ] AMPY: Loaded 39277 existing records from primary storage. [2025-10-13T17:13:09.874921] [INFO ] [MAIN ] AMPY: Loaded 39277 existing records. [2025-10-13T17:13:10.022588] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-13T17:13:10.072055] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:10.072765] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-13T17:13:10.072927] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-13T17:13:10.073462] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-13T17:13:10.073533] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-13T17:13:10.224585] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:13:10.500459] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:10.817947] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-13T17:13:11.191927] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:13:11.279311] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:13:11.617935] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-13T17:13:12.009278] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:13:12.417938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-13T17:13:13.223059] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-13T17:13:13.245121] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:13:13.789048] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:13:14.017938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-13T17:13:14.817932] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-13T17:13:15.000717] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:13:15.392783] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:13:15.617931] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-13T17:13:16.417902] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-13T17:13:16.592486] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:13:17.120260] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:13:17.218035] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-13T17:13:17.466546] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:13:18.018047] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-13T17:13:18.817900] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-13T17:13:19.146605] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T17:13:19.600847] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:13:19.605754] [INFO ] [REMOTE ] AMN: Full fetch complete (60234 records). [2025-10-13T17:13:19.605892] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-13T17:13:19.623118] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-13T17:13:20.065730] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-13T17:13:20.065849] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-13T17:13:20.066720] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-13T17:13:20.066811] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-13T17:13:20.068268] [DEBUG] [LOCAL ] AMN: Trimmed 60234 records to 41763 (keeping 200 days of data) [2025-10-13T17:13:20.212095] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:13:20.346843] [DEBUG] [LOCAL ] AMN: Primary data saved (41763 records). [2025-10-13T17:13:20.347027] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-13T17:13:20.347592] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 34.9s. Estimated remaining: 4h 52m 27s. Rate: 7.8 symbols/min [2025-10-13T17:13:20.423177] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-13T17:13:20.517769] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:20.549244] [DEBUG] [LOCAL ] AMR: Loaded 29346 existing records from primary storage. [2025-10-13T17:13:20.549496] [INFO ] [MAIN ] AMR: Loaded 29346 existing records. [2025-10-13T17:13:20.726447] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:20.726726] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-13T17:13:20.726781] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-13T17:13:20.727103] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-13T17:13:20.727162] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-13T17:13:21.077543] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:21.218032] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-13T17:13:21.580976] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:13:21.951210] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T17:13:21.954672] [INFO ] [REMOTE ] AMP: Full fetch complete (47351 records). [2025-10-13T17:13:21.954781] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-13T17:13:22.023908] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-13T17:13:22.315310] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:13:22.362501] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-13T17:13:22.362573] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-13T17:13:22.363089] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-13T17:13:22.363151] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-13T17:13:22.364063] [DEBUG] [LOCAL ] AMP: Trimmed 47351 records to 32007 (keeping 200 days of data) [2025-10-13T17:13:22.570188] [DEBUG] [LOCAL ] AMP: Primary data saved (32007 records). [2025-10-13T17:13:22.570336] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-13T17:13:22.570419] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMP took 25.4s. Estimated remaining: 4h 50m 19s. Rate: 7.8 symbols/min [2025-10-13T17:13:22.766936] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:22.805264] [DEBUG] [LOCAL ] AMRC: Loaded 38710 existing records from primary storage. [2025-10-13T17:13:22.805617] [INFO ] [MAIN ] AMRC: Loaded 38710 existing records. [2025-10-13T17:13:22.826201] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-13T17:13:22.984453] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:22.984627] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-13T17:13:22.984709] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-13T17:13:22.985408] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-13T17:13:22.985467] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-13T17:13:23.334274] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:23.618046] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-13T17:13:23.768515] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:13:23.798141] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:13:24.417965] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-13T17:13:24.860387] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:13:25.217966] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-13T17:13:25.448859] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T17:13:26.017920] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-13T17:13:26.454390] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T17:13:26.817934] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-13T17:13:27.594199] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:13:27.617925] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-13T17:13:27.734056] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T17:13:28.417925] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-13T17:13:28.810928] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T17:13:29.217932] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-13T17:13:30.018015] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-13T17:13:30.793180] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-13T17:13:30.825280] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-13T17:13:30.831259] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:13:31.237136] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:13:31.617937] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-13T17:13:32.196533] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:13:32.418000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-13T17:13:33.217956] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-13T17:13:33.619690] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T17:13:33.647278] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:13:34.017942] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-13T17:13:34.683239] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T17:13:34.817937] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-13T17:13:35.608266] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:13:35.617892] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-13T17:13:36.110231] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:13:36.418008] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-13T17:13:36.846876] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:13:37.217987] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-13T17:13:37.821439] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T17:13:38.018048] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-13T17:13:38.453984] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:13:38.817946] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-13T17:13:39.617961] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-13T17:13:39.924099] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T17:13:39.971394] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T17:13:40.418010] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-13T17:13:41.013751] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:13:41.217968] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-13T17:13:42.017963] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-13T17:13:42.709214] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T17:13:42.781536] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-13T17:13:42.787961] [INFO ] [REMOTE ] AMPX: Full fetch complete (75049 records). [2025-10-13T17:13:42.788196] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-13T17:13:42.823158] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-13T17:13:43.217281] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-13T17:13:43.217436] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-13T17:13:43.218387] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-13T17:13:43.218458] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-13T17:13:43.220498] [DEBUG] [LOCAL ] AMPX: Trimmed 75049 records to 52323 (keeping 200 days of data) [2025-10-13T17:13:43.458455] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:13:43.576702] [DEBUG] [LOCAL ] AMPX: Primary data saved (52323 records). [2025-10-13T17:13:43.576922] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-13T17:13:43.578411] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPX took 42.3s. Estimated remaining: 4h 54m 58s. Rate: 7.7 symbols/min [2025-10-13T17:13:43.624623] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-13T17:13:43.758817] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:43.759002] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-13T17:13:43.759041] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-13T17:13:43.759191] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-13T17:13:43.759232] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-13T17:13:43.759273] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-13T17:13:43.759316] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-13T17:13:44.140759] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:44.161122] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:13:44.418000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-13T17:13:45.150788] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:13:45.217947] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-13T17:13:45.431028] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:13:45.431506] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-13T17:13:45.431604] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:13:45.431698] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-13T17:13:45.431748] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:13:45.431792] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-13T17:13:45.431857] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-13T17:13:45.431894] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-13T17:13:45.431935] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-13T17:13:45.431989] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRZ took 1.9s. Estimated remaining: 4h 52m 43s. Rate: 7.7 symbols/min [2025-10-13T17:13:45.608218] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:45.636883] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:13:45.694997] [DEBUG] [LOCAL ] AMT: Loaded 53216 existing records from primary storage. [2025-10-13T17:13:45.695319] [INFO ] [MAIN ] AMT: Loaded 53216 existing records. [2025-10-13T17:13:45.893660] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:45.893892] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-13T17:13:45.893951] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-13T17:13:45.895037] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-13T17:13:45.895098] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-13T17:13:46.023047] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-13T17:13:46.280253] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:46.817949] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-13T17:13:47.273020] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:13:47.617934] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-13T17:13:48.426213] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-13T17:13:48.432348] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:13:49.117500] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:13:49.217939] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-13T17:13:50.023072] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-13T17:13:50.036796] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T17:13:50.377811] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:13:50.817981] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-13T17:13:51.463214] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:13:51.468086] [INFO ] [REMOTE ] AMPY: Full fetch complete (52464 records). [2025-10-13T17:13:51.468173] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-13T17:13:51.641360] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-13T17:13:51.850507] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-13T17:13:51.850581] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-13T17:13:51.851175] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-13T17:13:51.851239] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-13T17:13:51.852256] [DEBUG] [LOCAL ] AMPY: Trimmed 52464 records to 38869 (keeping 200 days of data) [2025-10-13T17:13:52.060693] [DEBUG] [LOCAL ] AMPY: Primary data saved (38869 records). [2025-10-13T17:13:52.060825] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-13T17:13:52.060905] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMPY took 42.4s. Estimated remaining: 4h 52m 12s. Rate: 7.7 symbols/min [2025-10-13T17:13:52.232066] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:52.253144] [DEBUG] [LOCAL ] AMTB: Loaded 20747 existing records from primary storage. [2025-10-13T17:13:52.253373] [INFO ] [MAIN ] AMTB: Loaded 20747 existing records. [2025-10-13T17:13:52.420535] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-13T17:13:52.433190] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:52.434314] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-13T17:13:52.434403] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-13T17:13:52.435047] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-13T17:13:52.435105] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-13T17:13:52.590571] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:13:52.872542] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:52.922379] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T17:13:53.217940] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-13T17:13:53.781567] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:13:54.017945] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-13T17:13:54.485749] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:13:54.491129] [INFO ] [REMOTE ] AMRC: Full fetch complete (53862 records). [2025-10-13T17:13:54.491267] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-13T17:13:54.832371] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-13T17:13:54.885901] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-13T17:13:54.885986] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-13T17:13:54.886546] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-13T17:13:54.886590] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-13T17:13:54.888088] [DEBUG] [LOCAL ] AMRC: Trimmed 53862 records to 38297 (keeping 200 days of data) [2025-10-13T17:13:55.109687] [DEBUG] [LOCAL ] AMRC: Primary data saved (38297 records). [2025-10-13T17:13:55.109845] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-13T17:13:55.109929] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 32.5s. Estimated remaining: 4h 50m 26s. Rate: 7.8 symbols/min [2025-10-13T17:13:55.285937] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:55.291636] [DEBUG] [LOCAL ] AMTD: Loaded 3793 existing records from primary storage. [2025-10-13T17:13:55.291826] [INFO ] [MAIN ] AMTD: Loaded 3793 existing records. [2025-10-13T17:13:55.482120] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:55.482563] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-13T17:13:55.482698] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-13T17:13:55.483059] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-13T17:13:55.483140] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-13T17:13:55.628830] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-13T17:13:55.771267] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T17:13:55.894116] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:55.975419] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:13:55.978602] [INFO ] [REMOTE ] AMR: Full fetch complete (40332 records). [2025-10-13T17:13:55.978717] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-13T17:13:56.362586] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-13T17:13:56.362780] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-13T17:13:56.363588] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-13T17:13:56.363684] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-13T17:13:56.365118] [DEBUG] [LOCAL ] AMR: Trimmed 40332 records to 28890 (keeping 200 days of data) [2025-10-13T17:13:56.422252] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-13T17:13:56.562506] [DEBUG] [LOCAL ] AMR: Primary data saved (28890 records). [2025-10-13T17:13:56.562745] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-13T17:13:56.563632] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMR took 36.2s. Estimated remaining: 4h 48m 8s. Rate: 7.9 symbols/min [2025-10-13T17:13:56.754473] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:56.815384] [DEBUG] [LOCAL ] AMTM: Loaded 51363 existing records from primary storage. [2025-10-13T17:13:56.815861] [INFO ] [MAIN ] AMTM: Loaded 51363 existing records. [2025-10-13T17:13:57.006796] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:13:57.031944] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:57.033031] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-13T17:13:57.033082] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-13T17:13:57.034039] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-13T17:13:57.034099] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-13T17:13:57.226625] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-13T17:13:57.382501] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:57.963381] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:13:58.018010] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-13T17:13:58.817962] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-13T17:13:59.114056] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:13:59.147751] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:13:59.617957] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-13T17:14:00.417983] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-13T17:14:00.487087] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T17:14:00.547896] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:14:00.841445] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T17:14:01.217991] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-13T17:14:02.017936] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-13T17:14:02.600713] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:14:02.739354] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:14:02.817960] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-13T17:14:03.618003] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-13T17:14:04.342402] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:14:04.417953] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-13T17:14:04.837933] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T17:14:05.129689] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:14:05.217907] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-13T17:14:06.017946] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-13T17:14:06.805117] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:14:06.818020] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-13T17:14:07.617939] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-13T17:14:08.046069] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:14:08.403789] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:14:08.417895] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-13T17:14:08.574603] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:14:09.217951] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-13T17:14:09.643520] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:14:09.867120] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:14:10.017958] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-13T17:14:10.817939] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-13T17:14:11.617946] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-13T17:14:11.844194] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T17:14:12.108587] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:14:12.417922] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-13T17:14:12.508255] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:14:13.217940] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-13T17:14:13.540458] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T17:14:14.017943] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-13T17:14:14.772030] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:14:14.817984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-13T17:14:15.617949] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-13T17:14:15.724086] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:14:15.763145] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:14:16.261899] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T17:14:16.417937] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-13T17:14:16.816437] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T17:14:17.217939] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-13T17:14:18.017963] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-13T17:14:18.817939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-13T17:14:19.163572] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T17:14:19.194375] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:14:19.412459] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T17:14:19.617954] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-13T17:14:20.417950] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-13T17:14:21.217914] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-13T17:14:21.301382] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:14:22.017939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-13T17:14:22.069005] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T17:14:22.243616] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:14:22.712899] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T17:14:22.817930] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-13T17:14:23.617939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-13T17:14:23.740449] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:14:24.177027] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:14:24.178125] [INFO ] [REMOTE ] AMTD: Full fetch complete (5603 records). [2025-10-13T17:14:24.178195] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-13T17:14:24.423133] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-13T17:14:24.546067] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-13T17:14:24.546187] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-13T17:14:24.546407] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-13T17:14:24.546453] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-13T17:14:24.547155] [DEBUG] [LOCAL ] AMTD: Trimmed 5603 records to 3779 (keeping 200 days of data) [2025-10-13T17:14:24.570252] [DEBUG] [LOCAL ] AMTD: Primary data saved (3779 records). [2025-10-13T17:14:24.570427] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-13T17:14:24.570534] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 29.5s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-13T17:14:24.751989] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:24.765871] [DEBUG] [LOCAL ] AMWL: Loaded 9466 existing records from primary storage. [2025-10-13T17:14:24.766213] [INFO ] [MAIN ] AMWL: Loaded 9466 existing records. [2025-10-13T17:14:24.954945] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:24.955238] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-13T17:14:24.955294] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-13T17:14:24.955699] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-13T17:14:24.955762] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-13T17:14:25.225322] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-13T17:14:25.338936] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:25.463190] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:14:25.465604] [INFO ] [REMOTE ] AMTB: Full fetch complete (29561 records). [2025-10-13T17:14:25.465851] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-13T17:14:25.845198] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-13T17:14:25.845302] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-13T17:14:25.845793] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-13T17:14:25.845858] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-13T17:14:25.847109] [DEBUG] [LOCAL ] AMTB: Trimmed 29561 records to 20503 (keeping 200 days of data) [2025-10-13T17:14:25.971787] [DEBUG] [LOCAL ] AMTB: Primary data saved (20503 records). [2025-10-13T17:14:25.971927] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-13T17:14:25.972013] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTB took 33.9s. Estimated remaining: 4h 52m 41s. Rate: 7.7 symbols/min [2025-10-13T17:14:26.023363] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-13T17:14:26.158629] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:26.209061] [DEBUG] [LOCAL ] AMX: Loaded 49829 existing records from primary storage. [2025-10-13T17:14:26.209445] [INFO ] [MAIN ] AMX: Loaded 49829 existing records. [2025-10-13T17:14:26.408547] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:26.408864] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-13T17:14:26.408928] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-13T17:14:26.410449] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-13T17:14:26.410543] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-13T17:14:26.819189] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-13T17:14:26.905334] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:26.949086] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:14:27.063474] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T17:14:27.617944] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-13T17:14:28.417968] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-13T17:14:28.880983] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T17:14:28.886966] [INFO ] [REMOTE ] AMT: Full fetch complete (76030 records). [2025-10-13T17:14:28.887240] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-13T17:14:29.225053] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-13T17:14:29.237950] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T17:14:29.266610] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:14:29.353889] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-13T17:14:29.353974] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-13T17:14:29.354762] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-13T17:14:29.354826] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-13T17:14:29.356300] [DEBUG] [LOCAL ] AMT: Trimmed 76030 records to 52462 (keeping 200 days of data) [2025-10-13T17:14:29.686843] [DEBUG] [LOCAL ] AMT: Primary data saved (52462 records). [2025-10-13T17:14:29.686991] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-13T17:14:29.687865] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMT took 44.3s. Estimated remaining: 4h 51m 11s. Rate: 7.8 symbols/min [2025-10-13T17:14:29.859332] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:29.896073] [DEBUG] [LOCAL ] AN: Loaded 32078 existing records from primary storage. [2025-10-13T17:14:29.896347] [INFO ] [MAIN ] AN: Loaded 32078 existing records. [2025-10-13T17:14:30.031403] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-13T17:14:30.071780] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:30.072030] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-13T17:14:30.072077] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-13T17:14:30.072415] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-13T17:14:30.072472] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-13T17:14:30.422887] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:30.796535] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T17:14:30.799734] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:14:30.817877] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-13T17:14:31.617941] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-13T17:14:32.375084] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:14:32.417926] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-13T17:14:33.220236] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-13T17:14:33.224607] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:14:33.230661] [INFO ] [REMOTE ] AMTM: Full fetch complete (73836 records). [2025-10-13T17:14:33.230772] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-13T17:14:33.647591] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-13T17:14:33.647709] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-13T17:14:33.648473] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-13T17:14:33.648540] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-13T17:14:33.650175] [DEBUG] [LOCAL ] AMTM: Trimmed 73836 records to 50593 (keeping 200 days of data) [2025-10-13T17:14:33.951171] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:14:33.975243] [DEBUG] [LOCAL ] AMTM: Primary data saved (50593 records). [2025-10-13T17:14:33.975340] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-13T17:14:33.976078] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 37.4s. Estimated remaining: 4h 49m 54s. Rate: 7.8 symbols/min [2025-10-13T17:14:34.023143] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-13T17:14:34.149240] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:34.205662] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-13T17:14:34.206016] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-10-13T17:14:34.383217] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:34.383572] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-13T17:14:34.383752] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-13T17:14:34.384112] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-13T17:14:34.384173] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-13T17:14:34.550392] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T17:14:34.777497] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:34.773969] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:14:34.817883] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-13T17:14:35.618035] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-13T17:14:35.632247] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:14:36.417976] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-13T17:14:37.217950] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-13T17:14:37.738900] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T17:14:38.028479] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-13T17:14:38.036048] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:14:38.431150] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:14:38.818051] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-13T17:14:39.618011] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-13T17:14:39.679316] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:14:39.995541] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T17:14:40.417954] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-13T17:14:40.984406] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T17:14:41.108476] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:14:41.217954] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-13T17:14:42.021543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-13T17:14:42.731581] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:14:42.748721] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T17:14:42.817881] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-13T17:14:43.561579] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:14:43.617943] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-13T17:14:44.417969] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-13T17:14:45.133544] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T17:14:45.226628] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-13T17:14:45.255744] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:14:45.928686] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:14:45.930847] [INFO ] [REMOTE ] AMWL: Full fetch complete (14370 records). [2025-10-13T17:14:45.930920] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-13T17:14:46.023170] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-13T17:14:46.306571] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-13T17:14:46.306674] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-13T17:14:46.306954] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-13T17:14:46.306995] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-13T17:14:46.307489] [DEBUG] [LOCAL ] AMWL: Trimmed 14370 records to 9437 (keeping 200 days of data) [2025-10-13T17:14:46.360467] [DEBUG] [LOCAL ] AMWL: Primary data saved (9437 records). [2025-10-13T17:14:46.360598] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-13T17:14:46.360770] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMWL took 21.8s. Estimated remaining: 4h 51m 19s. Rate: 7.7 symbols/min [2025-10-13T17:14:46.536033] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:46.588189] [DEBUG] [LOCAL ] ANF: Loaded 52849 existing records from primary storage. [2025-10-13T17:14:46.588540] [INFO ] [MAIN ] ANF: Loaded 52849 existing records. [2025-10-13T17:14:46.771957] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:46.772183] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-13T17:14:46.772257] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-13T17:14:46.772805] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-13T17:14:46.772865] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-13T17:14:46.827899] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-13T17:14:47.129099] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:47.621951] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-13T17:14:47.626613] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:14:48.064858] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:14:48.417938] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-13T17:14:49.217940] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-13T17:14:49.595064] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:14:50.017971] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-13T17:14:50.615232] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-13T17:14:50.706474] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:14:50.817938] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-13T17:14:51.480404] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:14:51.617940] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-13T17:14:52.361260] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:14:52.417905] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-13T17:14:52.813253] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:14:53.217986] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-13T17:14:53.804986] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:14:54.018032] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-13T17:14:54.817968] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-13T17:14:55.026547] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:14:55.573233] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T17:14:55.578454] [INFO ] [REMOTE ] AMX: Full fetch complete (70708 records). [2025-10-13T17:14:55.578557] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-13T17:14:55.623231] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-13T17:14:55.964123] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-13T17:14:55.964208] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-13T17:14:55.964934] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-13T17:14:55.964997] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-13T17:14:55.966409] [DEBUG] [LOCAL ] AMX: Trimmed 70708 records to 49092 (keeping 200 days of data) [2025-10-13T17:14:56.254995] [DEBUG] [LOCAL ] AMX: Primary data saved (49092 records). [2025-10-13T17:14:56.255128] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-13T17:14:56.255218] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AMX took 30.3s. Estimated remaining: 4h 51m 54s. Rate: 7.7 symbols/min [2025-10-13T17:14:56.423583] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-13T17:14:56.427049] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:56.428617] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-13T17:14:56.428846] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-13T17:14:56.428994] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-13T17:14:56.429044] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-13T17:14:56.429091] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-13T17:14:56.429127] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-13T17:14:56.821372] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:57.017858] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-13T17:14:57.075346] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:14:57.217945] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-13T17:14:57.818244] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:14:58.017951] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-13T17:14:58.817966] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-13T17:14:59.565851] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T17:14:59.617952] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-13T17:14:59.811246] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:14:59.830833] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:14:59.831114] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-13T17:14:59.831202] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:14:59.831250] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-13T17:14:59.831312] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:14:59.831384] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-13T17:14:59.831448] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-13T17:14:59.831485] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-13T17:14:59.831526] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-13T17:14:59.831574] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 3.6s. Estimated remaining: 4h 50m 25s. Rate: 7.8 symbols/min [2025-10-13T17:14:59.999983] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:15:00.033178] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:00.051718] [DEBUG] [LOCAL ] ANRO: Loaded 19612 existing records from primary storage. [2025-10-13T17:15:00.051952] [INFO ] [MAIN ] ANRO: Loaded 19612 existing records. [2025-10-13T17:15:00.240246] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:00.240490] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-13T17:15:00.240546] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-13T17:15:00.240800] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-13T17:15:00.240857] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-13T17:15:00.425240] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-13T17:15:00.600244] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:01.217960] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-13T17:15:01.769228] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:15:02.017979] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-13T17:15:02.817959] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-13T17:15:03.112021] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T17:15:03.617966] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-13T17:15:04.007787] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-13T17:15:04.357398] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:15:04.417973] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-13T17:15:05.217965] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-13T17:15:05.414901] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T17:15:06.018018] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-13T17:15:06.348408] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:15:06.408291] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T17:15:06.411418] [INFO ] [REMOTE ] AN: Full fetch complete (46881 records). [2025-10-13T17:15:06.411528] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-13T17:15:06.412288] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:15:06.412376] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:15:06.412442] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:15:06.412514] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-13T17:15:06.412578] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-13T17:15:06.412619] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-13T17:15:06.412856] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-10-13T17:15:06.413501] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. AN took 36.7s. Estimated remaining: 4h 49m 55s. Rate: 7.8 symbols/min [2025-10-13T17:15:06.817957] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-13T17:15:06.998291] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:15:07.617950] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-13T17:15:08.417953] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-13T17:15:08.715721] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:15:09.166855] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-13T17:15:09.217900] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-13T17:15:10.018007] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-13T17:15:10.348184] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T17:15:10.818013] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-13T17:15:11.087740] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T17:15:11.177084] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:15:11.617910] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-13T17:15:12.418000] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-13T17:15:12.550279] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:15:13.218019] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-13T17:15:13.580948] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T17:15:13.963908] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-13T17:15:14.017992] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-13T17:15:14.817982] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-13T17:15:14.973272] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:15:15.167472] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:15:15.450090] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T17:15:15.455560] [INFO ] [REMOTE ] ANET: Full fetch complete (77470 records). [2025-10-13T17:15:15.455768] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-13T17:15:15.457479] [FATAL] [VALIDATOR ] ANET: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:15:15.457732] [FATAL] [MAIN ] ANET: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:15:15.457806] [WARN ] [MAIN ] ANET: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:15:15.457882] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-13T17:15:15.457988] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-10-13T17:15:15.458046] [INFO ] [LOCAL ] ANET: Starting deletion of derivative data. [2025-10-13T17:15:15.458212] [DEBUG] [LOCAL ] ANET: Deleted derivative data file. [2025-10-13T17:15:15.458849] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 41.5s. Estimated remaining: 4h 50m 13s. Rate: 7.8 symbols/min [2025-10-13T17:15:15.617927] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-13T17:15:16.417925] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-13T17:15:17.268220] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:15:17.279602] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-13T17:15:17.430254] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:15:18.017964] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-13T17:15:18.844673] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:15:18.849635] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-13T17:15:19.138784] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:15:19.589533] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:15:19.617996] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-13T17:15:20.418033] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-13T17:15:20.440676] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T17:15:21.218021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-13T17:15:22.353216] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T17:15:22.371927] [INFO ] [REMOTE ] ANF: Full fetch complete (75593 records). [2025-10-13T17:15:22.373447] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:15:22.372854] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-13T17:15:22.378934] [INFO ] [REMOTE ] ANRO: Full fetch complete (29667 records). [2025-10-13T17:15:22.379066] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-13T17:15:23.150834] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-13T17:15:23.173695] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-13T17:15:23.154954] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-13T17:15:23.174278] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-13T17:15:23.173829] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-13T17:15:23.175139] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-13T17:15:23.175055] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-13T17:15:23.175405] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-13T17:15:23.176527] [DEBUG] [LOCAL ] ANRO: Trimmed 29667 records to 19332 (keeping 200 days of data) [2025-10-13T17:15:23.177547] [DEBUG] [LOCAL ] ANF: Trimmed 75593 records to 52071 (keeping 200 days of data) [2025-10-13T17:15:23.387717] [DEBUG] [LOCAL ] ANRO: Primary data saved (19332 records). [2025-10-13T17:15:23.396471] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-13T17:15:23.398863] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANRO took 23.6s. Estimated remaining: 4h 50m 9s. Rate: 7.8 symbols/min [2025-10-13T17:15:23.578589] [DEBUG] [LOCAL ] ANF: Primary data saved (52071 records). [2025-10-13T17:15:23.578752] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-13T17:15:23.578840] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 37.2s. Estimated remaining: 4h 47m 39s. Rate: 7.8 symbols/min [2025-10-13T17:15:24.196509] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.153693] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.232969] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.244224] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-13T17:15:24.264149] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-13T17:15:24.264379] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-13T17:15:24.264464] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-13T17:15:24.264567] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-13T17:15:24.264676] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-13T17:15:24.321472] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.355478] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-13T17:15:24.372369] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-13T17:15:24.403272] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-13T17:15:24.441903] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-13T17:15:24.496741] [DEBUG] [LOCAL ] AOD: Loaded 31144 existing records from primary storage. [2025-10-13T17:15:24.497926] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-13T17:15:24.505886] [INFO ] [MAIN ] AOD: Loaded 31144 existing records. [2025-10-13T17:15:24.495469] [DEBUG] [LOCAL ] ANVS: Loaded 23802 existing records from primary storage. [2025-10-13T17:15:24.505586] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-13T17:15:24.547493] [INFO ] [MAIN ] ANVS: Loaded 23802 existing records. [2025-10-13T17:15:25.058703] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:25.185784] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-13T17:15:25.235638] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:25.243162] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-13T17:15:25.289876] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:25.263430] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-13T17:15:25.297319] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-13T17:15:25.307116] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-13T17:15:25.351983] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-13T17:15:25.357234] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-13T17:15:25.411546] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-13T17:15:25.427188] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-13T17:15:25.721037] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:15:25.737168] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:25.792925] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-13T17:15:25.834314] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-13T17:15:25.835312] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:15:25.835420] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-13T17:15:25.835468] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:15:25.835510] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-13T17:15:25.905728] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-13T17:15:25.932727] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-13T17:15:26.003816] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-13T17:15:26.009155] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 45m 54s. Rate: 7.9 symbols/min [2025-10-13T17:15:26.336731] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:26.383920] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-13T17:15:26.466580] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:26.501702] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:26.502013] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-13T17:15:26.545313] [DEBUG] [LOCAL ] AON: Loaded 45735 existing records from primary storage. [2025-10-13T17:15:26.545627] [INFO ] [MAIN ] AON: Loaded 45735 existing records. [2025-10-13T17:15:26.729138] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:26.729622] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-13T17:15:26.729719] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-13T17:15:26.730057] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-13T17:15:26.730098] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-13T17:15:26.820801] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:15:26.824138] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-13T17:15:27.165443] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:27.165866] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-13T17:15:27.517061] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:15:27.520794] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-13T17:15:27.685966] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:15:27.692094] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-13T17:15:27.756462] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:15:28.334362] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:15:28.417933] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-13T17:15:28.540787] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:15:28.763908] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:15:29.217938] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-13T17:15:29.386948] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T17:15:30.018110] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-13T17:15:30.598146] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:15:30.817909] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-13T17:15:31.617898] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-13T17:15:31.717809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T17:15:31.986854] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:15:32.417920] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-13T17:15:32.597676] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T17:15:33.217911] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-13T17:15:33.666378] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T17:15:34.017924] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-13T17:15:34.316301] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:15:34.817932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-13T17:15:35.121983] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T17:15:35.618006] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-13T17:15:35.625488] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:15:36.418047] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-13T17:15:36.906520] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T17:15:37.217914] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-13T17:15:37.419844] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:15:38.018025] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-13T17:15:38.687600] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T17:15:38.817944] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-13T17:15:39.617890] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-13T17:15:39.646693] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T17:15:39.944314] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T17:15:40.417933] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-13T17:15:40.549762] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:15:41.217937] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-13T17:15:42.017912] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-13T17:15:42.151122] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:15:42.306053] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T17:15:42.817982] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-13T17:15:43.481190] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:15:43.617932] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-13T17:15:44.420794] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-13T17:15:44.423431] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:15:44.668018] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T17:15:45.217946] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-13T17:15:45.593861] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:15:46.017929] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-13T17:15:46.484962] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T17:15:46.817945] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-13T17:15:47.120562] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:15:47.570531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T17:15:47.617896] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-13T17:15:48.417905] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-13T17:15:48.649605] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T17:15:49.218005] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-13T17:15:49.705693] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:15:50.017936] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-13T17:15:50.636779] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:15:50.640155] [INFO ] [REMOTE ] ANVS: Full fetch complete (36501 records). [2025-10-13T17:15:50.640260] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-13T17:15:50.823111] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-13T17:15:51.007171] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-13T17:15:51.007243] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-13T17:15:51.007712] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-13T17:15:51.007777] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-13T17:15:51.008553] [DEBUG] [LOCAL ] ANVS: Trimmed 36501 records to 23559 (keeping 200 days of data) [2025-10-13T17:15:51.146761] [DEBUG] [LOCAL ] ANVS: Primary data saved (23559 records). [2025-10-13T17:15:51.146892] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-13T17:15:51.147024] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. ANVS took 27.6s. Estimated remaining: 4h 51m 10s. Rate: 7.7 symbols/min [2025-10-13T17:15:51.315785] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:51.359047] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:15:51.358253] [DEBUG] [LOCAL ] AORT: Loaded 29573 existing records from primary storage. [2025-10-13T17:15:51.366019] [INFO ] [MAIN ] AORT: Loaded 29573 existing records. [2025-10-13T17:15:51.538912] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:51.539171] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-13T17:15:51.539224] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-13T17:15:51.539786] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-13T17:15:51.539858] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-13T17:15:51.618783] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-13T17:15:51.906225] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:15:51.910552] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:52.417932] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-13T17:15:52.959046] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:15:52.963018] [INFO ] [REMOTE ] AOD: Full fetch complete (44518 records). [2025-10-13T17:15:52.963139] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-13T17:15:53.223031] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-13T17:15:53.345140] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-13T17:15:53.345286] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-13T17:15:53.345901] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-13T17:15:53.346053] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-13T17:15:53.359126] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:15:53.365011] [DEBUG] [LOCAL ] AOD: Trimmed 44518 records to 30694 (keeping 200 days of data) [2025-10-13T17:15:53.545695] [DEBUG] [LOCAL ] AOD: Primary data saved (30694 records). [2025-10-13T17:15:53.545834] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-13T17:15:53.546682] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 30.0s. Estimated remaining: 4h 49m 24s. Rate: 7.8 symbols/min [2025-10-13T17:15:53.711148] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:53.756037] [DEBUG] [LOCAL ] AOS: Loaded 49405 existing records from primary storage. [2025-10-13T17:15:53.756344] [INFO ] [MAIN ] AOS: Loaded 49405 existing records. [2025-10-13T17:15:53.931983] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:53.932229] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-13T17:15:53.932277] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-13T17:15:53.932571] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-13T17:15:53.932627] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-13T17:15:54.027703] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-13T17:15:54.278040] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:54.774237] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:15:54.817916] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-13T17:15:54.966286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:15:54.968105] [INFO ] [REMOTE ] AOMR: Full fetch complete (23162 records). [2025-10-13T17:15:54.968355] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-13T17:15:55.356836] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-13T17:15:55.356956] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-13T17:15:55.357474] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-13T17:15:55.357546] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-13T17:15:55.358355] [DEBUG] [LOCAL ] AOMR: Trimmed 23162 records to 16492 (keeping 200 days of data) [2025-10-13T17:15:55.466354] [DEBUG] [LOCAL ] AOMR: Primary data saved (16492 records). [2025-10-13T17:15:55.466571] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-13T17:15:55.466692] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMR took 31.9s. Estimated remaining: 4h 47m 31s. Rate: 7.8 symbols/min [2025-10-13T17:15:55.623235] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-13T17:15:55.672109] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:55.683023] [DEBUG] [LOCAL ] AP: Loaded 7276 existing records from primary storage. [2025-10-13T17:15:55.683317] [INFO ] [MAIN ] AP: Loaded 7276 existing records. [2025-10-13T17:15:55.884690] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:55.885172] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-13T17:15:55.885290] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-13T17:15:55.885617] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-13T17:15:55.885714] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-13T17:15:56.101590] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:15:56.328865] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:56.417937] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-13T17:15:57.109063] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:15:57.217896] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-13T17:15:57.760841] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:15:58.017953] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-13T17:15:58.676845] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:15:58.817926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-13T17:15:59.070766] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:15:59.617935] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-13T17:16:00.140377] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:16:00.417920] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-13T17:16:00.843165] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T17:16:00.985748] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:16:01.217930] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-13T17:16:02.017935] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-13T17:16:02.817919] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-13T17:16:02.934121] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:16:03.284077] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:16:03.488820] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:16:03.617926] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-13T17:16:04.417997] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-13T17:16:04.978752] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:16:05.218002] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-13T17:16:06.017962] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-13T17:16:06.242988] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T17:16:06.604490] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:16:06.817897] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-13T17:16:07.617905] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-13T17:16:07.689243] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:16:08.417895] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-13T17:16:08.493339] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T17:16:08.657113] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:16:09.217928] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-13T17:16:10.017905] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-13T17:16:10.096213] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:16:10.621583] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:16:10.730414] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:16:10.817908] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-13T17:16:11.617976] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-13T17:16:12.114107] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:16:12.120160] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:16:12.417944] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-13T17:16:13.217924] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-13T17:16:13.651496] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:16:14.018006] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-13T17:16:14.527066] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T17:16:14.531524] [INFO ] [REMOTE ] AON: Full fetch complete (64556 records). [2025-10-13T17:16:14.531679] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-13T17:16:14.823040] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-13T17:16:14.947052] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-13T17:16:14.947161] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-13T17:16:14.947828] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-13T17:16:14.947891] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-13T17:16:14.949817] [DEBUG] [LOCAL ] AON: Trimmed 64556 records to 45124 (keeping 200 days of data) [2025-10-13T17:16:15.236789] [DEBUG] [LOCAL ] AON: Primary data saved (45124 records). [2025-10-13T17:16:15.237018] [INFO ] [MAIN ] AON: Full history saved. [2025-10-13T17:16:15.237183] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 49.2s. Estimated remaining: 4h 51m 0s. Rate: 7.7 symbols/min [2025-10-13T17:16:15.422975] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:15.462246] [DEBUG] [LOCAL ] APAM: Loaded 36563 existing records from primary storage. [2025-10-13T17:16:15.462535] [INFO ] [MAIN ] APAM: Loaded 36563 existing records. [2025-10-13T17:16:15.653240] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:15.621037] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-13T17:16:15.653541] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-13T17:16:15.654779] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-13T17:16:15.655236] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-13T17:16:15.655388] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-13T17:16:15.988257] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T17:16:16.062110] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:16.125443] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T17:16:16.370850] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T17:16:16.417916] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-13T17:16:17.046954] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T17:16:17.217927] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-13T17:16:18.018024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-13T17:16:18.817939] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-13T17:16:18.828629] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:16:19.617976] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-13T17:16:19.767817] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-13T17:16:20.036309] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:16:20.417934] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-13T17:16:21.217928] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-13T17:16:21.598376] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:16:21.718104] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T17:16:21.721692] [INFO ] [REMOTE ] AORT: Full fetch complete (41946 records). [2025-10-13T17:16:21.721888] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-13T17:16:21.723233] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:21.723456] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:21.723523] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:21.723601] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-13T17:16:21.723724] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-13T17:16:21.723786] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-13T17:16:21.723973] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-10-13T17:16:21.724083] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AORT took 30.6s. Estimated remaining: 4h 50m 30s. Rate: 7.7 symbols/min [2025-10-13T17:16:21.893618] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:21.939064] [DEBUG] [LOCAL ] APD: Loaded 45975 existing records from primary storage. [2025-10-13T17:16:21.939362] [INFO ] [MAIN ] APD: Loaded 45975 existing records. [2025-10-13T17:16:22.018954] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-13T17:16:22.049399] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:16:22.133584] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:22.133844] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-13T17:16:22.133895] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-13T17:16:22.134212] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-13T17:16:22.134287] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-13T17:16:22.490989] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:22.817949] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-13T17:16:23.469747] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:16:23.618011] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-13T17:16:24.417951] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-13T17:16:24.478463] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:16:24.996130] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:16:25.216616] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T17:16:25.218936] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-13T17:16:26.017954] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-13T17:16:26.695943] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:16:26.817925] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-13T17:16:26.866565] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:16:27.617965] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-13T17:16:28.417958] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-13T17:16:28.554477] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:16:28.873587] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:16:28.874584] [INFO ] [REMOTE ] AP: Full fetch complete (8955 records). [2025-10-13T17:16:28.874687] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-13T17:16:28.875079] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:28.875164] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:28.875208] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:28.875247] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-13T17:16:28.875301] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-13T17:16:28.875336] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-13T17:16:28.875462] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-13T17:16:28.875525] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AP took 33.4s. Estimated remaining: 4h 50m 11s. Rate: 7.7 symbols/min [2025-10-13T17:16:29.050064] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:29.101903] [DEBUG] [LOCAL ] APG: Loaded 51201 existing records from primary storage. [2025-10-13T17:16:29.102230] [INFO ] [MAIN ] APG: Loaded 51201 existing records. [2025-10-13T17:16:29.218406] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-13T17:16:29.281500] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:16:29.307140] [INFO ] [REMOTE ] AOS: Full fetch complete (70366 records). [2025-10-13T17:16:29.311369] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:29.311721] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-13T17:16:29.311965] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-13T17:16:29.312285] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-13T17:16:29.313263] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-13T17:16:29.313183] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:29.313521] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-13T17:16:29.313453] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:29.348078] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:29.373837] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-13T17:16:29.389749] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-13T17:16:29.396054] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-13T17:16:29.422312] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-13T17:16:29.425611] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. AOS took 35.9s. Estimated remaining: 4h 47m 57s. Rate: 7.8 symbols/min [2025-10-13T17:16:29.810995] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:29.821425] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-13T17:16:29.821493] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-13T17:16:29.844791] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-13T17:16:29.857359] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-13T17:16:29.864888] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-13T17:16:29.880206] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-13T17:16:29.898923] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:30.023126] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-13T17:16:30.260725] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:30.817958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-13T17:16:30.920429] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:16:31.551450] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:16:31.617915] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-13T17:16:32.068033] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:16:32.417940] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-13T17:16:33.062371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:16:33.217946] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-13T17:16:34.017985] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-13T17:16:34.261385] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T17:16:34.732052] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:16:34.817915] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-13T17:16:35.395624] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:16:35.618031] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-13T17:16:36.139693] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:16:36.417931] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-13T17:16:37.217932] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-13T17:16:37.369389] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:16:37.635198] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:16:38.017982] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-13T17:16:38.817979] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-13T17:16:38.853207] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:16:39.451296] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:16:39.617927] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-13T17:16:40.417914] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-13T17:16:40.526453] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:16:41.217955] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-13T17:16:41.360357] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:16:42.017921] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-13T17:16:42.170718] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:16:42.559769] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:16:42.817943] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-13T17:16:43.538354] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:16:43.617900] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-13T17:16:44.417923] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-13T17:16:44.541260] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T17:16:45.111054] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:16:45.217922] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-13T17:16:46.017921] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-13T17:16:46.155420] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:16:46.817909] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-13T17:16:47.052002] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:16:47.086152] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T17:16:47.617950] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-13T17:16:48.417946] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-13T17:16:48.576883] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:16:49.214739] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:16:49.225513] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-13T17:16:49.790681] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:16:49.794878] [INFO ] [REMOTE ] APAM: Full fetch complete (51866 records). [2025-10-13T17:16:49.795123] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-13T17:16:50.024628] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-13T17:16:50.196049] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-13T17:16:50.196178] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-13T17:16:50.196828] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-13T17:16:50.196894] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-13T17:16:50.198389] [DEBUG] [LOCAL ] APAM: Trimmed 51866 records to 36096 (keeping 200 days of data) [2025-10-13T17:16:50.414316] [DEBUG] [LOCAL ] APAM: Primary data saved (36096 records). [2025-10-13T17:16:50.414460] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-13T17:16:50.414542] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APAM took 35.2s. Estimated remaining: 4h 51m 40s. Rate: 7.7 symbols/min [2025-10-13T17:16:50.586877] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:50.637572] [DEBUG] [LOCAL ] APLE: Loaded 52694 existing records from primary storage. [2025-10-13T17:16:50.637944] [INFO ] [MAIN ] APLE: Loaded 52694 existing records. [2025-10-13T17:16:50.821362] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:50.821497] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-13T17:16:50.823306] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-13T17:16:50.823494] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-13T17:16:50.824137] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-13T17:16:50.824408] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-13T17:16:51.185296] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:16:51.248083] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:51.617892] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-13T17:16:52.417892] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-13T17:16:52.453058] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:16:53.217953] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-13T17:16:53.478206] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:16:54.018078] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-13T17:16:54.517063] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T17:16:54.706858] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (4.68 seconds). [2025-10-13T17:16:54.817892] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-13T17:16:55.468752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:16:55.617908] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-13T17:16:56.417919] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-13T17:16:56.617145] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (3.40 seconds). [2025-10-13T17:16:57.183607] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T17:16:57.217893] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-13T17:16:57.719092] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T17:16:58.018059] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-13T17:16:58.373443] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (3.56 seconds). [2025-10-13T17:16:58.817892] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-13T17:16:58.896725] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:16:59.309051] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:16:59.314217] [INFO ] [REMOTE ] APD: Full fetch complete (66925 records). [2025-10-13T17:16:59.314323] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-13T17:16:59.623010] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-13T17:16:59.759124] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-13T17:16:59.759248] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-13T17:16:59.759991] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-13T17:16:59.760059] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-13T17:16:59.761686] [DEBUG] [LOCAL ] APD: Trimmed 66925 records to 45325 (keeping 200 days of data) [2025-10-13T17:17:00.049477] [DEBUG] [LOCAL ] APD: Primary data saved (45325 records). [2025-10-13T17:17:00.049613] [INFO ] [MAIN ] APD: Full history saved. [2025-10-13T17:17:00.050474] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 38.3s. Estimated remaining: 4h 52m 4s. Rate: 7.7 symbols/min [2025-10-13T17:17:00.228939] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:00.285711] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-13T17:17:00.286049] [INFO ] [MAIN ] APO: Loaded 54163 existing records. [2025-10-13T17:17:00.426803] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-13T17:17:00.467965] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:00.469262] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-13T17:17:00.469376] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-13T17:17:00.470140] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-13T17:17:00.470204] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-13T17:17:00.610459] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:17:00.705119] [INFO ] [REMOTE ] APG: Full fetch complete (71842 records). [2025-10-13T17:17:00.721717] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-13T17:17:01.001071] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:01.226584] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-13T17:17:01.284003] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-13T17:17:01.284132] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-13T17:17:01.285179] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-13T17:17:01.285253] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-13T17:17:01.287062] [DEBUG] [LOCAL ] APG: Trimmed 71842 records to 50584 (keeping 200 days of data) [2025-10-13T17:17:01.614054] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T17:17:01.642492] [DEBUG] [LOCAL ] APG: Primary data saved (50584 records). [2025-10-13T17:17:01.642595] [INFO ] [MAIN ] APG: Full history saved. [2025-10-13T17:17:01.642688] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APG took 32.8s. Estimated remaining: 4h 50m 10s. Rate: 7.7 symbols/min [2025-10-13T17:17:01.806333] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:01.814738] [DEBUG] [LOCAL ] APOS: Loaded 7591 existing records from primary storage. [2025-10-13T17:17:01.814923] [INFO ] [MAIN ] APOS: Loaded 7591 existing records. [2025-10-13T17:17:01.987154] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:01.987359] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-13T17:17:01.987406] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-13T17:17:01.987560] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-13T17:17:01.987597] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-13T17:17:02.018726] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-13T17:17:02.342012] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:02.383481] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:17:02.817949] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-13T17:17:03.385054] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:17:03.434477] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T17:17:03.617952] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-13T17:17:03.786698] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:17:04.320981] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:17:04.417954] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-13T17:17:05.064447] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T17:17:05.217989] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-13T17:17:06.017928] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-13T17:17:06.817954] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-13T17:17:07.617993] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-13T17:17:07.664274] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:17:08.149964] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-13T17:17:08.351401] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:17:08.417970] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-13T17:17:08.689508] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:17:09.175479] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T17:17:09.217958] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-13T17:17:10.012855] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T17:17:10.017872] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-13T17:17:10.817925] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-13T17:17:10.830801] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:17:11.617923] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-13T17:17:12.417967] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-13T17:17:12.665249] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:17:12.670628] [INFO ] [REMOTE ] APH: Full fetch complete (77692 records). [2025-10-13T17:17:12.670758] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-13T17:17:13.057893] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-13T17:17:13.058097] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-13T17:17:13.058981] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-13T17:17:13.059062] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-13T17:17:13.060704] [DEBUG] [LOCAL ] APH: Trimmed 77692 records to 53691 (keeping 200 days of data) [2025-10-13T17:17:13.191517] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:17:13.217917] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-13T17:17:13.432635] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-13T17:17:13.432795] [INFO ] [MAIN ] APH: Full history saved. [2025-10-13T17:17:13.432868] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APH took 44.0s. Estimated remaining: 4h 51m 10s. Rate: 7.7 symbols/min [2025-10-13T17:17:13.600360] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:13.649231] [DEBUG] [LOCAL ] APTV: Loaded 52790 existing records from primary storage. [2025-10-13T17:17:13.649536] [INFO ] [MAIN ] APTV: Loaded 52790 existing records. [2025-10-13T17:17:13.820680] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:13.820889] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-13T17:17:13.820934] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-13T17:17:13.821397] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-13T17:17:13.821458] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-13T17:17:14.026591] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-13T17:17:14.177198] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:14.204722] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T17:17:14.715181] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T17:17:14.777313] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:17:14.817889] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-13T17:17:15.617949] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-13T17:17:16.417918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-13T17:17:16.537348] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:17:16.906822] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:17:17.217979] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-13T17:17:17.530010] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:17:18.017961] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-13T17:17:18.817911] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-13T17:17:18.977148] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T17:17:19.453043] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T17:17:19.617904] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-13T17:17:20.426085] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-13T17:17:20.446625] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-13T17:17:20.484432] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:17:20.485579] [INFO ] [REMOTE ] APOS: Full fetch complete (10343 records). [2025-10-13T17:17:20.485680] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-13T17:17:20.486138] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:17:20.486223] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:17:20.486266] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:17:20.486304] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-13T17:17:20.486358] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-13T17:17:20.486397] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-13T17:17:20.486552] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-13T17:17:20.486663] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 18.8s. Estimated remaining: 4h 50m 50s. Rate: 7.7 symbols/min [2025-10-13T17:17:20.654879] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:20.655090] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-13T17:17:20.655128] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-13T17:17:20.655244] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-13T17:17:20.655285] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-13T17:17:20.655347] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-13T17:17:20.655382] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-13T17:17:21.039620] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:21.217911] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-13T17:17:22.017964] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-13T17:17:22.299088] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:17:22.817927] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-13T17:17:23.059559] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:17:23.510597] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:17:23.617936] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-13T17:17:24.417998] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-13T17:17:24.654690] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:17:24.943385] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:17:25.218036] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-13T17:17:26.017940] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-13T17:17:26.159957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:17:26.817919] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-13T17:17:27.101418] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:17:27.382724] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:17:27.617924] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-13T17:17:28.417953] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-13T17:17:28.696486] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T17:17:29.217956] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-13T17:17:29.406314] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:17:29.771904] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:17:30.017980] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-13T17:17:30.642138] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:17:30.817968] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-13T17:17:31.617970] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-13T17:17:31.713247] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:17:31.718189] [INFO ] [REMOTE ] APLE: Full fetch complete (74075 records). [2025-10-13T17:17:31.718322] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-13T17:17:31.719194] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:17:31.719283] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:17:31.719326] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:17:31.719364] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-13T17:17:31.719424] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-13T17:17:31.719459] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-13T17:17:31.719614] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-13T17:17:31.719734] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APLE took 41.3s. Estimated remaining: 4h 51m 39s. Rate: 7.7 symbols/min [2025-10-13T17:17:31.884856] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:31.890786] [DEBUG] [LOCAL ] AQNB: Loaded 4197 existing records from primary storage. [2025-10-13T17:17:31.890972] [INFO ] [MAIN ] AQNB: Loaded 4197 existing records. [2025-10-13T17:17:32.064759] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:32.064988] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-13T17:17:32.065034] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-13T17:17:32.065207] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-13T17:17:32.065264] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-13T17:17:32.421617] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-13T17:17:32.427090] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:32.508792] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:17:33.217958] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-13T17:17:33.428384] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T17:17:34.017969] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-13T17:17:34.336521] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:17:34.817914] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-13T17:17:34.917097] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:17:35.594391] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:17:35.617890] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-13T17:17:36.362329] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:17:36.417903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-13T17:17:37.065625] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T17:17:37.217951] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-13T17:17:37.842754] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:17:38.017910] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-13T17:17:38.143743] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:17:38.564119] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:17:38.817966] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-13T17:17:39.617986] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-13T17:17:40.417939] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-13T17:17:40.507528] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:17:40.873997] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:17:41.217954] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-13T17:17:41.635245] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-13T17:17:41.641763] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-13T17:17:41.641976] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-13T17:17:41.947032] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:17:42.023051] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-13T17:17:42.077672] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-13T17:17:42.077828] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-13T17:17:42.078766] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-13T17:17:42.078845] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-13T17:17:42.081085] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53387 (keeping 200 days of data) [2025-10-13T17:17:42.450374] [DEBUG] [LOCAL ] APO: Primary data saved (53387 records). [2025-10-13T17:17:42.450617] [INFO ] [MAIN ] APO: Full history saved. [2025-10-13T17:17:42.451753] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APO took 42.4s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-13T17:17:42.639556] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:42.704011] [DEBUG] [LOCAL ] AR: Loaded 54366 existing records from primary storage. [2025-10-13T17:17:42.704464] [INFO ] [MAIN ] AR: Loaded 54366 existing records. [2025-10-13T17:17:42.823092] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-13T17:17:42.895540] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:42.895947] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-13T17:17:42.895996] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-13T17:17:42.896423] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-13T17:17:42.896480] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-13T17:17:43.262900] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:43.510037] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T17:17:43.617931] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-13T17:17:43.881067] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:17:44.417951] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-13T17:17:45.218016] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-13T17:17:45.460589] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:17:45.609205] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T17:17:46.017953] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-13T17:17:46.132551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T17:17:46.138450] [INFO ] [REMOTE ] APTV: Full fetch complete (75809 records). [2025-10-13T17:17:46.138602] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-13T17:17:46.547977] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-13T17:17:46.551472] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-13T17:17:46.552513] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-13T17:17:46.552586] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-13T17:17:46.554230] [DEBUG] [LOCAL ] APTV: Trimmed 75809 records to 52009 (keeping 200 days of data) [2025-10-13T17:17:46.819067] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-13T17:17:46.864779] [DEBUG] [LOCAL ] APTV: Primary data saved (52009 records). [2025-10-13T17:17:46.864950] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-13T17:17:46.865112] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 33.4s. Estimated remaining: 4h 51m 15s. Rate: 7.7 symbols/min [2025-10-13T17:17:47.031791] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:47.031992] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-13T17:17:47.032030] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-13T17:17:47.032168] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-13T17:17:47.032209] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-13T17:17:47.032256] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-13T17:17:47.032335] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-13T17:17:47.386108] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:47.393267] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T17:17:47.617952] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-13T17:17:47.664261] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:17:48.417955] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-13T17:17:49.164747] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:17:49.217929] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-13T17:17:49.577386] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T17:17:49.579858] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:17:50.017938] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-13T17:17:50.817928] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-13T17:17:51.617903] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-13T17:17:51.686333] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:17:52.213068] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T17:17:52.417934] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-13T17:17:52.837307] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T17:17:53.217974] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-13T17:17:53.751790] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T17:17:53.753058] [INFO ] [REMOTE ] AQNB: Full fetch complete (5555 records). [2025-10-13T17:17:53.753133] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-13T17:17:54.023550] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-13T17:17:54.109615] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:17:54.193514] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-13T17:17:54.193599] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-13T17:17:54.193794] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-13T17:17:54.193857] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-13T17:17:54.194248] [DEBUG] [LOCAL ] AQNB: Trimmed 5555 records to 4117 (keeping 200 days of data) [2025-10-13T17:17:54.223102] [DEBUG] [LOCAL ] AQNB: Primary data saved (4117 records). [2025-10-13T17:17:54.223229] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-13T17:17:54.223315] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQNB took 22.5s. Estimated remaining: 4h 51m 0s. Rate: 7.7 symbols/min [2025-10-13T17:17:54.399418] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:54.415907] [DEBUG] [LOCAL ] ARDC: Loaded 15383 existing records from primary storage. [2025-10-13T17:17:54.416145] [INFO ] [MAIN ] ARDC: Loaded 15383 existing records. [2025-10-13T17:17:54.594631] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:54.595099] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-13T17:17:54.595166] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-13T17:17:54.595689] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-13T17:17:54.595749] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-13T17:17:54.823105] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-13T17:17:54.963110] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:55.617934] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-13T17:17:55.831703] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T17:17:56.417998] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-13T17:17:56.615579] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T17:17:56.861598] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T17:17:57.217938] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-13T17:17:57.892478] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:17:58.017903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-13T17:17:58.205544] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:17:58.817974] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-13T17:17:59.617895] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-13T17:18:00.013817] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T17:18:00.020056] [INFO ] [REMOTE ] AQN: Full fetch complete (75214 records). [2025-10-13T17:18:00.020244] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-13T17:18:00.417924] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-13T17:18:00.466623] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-13T17:18:00.466827] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-13T17:18:00.467722] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-13T17:18:00.467790] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-13T17:18:00.469683] [DEBUG] [LOCAL ] AQN: Trimmed 75214 records to 51791 (keeping 200 days of data) [2025-10-13T17:18:00.738535] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:18:00.854820] [DEBUG] [LOCAL ] AQN: Primary data saved (51791 records). [2025-10-13T17:18:00.855014] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-13T17:18:00.855104] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AQN took 40.4s. Estimated remaining: 4h 50m 33s. Rate: 7.7 symbols/min [2025-10-13T17:18:01.034410] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:01.067672] [DEBUG] [LOCAL ] ARDT: Loaded 28107 existing records from primary storage. [2025-10-13T17:18:01.068047] [INFO ] [MAIN ] ARDT: Loaded 28107 existing records. [2025-10-13T17:18:01.236942] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-13T17:18:01.243064] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:18:01.289821] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:01.290317] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-13T17:18:01.290436] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-13T17:18:01.302022] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-13T17:18:01.302251] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-13T17:18:01.396333] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:18:01.722736] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:02.017947] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-13T17:18:02.766168] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T17:18:02.817938] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-13T17:18:03.210716] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:18:03.617960] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-13T17:18:03.783300] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T17:18:04.417959] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-13T17:18:05.217916] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-13T17:18:05.323691] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:18:05.608798] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T17:18:06.017993] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-13T17:18:06.249266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:18:06.817968] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-13T17:18:07.617903] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-13T17:18:07.755614] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:18:08.417904] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-13T17:18:08.638512] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T17:18:08.867667] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:18:09.217990] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-13T17:18:09.981587] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:18:10.017884] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-13T17:18:10.817920] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-13T17:18:11.154638] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:18:11.617965] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-13T17:18:11.665891] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:18:11.696710] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T17:18:12.417950] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-13T17:18:12.468392] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T17:18:13.217975] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-13T17:18:13.866312] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T17:18:14.018036] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-13T17:18:14.213998] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:18:14.817967] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-13T17:18:15.419975] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:18:15.556023] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T17:18:15.617930] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-13T17:18:16.417979] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-13T17:18:16.965455] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:18:17.217974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-13T17:18:17.280297] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T17:18:18.017993] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-13T17:18:18.817898] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-13T17:18:18.885085] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:18:19.120336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:18:19.617947] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-13T17:18:20.417898] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-13T17:18:20.495215] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:18:20.593203] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T17:18:21.217917] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-13T17:18:21.368579] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:18:22.017973] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-13T17:18:22.817919] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-13T17:18:22.861533] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:18:22.869165] [INFO ] [REMOTE ] AR: Full fetch complete (77548 records). [2025-10-13T17:18:22.869281] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-13T17:18:23.269351] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-13T17:18:23.269890] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-13T17:18:23.270726] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-13T17:18:23.270790] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-13T17:18:23.272399] [DEBUG] [LOCAL ] AR: Trimmed 77548 records to 53587 (keeping 200 days of data) [2025-10-13T17:18:23.371203] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:18:23.376108] [INFO ] [REMOTE ] ARDC: Full fetch complete (21183 records). [2025-10-13T17:18:23.376498] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-13T17:18:23.377844] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:18:23.378724] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:18:23.378828] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:18:23.381518] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-13T17:18:23.382154] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-13T17:18:23.382501] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-13T17:18:23.383129] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-13T17:18:23.383230] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 29.2s. Estimated remaining: 4h 54m 22s. Rate: 7.6 symbols/min [2025-10-13T17:18:23.565769] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:23.627611] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-13T17:18:23.718169] [DEBUG] [LOCAL ] ARE: Loaded 51530 existing records from primary storage. [2025-10-13T17:18:23.719482] [INFO ] [MAIN ] ARE: Loaded 51530 existing records. [2025-10-13T17:18:23.971453] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:23.972887] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-13T17:18:23.973280] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-13T17:18:23.975757] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-13T17:18:23.976468] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-13T17:18:24.107289] [DEBUG] [LOCAL ] AR: Primary data saved (53587 records). [2025-10-13T17:18:24.113388] [INFO ] [MAIN ] AR: Full history saved. [2025-10-13T17:18:24.129856] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. AR took 41.7s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-13T17:18:24.361612] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:18:24.459840] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-13T17:18:24.577706] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:24.605894] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:24.653923] [DEBUG] [LOCAL ] ARES: Loaded 50417 existing records from primary storage. [2025-10-13T17:18:24.654219] [INFO ] [MAIN ] ARES: Loaded 50417 existing records. [2025-10-13T17:18:24.837359] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:24.837600] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-13T17:18:24.837677] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-13T17:18:24.838168] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-13T17:18:24.838224] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-13T17:18:25.184957] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:25.217908] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-13T17:18:25.329766] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:18:25.470851] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:18:26.017916] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-13T17:18:26.752198] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:18:26.817916] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-13T17:18:27.617909] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-13T17:18:27.871974] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:18:28.337869] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:18:28.417925] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-13T17:18:29.091784] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:18:29.096892] [INFO ] [REMOTE ] ARCO: Full fetch complete (64828 records). [2025-10-13T17:18:29.096999] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-13T17:18:29.097626] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:18:29.097734] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:18:29.097777] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:18:29.097816] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-13T17:18:29.097871] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-13T17:18:29.097907] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-13T17:18:29.097946] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-10-13T17:18:29.098574] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARCO took 42.2s. Estimated remaining: 4h 51m 26s. Rate: 7.7 symbols/min [2025-10-13T17:18:29.223088] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-13T17:18:29.271005] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:29.316956] [DEBUG] [LOCAL ] ARI: Loaded 44298 existing records from primary storage. [2025-10-13T17:18:29.317251] [INFO ] [MAIN ] ARI: Loaded 44298 existing records. [2025-10-13T17:18:29.495265] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:29.495524] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-13T17:18:29.495573] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-13T17:18:29.495897] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-13T17:18:29.495956] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-13T17:18:29.842289] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:29.994359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:18:30.017889] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-13T17:18:30.817914] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-13T17:18:30.862710] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:18:31.617923] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-13T17:18:31.828342] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:18:32.256092] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:18:32.417960] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-13T17:18:32.888943] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:18:33.217971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-13T17:18:33.676069] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:18:33.679573] [INFO ] [REMOTE ] ARDT: Full fetch complete (41556 records). [2025-10-13T17:18:33.679678] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-13T17:18:34.023131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-13T17:18:34.080335] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-13T17:18:34.080453] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-13T17:18:34.081128] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-13T17:18:34.081195] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-13T17:18:34.082637] [DEBUG] [LOCAL ] ARDT: Trimmed 41556 records to 27696 (keeping 200 days of data) [2025-10-13T17:18:34.266269] [DEBUG] [LOCAL ] ARDT: Primary data saved (27696 records). [2025-10-13T17:18:34.266474] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-13T17:18:34.266582] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARDT took 33.4s. Estimated remaining: 4h 50m 36s. Rate: 7.7 symbols/min [2025-10-13T17:18:34.465206] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:34.508825] [DEBUG] [LOCAL ] ARIS: Loaded 43096 existing records from primary storage. [2025-10-13T17:18:34.509256] [INFO ] [MAIN ] ARIS: Loaded 43096 existing records. [2025-10-13T17:18:34.707426] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:34.707970] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-13T17:18:34.708166] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-13T17:18:34.708521] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-13T17:18:34.708609] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-13T17:18:34.818749] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-13T17:18:35.114745] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:35.120259] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T17:18:35.335681] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:18:35.617969] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-13T17:18:36.308167] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:18:36.417924] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-13T17:18:37.138557] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:18:37.217905] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-13T17:18:38.017897] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-13T17:18:38.567871] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-13T17:18:38.714469] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:18:38.817880] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-13T17:18:39.419003] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:18:39.617919] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-13T17:18:40.417904] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-13T17:18:40.506997] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:18:41.225479] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-13T17:18:41.228567] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:18:42.017888] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-13T17:18:42.062252] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:18:42.817901] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-13T17:18:42.909071] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:18:43.617937] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-13T17:18:43.680894] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:18:44.099434] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T17:18:44.417972] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-13T17:18:45.217933] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-13T17:18:46.017973] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-13T17:18:46.109341] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-13T17:18:46.356875] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:18:46.817961] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-13T17:18:47.617953] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-13T17:18:47.929909] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-13T17:18:48.249079] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:18:48.418033] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-13T17:18:48.931771] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-10-13T17:18:49.217940] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-13T17:18:49.650752] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T17:18:49.959510] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:18:50.017889] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-13T17:18:50.817971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-13T17:18:51.618024] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-13T17:18:51.741452] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:18:52.045930] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-13T17:18:52.367328] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:18:52.417924] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-13T17:18:53.183986] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T17:18:53.217928] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-13T17:18:54.022334] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-13T17:18:54.029152] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:18:54.572619] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:18:54.817906] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-13T17:18:55.424553] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T17:18:55.433380] [INFO ] [REMOTE ] ARES: Full fetch complete (70989 records). [2025-10-13T17:18:55.433722] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-13T17:18:55.623601] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-13T17:18:55.884544] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-13T17:18:55.884720] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-13T17:18:55.885565] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-13T17:18:55.885722] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-13T17:18:55.887342] [DEBUG] [LOCAL ] ARES: Trimmed 70989 records to 49688 (keeping 200 days of data) [2025-10-13T17:18:56.021396] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:18:56.247609] [DEBUG] [LOCAL ] ARES: Primary data saved (49688 records). [2025-10-13T17:18:56.247784] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-13T17:18:56.247905] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 32.1s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-13T17:18:56.425768] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-13T17:18:56.428954] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:56.429851] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-13T17:18:56.429901] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-13T17:18:56.430019] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-13T17:18:56.430062] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-13T17:18:56.430103] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-13T17:18:56.430140] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-13T17:18:56.838745] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:56.915753] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T17:18:57.217925] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-13T17:18:57.978848] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:18:58.017893] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-13T17:18:58.515006] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:18:58.817969] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-13T17:18:59.269103] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:18:59.618004] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-13T17:19:00.417953] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-13T17:19:00.496043] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T17:19:01.219637] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-13T17:19:01.222457] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T17:19:01.907091] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:19:01.912312] [INFO ] [REMOTE ] ARI: Full fetch complete (62487 records). [2025-10-13T17:19:01.912550] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-13T17:19:02.023117] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-13T17:19:02.333098] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-13T17:19:02.333226] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-13T17:19:02.334037] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-13T17:19:02.334107] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-13T17:19:02.335978] [DEBUG] [LOCAL ] ARI: Trimmed 62487 records to 43711 (keeping 200 days of data) [2025-10-13T17:19:02.625940] [DEBUG] [LOCAL ] ARI: Primary data saved (43711 records). [2025-10-13T17:19:02.626121] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-13T17:19:02.627024] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 33.5s. Estimated remaining: 4h 53m 37s. Rate: 7.6 symbols/min [2025-10-13T17:19:02.814614] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:02.817961] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-13T17:19:02.873636] [DEBUG] [LOCAL ] ARMK: Loaded 51094 existing records from primary storage. [2025-10-13T17:19:02.874090] [INFO ] [MAIN ] ARMK: Loaded 51094 existing records. [2025-10-13T17:19:03.020156] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:19:03.108494] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:03.108793] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-13T17:19:03.108849] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-13T17:19:03.109373] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-13T17:19:03.109434] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-13T17:19:03.476709] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:03.617932] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-13T17:19:03.775270] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:19:04.130612] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:19:04.417947] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-13T17:19:05.079201] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T17:19:05.084799] [INFO ] [REMOTE ] ARIS: Full fetch complete (61350 records). [2025-10-13T17:19:05.084904] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-13T17:19:05.223046] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-13T17:19:05.496311] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-13T17:19:05.496395] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-13T17:19:05.497060] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-13T17:19:05.497122] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-13T17:19:05.498538] [DEBUG] [LOCAL ] ARIS: Trimmed 61350 records to 42525 (keeping 200 days of data) [2025-10-13T17:19:05.755875] [DEBUG] [LOCAL ] ARIS: Primary data saved (42525 records). [2025-10-13T17:19:05.756009] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-13T17:19:05.756089] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 31.5s. Estimated remaining: 4h 52m 16s. Rate: 7.6 symbols/min [2025-10-13T17:19:05.922747] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:05.967558] [DEBUG] [LOCAL ] AROC: Loaded 49688 existing records from primary storage. [2025-10-13T17:19:05.967917] [INFO ] [MAIN ] AROC: Loaded 49688 existing records. [2025-10-13T17:19:06.029565] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-13T17:19:06.194193] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:06.196495] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:19:06.196698] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-13T17:19:06.206040] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-13T17:19:06.207096] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-13T17:19:06.207161] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-13T17:19:06.722981] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:06.817977] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-13T17:19:07.039369] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:19:07.045730] [INFO ] [REMOTE ] ARE: Full fetch complete (72746 records). [2025-10-13T17:19:07.045932] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-13T17:19:07.601755] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-13T17:19:07.601892] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-13T17:19:07.602741] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-13T17:19:07.602808] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-13T17:19:07.604513] [DEBUG] [LOCAL ] ARE: Trimmed 72746 records to 50891 (keeping 200 days of data) [2025-10-13T17:19:07.663687] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-13T17:19:07.877809] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:19:07.982065] [DEBUG] [LOCAL ] ARE: Primary data saved (50891 records). [2025-10-13T17:19:07.982206] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-13T17:19:07.982295] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARE took 44.6s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-13T17:19:08.158832] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:08.207624] [DEBUG] [LOCAL ] ARR: Loaded 52847 existing records from primary storage. [2025-10-13T17:19:08.207966] [INFO ] [MAIN ] ARR: Loaded 52847 existing records. [2025-10-13T17:19:08.386008] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:08.386320] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-13T17:19:08.386382] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-13T17:19:08.395053] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-13T17:19:08.409247] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-13T17:19:08.423236] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-13T17:19:08.484298] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:19:08.774929] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:09.217981] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-13T17:19:10.000260] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-13T17:19:10.017911] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-13T17:19:10.084927] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:19:10.791665] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T17:19:10.817911] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-13T17:19:11.578453] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:19:11.617879] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-13T17:19:11.908964] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:19:12.417982] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-13T17:19:13.177845] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:19:13.217933] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-13T17:19:14.017987] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-13T17:19:14.626203] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T17:19:14.774865] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-13T17:19:14.817885] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-13T17:19:15.587553] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:19:15.617935] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-13T17:19:16.417931] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-13T17:19:16.512032] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:19:17.219377] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-13T17:19:17.225108] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T17:19:17.944855] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:19:18.017893] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-13T17:19:18.762005] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:19:18.817992] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-13T17:19:19.551841] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:19:19.617946] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-13T17:19:20.417913] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-13T17:19:20.573886] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:19:20.967064] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:19:21.217942] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-13T17:19:22.017962] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-13T17:19:22.387024] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:19:22.608083] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:19:22.817917] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-13T17:19:23.474612] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:19:23.617928] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-13T17:19:24.016522] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:19:24.021585] [INFO ] [REMOTE ] ARLO: Full fetch complete (62905 records). [2025-10-13T17:19:24.021772] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-13T17:19:24.425048] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-13T17:19:24.427092] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-13T17:19:24.427207] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-13T17:19:24.428220] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-13T17:19:24.428421] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-13T17:19:24.430150] [DEBUG] [LOCAL ] ARLO: Trimmed 62905 records to 43759 (keeping 200 days of data) [2025-10-13T17:19:24.706830] [DEBUG] [LOCAL ] ARLO: Primary data saved (43759 records). [2025-10-13T17:19:24.707056] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-13T17:19:24.707165] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARLO took 28.5s. Estimated remaining: 4h 52m 48s. Rate: 7.6 symbols/min [2025-10-13T17:19:24.886951] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:24.930155] [DEBUG] [LOCAL ] ARW: Loaded 33344 existing records from primary storage. [2025-10-13T17:19:24.930535] [INFO ] [MAIN ] ARW: Loaded 33344 existing records. [2025-10-13T17:19:25.134375] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:25.134942] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-13T17:19:25.135117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-13T17:19:25.135564] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-13T17:19:25.135635] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-13T17:19:25.228814] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-13T17:19:25.476023] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:19:25.588707] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:26.017980] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-13T17:19:26.049017] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:19:26.818012] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-13T17:19:27.188129] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:19:27.617977] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-13T17:19:27.672213] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:19:28.026147] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:19:28.417956] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-13T17:19:29.088195] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:19:29.217973] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-13T17:19:29.733001] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:19:30.017993] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-13T17:19:30.800690] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T17:19:30.817880] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-13T17:19:31.378545] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:19:31.617978] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-13T17:19:32.284566] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:19:32.417939] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-13T17:19:33.217903] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-13T17:19:33.451112] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:19:33.565745] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:19:34.017946] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-13T17:19:34.753385] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:19:34.759010] [INFO ] [REMOTE ] AROC: Full fetch complete (71009 records). [2025-10-13T17:19:34.759221] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-13T17:19:34.825275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-13T17:19:35.160948] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-13T17:19:35.161048] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-13T17:19:35.161857] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-13T17:19:35.161922] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-13T17:19:35.163674] [DEBUG] [LOCAL ] AROC: Trimmed 71009 records to 48999 (keeping 200 days of data) [2025-10-13T17:19:35.479019] [DEBUG] [LOCAL ] AROC: Primary data saved (48999 records). [2025-10-13T17:19:35.479232] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-13T17:19:35.479344] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 29.7s. Estimated remaining: 4h 53m 24s. Rate: 7.6 symbols/min [2025-10-13T17:19:35.618379] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-13T17:19:35.667636] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:35.668136] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-13T17:19:35.668221] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-13T17:19:35.668347] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-13T17:19:35.668392] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-13T17:19:35.668435] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-13T17:19:35.668470] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-13T17:19:35.975029] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:19:36.127089] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:36.417991] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-13T17:19:36.640283] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:19:36.640855] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-13T17:19:36.640975] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:19:36.641045] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-13T17:19:36.641116] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:19:36.641204] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-13T17:19:36.641307] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-13T17:19:36.641354] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-13T17:19:36.641397] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-13T17:19:36.641450] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARX took 1.2s. Estimated remaining: 4h 51m 35s. Rate: 7.6 symbols/min [2025-10-13T17:19:36.816614] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:36.817987] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-13T17:19:36.818089] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-13T17:19:36.818278] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-13T17:19:36.818503] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-13T17:19:36.818583] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-13T17:19:36.818766] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-13T17:19:36.971522] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T17:19:37.223073] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-13T17:19:37.257121] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:37.301730] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:19:38.017925] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-13T17:19:38.817973] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-13T17:19:39.213379] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T17:19:39.617952] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-13T17:19:39.817983] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:19:40.417971] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-13T17:19:40.477288] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:19:41.217978] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-13T17:19:41.610501] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:19:41.828293] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:19:42.017961] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-13T17:19:42.659833] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:19:42.665364] [INFO ] [REMOTE ] ARMK: Full fetch complete (72699 records). [2025-10-13T17:19:42.665480] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-13T17:19:42.823084] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-13T17:19:43.076402] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-13T17:19:43.076520] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-13T17:19:43.077351] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-13T17:19:43.077421] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-13T17:19:43.079504] [DEBUG] [LOCAL ] ARMK: Trimmed 72699 records to 50343 (keeping 200 days of data) [2025-10-13T17:19:43.420553] [DEBUG] [LOCAL ] ARMK: Primary data saved (50343 records). [2025-10-13T17:19:43.421056] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-13T17:19:43.421164] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARMK took 40.8s. Estimated remaining: 4h 51m 11s. Rate: 7.6 symbols/min [2025-10-13T17:19:43.567667] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:19:43.630307] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-13T17:19:43.637549] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:43.655770] [DEBUG] [LOCAL ] ASA: Loaded 15035 existing records from primary storage. [2025-10-13T17:19:43.656046] [INFO ] [MAIN ] ASA: Loaded 15035 existing records. [2025-10-13T17:19:43.836470] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:43.836826] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-13T17:19:43.836925] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-13T17:19:43.837325] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-13T17:19:43.837402] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-13T17:19:44.232202] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:44.417903] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-13T17:19:44.888473] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:19:45.134209] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T17:19:45.217921] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-13T17:19:45.328004] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T17:19:46.017942] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-13T17:19:46.325016] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T17:19:46.817964] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-13T17:19:47.618132] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T17:19:47.618272] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-13T17:19:47.785732] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:19:48.417957] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-13T17:19:48.972422] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:19:49.162322] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T17:19:49.217924] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-13T17:19:49.972169] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:19:50.017908] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-13T17:19:50.817935] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-13T17:19:51.617973] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-13T17:19:51.756160] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:19:52.417944] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-13T17:19:52.431365] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:19:52.461863] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:19:52.467530] [INFO ] [REMOTE ] ARR: Full fetch complete (75281 records). [2025-10-13T17:19:52.467731] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-13T17:19:52.857440] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-13T17:19:52.857792] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-13T17:19:52.858600] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-13T17:19:52.858704] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-13T17:19:52.861929] [DEBUG] [LOCAL ] ARR: Trimmed 75281 records to 52091 (keeping 200 days of data) [2025-10-13T17:19:53.174054] [DEBUG] [LOCAL ] ARR: Primary data saved (52091 records). [2025-10-13T17:19:53.174190] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-13T17:19:53.174268] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARR took 45.2s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-13T17:19:53.228211] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-13T17:19:53.345627] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:53.402267] [DEBUG] [LOCAL ] ASAN: Loaded 53501 existing records from primary storage. [2025-10-13T17:19:53.402566] [INFO ] [MAIN ] ASAN: Loaded 53501 existing records. [2025-10-13T17:19:53.581082] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:53.581309] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-13T17:19:53.581365] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-13T17:19:53.581951] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-13T17:19:53.582017] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-13T17:19:53.935632] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:53.959659] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:19:54.018006] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-13T17:19:54.106429] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T17:19:54.817945] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-13T17:19:55.617970] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-13T17:19:56.144796] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T17:19:56.237239] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:19:56.290975] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:19:56.417931] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-13T17:19:57.173284] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T17:19:57.217890] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-13T17:19:57.942259] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T17:19:58.017938] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-13T17:19:58.817960] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-13T17:19:59.065596] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:19:59.617942] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-13T17:20:00.424896] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-13T17:20:00.434052] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:20:01.030445] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:20:01.034626] [INFO ] [REMOTE ] ARW: Full fetch complete (48124 records). [2025-10-13T17:20:01.034832] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-13T17:20:01.228271] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-13T17:20:01.469960] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-13T17:20:01.470076] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-13T17:20:01.470732] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-13T17:20:01.470804] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-13T17:20:01.472403] [DEBUG] [LOCAL ] ARW: Trimmed 48124 records to 33011 (keeping 200 days of data) [2025-10-13T17:20:01.696340] [DEBUG] [LOCAL ] ARW: Primary data saved (33011 records). [2025-10-13T17:20:01.696555] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-13T17:20:01.697821] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 37.0s. Estimated remaining: 4h 51m 32s. Rate: 7.6 symbols/min [2025-10-13T17:20:01.902903] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:01.962021] [DEBUG] [LOCAL ] ASB: Loaded 50308 existing records from primary storage. [2025-10-13T17:20:01.962503] [INFO ] [MAIN ] ASB: Loaded 50308 existing records. [2025-10-13T17:20:02.018705] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-13T17:20:02.173844] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:02.174218] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-13T17:20:02.174275] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-13T17:20:02.174755] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-13T17:20:02.174815] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-13T17:20:02.650931] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T17:20:02.655671] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:02.817956] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-13T17:20:02.940453] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:20:03.129995] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:20:03.133071] [INFO ] [REMOTE ] ASA: Full fetch complete (19744 records). [2025-10-13T17:20:03.133185] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-13T17:20:03.544482] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-13T17:20:03.544594] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-13T17:20:03.544972] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-13T17:20:03.545036] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-13T17:20:03.546080] [DEBUG] [LOCAL ] ASA: Trimmed 19744 records to 14963 (keeping 200 days of data) [2025-10-13T17:20:03.618039] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-13T17:20:03.642373] [DEBUG] [LOCAL ] ASA: Primary data saved (14963 records). [2025-10-13T17:20:03.642613] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-13T17:20:03.642748] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 20.2s. Estimated remaining: 4h 49m 58s. Rate: 7.6 symbols/min [2025-10-13T17:20:03.834415] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:03.840352] [DEBUG] [LOCAL ] ASBA: Loaded 3495 existing records from primary storage. [2025-10-13T17:20:03.840593] [INFO ] [MAIN ] ASBA: Loaded 3495 existing records. [2025-10-13T17:20:04.038889] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:04.039249] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-13T17:20:04.039306] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-13T17:20:04.039490] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-13T17:20:04.039528] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-13T17:20:04.423309] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-13T17:20:04.459822] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:04.641330] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T17:20:05.217894] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-13T17:20:05.327128] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:20:06.009579] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T17:20:06.020242] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-13T17:20:06.817989] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-13T17:20:06.862975] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:20:07.617897] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-13T17:20:07.892868] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:20:08.417902] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-13T17:20:08.500996] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:20:09.027913] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T17:20:09.217951] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-13T17:20:10.017950] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-13T17:20:10.253231] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:20:10.817900] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-13T17:20:10.887461] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:20:11.617929] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-13T17:20:11.757450] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:20:12.285442] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:20:12.417962] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-13T17:20:12.735124] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:20:13.217939] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-13T17:20:13.924991] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:20:14.017981] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-13T17:20:14.817960] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-13T17:20:15.096048] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:20:15.102815] [INFO ] [REMOTE ] AS: Full fetch complete (76583 records). [2025-10-13T17:20:15.103026] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-13T17:20:15.444445] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T17:20:15.528129] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-13T17:20:15.528327] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-13T17:20:15.529218] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-13T17:20:15.529436] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-13T17:20:15.558778] [DEBUG] [LOCAL ] AS: Trimmed 76583 records to 53163 (keeping 200 days of data) [2025-10-13T17:20:15.561063] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:20:15.622336] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-13T17:20:15.879337] [DEBUG] [LOCAL ] AS: Primary data saved (53163 records). [2025-10-13T17:20:15.879476] [INFO ] [MAIN ] AS: Full history saved. [2025-10-13T17:20:15.879546] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. AS took 39.2s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-13T17:20:16.050932] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:16.089968] [DEBUG] [LOCAL ] ASC: Loaded 37942 existing records from primary storage. [2025-10-13T17:20:16.090311] [INFO ] [MAIN ] ASC: Loaded 37942 existing records. [2025-10-13T17:20:16.265344] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:16.265553] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-13T17:20:16.265599] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-13T17:20:16.266026] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-13T17:20:16.266078] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-13T17:20:16.426728] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-13T17:20:16.624281] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:17.087380] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:20:17.217936] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-13T17:20:17.512855] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T17:20:18.017991] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-13T17:20:18.817975] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-13T17:20:18.914828] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T17:20:19.596222] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-13T17:20:19.617896] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-13T17:20:20.417952] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-13T17:20:20.894393] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:20:20.898394] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-13T17:20:21.207122] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T17:20:21.217881] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-13T17:20:22.017923] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-13T17:20:22.731120] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:20:22.817887] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-13T17:20:23.592472] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:20:23.617899] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-13T17:20:24.320584] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:20:24.417975] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-13T17:20:25.137521] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:20:25.217948] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-13T17:20:25.832506] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:20:26.017996] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-13T17:20:26.464949] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:20:26.619841] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:20:26.817902] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-13T17:20:27.370352] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-13T17:20:27.617947] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-13T17:20:28.418020] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-13T17:20:28.985936] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:20:29.154715] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:20:29.160899] [INFO ] [REMOTE ] ASB: Full fetch complete (71772 records). [2025-10-13T17:20:29.161067] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-13T17:20:29.228252] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-13T17:20:29.582051] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-13T17:20:29.582188] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-13T17:20:29.583075] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-13T17:20:29.583140] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-13T17:20:29.585026] [DEBUG] [LOCAL ] ASB: Trimmed 71772 records to 49582 (keeping 200 days of data) [2025-10-13T17:20:29.784099] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:20:29.907874] [DEBUG] [LOCAL ] ASB: Primary data saved (49582 records). [2025-10-13T17:20:29.908077] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-13T17:20:29.908848] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 28.2s. Estimated remaining: 4h 52m 14s. Rate: 7.6 symbols/min [2025-10-13T17:20:30.023104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-13T17:20:30.091709] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:30.113834] [DEBUG] [LOCAL ] ASG: Loaded 19812 existing records from primary storage. [2025-10-13T17:20:30.114171] [INFO ] [MAIN ] ASG: Loaded 19812 existing records. [2025-10-13T17:20:30.300764] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:30.301076] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-13T17:20:30.301130] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-13T17:20:30.301421] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-13T17:20:30.301480] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-13T17:20:30.416984] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T17:20:30.676323] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:30.817935] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-13T17:20:31.380906] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:20:31.381832] [INFO ] [REMOTE ] ASBA: Full fetch complete (5214 records). [2025-10-13T17:20:31.381901] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-13T17:20:31.623196] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-13T17:20:31.735597] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-13T17:20:31.735690] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-13T17:20:31.735851] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-13T17:20:31.735891] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-13T17:20:31.736236] [DEBUG] [LOCAL ] ASBA: Trimmed 5214 records to 3450 (keeping 200 days of data) [2025-10-13T17:20:31.757694] [DEBUG] [LOCAL ] ASBA: Primary data saved (3450 records). [2025-10-13T17:20:31.757769] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-13T17:20:31.757838] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 28.1s. Estimated remaining: 4h 50m 40s. Rate: 7.6 symbols/min [2025-10-13T17:20:31.925745] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:31.949194] [DEBUG] [LOCAL ] ASGI: Loaded 23095 existing records from primary storage. [2025-10-13T17:20:31.949426] [INFO ] [MAIN ] ASGI: Loaded 23095 existing records. [2025-10-13T17:20:32.122281] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:32.122530] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-13T17:20:32.122600] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-13T17:20:32.122940] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-13T17:20:32.123020] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-13T17:20:32.423137] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-13T17:20:32.475899] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:32.655574] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:20:33.217937] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-13T17:20:33.605864] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T17:20:34.017898] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-13T17:20:34.279991] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:20:34.817998] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-13T17:20:35.494719] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:20:35.617931] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-13T17:20:35.811244] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T17:20:36.417939] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-13T17:20:36.820282] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:20:37.217964] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-13T17:20:38.017921] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-13T17:20:38.279260] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:20:38.447388] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T17:20:38.818024] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-13T17:20:39.043094] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:20:39.617900] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-13T17:20:39.707978] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:20:40.417960] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-13T17:20:41.217951] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-13T17:20:41.443339] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:20:41.492106] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:20:42.017942] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-13T17:20:42.376945] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:20:42.817984] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-13T17:20:43.617990] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-13T17:20:43.690675] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T17:20:43.696126] [INFO ] [REMOTE ] ASAN: Full fetch complete (76525 records). [2025-10-13T17:20:43.696251] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-13T17:20:44.095173] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-13T17:20:44.095313] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-13T17:20:44.096145] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-13T17:20:44.096227] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-13T17:20:44.097841] [DEBUG] [LOCAL ] ASAN: Trimmed 76525 records to 52724 (keeping 200 days of data) [2025-10-13T17:20:44.418791] [DEBUG] [LOCAL ] ASAN: Primary data saved (52724 records). [2025-10-13T17:20:44.418639] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-13T17:20:44.419200] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-13T17:20:44.438619] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASAN took 51.3s. Estimated remaining: 4h 51m 40s. Rate: 7.6 symbols/min [2025-10-13T17:20:44.443488] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T17:20:44.535663] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:20:45.217981] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-13T17:20:45.633095] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:20:46.017922] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-13T17:20:46.242804] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:20:46.817898] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-13T17:20:46.874393] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T17:20:47.617899] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-13T17:20:47.865453] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:20:48.417921] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-13T17:20:48.609384] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:20:49.217939] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-13T17:20:49.412393] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T17:20:50.017910] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-13T17:20:50.321199] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:20:50.817969] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-13T17:20:51.166728] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T17:20:51.617917] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-13T17:20:51.720550] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T17:20:51.722789] [INFO ] [REMOTE ] ASG: Full fetch complete (30895 records). [2025-10-13T17:20:51.722905] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-13T17:20:52.167893] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-13T17:20:52.167992] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-13T17:20:52.168500] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-13T17:20:52.168564] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-13T17:20:52.169520] [DEBUG] [LOCAL ] ASG: Trimmed 30895 records to 19522 (keeping 200 days of data) [2025-10-13T17:20:52.288744] [DEBUG] [LOCAL ] ASG: Primary data saved (19522 records). [2025-10-13T17:20:52.289025] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-13T17:20:52.289200] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 22.4s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-13T17:20:52.417934] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-13T17:20:52.991345] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:20:53.217932] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-13T17:20:53.568181] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:20:54.017913] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-13T17:20:54.603230] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:20:54.609582] [INFO ] [REMOTE ] ASC: Full fetch complete (56212 records). [2025-10-13T17:20:54.609894] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-13T17:20:55.136950] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:20:55.182978] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-13T17:20:55.231378] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-13T17:20:55.231483] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-13T17:20:55.232105] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-13T17:20:55.232169] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-13T17:20:55.233426] [DEBUG] [LOCAL ] ASC: Trimmed 56212 records to 37351 (keeping 200 days of data) [2025-10-13T17:20:55.463086] [DEBUG] [LOCAL ] ASC: Primary data saved (37351 records). [2025-10-13T17:20:55.463283] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-13T17:20:55.463393] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASC took 39.6s. Estimated remaining: 4h 50m 17s. Rate: 7.6 symbols/min [2025-10-13T17:20:56.346047] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:20:56.351797] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-13T17:20:57.431230] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:20:57.436637] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-13T17:20:58.440225] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T17:20:58.446784] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-13T17:20:59.588286] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:20:59.591001] [INFO ] [REMOTE ] ASGI: Full fetch complete (33306 records). [2025-10-13T17:20:59.591078] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-13T17:20:59.951554] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-13T17:20:59.951630] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-13T17:20:59.952060] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-13T17:20:59.952112] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-13T17:20:59.952906] [DEBUG] [LOCAL ] ASGI: Trimmed 33306 records to 22835 (keeping 200 days of data) [2025-10-13T17:21:00.092282] [DEBUG] [LOCAL ] ASGI: Primary data saved (22835 records). [2025-10-13T17:21:00.092402] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-13T17:21:00.092480] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGI took 28.3s. Estimated remaining: 4h 49m 25s. Rate: 7.6 symbols/min [2025-10-13T17:21:00.772940] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.738931] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.821452] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.818453] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.845815] [DEBUG] [LOCAL ] ASIX: Loaded 23212 existing records from primary storage. [2025-10-13T17:21:00.846165] [INFO ] [MAIN ] ASIX: Loaded 23212 existing records. [2025-10-13T17:21:01.001624] [DEBUG] [LOCAL ] ASGN: Loaded 36896 existing records from primary storage. [2025-10-13T17:21:01.013140] [DEBUG] [LOCAL ] ASH: Loaded 38182 existing records from primary storage. [2025-10-13T17:21:01.013311] [INFO ] [MAIN ] ASGN: Loaded 36896 existing records. [2025-10-13T17:21:01.049349] [INFO ] [MAIN ] ASH: Loaded 38182 existing records. [2025-10-13T17:21:01.216904] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.268930] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.283015] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-13T17:21:01.294418] [DEBUG] [LOCAL ] ASPN: Loaded 50499 existing records from primary storage. [2025-10-13T17:21:01.299872] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-13T17:21:01.335811] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-13T17:21:01.354397] [INFO ] [MAIN ] ASPN: Loaded 50499 existing records. [2025-10-13T17:21:01.604611] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.644425] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.668886] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.669130] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.697203] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-13T17:21:01.728509] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-13T17:21:01.751722] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-13T17:21:01.778087] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-13T17:21:01.787074] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.787188] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-13T17:21:01.787349] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-13T17:21:01.798355] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.818349] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-13T17:21:01.939856] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-13T17:21:02.067783] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-13T17:21:02.706051] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:02.745360] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-13T17:21:03.038424] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.074450] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-13T17:21:03.068899] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.081066] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-13T17:21:03.178035] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.178408] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-13T17:21:03.958862] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:21:03.962426] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-13T17:21:04.241697] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:21:04.250096] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-13T17:21:04.496706] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:21:04.505455] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-13T17:21:04.621744] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T17:21:04.625980] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-13T17:21:04.832906] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:21:04.843269] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-13T17:21:05.247818] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T17:21:05.251605] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-13T17:21:05.546725] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T17:21:05.576126] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:21:06.017915] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-13T17:21:06.327470] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T17:21:06.749292] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T17:21:06.817928] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-13T17:21:07.559141] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:21:07.617929] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-13T17:21:08.417932] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-13T17:21:08.623419] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T17:21:08.895701] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:21:09.217905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-13T17:21:09.474813] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:21:10.017949] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-13T17:21:10.477784] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:21:10.818004] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-13T17:21:11.617962] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-13T17:21:11.744286] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:21:11.886143] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:21:12.417951] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-13T17:21:12.823627] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T17:21:13.217939] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-13T17:21:13.923432] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:21:14.017898] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-13T17:21:14.817918] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-13T17:21:14.972217] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:21:15.376201] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:21:15.617985] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-13T17:21:16.099574] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:21:16.417933] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-13T17:21:17.217962] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-13T17:21:17.495211] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T17:21:17.530758] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:21:18.017977] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-13T17:21:18.480149] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:21:18.817983] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-13T17:21:19.508464] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:21:19.617943] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-13T17:21:19.839993] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:21:20.418010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-13T17:21:20.999709] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T17:21:21.217895] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-13T17:21:21.604532] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:21:22.017942] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-13T17:21:22.238285] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T17:21:22.817946] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-13T17:21:23.483792] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:21:23.617996] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-13T17:21:24.417963] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-13T17:21:25.217935] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-13T17:21:25.321361] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:21:25.781697] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:21:25.785847] [INFO ] [REMOTE ] ASH: Full fetch complete (55218 records). [2025-10-13T17:21:25.785945] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-13T17:21:26.025008] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-13T17:21:26.173206] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-13T17:21:26.173292] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-13T17:21:26.173921] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-13T17:21:26.173985] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-13T17:21:26.175194] [DEBUG] [LOCAL ] ASH: Trimmed 55218 records to 37545 (keeping 200 days of data) [2025-10-13T17:21:26.393742] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T17:21:26.426046] [DEBUG] [LOCAL ] ASH: Primary data saved (37545 records). [2025-10-13T17:21:26.426194] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-13T17:21:26.427051] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASH took 26.3s. Estimated remaining: 4h 53m 31s. Rate: 7.5 symbols/min [2025-10-13T17:21:26.600879] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:26.614393] [DEBUG] [LOCAL ] ASR: Loaded 9416 existing records from primary storage. [2025-10-13T17:21:26.614623] [INFO ] [MAIN ] ASR: Loaded 9416 existing records. [2025-10-13T17:21:26.787607] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:26.787830] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-13T17:21:26.787876] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-13T17:21:26.788060] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-13T17:21:26.788116] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-13T17:21:26.823009] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-13T17:21:27.143009] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:27.532529] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (4.71 seconds). [2025-10-13T17:21:27.617891] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-13T17:21:27.826886] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:21:27.914926] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:21:28.417913] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-13T17:21:28.796975] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:21:29.217953] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-13T17:21:29.267755] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T17:21:30.017935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-13T17:21:30.602354] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T17:21:30.817899] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-13T17:21:30.880511] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:21:31.414295] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:21:31.617927] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-13T17:21:32.371138] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:21:32.417923] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-13T17:21:33.217994] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-13T17:21:33.857377] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:21:34.018005] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-13T17:21:34.817928] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-13T17:21:35.044391] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T17:21:35.047254] [INFO ] [REMOTE ] ASIX: Full fetch complete (30612 records). [2025-10-13T17:21:35.047334] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-13T17:21:35.413639] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-13T17:21:35.413760] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-13T17:21:35.414130] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-13T17:21:35.414171] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-13T17:21:35.414953] [DEBUG] [LOCAL ] ASIX: Trimmed 30612 records to 22959 (keeping 200 days of data) [2025-10-13T17:21:35.551633] [DEBUG] [LOCAL ] ASIX: Primary data saved (22959 records). [2025-10-13T17:21:35.551780] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-13T17:21:35.551857] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 35.4s. Estimated remaining: 4h 53m 38s. Rate: 7.5 symbols/min [2025-10-13T17:21:35.629500] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-13T17:21:35.703946] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-13T17:21:35.759530] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:35.766831] [INFO ] [REMOTE ] ASPN: Full fetch complete (72448 records). [2025-10-13T17:21:35.766575] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T17:21:35.767163] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-13T17:21:36.203335] [DEBUG] [LOCAL ] ASX: Loaded 53634 existing records from primary storage. [2025-10-13T17:21:36.203733] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-13T17:21:36.204034] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-13T17:21:36.204236] [INFO ] [MAIN ] ASX: Loaded 53634 existing records. [2025-10-13T17:21:36.205166] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-13T17:21:36.262981] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-13T17:21:36.319230] [DEBUG] [LOCAL ] ASPN: Trimmed 72448 records to 49849 (keeping 200 days of data) [2025-10-13T17:21:36.457031] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:36.457382] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-13T17:21:36.485277] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-13T17:21:36.489416] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-13T17:21:36.491030] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-13T17:21:36.492811] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-13T17:21:37.002660] [DEBUG] [LOCAL ] ASPN: Primary data saved (49849 records). [2025-10-13T17:21:37.002982] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-13T17:21:37.014221] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 36.9s. Estimated remaining: 4h 52m 2s. Rate: 7.6 symbols/min [2025-10-13T17:21:37.182059] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:37.222892] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-13T17:21:37.280575] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:37.282453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:21:37.312145] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:21:37.352819] [DEBUG] [LOCAL ] ATEN: Loaded 39300 existing records from primary storage. [2025-10-13T17:21:37.353150] [INFO ] [MAIN ] ATEN: Loaded 39300 existing records. [2025-10-13T17:21:37.524226] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:37.524462] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-13T17:21:37.524509] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-13T17:21:37.524844] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-13T17:21:37.524909] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-13T17:21:37.870714] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:38.017903] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-13T17:21:38.818045] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-13T17:21:39.086844] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:21:39.159421] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T17:21:39.617955] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-13T17:21:39.764734] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:21:40.417966] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-13T17:21:41.217943] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-13T17:21:41.435156] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:21:41.540572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T17:21:41.545220] [INFO ] [REMOTE ] ASGN: Full fetch complete (52823 records). [2025-10-13T17:21:41.545358] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-13T17:21:41.972018] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-13T17:21:41.972115] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-13T17:21:41.972711] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-13T17:21:41.972775] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-13T17:21:41.974008] [DEBUG] [LOCAL ] ASGN: Trimmed 52823 records to 36450 (keeping 200 days of data) [2025-10-13T17:21:42.020738] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-13T17:21:42.195181] [DEBUG] [LOCAL ] ASGN: Primary data saved (36450 records). [2025-10-13T17:21:42.195357] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-13T17:21:42.195760] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASGN took 42.1s. Estimated remaining: 4h 51m 17s. Rate: 7.6 symbols/min [2025-10-13T17:21:42.385621] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:42.420401] [DEBUG] [LOCAL ] ATGE: Loaded 31480 existing records from primary storage. [2025-10-13T17:21:42.420740] [INFO ] [MAIN ] ATGE: Loaded 31480 existing records. [2025-10-13T17:21:42.609197] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:42.609583] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-13T17:21:42.610061] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-13T17:21:42.610665] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-13T17:21:42.610730] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-13T17:21:42.740724] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:21:42.823255] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-13T17:21:43.005123] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:43.617918] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-13T17:21:43.860032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T17:21:44.348807] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:21:44.417945] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-13T17:21:45.070933] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:21:45.217961] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-13T17:21:46.017954] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-13T17:21:46.325506] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:21:46.400903] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:21:46.771331] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:21:46.817969] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-13T17:21:47.617924] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-13T17:21:48.417889] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-13T17:21:48.469841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T17:21:49.217905] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-13T17:21:49.250526] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:21:49.738396] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:21:50.017938] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-13T17:21:50.817921] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-13T17:21:51.125942] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T17:21:51.200040] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T17:21:51.617934] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-13T17:21:52.333821] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:21:52.417910] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-13T17:21:52.471453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T17:21:53.217918] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-13T17:21:53.867174] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T17:21:54.017919] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-13T17:21:54.326213] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:21:54.817935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-13T17:21:55.418393] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T17:21:55.617890] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-13T17:21:55.697081] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T17:21:56.417924] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-13T17:21:57.217955] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-13T17:21:57.326037] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:21:57.922687] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:21:57.924195] [INFO ] [REMOTE ] ASR: Full fetch complete (12337 records). [2025-10-13T17:21:57.924271] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-13T17:21:58.023243] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-13T17:21:58.109744] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T17:21:58.322169] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-13T17:21:58.322245] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-13T17:21:58.322500] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-13T17:21:58.322561] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-13T17:21:58.323038] [DEBUG] [LOCAL ] ASR: Trimmed 12337 records to 9350 (keeping 200 days of data) [2025-10-13T17:21:58.381536] [DEBUG] [LOCAL ] ASR: Primary data saved (9350 records). [2025-10-13T17:21:58.381683] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-13T17:21:58.381820] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASR took 32.0s. Estimated remaining: 4h 52m 60s. Rate: 7.5 symbols/min [2025-10-13T17:21:58.548876] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:58.584743] [DEBUG] [LOCAL ] ATHM: Loaded 32282 existing records from primary storage. [2025-10-13T17:21:58.585002] [INFO ] [MAIN ] ATHM: Loaded 32282 existing records. [2025-10-13T17:21:58.760393] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:58.760597] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-13T17:21:58.760663] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-13T17:21:58.761040] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-13T17:21:58.761097] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-13T17:21:58.823328] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-13T17:21:59.117813] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:59.376767] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:21:59.617925] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-13T17:22:00.205990] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:22:00.417944] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-13T17:22:01.217902] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-13T17:22:01.423999] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:22:01.775824] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:22:02.017946] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-13T17:22:02.817914] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-13T17:22:03.324511] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T17:22:03.386601] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:22:03.617988] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-13T17:22:04.127718] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T17:22:04.417951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-13T17:22:05.131088] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:22:05.217917] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-13T17:22:06.023036] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-13T17:22:06.039578] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:22:06.629908] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:22:06.633611] [INFO ] [REMOTE ] ATEN: Full fetch complete (56793 records). [2025-10-13T17:22:06.633770] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-13T17:22:06.820406] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-13T17:22:07.034753] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-13T17:22:07.034843] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-13T17:22:07.035474] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-13T17:22:07.035519] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-13T17:22:07.037080] [DEBUG] [LOCAL ] ATEN: Trimmed 56793 records to 38519 (keeping 200 days of data) [2025-10-13T17:22:07.176729] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T17:22:07.302568] [DEBUG] [LOCAL ] ATEN: Primary data saved (38519 records). [2025-10-13T17:22:07.302744] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-13T17:22:07.303676] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 30.3s. Estimated remaining: 4h 53m 4s. Rate: 7.5 symbols/min [2025-10-13T17:22:07.469264] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:07.478605] [DEBUG] [LOCAL ] ATHS: Loaded 6841 existing records from primary storage. [2025-10-13T17:22:07.478845] [INFO ] [MAIN ] ATHS: Loaded 6841 existing records. [2025-10-13T17:22:07.628272] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-13T17:22:07.661740] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:07.661990] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-13T17:22:07.662041] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-13T17:22:07.662204] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-13T17:22:07.662263] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-13T17:22:08.032592] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:08.417986] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-13T17:22:08.677707] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:22:08.896871] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T17:22:09.217951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-13T17:22:09.236633] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T17:22:10.017956] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-13T17:22:10.661389] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T17:22:10.817967] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-13T17:22:11.015284] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T17:22:11.021131] [INFO ] [REMOTE ] ASX: Full fetch complete (76585 records). [2025-10-13T17:22:11.021299] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-13T17:22:11.418967] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-13T17:22:11.419050] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-13T17:22:11.419810] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-13T17:22:11.419873] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-13T17:22:11.421545] [DEBUG] [LOCAL ] ASX: Trimmed 76585 records to 52872 (keeping 200 days of data) [2025-10-13T17:22:11.516032] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:22:11.635010] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-13T17:22:11.746559] [DEBUG] [LOCAL ] ASX: Primary data saved (52872 records). [2025-10-13T17:22:11.746733] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-13T17:22:11.746822] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ASX took 36.2s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-13T17:22:11.923128] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:11.971508] [DEBUG] [LOCAL ] ATI: Loaded 52075 existing records from primary storage. [2025-10-13T17:22:11.971861] [INFO ] [MAIN ] ATI: Loaded 52075 existing records. [2025-10-13T17:22:12.153482] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:12.153710] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-13T17:22:12.153781] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-13T17:22:12.154251] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-13T17:22:12.154307] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-13T17:22:12.426978] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-13T17:22:12.512677] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:13.031004] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:22:13.217918] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-13T17:22:13.607557] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:22:13.610528] [INFO ] [REMOTE ] ATGE: Full fetch complete (45893 records). [2025-10-13T17:22:13.610602] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-13T17:22:14.001515] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-13T17:22:14.001591] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-13T17:22:14.002109] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-13T17:22:14.002172] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-13T17:22:14.003083] [DEBUG] [LOCAL ] ATGE: Trimmed 45893 records to 31039 (keeping 200 days of data) [2025-10-13T17:22:14.052045] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-13T17:22:14.189196] [DEBUG] [LOCAL ] ATGE: Primary data saved (31039 records). [2025-10-13T17:22:14.189342] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-13T17:22:14.189422] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATGE took 32.0s. Estimated remaining: 4h 50m 50s. Rate: 7.6 symbols/min [2025-10-13T17:22:14.358856] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:14.359065] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-10-13T17:22:14.359138] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-10-13T17:22:14.359366] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-13T17:22:14.359527] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-13T17:22:14.359611] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-13T17:22:14.359703] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-13T17:22:14.489417] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:22:14.759438] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:14.755011] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:22:14.817890] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-13T17:22:15.617912] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-13T17:22:16.231905] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:22:16.310012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:22:16.417928] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-13T17:22:17.217970] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-13T17:22:17.903023] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T17:22:17.961333] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:22:18.017911] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-13T17:22:18.817937] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-13T17:22:19.581016] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:22:19.618337] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-13T17:22:19.619896] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T17:22:20.418001] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-13T17:22:21.217932] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-13T17:22:21.351331] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:22:21.595261] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T17:22:21.915105] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T17:22:22.018048] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-13T17:22:22.718970] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:22:22.817965] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-13T17:22:23.617952] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-13T17:22:24.269913] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:22:24.359772] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:22:24.417925] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-13T17:22:25.217951] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-13T17:22:26.018006] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-13T17:22:26.057613] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:22:26.780605] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:22:26.817942] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-13T17:22:27.174305] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:22:27.617955] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-13T17:22:28.295012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:22:28.309676] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T17:22:28.311004] [INFO ] [REMOTE ] ATHS: Full fetch complete (9682 records). [2025-10-13T17:22:28.311083] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-13T17:22:28.420257] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-13T17:22:28.695684] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-13T17:22:28.695797] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-13T17:22:28.696089] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-13T17:22:28.696129] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-13T17:22:28.696608] [DEBUG] [LOCAL ] ATHS: Trimmed 9682 records to 6739 (keeping 200 days of data) [2025-10-13T17:22:28.740584] [DEBUG] [LOCAL ] ATHS: Primary data saved (6739 records). [2025-10-13T17:22:28.740793] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-13T17:22:28.740900] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 21.4s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-13T17:22:28.920248] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:28.968796] [DEBUG] [LOCAL ] ATMU: Loaded 39700 existing records from primary storage. [2025-10-13T17:22:28.969228] [INFO ] [MAIN ] ATMU: Loaded 39700 existing records. [2025-10-13T17:22:29.189460] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:29.190541] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-13T17:22:29.190595] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-13T17:22:29.190881] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-13T17:22:29.190940] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-13T17:22:29.224556] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-13T17:22:29.582424] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:29.598240] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:22:30.017935] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-13T17:22:30.817949] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-13T17:22:31.011764] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:22:31.066051] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:22:31.617926] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-13T17:22:32.419240] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-13T17:22:32.425562] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:22:33.218304] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-13T17:22:33.548294] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:22:33.583131] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:22:34.017952] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-13T17:22:34.378536] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:22:34.817927] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-13T17:22:35.617901] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-13T17:22:35.699056] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:22:36.103579] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:22:36.417923] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-13T17:22:37.048473] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:22:37.217928] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-13T17:22:37.908598] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:22:38.017901] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-13T17:22:38.247826] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:22:38.818009] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-13T17:22:39.617978] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-13T17:22:39.697530] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:22:40.200076] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:22:40.418000] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-13T17:22:40.965634] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:22:41.217899] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-13T17:22:41.575913] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:22:41.579101] [INFO ] [REMOTE ] ATHM: Full fetch complete (50057 records). [2025-10-13T17:22:41.579189] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-13T17:22:41.579800] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:22:41.579887] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:22:41.579930] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:22:41.579993] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-13T17:22:41.580080] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-13T17:22:41.580129] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-13T17:22:41.580382] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-13T17:22:41.581283] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATHM took 43.2s. Estimated remaining: 4h 53m 3s. Rate: 7.5 symbols/min [2025-10-13T17:22:41.747625] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:41.794189] [DEBUG] [LOCAL ] ATO: Loaded 42368 existing records from primary storage. [2025-10-13T17:22:41.794503] [INFO ] [MAIN ] ATO: Loaded 42368 existing records. [2025-10-13T17:22:41.976381] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:41.976612] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-13T17:22:41.976692] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-13T17:22:41.977169] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-13T17:22:41.977225] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-13T17:22:42.023106] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-13T17:22:42.343859] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:42.671922] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T17:22:42.817891] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-13T17:22:43.337153] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:22:43.617995] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-13T17:22:44.046474] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:22:44.417918] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-13T17:22:45.217963] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-13T17:22:45.405560] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:22:46.017902] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-13T17:22:46.084384] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:22:46.782182] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:22:46.817877] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-13T17:22:47.398696] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T17:22:47.617918] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-13T17:22:48.170961] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:22:48.174422] [INFO ] [REMOTE ] ATKR: Full fetch complete (53189 records). [2025-10-13T17:22:48.174535] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-13T17:22:48.175228] [FATAL] [VALIDATOR ] ATKR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:22:48.175318] [FATAL] [MAIN ] ATKR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:22:48.175361] [WARN ] [MAIN ] ATKR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:22:48.175408] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-13T17:22:48.175502] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-13T17:22:48.175552] [INFO ] [LOCAL ] ATKR: Starting deletion of derivative data. [2025-10-13T17:22:48.175689] [DEBUG] [LOCAL ] ATKR: No derivative data file found to delete. [2025-10-13T17:22:48.175788] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 34.0s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-13T17:22:48.346192] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:48.381495] [DEBUG] [LOCAL ] ATR: Loaded 31070 existing records from primary storage. [2025-10-13T17:22:48.381796] [INFO ] [MAIN ] ATR: Loaded 31070 existing records. [2025-10-13T17:22:48.424018] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-13T17:22:48.562234] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:48.562454] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-13T17:22:48.562501] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-13T17:22:48.563181] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-13T17:22:48.563240] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-13T17:22:48.947180] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:49.186479] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T17:22:49.191685] [INFO ] [REMOTE ] ATI: Full fetch complete (73815 records). [2025-10-13T17:22:49.191812] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-13T17:22:49.224080] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-13T17:22:49.603352] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-13T17:22:49.603562] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-13T17:22:49.604802] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-13T17:22:49.605019] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-13T17:22:49.607130] [DEBUG] [LOCAL ] ATI: Trimmed 73815 records to 51366 (keeping 200 days of data) [2025-10-13T17:22:49.720500] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:22:49.954837] [DEBUG] [LOCAL ] ATI: Primary data saved (51366 records). [2025-10-13T17:22:49.955037] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-13T17:22:49.955138] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATI took 38.2s. Estimated remaining: 4h 51m 10s. Rate: 7.6 symbols/min [2025-10-13T17:22:50.023263] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-13T17:22:50.134090] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:50.153249] [DEBUG] [LOCAL ] ATS: Loaded 17912 existing records from primary storage. [2025-10-13T17:22:50.153678] [INFO ] [MAIN ] ATS: Loaded 17912 existing records. [2025-10-13T17:22:50.345236] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:50.345834] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-13T17:22:50.345953] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-13T17:22:50.352401] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-13T17:22:50.352508] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-13T17:22:50.428461] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:22:50.737829] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:50.817936] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-13T17:22:51.488314] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:22:51.617916] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-13T17:22:52.417977] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-13T17:22:53.217957] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-13T17:23:05.032271] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (11.81 seconds). [2025-10-13T17:23:05.040969] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-13T17:23:05.411497] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (13.79 seconds). [2025-10-13T17:23:05.417505] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-13T17:23:06.712802] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (15.89 seconds). [2025-10-13T17:23:06.716741] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-13T17:23:06.934692] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:23:06.941441] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-13T17:23:07.545389] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:23:07.550126] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-13T17:23:08.043493] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T17:23:08.050211] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-13T17:23:08.115377] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T17:23:08.120245] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-13T17:23:08.443421] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (16.03 seconds). [2025-10-13T17:23:08.451783] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-13T17:23:08.942151] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:23:08.948496] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-13T17:23:09.124932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T17:23:09.129391] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-13T17:23:09.352790] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (4.31 seconds). [2025-10-13T17:23:09.361513] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-13T17:23:09.786166] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T17:23:09.795829] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-13T17:23:10.031821] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:23:10.037368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-13T17:23:10.343022] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:23:10.350045] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-13T17:23:10.611244] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T17:23:10.620682] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-13T17:23:10.776838] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:23:10.781408] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-13T17:23:11.369963] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:23:11.379079] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-13T17:23:11.685790] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:23:11.693281] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-13T17:23:11.704437] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:23:11.708750] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-13T17:23:12.136015] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:23:12.146098] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-13T17:23:12.403509] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T17:23:12.407170] [INFO ] [REMOTE ] ATMU: Full fetch complete (56312 records). [2025-10-13T17:23:12.407250] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-13T17:23:12.407922] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:12.408005] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:12.408090] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:12.408133] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-13T17:23:12.408189] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-13T17:23:12.408227] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-10-13T17:23:12.408378] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-10-13T17:23:12.408943] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 43.7s. Estimated remaining: 4h 54m 7s. Rate: 7.5 symbols/min [2025-10-13T17:23:12.585473] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:12.630818] [DEBUG] [LOCAL ] ATUS: Loaded 50199 existing records from primary storage. [2025-10-13T17:23:12.631171] [INFO ] [MAIN ] ATUS: Loaded 50199 existing records. [2025-10-13T17:23:12.834850] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:12.837434] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-13T17:23:12.837555] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-13T17:23:12.836730] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T17:23:12.843205] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-13T17:23:12.843925] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-13T17:23:12.856327] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-13T17:23:13.195134] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:23:13.224540] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-13T17:23:13.254150] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:13.255242] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-13T17:23:13.788713] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:23:13.793538] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-13T17:23:13.821870] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:23:13.832976] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-13T17:23:14.620679] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:23:14.624274] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-13T17:23:14.739001] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:23:14.817891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-13T17:23:14.923712] [DEBUG] [REMOTE ] ATR: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-13T17:23:14.924065] [WARN ] [REMOTE ] ATR: No data returned for month 2025-09 [2025-10-13T17:23:14.924162] [FATAL] [REMOTE ] ATR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:23:14.924254] [FATAL] [MAIN ] ATR: Failed to fetch primary data. [2025-10-13T17:23:14.924334] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:23:14.924419] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-13T17:23:14.924497] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-13T17:23:14.924550] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-13T17:23:14.924813] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-13T17:23:14.924925] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 26.7s. Estimated remaining: 4h 52m 49s. Rate: 7.5 symbols/min [2025-10-13T17:23:15.132231] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:23:15.130683] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:15.165394] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:23:15.225054] [DEBUG] [LOCAL ] AU: Loaded 53767 existing records from primary storage. [2025-10-13T17:23:15.225368] [INFO ] [MAIN ] AU: Loaded 53767 existing records. [2025-10-13T17:23:15.401453] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:15.401867] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-13T17:23:15.401945] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-13T17:23:15.403082] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-13T17:23:15.403142] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-13T17:23:15.507823] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:23:15.530745] [INFO ] [REMOTE ] ATS: Full fetch complete (25448 records). [2025-10-13T17:23:15.549229] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-13T17:23:15.570594] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:15.586765] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:15.632479] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:15.626038] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-13T17:23:15.675405] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-13T17:23:15.688568] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-13T17:23:15.692538] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-13T17:23:15.692902] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-13T17:23:15.709142] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 25.8s. Estimated remaining: 4h 51m 10s. Rate: 7.5 symbols/min [2025-10-13T17:23:15.877743] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:15.962755] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:16.011283] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-10-13T17:23:16.011750] [INFO ] [MAIN ] AUB: Loaded 46863 existing records. [2025-10-13T17:23:16.201931] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:16.202221] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-13T17:23:16.202270] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-13T17:23:16.203491] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-13T17:23:16.203557] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-13T17:23:16.423102] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-13T17:23:16.574401] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:17.217950] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-13T17:23:17.251529] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:23:18.017926] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-13T17:23:18.703326] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T17:23:18.761285] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:23:18.817903] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-13T17:23:19.538261] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:23:19.617898] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-13T17:23:20.372877] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:23:20.417986] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-13T17:23:21.217902] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-13T17:23:21.698266] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T17:23:21.786095] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:23:22.017968] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-13T17:23:22.701769] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T17:23:22.817932] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-13T17:23:23.283764] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:23:23.617933] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-13T17:23:24.099353] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:23:24.417944] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-13T17:23:25.217968] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-13T17:23:25.344159] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T17:23:25.770462] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:23:26.018062] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-13T17:23:26.817992] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-13T17:23:26.990063] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:23:27.587066] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:23:27.617943] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-13T17:23:28.291462] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T17:23:28.417984] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-13T17:23:29.217948] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-13T17:23:29.655169] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:23:29.683043] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:23:29.687546] [INFO ] [REMOTE ] ATO: Full fetch complete (60103 records). [2025-10-13T17:23:29.687854] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-13T17:23:29.689000] [FATAL] [VALIDATOR ] ATO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:29.689098] [FATAL] [MAIN ] ATO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:29.689142] [WARN ] [MAIN ] ATO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:29.689186] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-13T17:23:29.689265] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-13T17:23:29.689322] [INFO ] [LOCAL ] ATO: Starting deletion of derivative data. [2025-10-13T17:23:29.689480] [DEBUG] [LOCAL ] ATO: Deleted derivative data file. [2025-10-13T17:23:29.690101] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATO took 48.1s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-13T17:23:29.868543] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:29.878280] [DEBUG] [LOCAL ] AUNA: Loaded 5124 existing records from primary storage. [2025-10-13T17:23:29.878603] [INFO ] [MAIN ] AUNA: Loaded 5124 existing records. [2025-10-13T17:23:30.023106] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-13T17:23:30.063284] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:30.063554] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-13T17:23:30.063603] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-13T17:23:30.063943] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-13T17:23:30.064004] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-13T17:23:30.429251] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:30.470887] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:23:30.817981] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-13T17:23:31.617899] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-13T17:23:31.733756] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:23:32.188588] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:23:32.417945] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-13T17:23:33.217978] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-13T17:23:33.509260] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:23:34.018307] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-13T17:23:34.021511] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:23:34.728028] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:23:34.817885] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-13T17:23:35.617924] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-13T17:23:35.835521] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:23:36.417994] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-13T17:23:36.535080] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:23:36.809752] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:23:37.217915] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-13T17:23:38.017953] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-13T17:23:38.097942] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T17:23:38.344124] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T17:23:38.766966] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:23:38.817908] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-13T17:23:39.617952] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-13T17:23:40.256948] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:23:40.261874] [INFO ] [REMOTE ] AUB: Full fetch complete (65821 records). [2025-10-13T17:23:40.261981] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-13T17:23:40.439721] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-13T17:23:40.662072] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-13T17:23:40.662177] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-13T17:23:40.663125] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-13T17:23:40.663204] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-13T17:23:40.664873] [DEBUG] [LOCAL ] AUB: Trimmed 65821 records to 46091 (keeping 200 days of data) [2025-10-13T17:23:40.953633] [DEBUG] [LOCAL ] AUB: Primary data saved (46091 records). [2025-10-13T17:23:40.953870] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-13T17:23:40.953977] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 25.2s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-13T17:23:41.143181] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:41.182237] [DEBUG] [LOCAL ] AVA: Loaded 39567 existing records from primary storage. [2025-10-13T17:23:41.182717] [INFO ] [MAIN ] AVA: Loaded 39567 existing records. [2025-10-13T17:23:41.234471] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-13T17:23:41.267443] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:23:41.385694] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:41.386058] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-13T17:23:41.386121] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-13T17:23:41.387220] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-13T17:23:41.387299] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-13T17:23:41.793012] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:41.826099] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T17:23:42.017941] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-13T17:23:42.817956] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-13T17:23:42.875361] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:23:43.346629] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T17:23:43.617941] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-13T17:23:44.065253] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T17:23:44.417932] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-13T17:23:45.053541] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:23:45.217950] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-13T17:23:46.002460] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:23:46.017885] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-13T17:23:46.817925] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-13T17:23:46.863977] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:23:46.869817] [INFO ] [REMOTE ] ATUS: Full fetch complete (71057 records). [2025-10-13T17:23:46.869993] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-13T17:23:47.270019] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:23:47.314790] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-13T17:23:47.314894] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-13T17:23:47.315799] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-13T17:23:47.315869] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-13T17:23:47.317706] [DEBUG] [LOCAL ] ATUS: Trimmed 71057 records to 49722 (keeping 200 days of data) [2025-10-13T17:23:47.618740] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-13T17:23:47.625545] [DEBUG] [LOCAL ] ATUS: Primary data saved (49722 records). [2025-10-13T17:23:47.625823] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-13T17:23:47.626516] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. ATUS took 35.2s. Estimated remaining: 4h 52m 26s. Rate: 7.5 symbols/min [2025-10-13T17:23:47.852629] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:47.865173] [DEBUG] [LOCAL ] AVAL: Loaded 8816 existing records from primary storage. [2025-10-13T17:23:47.865505] [INFO ] [MAIN ] AVAL: Loaded 8816 existing records. [2025-10-13T17:23:48.057852] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:48.058161] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-13T17:23:48.058218] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-13T17:23:48.058740] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-13T17:23:48.058802] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-13T17:23:48.420694] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-13T17:23:48.448627] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:48.906082] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:23:48.917622] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:23:48.976878] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T17:23:49.217967] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-13T17:23:50.017957] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-13T17:23:50.487122] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T17:23:50.817928] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-13T17:23:51.125296] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T17:23:51.132910] [INFO ] [REMOTE ] AU: Full fetch complete (75922 records). [2025-10-13T17:23:51.133170] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-13T17:23:51.134270] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:51.134361] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:51.134403] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:51.134444] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-13T17:23:51.134502] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-13T17:23:51.134539] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-13T17:23:51.134768] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-10-13T17:23:51.134871] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AU took 36.2s. Estimated remaining: 4h 51m 23s. Rate: 7.5 symbols/min [2025-10-13T17:23:51.310799] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:51.350772] [DEBUG] [LOCAL ] AVB: Loaded 42671 existing records from primary storage. [2025-10-13T17:23:51.351095] [INFO ] [MAIN ] AVB: Loaded 42671 existing records. [2025-10-13T17:23:51.538338] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:51.538546] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-13T17:23:51.538593] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-13T17:23:51.539565] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-13T17:23:51.539625] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-13T17:23:51.623071] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-13T17:23:51.922183] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:52.092709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:23:52.158258] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:23:52.417913] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-13T17:23:53.217934] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-13T17:23:53.764809] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:23:54.017941] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-13T17:23:54.712944] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:23:54.817885] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-13T17:23:54.831171] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:23:55.617931] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-13T17:23:56.132352] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:23:56.220593] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T17:23:56.418000] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-13T17:23:57.217996] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-13T17:23:57.964715] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:23:57.970582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:23:58.017948] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-13T17:23:58.617572] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T17:23:58.817950] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-13T17:23:59.516187] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:23:59.617944] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-13T17:24:00.417917] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-13T17:24:00.429324] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:24:01.217957] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-13T17:24:01.977541] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:24:02.017996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-13T17:24:02.193593] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:24:02.817965] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-13T17:24:03.365885] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T17:24:03.617951] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-13T17:24:04.177846] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T17:24:04.203796] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:24:04.417964] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-13T17:24:05.218003] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-13T17:24:05.930737] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:24:06.019855] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-13T17:24:06.027220] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:24:06.817977] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-13T17:24:07.425032] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T17:24:07.426672] [INFO ] [REMOTE ] AUNA: Full fetch complete (7803 records). [2025-10-13T17:24:07.426747] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-13T17:24:07.618632] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-13T17:24:07.821278] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-13T17:24:07.821403] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-13T17:24:07.821892] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-13T17:24:07.822071] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-13T17:24:07.822933] [DEBUG] [LOCAL ] AUNA: Trimmed 7803 records to 5088 (keeping 200 days of data) [2025-10-13T17:24:07.855727] [DEBUG] [LOCAL ] AUNA: Primary data saved (5088 records). [2025-10-13T17:24:07.856214] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-13T17:24:07.856352] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AUNA took 38.2s. Estimated remaining: 4h 53m 1s. Rate: 7.5 symbols/min [2025-10-13T17:24:07.993164] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T17:24:08.078253] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:08.078490] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-13T17:24:08.078557] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-13T17:24:08.078708] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-13T17:24:08.078763] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-13T17:24:08.078806] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-13T17:24:08.078838] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-13T17:24:08.379794] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:24:08.423295] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-13T17:24:08.467070] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:09.217966] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-13T17:24:09.779899] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:24:09.953004] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T17:24:10.017948] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-13T17:24:10.674780] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T17:24:10.817984] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-13T17:24:11.617958] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-13T17:24:12.253679] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:24:12.417990] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-13T17:24:12.982480] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:24:13.218875] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T17:24:13.218978] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-13T17:24:13.904622] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T17:24:14.017966] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-13T17:24:14.817992] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-13T17:24:15.013144] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:24:15.013515] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-13T17:24:15.013610] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:24:15.013697] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-13T17:24:15.013748] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:24:15.013819] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-13T17:24:15.013932] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-13T17:24:15.014029] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-13T17:24:15.014087] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-13T17:24:15.014140] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVBC took 7.2s. Estimated remaining: 4h 52m 43s. Rate: 7.5 symbols/min [2025-10-13T17:24:15.199902] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:15.223420] [DEBUG] [LOCAL ] AVD: Loaded 22475 existing records from primary storage. [2025-10-13T17:24:15.223754] [INFO ] [MAIN ] AVD: Loaded 22475 existing records. [2025-10-13T17:24:15.408382] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:15.408932] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-13T17:24:15.409032] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-13T17:24:15.409309] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-13T17:24:15.409370] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-13T17:24:15.623210] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-13T17:24:15.788997] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:15.823397] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:24:16.417992] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-13T17:24:16.952796] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T17:24:17.217939] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-13T17:24:17.251611] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T17:24:17.253773] [INFO ] [REMOTE ] AVAL: Full fetch complete (14823 records). [2025-10-13T17:24:17.253869] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-13T17:24:17.620552] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-13T17:24:17.620635] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-13T17:24:17.620957] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-13T17:24:17.621000] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-13T17:24:17.621458] [DEBUG] [LOCAL ] AVAL: Trimmed 14823 records to 8610 (keeping 200 days of data) [2025-10-13T17:24:17.673233] [DEBUG] [LOCAL ] AVAL: Primary data saved (8610 records). [2025-10-13T17:24:17.673350] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-13T17:24:17.673431] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 30.0s. Estimated remaining: 4h 51m 30s. Rate: 7.5 symbols/min [2025-10-13T17:24:17.843669] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:17.862341] [DEBUG] [LOCAL ] AVK: Loaded 18620 existing records from primary storage. [2025-10-13T17:24:17.862608] [INFO ] [MAIN ] AVK: Loaded 18620 existing records. [2025-10-13T17:24:18.024429] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-13T17:24:18.049690] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:18.050818] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-13T17:24:18.050868] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-13T17:24:18.051169] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-13T17:24:18.051226] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-13T17:24:18.438067] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:24:18.441175] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:18.817935] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-13T17:24:19.617939] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-13T17:24:19.713212] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:24:20.013310] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:24:20.417946] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-13T17:24:20.723700] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T17:24:21.218045] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-13T17:24:22.019144] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:24:22.018040] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-13T17:24:22.191232] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T17:24:22.817987] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-13T17:24:23.412763] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:24:23.418719] [INFO ] [REMOTE ] AVA: Full fetch complete (55446 records). [2025-10-13T17:24:23.418940] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-13T17:24:23.624545] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-13T17:24:23.847765] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-13T17:24:23.847884] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-13T17:24:23.848856] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-13T17:24:23.848925] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-13T17:24:23.850638] [DEBUG] [LOCAL ] AVA: Trimmed 55446 records to 38997 (keeping 200 days of data) [2025-10-13T17:24:24.097217] [DEBUG] [LOCAL ] AVA: Primary data saved (38997 records). [2025-10-13T17:24:24.097412] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-13T17:24:24.097510] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVA took 43.1s. Estimated remaining: 4h 51m 4s. Rate: 7.5 symbols/min [2025-10-13T17:24:24.280305] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:24.320264] [DEBUG] [LOCAL ] AVNS: Loaded 33979 existing records from primary storage. [2025-10-13T17:24:24.320713] [INFO ] [MAIN ] AVNS: Loaded 33979 existing records. [2025-10-13T17:24:24.425740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-13T17:24:24.521788] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:24.522395] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-13T17:24:24.522485] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-13T17:24:24.522770] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-13T17:24:24.522829] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-13T17:24:24.776686] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T17:24:24.841261] [INFO ] [REMOTE ] AVB: Full fetch complete (58758 records). [2025-10-13T17:24:24.842965] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T17:24:24.848291] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-13T17:24:25.052015] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:25.223071] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-13T17:24:25.336615] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-13T17:24:25.336738] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-13T17:24:25.337382] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-13T17:24:25.337424] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-13T17:24:25.338871] [DEBUG] [LOCAL ] AVB: Trimmed 58758 records to 42176 (keeping 200 days of data) [2025-10-13T17:24:25.612264] [DEBUG] [LOCAL ] AVB: Primary data saved (42176 records). [2025-10-13T17:24:25.612377] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-13T17:24:25.612465] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVB took 34.5s. Estimated remaining: 4h 49m 39s. Rate: 7.6 symbols/min [2025-10-13T17:24:25.799548] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:24:25.798475] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:25.848513] [DEBUG] [LOCAL ] AVNT: Loaded 39655 existing records from primary storage. [2025-10-13T17:24:25.848886] [INFO ] [MAIN ] AVNT: Loaded 39655 existing records. [2025-10-13T17:24:26.022988] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-13T17:24:26.022920] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:26.024136] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-13T17:24:26.024209] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-13T17:24:26.024885] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-13T17:24:26.024974] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-13T17:24:26.381446] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:26.533882] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:24:26.817936] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-13T17:24:27.275120] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:24:27.617937] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-13T17:24:28.151585] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:24:28.417960] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-13T17:24:28.685683] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T17:24:29.217882] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-13T17:24:29.320258] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T17:24:29.963275] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:24:30.017890] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-13T17:24:30.817902] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-13T17:24:30.971177] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:24:31.617936] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-13T17:24:32.213391] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:24:32.417950] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-13T17:24:32.708239] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:24:33.217991] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-13T17:24:33.930585] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:24:34.017898] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-13T17:24:34.036753] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T17:24:34.817928] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-13T17:24:35.247187] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:24:35.617928] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-13T17:24:36.314739] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T17:24:36.417932] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-13T17:24:36.849980] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:24:37.137990] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:24:37.217927] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-13T17:24:38.017927] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-13T17:24:38.411676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:24:38.817940] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-13T17:24:39.252392] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:24:39.617916] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-13T17:24:39.878386] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:24:40.417928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-13T17:24:40.505314] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T17:24:40.507828] [INFO ] [REMOTE ] AVD: Full fetch complete (33048 records). [2025-10-13T17:24:40.507906] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-13T17:24:40.913477] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-13T17:24:40.913559] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-13T17:24:40.913990] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-13T17:24:40.914052] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-13T17:24:40.914821] [DEBUG] [LOCAL ] AVD: Trimmed 33048 records to 22083 (keeping 200 days of data) [2025-10-13T17:24:41.049088] [DEBUG] [LOCAL ] AVD: Primary data saved (22083 records). [2025-10-13T17:24:41.049257] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-13T17:24:41.049374] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVD took 26.0s. Estimated remaining: 4h 50m 59s. Rate: 7.5 symbols/min [2025-10-13T17:24:41.221797] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:41.221917] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-13T17:24:41.297700] [DEBUG] [LOCAL ] AVTR: Loaded 54340 existing records from primary storage. [2025-10-13T17:24:41.298257] [INFO ] [MAIN ] AVTR: Loaded 54340 existing records. [2025-10-13T17:24:41.488439] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:41.488752] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-13T17:24:41.488809] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-13T17:24:41.489125] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-13T17:24:41.489170] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-13T17:24:41.871813] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:41.896512] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:24:42.017916] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-13T17:24:42.105559] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T17:24:42.817953] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-13T17:24:43.065894] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T17:24:43.617929] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-13T17:24:44.130001] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:24:44.417965] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-13T17:24:44.809407] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:24:45.217990] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-13T17:24:46.017955] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-13T17:24:46.224373] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:24:46.225741] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T17:24:46.817933] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-13T17:24:47.617907] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-13T17:24:47.645413] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:24:47.827809] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:24:48.417953] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-13T17:24:49.130577] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:24:49.217920] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-13T17:24:49.731301] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T17:24:50.017969] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-13T17:24:50.355943] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T17:24:50.817949] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-13T17:24:51.326146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:24:51.617991] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-13T17:24:52.171571] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:24:52.175807] [INFO ] [REMOTE ] AVNS: Full fetch complete (48276 records). [2025-10-13T17:24:52.175994] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-13T17:24:52.423735] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-13T17:24:52.586921] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-13T17:24:52.587033] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-13T17:24:52.587731] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-13T17:24:52.587798] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-13T17:24:52.588858] [DEBUG] [LOCAL ] AVNS: Trimmed 48276 records to 33586 (keeping 200 days of data) [2025-10-13T17:24:52.799393] [DEBUG] [LOCAL ] AVNS: Primary data saved (33586 records). [2025-10-13T17:24:52.799558] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-13T17:24:52.799678] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 28.7s. Estimated remaining: 4h 51m 35s. Rate: 7.5 symbols/min [2025-10-13T17:24:52.972532] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:52.972843] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-13T17:24:52.972913] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-13T17:24:52.973140] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-13T17:24:52.973218] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-13T17:24:52.973340] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-13T17:24:52.973389] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-13T17:24:53.118941] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:24:53.223112] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-13T17:24:53.379976] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:54.017913] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-13T17:24:54.096785] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:24:54.504983] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T17:24:54.817948] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-13T17:24:55.246767] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:24:55.617953] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-13T17:24:56.208182] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:24:56.418033] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-13T17:24:57.098346] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:24:57.217948] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-13T17:24:57.569062] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:24:57.573111] [INFO ] [REMOTE ] AVK: Full fetch complete (26588 records). [2025-10-13T17:24:57.573216] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-13T17:24:57.970079] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-13T17:24:57.970209] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-13T17:24:57.970704] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-13T17:24:57.970766] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-13T17:24:57.972124] [DEBUG] [LOCAL ] AVK: Trimmed 26588 records to 18522 (keeping 200 days of data) [2025-10-13T17:24:58.024087] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-13T17:24:58.098339] [DEBUG] [LOCAL ] AVK: Primary data saved (18522 records). [2025-10-13T17:24:58.098537] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-13T17:24:58.098638] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVK took 40.4s. Estimated remaining: 4h 50m 56s. Rate: 7.5 symbols/min [2025-10-13T17:24:58.285369] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:58.314402] [DEBUG] [LOCAL ] AWF: Loaded 24541 existing records from primary storage. [2025-10-13T17:24:58.314772] [INFO ] [MAIN ] AWF: Loaded 24541 existing records. [2025-10-13T17:24:58.517717] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:58.518268] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-13T17:24:58.518427] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-13T17:24:58.518817] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-13T17:24:58.518957] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-13T17:24:58.695278] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:24:58.827112] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-13T17:24:58.944186] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:59.230873] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T17:24:59.235200] [INFO ] [REMOTE ] AVNT: Full fetch complete (56302 records). [2025-10-13T17:24:59.235294] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-13T17:24:59.618203] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-13T17:24:59.635948] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-13T17:24:59.636029] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-13T17:24:59.636741] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-13T17:24:59.636805] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-13T17:24:59.638618] [DEBUG] [LOCAL ] AVNT: Trimmed 56302 records to 39118 (keeping 200 days of data) [2025-10-13T17:24:59.884150] [DEBUG] [LOCAL ] AVNT: Primary data saved (39118 records). [2025-10-13T17:24:59.884312] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-13T17:24:59.884408] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVNT took 34.3s. Estimated remaining: 4h 49m 36s. Rate: 7.5 symbols/min [2025-10-13T17:25:00.061730] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:00.095927] [DEBUG] [LOCAL ] AWI: Loaded 25695 existing records from primary storage. [2025-10-13T17:25:00.096243] [INFO ] [MAIN ] AWI: Loaded 25695 existing records. [2025-10-13T17:25:00.276502] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:00.276923] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-13T17:25:00.277106] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-13T17:25:00.277467] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-13T17:25:00.277611] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-13T17:25:00.428129] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-13T17:25:00.682623] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:00.687267] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T17:25:01.092542] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T17:25:01.217967] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-13T17:25:02.017911] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-13T17:25:02.074415] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:25:02.277069] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:25:02.817997] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-13T17:25:03.618005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-13T17:25:03.781508] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:25:04.356477] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:25:04.418235] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-13T17:25:04.773750] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:25:05.217990] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-13T17:25:06.018039] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-13T17:25:06.221765] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:25:06.291425] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:25:06.818078] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-13T17:25:07.123368] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T17:25:07.617972] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-13T17:25:08.417917] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-13T17:25:08.644378] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T17:25:08.698893] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T17:25:09.217921] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-13T17:25:09.311972] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T17:25:10.017916] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-13T17:25:10.401979] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T17:25:10.817954] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-13T17:25:11.393639] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:25:11.617966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-13T17:25:12.417962] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-13T17:25:12.904916] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T17:25:13.185571] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:25:13.217968] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-13T17:25:13.833689] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:25:14.017944] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-13T17:25:14.776187] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:25:14.817931] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-13T17:25:15.206199] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:25:15.617960] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-13T17:25:16.413626] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:25:16.421885] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-13T17:25:16.864106] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:25:17.217983] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-13T17:25:18.017950] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-13T17:25:18.247446] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T17:25:18.526218] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:25:18.817948] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-13T17:25:19.134905] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:25:19.617943] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-13T17:25:20.287029] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:25:20.417885] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-13T17:25:21.217959] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-13T17:25:21.354278] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:25:21.881116] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:25:21.926189] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:25:22.017908] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-13T17:25:22.817957] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-13T17:25:23.088912] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:25:23.617899] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-13T17:25:24.041132] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:25:24.417922] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-13T17:25:24.595037] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:25:25.217949] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-13T17:25:25.771366] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:25:26.017997] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-13T17:25:26.561599] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:25:26.566595] [INFO ] [REMOTE ] AVTR: Full fetch complete (77055 records). [2025-10-13T17:25:26.566746] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-13T17:25:26.567603] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:25:26.567720] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:25:26.567764] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:25:26.567827] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-13T17:25:26.567884] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-13T17:25:26.567918] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-13T17:25:26.568112] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-13T17:25:26.568972] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 45.5s. Estimated remaining: 4h 53m 4s. Rate: 7.4 symbols/min [2025-10-13T17:25:26.740010] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:26.793047] [DEBUG] [LOCAL ] AWK: Loaded 49396 existing records from primary storage. [2025-10-13T17:25:26.793371] [INFO ] [MAIN ] AWK: Loaded 49396 existing records. [2025-10-13T17:25:26.823194] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-13T17:25:26.976252] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:26.976537] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-13T17:25:26.976585] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-13T17:25:26.977250] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-13T17:25:26.977314] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-13T17:25:27.261930] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:25:27.374617] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:27.617941] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-13T17:25:28.416637] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:25:28.424442] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-13T17:25:28.782345] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:25:28.785498] [INFO ] [REMOTE ] AWF: Full fetch complete (35586 records). [2025-10-13T17:25:28.785678] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-13T17:25:29.180403] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-13T17:25:29.180490] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-13T17:25:29.180975] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-13T17:25:29.181038] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-13T17:25:29.182227] [DEBUG] [LOCAL ] AWF: Trimmed 35586 records to 24023 (keeping 200 days of data) [2025-10-13T17:25:29.240111] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-13T17:25:29.332792] [DEBUG] [LOCAL ] AWF: Primary data saved (24023 records). [2025-10-13T17:25:29.332931] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-13T17:25:29.333010] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.2s. Estimated remaining: 4h 51m 55s. Rate: 7.5 symbols/min [2025-10-13T17:25:29.502576] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:29.522669] [DEBUG] [LOCAL ] AWP: Loaded 21748 existing records from primary storage. [2025-10-13T17:25:29.522940] [INFO ] [MAIN ] AWP: Loaded 21748 existing records. [2025-10-13T17:25:29.664037] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:25:29.722181] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:29.722696] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-13T17:25:29.722753] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-13T17:25:29.723046] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-13T17:25:29.723103] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-13T17:25:30.023006] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-13T17:25:30.084451] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:30.817921] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-13T17:25:30.869177] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T17:25:30.873838] [INFO ] [REMOTE ] AVY: Full fetch complete (56381 records). [2025-10-13T17:25:30.873947] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-13T17:25:31.266864] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T17:25:31.315895] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-13T17:25:31.315634] [INFO ] [REMOTE ] AWI: Full fetch complete (35781 records). [2025-10-13T17:25:31.316103] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-13T17:25:31.316213] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-13T17:25:31.317271] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-13T17:25:31.317381] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-13T17:25:31.423788] [DEBUG] [LOCAL ] AVY: Trimmed 56381 records to 37819 (keeping 200 days of data) [2025-10-13T17:25:31.619472] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-13T17:25:31.963155] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-13T17:25:31.964989] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-13T17:25:31.966543] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-13T17:25:31.967697] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-13T17:25:31.979930] [DEBUG] [LOCAL ] AWI: Trimmed 35781 records to 25385 (keeping 200 days of data) [2025-10-13T17:25:32.068345] [DEBUG] [LOCAL ] AVY: Primary data saved (37819 records). [2025-10-13T17:25:32.068551] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-13T17:25:32.068678] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AVY took 39.3s. Estimated remaining: 4h 50m 47s. Rate: 7.5 symbols/min [2025-10-13T17:25:32.290508] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:32.343084] [DEBUG] [LOCAL ] AWI: Primary data saved (25385 records). [2025-10-13T17:25:32.343284] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-13T17:25:32.343378] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWI took 32.5s. Estimated remaining: 4h 49m 11s. Rate: 7.5 symbols/min [2025-10-13T17:25:32.393148] [DEBUG] [LOCAL ] AWR: Loaded 23017 existing records from primary storage. [2025-10-13T17:25:32.405604] [INFO ] [MAIN ] AWR: Loaded 23017 existing records. [2025-10-13T17:25:32.653372] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:32.729905] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:32.730591] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-13T17:25:32.730718] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-13T17:25:32.731072] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-13T17:25:32.731195] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-13T17:25:32.884996] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:25:32.908495] [DEBUG] [LOCAL ] AX: Loaded 28446 existing records from primary storage. [2025-10-13T17:25:32.930912] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:25:32.931561] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-13T17:25:32.947412] [INFO ] [MAIN ] AX: Loaded 28446 existing records. [2025-10-13T17:25:33.228044] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-13T17:25:33.380054] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:33.401073] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-13T17:25:33.404848] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-13T17:25:33.426893] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:33.426959] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-13T17:25:33.427175] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-13T17:25:33.792482] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:34.017997] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-13T17:25:34.525270] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:25:34.597059] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:25:34.817943] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-13T17:25:35.025303] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T17:25:35.617940] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-13T17:25:36.158186] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:25:36.417919] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-13T17:25:36.716917] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:25:37.217925] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-13T17:25:38.024805] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-13T17:25:38.044606] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:25:38.387481] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T17:25:38.688511] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:25:38.817924] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-13T17:25:39.617909] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-13T17:25:39.939992] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T17:25:40.417915] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-13T17:25:40.501116] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T17:25:41.217896] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-13T17:25:41.495132] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:25:42.017938] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-13T17:25:42.817906] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-13T17:25:43.125492] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:25:43.330021] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:25:43.617895] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-13T17:25:43.851426] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:25:44.417909] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-13T17:25:44.796410] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:25:45.217922] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-13T17:25:45.474055] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T17:25:46.017941] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-13T17:25:46.525319] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:25:46.817935] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-13T17:25:47.319461] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T17:25:47.617930] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-13T17:25:47.962122] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:25:48.417917] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-13T17:25:49.217962] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-13T17:25:49.347400] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:25:49.805217] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:25:50.017973] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-13T17:25:50.425751] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T17:25:50.817942] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-13T17:25:50.873993] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:25:51.617974] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-13T17:25:52.013266] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:25:52.417963] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-13T17:25:52.643451] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:25:53.217884] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-13T17:25:53.335762] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:25:54.017892] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-13T17:25:54.377210] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:25:54.817977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-13T17:25:55.512318] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:25:55.617901] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-13T17:25:56.057712] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:25:56.417954] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-13T17:25:57.218004] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-13T17:25:57.380579] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:25:57.684680] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:25:58.017930] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-13T17:25:58.294202] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:25:58.817990] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-13T17:25:58.935396] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:25:59.617956] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-13T17:25:59.807688] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T17:26:00.417917] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-13T17:26:00.681585] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:26:01.217955] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-13T17:26:01.704215] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T17:26:02.017938] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-13T17:26:02.716995] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:26:02.817920] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-13T17:26:03.215013] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:26:03.218136] [INFO ] [REMOTE ] AX: Full fetch complete (42184 records). [2025-10-13T17:26:03.218238] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-13T17:26:03.592217] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-13T17:26:03.592339] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-13T17:26:03.592819] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-13T17:26:03.592880] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-13T17:26:03.593746] [DEBUG] [LOCAL ] AX: Trimmed 42184 records to 28013 (keeping 200 days of data) [2025-10-13T17:26:03.641172] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-13T17:26:03.756460] [DEBUG] [LOCAL ] AX: Primary data saved (28013 records). [2025-10-13T17:26:03.756619] [INFO ] [MAIN ] AX: Full history saved. [2025-10-13T17:26:03.756736] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AX took 31.4s. Estimated remaining: 4h 53m 28s. Rate: 7.4 symbols/min [2025-10-13T17:26:03.924485] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:03.977705] [DEBUG] [LOCAL ] AXL: Loaded 51267 existing records from primary storage. [2025-10-13T17:26:03.978766] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:26:03.982757] [INFO ] [MAIN ] AXL: Loaded 51267 existing records. [2025-10-13T17:26:04.025298] [INFO ] [REMOTE ] AWP: Full fetch complete (31899 records). [2025-10-13T17:26:04.057056] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-13T17:26:04.336944] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:04.352613] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-13T17:26:04.378149] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-13T17:26:04.410936] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-13T17:26:04.428412] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-13T17:26:04.428617] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-13T17:26:04.838151] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-13T17:26:04.847767] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-13T17:26:04.871188] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-13T17:26:04.897158] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-13T17:26:04.946105] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:26:04.958315] [DEBUG] [LOCAL ] AWP: Trimmed 31899 records to 21557 (keeping 200 days of data) [2025-10-13T17:26:05.022718] [INFO ] [REMOTE ] AWR: Full fetch complete (32203 records). [2025-10-13T17:26:05.028925] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:05.076215] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-13T17:26:05.217906] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-13T17:26:05.553435] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-13T17:26:05.560472] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-13T17:26:05.561349] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-13T17:26:05.561436] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-13T17:26:05.564258] [DEBUG] [LOCAL ] AWP: Primary data saved (21557 records). [2025-10-13T17:26:05.564676] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-13T17:26:05.564806] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWP took 36.2s. Estimated remaining: 4h 52m 9s. Rate: 7.5 symbols/min [2025-10-13T17:26:05.564924] [DEBUG] [LOCAL ] AWR: Trimmed 32203 records to 22779 (keeping 200 days of data) [2025-10-13T17:26:05.869453] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:05.944454] [DEBUG] [LOCAL ] AWR: Primary data saved (22779 records). [2025-10-13T17:26:05.944704] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-13T17:26:05.944911] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 33.8s. Estimated remaining: 4h 50m 35s. Rate: 7.5 symbols/min [2025-10-13T17:26:06.082716] [DEBUG] [LOCAL ] AXP: Loaded 53949 existing records from primary storage. [2025-10-13T17:26:06.147579] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:06.098941] [INFO ] [MAIN ] AXP: Loaded 53949 existing records. [2025-10-13T17:26:06.148201] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-13T17:26:06.159819] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-13T17:26:06.192095] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-13T17:26:06.204112] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-13T17:26:06.217953] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-13T17:26:06.239848] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-13T17:26:06.454520] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:06.460042] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-13T17:26:06.465979] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-13T17:26:06.512595] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-13T17:26:06.527471] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-13T17:26:06.626231] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T17:26:06.792432] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-13T17:26:07.016191] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:07.026490] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-13T17:26:07.270572] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:07.273052] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T17:26:07.617955] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-13T17:26:07.804432] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T17:26:08.206801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:26:08.212082] [INFO ] [REMOTE ] AWK: Full fetch complete (70692 records). [2025-10-13T17:26:08.212260] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-13T17:26:08.423033] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-13T17:26:08.611106] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-13T17:26:08.611192] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-13T17:26:08.611931] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-13T17:26:08.611995] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-13T17:26:08.616474] [DEBUG] [LOCAL ] AWK: Trimmed 70692 records to 48619 (keeping 200 days of data) [2025-10-13T17:26:08.928593] [DEBUG] [LOCAL ] AWK: Primary data saved (48619 records). [2025-10-13T17:26:08.928816] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-13T17:26:08.929607] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AWK took 42.4s. Estimated remaining: 4h 49m 32s. Rate: 7.5 symbols/min [2025-10-13T17:26:09.032244] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:26:09.103232] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:09.140610] [DEBUG] [LOCAL ] AXS: Loaded 39207 existing records from primary storage. [2025-10-13T17:26:09.140957] [INFO ] [MAIN ] AXS: Loaded 39207 existing records. [2025-10-13T17:26:09.223079] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-13T17:26:09.318485] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:09.318804] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-13T17:26:09.318853] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-13T17:26:09.319198] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-13T17:26:09.319255] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-13T17:26:09.676227] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:09.756064] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-13T17:26:10.017924] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-13T17:26:10.817944] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-13T17:26:10.866731] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:26:11.507403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:26:11.617959] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-13T17:26:12.417960] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-13T17:26:12.736954] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T17:26:12.795451] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:26:12.882376] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:26:13.217951] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-13T17:26:13.718758] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:26:14.017961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-13T17:26:14.626445] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:26:14.817926] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-13T17:26:15.617929] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-13T17:26:16.279205] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:26:16.417929] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-13T17:26:16.525450] [DEBUG] [REMOTE ] AXP: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T17:26:16.526271] [WARN ] [REMOTE ] AXP: No data returned for month 2025-02 [2025-10-13T17:26:16.526385] [FATAL] [REMOTE ] AXP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:26:16.526498] [FATAL] [MAIN ] AXP: Failed to fetch primary data. [2025-10-13T17:26:16.526563] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:26:16.526669] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-13T17:26:16.526844] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-13T17:26:16.526909] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-10-13T17:26:16.527631] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-10-13T17:26:16.529005] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXP took 11.0s. Estimated remaining: 4h 49m 19s. Rate: 7.5 symbols/min [2025-10-13T17:26:17.217948] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-13T17:26:17.219008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:26:17.656058] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T17:26:18.017970] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-13T17:26:18.554074] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T17:26:18.817961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-13T17:26:19.277921] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:26:19.617971] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-13T17:26:20.417898] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-13T17:26:21.093824] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:26:21.122333] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:26:21.217955] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-13T17:26:21.787379] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:26:22.017917] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-13T17:26:22.556384] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T17:26:22.557166] [INFO ] [REMOTE ] AXR: Full fetch complete (4431 records). [2025-10-13T17:26:22.557235] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-13T17:26:22.557764] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:26:22.557828] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:26:22.557866] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:26:22.557903] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-13T17:26:22.557957] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-13T17:26:22.557993] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-13T17:26:22.558082] [DEBUG] [LOCAL ] AXR: No derivative data file found to delete. [2025-10-13T17:26:22.558149] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXR took 16.6s. Estimated remaining: 4h 48m 50s. Rate: 7.5 symbols/min [2025-10-13T17:26:22.818039] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-13T17:26:23.617950] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-13T17:26:24.351313] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:26:24.417953] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-13T17:26:25.247330] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:26:25.256056] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-13T17:26:26.441243] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:26:26.452881] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-13T17:26:26.876926] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:26:26.885324] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-13T17:26:28.166272] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:26:28.177619] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-13T17:26:28.308541] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:26:28.418003] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-13T17:26:29.697360] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:26:29.706486] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-13T17:26:29.774516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:26:30.017972] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-13T17:26:31.182869] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:26:31.192993] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-13T17:26:31.308198] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:26:31.617945] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-13T17:26:32.371254] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:26:32.417889] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-13T17:26:32.856049] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:26:33.217937] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-13T17:26:33.764296] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:26:34.017973] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-13T17:26:34.917367] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:26:34.922800] [INFO ] [REMOTE ] AXL: Full fetch complete (72821 records). [2025-10-13T17:26:34.922968] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-13T17:26:35.329615] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-13T17:26:35.329818] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-13T17:26:35.330626] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-13T17:26:35.330731] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-13T17:26:35.342465] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:26:35.347311] [DEBUG] [LOCAL ] AXL: Trimmed 72821 records to 50550 (keeping 200 days of data) [2025-10-13T17:26:35.347828] [INFO ] [REMOTE ] AXS: Full fetch complete (55646 records). [2025-10-13T17:26:35.347919] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-13T17:26:36.005357] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-13T17:26:36.020460] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-13T17:26:36.022035] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-13T17:26:36.022400] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-13T17:26:36.040490] [DEBUG] [LOCAL ] AXL: Primary data saved (50550 records). [2025-10-13T17:26:36.040593] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-13T17:26:36.040726] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXL took 32.3s. Estimated remaining: 4h 49m 42s. Rate: 7.5 symbols/min [2025-10-13T17:26:36.037603] [DEBUG] [LOCAL ] AXS: Trimmed 55646 records to 38639 (keeping 200 days of data) [2025-10-13T17:26:36.310391] [DEBUG] [LOCAL ] AXS: Primary data saved (38639 records). [2025-10-13T17:26:36.310546] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-13T17:26:36.310630] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXS took 27.4s. Estimated remaining: 4h 48m 10s. Rate: 7.5 symbols/min [2025-10-13T17:26:36.866521] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.006310] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.039048] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.074931] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.104183] [DEBUG] [LOCAL ] AYI: Loaded 25627 existing records from primary storage. [2025-10-13T17:26:37.112410] [INFO ] [MAIN ] AYI: Loaded 25627 existing records. [2025-10-13T17:26:37.167529] [DEBUG] [LOCAL ] AZO: Loaded 11422 existing records from primary storage. [2025-10-13T17:26:37.194450] [INFO ] [MAIN ] AZO: Loaded 11422 existing records. [2025-10-13T17:26:37.223128] [DEBUG] [LOCAL ] AZZ: Loaded 22750 existing records from primary storage. [2025-10-13T17:26:37.269134] [INFO ] [MAIN ] AZZ: Loaded 22750 existing records. [2025-10-13T17:26:37.503275] [DEBUG] [LOCAL ] AXTA: Loaded 52953 existing records from primary storage. [2025-10-13T17:26:37.583990] [INFO ] [MAIN ] AXTA: Loaded 52953 existing records. [2025-10-13T17:26:37.690820] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.801981] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.813150] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.822500] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.838400] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-13T17:26:37.854636] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.843998] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.864872] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-13T17:26:37.864732] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-13T17:26:37.865577] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-13T17:26:37.865985] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-13T17:26:37.865725] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-13T17:26:37.865848] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-13T17:26:37.906322] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-13T17:26:37.892573] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-13T17:26:38.179823] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:38.216492] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-13T17:26:38.221884] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-13T17:26:38.277925] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-13T17:26:38.313583] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-13T17:26:39.323001] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.416318] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-13T17:26:39.406669] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.455127] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-13T17:26:39.466556] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.484281] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-13T17:26:39.586757] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.587129] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-13T17:26:40.437818] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T17:26:40.441865] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-13T17:26:40.608856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:26:40.613040] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-13T17:26:40.769241] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T17:26:40.774578] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-13T17:26:41.203115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:26:41.213816] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-13T17:26:41.266891] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:26:41.269765] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-13T17:26:41.647976] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T17:26:41.907668] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:26:41.949309] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T17:26:42.017925] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-13T17:26:42.631541] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:26:42.722768] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:26:42.817945] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-13T17:26:43.617968] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-13T17:26:43.815477] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:26:44.417973] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-13T17:26:44.600384] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:26:45.182818] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:26:45.217944] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-13T17:26:46.017928] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-13T17:26:46.641822] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:26:46.818038] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-13T17:26:47.619526] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:26:47.619686] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-13T17:26:48.198687] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:26:48.310222] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T17:26:48.417959] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-13T17:26:49.217912] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-13T17:26:49.425231] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:26:50.017929] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-13T17:26:50.409028] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:26:50.817960] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-13T17:26:51.181540] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:26:51.617952] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-13T17:26:51.758420] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T17:26:52.417931] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-13T17:26:53.217937] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-13T17:26:53.383942] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T17:26:53.436324] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:26:53.818119] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:26:54.017966] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-13T17:26:54.818000] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-13T17:26:55.240486] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:26:55.617943] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-13T17:26:56.418002] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-13T17:26:56.555213] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:26:56.576373] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:26:57.217913] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-13T17:26:57.525167] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:26:58.017898] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-13T17:26:58.319254] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:26:58.514961] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T17:26:58.817944] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-13T17:26:59.617944] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-13T17:27:00.417966] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-13T17:27:00.543739] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:27:00.697621] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:27:01.217920] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-13T17:27:01.309674] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:27:02.017951] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-13T17:27:02.608222] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:27:02.817921] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-13T17:27:03.617900] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-13T17:27:03.719736] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:27:03.776858] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T17:27:04.354883] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T17:27:04.356817] [INFO ] [REMOTE ] AZO: Full fetch complete (15954 records). [2025-10-13T17:27:04.356923] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-13T17:27:04.423041] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-13T17:27:04.751409] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-13T17:27:04.751520] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-13T17:27:04.751984] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-13T17:27:04.752047] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-13T17:27:04.752591] [DEBUG] [LOCAL ] AZO: Trimmed 15954 records to 11208 (keeping 200 days of data) [2025-10-13T17:27:04.821173] [DEBUG] [LOCAL ] AZO: Primary data saved (11208 records). [2025-10-13T17:27:04.821316] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-13T17:27:04.821396] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 28.5s. Estimated remaining: 4h 51m 44s. Rate: 7.4 symbols/min [2025-10-13T17:27:04.986590] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:04.986895] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-13T17:27:04.987823] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-13T17:27:04.987974] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-13T17:27:04.988055] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-13T17:27:04.988130] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-13T17:27:04.988204] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-13T17:27:05.223041] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-13T17:27:05.342179] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:05.753570] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T17:27:05.757083] [INFO ] [REMOTE ] AYI: Full fetch complete (36969 records). [2025-10-13T17:27:05.757197] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-13T17:27:06.023135] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-13T17:27:06.156357] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-13T17:27:06.156469] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-13T17:27:06.157051] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-13T17:27:06.157116] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-13T17:27:06.158243] [DEBUG] [LOCAL ] AYI: Trimmed 36969 records to 25068 (keeping 200 days of data) [2025-10-13T17:27:06.317935] [DEBUG] [LOCAL ] AYI: Primary data saved (25068 records). [2025-10-13T17:27:06.318118] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-13T17:27:06.318211] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AYI took 30.0s. Estimated remaining: 4h 50m 25s. Rate: 7.5 symbols/min [2025-10-13T17:27:06.452960] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:27:06.513474] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:06.567144] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-13T17:27:06.567503] [INFO ] [MAIN ] BA: Loaded 54570 existing records. [2025-10-13T17:27:06.753162] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:06.753431] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-13T17:27:06.753488] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-13T17:27:06.753890] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-13T17:27:06.753948] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-13T17:27:06.827577] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-13T17:27:07.111846] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:07.616794] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:27:07.627068] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-13T17:27:07.736467] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:27:07.739872] [INFO ] [REMOTE ] AZZ: Full fetch complete (31610 records). [2025-10-13T17:27:07.739948] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-13T17:27:08.101559] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-13T17:27:08.101681] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-13T17:27:08.102123] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-13T17:27:08.102165] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-13T17:27:08.103171] [DEBUG] [LOCAL ] AZZ: Trimmed 31610 records to 22566 (keeping 200 days of data) [2025-10-13T17:27:08.235836] [DEBUG] [LOCAL ] AZZ: Primary data saved (22566 records). [2025-10-13T17:27:08.235972] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-13T17:27:08.236051] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 31.9s. Estimated remaining: 4h 49m 12s. Rate: 7.5 symbols/min [2025-10-13T17:27:08.401975] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:08.417925] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-13T17:27:08.458101] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-13T17:27:08.458419] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-10-13T17:27:08.635475] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:08.635815] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-13T17:27:08.635875] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-13T17:27:08.636190] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-13T17:27:08.636250] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-13T17:27:08.979974] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:09.217881] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-13T17:27:10.017894] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-13T17:27:10.107312] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-13T17:27:10.149025] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T17:27:10.817947] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-13T17:27:11.407414] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:27:11.526511] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-13T17:27:11.617881] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-13T17:27:12.417981] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-13T17:27:13.223086] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-13T17:27:13.242129] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-13T17:27:13.574140] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T17:27:14.017931] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-13T17:27:14.174451] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-13T17:27:14.818187] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-13T17:27:14.825024] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:27:15.617954] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-13T17:27:15.843096] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:27:15.843421] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-13T17:27:15.843509] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:27:15.843592] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-13T17:27:15.843681] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:27:15.843752] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-13T17:27:15.843816] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-13T17:27:15.843869] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-13T17:27:15.843920] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-13T17:27:15.844004] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. B took 11.0s. Estimated remaining: 4h 48m 60s. Rate: 7.5 symbols/min [2025-10-13T17:27:16.028121] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:16.058310] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-13T17:27:16.113524] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-13T17:27:16.113897] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-10-13T17:27:16.287398] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:16.287670] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-13T17:27:16.287730] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-13T17:27:16.288100] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-13T17:27:16.288162] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-13T17:27:16.423841] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-13T17:27:16.640761] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:17.217954] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-13T17:27:17.380501] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-13T17:27:18.017946] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-13T17:27:18.652974] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:27:18.658185] [INFO ] [REMOTE ] AXTA: Full fetch complete (74732 records). [2025-10-13T17:27:18.658347] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-13T17:27:18.659118] [FATAL] [VALIDATOR ] AXTA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:27:18.659211] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:27:18.659254] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:27:18.659293] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-13T17:27:18.659348] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-13T17:27:18.659384] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-10-13T17:27:18.659558] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-10-13T17:27:18.659673] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. AXTA took 42.3s. Estimated remaining: 4h 47m 57s. Rate: 7.5 symbols/min [2025-10-13T17:27:18.834238] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:18.831004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-13T17:27:18.886972] [DEBUG] [LOCAL ] BAH: Loaded 52445 existing records from primary storage. [2025-10-13T17:27:18.887323] [INFO ] [MAIN ] BAH: Loaded 52445 existing records. [2025-10-13T17:27:19.107495] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-13T17:27:19.102821] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:19.108028] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-13T17:27:19.119252] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-13T17:27:19.119932] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-13T17:27:19.120172] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-13T17:27:19.464081] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:19.617955] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-13T17:27:20.417964] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-13T17:27:20.788519] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-13T17:27:20.933323] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-13T17:27:21.217956] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-13T17:27:21.798037] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:27:21.895747] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T17:27:22.017972] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-13T17:27:22.817953] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-13T17:27:23.592349] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-13T17:27:23.617908] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-13T17:27:23.848757] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T17:27:24.417979] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-13T17:27:25.217986] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-13T17:27:25.691663] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-13T17:27:25.809427] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T17:27:26.017977] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-13T17:27:26.505519] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:27:26.693470] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-13T17:27:26.817919] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-13T17:27:27.617952] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-13T17:27:28.184270] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-13T17:27:28.417946] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-13T17:27:29.217942] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-13T17:27:29.349422] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-13T17:27:29.393024] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:27:30.017918] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-13T17:27:30.817994] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-13T17:27:30.940008] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-13T17:27:31.532542] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:27:31.617984] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-13T17:27:31.664985] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T17:27:32.417938] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-13T17:27:33.188459] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:27:33.217920] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-13T17:27:33.278408] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-13T17:27:34.017925] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-13T17:27:34.737167] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-13T17:27:34.817947] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-13T17:27:35.620988] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-13T17:27:35.634366] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T17:27:36.252692] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:27:36.417895] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-13T17:27:36.464399] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T17:27:37.217956] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-13T17:27:38.017973] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-13T17:27:38.114603] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:27:38.473160] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-13T17:27:38.817920] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-13T17:27:39.463937] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-13T17:27:39.617905] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-13T17:27:40.363965] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:27:40.417893] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-13T17:27:40.592564] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-13T17:27:41.217939] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-13T17:27:42.012631] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:27:42.022850] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-13T17:27:42.187800] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-13T17:27:42.741185] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:27:42.746886] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-13T17:27:42.747071] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-13T17:27:42.822998] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-13T17:27:43.139625] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-13T17:27:43.139750] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-13T17:27:43.140526] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-13T17:27:43.140568] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-13T17:27:43.142198] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-13T17:27:43.470706] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-13T17:27:43.470842] [INFO ] [MAIN ] BA: Full history saved. [2025-10-13T17:27:43.470919] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BA took 37.2s. Estimated remaining: 4h 50m 46s. Rate: 7.4 symbols/min [2025-10-13T17:27:43.639775] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:43.637145] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-13T17:27:43.640053] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-10-13T17:27:43.640177] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-10-13T17:27:43.640389] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-13T17:27:43.640521] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-13T17:27:43.640615] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-13T17:27:43.640742] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-13T17:27:44.000188] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:44.034331] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-13T17:27:44.417960] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-13T17:27:44.438196] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:27:44.443279] [INFO ] [REMOTE ] BAH: Full fetch complete (74573 records). [2025-10-13T17:27:44.443408] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-13T17:27:44.444242] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:27:44.444334] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:27:44.444377] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:27:44.444445] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-13T17:27:44.444749] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-13T17:27:44.445004] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-13T17:27:44.445293] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-10-13T17:27:44.445448] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 25.8s. Estimated remaining: 4h 49m 24s. Rate: 7.5 symbols/min [2025-10-13T17:27:44.635613] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:44.691828] [DEBUG] [LOCAL ] BALL: Loaded 52599 existing records from primary storage. [2025-10-13T17:27:44.692233] [INFO ] [MAIN ] BALL: Loaded 52599 existing records. [2025-10-13T17:27:44.875389] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:44.875692] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-13T17:27:44.875766] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-13T17:27:44.876161] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-13T17:27:44.876229] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-13T17:27:45.227301] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-13T17:27:45.260489] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:46.001844] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-13T17:27:46.017881] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-13T17:27:46.080064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:27:46.817986] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-13T17:27:47.617961] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-13T17:27:47.927603] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-13T17:27:48.341089] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-13T17:27:48.412539] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:27:48.422927] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-13T17:27:49.148179] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:27:49.217957] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-13T17:27:50.017931] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-13T17:27:50.614862] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:27:50.703310] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-13T17:27:50.709289] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-13T17:27:50.709458] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-13T17:27:50.823057] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-13T17:27:51.128942] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-13T17:27:51.129046] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-13T17:27:51.129962] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-13T17:27:51.130032] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-13T17:27:51.132129] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-13T17:27:51.493567] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-13T17:27:51.493783] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-13T17:27:51.493892] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 35.6s. Estimated remaining: 4h 49m 6s. Rate: 7.5 symbols/min [2025-10-13T17:27:51.623135] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-13T17:27:51.677420] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:51.677622] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-13T17:27:51.677708] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-13T17:27:51.677835] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-13T17:27:51.677878] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-13T17:27:51.677928] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-13T17:27:51.678027] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-13T17:27:52.054232] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:52.417935] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-13T17:27:52.568789] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:27:52.730725] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-13T17:27:52.736919] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-13T17:27:52.737118] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-13T17:27:53.149912] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-13T17:27:53.150274] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-13T17:27:53.151284] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-13T17:27:53.159865] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-13T17:27:53.179292] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:27:53.179487] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-13T17:27:53.247545] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-13T17:27:53.566936] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-13T17:27:53.567119] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-13T17:27:53.567856] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 45.3s. Estimated remaining: 4h 47m 56s. Rate: 7.5 symbols/min [2025-10-13T17:27:53.826622] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:27:53.830266] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:53.899913] [DEBUG] [LOCAL ] BAM: Loaded 52777 existing records from primary storage. [2025-10-13T17:27:53.900349] [INFO ] [MAIN ] BAM: Loaded 52777 existing records. [2025-10-13T17:27:54.023142] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-13T17:27:54.110569] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:54.110804] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-13T17:27:54.110858] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-13T17:27:54.111133] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-13T17:27:54.111190] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-13T17:27:54.456046] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:54.762191] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:27:54.817912] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-13T17:27:55.617921] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-13T17:27:55.687335] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:27:56.115710] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:27:56.417913] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-13T17:27:56.856149] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:27:57.217962] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-13T17:27:58.017905] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-13T17:27:58.291127] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:27:58.818037] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-13T17:27:59.097114] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:27:59.428216] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:27:59.617986] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-13T17:28:00.273858] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:28:00.417980] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-13T17:28:00.889910] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T17:28:01.218028] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-13T17:28:02.017922] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-13T17:28:02.192298] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:28:02.549374] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T17:28:02.817947] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-13T17:28:03.618028] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-13T17:28:04.154506] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T17:28:04.350588] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T17:28:04.417963] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-13T17:28:05.030912] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T17:28:05.218000] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-13T17:28:06.024151] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-13T17:28:06.030163] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:28:06.434562] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:28:06.630291] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T17:28:06.817946] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-13T17:28:07.618025] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-13T17:28:08.417973] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-13T17:28:08.538363] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:28:09.136501] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:28:09.184951] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:28:09.217928] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-13T17:28:10.017954] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-13T17:28:10.817974] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-13T17:28:11.057375] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:28:11.100035] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T17:28:11.617944] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-13T17:28:12.118190] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:28:12.123075] [INFO ] [REMOTE ] BAK: Full fetch complete (57007 records). [2025-10-13T17:28:12.123216] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-13T17:28:12.423153] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-13T17:28:12.468026] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T17:28:12.565590] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-13T17:28:12.565718] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-13T17:28:12.566503] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-13T17:28:12.566570] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-13T17:28:12.568453] [DEBUG] [LOCAL ] BAK: Trimmed 57007 records to 39338 (keeping 200 days of data) [2025-10-13T17:28:12.792380] [DEBUG] [LOCAL ] BAK: Primary data saved (39338 records). [2025-10-13T17:28:12.792550] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-13T17:28:12.792689] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAK took 29.3s. Estimated remaining: 4h 49m 44s. Rate: 7.5 symbols/min [2025-10-13T17:28:12.968873] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:13.027314] [DEBUG] [LOCAL ] BANC: Loaded 52050 existing records from primary storage. [2025-10-13T17:28:13.027765] [INFO ] [MAIN ] BANC: Loaded 52050 existing records. [2025-10-13T17:28:13.223902] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:13.224076] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-13T17:28:13.226979] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-13T17:28:13.227096] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-13T17:28:13.228170] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-13T17:28:13.228246] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-13T17:28:13.605267] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:14.017949] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-13T17:28:14.284270] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:28:14.532245] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T17:28:14.817909] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-13T17:28:14.965107] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:28:15.617935] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-13T17:28:16.242807] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T17:28:16.417938] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-13T17:28:16.490945] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:28:17.217961] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-13T17:28:17.280305] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:28:18.017959] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-13T17:28:18.131157] [DEBUG] [REMOTE ] BAM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-13T17:28:18.131530] [WARN ] [REMOTE ] BAM: No data returned for month 2025-05 [2025-10-13T17:28:18.131624] [FATAL] [REMOTE ] BAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:28:18.131751] [FATAL] [MAIN ] BAM: Failed to fetch primary data. [2025-10-13T17:28:18.131819] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:28:18.131894] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-13T17:28:18.131964] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-13T17:28:18.132001] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-10-13T17:28:18.132240] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-10-13T17:28:18.133437] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BAM took 24.6s. Estimated remaining: 4h 49m 8s. Rate: 7.5 symbols/min [2025-10-13T17:28:18.310173] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:18.342712] [DEBUG] [LOCAL ] BAP: Loaded 26295 existing records from primary storage. [2025-10-13T17:28:18.343044] [INFO ] [MAIN ] BAP: Loaded 26295 existing records. [2025-10-13T17:28:18.532275] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:18.532474] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-13T17:28:18.532524] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-13T17:28:18.532881] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-13T17:28:18.532990] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-13T17:28:18.818868] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-13T17:28:18.917073] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:18.950334] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T17:28:19.617945] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-13T17:28:20.297860] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:28:20.304565] [INFO ] [REMOTE ] BALL: Full fetch complete (75377 records). [2025-10-13T17:28:20.304747] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-13T17:28:20.423038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-13T17:28:20.752217] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-13T17:28:20.752341] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-13T17:28:20.753607] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-13T17:28:20.753974] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-13T17:28:20.774471] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:28:20.774620] [DEBUG] [LOCAL ] BALL: Trimmed 75377 records to 51851 (keeping 200 days of data) [2025-10-13T17:28:21.124823] [DEBUG] [LOCAL ] BALL: Primary data saved (51851 records). [2025-10-13T17:28:21.125766] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-13T17:28:21.125450] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:28:21.126053] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 36.7s. Estimated remaining: 4h 48m 9s. Rate: 7.5 symbols/min [2025-10-13T17:28:21.163273] [INFO ] [REMOTE ] BALY: Full fetch complete (16538 records). [2025-10-13T17:28:21.204222] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-13T17:28:21.223498] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-13T17:28:21.435964] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:21.526271] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T17:28:21.526614] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:28:21.526978] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:28:21.527078] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-13T17:28:21.527178] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-13T17:28:21.527242] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-13T17:28:21.527296] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-13T17:28:21.527369] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BALY took 30.0s. Estimated remaining: 4h 46m 44s. Rate: 7.5 symbols/min [2025-10-13T17:28:21.720082] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:21.733385] [DEBUG] [LOCAL ] BARK: Loaded 38560 existing records from primary storage. [2025-10-13T17:28:21.733912] [INFO ] [MAIN ] BARK: Loaded 38560 existing records. [2025-10-13T17:28:21.936095] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:21.936697] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-13T17:28:21.936802] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-13T17:28:21.937389] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-13T17:28:21.953513] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-13T17:28:22.030426] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-13T17:28:22.103489] [DEBUG] [LOCAL ] BAX: Loaded 54283 existing records from primary storage. [2025-10-13T17:28:22.109486] [INFO ] [MAIN ] BAX: Loaded 54283 existing records. [2025-10-13T17:28:22.508309] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:22.529264] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-13T17:28:22.547941] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-13T17:28:22.587719] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-13T17:28:22.587624] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:22.587908] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-13T17:28:22.822600] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-13T17:28:22.992069] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:23.019844] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T17:28:23.306117] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:28:23.617941] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-13T17:28:24.336503] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:28:24.418038] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-13T17:28:25.096796] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:28:25.217931] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-13T17:28:26.018036] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-13T17:28:26.235428] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:28:26.806861] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T17:28:26.817979] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-13T17:28:27.030142] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T17:28:27.617903] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-13T17:28:28.417960] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-13T17:28:28.579536] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:28:28.632514] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:28:29.217940] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-13T17:28:29.943604] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:28:30.017965] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-13T17:28:30.817961] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-13T17:28:30.884351] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:28:31.617939] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-13T17:28:31.754695] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:28:31.991955] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:28:32.417946] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-13T17:28:33.110149] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:28:33.217956] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-13T17:28:33.476871] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:28:34.017944] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-13T17:28:34.817925] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-13T17:28:35.002113] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:28:35.470860] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:28:35.617952] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-13T17:28:36.264084] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T17:28:36.417942] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-13T17:28:37.127134] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:28:37.217951] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-13T17:28:38.017920] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-13T17:28:38.199814] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:28:38.818213] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-13T17:28:38.855850] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T17:28:39.239004] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:28:39.617946] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-13T17:28:40.417905] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-13T17:28:40.538587] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:28:40.589391] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T17:28:41.217937] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-13T17:28:41.874475] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:28:42.017923] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-13T17:28:42.392261] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:28:42.817964] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-13T17:28:43.617954] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-13T17:28:43.859409] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:28:44.417930] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-13T17:28:44.499621] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:28:44.827322] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:28:45.217972] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-13T17:28:46.017938] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-13T17:28:46.069045] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:28:46.817920] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-13T17:28:47.042018] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:28:47.048485] [INFO ] [REMOTE ] BANC: Full fetch complete (74343 records). [2025-10-13T17:28:47.048748] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-13T17:28:47.498954] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:28:47.503314] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-13T17:28:47.509243] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-13T17:28:47.511451] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-13T17:28:47.511620] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-13T17:28:47.514048] [DEBUG] [LOCAL ] BANC: Trimmed 74343 records to 51326 (keeping 200 days of data) [2025-10-13T17:28:47.618038] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-13T17:28:47.860751] [DEBUG] [LOCAL ] BANC: Primary data saved (51326 records). [2025-10-13T17:28:47.860939] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-13T17:28:47.861036] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BANC took 35.1s. Estimated remaining: 4h 49m 41s. Rate: 7.4 symbols/min [2025-10-13T17:28:48.036964] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:48.099750] [DEBUG] [LOCAL ] BB: Loaded 53713 existing records from primary storage. [2025-10-13T17:28:48.100589] [INFO ] [MAIN ] BB: Loaded 53713 existing records. [2025-10-13T17:28:48.281425] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:28:48.322870] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:48.323780] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-13T17:28:48.323845] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-13T17:28:48.324331] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-13T17:28:48.324382] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-13T17:28:48.427428] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-13T17:28:48.705909] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:48.725191] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:28:49.217991] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-13T17:28:49.890812] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:28:50.017930] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-13T17:28:50.344941] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:28:50.347959] [INFO ] [REMOTE ] BAP: Full fetch complete (37306 records). [2025-10-13T17:28:50.348089] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-13T17:28:50.733674] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-13T17:28:50.733812] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-13T17:28:50.734362] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-13T17:28:50.734410] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-13T17:28:50.735540] [DEBUG] [LOCAL ] BAP: Trimmed 37306 records to 25796 (keeping 200 days of data) [2025-10-13T17:28:50.829977] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-13T17:28:50.910263] [DEBUG] [LOCAL ] BAP: Primary data saved (25796 records). [2025-10-13T17:28:50.910422] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-13T17:28:50.910510] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAP took 32.8s. Estimated remaining: 4h 48m 42s. Rate: 7.5 symbols/min [2025-10-13T17:28:51.077380] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:51.130719] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-13T17:28:51.131083] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-10-13T17:28:51.314411] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:51.314703] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-13T17:28:51.314763] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-13T17:28:51.315094] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-13T17:28:51.315196] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-13T17:28:51.618922] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-13T17:28:51.688959] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:51.720024] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:28:52.417958] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-13T17:28:52.734796] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T17:28:53.218047] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-13T17:28:53.813057] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-13T17:28:53.818585] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-10-13T17:28:53.818767] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-13T17:28:54.023736] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-13T17:28:54.265471] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-13T17:28:54.266040] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-13T17:28:54.267034] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-13T17:28:54.267104] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-13T17:28:54.269557] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 53520 (keeping 200 days of data) [2025-10-13T17:28:54.628694] [DEBUG] [LOCAL ] BAX: Primary data saved (53520 records). [2025-10-13T17:28:54.628889] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-13T17:28:54.628985] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 33.1s. Estimated remaining: 4h 47m 51s. Rate: 7.5 symbols/min [2025-10-13T17:28:54.817968] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:54.865446] [DEBUG] [LOCAL ] BBAR: Loaded 42518 existing records from primary storage. [2025-10-13T17:28:54.865872] [INFO ] [MAIN ] BBAR: Loaded 42518 existing records. [2025-10-13T17:28:55.056495] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:55.057383] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-13T17:28:55.057875] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-13T17:28:55.058593] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-13T17:28:55.058776] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-13T17:28:55.264552] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T17:28:55.318091] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-13T17:28:55.472499] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-10-13T17:28:55.589797] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:55.610154] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:28:55.617903] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-13T17:28:56.417990] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-13T17:28:57.217976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-13T17:28:57.574276] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T17:28:57.639077] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:28:58.017943] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-13T17:28:58.109732] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-13T17:28:58.645884] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T17:28:58.817935] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-13T17:28:59.133866] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T17:28:59.137843] [INFO ] [REMOTE ] BARK: Full fetch complete (56024 records). [2025-10-13T17:28:59.137948] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-13T17:28:59.522272] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-13T17:28:59.522357] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-13T17:28:59.523036] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-13T17:28:59.523101] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-13T17:28:59.524376] [DEBUG] [LOCAL ] BARK: Trimmed 56024 records to 38175 (keeping 200 days of data) [2025-10-13T17:28:59.618204] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-13T17:28:59.743276] [DEBUG] [LOCAL ] BARK: Primary data saved (38175 records). [2025-10-13T17:28:59.743464] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-13T17:28:59.743561] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BARK took 38.6s. Estimated remaining: 4h 47m 15s. Rate: 7.5 symbols/min [2025-10-13T17:28:59.914085] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:59.964260] [DEBUG] [LOCAL ] BBD: Loaded 54018 existing records from primary storage. [2025-10-13T17:28:59.964623] [INFO ] [MAIN ] BBD: Loaded 54018 existing records. [2025-10-13T17:29:00.179453] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:00.179747] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-13T17:29:00.179801] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-13T17:29:00.180392] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-13T17:29:00.180451] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-13T17:29:00.424468] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-13T17:29:00.538162] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:01.217902] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-13T17:29:01.713217] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:29:01.755230] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-13T17:29:02.017940] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-13T17:29:02.201281] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:29:02.750401] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:29:02.817981] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-13T17:29:03.617957] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-13T17:29:04.304524] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:29:04.417954] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-13T17:29:04.729198] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-13T17:29:05.217909] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-13T17:29:05.292981] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:29:05.921315] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:29:06.017950] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-13T17:29:06.817910] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-13T17:29:07.091540] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:29:07.617920] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-13T17:29:08.309225] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:29:08.417922] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-13T17:29:08.490602] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-13T17:29:09.217924] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-13T17:29:09.681935] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T17:29:09.776395] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:29:10.017911] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-13T17:29:10.817924] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-13T17:29:10.897902] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:29:11.617902] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-13T17:29:11.878408] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T17:29:12.417972] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-13T17:29:13.195068] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:29:13.217885] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-13T17:29:13.467824] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-13T17:29:14.017939] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-13T17:29:14.586592] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T17:29:14.772025] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:29:14.817903] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-13T17:29:15.617969] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-13T17:29:16.278877] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:29:16.417926] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-13T17:29:16.588297] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-13T17:29:17.217914] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-13T17:29:17.485201] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:29:17.906910] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T17:29:18.017930] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-13T17:29:18.817972] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-13T17:29:19.594723] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:29:19.599947] [INFO ] [REMOTE ] BBAR: Full fetch complete (61089 records). [2025-10-13T17:29:19.600070] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-13T17:29:19.632749] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-13T17:29:20.006919] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-13T17:29:20.007080] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-13T17:29:20.007835] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-13T17:29:20.007919] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-13T17:29:20.009524] [DEBUG] [LOCAL ] BBAR: Trimmed 61089 records to 42127 (keeping 200 days of data) [2025-10-13T17:29:20.139562] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-13T17:29:20.315083] [DEBUG] [LOCAL ] BBAR: Primary data saved (42127 records). [2025-10-13T17:29:20.315237] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-13T17:29:20.315322] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 25.7s. Estimated remaining: 4h 49m 11s. Rate: 7.4 symbols/min [2025-10-13T17:29:20.423193] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-13T17:29:20.490610] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:20.521043] [DEBUG] [LOCAL ] BBDC: Loaded 33535 existing records from primary storage. [2025-10-13T17:29:20.521336] [INFO ] [MAIN ] BBDC: Loaded 33535 existing records. [2025-10-13T17:29:20.731405] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:20.732178] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-13T17:29:20.732279] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-13T17:29:20.735404] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-13T17:29:20.735353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:29:20.735549] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-13T17:29:21.109634] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:21.217933] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-13T17:29:21.637230] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T17:29:22.017911] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-13T17:29:22.823619] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-13T17:29:22.830342] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:29:23.158399] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-13T17:29:23.617946] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-13T17:29:24.037412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T17:29:24.274164] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:29:24.417953] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-13T17:29:25.197403] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:29:25.217891] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-13T17:29:26.017976] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-13T17:29:26.456369] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T17:29:26.462413] [INFO ] [REMOTE ] BB: Full fetch complete (76972 records). [2025-10-13T17:29:26.463254] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-13T17:29:26.837739] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-13T17:29:26.882499] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-13T17:29:26.882963] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-13T17:29:26.883966] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-13T17:29:26.884080] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-13T17:29:26.914700] [DEBUG] [LOCAL ] BB: Trimmed 76972 records to 52937 (keeping 200 days of data) [2025-10-13T17:29:26.938440] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:29:27.068249] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T17:29:27.305666] [DEBUG] [LOCAL ] BB: Primary data saved (52937 records). [2025-10-13T17:29:27.305859] [INFO ] [MAIN ] BB: Full history saved. [2025-10-13T17:29:27.305961] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BB took 39.4s. Estimated remaining: 4h 48m 52s. Rate: 7.4 symbols/min [2025-10-13T17:29:27.481976] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:27.489146] [DEBUG] [LOCAL ] BBDO: Loaded 5077 existing records from primary storage. [2025-10-13T17:29:27.489405] [INFO ] [MAIN ] BBDO: Loaded 5077 existing records. [2025-10-13T17:29:27.623049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-13T17:29:27.728938] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:27.729204] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-13T17:29:27.729254] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-13T17:29:27.729486] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-13T17:29:27.729543] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-13T17:29:28.098891] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:28.417953] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-13T17:29:29.217951] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-13T17:29:29.303583] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T17:29:29.563392] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:29:29.655188] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-13T17:29:30.017949] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-13T17:29:30.587200] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:29:30.611520] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:29:30.817942] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-13T17:29:31.617933] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-13T17:29:32.417964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-13T17:29:32.684576] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:29:32.933484] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T17:29:33.038328] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:29:33.217895] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-13T17:29:34.017961] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-13T17:29:34.817966] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-13T17:29:34.974340] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:29:34.980196] [INFO ] [REMOTE ] BBD: Full fetch complete (77111 records). [2025-10-13T17:29:34.980347] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-13T17:29:35.377330] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-13T17:29:35.377487] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-13T17:29:35.378761] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-13T17:29:35.378827] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-13T17:29:35.380457] [DEBUG] [LOCAL ] BBD: Trimmed 77111 records to 53253 (keeping 200 days of data) [2025-10-13T17:29:35.618349] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:29:35.619636] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-13T17:29:35.730200] [DEBUG] [LOCAL ] BBD: Primary data saved (53253 records). [2025-10-13T17:29:35.730352] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-13T17:29:35.730430] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBD took 36.0s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-13T17:29:35.898142] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:35.915675] [DEBUG] [LOCAL ] BBN: Loaded 18236 existing records from primary storage. [2025-10-13T17:29:35.915915] [INFO ] [MAIN ] BBN: Loaded 18236 existing records. [2025-10-13T17:29:36.094051] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:36.094274] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-13T17:29:36.094322] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-13T17:29:36.094536] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-13T17:29:36.094593] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-13T17:29:36.322725] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:29:36.423065] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-13T17:29:36.481182] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:37.217930] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-13T17:29:37.464686] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-13T17:29:37.471305] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-13T17:29:37.471503] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-13T17:29:37.648722] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:29:37.928888] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-13T17:29:37.929010] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-13T17:29:37.930041] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-13T17:29:37.930110] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-13T17:29:37.932119] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-13T17:29:38.023088] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-13T17:29:38.267240] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-13T17:29:38.267393] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-13T17:29:38.268225] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBAI took 47.4s. Estimated remaining: 4h 47m 46s. Rate: 7.5 symbols/min [2025-10-13T17:29:38.459445] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:38.460489] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-13T17:29:38.460580] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-13T17:29:38.461265] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:29:38.461567] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-13T17:29:38.467373] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-13T17:29:38.468324] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-13T17:29:38.468370] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-13T17:29:38.788897] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:29:38.821338] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-13T17:29:38.854731] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:39.556892] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T17:29:39.617949] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-13T17:29:39.817252] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:29:39.817705] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-13T17:29:39.817824] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:29:39.817882] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-13T17:29:39.817918] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:29:39.817958] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-13T17:29:39.818060] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-13T17:29:39.818122] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-13T17:29:39.818166] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-13T17:29:39.818221] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 1.5s. Estimated remaining: 4h 46m 35s. Rate: 7.5 symbols/min [2025-10-13T17:29:40.016168] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:40.026763] [DEBUG] [LOCAL ] BBU: Loaded 5254 existing records from primary storage. [2025-10-13T17:29:40.027056] [INFO ] [MAIN ] BBU: Loaded 5254 existing records. [2025-10-13T17:29:40.256212] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:40.256488] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-13T17:29:40.256540] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-13T17:29:40.256785] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-13T17:29:40.256846] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-13T17:29:40.423237] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-13T17:29:40.763340] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:41.166525] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:29:41.217939] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-13T17:29:41.711731] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T17:29:42.017952] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-13T17:29:42.612426] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T17:29:42.817983] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-13T17:29:43.375825] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:29:43.617932] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-13T17:29:44.171248] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T17:29:44.417993] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-13T17:29:45.037852] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T17:29:45.039274] [INFO ] [REMOTE ] BBDO: Full fetch complete (7530 records). [2025-10-13T17:29:45.039347] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-13T17:29:45.222897] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-13T17:29:45.415673] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-13T17:29:45.415775] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-13T17:29:45.416057] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-13T17:29:45.416100] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-13T17:29:45.416514] [DEBUG] [LOCAL ] BBDO: Trimmed 7530 records to 5048 (keeping 200 days of data) [2025-10-13T17:29:45.452361] [DEBUG] [LOCAL ] BBDO: Primary data saved (5048 records). [2025-10-13T17:29:45.452637] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-13T17:29:45.452781] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 18.1s. Estimated remaining: 4h 46m 4s. Rate: 7.5 symbols/min [2025-10-13T17:29:45.626517] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:45.626742] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-13T17:29:45.626794] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-13T17:29:45.626995] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-13T17:29:45.627039] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-13T17:29:45.627082] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-13T17:29:45.627114] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-13T17:29:46.002059] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:46.017955] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-13T17:29:46.174779] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T17:29:46.526376] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T17:29:46.817963] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-13T17:29:47.617943] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-13T17:29:47.750815] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T17:29:48.339636] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:29:48.417923] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-13T17:29:49.029554] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T17:29:49.217909] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-13T17:29:49.963755] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:29:50.017963] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-13T17:29:50.693574] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T17:29:50.817984] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-13T17:29:51.617944] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-13T17:29:51.981494] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T17:29:52.417922] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-13T17:29:52.867082] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:29:53.015888] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:29:53.217952] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-13T17:29:54.017937] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-13T17:29:54.196724] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:29:54.817890] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-13T17:29:55.221213] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T17:29:55.617924] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-13T17:29:55.752554] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:29:56.418108] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-13T17:29:56.892073] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:29:57.100814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T17:29:57.217952] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-13T17:29:57.908070] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T17:29:58.017951] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-13T17:29:58.817905] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-13T17:29:59.037233] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T17:29:59.604880] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T17:29:59.617879] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-13T17:30:00.409312] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T17:30:00.417878] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-13T17:30:01.210684] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T17:30:01.212847] [INFO ] [REMOTE ] BBUC: Full fetch complete (18467 records). [2025-10-13T17:30:01.212962] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-13T17:30:01.213594] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:30:01.213706] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:30:01.213757] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:30:01.213797] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-13T17:30:01.213853] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-13T17:30:01.213890] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-13T17:30:01.213929] [DEBUG] [LOCAL ] BBUC: No derivative data file found to delete. [2025-10-13T17:30:01.214021] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 15.8s. Estimated remaining: 4h 47m 11s. Rate: 7.5 symbols/min [2025-10-13T17:30:01.225354] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-13T17:30:01.409879] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:01.457779] [DEBUG] [LOCAL ] BBVA: Loaded 49892 existing records from primary storage. [2025-10-13T17:30:01.458227] [INFO ] [MAIN ] BBVA: Loaded 49892 existing records. [2025-10-13T17:30:01.637086] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:01.637334] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-13T17:30:01.637380] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-13T17:30:01.637713] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-13T17:30:01.637784] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-13T17:30:01.997194] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:02.017905] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-13T17:30:02.062721] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T17:30:02.817942] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-13T17:30:03.617943] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-13T17:30:03.767070] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:30:04.034119] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:30:04.417963] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-13T17:30:04.915826] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:30:05.217952] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-13T17:30:05.323548] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:30:05.616446] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-13T17:30:06.017976] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-13T17:30:06.817944] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-13T17:30:06.907868] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:30:07.617927] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-13T17:30:08.417952] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-13T17:30:08.454904] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:30:08.669039] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:30:09.218073] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-13T17:30:09.706383] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:30:09.706257] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:30:09.714183] [INFO ] [REMOTE ] BBDC: Full fetch complete (48630 records). [2025-10-13T17:30:09.714282] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-13T17:30:10.023161] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-13T17:30:10.143017] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-13T17:30:10.143100] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-13T17:30:10.143688] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-13T17:30:10.143751] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-13T17:30:10.144756] [DEBUG] [LOCAL ] BBDC: Trimmed 48630 records to 33121 (keeping 200 days of data) [2025-10-13T17:30:10.339088] [DEBUG] [LOCAL ] BBDC: Primary data saved (33121 records). [2025-10-13T17:30:10.339236] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-13T17:30:10.339345] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBDC took 50.0s. Estimated remaining: 4h 47m 13s. Rate: 7.5 symbols/min [2025-10-13T17:30:10.513207] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:10.541385] [DEBUG] [LOCAL ] BBW: Loaded 27623 existing records from primary storage. [2025-10-13T17:30:10.546075] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T17:30:10.546477] [INFO ] [MAIN ] BBW: Loaded 27623 existing records. [2025-10-13T17:30:10.729698] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:10.729941] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-13T17:30:10.729989] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-13T17:30:10.730284] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-13T17:30:10.730355] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-13T17:30:10.823217] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-13T17:30:11.083120] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:11.617943] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-13T17:30:12.318860] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:30:12.417918] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-13T17:30:12.669285] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T17:30:13.217956] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-13T17:30:14.017946] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-13T17:30:14.466352] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:30:14.506992] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T17:30:14.537751] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T17:30:14.817958] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-13T17:30:15.570800] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:30:15.617936] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-13T17:30:16.417921] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-13T17:30:16.672007] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:30:16.673928] [INFO ] [REMOTE ] BBN: Full fetch complete (25738 records). [2025-10-13T17:30:16.674000] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-13T17:30:17.044105] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-13T17:30:17.044194] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-13T17:30:17.044782] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-13T17:30:17.044847] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-13T17:30:17.045892] [DEBUG] [LOCAL ] BBN: Trimmed 25738 records to 18055 (keeping 200 days of data) [2025-10-13T17:30:17.164492] [DEBUG] [LOCAL ] BBN: Primary data saved (18055 records). [2025-10-13T17:30:17.164637] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-13T17:30:17.164765] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBN took 41.4s. Estimated remaining: 4h 46m 54s. Rate: 7.5 symbols/min [2025-10-13T17:30:17.223751] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-13T17:30:17.365138] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:17.427991] [DEBUG] [LOCAL ] BBWI: Loaded 54362 existing records from primary storage. [2025-10-13T17:30:17.428417] [INFO ] [MAIN ] BBWI: Loaded 54362 existing records. [2025-10-13T17:30:17.624980] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:17.625223] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-13T17:30:17.625273] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-13T17:30:17.625759] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-13T17:30:17.625818] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-13T17:30:17.912191] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:30:18.005230] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:18.017883] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-13T17:30:18.163816] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:30:18.818053] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-13T17:30:19.565759] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T17:30:19.617966] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-13T17:30:19.906843] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T17:30:20.417988] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-13T17:30:21.147242] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T17:30:21.149120] [INFO ] [REMOTE ] BBU: Full fetch complete (7069 records). [2025-10-13T17:30:21.149202] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-13T17:30:21.219714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-13T17:30:21.551939] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-13T17:30:21.552075] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-13T17:30:21.552391] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-13T17:30:21.552625] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-13T17:30:21.553636] [DEBUG] [LOCAL ] BBU: Trimmed 7069 records to 5248 (keeping 200 days of data) [2025-10-13T17:30:21.636634] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:30:21.652564] [DEBUG] [LOCAL ] BBU: Primary data saved (5248 records). [2025-10-13T17:30:21.652783] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-13T17:30:21.652896] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBU took 41.8s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-13T17:30:21.833996] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:21.902696] [DEBUG] [LOCAL ] BBY: Loaded 54230 existing records from primary storage. [2025-10-13T17:30:21.903248] [INFO ] [MAIN ] BBY: Loaded 54230 existing records. [2025-10-13T17:30:22.023120] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-13T17:30:22.105782] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:22.106370] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-13T17:30:22.106507] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-13T17:30:22.106968] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-13T17:30:22.107032] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-13T17:30:22.317884] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:30:22.534725] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:22.817961] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-13T17:30:23.617909] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-13T17:30:23.682789] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:30:24.417912] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-13T17:30:24.624559] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:30:25.011726] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:30:25.217943] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-13T17:30:26.016040] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:30:26.024888] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-13T17:30:26.817961] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-13T17:30:26.929590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T17:30:27.617905] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-13T17:30:27.702953] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:30:28.417897] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-13T17:30:28.503676] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T17:30:29.227759] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-13T17:30:29.252827] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T17:30:30.027742] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-13T17:30:30.050057] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T17:30:30.256540] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:30:30.817943] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-13T17:30:31.617921] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-13T17:30:31.960129] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T17:30:31.993779] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:30:32.417951] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-13T17:30:33.217986] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-13T17:30:33.330735] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:30:34.017898] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-13T17:30:34.290020] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:30:34.817899] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-13T17:30:35.012667] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:30:35.617942] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-13T17:30:36.014241] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T17:30:36.294699] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:30:36.417995] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-13T17:30:36.787844] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T17:30:37.218037] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-13T17:30:38.017912] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-13T17:30:38.266975] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:30:38.295610] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:30:38.817920] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-13T17:30:39.617905] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-13T17:30:39.799993] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:30:40.324352] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:30:40.417912] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-13T17:30:41.217907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-13T17:30:41.325136] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:30:41.957558] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:30:41.961605] [INFO ] [REMOTE ] BBW: Full fetch complete (39760 records). [2025-10-13T17:30:41.961734] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-13T17:30:42.026790] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-13T17:30:42.350099] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-13T17:30:42.350194] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-13T17:30:42.350798] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-13T17:30:42.350875] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-13T17:30:42.351707] [DEBUG] [LOCAL ] BBW: Trimmed 39760 records to 27362 (keeping 200 days of data) [2025-10-13T17:30:42.517067] [DEBUG] [LOCAL ] BBW: Primary data saved (27362 records). [2025-10-13T17:30:42.517200] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-13T17:30:42.517293] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBW took 32.2s. Estimated remaining: 4h 48m 5s. Rate: 7.4 symbols/min [2025-10-13T17:30:42.691412] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:42.732311] [DEBUG] [LOCAL ] BC: Loaded 44741 existing records from primary storage. [2025-10-13T17:30:42.732619] [INFO ] [MAIN ] BC: Loaded 44741 existing records. [2025-10-13T17:30:42.843787] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-13T17:30:42.929577] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:42.930038] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-13T17:30:42.930093] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-13T17:30:42.930492] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-13T17:30:42.930552] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-13T17:30:43.072517] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:30:43.144200] [INFO ] [REMOTE ] BBVA: Full fetch complete (71581 records). [2025-10-13T17:30:43.198620] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-13T17:30:43.464604] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:43.621513] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-13T17:30:43.748063] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-13T17:30:43.748168] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-13T17:30:43.748970] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-13T17:30:43.749036] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-13T17:30:43.750588] [DEBUG] [LOCAL ] BBVA: Trimmed 71581 records to 49136 (keeping 200 days of data) [2025-10-13T17:30:44.006084] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T17:30:44.100540] [DEBUG] [LOCAL ] BBVA: Primary data saved (49136 records). [2025-10-13T17:30:44.100749] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-13T17:30:44.100851] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBVA took 42.9s. Estimated remaining: 4h 46m 57s. Rate: 7.5 symbols/min [2025-10-13T17:30:44.289352] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:44.289577] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-10-13T17:30:44.289616] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-10-13T17:30:44.289757] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-13T17:30:44.289798] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-13T17:30:44.289841] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-13T17:30:44.289874] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-13T17:30:44.426718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-13T17:30:44.659715] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:44.874957] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T17:30:44.941907] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T17:30:45.217982] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-13T17:30:46.017913] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-13T17:30:46.313128] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:30:46.799762] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:30:46.817891] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-13T17:30:47.617985] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-13T17:30:47.778239] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:30:48.152699] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:30:48.417946] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-13T17:30:49.084138] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:30:49.217961] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-13T17:30:50.017937] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-13T17:30:50.241578] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:30:50.447706] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:30:50.817941] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-13T17:30:51.244857] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:30:51.617944] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-13T17:30:52.295811] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:30:52.417911] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-13T17:30:53.217990] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-13T17:30:53.488578] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:30:53.520914] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:30:54.017963] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-13T17:30:54.700822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T17:30:54.817953] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-13T17:30:55.617928] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-13T17:30:55.966963] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T17:30:55.975875] [INFO ] [REMOTE ] BBWI: Full fetch complete (77446 records). [2025-10-13T17:30:55.976092] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-13T17:30:56.418226] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-13T17:30:56.439935] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-13T17:30:56.440158] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-13T17:30:56.441365] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-13T17:30:56.441635] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-13T17:30:56.483337] [DEBUG] [LOCAL ] BBWI: Trimmed 77446 records to 53583 (keeping 200 days of data) [2025-10-13T17:30:56.483162] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:30:56.824969] [DEBUG] [LOCAL ] BBWI: Primary data saved (53583 records). [2025-10-13T17:30:56.825134] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-13T17:30:56.825219] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBWI took 39.7s. Estimated remaining: 4h 47m 32s. Rate: 7.4 symbols/min [2025-10-13T17:30:56.991194] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:57.019900] [DEBUG] [LOCAL ] BCC: Loaded 28719 existing records from primary storage. [2025-10-13T17:30:57.020219] [INFO ] [MAIN ] BCC: Loaded 28719 existing records. [2025-10-13T17:30:57.200156] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:57.200571] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-13T17:30:57.200669] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-13T17:30:57.201081] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-13T17:30:57.201142] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-13T17:30:57.231779] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-13T17:30:57.366605] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:30:57.407451] [INFO ] [REMOTE ] BBY: Full fetch complete (77243 records). [2025-10-13T17:30:57.449231] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-13T17:30:57.733663] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:58.032036] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-13T17:30:58.056232] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-13T17:30:58.057333] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-13T17:30:58.058313] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-13T17:30:58.065810] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-13T17:30:58.079508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:30:58.088408] [DEBUG] [LOCAL ] BBY: Trimmed 77243 records to 53453 (keeping 200 days of data) [2025-10-13T17:30:58.420091] [DEBUG] [LOCAL ] BBY: Primary data saved (53453 records). [2025-10-13T17:30:58.420241] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-13T17:30:58.421025] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BBY took 36.8s. Estimated remaining: 4h 46m 24s. Rate: 7.5 symbols/min [2025-10-13T17:30:58.587698] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:58.644777] [DEBUG] [LOCAL ] BCE: Loaded 52976 existing records from primary storage. [2025-10-13T17:30:58.645102] [INFO ] [MAIN ] BCE: Loaded 52976 existing records. [2025-10-13T17:30:58.819524] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-13T17:30:58.824158] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:58.826168] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-13T17:30:58.826379] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-13T17:30:58.826780] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-13T17:30:58.827074] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-13T17:30:59.150033] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:30:59.243605] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:59.257323] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:30:59.617930] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-13T17:31:00.191044] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:31:00.417963] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-13T17:31:00.917126] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:31:01.218028] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-13T17:31:02.017975] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-13T17:31:02.110570] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:31:02.776686] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T17:31:02.817985] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-13T17:31:03.200061] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:31:03.617946] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-13T17:31:04.233171] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:31:04.417933] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-13T17:31:05.146399] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:31:05.217932] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-13T17:31:05.977036] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:31:06.017930] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-13T17:31:06.644063] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:31:06.817975] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-13T17:31:07.296562] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T17:31:07.617928] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-13T17:31:08.305456] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:31:08.417967] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-13T17:31:09.014150] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:31:09.217967] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-13T17:31:10.017924] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-13T17:31:10.116343] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T17:31:10.193733] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T17:31:10.817911] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-13T17:31:11.500119] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:31:11.617904] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-13T17:31:12.010598] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:31:12.417942] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-13T17:31:13.178491] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:31:13.217924] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-13T17:31:13.803909] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:31:13.807702] [INFO ] [REMOTE ] BCAT: Full fetch complete (49899 records). [2025-10-13T17:31:13.807831] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-13T17:31:14.027412] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-13T17:31:14.185081] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-13T17:31:14.185175] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-13T17:31:14.185765] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-13T17:31:14.185827] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-13T17:31:14.186856] [DEBUG] [LOCAL ] BCAT: Trimmed 49899 records to 34066 (keeping 200 days of data) [2025-10-13T17:31:14.396208] [DEBUG] [LOCAL ] BCAT: Primary data saved (34066 records). [2025-10-13T17:31:14.396360] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-13T17:31:14.396433] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 30.3s. Estimated remaining: 4h 47m 30s. Rate: 7.4 symbols/min [2025-10-13T17:31:14.566085] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:14.596244] [DEBUG] [LOCAL ] BCH: Loaded 30383 existing records from primary storage. [2025-10-13T17:31:14.596569] [INFO ] [MAIN ] BCH: Loaded 30383 existing records. [2025-10-13T17:31:14.783051] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:31:14.813939] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:14.825307] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-13T17:31:14.826843] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-13T17:31:14.826944] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-13T17:31:14.827941] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-13T17:31:14.828044] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-13T17:31:15.174965] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:15.617888] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-13T17:31:15.842527] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:31:15.868428] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T17:31:16.417919] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-13T17:31:16.754822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:31:16.758952] [INFO ] [REMOTE ] BC: Full fetch complete (63629 records). [2025-10-13T17:31:16.759063] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-13T17:31:17.156005] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-13T17:31:17.156094] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-13T17:31:17.156967] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-13T17:31:17.157032] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-13T17:31:17.158362] [DEBUG] [LOCAL ] BC: Trimmed 63629 records to 44145 (keeping 200 days of data) [2025-10-13T17:31:17.218794] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-13T17:31:17.393473] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T17:31:17.450895] [DEBUG] [LOCAL ] BC: Primary data saved (44145 records). [2025-10-13T17:31:17.451049] [INFO ] [MAIN ] BC: Full history saved. [2025-10-13T17:31:17.451156] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BC took 34.9s. Estimated remaining: 4h 46m 35s. Rate: 7.5 symbols/min [2025-10-13T17:31:17.616738] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:17.640956] [DEBUG] [LOCAL ] BCO: Loaded 26031 existing records from primary storage. [2025-10-13T17:31:17.641236] [INFO ] [MAIN ] BCO: Loaded 26031 existing records. [2025-10-13T17:31:17.813273] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:17.813498] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-13T17:31:17.813542] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-13T17:31:17.813818] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-13T17:31:17.813874] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-13T17:31:18.027322] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-13T17:31:18.161953] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:18.817948] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-13T17:31:19.022269] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:31:19.337314] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:31:19.617929] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-13T17:31:20.063238] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:31:20.417922] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-13T17:31:21.217948] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-13T17:31:21.463535] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:31:21.535976] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:31:22.017984] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-13T17:31:22.213366] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T17:31:22.817974] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-13T17:31:23.617913] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-13T17:31:23.872434] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T17:31:23.873424] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:31:24.417930] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-13T17:31:24.913305] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:31:24.918810] [INFO ] [REMOTE ] BCC: Full fetch complete (40786 records). [2025-10-13T17:31:24.919016] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-13T17:31:24.919893] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:31:24.920002] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:31:24.920065] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:31:24.920154] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-13T17:31:24.920255] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-13T17:31:24.920316] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-10-13T17:31:24.920949] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-10-13T17:31:24.921294] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCC took 28.1s. Estimated remaining: 4h 46m 22s. Rate: 7.5 symbols/min [2025-10-13T17:31:25.197045] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:25.218028] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-13T17:31:25.281264] [DEBUG] [LOCAL ] BCS: Loaded 54222 existing records from primary storage. [2025-10-13T17:31:25.282585] [INFO ] [MAIN ] BCS: Loaded 54222 existing records. [2025-10-13T17:31:25.567201] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:25.567819] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-13T17:31:25.568175] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-13T17:31:25.574798] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-13T17:31:25.590484] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-13T17:31:25.608568] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:31:26.023276] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-13T17:31:26.175559] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:26.300603] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:31:26.817954] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-13T17:31:27.617928] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-13T17:31:27.669863] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:31:28.417967] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-13T17:31:28.595406] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:31:28.734483] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T17:31:29.217916] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-13T17:31:29.724352] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T17:31:30.017916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-13T17:31:30.174082] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:31:30.817929] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-13T17:31:31.295763] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T17:31:31.300808] [INFO ] [REMOTE ] BCE: Full fetch complete (75553 records). [2025-10-13T17:31:31.300986] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-13T17:31:31.302078] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:31:31.302208] [FATAL] [MAIN ] BCE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:31:31.302263] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:31:31.302330] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-13T17:31:31.302421] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-13T17:31:31.302479] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-10-13T17:31:31.302709] [DEBUG] [LOCAL ] BCE: Deleted derivative data file. [2025-10-13T17:31:31.303512] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCE took 32.9s. Estimated remaining: 4h 45m 59s. Rate: 7.5 symbols/min [2025-10-13T17:31:31.497318] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:31.533551] [DEBUG] [LOCAL ] BCSF: Loaded 28477 existing records from primary storage. [2025-10-13T17:31:31.533890] [INFO ] [MAIN ] BCSF: Loaded 28477 existing records. [2025-10-13T17:31:31.623051] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-13T17:31:31.711250] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:31.711511] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-13T17:31:31.711559] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-13T17:31:31.711865] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-13T17:31:31.711935] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-13T17:31:32.069871] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:32.137683] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:31:32.417928] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-13T17:31:33.035501] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:31:33.204849] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T17:31:33.217944] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-13T17:31:34.017976] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-13T17:31:34.374490] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T17:31:34.817993] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-13T17:31:35.617956] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-13T17:31:35.901753] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:31:36.375259] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:31:36.417920] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-13T17:31:36.789153] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:31:37.217984] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-13T17:31:37.559678] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:31:38.017924] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-13T17:31:38.571784] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:31:38.817967] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-13T17:31:39.175317] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:31:39.617943] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-13T17:31:39.789960] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T17:31:40.417973] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-13T17:31:40.752230] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T17:31:41.217916] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-13T17:31:41.502340] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T17:31:42.017963] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-13T17:31:42.817917] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-13T17:31:43.213421] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:31:43.257335] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:31:43.617943] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-13T17:31:44.009464] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:31:44.417989] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-13T17:31:45.218042] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-13T17:31:45.573715] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:31:45.832887] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T17:31:46.017971] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-13T17:31:46.538195] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:31:46.817929] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-13T17:31:47.336160] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T17:31:47.617889] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-13T17:31:47.738109] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:31:48.417953] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-13T17:31:48.866799] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T17:31:49.217902] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-13T17:31:49.433922] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T17:31:50.017974] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-13T17:31:50.796758] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T17:31:50.817880] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-13T17:31:51.128470] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:31:51.617914] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-13T17:31:52.417961] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-13T17:31:52.712800] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T17:31:52.921936] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:31:52.925968] [INFO ] [REMOTE ] BCH: Full fetch complete (41345 records). [2025-10-13T17:31:52.926066] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-13T17:31:53.223024] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-13T17:31:53.308405] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-13T17:31:53.308496] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-13T17:31:53.309039] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-13T17:31:53.309104] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-13T17:31:53.310068] [DEBUG] [LOCAL ] BCH: Trimmed 41345 records to 30043 (keeping 200 days of data) [2025-10-13T17:31:53.480487] [DEBUG] [LOCAL ] BCH: Primary data saved (30043 records). [2025-10-13T17:31:53.480625] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-13T17:31:53.480741] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCH took 39.1s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-13T17:31:53.650075] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:53.669886] [DEBUG] [LOCAL ] BCX: Loaded 22009 existing records from primary storage. [2025-10-13T17:31:53.670142] [INFO ] [MAIN ] BCX: Loaded 22009 existing records. [2025-10-13T17:31:53.787061] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:31:53.879825] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:53.880111] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-13T17:31:53.880167] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-13T17:31:53.880435] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-13T17:31:53.880475] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-13T17:31:54.031602] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-13T17:31:54.250090] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:54.817911] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-13T17:31:55.142801] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:31:55.145277] [INFO ] [REMOTE ] BCO: Full fetch complete (36245 records). [2025-10-13T17:31:55.145374] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-13T17:31:55.529975] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-13T17:31:55.530270] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-13T17:31:55.530813] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-13T17:31:55.530894] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-13T17:31:55.532329] [DEBUG] [LOCAL ] BCO: Trimmed 36245 records to 25559 (keeping 200 days of data) [2025-10-13T17:31:55.621667] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-13T17:31:55.663138] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-13T17:31:55.747435] [DEBUG] [LOCAL ] BCO: Primary data saved (25559 records). [2025-10-13T17:31:55.747585] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-13T17:31:55.747692] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCO took 38.3s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-13T17:31:56.019493] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:31:56.418035] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-13T17:31:56.888142] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:31:57.217941] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-13T17:31:58.017900] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-13T17:31:58.352030] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T17:31:58.419132] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:31:58.818063] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-13T17:31:58.943171] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:31:59.617923] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-13T17:32:00.424875] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-13T17:32:00.445255] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T17:32:00.556386] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:32:00.560382] [INFO ] [REMOTE ] BCSF: Full fetch complete (39247 records). [2025-10-13T17:32:00.560469] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-13T17:32:00.946361] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-13T17:32:00.946447] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-13T17:32:00.946970] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-13T17:32:00.947032] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-13T17:32:00.948024] [DEBUG] [LOCAL ] BCSF: Trimmed 39247 records to 28213 (keeping 200 days of data) [2025-10-13T17:32:01.121958] [DEBUG] [LOCAL ] BCSF: Primary data saved (28213 records). [2025-10-13T17:32:01.122101] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-13T17:32:01.122838] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCSF took 29.8s. Estimated remaining: 4h 46m 26s. Rate: 7.4 symbols/min [2025-10-13T17:32:01.217935] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-13T17:32:01.797211] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T17:32:02.017971] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-13T17:32:02.942597] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:32:02.948216] [INFO ] [REMOTE ] BCS: Full fetch complete (77333 records). [2025-10-13T17:32:02.948349] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-13T17:32:03.325526] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:32:03.393713] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-13T17:32:03.439075] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-13T17:32:03.439220] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-13T17:32:03.440270] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-13T17:32:03.440343] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-13T17:32:03.442630] [DEBUG] [LOCAL ] BCS: Trimmed 77333 records to 53441 (keeping 200 days of data) [2025-10-13T17:32:03.785089] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-13T17:32:03.785253] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-13T17:32:03.785338] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCS took 38.9s. Estimated remaining: 4h 45m 30s. Rate: 7.5 symbols/min [2025-10-13T17:32:04.648515] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:32:04.654880] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-13T17:32:05.519931] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T17:32:05.524387] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-13T17:32:06.549015] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T17:32:06.554080] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-13T17:32:07.644926] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:32:07.651065] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-13T17:32:08.560964] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T17:32:08.565301] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-13T17:32:09.419584] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:32:09.424371] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-13T17:32:10.429546] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T17:32:10.432145] [INFO ] [REMOTE ] BCX: Full fetch complete (33421 records). [2025-10-13T17:32:10.432258] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-13T17:32:10.432950] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:32:10.433061] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:32:10.433104] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:32:10.433142] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-13T17:32:10.433197] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-13T17:32:10.433233] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-10-13T17:32:10.433412] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-10-13T17:32:10.433550] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BCX took 17.0s. Estimated remaining: 4h 45m 10s. Rate: 7.5 symbols/min [2025-10-13T17:32:11.113494] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.115687] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.159906] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.184732] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.232514] [DEBUG] [LOCAL ] BDC: Loaded 24890 existing records from primary storage. [2025-10-13T17:32:11.233777] [INFO ] [MAIN ] BDC: Loaded 24890 existing records. [2025-10-13T17:32:11.273724] [DEBUG] [LOCAL ] BDN: Loaded 48258 existing records from primary storage. [2025-10-13T17:32:11.328833] [INFO ] [MAIN ] BDN: Loaded 48258 existing records. [2025-10-13T17:32:11.338322] [DEBUG] [LOCAL ] BDJ: Loaded 29717 existing records from primary storage. [2025-10-13T17:32:11.385606] [INFO ] [MAIN ] BDJ: Loaded 29717 existing records. [2025-10-13T17:32:11.619514] [DEBUG] [LOCAL ] BDX: Loaded 52941 existing records from primary storage. [2025-10-13T17:32:11.644795] [INFO ] [MAIN ] BDX: Loaded 52941 existing records. [2025-10-13T17:32:11.772311] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:11.938806] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-13T17:32:11.938607] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:11.994812] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-13T17:32:12.042930] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-13T17:32:12.082185] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:12.083231] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.086560] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:12.086889] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-13T17:32:12.086672] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-13T17:32:12.087261] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.108035] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-13T17:32:12.092594] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-13T17:32:12.108226] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-13T17:32:12.127573] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-13T17:32:12.107945] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.168506] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-13T17:32:12.168607] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-13T17:32:12.224070] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-13T17:32:12.369736] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-13T17:32:13.508745] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.553225] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-13T17:32:13.565847] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.577350] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-13T17:32:13.569903] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.589977] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-13T17:32:13.658136] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.658624] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-13T17:32:14.846300] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T17:32:14.852892] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-13T17:32:14.948699] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:32:14.953549] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-13T17:32:15.175070] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:32:15.185908] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-13T17:32:15.312607] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:32:15.322592] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-13T17:32:15.848939] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:32:15.854148] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-13T17:32:16.134906] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:32:16.141417] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-13T17:32:16.796086] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:32:16.801602] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-13T17:32:17.063254] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:32:17.146734] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:32:17.217977] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-13T17:32:17.359036] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:32:17.992753] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T17:32:18.017976] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-13T17:32:18.817921] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-13T17:32:18.952870] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:32:19.089589] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T17:32:19.617950] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-13T17:32:19.808091] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:32:20.417982] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-13T17:32:20.811832] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:32:21.217968] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-13T17:32:21.651958] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:32:22.017933] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-13T17:32:22.377708] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:32:22.817956] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-13T17:32:23.155046] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:32:23.617927] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-13T17:32:24.025497] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:32:24.417902] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-13T17:32:24.616047] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:32:25.217974] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-13T17:32:25.352467] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:32:26.017941] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-13T17:32:26.470373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T17:32:26.817946] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-13T17:32:27.617928] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-13T17:32:28.115811] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:32:28.147916] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-13T17:32:28.417922] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-13T17:32:28.509769] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:32:29.217929] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-13T17:32:30.017889] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-13T17:32:30.127977] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:32:30.189568] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:32:30.817919] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-13T17:32:31.159762] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:32:31.162563] [INFO ] [REMOTE ] BDC: Full fetch complete (35776 records). [2025-10-13T17:32:31.162639] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-13T17:32:31.526286] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-13T17:32:31.526375] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-13T17:32:31.526883] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-13T17:32:31.526946] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-13T17:32:31.527906] [DEBUG] [LOCAL ] BDC: Trimmed 35776 records to 24544 (keeping 200 days of data) [2025-10-13T17:32:31.618351] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-13T17:32:31.693578] [DEBUG] [LOCAL ] BDC: Primary data saved (24544 records). [2025-10-13T17:32:31.693747] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-13T17:32:31.693838] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDC took 21.3s. Estimated remaining: 4h 46m 59s. Rate: 7.4 symbols/min [2025-10-13T17:32:31.865801] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:31.917607] [DEBUG] [LOCAL ] BE: Loaded 54439 existing records from primary storage. [2025-10-13T17:32:31.917948] [INFO ] [MAIN ] BE: Loaded 54439 existing records. [2025-10-13T17:32:32.086588] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:32:32.106766] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:32.110104] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-13T17:32:32.110267] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-13T17:32:32.110473] [INFO ] [REMOTE ] BDJ: Full fetch complete (42942 records). [2025-10-13T17:32:32.110546] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-13T17:32:32.110666] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-13T17:32:32.110733] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-13T17:32:32.428127] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-13T17:32:32.865744] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:32.896882] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-13T17:32:32.896974] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-13T17:32:32.897566] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-13T17:32:32.897609] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-13T17:32:32.898878] [DEBUG] [LOCAL ] BDJ: Trimmed 42942 records to 29388 (keeping 200 days of data) [2025-10-13T17:32:33.080995] [DEBUG] [LOCAL ] BDJ: Primary data saved (29388 records). [2025-10-13T17:32:33.081401] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-13T17:32:33.081588] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDJ took 22.6s. Estimated remaining: 4h 45m 52s. Rate: 7.4 symbols/min [2025-10-13T17:32:33.226708] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-13T17:32:33.261768] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:33.261955] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-13T17:32:33.262053] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-13T17:32:33.262334] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-13T17:32:33.262403] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-13T17:32:33.262558] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-13T17:32:33.262782] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-13T17:32:33.633815] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:33.716017] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:32:33.907534] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:32:34.017911] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-13T17:32:34.753784] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:32:34.821913] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-13T17:32:35.099616] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T17:32:35.141152] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T17:32:35.617937] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-13T17:32:36.417919] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-13T17:32:36.738379] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-13T17:32:37.217930] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-13T17:32:37.731301] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T17:32:38.017920] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-13T17:32:38.430807] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T17:32:38.817907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-13T17:32:38.950869] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T17:32:39.618028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-13T17:32:40.417931] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-13T17:32:40.595045] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:32:41.217907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-13T17:32:41.325552] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:32:42.017939] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-13T17:32:42.389514] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:32:42.450200] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:32:42.817909] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-13T17:32:43.617888] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-13T17:32:43.969587] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:32:44.086510] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T17:32:44.100231] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:32:44.417931] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-13T17:32:44.834001] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-13T17:32:45.217967] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-13T17:32:46.017937] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-13T17:32:46.817913] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-13T17:32:47.183605] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T17:32:47.617913] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-13T17:32:48.168209] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-13T17:32:48.417985] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-13T17:32:48.485670] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:32:48.798758] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-13T17:32:49.094088] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:32:49.217955] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-13T17:32:50.017963] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-13T17:32:50.817936] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-13T17:32:51.015211] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:32:51.618044] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-13T17:32:51.976699] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:32:52.416638] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:32:52.426445] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-13T17:32:52.667664] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-13T17:32:53.217898] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-13T17:32:53.335797] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:32:54.017947] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-13T17:32:54.253134] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-13T17:32:54.711049] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:32:54.716681] [INFO ] [REMOTE ] BDX: Full fetch complete (75442 records). [2025-10-13T17:32:54.716836] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-13T17:32:54.823165] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-13T17:32:55.124045] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-13T17:32:55.124145] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-13T17:32:55.124973] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-13T17:32:55.125042] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-13T17:32:55.129123] [DEBUG] [LOCAL ] BDX: Trimmed 75442 records to 52183 (keeping 200 days of data) [2025-10-13T17:32:55.354761] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:32:55.490534] [DEBUG] [LOCAL ] BDX: Primary data saved (52183 records). [2025-10-13T17:32:55.490721] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-13T17:32:55.492107] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 45.1s. Estimated remaining: 4h 47m 49s. Rate: 7.4 symbols/min [2025-10-13T17:32:55.623167] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-13T17:32:55.668142] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:55.723638] [DEBUG] [LOCAL ] BEKE: Loaded 54007 existing records from primary storage. [2025-10-13T17:32:55.724015] [INFO ] [MAIN ] BEKE: Loaded 54007 existing records. [2025-10-13T17:32:55.905436] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:55.905724] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-13T17:32:55.905782] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-13T17:32:55.906256] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-13T17:32:55.906317] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-13T17:32:56.282746] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:56.417925] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-13T17:32:57.218021] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-13T17:32:57.245463] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:32:57.250581] [INFO ] [REMOTE ] BDN: Full fetch complete (69161 records). [2025-10-13T17:32:57.250739] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-13T17:32:57.649768] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-13T17:32:57.649867] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-13T17:32:57.650737] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-13T17:32:57.650815] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-13T17:32:57.652308] [DEBUG] [LOCAL ] BDN: Trimmed 69161 records to 47607 (keeping 200 days of data) [2025-10-13T17:32:57.940497] [DEBUG] [LOCAL ] BDN: Primary data saved (47607 records). [2025-10-13T17:32:57.940632] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-13T17:32:57.940791] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDN took 47.5s. Estimated remaining: 4h 46m 52s. Rate: 7.4 symbols/min [2025-10-13T17:32:58.030832] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-13T17:32:58.112907] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:58.163884] [DEBUG] [LOCAL ] BEN: Loaded 53824 existing records from primary storage. [2025-10-13T17:32:58.164213] [INFO ] [MAIN ] BEN: Loaded 53824 existing records. [2025-10-13T17:32:58.348359] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:58.348766] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-13T17:32:58.348863] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-13T17:32:58.349383] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-13T17:32:58.349528] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-13T17:32:58.602278] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-13T17:32:58.675458] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T17:32:58.682353] [INFO ] [REMOTE ] BEDU: Full fetch complete (1388 records). [2025-10-13T17:32:58.701438] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-13T17:32:58.824076] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-13T17:32:58.875526] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:58.970063] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-13T17:32:58.970352] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:32:58.970436] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:32:58.970532] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-13T17:32:58.970620] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-13T17:32:58.970750] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-13T17:32:58.970820] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-13T17:32:58.970901] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 25.9s. Estimated remaining: 4h 45m 42s. Rate: 7.4 symbols/min [2025-10-13T17:32:59.141746] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:59.180504] [DEBUG] [LOCAL ] BEP: Loaded 39584 existing records from primary storage. [2025-10-13T17:32:59.180815] [INFO ] [MAIN ] BEP: Loaded 39584 existing records. [2025-10-13T17:32:59.360318] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:59.360796] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-13T17:32:59.360928] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-13T17:32:59.361457] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-13T17:32:59.361533] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-13T17:32:59.502894] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-13T17:32:59.623133] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-13T17:32:59.781781] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:00.417964] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-13T17:33:00.728125] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T17:33:01.217953] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-13T17:33:01.429938] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:33:02.017950] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-13T17:33:02.220908] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:33:02.818022] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-13T17:33:03.151487] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T17:33:03.617954] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-13T17:33:03.671662] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:33:04.021039] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:33:04.417930] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-13T17:33:05.217965] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-13T17:33:05.507301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:33:05.778338] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:33:06.017942] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-13T17:33:06.753633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:33:06.818051] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-13T17:33:07.618044] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-13T17:33:08.336870] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:33:08.412820] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-13T17:33:08.423181] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-13T17:33:09.217931] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-13T17:33:09.484790] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:33:09.954519] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:33:10.017906] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-13T17:33:10.818015] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-13T17:33:11.515110] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:33:11.562804] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-13T17:33:11.617944] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-13T17:33:12.379116] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:33:12.417908] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-13T17:33:12.899249] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:33:13.217984] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-13T17:33:14.017981] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-13T17:33:14.817926] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-13T17:33:14.984393] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-13T17:33:14.990714] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-13T17:33:14.990922] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-13T17:33:15.234426] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T17:33:15.452031] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-13T17:33:15.452288] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-13T17:33:15.453434] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-13T17:33:15.453676] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-13T17:33:15.455619] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53661 (keeping 200 days of data) [2025-10-13T17:33:15.593620] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:33:15.618221] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-13T17:33:15.838589] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-13T17:33:15.838828] [INFO ] [MAIN ] BE: Full history saved. [2025-10-13T17:33:15.838948] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BE took 44.1s. Estimated remaining: 4h 46m 50s. Rate: 7.4 symbols/min [2025-10-13T17:33:16.021926] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:16.069558] [DEBUG] [LOCAL ] BEPC: Loaded 47216 existing records from primary storage. [2025-10-13T17:33:16.069983] [INFO ] [MAIN ] BEPC: Loaded 47216 existing records. [2025-10-13T17:33:16.259738] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:16.260185] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-13T17:33:16.260349] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-13T17:33:16.260943] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-13T17:33:16.261010] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-13T17:33:16.433706] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-13T17:33:16.518450] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:33:16.659789] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:17.125754] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:33:17.217930] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-13T17:33:18.017911] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-13T17:33:18.385131] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:33:18.809440] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:33:18.819322] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-13T17:33:19.617934] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-13T17:33:19.829019] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T17:33:20.425957] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-13T17:33:20.445376] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:33:21.217939] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-13T17:33:21.395870] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T17:33:21.974076] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:33:22.017905] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-13T17:33:22.737235] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:33:22.817882] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-13T17:33:23.527563] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:33:23.617906] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-13T17:33:24.396094] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:33:24.417884] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-13T17:33:24.754019] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:33:24.758758] [INFO ] [REMOTE ] BEP: Full fetch complete (58828 records). [2025-10-13T17:33:24.758869] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-13T17:33:25.144204] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-13T17:33:25.144361] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-13T17:33:25.145425] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-13T17:33:25.145494] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-13T17:33:25.147234] [DEBUG] [LOCAL ] BEP: Trimmed 58828 records to 38934 (keeping 200 days of data) [2025-10-13T17:33:25.238898] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-13T17:33:25.423204] [DEBUG] [LOCAL ] BEP: Primary data saved (38934 records). [2025-10-13T17:33:25.423396] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-13T17:33:25.424119] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 26.5s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-13T17:33:25.596371] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:25.607459] [DEBUG] [LOCAL ] BEPH: Loaded 5407 existing records from primary storage. [2025-10-13T17:33:25.607767] [INFO ] [MAIN ] BEPH: Loaded 5407 existing records. [2025-10-13T17:33:25.783920] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:25.784231] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-13T17:33:25.784281] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-13T17:33:25.784490] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-13T17:33:25.784547] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-13T17:33:26.026006] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-13T17:33:26.150370] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:26.556760] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T17:33:26.817988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-13T17:33:27.146977] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T17:33:27.617949] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-13T17:33:27.892094] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:33:28.080777] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:33:28.417931] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-13T17:33:29.110274] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:33:29.217908] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-13T17:33:29.476936] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:33:30.017908] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-13T17:33:30.695193] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:33:30.817922] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-13T17:33:31.617977] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-13T17:33:31.936825] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:33:32.123639] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:33:32.182727] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:33:32.417924] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-13T17:33:32.945244] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T17:33:33.217926] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-13T17:33:33.897069] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T17:33:34.017958] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-13T17:33:34.818021] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-13T17:33:35.617949] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-13T17:33:35.811506] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:33:35.817083] [INFO ] [REMOTE ] BEKE: Full fetch complete (77182 records). [2025-10-13T17:33:35.817193] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-13T17:33:36.198493] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-13T17:33:36.198580] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-13T17:33:36.199454] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-13T17:33:36.199519] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-13T17:33:36.201116] [DEBUG] [LOCAL ] BEKE: Trimmed 77182 records to 53220 (keeping 200 days of data) [2025-10-13T17:33:36.418383] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-13T17:33:36.520855] [DEBUG] [LOCAL ] BEKE: Primary data saved (53220 records). [2025-10-13T17:33:36.521007] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-13T17:33:36.521092] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 41.0s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-13T17:33:36.692784] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:36.698290] [DEBUG] [LOCAL ] BEPI: Loaded 3641 existing records from primary storage. [2025-10-13T17:33:36.698460] [INFO ] [MAIN ] BEPI: Loaded 3641 existing records. [2025-10-13T17:33:36.911552] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T17:33:36.910483] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:36.917412] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-13T17:33:36.917518] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-13T17:33:36.917973] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-13T17:33:36.918062] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-13T17:33:36.930129] [INFO ] [REMOTE ] BEN: Full fetch complete (76913 records). [2025-10-13T17:33:36.950849] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-13T17:33:37.294046] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T17:33:37.398238] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-13T17:33:37.655403] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:37.730343] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T17:33:37.786245] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-13T17:33:37.786430] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-13T17:33:37.787301] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-13T17:33:37.787387] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-13T17:33:37.788977] [DEBUG] [LOCAL ] BEN: Trimmed 76913 records to 53109 (keeping 200 days of data) [2025-10-13T17:33:38.017783] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:33:38.018210] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-13T17:33:38.127191] [DEBUG] [LOCAL ] BEN: Primary data saved (53109 records). [2025-10-13T17:33:38.127339] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-13T17:33:38.127420] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEN took 40.2s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-13T17:33:38.292292] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:38.296944] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-13T17:33:38.297120] [INFO ] [MAIN ] BEPJ: Loaded 3156 existing records. [2025-10-13T17:33:38.471197] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:38.471418] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-13T17:33:38.471463] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-13T17:33:38.471638] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-13T17:33:38.471731] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-13T17:33:38.823094] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-13T17:33:38.864508] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:39.550759] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:33:39.617926] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-13T17:33:39.766402] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:33:40.145949] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T17:33:40.417936] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-13T17:33:41.217975] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-13T17:33:41.836234] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:33:42.017910] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-13T17:33:42.073825] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:33:42.588787] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:33:42.818053] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-13T17:33:43.617931] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-13T17:33:44.167154] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:33:44.357415] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:33:44.417961] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-13T17:33:44.891329] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:33:45.217926] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-13T17:33:46.017931] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-13T17:33:46.466495] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T17:33:46.817935] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-13T17:33:46.855827] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:33:46.861749] [INFO ] [REMOTE ] BEPC: Full fetch complete (68340 records). [2025-10-13T17:33:46.861867] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-13T17:33:46.862696] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:33:46.862788] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:33:46.862831] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:33:46.862870] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-13T17:33:46.862925] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-13T17:33:46.862959] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-13T17:33:46.863144] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-10-13T17:33:46.863238] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPC took 31.0s. Estimated remaining: 4h 46m 6s. Rate: 7.4 symbols/min [2025-10-13T17:33:47.031361] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:47.065124] [DEBUG] [LOCAL ] BFAM: Loaded 33979 existing records from primary storage. [2025-10-13T17:33:47.065426] [INFO ] [MAIN ] BFAM: Loaded 33979 existing records. [2025-10-13T17:33:47.241473] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:47.241713] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-13T17:33:47.241768] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-13T17:33:47.242143] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-13T17:33:47.242198] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-13T17:33:47.530893] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T17:33:47.609035] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:47.617884] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-13T17:33:48.417898] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-13T17:33:49.025921] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T17:33:49.025770] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:33:49.217978] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-13T17:33:49.646340] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:33:50.017969] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-13T17:33:50.605195] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T17:33:50.817977] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-13T17:33:51.306096] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-13T17:33:51.617920] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-13T17:33:52.346087] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T17:33:52.347326] [INFO ] [REMOTE ] BEPH: Full fetch complete (7621 records). [2025-10-13T17:33:52.347398] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-13T17:33:52.423210] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-13T17:33:52.762100] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-13T17:33:52.762194] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-13T17:33:52.762454] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-13T17:33:52.762495] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-13T17:33:52.762945] [DEBUG] [LOCAL ] BEPH: Trimmed 7621 records to 5283 (keeping 200 days of data) [2025-10-13T17:33:52.800879] [DEBUG] [LOCAL ] BEPH: Primary data saved (5283 records). [2025-10-13T17:33:52.801026] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-13T17:33:52.801115] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPH took 27.4s. Estimated remaining: 4h 45m 40s. Rate: 7.4 symbols/min [2025-10-13T17:33:52.968566] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:33:53.006194] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:53.051871] [DEBUG] [LOCAL ] BFH: Loaded 42048 existing records from primary storage. [2025-10-13T17:33:53.052228] [INFO ] [MAIN ] BFH: Loaded 42048 existing records. [2025-10-13T17:33:53.228942] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-13T17:33:53.235614] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:53.237174] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-13T17:33:53.237231] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-13T17:33:53.237704] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-13T17:33:53.237773] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-13T17:33:53.652728] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:53.714276] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:33:54.017954] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-13T17:33:54.509169] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:33:54.817951] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-13T17:33:55.340509] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T17:33:55.617939] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-13T17:33:56.417928] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-13T17:33:56.830292] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:33:56.978541] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:33:57.218019] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-13T17:33:57.820464] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T17:33:58.018026] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-13T17:33:58.817939] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-13T17:33:59.277987] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T17:33:59.604493] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:33:59.617880] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-13T17:34:00.418068] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-13T17:34:01.007367] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:34:01.217907] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-13T17:34:01.285134] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:34:01.734988] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:34:01.735820] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4471 records). [2025-10-13T17:34:01.735890] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-13T17:34:02.023271] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-13T17:34:02.138743] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-13T17:34:02.138834] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-13T17:34:02.138986] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-13T17:34:02.139048] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-13T17:34:02.139415] [DEBUG] [LOCAL ] BEPJ: Trimmed 4471 records to 3122 (keeping 200 days of data) [2025-10-13T17:34:02.159229] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3122 records). [2025-10-13T17:34:02.159367] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-13T17:34:02.159528] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPJ took 24.0s. Estimated remaining: 4h 45m 43s. Rate: 7.4 symbols/min [2025-10-13T17:34:02.331076] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:02.345838] [DEBUG] [LOCAL ] BFK: Loaded 13833 existing records from primary storage. [2025-10-13T17:34:02.346044] [INFO ] [MAIN ] BFK: Loaded 13833 existing records. [2025-10-13T17:34:02.523320] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:02.523619] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-13T17:34:02.523700] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-13T17:34:02.523958] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-13T17:34:02.524026] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-13T17:34:02.823037] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-13T17:34:02.877580] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:03.551080] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:34:03.605892] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:34:03.617894] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-13T17:34:04.417961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-13T17:34:04.741497] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:34:05.217976] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-13T17:34:05.796442] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:34:06.017904] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-13T17:34:06.110828] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T17:34:06.817924] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-13T17:34:07.298388] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:34:07.372580] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T17:34:07.617926] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-13T17:34:08.417982] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-13T17:34:09.012001] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:34:09.217938] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-13T17:34:09.875459] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:34:10.017927] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-13T17:34:10.182566] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:34:10.578135] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:34:10.818030] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-13T17:34:11.617927] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-13T17:34:12.228153] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:34:12.417896] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-13T17:34:12.519217] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:34:13.217919] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-13T17:34:13.745745] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:34:13.761969] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T17:34:14.017923] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-13T17:34:14.817940] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-13T17:34:15.092990] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T17:34:15.617929] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-13T17:34:16.165274] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:34:16.417961] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-13T17:34:16.451137] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:34:16.884628] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T17:34:17.217948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-13T17:34:17.753788] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T17:34:17.754829] [INFO ] [REMOTE ] BEPI: Full fetch complete (4797 records). [2025-10-13T17:34:17.754905] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-13T17:34:18.023211] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-13T17:34:18.140469] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-13T17:34:18.140561] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-13T17:34:18.140814] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-13T17:34:18.140877] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-13T17:34:18.141296] [DEBUG] [LOCAL ] BEPI: Trimmed 4797 records to 3617 (keeping 200 days of data) [2025-10-13T17:34:18.165585] [DEBUG] [LOCAL ] BEPI: Primary data saved (3617 records). [2025-10-13T17:34:18.165784] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-13T17:34:18.165886] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BEPI took 41.6s. Estimated remaining: 4h 46m 41s. Rate: 7.4 symbols/min [2025-10-13T17:34:18.347538] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:18.401509] [DEBUG] [LOCAL ] BFLY: Loaded 52599 existing records from primary storage. [2025-10-13T17:34:18.401992] [INFO ] [MAIN ] BFLY: Loaded 52599 existing records. [2025-10-13T17:34:18.619170] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:18.619437] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-13T17:34:18.619488] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-13T17:34:18.619917] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-13T17:34:18.619979] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-13T17:34:18.823121] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-13T17:34:19.002216] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:19.618049] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-13T17:34:19.755077] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:34:19.866332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T17:34:20.418038] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-13T17:34:21.217965] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T17:34:21.223115] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-13T17:34:21.443192] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:34:22.017945] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-13T17:34:22.200082] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:34:22.817938] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-13T17:34:23.294240] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T17:34:23.617947] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-13T17:34:24.417949] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-13T17:34:24.468137] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:34:25.125089] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:34:25.217937] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-13T17:34:25.298985] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T17:34:26.017913] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-13T17:34:26.716624] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:34:26.817957] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-13T17:34:27.617944] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-13T17:34:27.786523] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:34:28.331634] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:34:28.335422] [INFO ] [REMOTE ] BFAM: Full fetch complete (47021 records). [2025-10-13T17:34:28.335504] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-13T17:34:28.423527] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-13T17:34:28.706028] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-13T17:34:28.706110] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-13T17:34:28.706612] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-13T17:34:28.706704] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-13T17:34:28.707620] [DEBUG] [LOCAL ] BFAM: Trimmed 47021 records to 33707 (keeping 200 days of data) [2025-10-13T17:34:28.904895] [DEBUG] [LOCAL ] BFAM: Primary data saved (33707 records). [2025-10-13T17:34:28.905029] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-13T17:34:28.905122] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFAM took 42.0s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-13T17:34:29.072431] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:29.097395] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:34:29.112531] [DEBUG] [LOCAL ] BFS: Loaded 9495 existing records from primary storage. [2025-10-13T17:34:29.112762] [INFO ] [MAIN ] BFS: Loaded 9495 existing records. [2025-10-13T17:34:29.223171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-13T17:34:29.289703] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:29.289884] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-13T17:34:29.289949] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-13T17:34:29.290132] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-13T17:34:29.290188] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-13T17:34:29.633244] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:30.017960] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-13T17:34:30.112269] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T17:34:30.113940] [INFO ] [REMOTE ] BFK: Full fetch complete (18912 records). [2025-10-13T17:34:30.114028] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-13T17:34:30.424246] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T17:34:30.514948] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-13T17:34:30.515020] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-13T17:34:30.515331] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-13T17:34:30.515369] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-13T17:34:30.515916] [DEBUG] [LOCAL ] BFK: Trimmed 18912 records to 13519 (keeping 200 days of data) [2025-10-13T17:34:30.601683] [DEBUG] [LOCAL ] BFK: Primary data saved (13519 records). [2025-10-13T17:34:30.601812] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-13T17:34:30.601885] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 28.4s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-13T17:34:30.773628] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:30.785922] [DEBUG] [LOCAL ] BFZ: Loaded 12034 existing records from primary storage. [2025-10-13T17:34:30.786118] [INFO ] [MAIN ] BFZ: Loaded 12034 existing records. [2025-10-13T17:34:30.827830] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-13T17:34:30.961218] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:30.961431] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-13T17:34:30.961476] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-13T17:34:30.961637] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-13T17:34:30.961726] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-13T17:34:31.312838] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:31.332486] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:34:31.617907] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-13T17:34:32.417958] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-13T17:34:32.651202] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:34:33.069951] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:34:33.217901] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-13T17:34:33.358232] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:34:34.017976] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-13T17:34:34.685358] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T17:34:34.817958] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-13T17:34:35.042804] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:34:35.564468] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T17:34:35.617954] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-13T17:34:36.418032] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-13T17:34:36.665888] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T17:34:37.217965] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-13T17:34:38.001605] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:34:38.017885] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-13T17:34:38.063710] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:34:38.755706] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:34:38.818141] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-13T17:34:39.617934] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-13T17:34:39.656865] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T17:34:40.418024] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-13T17:34:40.447248] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:34:41.215317] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T17:34:41.218396] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-13T17:34:41.849541] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:34:42.017910] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-13T17:34:42.817936] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-13T17:34:43.389004] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:34:43.394305] [INFO ] [REMOTE ] BFH: Full fetch complete (59725 records). [2025-10-13T17:34:43.394501] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-13T17:34:43.625637] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-13T17:34:43.787251] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-13T17:34:43.787338] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-13T17:34:43.788057] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-13T17:34:43.788121] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-13T17:34:43.789384] [DEBUG] [LOCAL ] BFH: Trimmed 59725 records to 41480 (keeping 200 days of data) [2025-10-13T17:34:44.043900] [DEBUG] [LOCAL ] BFH: Primary data saved (41480 records). [2025-10-13T17:34:44.044034] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-13T17:34:44.044774] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFH took 51.2s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-13T17:34:44.224233] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:44.281144] [DEBUG] [LOCAL ] BG: Loaded 51146 existing records from primary storage. [2025-10-13T17:34:44.281578] [INFO ] [MAIN ] BG: Loaded 51146 existing records. [2025-10-13T17:34:44.433525] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-13T17:34:44.485030] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:44.495375] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T17:34:44.494924] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-13T17:34:44.498505] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-13T17:34:44.499913] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-13T17:34:44.500139] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-13T17:34:44.810064] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:34:44.930705] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:45.218022] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-13T17:34:45.234343] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T17:34:46.017935] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-13T17:34:46.817932] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-13T17:34:46.870093] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:34:46.998414] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:34:47.617908] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-13T17:34:47.692255] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T17:34:48.417944] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-13T17:34:49.217905] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-13T17:34:49.414042] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:34:49.897466] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:34:50.017899] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-13T17:34:50.190074] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T17:34:50.817925] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-13T17:34:51.617946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-13T17:34:52.012031] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T17:34:52.018129] [INFO ] [REMOTE ] BFLY: Full fetch complete (75322 records). [2025-10-13T17:34:52.018318] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-13T17:34:52.438298] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-13T17:34:52.497585] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-13T17:34:52.498138] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-13T17:34:52.499369] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-13T17:34:52.499532] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-13T17:34:52.508241] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T17:34:52.512614] [DEBUG] [LOCAL ] BFLY: Trimmed 75322 records to 51828 (keeping 200 days of data) [2025-10-13T17:34:52.629001] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:34:52.862681] [DEBUG] [LOCAL ] BFLY: Primary data saved (51828 records). [2025-10-13T17:34:52.862883] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-13T17:34:52.862985] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFLY took 34.7s. Estimated remaining: 4h 46m 27s. Rate: 7.4 symbols/min [2025-10-13T17:34:53.034742] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:53.057903] [DEBUG] [LOCAL ] BGB: Loaded 18164 existing records from primary storage. [2025-10-13T17:34:53.058274] [INFO ] [MAIN ] BGB: Loaded 18164 existing records. [2025-10-13T17:34:53.218476] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-13T17:34:53.240597] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:53.241805] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-13T17:34:53.241861] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-13T17:34:53.242120] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-13T17:34:53.242177] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-13T17:34:53.429605] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:34:53.507591] [INFO ] [REMOTE ] BFZ: Full fetch complete (17457 records). [2025-10-13T17:34:53.537290] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-13T17:34:53.755145] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:53.893010] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:34:54.024110] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-13T17:34:54.056587] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-13T17:34:54.056720] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-13T17:34:54.057239] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-13T17:34:54.057306] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-13T17:34:54.058151] [DEBUG] [LOCAL ] BFZ: Trimmed 17457 records to 11930 (keeping 200 days of data) [2025-10-13T17:34:54.137051] [DEBUG] [LOCAL ] BFZ: Primary data saved (11930 records). [2025-10-13T17:34:54.137256] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-13T17:34:54.137359] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 23.5s. Estimated remaining: 4h 45m 22s. Rate: 7.4 symbols/min [2025-10-13T17:34:54.318468] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:54.338218] [DEBUG] [LOCAL ] BGH: Loaded 17497 existing records from primary storage. [2025-10-13T17:34:54.338550] [INFO ] [MAIN ] BGH: Loaded 17497 existing records. [2025-10-13T17:34:54.527921] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:54.528258] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-13T17:34:54.528311] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-13T17:34:54.528534] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-13T17:34:54.528593] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-13T17:34:54.823131] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-13T17:34:54.844415] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:34:54.957309] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:55.617935] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-13T17:34:56.417943] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-13T17:34:56.485444] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:34:56.555977] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:34:57.217927] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-13T17:34:57.302251] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T17:34:57.862615] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T17:34:58.017973] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-13T17:34:58.639865] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T17:34:58.817957] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-13T17:34:59.617916] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-13T17:34:59.637044] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T17:35:00.418031] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-13T17:35:00.526841] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T17:35:01.217981] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-13T17:35:02.017971] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-13T17:35:02.291004] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:35:02.361831] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:35:02.817973] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-13T17:35:03.047738] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:35:03.617962] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-13T17:35:04.417915] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-13T17:35:04.453712] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:35:04.580845] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:35:05.217977] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-13T17:35:05.341426] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T17:35:06.018006] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-13T17:35:06.817935] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-13T17:35:06.978902] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:35:07.025602] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T17:35:07.617894] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-13T17:35:07.728609] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T17:35:08.417935] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-13T17:35:09.217903] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-13T17:35:09.250297] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:35:09.505567] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T17:35:09.820295] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T17:35:09.822046] [INFO ] [REMOTE ] BFS: Full fetch complete (12879 records). [2025-10-13T17:35:09.822118] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-13T17:35:10.027507] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-13T17:35:10.210473] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-13T17:35:10.210557] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-13T17:35:10.211010] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-13T17:35:10.211075] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-13T17:35:10.211582] [DEBUG] [LOCAL ] BFS: Trimmed 12879 records to 9473 (keeping 200 days of data) [2025-10-13T17:35:10.269331] [DEBUG] [LOCAL ] BFS: Primary data saved (9473 records). [2025-10-13T17:35:10.269469] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-13T17:35:10.269550] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BFS took 41.4s. Estimated remaining: 4h 46m 20s. Rate: 7.4 symbols/min [2025-10-13T17:35:10.448925] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:10.462850] [DEBUG] [LOCAL ] BGR: Loaded 13729 existing records from primary storage. [2025-10-13T17:35:10.463086] [INFO ] [MAIN ] BGR: Loaded 13729 existing records. [2025-10-13T17:35:10.645974] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:10.646217] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-13T17:35:10.646265] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-13T17:35:10.646472] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-13T17:35:10.646529] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-13T17:35:10.822466] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-13T17:35:11.041801] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:11.054812] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:35:11.617919] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-13T17:35:12.417965] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-13T17:35:12.568393] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T17:35:12.942284] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T17:35:13.015744] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:35:13.217945] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-13T17:35:14.017960] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-13T17:35:14.286240] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:35:14.772476] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T17:35:14.817953] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-13T17:35:15.617941] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-13T17:35:15.640314] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:35:16.417982] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-13T17:35:16.573219] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T17:35:17.217939] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-13T17:35:18.017914] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-13T17:35:18.063915] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:35:18.272724] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:35:18.573948] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T17:35:18.817961] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-13T17:35:19.625400] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-13T17:35:19.626680] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:35:20.417934] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-13T17:35:21.217916] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-13T17:35:21.509987] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:35:21.507414] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:35:21.526342] [INFO ] [REMOTE ] BGB: Full fetch complete (27003 records). [2025-10-13T17:35:21.526515] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-13T17:35:21.901847] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-13T17:35:21.902079] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-13T17:35:21.902691] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-13T17:35:21.902753] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-13T17:35:21.903469] [DEBUG] [LOCAL ] BGB: Trimmed 27003 records to 18070 (keeping 200 days of data) [2025-10-13T17:35:22.013085] [DEBUG] [LOCAL ] BGB: Primary data saved (18070 records). [2025-10-13T17:35:22.013237] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-13T17:35:22.013319] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 29.2s. Estimated remaining: 4h 46m 41s. Rate: 7.4 symbols/min [2025-10-13T17:35:22.024268] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-13T17:35:22.185071] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:35:22.225271] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:22.275829] [DEBUG] [LOCAL ] BGS: Loaded 51214 existing records from primary storage. [2025-10-13T17:35:22.276215] [INFO ] [MAIN ] BGS: Loaded 51214 existing records. [2025-10-13T17:35:22.457334] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:22.457827] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-13T17:35:22.457896] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-13T17:35:22.458301] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-13T17:35:22.458359] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-13T17:35:22.801332] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:22.817925] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-13T17:35:23.130464] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:35:23.617984] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-13T17:35:24.390785] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:35:24.417891] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-13T17:35:24.562518] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T17:35:25.217914] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-13T17:35:25.906584] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T17:35:26.017951] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-13T17:35:26.085246] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T17:35:26.817927] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-13T17:35:27.568759] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T17:35:27.617879] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-13T17:35:27.679578] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T17:35:27.682244] [INFO ] [REMOTE ] BGH: Full fetch complete (22782 records). [2025-10-13T17:35:27.682314] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-13T17:35:28.037947] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-13T17:35:28.038094] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-13T17:35:28.038540] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-13T17:35:28.038581] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-13T17:35:28.039209] [DEBUG] [LOCAL ] BGH: Trimmed 22782 records to 17259 (keeping 200 days of data) [2025-10-13T17:35:28.146020] [DEBUG] [LOCAL ] BGH: Primary data saved (17259 records). [2025-10-13T17:35:28.146161] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-13T17:35:28.146244] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGH took 34.0s. Estimated remaining: 4h 46m 16s. Rate: 7.4 symbols/min [2025-10-13T17:35:28.309413] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:28.317739] [DEBUG] [LOCAL ] BGSF: Loaded 7869 existing records from primary storage. [2025-10-13T17:35:28.317936] [INFO ] [MAIN ] BGSF: Loaded 7869 existing records. [2025-10-13T17:35:28.418076] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-13T17:35:28.497560] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:28.497813] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-13T17:35:28.497862] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-13T17:35:28.498051] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-13T17:35:28.498106] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-13T17:35:28.842571] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:29.091178] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:35:29.217973] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-13T17:35:30.017958] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-13T17:35:30.258860] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T17:35:30.264423] [INFO ] [REMOTE ] BG: Full fetch complete (72751 records). [2025-10-13T17:35:30.264556] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-13T17:35:30.670737] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-13T17:35:30.670966] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-13T17:35:30.672037] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-13T17:35:30.672117] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-13T17:35:30.674078] [DEBUG] [LOCAL ] BG: Trimmed 72751 records to 50492 (keeping 200 days of data) [2025-10-13T17:35:30.864284] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-13T17:35:30.953435] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:35:30.952553] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:35:31.058602] [DEBUG] [LOCAL ] BG: Primary data saved (50492 records). [2025-10-13T17:35:31.058816] [INFO ] [MAIN ] BG: Full history saved. [2025-10-13T17:35:31.059686] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BG took 47.0s. Estimated remaining: 4h 45m 26s. Rate: 7.4 symbols/min [2025-10-13T17:35:31.238063] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:31.259421] [DEBUG] [LOCAL ] BGT: Loaded 16808 existing records from primary storage. [2025-10-13T17:35:31.259789] [INFO ] [MAIN ] BGT: Loaded 16808 existing records. [2025-10-13T17:35:31.449887] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:31.450138] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-13T17:35:31.450188] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-13T17:35:31.450442] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-13T17:35:31.450499] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-13T17:35:31.554045] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:35:31.630779] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-13T17:35:31.812526] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:32.417886] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-13T17:35:32.471459] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T17:35:33.217966] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-13T17:35:33.960464] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:35:34.017963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-13T17:35:34.164138] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:35:34.754537] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:35:34.817923] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-13T17:35:35.617928] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-13T17:35:35.874623] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:35:36.417948] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-13T17:35:37.219504] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-13T17:35:37.223385] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:35:37.246122] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T17:35:38.013923] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:35:38.017870] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-13T17:35:38.817913] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-13T17:35:38.972758] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T17:35:39.618054] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-13T17:35:39.707067] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:35:40.417902] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-13T17:35:41.217963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-13T17:35:41.261837] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:35:41.263867] [INFO ] [REMOTE ] BGR: Full fetch complete (20074 records). [2025-10-13T17:35:41.264086] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-13T17:35:41.646982] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T17:35:41.740231] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-13T17:35:41.740316] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-13T17:35:41.740758] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-13T17:35:41.740825] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-13T17:35:41.741416] [DEBUG] [LOCAL ] BGR: Trimmed 20074 records to 13557 (keeping 200 days of data) [2025-10-13T17:35:41.825583] [DEBUG] [LOCAL ] BGR: Primary data saved (13557 records). [2025-10-13T17:35:41.825760] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-13T17:35:41.825854] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGR took 31.6s. Estimated remaining: 4h 45m 39s. Rate: 7.4 symbols/min [2025-10-13T17:35:42.014188] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:42.019743] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-13T17:35:42.032940] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:35:42.047933] [DEBUG] [LOCAL ] BGX: Loaded 11399 existing records from primary storage. [2025-10-13T17:35:42.048199] [INFO ] [MAIN ] BGX: Loaded 11399 existing records. [2025-10-13T17:35:42.225684] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:42.225960] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-13T17:35:42.226013] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-13T17:35:42.226203] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-13T17:35:42.226259] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-13T17:35:42.580068] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:42.704490] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T17:35:42.817898] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-13T17:35:43.617899] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-13T17:35:43.770416] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T17:35:44.417969] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-13T17:35:44.574949] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:35:45.217953] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-13T17:35:46.017908] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-13T17:35:46.156148] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T17:35:46.294127] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:35:46.748604] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T17:35:46.817919] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-13T17:35:47.204684] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T17:35:47.617929] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-13T17:35:48.417903] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-13T17:35:48.687387] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:35:49.217941] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-13T17:35:50.017901] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-13T17:35:50.208112] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:35:50.207434] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T17:35:50.580865] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:35:50.817920] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-13T17:35:51.621323] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-13T17:35:51.623579] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:35:52.171059] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:35:52.417968] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-13T17:35:53.217965] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-13T17:35:53.959391] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T17:35:54.006331] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:35:54.011879] [INFO ] [REMOTE ] BGS: Full fetch complete (72475 records). [2025-10-13T17:35:54.012088] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-13T17:35:54.024269] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-13T17:35:54.418701] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-13T17:35:54.418802] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-13T17:35:54.419581] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-13T17:35:54.419624] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-13T17:35:54.421088] [DEBUG] [LOCAL ] BGS: Trimmed 72475 records to 50490 (keeping 200 days of data) [2025-10-13T17:35:54.710608] [DEBUG] [LOCAL ] BGS: Primary data saved (50490 records). [2025-10-13T17:35:54.710780] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-13T17:35:54.710872] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 32.7s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-13T17:35:54.822121] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-13T17:35:54.879371] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:35:54.899105] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:54.924471] [DEBUG] [LOCAL ] BGY: Loaded 22421 existing records from primary storage. [2025-10-13T17:35:54.924774] [INFO ] [MAIN ] BGY: Loaded 22421 existing records. [2025-10-13T17:35:55.110281] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:55.111183] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-13T17:35:55.111244] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-13T17:35:55.111707] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-13T17:35:55.111766] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-13T17:35:55.521722] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:55.621833] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-13T17:35:55.624264] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T17:35:56.417973] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-13T17:35:56.582736] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:35:56.584566] [INFO ] [REMOTE ] BGT: Full fetch complete (24171 records). [2025-10-13T17:35:56.584638] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-13T17:35:56.950724] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-13T17:35:56.950817] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-13T17:35:56.951228] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-13T17:35:56.951267] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-13T17:35:56.951931] [DEBUG] [LOCAL ] BGT: Trimmed 24171 records to 16534 (keeping 200 days of data) [2025-10-13T17:35:57.051405] [DEBUG] [LOCAL ] BGT: Primary data saved (16534 records). [2025-10-13T17:35:57.051547] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-13T17:35:57.051626] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 26.0s. Estimated remaining: 4h 45m 15s. Rate: 7.4 symbols/min [2025-10-13T17:35:57.216798] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:57.217974] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-13T17:35:57.234917] [DEBUG] [LOCAL ] BH: Loaded 16341 existing records from primary storage. [2025-10-13T17:35:57.235250] [INFO ] [MAIN ] BH: Loaded 16341 existing records. [2025-10-13T17:35:57.412131] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:57.412489] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-13T17:35:57.412543] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-13T17:35:57.412797] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-13T17:35:57.412854] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-13T17:35:57.737910] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:35:57.756139] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:35:57.816729] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:58.017931] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-13T17:35:58.817965] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-13T17:35:59.062875] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T17:35:59.269281] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:35:59.617954] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-13T17:36:00.374450] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T17:36:00.417893] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-13T17:36:01.069692] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T17:36:01.217939] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-13T17:36:02.017933] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-13T17:36:02.215736] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T17:36:02.496476] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T17:36:02.817967] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-13T17:36:03.617903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-13T17:36:03.625702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:36:04.418022] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-13T17:36:04.710705] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:36:05.148757] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:36:05.217969] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-13T17:36:06.017966] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-13T17:36:06.114897] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T17:36:06.817955] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-13T17:36:07.275161] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:36:07.610623] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T17:36:07.617880] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-13T17:36:08.418047] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-13T17:36:08.572333] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:36:09.217896] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-13T17:36:09.606186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:36:10.017919] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-13T17:36:10.119170] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T17:36:10.817940] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-13T17:36:11.119577] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T17:36:11.617904] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-13T17:36:11.853742] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:36:12.418016] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-13T17:36:12.436019] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:36:13.217910] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-13T17:36:13.323612] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T17:36:14.017954] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-13T17:36:14.406304] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T17:36:14.651068] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:36:14.817911] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-13T17:36:15.617922] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-13T17:36:15.981795] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:36:16.417981] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-13T17:36:16.840882] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:36:17.158371] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:36:17.217897] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-13T17:36:18.017902] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-13T17:36:18.324298] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:36:18.817910] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-13T17:36:19.355816] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:36:19.358068] [INFO ] [REMOTE ] BGSF: Full fetch complete (9397 records). [2025-10-13T17:36:19.358168] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-13T17:36:19.623097] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-13T17:36:19.782759] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-13T17:36:19.783362] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-13T17:36:19.783280] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:36:19.783819] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-13T17:36:19.787865] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-13T17:36:19.789047] [DEBUG] [LOCAL ] BGSF: Trimmed 9397 records to 7846 (keeping 200 days of data) [2025-10-13T17:36:19.839033] [DEBUG] [LOCAL ] BGSF: Primary data saved (7846 records). [2025-10-13T17:36:19.839146] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-13T17:36:19.839261] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGSF took 51.7s. Estimated remaining: 4h 47m 3s. Rate: 7.3 symbols/min [2025-10-13T17:36:20.007412] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:20.051548] [DEBUG] [LOCAL ] BHC: Loaded 47488 existing records from primary storage. [2025-10-13T17:36:20.051947] [INFO ] [MAIN ] BHC: Loaded 47488 existing records. [2025-10-13T17:36:20.230788] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:20.231014] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-13T17:36:20.231062] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-13T17:36:20.231485] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-13T17:36:20.231553] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-13T17:36:20.423351] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-13T17:36:20.545420] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:36:20.609439] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:21.217906] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-13T17:36:21.225822] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T17:36:21.229857] [INFO ] [REMOTE ] BGY: Full fetch complete (32981 records). [2025-10-13T17:36:21.229933] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-13T17:36:21.601667] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-13T17:36:21.601757] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-13T17:36:21.602208] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-13T17:36:21.602247] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-13T17:36:21.602994] [DEBUG] [LOCAL ] BGY: Trimmed 32981 records to 22024 (keeping 200 days of data) [2025-10-13T17:36:21.728286] [DEBUG] [LOCAL ] BGY: Primary data saved (22024 records). [2025-10-13T17:36:21.728414] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-13T17:36:21.728492] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 27.0s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-13T17:36:21.903852] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:21.927004] [DEBUG] [LOCAL ] BHE: Loaded 24326 existing records from primary storage. [2025-10-13T17:36:21.927290] [INFO ] [MAIN ] BHE: Loaded 24326 existing records. [2025-10-13T17:36:22.024992] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-13T17:36:22.111732] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:22.112041] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-13T17:36:22.112091] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-13T17:36:22.112351] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-13T17:36:22.112409] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-13T17:36:22.470272] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:22.817980] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-13T17:36:22.852945] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T17:36:22.887138] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T17:36:22.889298] [INFO ] [REMOTE ] BGX: Full fetch complete (16460 records). [2025-10-13T17:36:22.889379] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-13T17:36:22.889878] [FATAL] [VALIDATOR ] BGX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:36:22.889961] [FATAL] [MAIN ] BGX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:36:22.890002] [WARN ] [MAIN ] BGX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:36:22.890040] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-13T17:36:22.890095] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-13T17:36:22.890128] [INFO ] [LOCAL ] BGX: Starting deletion of derivative data. [2025-10-13T17:36:22.890382] [DEBUG] [LOCAL ] BGX: Deleted derivative data file. [2025-10-13T17:36:22.890484] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BGX took 41.1s. Estimated remaining: 4h 45m 2s. Rate: 7.4 symbols/min [2025-10-13T17:36:23.065746] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:23.066039] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-13T17:36:23.066094] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-13T17:36:23.066236] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-13T17:36:23.066305] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-13T17:36:23.066368] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-13T17:36:23.066404] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-13T17:36:23.422294] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:23.617966] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-13T17:36:24.056031] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:36:24.417936] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-13T17:36:24.920540] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:36:25.217912] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-13T17:36:25.542113] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:36:26.017908] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-13T17:36:26.119834] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T17:36:26.817934] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-13T17:36:26.955419] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:36:27.617929] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-13T17:36:27.754853] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:36:28.417959] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-13T17:36:28.464083] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:36:29.217946] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-13T17:36:29.299170] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:36:29.301074] [INFO ] [REMOTE ] BH: Full fetch complete (19573 records). [2025-10-13T17:36:29.301143] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-13T17:36:29.663908] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-13T17:36:29.663991] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-13T17:36:29.664339] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-13T17:36:29.664376] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-13T17:36:29.665057] [DEBUG] [LOCAL ] BH: Trimmed 19573 records to 16227 (keeping 200 days of data) [2025-10-13T17:36:29.760463] [DEBUG] [LOCAL ] BH: Primary data saved (16227 records). [2025-10-13T17:36:29.760595] [INFO ] [MAIN ] BH: Full history saved. [2025-10-13T17:36:29.760714] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BH took 32.7s. Estimated remaining: 4h 44m 44s. Rate: 7.4 symbols/min [2025-10-13T17:36:29.924886] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:29.925078] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-13T17:36:29.925114] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-13T17:36:29.925225] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-13T17:36:29.925266] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-13T17:36:29.925305] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-13T17:36:29.925336] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-13T17:36:30.023235] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-13T17:36:30.271854] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:30.824527] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-13T17:36:30.840960] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:36:31.391577] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:36:31.407197] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:36:31.617961] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-13T17:36:32.417929] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-13T17:36:33.217954] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-13T17:36:33.502012] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:36:34.027882] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-13T17:36:34.033018] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:36:34.277539] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:36:34.817885] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-13T17:36:34.874804] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T17:36:35.617927] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-13T17:36:36.417925] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-13T17:36:36.518213] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:36:36.585876] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:36:37.217952] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-13T17:36:37.899889] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:36:38.017936] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-13T17:36:38.071815] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T17:36:38.817927] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-13T17:36:39.134201] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T17:36:39.617943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-13T17:36:40.417910] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-13T17:36:40.692815] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:36:41.216419] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:36:41.220236] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-13T17:36:41.331875] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:36:42.017927] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-13T17:36:42.440704] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T17:36:42.817913] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-13T17:36:43.062821] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T17:36:43.617955] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-13T17:36:44.238429] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:36:44.418017] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-13T17:36:45.217905] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-13T17:36:45.696606] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T17:36:46.017930] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-13T17:36:46.114027] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:36:46.284323] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T17:36:46.817932] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-13T17:36:47.617923] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-13T17:36:48.073187] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T17:36:48.117325] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:36:48.417896] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-13T17:36:48.725271] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:36:49.217943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-13T17:36:50.017967] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-13T17:36:50.132383] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:36:50.817924] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-13T17:36:50.858514] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T17:36:50.918765] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T17:36:51.617903] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-13T17:36:51.906143] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:36:51.908778] [INFO ] [REMOTE ] BHE: Full fetch complete (36225 records). [2025-10-13T17:36:51.908912] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-13T17:36:52.281854] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-13T17:36:52.281933] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-13T17:36:52.282400] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-13T17:36:52.282439] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-13T17:36:52.283359] [DEBUG] [LOCAL ] BHE: Trimmed 36225 records to 23897 (keeping 200 days of data) [2025-10-13T17:36:52.421317] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-13T17:36:52.428802] [DEBUG] [LOCAL ] BHE: Primary data saved (23897 records). [2025-10-13T17:36:52.428933] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-13T17:36:52.429013] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 30.7s. Estimated remaining: 4h 46m 29s. Rate: 7.3 symbols/min [2025-10-13T17:36:52.599054] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:52.620260] [DEBUG] [LOCAL ] BHR: Loaded 22281 existing records from primary storage. [2025-10-13T17:36:52.620525] [INFO ] [MAIN ] BHR: Loaded 22281 existing records. [2025-10-13T17:36:52.800204] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:52.800458] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-13T17:36:52.800517] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-13T17:36:52.800836] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-13T17:36:52.800895] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-13T17:36:53.169562] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:53.217916] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-13T17:36:53.328831] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T17:36:53.335906] [INFO ] [REMOTE ] BHC: Full fetch complete (67178 records). [2025-10-13T17:36:53.336082] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-13T17:36:53.726616] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-13T17:36:53.726782] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-13T17:36:53.727522] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-13T17:36:53.727583] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-13T17:36:53.729204] [DEBUG] [LOCAL ] BHC: Trimmed 67178 records to 46690 (keeping 200 days of data) [2025-10-13T17:36:53.988973] [DEBUG] [LOCAL ] BHC: Primary data saved (46690 records). [2025-10-13T17:36:53.989105] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-13T17:36:53.989186] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHC took 34.1s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-13T17:36:54.020250] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-13T17:36:54.162766] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:54.163450] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-13T17:36:54.163911] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-13T17:36:54.164136] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-13T17:36:54.164189] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-13T17:36:54.164235] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-13T17:36:54.164320] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-13T17:36:54.462925] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:36:54.629220] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:54.631554] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-13T17:36:54.817897] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-13T17:36:55.217677] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:36:55.617934] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-13T17:36:56.417958] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-13T17:36:56.687363] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:36:56.775515] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:36:57.217927] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-13T17:36:57.552696] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:36:58.017928] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-13T17:36:58.267613] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:36:58.271299] [INFO ] [REMOTE ] BHK: Full fetch complete (30579 records). [2025-10-13T17:36:58.271581] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-13T17:36:58.669294] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-13T17:36:58.669383] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-13T17:36:58.669845] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-13T17:36:58.669907] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-13T17:36:58.670626] [DEBUG] [LOCAL ] BHK: Trimmed 30579 records to 23543 (keeping 200 days of data) [2025-10-13T17:36:58.811856] [DEBUG] [LOCAL ] BHK: Primary data saved (23543 records). [2025-10-13T17:36:58.811988] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-13T17:36:58.812057] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHK took 35.9s. Estimated remaining: 4h 44m 56s. Rate: 7.4 symbols/min [2025-10-13T17:36:58.823352] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-13T17:36:58.985548] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:58.996714] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:36:59.050298] [DEBUG] [LOCAL ] BHVN: Loaded 50961 existing records from primary storage. [2025-10-13T17:36:59.050620] [INFO ] [MAIN ] BHVN: Loaded 50961 existing records. [2025-10-13T17:36:59.230719] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:59.230931] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-13T17:36:59.230979] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-13T17:36:59.231281] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-13T17:36:59.231339] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-13T17:36:59.579453] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:59.617886] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-13T17:37:00.417948] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-13T17:37:00.767410] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:37:00.953107] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T17:37:01.020790] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:37:01.217910] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-13T17:37:02.017916] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-13T17:37:02.359219] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-13T17:37:02.670036] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:37:02.817950] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-13T17:37:03.617980] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-13T17:37:03.814519] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T17:37:04.417930] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-13T17:37:05.126071] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T17:37:05.217903] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-13T17:37:05.647158] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:37:06.017931] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-13T17:37:06.758809] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:37:06.817906] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-13T17:37:07.617907] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-13T17:37:08.142843] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-13T17:37:08.337372] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:37:08.417893] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-13T17:37:08.745510] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T17:37:09.217930] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-13T17:37:10.019020] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-13T17:37:10.022416] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:37:10.048806] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:37:10.817939] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-13T17:37:11.617917] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-13T17:37:11.778908] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:37:11.921626] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T17:37:11.927299] [INFO ] [REMOTE ] BHP: Full fetch complete (77269 records). [2025-10-13T17:37:11.927432] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-13T17:37:12.324670] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-13T17:37:12.324768] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-13T17:37:12.325578] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-13T17:37:12.325618] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-13T17:37:12.327170] [DEBUG] [LOCAL ] BHP: Trimmed 77269 records to 53373 (keeping 200 days of data) [2025-10-13T17:37:12.425212] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-13T17:37:12.668426] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-10-13T17:37:12.668623] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-13T17:37:12.668769] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHP took 42.9s. Estimated remaining: 4h 45m 31s. Rate: 7.3 symbols/min [2025-10-13T17:37:12.838115] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:12.887587] [DEBUG] [LOCAL ] BILL: Loaded 53182 existing records from primary storage. [2025-10-13T17:37:12.887977] [INFO ] [MAIN ] BILL: Loaded 53182 existing records. [2025-10-13T17:37:13.062093] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:13.062321] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-13T17:37:13.062368] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-13T17:37:13.062704] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-13T17:37:13.062761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-13T17:37:13.261397] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-13T17:37:13.440600] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:13.442052] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T17:37:13.475346] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T17:37:13.764695] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:37:14.017911] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-13T17:37:14.817962] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-13T17:37:15.124597] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-13T17:37:15.617933] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-13T17:37:15.779339] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:37:16.417918] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-13T17:37:17.139575] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:37:17.217889] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-13T17:37:17.641280] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T17:37:17.753279] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:37:18.017923] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-13T17:37:18.817965] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-13T17:37:19.623214] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-13T17:37:19.644049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:37:20.417927] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-13T17:37:20.500680] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:37:20.775636] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:37:20.778881] [INFO ] [REMOTE ] BHR: Full fetch complete (31271 records). [2025-10-13T17:37:20.778955] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-13T17:37:21.151218] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-13T17:37:21.151298] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-13T17:37:21.151752] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-13T17:37:21.151812] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-13T17:37:21.152500] [DEBUG] [LOCAL ] BHR: Trimmed 31271 records to 22109 (keeping 200 days of data) [2025-10-13T17:37:21.236004] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-13T17:37:21.282744] [DEBUG] [LOCAL ] BHR: Primary data saved (22109 records). [2025-10-13T17:37:21.282885] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-13T17:37:21.282969] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHR took 28.9s. Estimated remaining: 4h 45m 27s. Rate: 7.3 symbols/min [2025-10-13T17:37:21.449494] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:21.472182] [DEBUG] [LOCAL ] BIO: Loaded 24502 existing records from primary storage. [2025-10-13T17:37:21.472429] [INFO ] [MAIN ] BIO: Loaded 24502 existing records. [2025-10-13T17:37:21.634610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-13T17:37:21.653488] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:21.654736] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-13T17:37:21.654790] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-13T17:37:21.655025] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-13T17:37:21.655082] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-13T17:37:22.037346] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-13T17:37:22.037284] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:22.074495] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:37:22.399299] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T17:37:22.817958] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-13T17:37:23.618007] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-13T17:37:23.729608] [DEBUG] [REMOTE ] BIO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T17:37:23.730042] [WARN ] [REMOTE ] BIO: No data returned for month 2024-12 [2025-10-13T17:37:23.730160] [FATAL] [REMOTE ] BIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:37:23.730248] [FATAL] [MAIN ] BIO: Failed to fetch primary data. [2025-10-13T17:37:23.730331] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:37:23.730418] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-13T17:37:23.730499] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-13T17:37:23.730549] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-13T17:37:23.730813] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-13T17:37:23.730926] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 2.4s. Estimated remaining: 4h 44m 35s. Rate: 7.4 symbols/min [2025-10-13T17:37:23.917405] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:23.917726] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-10-13T17:37:23.917778] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-10-13T17:37:23.917896] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-13T17:37:23.917939] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-13T17:37:23.918004] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-13T17:37:23.918062] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-13T17:37:24.306097] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:24.417914] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-13T17:37:24.475220] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:37:25.217977] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-13T17:37:25.748272] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T17:37:26.018030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-13T17:37:26.817973] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-13T17:37:27.092032] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T17:37:27.098017] [INFO ] [REMOTE ] BHVN: Full fetch complete (70190 records). [2025-10-13T17:37:27.098208] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-13T17:37:27.374681] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:37:27.549864] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-13T17:37:27.550904] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-13T17:37:27.550692] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:37:27.559194] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-13T17:37:27.560385] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-13T17:37:27.562544] [DEBUG] [LOCAL ] BHVN: Trimmed 70190 records to 50396 (keeping 200 days of data) [2025-10-13T17:37:27.623835] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-13T17:37:27.882093] [DEBUG] [LOCAL ] BHVN: Primary data saved (50396 records). [2025-10-13T17:37:27.882276] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-13T17:37:27.882368] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 29.1s. Estimated remaining: 4h 43m 56s. Rate: 7.4 symbols/min [2025-10-13T17:37:28.059289] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:28.099998] [DEBUG] [LOCAL ] BIPC: Loaded 41873 existing records from primary storage. [2025-10-13T17:37:28.100446] [INFO ] [MAIN ] BIPC: Loaded 41873 existing records. [2025-10-13T17:37:28.288686] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:28.288973] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-13T17:37:28.289022] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-13T17:37:28.289404] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-13T17:37:28.289462] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-13T17:37:28.423087] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-13T17:37:28.669254] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:28.975413] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:37:29.217913] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-13T17:37:30.017921] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-13T17:37:30.162302] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:37:30.399617] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T17:37:30.720456] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:37:30.817879] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-13T17:37:31.617908] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-13T17:37:32.129407] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:37:32.417908] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-13T17:37:33.217897] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-13T17:37:33.392006] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:37:33.701040] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T17:37:34.017968] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-13T17:37:34.672298] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:37:34.817965] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-13T17:37:35.399366] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:37:35.617937] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-13T17:37:36.093283] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:37:36.417977] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-13T17:37:37.074164] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:37:37.217950] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-13T17:37:37.893996] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:37:37.918815] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:37:38.017911] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-13T17:37:38.479301] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:37:38.480132] [INFO ] [REMOTE ] BHV: Full fetch complete (1383 records). [2025-10-13T17:37:38.480200] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-13T17:37:38.669954] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-13T17:37:38.670236] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:37:38.670323] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:37:38.670415] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-13T17:37:38.671048] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-13T17:37:38.671132] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-13T17:37:38.671237] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-13T17:37:38.671348] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BHV took 44.7s. Estimated remaining: 4h 44m 8s. Rate: 7.4 symbols/min [2025-10-13T17:37:38.818019] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-13T17:37:39.617959] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-13T17:37:40.422980] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-13T17:37:40.436447] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:37:41.217951] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-13T17:37:41.248924] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:37:42.017938] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-13T17:37:42.061051] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:37:42.764139] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:37:42.817892] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-13T17:37:43.618053] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-13T17:37:43.790736] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T17:37:44.372589] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:37:44.417918] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-13T17:37:44.998349] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:37:45.217960] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-13T17:37:46.018070] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-13T17:37:46.210693] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:37:46.258729] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:37:46.263508] [INFO ] [REMOTE ] BIP: Full fetch complete (57030 records). [2025-10-13T17:37:46.263683] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-13T17:37:46.653573] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-13T17:37:46.653724] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-13T17:37:46.654514] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-13T17:37:46.654568] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-13T17:37:46.656281] [DEBUG] [LOCAL ] BIP: Trimmed 57030 records to 39207 (keeping 200 days of data) [2025-10-13T17:37:46.837789] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-13T17:37:46.910353] [DEBUG] [LOCAL ] BIP: Primary data saved (39207 records). [2025-10-13T17:37:46.910560] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-13T17:37:46.910677] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIP took 23.2s. Estimated remaining: 4h 44m 1s. Rate: 7.4 symbols/min [2025-10-13T17:37:47.288467] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T17:37:47.617963] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-13T17:37:48.805373] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:37:48.818330] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-13T17:37:48.892090] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T17:37:49.218078] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-13T17:37:50.563938] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:37:50.573181] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-13T17:37:50.862333] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T17:37:50.867884] [INFO ] [REMOTE ] BILL: Full fetch complete (75901 records). [2025-10-13T17:37:50.868041] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-13T17:37:51.250070] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-13T17:37:51.250157] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-13T17:37:51.251100] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-13T17:37:51.251163] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-13T17:37:51.252621] [DEBUG] [LOCAL ] BILL: Trimmed 75901 records to 52444 (keeping 200 days of data) [2025-10-13T17:37:51.558733] [DEBUG] [LOCAL ] BILL: Primary data saved (52444 records). [2025-10-13T17:37:51.558914] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-13T17:37:51.559714] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BILL took 38.9s. Estimated remaining: 4h 43m 27s. Rate: 7.4 symbols/min [2025-10-13T17:37:51.607128] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:37:51.617463] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-13T17:37:53.033182] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T17:37:53.042522] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-13T17:37:54.480902] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:37:54.486340] [INFO ] [REMOTE ] BIPC: Full fetch complete (59966 records). [2025-10-13T17:37:54.486499] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-13T17:37:54.864421] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-13T17:37:54.864501] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-13T17:37:54.865193] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-13T17:37:54.865254] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-13T17:37:54.866392] [DEBUG] [LOCAL ] BIPC: Trimmed 59966 records to 41208 (keeping 200 days of data) [2025-10-13T17:37:55.112574] [DEBUG] [LOCAL ] BIPC: Primary data saved (41208 records). [2025-10-13T17:37:55.112731] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-13T17:37:55.112815] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 27.2s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-13T17:37:55.716695] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.766843] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.865172] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.887810] [DEBUG] [LOCAL ] BIPH: Loaded 2591 existing records from primary storage. [2025-10-13T17:37:55.887523] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.889803] [INFO ] [MAIN ] BIPH: Loaded 2591 existing records. [2025-10-13T17:37:55.933808] [DEBUG] [LOCAL ] BIPI: Loaded 3192 existing records from primary storage. [2025-10-13T17:37:55.939446] [INFO ] [MAIN ] BIPI: Loaded 3192 existing records. [2025-10-13T17:37:56.114060] [DEBUG] [LOCAL ] BIPJ: Loaded 3196 existing records from primary storage. [2025-10-13T17:37:56.131185] [INFO ] [MAIN ] BIPJ: Loaded 3196 existing records. [2025-10-13T17:37:56.314844] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.320372] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.385627] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-13T17:37:56.423032] [DEBUG] [LOCAL ] BIRK: Loaded 51758 existing records from primary storage. [2025-10-13T17:37:56.450676] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-13T17:37:56.440277] [INFO ] [MAIN ] BIRK: Loaded 51758 existing records. [2025-10-13T17:37:56.482040] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-13T17:37:56.624623] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.660863] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.634461] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.687100] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-13T17:37:56.692603] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.726515] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-13T17:37:56.749109] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-13T17:37:56.764915] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-13T17:37:56.828715] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-13T17:37:56.850254] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-13T17:37:57.083867] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:57.165008] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-13T17:37:57.203371] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-13T17:37:57.248575] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-13T17:37:57.347120] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-13T17:37:57.983194] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.041101] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-13T17:37:58.231367] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.242422] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-13T17:37:58.304365] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.337480] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-13T17:37:58.514145] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.514575] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-13T17:37:59.013837] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T17:37:59.015522] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-13T17:37:59.032423] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:37:59.034120] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-13T17:37:59.381031] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-13T17:37:59.382357] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-13T17:37:59.468976] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T17:37:59.471616] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-13T17:37:59.481772] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T17:37:59.483725] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-13T17:37:59.797711] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T17:37:59.798999] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-13T17:37:59.946847] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:38:00.016521] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T17:38:00.092880] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-13T17:38:00.417923] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-13T17:38:00.465992] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:38:00.844146] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:38:01.217936] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-13T17:38:02.017936] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-13T17:38:02.452111] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:38:02.714142] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T17:38:02.817975] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-13T17:38:03.369725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T17:38:03.617958] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-13T17:38:04.417905] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-13T17:38:04.863403] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:38:05.152872] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:38:05.217890] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-13T17:38:06.017915] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-13T17:38:06.606282] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T17:38:06.818091] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-13T17:38:06.899340] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:38:07.245138] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T17:38:07.617946] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-13T17:38:07.946402] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T17:38:08.417940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-13T17:38:08.945758] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T17:38:09.217920] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-13T17:38:09.684843] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:38:10.017926] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-13T17:38:10.714942] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:38:10.817938] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-13T17:38:11.354297] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T17:38:11.617896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-13T17:38:12.156674] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T17:38:12.417928] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-13T17:38:12.936774] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:38:12.937664] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4383 records). [2025-10-13T17:38:12.937754] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-13T17:38:13.225387] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-13T17:38:13.313013] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-13T17:38:13.313098] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-13T17:38:13.313286] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-13T17:38:13.313349] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-13T17:38:13.313766] [DEBUG] [LOCAL ] BIPJ: Trimmed 4383 records to 3168 (keeping 200 days of data) [2025-10-13T17:38:13.334289] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3168 records). [2025-10-13T17:38:13.334374] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-13T17:38:13.334494] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 51s. Rate: 7.4 symbols/min [2025-10-13T17:38:13.509203] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:13.534213] [DEBUG] [LOCAL ] BIT: Loaded 23580 existing records from primary storage. [2025-10-13T17:38:13.534549] [INFO ] [MAIN ] BIT: Loaded 23580 existing records. [2025-10-13T17:38:13.716896] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:13.717146] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-13T17:38:13.717194] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-13T17:38:13.717452] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-13T17:38:13.717529] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-13T17:38:14.023156] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-13T17:38:14.116986] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:14.460354] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T17:38:14.810226] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:38:14.820566] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-13T17:38:15.300017] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:38:15.617951] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-13T17:38:16.058750] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T17:38:16.418030] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-13T17:38:16.801963] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T17:38:17.218002] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-13T17:38:18.018027] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-13T17:38:18.475769] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:38:18.476794] [INFO ] [REMOTE ] BIPH: Full fetch complete (4153 records). [2025-10-13T17:38:18.476865] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-13T17:38:18.839815] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-13T17:38:18.888749] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-13T17:38:18.888994] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-13T17:38:18.889375] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-13T17:38:18.889518] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-13T17:38:18.891050] [DEBUG] [LOCAL ] BIPH: Trimmed 4153 records to 2553 (keeping 200 days of data) [2025-10-13T17:38:18.947926] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:38:18.951954] [DEBUG] [LOCAL ] BIPH: Primary data saved (2553 records). [2025-10-13T17:38:18.963979] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-13T17:38:18.964171] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPH took 23.9s. Estimated remaining: 4h 43m 24s. Rate: 7.4 symbols/min [2025-10-13T17:38:19.141718] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:19.203895] [DEBUG] [LOCAL ] BJ: Loaded 52284 existing records from primary storage. [2025-10-13T17:38:19.204260] [INFO ] [MAIN ] BJ: Loaded 52284 existing records. [2025-10-13T17:38:19.394377] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:19.399179] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-13T17:38:19.398988] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T17:38:19.399375] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-13T17:38:19.401927] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-13T17:38:19.402008] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-13T17:38:19.623174] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-13T17:38:19.782208] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:20.151787] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T17:38:20.418017] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-13T17:38:21.217936] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-13T17:38:21.696969] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T17:38:21.979552] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:38:22.017898] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-13T17:38:22.817959] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-13T17:38:23.368245] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T17:38:23.617957] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-13T17:38:23.829749] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:38:23.978089] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T17:38:24.417944] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-13T17:38:24.893871] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T17:38:24.894918] [INFO ] [REMOTE ] BIPI: Full fetch complete (4905 records). [2025-10-13T17:38:24.894993] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-13T17:38:25.227204] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-13T17:38:25.270544] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-13T17:38:25.270672] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-13T17:38:25.270988] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-13T17:38:25.271073] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-13T17:38:25.271538] [DEBUG] [LOCAL ] BIPI: Trimmed 4905 records to 3114 (keeping 200 days of data) [2025-10-13T17:38:25.294236] [DEBUG] [LOCAL ] BIPI: Primary data saved (3114 records). [2025-10-13T17:38:25.294402] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-13T17:38:25.294521] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIPI took 30.2s. Estimated remaining: 4h 43m 3s. Rate: 7.4 symbols/min [2025-10-13T17:38:25.469708] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:25.526246] [DEBUG] [LOCAL ] BK: Loaded 54309 existing records from primary storage. [2025-10-13T17:38:25.526687] [INFO ] [MAIN ] BK: Loaded 54309 existing records. [2025-10-13T17:38:25.711272] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:25.711553] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-13T17:38:25.711603] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-13T17:38:25.711884] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-13T17:38:25.711942] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-13T17:38:26.023112] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-13T17:38:26.102598] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:26.817942] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-13T17:38:27.042346] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:38:27.393187] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:38:27.618195] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-13T17:38:28.289111] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T17:38:28.417903] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-13T17:38:28.492563] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:38:29.217898] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-13T17:38:29.398782] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:38:30.018021] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-13T17:38:30.818047] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-13T17:38:30.865418] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:38:31.581786] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:38:31.617886] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-13T17:38:32.428878] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-13T17:38:32.435211] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T17:38:33.217912] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-13T17:38:33.522865] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T17:38:34.017903] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-13T17:38:34.052546] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:38:34.174574] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:38:34.817965] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-13T17:38:35.617933] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-13T17:38:35.769966] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:38:35.775348] [INFO ] [REMOTE ] BIRK: Full fetch complete (73048 records). [2025-10-13T17:38:35.775460] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-13T17:38:35.925401] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:38:36.213991] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-13T17:38:36.214075] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-13T17:38:36.214871] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-13T17:38:36.214938] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-13T17:38:36.216351] [DEBUG] [LOCAL ] BIRK: Trimmed 73048 records to 51043 (keeping 200 days of data) [2025-10-13T17:38:36.417972] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-13T17:38:36.513861] [DEBUG] [LOCAL ] BIRK: Primary data saved (51043 records). [2025-10-13T17:38:36.514004] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-13T17:38:36.514085] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 41.4s. Estimated remaining: 4h 43m 18s. Rate: 7.4 symbols/min [2025-10-13T17:38:36.686611] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:36.733161] [DEBUG] [LOCAL ] BKD: Loaded 51097 existing records from primary storage. [2025-10-13T17:38:36.733504] [INFO ] [MAIN ] BKD: Loaded 51097 existing records. [2025-10-13T17:38:36.910216] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:36.910510] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-13T17:38:36.910557] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-13T17:38:36.910857] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-13T17:38:36.910947] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-13T17:38:37.230355] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-13T17:38:37.274696] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:37.539274] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T17:38:38.001499] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:38:38.017877] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-13T17:38:38.285540] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:38:38.817952] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-13T17:38:39.617950] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-13T17:38:39.955020] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:38:40.423030] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-13T17:38:40.444426] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:38:40.490490] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T17:38:41.217941] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-13T17:38:42.017890] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-13T17:38:42.096682] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:38:42.778519] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:38:42.817913] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-13T17:38:43.617900] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-13T17:38:43.728904] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:38:44.417924] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-13T17:38:44.510548] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:38:45.223124] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-13T17:38:45.240131] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:38:46.017925] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-13T17:38:46.401681] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:38:46.535785] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T17:38:46.817923] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-13T17:38:47.402925] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:38:47.617918] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-13T17:38:48.412675] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T17:38:48.424532] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-13T17:38:49.168530] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T17:38:49.217893] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-13T17:38:50.022789] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-13T17:38:50.025621] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T17:38:50.817902] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-13T17:38:51.000271] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:38:51.375977] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:38:51.617919] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-13T17:38:52.417930] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-13T17:38:52.550963] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:38:52.771597] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T17:38:53.217974] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-13T17:38:54.017956] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-13T17:38:54.105761] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:38:54.831432] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-13T17:38:54.835357] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:38:55.617999] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-13T17:38:55.958863] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T17:38:56.417906] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-13T17:38:56.531206] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:38:56.538253] [INFO ] [REMOTE ] BJ: Full fetch complete (74088 records). [2025-10-13T17:38:56.538415] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-13T17:38:56.950317] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-13T17:38:56.950457] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-13T17:38:56.951547] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-13T17:38:56.951619] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-13T17:38:56.953709] [DEBUG] [LOCAL ] BJ: Trimmed 74088 records to 51584 (keeping 200 days of data) [2025-10-13T17:38:57.214719] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:38:57.225936] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-13T17:38:57.327109] [DEBUG] [LOCAL ] BJ: Primary data saved (51584 records). [2025-10-13T17:38:57.327312] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-13T17:38:57.327432] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 38.4s. Estimated remaining: 4h 44m 42s. Rate: 7.3 symbols/min [2025-10-13T17:38:57.506748] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:57.543016] [DEBUG] [LOCAL ] BKE: Loaded 34527 existing records from primary storage. [2025-10-13T17:38:57.543390] [INFO ] [MAIN ] BKE: Loaded 34527 existing records. [2025-10-13T17:38:57.738525] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:57.738859] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-13T17:38:57.738911] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-13T17:38:57.739292] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-13T17:38:57.739352] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-13T17:38:58.018280] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-13T17:38:58.139469] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:58.169766] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:38:58.528860] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:38:58.532494] [INFO ] [REMOTE ] BIT: Full fetch complete (31892 records). [2025-10-13T17:38:58.532591] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-13T17:38:58.825799] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-13T17:38:58.916811] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-13T17:38:58.916908] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-13T17:38:58.917554] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-13T17:38:58.917616] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-13T17:38:58.918682] [DEBUG] [LOCAL ] BIT: Trimmed 31892 records to 23487 (keeping 200 days of data) [2025-10-13T17:38:59.063994] [DEBUG] [LOCAL ] BIT: Primary data saved (23487 records). [2025-10-13T17:38:59.064164] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-13T17:38:59.064259] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BIT took 45.7s. Estimated remaining: 4h 43m 47s. Rate: 7.3 symbols/min [2025-10-13T17:38:59.237191] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:59.277206] [DEBUG] [LOCAL ] BKH: Loaded 37451 existing records from primary storage. [2025-10-13T17:38:59.277713] [INFO ] [MAIN ] BKH: Loaded 37451 existing records. [2025-10-13T17:38:59.463497] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:59.464049] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-13T17:38:59.464139] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-13T17:38:59.464925] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-13T17:38:59.464990] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-13T17:38:59.615552] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:38:59.620923] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-13T17:38:59.873552] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:00.360104] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:39:00.417952] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-13T17:39:01.218009] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-13T17:39:01.582904] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:39:02.017911] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-13T17:39:02.118745] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T17:39:02.278147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T17:39:02.818028] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-13T17:39:03.593306] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:39:03.602211] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-13T17:39:03.602429] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-13T17:39:03.623800] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-13T17:39:03.988392] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-13T17:39:03.988528] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-13T17:39:03.989433] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-13T17:39:03.989540] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-13T17:39:03.991229] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53535 (keeping 200 days of data) [2025-10-13T17:39:04.251899] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:39:04.347604] [DEBUG] [LOCAL ] BK: Primary data saved (53535 records). [2025-10-13T17:39:04.347773] [INFO ] [MAIN ] BK: Full history saved. [2025-10-13T17:39:04.347860] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BK took 39.1s. Estimated remaining: 4h 43m 18s. Rate: 7.4 symbols/min [2025-10-13T17:39:04.423440] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-13T17:39:04.519778] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:04.554479] [DEBUG] [LOCAL ] BKKT: Loaded 36488 existing records from primary storage. [2025-10-13T17:39:04.554804] [INFO ] [MAIN ] BKKT: Loaded 36488 existing records. [2025-10-13T17:39:04.727068] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:04.727267] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-13T17:39:04.727314] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-13T17:39:04.727560] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-13T17:39:04.727615] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-13T17:39:05.071766] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:05.217973] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-13T17:39:05.320855] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:39:05.806500] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:39:06.017910] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-13T17:39:06.384634] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:39:06.817953] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-13T17:39:07.460701] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:39:07.465844] [INFO ] [REMOTE ] BKD: Full fetch complete (71845 records). [2025-10-13T17:39:07.465957] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-13T17:39:07.622697] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-13T17:39:07.852287] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-13T17:39:07.852370] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-13T17:39:07.853199] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-13T17:39:07.853261] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-13T17:39:07.854607] [DEBUG] [LOCAL ] BKD: Trimmed 71845 records to 50414 (keeping 200 days of data) [2025-10-13T17:39:08.136027] [DEBUG] [LOCAL ] BKD: Primary data saved (50414 records). [2025-10-13T17:39:08.136151] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-13T17:39:08.136229] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKD took 31.6s. Estimated remaining: 4h 42m 38s. Rate: 7.4 symbols/min [2025-10-13T17:39:08.258610] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:39:08.335579] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:08.345049] [DEBUG] [LOCAL ] BKN: Loaded 7736 existing records from primary storage. [2025-10-13T17:39:08.345275] [INFO ] [MAIN ] BKN: Loaded 7736 existing records. [2025-10-13T17:39:08.423375] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-13T17:39:08.531092] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:08.531312] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-13T17:39:08.531360] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-13T17:39:08.531533] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-13T17:39:08.531589] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-13T17:39:08.893286] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:09.032686] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T17:39:09.217928] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-13T17:39:09.466749] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T17:39:10.017968] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-13T17:39:10.817929] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-13T17:39:11.283580] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:39:11.385697] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:39:11.617956] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-13T17:39:11.849163] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:39:12.417948] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-13T17:39:13.217914] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-13T17:39:13.263769] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T17:39:14.026077] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-13T17:39:14.030953] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:39:14.749312] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:39:14.817906] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-13T17:39:14.863596] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:39:15.617944] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-13T17:39:16.254454] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:39:16.417952] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-13T17:39:17.038474] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:39:17.217968] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-13T17:39:17.978991] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T17:39:18.018082] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-13T17:39:18.057320] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T17:39:18.818048] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-13T17:39:19.307192] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:39:19.617966] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-13T17:39:19.998788] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T17:39:20.395732] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T17:39:20.417894] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-13T17:39:21.217941] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-13T17:39:21.814860] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:39:22.018042] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-13T17:39:22.817945] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-13T17:39:22.870849] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:39:22.884574] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T17:39:23.617949] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-13T17:39:24.209903] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:39:24.214159] [INFO ] [REMOTE ] BKH: Full fetch complete (52433 records). [2025-10-13T17:39:24.214301] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-13T17:39:24.428052] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-13T17:39:24.612280] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-13T17:39:24.612425] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-13T17:39:24.613180] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-13T17:39:24.613246] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-13T17:39:24.614834] [DEBUG] [LOCAL ] BKH: Trimmed 52433 records to 36967 (keeping 200 days of data) [2025-10-13T17:39:24.857679] [DEBUG] [LOCAL ] BKH: Primary data saved (36967 records). [2025-10-13T17:39:24.857892] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-13T17:39:24.858860] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 25.8s. Estimated remaining: 4h 43m 32s. Rate: 7.3 symbols/min [2025-10-13T17:39:25.042800] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:25.076876] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:39:25.118335] [DEBUG] [LOCAL ] BKSY: Loaded 49237 existing records from primary storage. [2025-10-13T17:39:25.118741] [INFO ] [MAIN ] BKSY: Loaded 49237 existing records. [2025-10-13T17:39:25.218026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-13T17:39:25.300038] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:25.300295] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-13T17:39:25.300344] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-13T17:39:25.301061] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-13T17:39:25.301119] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-13T17:39:25.654534] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:39:25.688338] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:26.021675] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-13T17:39:26.023405] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:39:26.817943] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-13T17:39:27.400259] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:39:27.617879] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-13T17:39:28.381065] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:39:28.417883] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-13T17:39:28.932537] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:39:29.217934] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-13T17:39:29.950249] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T17:39:30.017898] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-13T17:39:30.144420] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:39:30.817939] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-13T17:39:31.347675] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T17:39:31.617939] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-13T17:39:32.417920] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-13T17:39:32.704271] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:39:32.718591] [INFO ] [REMOTE ] BKE: Full fetch complete (50174 records). [2025-10-13T17:39:32.732845] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-13T17:39:32.741098] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T17:39:33.129856] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-13T17:39:33.129965] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-13T17:39:33.130679] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-13T17:39:33.130742] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-13T17:39:33.131846] [DEBUG] [LOCAL ] BKE: Trimmed 50174 records to 33944 (keeping 200 days of data) [2025-10-13T17:39:33.218926] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-13T17:39:33.326024] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:39:33.350238] [DEBUG] [LOCAL ] BKE: Primary data saved (33944 records). [2025-10-13T17:39:33.350450] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-13T17:39:33.350555] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKE took 36.0s. Estimated remaining: 4h 43m 26s. Rate: 7.3 symbols/min [2025-10-13T17:39:33.531202] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:33.545019] [DEBUG] [LOCAL ] BKT: Loaded 12155 existing records from primary storage. [2025-10-13T17:39:33.545308] [INFO ] [MAIN ] BKT: Loaded 12155 existing records. [2025-10-13T17:39:33.726919] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:33.727197] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-13T17:39:33.727248] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-13T17:39:33.727763] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-13T17:39:33.728090] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-13T17:39:34.023116] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-13T17:39:34.109788] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:34.817931] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-13T17:39:35.265365] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T17:39:35.486603] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:39:35.535976] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T17:39:35.617901] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-13T17:39:36.288678] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T17:39:36.417913] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-13T17:39:37.143693] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T17:39:37.217933] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-13T17:39:38.017955] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-13T17:39:38.817952] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-13T17:39:39.185456] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:39:39.510571] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T17:39:39.512246] [INFO ] [REMOTE ] BKN: Full fetch complete (11471 records). [2025-10-13T17:39:39.512341] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-13T17:39:39.623158] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-13T17:39:39.910505] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-13T17:39:39.910590] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-13T17:39:39.910980] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-13T17:39:39.911040] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-13T17:39:39.911483] [DEBUG] [LOCAL ] BKN: Trimmed 11471 records to 7347 (keeping 200 days of data) [2025-10-13T17:39:39.957382] [DEBUG] [LOCAL ] BKN: Primary data saved (7347 records). [2025-10-13T17:39:39.957582] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-13T17:39:39.957775] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKN took 31.8s. Estimated remaining: 4h 43m 6s. Rate: 7.3 symbols/min [2025-10-13T17:39:40.162884] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:40.163160] [DEBUG] [LOCAL ] BKU: No existing data file found in primary storage. [2025-10-13T17:39:40.163321] [WARN ] [MAIN ] BKU: No existing data found, performing full refresh instead. [2025-10-13T17:39:40.163582] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-13T17:39:40.163690] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-13T17:39:40.163800] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-13T17:39:40.163983] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-13T17:39:40.329605] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T17:39:40.432637] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-13T17:39:40.622869] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:41.217920] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-13T17:39:41.351184] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T17:39:41.737862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:39:41.744381] [INFO ] [REMOTE ] BKKT: Full fetch complete (51047 records). [2025-10-13T17:39:41.744602] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-13T17:39:42.027222] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-13T17:39:42.129424] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-13T17:39:42.129516] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-13T17:39:42.130338] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-13T17:39:42.130402] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-13T17:39:42.131554] [DEBUG] [LOCAL ] BKKT: Trimmed 51047 records to 36153 (keeping 200 days of data) [2025-10-13T17:39:42.337804] [DEBUG] [LOCAL ] BKKT: Primary data saved (36153 records). [2025-10-13T17:39:42.337939] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-13T17:39:42.338046] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKKT took 38.0s. Estimated remaining: 4h 42m 17s. Rate: 7.4 symbols/min [2025-10-13T17:39:42.510298] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:42.541615] [DEBUG] [LOCAL ] BKV: Loaded 30370 existing records from primary storage. [2025-10-13T17:39:42.542052] [INFO ] [MAIN ] BKV: Loaded 30370 existing records. [2025-10-13T17:39:42.755052] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:42.751373] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:39:42.755832] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-13T17:39:42.759060] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-13T17:39:42.759321] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-13T17:39:42.759364] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-13T17:39:42.822859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-13T17:39:43.134171] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:43.164756] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:39:43.617962] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-13T17:39:44.417968] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-13T17:39:44.470587] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:39:45.046939] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T17:39:45.098507] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T17:39:45.217924] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-13T17:39:46.018021] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-13T17:39:46.806838] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:39:46.817900] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-13T17:39:46.955334] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T17:39:47.617993] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-13T17:39:48.332297] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T17:39:48.382951] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:39:48.417922] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-13T17:39:49.217955] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-13T17:39:50.017948] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-13T17:39:50.403127] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:39:50.471890] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T17:39:50.817965] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-13T17:39:51.270836] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:39:51.617951] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-13T17:39:52.417956] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-13T17:39:52.998826] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:39:53.055528] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T17:39:53.110315] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T17:39:53.217966] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-13T17:39:54.018043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-13T17:39:54.817906] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-13T17:39:55.036392] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:39:55.478525] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:39:55.617946] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-13T17:39:55.908184] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T17:39:56.417950] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-13T17:39:56.974436] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:39:57.217998] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-13T17:39:57.235414] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T17:39:58.017953] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-13T17:39:58.818073] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-13T17:39:58.903019] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:39:59.268090] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:39:59.617948] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-13T17:40:00.343997] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:40:00.417970] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-13T17:40:00.881087] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T17:40:01.218007] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-13T17:40:01.651577] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:40:02.018055] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-13T17:40:02.047125] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:40:02.817957] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-13T17:40:03.440342] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:40:03.617967] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-13T17:40:04.202593] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:40:04.418013] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-13T17:40:04.603293] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:40:05.217970] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-13T17:40:05.400704] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:40:06.017948] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-13T17:40:06.817965] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-13T17:40:07.326107] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:40:07.335438] [INFO ] [REMOTE ] BKSY: Full fetch complete (70100 records). [2025-10-13T17:40:07.335745] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-13T17:40:07.621794] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-13T17:40:07.818564] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-13T17:40:07.818788] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-13T17:40:07.819844] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-13T17:40:07.819931] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-13T17:40:07.862164] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:40:07.862334] [DEBUG] [LOCAL ] BKSY: Trimmed 70100 records to 48596 (keeping 200 days of data) [2025-10-13T17:40:07.984342] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:40:08.205089] [DEBUG] [LOCAL ] BKSY: Primary data saved (48596 records). [2025-10-13T17:40:08.205280] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-13T17:40:08.205381] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 43.3s. Estimated remaining: 4h 44m 15s. Rate: 7.3 symbols/min [2025-10-13T17:40:08.394965] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:08.417955] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-13T17:40:08.436473] [DEBUG] [LOCAL ] BLCO: Loaded 36059 existing records from primary storage. [2025-10-13T17:40:08.436950] [INFO ] [MAIN ] BLCO: Loaded 36059 existing records. [2025-10-13T17:40:08.656566] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:08.657084] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-13T17:40:08.657151] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-13T17:40:08.657567] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-13T17:40:08.657635] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-13T17:40:09.013164] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:40:09.112247] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:09.217938] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-13T17:40:10.017898] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-13T17:40:10.091821] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:40:10.636529] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:40:10.817946] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-13T17:40:11.617964] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-13T17:40:12.177255] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T17:40:12.417935] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-13T17:40:12.574026] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:40:12.576754] [INFO ] [REMOTE ] BKT: Full fetch complete (16083 records). [2025-10-13T17:40:12.576860] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-13T17:40:12.979986] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-13T17:40:12.980109] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-13T17:40:12.980620] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-13T17:40:12.980712] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-13T17:40:12.981437] [DEBUG] [LOCAL ] BKT: Trimmed 16083 records to 12267 (keeping 200 days of data) [2025-10-13T17:40:13.074095] [DEBUG] [LOCAL ] BKT: Primary data saved (12267 records). [2025-10-13T17:40:13.074281] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-13T17:40:13.074433] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKT took 39.7s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-13T17:40:13.219244] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-13T17:40:13.254126] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:13.285728] [DEBUG] [LOCAL ] BLD: Loaded 28106 existing records from primary storage. [2025-10-13T17:40:13.286108] [INFO ] [MAIN ] BLD: Loaded 28106 existing records. [2025-10-13T17:40:13.483534] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:13.484842] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-13T17:40:13.484932] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-13T17:40:13.486344] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-13T17:40:13.486494] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-13T17:40:13.878136] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:13.906952] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:40:13.941775] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (3.92 seconds). [2025-10-13T17:40:13.946146] [INFO ] [REMOTE ] BKV: Full fetch complete (44802 records). [2025-10-13T17:40:13.946435] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-13T17:40:14.023033] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-13T17:40:14.368056] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-13T17:40:14.368148] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-13T17:40:14.369353] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-13T17:40:14.369417] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-13T17:40:14.371377] [DEBUG] [LOCAL ] BKV: Trimmed 44802 records to 29753 (keeping 200 days of data) [2025-10-13T17:40:14.542380] [DEBUG] [LOCAL ] BKV: Primary data saved (29753 records). [2025-10-13T17:40:14.542522] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-13T17:40:14.542604] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 32.2s. Estimated remaining: 4h 42m 47s. Rate: 7.3 symbols/min [2025-10-13T17:40:14.742582] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:14.769043] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:40:14.821281] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-13T17:40:14.823169] [DEBUG] [LOCAL ] BLDR: Loaded 52473 existing records from primary storage. [2025-10-13T17:40:14.823547] [INFO ] [MAIN ] BLDR: Loaded 52473 existing records. [2025-10-13T17:40:15.002534] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:15.002957] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-13T17:40:15.003054] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-13T17:40:15.003687] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-13T17:40:15.003884] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-13T17:40:15.200905] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T17:40:15.392432] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:15.617918] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-13T17:40:16.370298] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:40:16.417897] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-13T17:40:17.217901] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-13T17:40:17.455089] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:40:18.017930] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-13T17:40:18.182165] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:40:18.186916] [INFO ] [REMOTE ] BKU: Full fetch complete (60324 records). [2025-10-13T17:40:18.187032] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-13T17:40:18.593322] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-13T17:40:18.593936] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-13T17:40:18.594458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T17:40:18.595223] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-13T17:40:18.601224] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-13T17:40:18.602360] [DEBUG] [LOCAL ] BKU: Trimmed 60324 records to 41954 (keeping 200 days of data) [2025-10-13T17:40:18.818394] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-13T17:40:18.865043] [DEBUG] [LOCAL ] BKU: Primary data saved (41954 records). [2025-10-13T17:40:18.865178] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-13T17:40:18.865261] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BKU took 38.9s. Estimated remaining: 4h 42m 12s. Rate: 7.4 symbols/min [2025-10-13T17:40:19.041354] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:19.058966] [DEBUG] [LOCAL ] BLE: Loaded 14251 existing records from primary storage. [2025-10-13T17:40:19.059282] [INFO ] [MAIN ] BLE: Loaded 14251 existing records. [2025-10-13T17:40:19.263491] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:19.264086] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-13T17:40:19.264282] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-13T17:40:19.264591] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-13T17:40:19.264696] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-13T17:40:19.377888] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:40:19.627085] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-13T17:40:19.674228] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:20.418039] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-13T17:40:20.616002] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T17:40:21.045728] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:40:21.135476] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T17:40:21.217929] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-13T17:40:22.018033] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-13T17:40:22.817910] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-13T17:40:22.945609] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:40:23.619326] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:40:23.619484] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-13T17:40:24.147316] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:40:24.417924] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-13T17:40:25.217963] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-13T17:40:25.367682] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T17:40:25.470007] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:40:25.912339] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:40:26.018007] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-13T17:40:26.129236] [DEBUG] [REMOTE ] BLE: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T17:40:26.129618] [WARN ] [REMOTE ] BLE: No data returned for month 2025-02 [2025-10-13T17:40:26.129787] [FATAL] [REMOTE ] BLE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:40:26.129884] [FATAL] [MAIN ] BLE: Failed to fetch primary data. [2025-10-13T17:40:26.129946] [WARN ] [MAIN ] BLE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:40:26.130023] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-13T17:40:26.130139] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-13T17:40:26.130185] [INFO ] [LOCAL ] BLE: Starting deletion of derivative data. [2025-10-13T17:40:26.130364] [DEBUG] [LOCAL ] BLE: Deleted derivative data file. [2025-10-13T17:40:26.130457] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLE took 7.3s. Estimated remaining: 4h 41m 58s. Rate: 7.4 symbols/min [2025-10-13T17:40:26.322971] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:26.362799] [DEBUG] [LOCAL ] BLK: Loaded 34578 existing records from primary storage. [2025-10-13T17:40:26.363152] [INFO ] [MAIN ] BLK: Loaded 34578 existing records. [2025-10-13T17:40:26.549306] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:26.549605] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-13T17:40:26.549711] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-13T17:40:26.550003] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-13T17:40:26.550076] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-13T17:40:26.823099] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-13T17:40:26.947425] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:27.617939] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-13T17:40:28.262126] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:40:28.417955] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-13T17:40:29.217919] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-13T17:40:29.551451] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:40:29.630176] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:40:30.017955] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-13T17:40:30.772489] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:40:30.817924] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-13T17:40:31.408903] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:40:31.617968] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-13T17:40:31.964516] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:40:32.418009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-13T17:40:33.217971] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-13T17:40:33.410981] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T17:40:33.784014] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:40:34.017910] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-13T17:40:34.162912] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T17:40:34.817945] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-13T17:40:35.337423] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:40:35.341178] [INFO ] [REMOTE ] BLCO: Full fetch complete (52243 records). [2025-10-13T17:40:35.341275] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-13T17:40:35.623064] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-13T17:40:35.725069] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-13T17:40:35.725147] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-13T17:40:35.725787] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-13T17:40:35.725847] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-13T17:40:35.727253] [DEBUG] [LOCAL ] BLCO: Trimmed 52243 records to 35532 (keeping 200 days of data) [2025-10-13T17:40:35.930763] [DEBUG] [LOCAL ] BLCO: Primary data saved (35532 records). [2025-10-13T17:40:35.930918] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-13T17:40:35.931800] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLCO took 27.7s. Estimated remaining: 4h 42m 1s. Rate: 7.4 symbols/min [2025-10-13T17:40:36.107098] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:36.159984] [DEBUG] [LOCAL ] BLND: Loaded 49952 existing records from primary storage. [2025-10-13T17:40:36.160331] [INFO ] [MAIN ] BLND: Loaded 49952 existing records. [2025-10-13T17:40:36.337809] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:36.338197] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-13T17:40:36.338251] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-13T17:40:36.338796] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-13T17:40:36.338853] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-13T17:40:36.419210] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-13T17:40:36.704088] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:36.727436] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T17:40:37.217922] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-13T17:40:37.393846] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T17:40:37.794787] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:40:38.017920] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-13T17:40:38.817926] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-13T17:40:38.918172] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:40:39.317504] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:40:39.617906] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-13T17:40:40.374191] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:40:40.417893] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-13T17:40:40.878779] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T17:40:41.217927] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-13T17:40:42.018023] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-13T17:40:42.149282] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:40:42.817905] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-13T17:40:42.860814] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:40:42.889521] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:40:42.892668] [INFO ] [REMOTE ] BLD: Full fetch complete (39960 records). [2025-10-13T17:40:42.892754] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-13T17:40:43.262294] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-13T17:40:43.262379] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-13T17:40:43.262978] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-13T17:40:43.263039] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-13T17:40:43.263916] [DEBUG] [LOCAL ] BLD: Trimmed 39960 records to 27619 (keeping 200 days of data) [2025-10-13T17:40:43.428003] [DEBUG] [LOCAL ] BLD: Primary data saved (27619 records). [2025-10-13T17:40:43.428146] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-13T17:40:43.428259] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLD took 30.4s. Estimated remaining: 4h 41m 48s. Rate: 7.4 symbols/min [2025-10-13T17:40:43.606313] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:43.606516] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-13T17:40:43.606556] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-13T17:40:43.606691] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-13T17:40:43.606745] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-13T17:40:43.606789] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-13T17:40:43.606854] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-13T17:40:43.627187] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-13T17:40:43.961271] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:44.225124] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:40:44.417939] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-13T17:40:45.202892] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:40:45.217889] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-13T17:40:46.017963] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-13T17:40:46.207075] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:40:46.207476] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-13T17:40:46.207573] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:40:46.207627] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-13T17:40:46.207715] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:40:46.207795] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-13T17:40:46.207869] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-13T17:40:46.207907] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-13T17:40:46.207947] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-13T17:40:46.208033] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLSH took 2.8s. Estimated remaining: 4h 41m 3s. Rate: 7.4 symbols/min [2025-10-13T17:40:46.381605] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:46.406565] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T17:40:46.425343] [DEBUG] [LOCAL ] BLW: Loaded 13518 existing records from primary storage. [2025-10-13T17:40:46.425598] [INFO ] [MAIN ] BLW: Loaded 13518 existing records. [2025-10-13T17:40:46.612203] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:46.612435] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-13T17:40:46.612483] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-13T17:40:46.612730] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-13T17:40:46.612812] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-13T17:40:46.824300] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-13T17:40:46.991231] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:47.020818] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:40:47.617925] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-13T17:40:48.417927] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-13T17:40:48.585453] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:40:48.641840] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:40:49.217927] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-13T17:40:49.988730] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T17:40:50.017901] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-13T17:40:50.221967] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:40:50.815788] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:40:50.818801] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-13T17:40:51.617955] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-13T17:40:52.417967] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-13T17:40:52.474838] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:40:52.525891] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T17:40:53.217924] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-13T17:40:54.017939] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-13T17:40:54.303969] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T17:40:54.309511] [INFO ] [REMOTE ] BLDR: Full fetch complete (74519 records). [2025-10-13T17:40:54.309703] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-13T17:40:54.718766] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-13T17:40:54.719574] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-13T17:40:54.720824] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-13T17:40:54.720955] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-13T17:40:54.722998] [DEBUG] [LOCAL ] BLDR: Trimmed 74519 records to 51810 (keeping 200 days of data) [2025-10-13T17:40:54.827090] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-13T17:40:54.867021] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:40:54.886666] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:40:55.120688] [DEBUG] [LOCAL ] BLDR: Primary data saved (51810 records). [2025-10-13T17:40:55.120849] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-13T17:40:55.120946] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLDR took 40.6s. Estimated remaining: 4h 41m 0s. Rate: 7.4 symbols/min [2025-10-13T17:40:55.290117] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:55.305820] [DEBUG] [LOCAL ] BLX: Loaded 15813 existing records from primary storage. [2025-10-13T17:40:55.306054] [INFO ] [MAIN ] BLX: Loaded 15813 existing records. [2025-10-13T17:40:55.477066] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:55.477330] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-13T17:40:55.477378] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-13T17:40:55.477569] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-13T17:40:55.477625] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-13T17:40:55.623060] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-13T17:40:55.835313] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:56.399098] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:40:56.417883] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-13T17:40:56.712393] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:40:57.217944] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-13T17:40:57.228881] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:40:58.017921] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-13T17:40:58.827511] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-13T17:40:58.829987] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:40:59.497553] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-13T17:40:59.525449] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:40:59.617924] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-13T17:41:00.417936] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-13T17:41:01.217950] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-13T17:41:01.418342] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:41:02.017940] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-13T17:41:02.030464] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:41:02.473785] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:41:02.818046] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-13T17:41:02.955661] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T17:41:03.617923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-13T17:41:04.417900] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-13T17:41:04.619729] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T17:41:04.715537] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T17:41:05.060366] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T17:41:05.217923] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-13T17:41:06.017961] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-13T17:41:06.181270] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:41:06.183517] [INFO ] [REMOTE ] BLW: Full fetch complete (19268 records). [2025-10-13T17:41:06.183588] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-13T17:41:06.581169] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-13T17:41:06.581262] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-13T17:41:06.581719] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-13T17:41:06.581782] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-13T17:41:06.582619] [DEBUG] [LOCAL ] BLW: Trimmed 19268 records to 13268 (keeping 200 days of data) [2025-10-13T17:41:06.675081] [DEBUG] [LOCAL ] BLW: Primary data saved (13268 records). [2025-10-13T17:41:06.675227] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-13T17:41:06.675308] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 20.5s. Estimated remaining: 4h 41m 15s. Rate: 7.4 symbols/min [2025-10-13T17:41:06.823031] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-13T17:41:06.848978] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:06.883731] [DEBUG] [LOCAL ] BMA: Loaded 36296 existing records from primary storage. [2025-10-13T17:41:06.884066] [INFO ] [MAIN ] BMA: Loaded 36296 existing records. [2025-10-13T17:41:07.061229] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:07.061497] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-13T17:41:07.061551] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-13T17:41:07.061841] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-13T17:41:07.061898] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-13T17:41:07.424191] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:07.618015] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-13T17:41:07.619732] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:41:07.670035] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:41:08.417925] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-13T17:41:09.203710] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:41:09.217890] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-13T17:41:10.024045] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-13T17:41:10.026419] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:41:10.031920] [INFO ] [REMOTE ] BLND: Full fetch complete (72196 records). [2025-10-13T17:41:10.032033] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-13T17:41:10.428903] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-13T17:41:10.429200] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-13T17:41:10.430223] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-13T17:41:10.430394] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-13T17:41:10.432003] [DEBUG] [LOCAL ] BLND: Trimmed 72196 records to 49275 (keeping 200 days of data) [2025-10-13T17:41:10.537913] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:41:10.731778] [DEBUG] [LOCAL ] BLND: Primary data saved (49275 records). [2025-10-13T17:41:10.731927] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-13T17:41:10.732669] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 34.8s. Estimated remaining: 4h 40m 39s. Rate: 7.4 symbols/min [2025-10-13T17:41:10.823097] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-13T17:41:10.905619] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:10.919387] [DEBUG] [LOCAL ] BME: Loaded 11309 existing records from primary storage. [2025-10-13T17:41:10.919671] [INFO ] [MAIN ] BME: Loaded 11309 existing records. [2025-10-13T17:41:11.099683] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:11.109825] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-13T17:41:11.110361] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-13T17:41:11.110775] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:41:11.110817] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-13T17:41:11.112286] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-13T17:41:11.461755] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:11.617923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-13T17:41:12.179038] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:41:12.417945] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-13T17:41:12.859201] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T17:41:13.217940] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-13T17:41:14.017902] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-13T17:41:14.151704] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:41:14.170173] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T17:41:14.817935] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-13T17:41:15.038690] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T17:41:15.578863] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:41:15.617914] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-13T17:41:16.417900] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-13T17:41:16.535020] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T17:41:17.218006] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-13T17:41:17.265274] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:41:18.017918] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-13T17:41:18.426687] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:41:18.673444] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:41:18.817898] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-13T17:41:19.549916] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:41:19.617907] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-13T17:41:20.344507] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:41:20.417900] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-13T17:41:21.200407] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:41:21.217887] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-13T17:41:21.932585] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:41:22.017921] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-13T17:41:22.818008] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-13T17:41:22.869290] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T17:41:23.618032] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-13T17:41:24.372593] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:41:24.417926] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-13T17:41:24.549027] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:41:25.218033] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-13T17:41:25.966012] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:41:26.017919] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-13T17:41:26.151282] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:41:26.818000] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-13T17:41:27.459569] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T17:41:27.617954] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-13T17:41:28.337059] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T17:41:28.417947] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-13T17:41:28.533792] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:41:29.218004] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-13T17:41:29.803873] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:41:30.017951] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-13T17:41:30.124862] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:41:30.126997] [INFO ] [REMOTE ] BME: Full fetch complete (15963 records). [2025-10-13T17:41:30.127071] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-13T17:41:30.492887] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-13T17:41:30.492972] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-13T17:41:30.493357] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-13T17:41:30.493396] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-13T17:41:30.493914] [DEBUG] [LOCAL ] BME: Trimmed 15963 records to 11201 (keeping 200 days of data) [2025-10-13T17:41:30.562211] [DEBUG] [LOCAL ] BME: Primary data saved (11201 records). [2025-10-13T17:41:30.562356] [INFO ] [MAIN ] BME: Full history saved. [2025-10-13T17:41:30.562440] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 19.8s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-13T17:41:30.726740] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:30.752755] [DEBUG] [LOCAL ] BMEZ: Loaded 26860 existing records from primary storage. [2025-10-13T17:41:30.753028] [INFO ] [MAIN ] BMEZ: Loaded 26860 existing records. [2025-10-13T17:41:30.825183] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-13T17:41:30.932307] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:30.932570] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-13T17:41:30.932624] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-13T17:41:30.932985] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-13T17:41:30.933044] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-13T17:41:31.299336] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:31.618289] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-13T17:41:31.622034] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T17:41:31.627096] [INFO ] [REMOTE ] BLK: Full fetch complete (52549 records). [2025-10-13T17:41:31.627190] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-13T17:41:32.063370] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-13T17:41:32.063547] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-13T17:41:32.064415] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-13T17:41:32.064601] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-13T17:41:32.067786] [DEBUG] [LOCAL ] BLK: Trimmed 52549 records to 34143 (keeping 200 days of data) [2025-10-13T17:41:32.226034] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:41:32.343776] [DEBUG] [LOCAL ] BLK: Primary data saved (34143 records). [2025-10-13T17:41:32.343969] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-13T17:41:32.344070] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BLK took 1m 6s. Estimated remaining: 4h 40m 59s. Rate: 7.4 symbols/min [2025-10-13T17:41:32.423128] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-13T17:41:32.531549] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:32.557826] [DEBUG] [LOCAL ] BMI: Loaded 24727 existing records from primary storage. [2025-10-13T17:41:32.558200] [INFO ] [MAIN ] BMI: Loaded 24727 existing records. [2025-10-13T17:41:32.756031] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:32.756465] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-13T17:41:32.756525] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-13T17:41:32.756807] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-13T17:41:32.756867] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-13T17:41:33.170511] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:33.173761] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:41:33.209129] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T17:41:33.217880] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-13T17:41:34.017900] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-13T17:41:34.126594] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:41:34.129222] [INFO ] [REMOTE ] BLX: Full fetch complete (22409 records). [2025-10-13T17:41:34.129348] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-13T17:41:34.508386] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-13T17:41:34.508499] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-13T17:41:34.509046] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-13T17:41:34.509119] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-13T17:41:34.510195] [DEBUG] [LOCAL ] BLX: Trimmed 22409 records to 15613 (keeping 200 days of data) [2025-10-13T17:41:34.609513] [DEBUG] [LOCAL ] BLX: Primary data saved (15613 records). [2025-10-13T17:41:34.609741] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-13T17:41:34.609855] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BLX took 39.5s. Estimated remaining: 4h 40m 11s. Rate: 7.4 symbols/min [2025-10-13T17:41:34.786552] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:34.786812] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-10-13T17:41:34.786857] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-10-13T17:41:34.786988] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-13T17:41:34.787029] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-13T17:41:34.787069] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-13T17:41:34.787102] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-13T17:41:34.823105] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-13T17:41:35.189312] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:35.367274] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T17:41:35.617946] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-13T17:41:36.253086] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:41:36.417901] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-13T17:41:36.772890] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:41:37.217935] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-13T17:41:38.018025] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-13T17:41:38.097031] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:41:38.153554] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:41:38.574559] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T17:41:38.817954] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-13T17:41:39.617969] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-13T17:41:39.885073] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T17:41:40.417952] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-13T17:41:40.528991] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:41:41.218029] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-13T17:41:41.510200] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:41:41.515809] [INFO ] [REMOTE ] BMA: Full fetch complete (51598 records). [2025-10-13T17:41:41.516031] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-13T17:41:41.933628] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-13T17:41:41.933870] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-13T17:41:41.934855] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-13T17:41:41.934923] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-13T17:41:41.936625] [DEBUG] [LOCAL ] BMA: Trimmed 51598 records to 35960 (keeping 200 days of data) [2025-10-13T17:41:42.030568] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-13T17:41:42.164192] [DEBUG] [LOCAL ] BMA: Primary data saved (35960 records). [2025-10-13T17:41:42.164349] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-13T17:41:42.164436] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMA took 35.5s. Estimated remaining: 4h 39m 59s. Rate: 7.4 symbols/min [2025-10-13T17:41:42.336410] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:42.375346] [DEBUG] [LOCAL ] BMO: Loaded 41706 existing records from primary storage. [2025-10-13T17:41:42.382455] [INFO ] [MAIN ] BMO: Loaded 41706 existing records. [2025-10-13T17:41:42.487955] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:41:42.580872] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:42.581173] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-13T17:41:42.581221] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-13T17:41:42.581629] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-13T17:41:42.581716] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-13T17:41:42.827755] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-13T17:41:42.953684] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:42.972114] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T17:41:43.333721] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:41:43.617921] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-13T17:41:44.052181] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:41:44.417930] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-13T17:41:44.847734] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:41:45.217933] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-13T17:41:46.017959] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-13T17:41:46.563907] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T17:41:46.781874] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:41:46.817929] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-13T17:41:47.275006] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T17:41:47.617949] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-13T17:41:48.418024] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-13T17:41:49.091433] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:41:49.217935] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-13T17:41:49.518254] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:41:50.017949] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-13T17:41:50.679155] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:41:50.817896] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-13T17:41:51.225611] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T17:41:51.617931] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-13T17:41:52.246430] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T17:41:52.276382] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:41:52.417941] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-13T17:41:53.217947] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-13T17:41:54.017964] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-13T17:41:54.090921] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:41:54.260475] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T17:41:54.817950] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-13T17:41:54.948558] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:41:55.276620] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:41:55.618002] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-13T17:41:56.092190] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:41:56.418024] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-13T17:41:56.888998] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T17:41:57.217939] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-13T17:41:57.725444] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T17:41:57.726547] [INFO ] [REMOTE ] BMN: Full fetch complete (3715 records). [2025-10-13T17:41:57.726948] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-13T17:41:58.023105] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-13T17:41:58.092027] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-13T17:41:58.092119] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-13T17:41:58.092294] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-13T17:41:58.092357] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-13T17:41:58.092796] [DEBUG] [LOCAL ] BMN: Trimmed 3715 records to 2587 (keeping 200 days of data) [2025-10-13T17:41:58.111196] [DEBUG] [LOCAL ] BMN: Primary data saved (2587 records). [2025-10-13T17:41:58.111353] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-13T17:41:58.111476] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 23.5s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-13T17:41:58.283141] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:58.336299] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-13T17:41:58.336844] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-10-13T17:41:58.511463] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:58.511732] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-13T17:41:58.511787] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-13T17:41:58.512300] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-13T17:41:58.512366] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-13T17:41:58.823085] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-13T17:41:58.862712] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:59.617948] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-13T17:41:59.733327] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:41:59.854535] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:42:00.417914] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-13T17:42:01.217927] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-13T17:42:01.496563] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:42:01.632388] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T17:42:02.017954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-13T17:42:02.229374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:42:02.817958] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-13T17:42:03.072969] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T17:42:03.075951] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40256 records). [2025-10-13T17:42:03.076026] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-13T17:42:03.076621] [FATAL] [VALIDATOR ] BMEZ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:42:03.076729] [FATAL] [MAIN ] BMEZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:42:03.076774] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:42:03.076813] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-13T17:42:03.076885] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-13T17:42:03.076939] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-13T17:42:03.077301] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-13T17:42:03.077391] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMEZ took 32.5s. Estimated remaining: 4h 40m 14s. Rate: 7.4 symbols/min [2025-10-13T17:42:03.249742] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:03.305333] [DEBUG] [LOCAL ] BN: Loaded 53765 existing records from primary storage. [2025-10-13T17:42:03.305693] [INFO ] [MAIN ] BN: Loaded 53765 existing records. [2025-10-13T17:42:03.479120] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:03.479328] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-13T17:42:03.479372] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-13T17:42:03.479840] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-13T17:42:03.479896] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-13T17:42:03.621032] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-13T17:42:03.831863] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:04.417918] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-13T17:42:04.566885] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:42:05.217854] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-13T17:42:05.301156] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:42:06.018037] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-13T17:42:06.445506] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:42:06.712944] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T17:42:06.817915] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-13T17:42:07.617996] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-13T17:42:07.791814] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T17:42:07.912400] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:42:08.418003] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-13T17:42:08.892499] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:42:09.217966] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-13T17:42:10.018024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-13T17:42:10.228832] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:42:10.277322] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T17:42:10.817961] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-13T17:42:11.618094] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-13T17:42:12.086869] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T17:42:12.140232] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:42:12.418043] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-13T17:42:13.030038] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:42:13.218023] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-13T17:42:14.018026] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-13T17:42:14.407196] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:42:14.491517] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T17:42:14.818001] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-13T17:42:15.601509] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:42:15.605947] [INFO ] [REMOTE ] BMO: Full fetch complete (59510 records). [2025-10-13T17:42:15.606050] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-13T17:42:15.626979] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-13T17:42:15.989867] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-13T17:42:15.989953] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-13T17:42:15.990839] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-13T17:42:15.990910] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-13T17:42:15.992881] [DEBUG] [LOCAL ] BMO: Trimmed 59510 records to 41112 (keeping 200 days of data) [2025-10-13T17:42:16.257772] [DEBUG] [LOCAL ] BMO: Primary data saved (41112 records). [2025-10-13T17:42:16.257916] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-13T17:42:16.258024] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 34.1s. Estimated remaining: 4h 40m 39s. Rate: 7.3 symbols/min [2025-10-13T17:42:16.419439] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-13T17:42:16.439170] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:16.471050] [DEBUG] [LOCAL ] BNED: Loaded 29437 existing records from primary storage. [2025-10-13T17:42:16.471399] [INFO ] [MAIN ] BNED: Loaded 29437 existing records. [2025-10-13T17:42:16.666054] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:16.666505] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-13T17:42:16.667014] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-13T17:42:16.667607] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-13T17:42:16.667780] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-13T17:42:16.996805] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-13T17:42:17.155346] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:17.161922] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T17:42:17.217945] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-13T17:42:18.017935] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-13T17:42:18.384131] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:42:18.614124] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:42:18.818025] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-13T17:42:19.617895] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-13T17:42:19.914914] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T17:42:19.918782] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T17:42:19.933865] [INFO ] [REMOTE ] BMI: Full fetch complete (33136 records). [2025-10-13T17:42:19.934598] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-13T17:42:20.321561] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-13T17:42:20.321677] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-13T17:42:20.322253] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-13T17:42:20.322380] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-13T17:42:20.323307] [DEBUG] [LOCAL ] BMI: Trimmed 33136 records to 24442 (keeping 200 days of data) [2025-10-13T17:42:20.418163] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-13T17:42:20.494898] [DEBUG] [LOCAL ] BMI: Primary data saved (24442 records). [2025-10-13T17:42:20.495075] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-13T17:42:20.495205] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMI took 48.2s. Estimated remaining: 4h 40m 5s. Rate: 7.4 symbols/min [2025-10-13T17:42:20.661776] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:20.668906] [DEBUG] [LOCAL ] BNH: Loaded 5306 existing records from primary storage. [2025-10-13T17:42:20.669147] [INFO ] [MAIN ] BNH: Loaded 5306 existing records. [2025-10-13T17:42:20.857147] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:20.857614] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-13T17:42:20.857803] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-13T17:42:20.858062] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-13T17:42:20.858124] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-13T17:42:21.111879] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:42:21.228694] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-13T17:42:21.275591] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:22.030555] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-13T17:42:22.039357] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:42:22.426852] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:42:22.818008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-13T17:42:23.560249] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:42:23.617938] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-13T17:42:23.907526] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:42:24.172475] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:42:24.418056] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-13T17:42:25.218000] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-13T17:42:26.017937] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-13T17:42:26.120243] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:42:26.580914] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:42:26.817919] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-13T17:42:27.006332] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:42:27.617955] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-13T17:42:28.417919] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-13T17:42:28.679163] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:42:28.886483] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T17:42:29.218032] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-13T17:42:29.790188] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:42:30.017926] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-13T17:42:30.408539] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T17:42:30.817946] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-13T17:42:31.617924] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-13T17:42:31.889485] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T17:42:31.956421] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T17:42:32.417960] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-13T17:42:33.217898] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-13T17:42:33.539086] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:42:33.681518] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:42:34.017924] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-13T17:42:34.817934] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-13T17:42:34.900574] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:42:35.244050] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:42:35.284149] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T17:42:35.289753] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-13T17:42:35.289928] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-13T17:42:35.629401] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-13T17:42:35.688446] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-13T17:42:35.688672] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-13T17:42:35.689542] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-13T17:42:35.689586] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-13T17:42:35.691342] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-13T17:42:36.031459] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-13T17:42:36.031713] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-13T17:42:36.031808] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 37.9s. Estimated remaining: 4h 40m 45s. Rate: 7.3 symbols/min [2025-10-13T17:42:36.199737] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:36.203964] [DEBUG] [LOCAL ] BNJ: Loaded 2710 existing records from primary storage. [2025-10-13T17:42:36.204122] [INFO ] [MAIN ] BNJ: Loaded 2710 existing records. [2025-10-13T17:42:36.379755] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:36.380022] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-13T17:42:36.380072] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-13T17:42:36.380251] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-13T17:42:36.380306] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-13T17:42:36.423074] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-13T17:42:36.762249] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:36.779194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T17:42:37.024503] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:42:37.218092] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-13T17:42:37.805410] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T17:42:38.018013] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-13T17:42:38.473688] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T17:42:38.817935] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-13T17:42:39.617931] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-13T17:42:40.417955] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-13T17:42:40.646507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T17:42:40.652539] [INFO ] [REMOTE ] BN: Full fetch complete (76713 records). [2025-10-13T17:42:40.652709] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-13T17:42:41.124781] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:42:41.124944] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-13T17:42:41.132444] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-13T17:42:41.133745] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-13T17:42:41.134202] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-13T17:42:41.136076] [DEBUG] [LOCAL ] BN: Trimmed 76713 records to 52987 (keeping 200 days of data) [2025-10-13T17:42:41.227387] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-13T17:42:41.264821] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T17:42:41.477231] [DEBUG] [LOCAL ] BN: Primary data saved (52987 records). [2025-10-13T17:42:41.477389] [INFO ] [MAIN ] BN: Full history saved. [2025-10-13T17:42:41.478160] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 38.4s. Estimated remaining: 4h 40m 19s. Rate: 7.3 symbols/min [2025-10-13T17:42:41.643520] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:41.690624] [DEBUG] [LOCAL ] BNL: Loaded 47890 existing records from primary storage. [2025-10-13T17:42:41.690985] [INFO ] [MAIN ] BNL: Loaded 47890 existing records. [2025-10-13T17:42:41.900091] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:41.900407] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-13T17:42:41.900477] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-13T17:42:41.900881] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-13T17:42:41.900948] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-13T17:42:42.020311] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-13T17:42:42.306110] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:42.518037] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-13T17:42:42.549057] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:42:42.817950] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-13T17:42:43.317385] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:42:43.618007] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-13T17:42:44.139396] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T17:42:44.418001] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-13T17:42:45.218023] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-13T17:42:45.774312] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T17:42:46.024071] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-13T17:42:46.045455] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:42:46.752614] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:42:46.817962] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-13T17:42:47.302369] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:42:47.617961] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-13T17:42:48.418067] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-13T17:42:48.909482] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:42:48.995851] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T17:42:49.218005] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-13T17:42:50.018026] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-13T17:42:50.420827] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T17:42:50.672469] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:42:50.817961] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-13T17:42:51.617957] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-13T17:42:51.865094] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:42:51.867999] [INFO ] [REMOTE ] BNED: Full fetch complete (42814 records). [2025-10-13T17:42:51.868088] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-13T17:42:52.252231] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-13T17:42:52.252316] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-13T17:42:52.252986] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-13T17:42:52.253048] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-13T17:42:52.254068] [DEBUG] [LOCAL ] BNED: Trimmed 42814 records to 28770 (keeping 200 days of data) [2025-10-13T17:42:52.418692] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-13T17:42:52.418567] [DEBUG] [LOCAL ] BNED: Primary data saved (28770 records). [2025-10-13T17:42:52.419265] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-13T17:42:52.419395] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNED took 36.2s. Estimated remaining: 4h 40m 29s. Rate: 7.3 symbols/min [2025-10-13T17:42:52.594793] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:52.644852] [DEBUG] [LOCAL ] BNS: Loaded 52233 existing records from primary storage. [2025-10-13T17:42:52.645183] [INFO ] [MAIN ] BNS: Loaded 52233 existing records. [2025-10-13T17:42:52.835055] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:52.835416] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-13T17:42:52.835490] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-13T17:42:52.836106] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-13T17:42:52.836164] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-13T17:42:53.019925] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:42:53.162684] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T17:42:53.167231] [INFO ] [REMOTE ] BNH: Full fetch complete (6942 records). [2025-10-13T17:42:53.177948] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-13T17:42:53.233366] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-13T17:42:53.293912] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:53.655617] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-13T17:42:53.655725] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-13T17:42:53.655942] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-13T17:42:53.655980] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-13T17:42:53.656352] [DEBUG] [LOCAL ] BNH: Trimmed 6942 records to 5246 (keeping 200 days of data) [2025-10-13T17:42:53.688095] [DEBUG] [LOCAL ] BNH: Primary data saved (5246 records). [2025-10-13T17:42:53.688179] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-13T17:42:53.688250] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNH took 33.2s. Estimated remaining: 4h 39m 36s. Rate: 7.4 symbols/min [2025-10-13T17:42:53.856548] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:53.861356] [DEBUG] [LOCAL ] BNT: Loaded 3433 existing records from primary storage. [2025-10-13T17:42:53.861506] [INFO ] [MAIN ] BNT: Loaded 3433 existing records. [2025-10-13T17:42:53.932858] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T17:42:54.020446] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-13T17:42:54.047668] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:54.047964] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-13T17:42:54.048062] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-13T17:42:54.048208] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-13T17:42:54.048252] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-13T17:42:54.398519] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:54.504522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T17:42:54.817917] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-13T17:42:55.617917] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-13T17:42:56.417950] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-13T17:42:56.504440] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:42:57.011852] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T17:42:57.217955] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-13T17:42:57.294585] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:42:58.018020] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-13T17:42:58.410392] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T17:42:58.618124] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T17:42:58.817912] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-13T17:42:59.617917] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-13T17:43:00.151390] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:43:00.417897] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-13T17:43:00.578333] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:43:01.217922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-13T17:43:01.669355] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T17:43:02.017903] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-13T17:43:02.160354] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:43:02.450857] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:43:02.818044] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-13T17:43:03.617964] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-13T17:43:04.193728] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T17:43:04.417934] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-13T17:43:04.542553] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T17:43:05.125941] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:43:05.126847] [INFO ] [REMOTE ] BNJ: Full fetch complete (4197 records). [2025-10-13T17:43:05.126915] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-13T17:43:05.224251] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-13T17:43:05.519617] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-13T17:43:05.519750] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-13T17:43:05.519929] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-13T17:43:05.519975] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-13T17:43:05.520406] [DEBUG] [LOCAL ] BNJ: Trimmed 4197 records to 2668 (keeping 200 days of data) [2025-10-13T17:43:05.539962] [DEBUG] [LOCAL ] BNJ: Primary data saved (2668 records). [2025-10-13T17:43:05.540153] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-13T17:43:05.540263] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNJ took 29.5s. Estimated remaining: 4h 39m 52s. Rate: 7.3 symbols/min [2025-10-13T17:43:05.712248] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:05.721258] [DEBUG] [LOCAL ] BNY: Loaded 7231 existing records from primary storage. [2025-10-13T17:43:05.721460] [INFO ] [MAIN ] BNY: Loaded 7231 existing records. [2025-10-13T17:43:05.899826] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:05.900064] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-13T17:43:05.900112] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-13T17:43:05.900355] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-13T17:43:05.900432] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-13T17:43:06.023180] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-13T17:43:06.254167] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:06.817908] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-13T17:43:07.072895] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:43:07.391142] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T17:43:07.617909] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-13T17:43:07.760230] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:43:08.417939] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-13T17:43:09.170719] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:43:09.217916] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-13T17:43:09.377359] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:43:10.017927] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-13T17:43:10.079702] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:43:10.818005] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-13T17:43:11.519884] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:43:11.555267] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T17:43:11.617887] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-13T17:43:12.421170] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-13T17:43:12.807820] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:43:13.217909] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-13T17:43:13.462259] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T17:43:14.017914] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-13T17:43:14.563266] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:43:14.614333] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:43:14.818012] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-13T17:43:15.608513] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:43:15.617870] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-13T17:43:16.007338] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T17:43:16.417995] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-13T17:43:17.218071] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-13T17:43:18.018015] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-13T17:43:18.259436] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:43:18.430009] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T17:43:18.818285] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-13T17:43:18.824191] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T17:43:19.490732] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:43:19.617927] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-13T17:43:20.417928] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-13T17:43:20.809946] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T17:43:21.217958] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-13T17:43:21.330772] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:43:21.633962] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T17:43:22.017939] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-13T17:43:22.552437] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:43:22.817949] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-13T17:43:23.617935] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-13T17:43:24.137513] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:43:24.139036] [INFO ] [REMOTE ] BNT: Full fetch complete (4593 records). [2025-10-13T17:43:24.139123] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-13T17:43:24.421741] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-13T17:43:24.548500] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-13T17:43:24.549302] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-13T17:43:24.549816] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T17:43:24.554891] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-13T17:43:24.555367] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-13T17:43:24.556365] [INFO ] [REMOTE ] BNS: Full fetch complete (74371 records). [2025-10-13T17:43:24.556493] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-13T17:43:24.556253] [DEBUG] [LOCAL ] BNT: Trimmed 4593 records to 3428 (keeping 200 days of data) [2025-10-13T17:43:24.683058] [DEBUG] [LOCAL ] BNT: Primary data saved (3428 records). [2025-10-13T17:43:24.685737] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-13T17:43:24.691619] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 31.0s. Estimated remaining: 4h 40m 55s. Rate: 7.3 symbols/min [2025-10-13T17:43:24.977442] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-13T17:43:24.977526] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-13T17:43:24.978370] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-13T17:43:24.978433] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-13T17:43:24.980035] [DEBUG] [LOCAL ] BNS: Trimmed 74371 records to 51465 (keeping 200 days of data) [2025-10-13T17:43:25.220757] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-13T17:43:25.299900] [DEBUG] [LOCAL ] BNS: Primary data saved (51465 records). [2025-10-13T17:43:25.300035] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-13T17:43:25.300113] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 32.9s. Estimated remaining: 4h 39m 57s. Rate: 7.3 symbols/min [2025-10-13T17:43:25.942753] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T17:43:26.017999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-13T17:43:26.051391] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:43:26.818011] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-13T17:43:27.502352] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:43:27.604259] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:43:27.617875] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-13T17:43:27.739976] [DEBUG] [REMOTE ] BNL: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T17:43:27.740405] [WARN ] [REMOTE ] BNL: No data returned for month 2025-10 [2025-10-13T17:43:27.740503] [FATAL] [REMOTE ] BNL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:43:27.740618] [FATAL] [MAIN ] BNL: Failed to fetch primary data. [2025-10-13T17:43:27.740790] [WARN ] [MAIN ] BNL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:43:27.740853] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-13T17:43:27.740957] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-10-13T17:43:27.741014] [INFO ] [LOCAL ] BNL: Starting deletion of derivative data. [2025-10-13T17:43:27.741210] [DEBUG] [LOCAL ] BNL: Deleted derivative data file. [2025-10-13T17:43:27.742256] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNL took 46.3s. Estimated remaining: 4h 39m 12s. Rate: 7.3 symbols/min [2025-10-13T17:43:28.418006] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-13T17:43:29.127930] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T17:43:29.218074] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-13T17:43:30.031268] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T17:43:30.032999] [INFO ] [REMOTE ] BNY: Full fetch complete (10402 records). [2025-10-13T17:43:30.033071] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-13T17:43:30.400097] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-13T17:43:30.400203] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-13T17:43:30.400600] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-13T17:43:30.400685] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-13T17:43:30.401256] [DEBUG] [LOCAL ] BNY: Trimmed 10402 records to 7160 (keeping 200 days of data) [2025-10-13T17:43:30.445508] [DEBUG] [LOCAL ] BNY: Primary data saved (7160 records). [2025-10-13T17:43:30.445700] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-13T17:43:30.445803] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BNY took 24.9s. Estimated remaining: 4h 38m 29s. Rate: 7.4 symbols/min [2025-10-13T17:43:31.174914] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.193228] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.106351] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.257262] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.317104] [DEBUG] [LOCAL ] BOC: Loaded 18790 existing records from primary storage. [2025-10-13T17:43:31.316553] [DEBUG] [LOCAL ] BOE: Loaded 18415 existing records from primary storage. [2025-10-13T17:43:31.326063] [INFO ] [MAIN ] BOC: Loaded 18790 existing records. [2025-10-13T17:43:31.325955] [INFO ] [MAIN ] BOE: Loaded 18415 existing records. [2025-10-13T17:43:31.371793] [DEBUG] [LOCAL ] BOH: Loaded 30903 existing records from primary storage. [2025-10-13T17:43:31.420379] [INFO ] [MAIN ] BOH: Loaded 30903 existing records. [2025-10-13T17:43:31.434878] [DEBUG] [LOCAL ] BOND: Loaded 32729 existing records from primary storage. [2025-10-13T17:43:31.449102] [INFO ] [MAIN ] BOND: Loaded 32729 existing records. [2025-10-13T17:43:31.858625] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:31.959931] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:31.966095] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.012744] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-13T17:43:32.018191] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.038232] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-13T17:43:32.058706] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-13T17:43:32.069368] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-13T17:43:32.090063] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-13T17:43:32.106408] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-13T17:43:32.161523] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:32.197824] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.234994] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-13T17:43:32.224605] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:32.279244] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.284486] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-13T17:43:32.284621] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-13T17:43:32.323975] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-13T17:43:32.289958] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-13T17:43:32.324150] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-13T17:43:33.540022] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.581181] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-13T17:43:33.585934] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.592330] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-13T17:43:33.729871] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.730847] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-13T17:43:33.751193] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.751475] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-13T17:43:34.819149] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:43:34.824172] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-13T17:43:34.853993] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:43:34.859085] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-13T17:43:34.927421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:43:34.933984] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-13T17:43:35.009235] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T17:43:35.617959] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-13T17:43:35.869948] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T17:43:35.944884] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T17:43:36.329443] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T17:43:36.417878] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-13T17:43:36.511691] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T17:43:37.217912] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-13T17:43:37.476748] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:43:38.017917] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-13T17:43:38.450750] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:43:38.794022] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T17:43:38.817904] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-13T17:43:39.617951] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-13T17:43:39.835952] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:43:40.417938] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-13T17:43:40.992587] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:43:41.217939] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-13T17:43:41.760026] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T17:43:42.018048] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-13T17:43:42.679916] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:43:42.817961] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-13T17:43:42.996792] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:43:43.617919] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-13T17:43:44.223528] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:43:44.417937] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-13T17:43:44.694509] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:43:45.218007] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-13T17:43:45.722067] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:43:46.017926] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-13T17:43:46.312129] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:43:46.817996] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-13T17:43:47.240317] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:43:47.617940] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-13T17:43:48.045554] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:43:48.418009] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-13T17:43:48.589384] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T17:43:49.122473] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T17:43:49.217921] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-13T17:43:49.994411] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:43:50.017903] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-13T17:43:50.817938] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-13T17:43:51.013091] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:43:51.617897] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-13T17:43:51.677443] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T17:43:52.317878] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T17:43:52.417887] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-13T17:43:53.218000] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-13T17:43:53.333427] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:43:54.017900] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-13T17:43:54.183527] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:43:54.755629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T17:43:54.817895] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-13T17:43:55.617942] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-13T17:43:55.747629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T17:43:55.749975] [INFO ] [REMOTE ] BOC: Full fetch complete (25835 records). [2025-10-13T17:43:55.750047] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-13T17:43:56.120104] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-13T17:43:56.120188] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-13T17:43:56.120693] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-13T17:43:56.120753] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-13T17:43:56.121417] [DEBUG] [LOCAL ] BOC: Trimmed 25835 records to 18609 (keeping 200 days of data) [2025-10-13T17:43:56.235431] [DEBUG] [LOCAL ] BOC: Primary data saved (18609 records). [2025-10-13T17:43:56.235579] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-13T17:43:56.235683] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOC took 25.8s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-13T17:43:56.400472] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:56.420160] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-13T17:43:56.438627] [DEBUG] [LOCAL ] BOOT: Loaded 40592 existing records from primary storage. [2025-10-13T17:43:56.438984] [INFO ] [MAIN ] BOOT: Loaded 40592 existing records. [2025-10-13T17:43:56.614619] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:56.614885] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-13T17:43:56.614929] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-13T17:43:56.615127] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-13T17:43:56.615164] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-13T17:43:56.982124] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:57.050804] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:43:57.217939] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-13T17:43:57.349804] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:43:58.017943] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-13T17:43:58.305311] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:43:58.817936] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-13T17:43:59.373838] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T17:43:59.617889] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-13T17:43:59.993664] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:44:00.417916] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-13T17:44:01.217952] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-13T17:44:01.311838] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:44:02.017930] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-13T17:44:02.063696] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:44:02.153816] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:44:02.156675] [INFO ] [REMOTE ] BOE: Full fetch complete (26724 records). [2025-10-13T17:44:02.156816] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-13T17:44:02.561007] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-13T17:44:02.561137] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-13T17:44:02.561750] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-13T17:44:02.561823] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-13T17:44:02.562751] [DEBUG] [LOCAL ] BOE: Trimmed 26724 records to 18261 (keeping 200 days of data) [2025-10-13T17:44:02.677149] [DEBUG] [LOCAL ] BOE: Primary data saved (18261 records). [2025-10-13T17:44:02.677372] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-13T17:44:02.677477] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 32.2s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-13T17:44:02.828313] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-13T17:44:02.869460] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:02.925339] [DEBUG] [LOCAL ] BORR: Loaded 51843 existing records from primary storage. [2025-10-13T17:44:02.925830] [INFO ] [MAIN ] BORR: Loaded 51843 existing records. [2025-10-13T17:44:03.118268] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:03.118523] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-13T17:44:03.118575] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-13T17:44:03.118838] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-13T17:44:03.118898] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-13T17:44:03.486893] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:03.538000] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:44:03.617895] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-13T17:44:04.187636] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:44:04.417953] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-13T17:44:05.079804] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:44:05.217958] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-13T17:44:05.472880] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:44:06.018005] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-13T17:44:06.817945] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-13T17:44:06.935039] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T17:44:07.485886] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:44:07.489670] [INFO ] [REMOTE ] BOND: Full fetch complete (46410 records). [2025-10-13T17:44:07.489762] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-13T17:44:07.623140] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-13T17:44:07.911166] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-13T17:44:07.911330] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-13T17:44:07.912101] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-13T17:44:07.912181] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-13T17:44:07.913778] [DEBUG] [LOCAL ] BOND: Trimmed 46410 records to 32321 (keeping 200 days of data) [2025-10-13T17:44:08.131129] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:44:08.161390] [DEBUG] [LOCAL ] BOND: Primary data saved (32321 records). [2025-10-13T17:44:08.161579] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-13T17:44:08.161716] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 37.7s. Estimated remaining: 4h 39m 29s. Rate: 7.3 symbols/min [2025-10-13T17:44:08.343410] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:08.369937] [DEBUG] [LOCAL ] BOW: Loaded 24153 existing records from primary storage. [2025-10-13T17:44:08.370317] [INFO ] [MAIN ] BOW: Loaded 24153 existing records. [2025-10-13T17:44:08.423174] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-13T17:44:08.599990] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:08.600334] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-13T17:44:08.600384] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-13T17:44:08.600820] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-13T17:44:08.600888] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-13T17:44:08.987774] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:09.217930] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-13T17:44:09.556776] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:44:10.017921] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-13T17:44:10.182581] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:44:10.294060] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T17:44:10.818005] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-13T17:44:11.625517] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-13T17:44:11.661438] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:44:12.273621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:44:12.417992] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-13T17:44:12.602373] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:44:13.217998] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-13T17:44:13.957125] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T17:44:14.017914] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-13T17:44:14.127810] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:44:14.817913] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-13T17:44:15.206169] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T17:44:15.617943] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-13T17:44:16.243071] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T17:44:16.418025] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-13T17:44:17.217947] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-13T17:44:17.449548] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:44:17.640071] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T17:44:17.643877] [INFO ] [REMOTE ] BOH: Full fetch complete (44896 records). [2025-10-13T17:44:17.644025] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-13T17:44:18.023190] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-13T17:44:18.067497] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-13T17:44:18.067739] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-13T17:44:18.073375] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-13T17:44:18.073687] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-13T17:44:18.075436] [DEBUG] [LOCAL ] BOH: Trimmed 44896 records to 30490 (keeping 200 days of data) [2025-10-13T17:44:18.275435] [DEBUG] [LOCAL ] BOH: Primary data saved (30490 records). [2025-10-13T17:44:18.275703] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-13T17:44:18.276786] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOH took 47.8s. Estimated remaining: 4h 39m 33s. Rate: 7.3 symbols/min [2025-10-13T17:44:18.461451] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:18.518624] [DEBUG] [LOCAL ] BOX: Loaded 50941 existing records from primary storage. [2025-10-13T17:44:18.519192] [INFO ] [MAIN ] BOX: Loaded 50941 existing records. [2025-10-13T17:44:18.724440] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:18.751496] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-13T17:44:18.751638] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-13T17:44:18.752211] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-13T17:44:18.752929] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-13T17:44:18.754954] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:44:18.825340] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-13T17:44:19.152064] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:19.617907] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-13T17:44:19.958394] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:44:20.182300] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:44:20.417988] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-13T17:44:21.173404] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:44:21.217890] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-13T17:44:22.017946] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-13T17:44:22.254293] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:44:22.457180] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:44:22.817927] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-13T17:44:23.617917] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-13T17:44:23.709555] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:44:24.417912] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-13T17:44:24.578053] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:44:24.832100] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T17:44:24.836792] [INFO ] [REMOTE ] BOOT: Full fetch complete (59979 records). [2025-10-13T17:44:24.836960] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-13T17:44:25.226560] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-13T17:44:25.251030] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-13T17:44:25.251179] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-13T17:44:25.252062] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-13T17:44:25.252127] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-13T17:44:25.253937] [DEBUG] [LOCAL ] BOOT: Trimmed 59979 records to 39875 (keeping 200 days of data) [2025-10-13T17:44:25.513090] [DEBUG] [LOCAL ] BOOT: Primary data saved (39875 records). [2025-10-13T17:44:25.513298] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-13T17:44:25.513434] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOOT took 29.3s. Estimated remaining: 4h 39m 19s. Rate: 7.3 symbols/min [2025-10-13T17:44:25.705717] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:25.707504] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:44:25.764989] [DEBUG] [LOCAL ] BP: Loaded 54489 existing records from primary storage. [2025-10-13T17:44:25.765326] [INFO ] [MAIN ] BP: Loaded 54489 existing records. [2025-10-13T17:44:25.946216] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:25.946483] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-13T17:44:25.946541] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-13T17:44:25.947134] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-13T17:44:25.947191] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-13T17:44:26.026326] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-13T17:44:26.333215] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:26.817905] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-13T17:44:27.066594] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T17:44:27.618018] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-13T17:44:27.693813] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:44:28.418010] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-13T17:44:28.891572] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:44:29.217897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-13T17:44:29.261251] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:44:29.980198] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:44:30.017984] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-13T17:44:30.817957] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-13T17:44:31.188730] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T17:44:31.617906] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-13T17:44:31.769884] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:44:31.915765] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:44:32.417949] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-13T17:44:33.217894] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-13T17:44:33.675936] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T17:44:33.987590] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:44:34.017897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-13T17:44:34.032587] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:44:34.817922] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-13T17:44:35.617994] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-13T17:44:36.150412] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T17:44:36.417916] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-13T17:44:36.456142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T17:44:37.144079] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T17:44:37.150930] [INFO ] [REMOTE ] BORR: Full fetch complete (74534 records). [2025-10-13T17:44:37.151152] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-13T17:44:37.218694] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-13T17:44:37.560937] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-13T17:44:37.561046] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-13T17:44:37.561977] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-13T17:44:37.562052] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-13T17:44:37.581946] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:44:37.588136] [DEBUG] [LOCAL ] BORR: Trimmed 74534 records to 51152 (keeping 200 days of data) [2025-10-13T17:44:37.874501] [DEBUG] [LOCAL ] BORR: Primary data saved (51152 records). [2025-10-13T17:44:37.874674] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-13T17:44:37.874776] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 35.2s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-13T17:44:38.023567] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-13T17:44:38.043183] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:38.078740] [DEBUG] [LOCAL ] BR: Loaded 35349 existing records from primary storage. [2025-10-13T17:44:38.079037] [INFO ] [MAIN ] BR: Loaded 35349 existing records. [2025-10-13T17:44:38.259902] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:38.260160] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-13T17:44:38.260217] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-13T17:44:38.260457] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-13T17:44:38.260514] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-13T17:44:38.609507] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:38.817924] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-13T17:44:38.959327] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:44:39.036571] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:44:39.617929] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-13T17:44:39.941380] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:44:40.417930] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-13T17:44:41.101422] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T17:44:41.217901] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-13T17:44:41.600446] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:44:41.604337] [INFO ] [REMOTE ] BOW: Full fetch complete (32054 records). [2025-10-13T17:44:41.604423] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-13T17:44:41.984798] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-13T17:44:41.984883] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-13T17:44:41.985356] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-13T17:44:41.985394] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-13T17:44:41.986164] [DEBUG] [LOCAL ] BOW: Trimmed 32054 records to 23502 (keeping 200 days of data) [2025-10-13T17:44:42.035920] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-13T17:44:42.131094] [DEBUG] [LOCAL ] BOW: Primary data saved (23502 records). [2025-10-13T17:44:42.131259] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-13T17:44:42.131357] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOW took 34.0s. Estimated remaining: 4h 39m 4s. Rate: 7.3 symbols/min [2025-10-13T17:44:42.299661] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:42.351372] [DEBUG] [LOCAL ] BRBR: Loaded 52223 existing records from primary storage. [2025-10-13T17:44:42.351714] [INFO ] [MAIN ] BRBR: Loaded 52223 existing records. [2025-10-13T17:44:42.534018] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:42.534306] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-13T17:44:42.534372] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-13T17:44:42.534989] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-13T17:44:42.535049] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-13T17:44:42.818223] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-13T17:44:42.932900] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:42.970090] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:44:43.617938] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-13T17:44:44.345553] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:44:44.417914] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-13T17:44:44.482883] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T17:44:44.921748] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:44:45.217923] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-13T17:44:45.402621] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:44:46.017940] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-13T17:44:46.817939] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-13T17:44:46.925059] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:44:47.341862] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:44:47.617985] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-13T17:44:48.417941] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-13T17:44:49.006753] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T17:44:49.044736] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T17:44:49.217940] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-13T17:44:50.018167] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-13T17:44:50.122818] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:44:50.128428] [INFO ] [REMOTE ] BOX: Full fetch complete (72081 records). [2025-10-13T17:44:50.128632] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-13T17:44:50.660992] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-13T17:44:50.661181] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-13T17:44:50.662519] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-13T17:44:50.662736] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-13T17:44:50.664610] [DEBUG] [LOCAL ] BOX: Trimmed 72081 records to 50236 (keeping 200 days of data) [2025-10-13T17:44:50.842888] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-13T17:44:50.954244] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T17:44:51.053983] [DEBUG] [LOCAL ] BOX: Primary data saved (50236 records). [2025-10-13T17:44:51.054173] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-13T17:44:51.054974] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BOX took 32.8s. Estimated remaining: 4h 38m 60s. Rate: 7.3 symbols/min [2025-10-13T17:44:51.230054] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:51.251090] [DEBUG] [LOCAL ] BRC: Loaded 19046 existing records from primary storage. [2025-10-13T17:44:51.251370] [INFO ] [MAIN ] BRC: Loaded 19046 existing records. [2025-10-13T17:44:51.439004] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:51.439278] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-13T17:44:51.439326] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-13T17:44:51.439537] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-13T17:44:51.439594] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-13T17:44:51.619824] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-13T17:44:51.811210] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:52.063527] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T17:44:52.417953] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-13T17:44:52.494159] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T17:44:53.223397] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-13T17:44:53.242956] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T17:44:54.017930] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-13T17:44:54.542052] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:44:54.802986] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-13T17:44:54.817872] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-13T17:44:54.854144] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T17:44:55.617937] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-13T17:44:56.417913] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-13T17:44:56.495638] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T17:44:56.607809] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:44:57.217927] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-13T17:44:57.807408] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:44:58.017932] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-13T17:44:58.616819] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:44:58.818034] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-13T17:44:59.617922] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-13T17:44:59.845366] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:45:00.268535] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-13T17:45:00.418007] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-13T17:45:01.231135] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-13T17:45:01.234136] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:45:01.891022] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T17:45:02.017933] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-13T17:45:02.818035] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-13T17:45:03.472811] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-13T17:45:03.477816] [INFO ] [REMOTE ] BP: Full fetch complete (77371 records). [2025-10-13T17:45:03.477931] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-13T17:45:03.478735] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:45:03.478823] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:45:03.478865] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:45:03.478902] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-13T17:45:03.478960] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-13T17:45:03.479002] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-10-13T17:45:03.479165] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-10-13T17:45:03.479253] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BP took 38.0s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-13T17:45:03.619706] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-13T17:45:03.657331] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:03.698239] [DEBUG] [LOCAL ] BRCC: Loaded 40648 existing records from primary storage. [2025-10-13T17:45:03.698726] [INFO ] [MAIN ] BRCC: Loaded 40648 existing records. [2025-10-13T17:45:03.802614] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:45:03.917762] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:03.918084] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-13T17:45:03.918182] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-13T17:45:03.918705] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-13T17:45:03.918761] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-13T17:45:04.243622] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T17:45:04.323093] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:04.417921] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-13T17:45:05.131414] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:45:05.217880] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-13T17:45:05.607388] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:45:06.017915] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-13T17:45:06.439977] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:45:06.817958] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-13T17:45:07.535911] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:45:07.540290] [INFO ] [REMOTE ] BR: Full fetch complete (49627 records). [2025-10-13T17:45:07.540403] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-13T17:45:07.623342] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-13T17:45:07.921750] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-13T17:45:07.921852] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-13T17:45:07.922475] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-13T17:45:07.922570] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-13T17:45:07.923881] [DEBUG] [LOCAL ] BR: Trimmed 49627 records to 34832 (keeping 200 days of data) [2025-10-13T17:45:08.145516] [DEBUG] [LOCAL ] BR: Primary data saved (34832 records). [2025-10-13T17:45:08.145684] [INFO ] [MAIN ] BR: Full history saved. [2025-10-13T17:45:08.145780] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BR took 30.3s. Estimated remaining: 4h 38m 48s. Rate: 7.3 symbols/min [2025-10-13T17:45:08.317425] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:08.368470] [DEBUG] [LOCAL ] BRO: Loaded 52722 existing records from primary storage. [2025-10-13T17:45:08.368887] [INFO ] [MAIN ] BRO: Loaded 52722 existing records. [2025-10-13T17:45:08.424395] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-13T17:45:08.550497] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:08.550849] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-13T17:45:08.550897] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-13T17:45:08.551240] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-13T17:45:08.551296] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-13T17:45:08.910282] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T17:45:08.930824] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T17:45:08.952154] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:09.217917] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-13T17:45:10.002235] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:45:10.017884] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-13T17:45:10.817961] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-13T17:45:11.052606] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:45:11.617907] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-13T17:45:11.793358] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:45:11.846552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:45:12.417946] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-13T17:45:12.873822] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T17:45:13.217924] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-13T17:45:14.017934] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-13T17:45:14.168870] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:45:14.546536] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T17:45:14.817924] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-13T17:45:15.617937] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-13T17:45:15.755100] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:45:16.418030] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-13T17:45:16.561002] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:45:17.216176] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:45:17.224330] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-13T17:45:18.017896] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-13T17:45:18.053363] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:45:18.818026] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-13T17:45:18.961877] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T17:45:18.967119] [INFO ] [REMOTE ] BRBR: Full fetch complete (72456 records). [2025-10-13T17:45:18.967234] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-13T17:45:19.350834] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-13T17:45:19.350971] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-13T17:45:19.351920] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-13T17:45:19.351985] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-13T17:45:19.353320] [DEBUG] [LOCAL ] BRBR: Trimmed 72456 records to 51571 (keeping 200 days of data) [2025-10-13T17:45:19.605440] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:45:19.618185] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-13T17:45:19.686956] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T17:45:19.709194] [DEBUG] [LOCAL ] BRBR: Primary data saved (51571 records). [2025-10-13T17:45:19.709302] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-13T17:45:19.709376] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 37.6s. Estimated remaining: 4h 39m 0s. Rate: 7.3 symbols/min [2025-10-13T17:45:19.875805] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:19.924770] [DEBUG] [LOCAL ] BROS: Loaded 54079 existing records from primary storage. [2025-10-13T17:45:19.925116] [INFO ] [MAIN ] BROS: Loaded 54079 existing records. [2025-10-13T17:45:20.098362] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:20.098570] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-13T17:45:20.098619] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-13T17:45:20.099075] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-13T17:45:20.099125] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-13T17:45:20.423037] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-13T17:45:20.451829] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:21.217892] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-13T17:45:21.640730] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T17:45:22.017903] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-13T17:45:22.184601] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:45:22.817999] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-13T17:45:23.147807] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:45:23.194277] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:45:23.618001] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-13T17:45:24.417899] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-13T17:45:24.529272] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:45:25.175086] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:45:25.217924] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-13T17:45:25.925921] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:45:26.017944] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-13T17:45:26.817922] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-13T17:45:27.164074] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T17:45:27.416596] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:45:27.617933] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-13T17:45:28.417910] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-13T17:45:28.662839] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:45:29.217934] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-13T17:45:29.306876] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:45:30.018009] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-13T17:45:30.381228] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:45:30.425839] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T17:45:30.817910] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-13T17:45:31.579201] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:45:31.617906] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-13T17:45:31.946363] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:45:31.948957] [INFO ] [REMOTE ] BRC: Full fetch complete (28457 records). [2025-10-13T17:45:31.949042] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-13T17:45:32.375760] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-13T17:45:32.375906] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-13T17:45:32.376432] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-13T17:45:32.376495] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-13T17:45:32.377462] [DEBUG] [LOCAL ] BRC: Trimmed 28457 records to 18661 (keeping 200 days of data) [2025-10-13T17:45:32.428423] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-13T17:45:32.494529] [DEBUG] [LOCAL ] BRC: Primary data saved (18661 records). [2025-10-13T17:45:32.494702] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-13T17:45:32.494796] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRC took 41.4s. Estimated remaining: 4h 39m 20s. Rate: 7.3 symbols/min [2025-10-13T17:45:32.675311] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:32.675502] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-13T17:45:32.675539] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-13T17:45:32.675690] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-13T17:45:32.675746] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-13T17:45:32.675790] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-13T17:45:32.675824] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-13T17:45:33.031084] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:33.061498] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:45:33.065417] [INFO ] [REMOTE ] BRCC: Full fetch complete (57366 records). [2025-10-13T17:45:33.065529] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-13T17:45:33.223046] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-13T17:45:33.480091] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-13T17:45:33.480226] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-13T17:45:33.481111] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-13T17:45:33.481178] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-13T17:45:33.482673] [DEBUG] [LOCAL ] BRCC: Trimmed 57366 records to 40184 (keeping 200 days of data) [2025-10-13T17:45:33.536324] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:45:33.562979] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-13T17:45:33.563996] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:45:33.565217] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-13T17:45:33.566910] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:45:33.570185] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-13T17:45:33.570846] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-13T17:45:33.571733] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-13T17:45:33.572420] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-13T17:45:33.572512] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 38m 28s. Rate: 7.3 symbols/min [2025-10-13T17:45:33.768710] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:33.896101] [DEBUG] [LOCAL ] BRCC: Primary data saved (40184 records). [2025-10-13T17:45:33.896241] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-13T17:45:33.896320] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRCC took 30.4s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-13T17:45:33.977673] [DEBUG] [LOCAL ] BRSP: Loaded 37280 existing records from primary storage. [2025-10-13T17:45:33.999162] [INFO ] [MAIN ] BRSP: Loaded 37280 existing records. [2025-10-13T17:45:34.021593] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-13T17:45:34.166968] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:34.190210] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-13T17:45:34.190424] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-13T17:45:34.190725] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-13T17:45:34.201763] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-13T17:45:34.250678] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-13T17:45:34.267888] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-13T17:45:34.273611] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:34.306268] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-13T17:45:34.306423] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-13T17:45:34.319356] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-13T17:45:34.345414] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-13T17:45:34.968966] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-13T17:45:34.965808] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:35.020271] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-13T17:45:35.065358] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:35.617899] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-13T17:45:35.834588] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:45:35.951584] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:45:36.417939] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-13T17:45:36.947712] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T17:45:37.092978] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:45:37.217944] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-13T17:45:37.695049] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T17:45:38.017927] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-13T17:45:38.817934] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-13T17:45:39.439153] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:45:39.617959] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-13T17:45:40.417919] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-13T17:45:40.495437] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:45:41.012004] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T17:45:41.036023] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:45:41.217944] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-13T17:45:42.017941] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-13T17:45:42.818051] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-13T17:45:43.038815] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:45:43.434697] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:45:43.617957] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-13T17:45:44.417911] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-13T17:45:44.601923] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:45:44.966253] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:45:45.217997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-13T17:45:46.018023] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-13T17:45:46.066689] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:45:46.308003] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:45:46.817924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-13T17:45:47.403006] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T17:45:47.617895] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-13T17:45:47.867468] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:45:48.417922] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-13T17:45:49.093945] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:45:49.217916] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-13T17:45:49.729396] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T17:45:49.850720] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:45:49.856048] [INFO ] [REMOTE ] BRO: Full fetch complete (74491 records). [2025-10-13T17:45:49.856177] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-13T17:45:50.035421] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-13T17:45:50.251187] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-13T17:45:50.251268] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-13T17:45:50.252128] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-13T17:45:50.252190] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-13T17:45:50.253706] [DEBUG] [LOCAL ] BRO: Trimmed 74491 records to 52044 (keeping 200 days of data) [2025-10-13T17:45:50.571231] [DEBUG] [LOCAL ] BRO: Primary data saved (52044 records). [2025-10-13T17:45:50.571369] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-13T17:45:50.571447] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRO took 42.4s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-13T17:45:50.743663] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:50.763033] [DEBUG] [LOCAL ] BRW: Loaded 21087 existing records from primary storage. [2025-10-13T17:45:50.763285] [INFO ] [MAIN ] BRW: Loaded 21087 existing records. [2025-10-13T17:45:50.823164] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-13T17:45:50.952451] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:50.952688] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-13T17:45:50.952745] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-13T17:45:50.953023] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-13T17:45:50.953066] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-13T17:45:51.315474] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:51.427452] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:45:51.437080] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T17:45:51.617905] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-13T17:45:52.225635] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T17:45:52.417922] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-13T17:45:53.043406] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T17:45:53.218002] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-13T17:45:54.017931] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-13T17:45:54.663237] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T17:45:54.664457] [INFO ] [REMOTE ] BRT: Full fetch complete (6822 records). [2025-10-13T17:45:54.664526] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-13T17:45:54.664984] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:45:54.665066] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:45:54.665109] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:45:54.665146] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-13T17:45:54.665199] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-13T17:45:54.665233] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-13T17:45:54.665275] [DEBUG] [LOCAL ] BRT: No derivative data file found to delete. [2025-10-13T17:45:54.665329] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 20.8s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-13T17:45:54.822284] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-13T17:45:54.861113] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:54.863071] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:45:54.921848] [DEBUG] [LOCAL ] BRX: Loaded 52530 existing records from primary storage. [2025-10-13T17:45:54.922198] [INFO ] [MAIN ] BRX: Loaded 52530 existing records. [2025-10-13T17:45:55.093520] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:55.093794] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-13T17:45:55.093843] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-13T17:45:55.094202] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-13T17:45:55.094241] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-13T17:45:55.492975] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:55.617942] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-13T17:45:55.917262] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:45:56.417930] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-13T17:45:56.992134] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:45:57.217919] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-13T17:45:57.808497] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:45:58.017888] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-13T17:45:58.334949] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:45:58.818017] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-13T17:45:59.617894] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-13T17:46:00.125184] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T17:46:00.353918] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:46:00.377476] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:46:00.417878] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-13T17:46:01.217933] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-13T17:46:01.439350] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T17:46:02.017994] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-13T17:46:02.473163] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:46:02.477431] [INFO ] [REMOTE ] BRSP: Full fetch complete (54256 records). [2025-10-13T17:46:02.477623] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-13T17:46:02.820990] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-13T17:46:02.858594] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-13T17:46:02.858712] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-13T17:46:02.859506] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-13T17:46:02.859549] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-13T17:46:02.860835] [DEBUG] [LOCAL ] BRSP: Trimmed 54256 records to 36738 (keeping 200 days of data) [2025-10-13T17:46:03.074831] [DEBUG] [LOCAL ] BRSP: Primary data saved (36738 records). [2025-10-13T17:46:03.074983] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-13T17:46:03.075625] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRSP took 29.5s. Estimated remaining: 4h 37m 36s. Rate: 7.3 symbols/min [2025-10-13T17:46:03.241153] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:03.276930] [DEBUG] [LOCAL ] BSAC: Loaded 33396 existing records from primary storage. [2025-10-13T17:46:03.277228] [INFO ] [MAIN ] BSAC: Loaded 33396 existing records. [2025-10-13T17:46:03.461257] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:03.461409] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-13T17:46:03.461457] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-13T17:46:03.461706] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-13T17:46:03.461763] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-13T17:46:03.619334] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-13T17:46:03.845996] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:04.243983] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T17:46:04.417934] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-13T17:46:04.743906] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T17:46:04.781901] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T17:46:05.217996] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-13T17:46:06.017959] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-13T17:46:06.517121] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T17:46:06.817901] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-13T17:46:06.934625] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T17:46:06.997318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:46:07.617988] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-13T17:46:08.418031] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-13T17:46:09.147000] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-13T17:46:09.153592] [INFO ] [REMOTE ] BROS: Full fetch complete (77085 records). [2025-10-13T17:46:09.153836] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-13T17:46:09.238223] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-13T17:46:09.496555] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:46:09.554526] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:46:09.619048] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-13T17:46:09.620258] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-13T17:46:09.621253] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-13T17:46:09.621340] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-13T17:46:09.623001] [DEBUG] [LOCAL ] BROS: Trimmed 77085 records to 53300 (keeping 200 days of data) [2025-10-13T17:46:09.929715] [DEBUG] [LOCAL ] BROS: Primary data saved (53300 records). [2025-10-13T17:46:09.929861] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-13T17:46:09.929945] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BROS took 50.2s. Estimated remaining: 4h 37m 20s. Rate: 7.3 symbols/min [2025-10-13T17:46:10.026508] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-13T17:46:10.099095] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:10.132078] [DEBUG] [LOCAL ] BSBR: Loaded 35864 existing records from primary storage. [2025-10-13T17:46:10.132374] [INFO ] [MAIN ] BSBR: Loaded 35864 existing records. [2025-10-13T17:46:10.314177] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:10.325835] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-13T17:46:10.326398] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-13T17:46:10.326845] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:46:10.328476] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-13T17:46:10.331597] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-13T17:46:10.684761] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:10.817929] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-13T17:46:11.617902] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-13T17:46:11.744717] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T17:46:12.189323] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:46:12.417932] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-13T17:46:12.734246] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T17:46:13.217921] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-13T17:46:13.875136] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:46:14.017935] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-13T17:46:14.799102] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T17:46:14.817879] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-13T17:46:15.101022] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:46:15.617904] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-13T17:46:16.417921] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-13T17:46:16.615682] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T17:46:16.973716] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:46:17.217917] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-13T17:46:17.636430] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:46:18.018009] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-13T17:46:18.499502] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:46:18.818126] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-13T17:46:19.554595] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:46:19.617912] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-13T17:46:20.187052] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:46:20.417919] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-13T17:46:21.217995] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-13T17:46:21.379862] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T17:46:21.448573] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:46:22.017946] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-13T17:46:22.323325] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:46:22.818116] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-13T17:46:23.618004] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-13T17:46:23.692124] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T17:46:24.331329] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:46:24.417936] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-13T17:46:24.851810] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:46:25.218017] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-13T17:46:25.919943] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T17:46:26.017884] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-13T17:46:26.539964] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:46:26.543390] [INFO ] [REMOTE ] BRW: Full fetch complete (30495 records). [2025-10-13T17:46:26.543563] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-13T17:46:26.823958] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-13T17:46:26.954619] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-13T17:46:26.954738] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-13T17:46:26.955524] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-13T17:46:26.955590] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-13T17:46:26.959254] [DEBUG] [LOCAL ] BRW: Trimmed 30495 records to 20943 (keeping 200 days of data) [2025-10-13T17:46:27.095691] [DEBUG] [LOCAL ] BRW: Primary data saved (20943 records). [2025-10-13T17:46:27.095845] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-13T17:46:27.095970] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRW took 36.5s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-13T17:46:27.297088] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:27.308259] [DEBUG] [LOCAL ] BSL: Loaded 8430 existing records from primary storage. [2025-10-13T17:46:27.308514] [INFO ] [MAIN ] BSL: Loaded 8430 existing records. [2025-10-13T17:46:27.543715] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:27.543957] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-13T17:46:27.544029] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-13T17:46:27.547287] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-13T17:46:27.547214] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T17:46:27.547415] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-13T17:46:27.624686] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-13T17:46:27.935805] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:28.418008] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-13T17:46:28.495475] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T17:46:28.504964] [INFO ] [REMOTE ] BRX: Full fetch complete (74928 records). [2025-10-13T17:46:28.505127] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-13T17:46:28.897248] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-13T17:46:28.897348] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-13T17:46:28.898311] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-13T17:46:28.898382] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-13T17:46:28.900069] [DEBUG] [LOCAL ] BRX: Trimmed 74928 records to 51788 (keeping 200 days of data) [2025-10-13T17:46:29.221893] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-13T17:46:29.249267] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:46:29.253892] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:46:29.268215] [DEBUG] [LOCAL ] BRX: Primary data saved (51788 records). [2025-10-13T17:46:29.268310] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-13T17:46:29.268399] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 34.6s. Estimated remaining: 4h 37m 21s. Rate: 7.3 symbols/min [2025-10-13T17:46:29.433719] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:29.467364] [DEBUG] [LOCAL ] BSM: Loaded 32627 existing records from primary storage. [2025-10-13T17:46:29.467635] [INFO ] [MAIN ] BSM: Loaded 32627 existing records. [2025-10-13T17:46:29.643026] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:29.643255] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-13T17:46:29.643300] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-13T17:46:29.643565] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-13T17:46:29.643619] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-13T17:46:29.983968] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:30.017877] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-13T17:46:30.694914] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T17:46:30.817908] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-13T17:46:31.119732] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:46:31.617925] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-13T17:46:32.240316] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T17:46:32.417930] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-13T17:46:32.954707] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:46:33.217927] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-13T17:46:33.390738] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T17:46:33.394483] [INFO ] [REMOTE ] BSBR: Full fetch complete (50660 records). [2025-10-13T17:46:33.394606] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-13T17:46:33.771364] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-13T17:46:33.771444] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-13T17:46:33.772161] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-13T17:46:33.772224] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-13T17:46:33.773210] [DEBUG] [LOCAL ] BSBR: Trimmed 50660 records to 35612 (keeping 200 days of data) [2025-10-13T17:46:33.977335] [DEBUG] [LOCAL ] BSBR: Primary data saved (35612 records). [2025-10-13T17:46:33.977481] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-13T17:46:33.977578] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 24.0s. Estimated remaining: 4h 36m 52s. Rate: 7.3 symbols/min [2025-10-13T17:46:34.023140] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-13T17:46:34.147734] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:34.167486] [DEBUG] [LOCAL ] BST: Loaded 19239 existing records from primary storage. [2025-10-13T17:46:34.167750] [INFO ] [MAIN ] BST: Loaded 19239 existing records. [2025-10-13T17:46:34.344910] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:34.345112] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-13T17:46:34.345158] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-13T17:46:34.345446] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-13T17:46:34.345502] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-13T17:46:34.715823] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:46:34.744121] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:34.766322] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:46:34.817883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-13T17:46:35.618033] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-13T17:46:36.197000] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:46:36.417996] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-13T17:46:36.439573] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:46:37.217998] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-13T17:46:37.621081] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:46:38.017916] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-13T17:46:38.416615] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:46:38.817939] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-13T17:46:39.228529] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:46:39.617891] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-13T17:46:39.674979] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T17:46:40.417933] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-13T17:46:40.979702] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:46:41.189164] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:46:41.217887] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-13T17:46:41.970999] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T17:46:42.017888] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-13T17:46:42.712350] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:46:42.817922] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-13T17:46:43.617956] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-13T17:46:43.920301] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:46:44.418008] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-13T17:46:44.799846] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:46:44.803501] [INFO ] [REMOTE ] BSAC: Full fetch complete (44420 records). [2025-10-13T17:46:44.803624] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-13T17:46:45.179441] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-13T17:46:45.179524] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-13T17:46:45.180151] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-13T17:46:45.180271] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-13T17:46:45.181286] [DEBUG] [LOCAL ] BSAC: Trimmed 44420 records to 32825 (keeping 200 days of data) [2025-10-13T17:46:45.233149] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-13T17:46:45.381029] [DEBUG] [LOCAL ] BSAC: Primary data saved (32825 records). [2025-10-13T17:46:45.381184] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-13T17:46:45.382095] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSAC took 42.3s. Estimated remaining: 4h 37m 3s. Rate: 7.3 symbols/min [2025-10-13T17:46:45.556760] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:45.570030] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:46:45.597947] [DEBUG] [LOCAL ] BSTZ: Loaded 25316 existing records from primary storage. [2025-10-13T17:46:45.598252] [INFO ] [MAIN ] BSTZ: Loaded 25316 existing records. [2025-10-13T17:46:45.775852] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:45.776084] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-13T17:46:45.776129] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-13T17:46:45.776399] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-13T17:46:45.776457] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-13T17:46:46.024935] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-13T17:46:46.131369] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:46.688303] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:46:46.811467] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T17:46:46.817870] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-13T17:46:47.516009] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:46:47.617892] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-13T17:46:48.223142] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T17:46:48.417934] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-13T17:46:49.217939] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-13T17:46:49.634342] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:46:50.018094] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-13T17:46:50.124734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:46:50.127101] [INFO ] [REMOTE ] BSL: Full fetch complete (12803 records). [2025-10-13T17:46:50.127196] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-13T17:46:50.493049] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-13T17:46:50.493126] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-13T17:46:50.493417] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-13T17:46:50.493453] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-13T17:46:50.493934] [DEBUG] [LOCAL ] BSL: Trimmed 12803 records to 8260 (keeping 200 days of data) [2025-10-13T17:46:50.545234] [DEBUG] [LOCAL ] BSL: Primary data saved (8260 records). [2025-10-13T17:46:50.545344] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-13T17:46:50.545416] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSL took 23.4s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-13T17:46:50.711021] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:50.769208] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-13T17:46:50.769520] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-10-13T17:46:50.823056] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-13T17:46:50.948225] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:50.948411] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-13T17:46:50.948455] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-13T17:46:50.948763] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-13T17:46:50.948818] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-13T17:46:51.307159] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:51.341782] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:46:51.617920] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-13T17:46:51.992384] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T17:46:52.417940] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-13T17:46:53.217896] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-13T17:46:53.540292] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T17:46:53.735187] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T17:46:54.017903] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-13T17:46:54.241229] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:46:54.817896] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-13T17:46:55.617916] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-13T17:46:55.818223] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T17:46:55.884276] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T17:46:56.417921] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-13T17:46:56.886702] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T17:46:57.217902] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-13T17:46:57.594898] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:46:58.017992] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-13T17:46:58.470990] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:46:58.817909] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-13T17:46:59.091668] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:46:59.618016] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-13T17:47:00.001881] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:47:00.417935] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-13T17:47:01.217912] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-13T17:47:01.268540] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T17:47:01.358085] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T17:47:02.017927] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-13T17:47:02.677244] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:47:02.817927] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-13T17:47:03.617893] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-13T17:47:04.045755] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T17:47:04.068144] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:47:04.417930] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-13T17:47:05.022823] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:47:05.217984] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-13T17:47:05.474850] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:47:06.018009] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-13T17:47:06.283083] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:47:06.817908] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-13T17:47:07.617941] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-13T17:47:07.993150] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:47:08.123982] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:47:08.417994] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-13T17:47:08.654386] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:47:08.657334] [INFO ] [REMOTE ] BST: Full fetch complete (28525 records). [2025-10-13T17:47:08.657452] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-13T17:47:09.172699] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-13T17:47:09.172835] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-13T17:47:09.173420] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-13T17:47:09.173468] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-13T17:47:09.174831] [DEBUG] [LOCAL ] BST: Trimmed 28525 records to 18945 (keeping 200 days of data) [2025-10-13T17:47:09.229775] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-13T17:47:09.304561] [DEBUG] [LOCAL ] BST: Primary data saved (18945 records). [2025-10-13T17:47:09.304750] [INFO ] [MAIN ] BST: Full history saved. [2025-10-13T17:47:09.304850] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 35.3s. Estimated remaining: 4h 37m 31s. Rate: 7.3 symbols/min [2025-10-13T17:47:09.481495] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:09.488288] [DEBUG] [LOCAL ] BTA: Loaded 5614 existing records from primary storage. [2025-10-13T17:47:09.488481] [INFO ] [MAIN ] BTA: Loaded 5614 existing records. [2025-10-13T17:47:09.673431] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:09.682162] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-13T17:47:09.682624] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:47:09.682245] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-13T17:47:09.686577] [INFO ] [REMOTE ] BSM: Full fetch complete (46957 records). [2025-10-13T17:47:09.686623] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-13T17:47:09.686826] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-13T17:47:09.686881] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-13T17:47:10.021858] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-13T17:47:10.456770] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:10.472748] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-13T17:47:10.472837] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-13T17:47:10.473532] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-13T17:47:10.473574] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-13T17:47:10.474553] [DEBUG] [LOCAL ] BSM: Trimmed 46957 records to 32287 (keeping 200 days of data) [2025-10-13T17:47:10.675425] [DEBUG] [LOCAL ] BSM: Primary data saved (32287 records). [2025-10-13T17:47:10.675574] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-13T17:47:10.675680] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSM took 41.4s. Estimated remaining: 4h 36m 43s. Rate: 7.3 symbols/min [2025-10-13T17:47:10.821395] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-13T17:47:10.846754] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:10.865361] [DEBUG] [LOCAL ] BTCM: Loaded 16477 existing records from primary storage. [2025-10-13T17:47:10.865692] [INFO ] [MAIN ] BTCM: Loaded 16477 existing records. [2025-10-13T17:47:11.049439] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:11.050152] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-13T17:47:11.050261] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-13T17:47:11.050753] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-13T17:47:11.050902] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-13T17:47:11.375416] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T17:47:11.487917] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:11.503551] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:47:11.569599] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:47:11.617953] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-13T17:47:12.336860] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:47:12.417935] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-13T17:47:13.218025] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-13T17:47:14.017939] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-13T17:47:14.346328] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:47:14.403047] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:47:14.817917] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-13T17:47:15.082626] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:47:15.617992] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-13T17:47:15.645993] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:47:16.417923] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-13T17:47:17.208508] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:47:17.217872] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-13T17:47:17.511485] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T17:47:17.789029] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:47:18.018026] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-13T17:47:18.817998] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-13T17:47:19.218585] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:47:19.339996] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:47:19.617936] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-13T17:47:20.417955] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-13T17:47:20.935207] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:47:21.218043] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-13T17:47:21.218358] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:47:22.017925] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-13T17:47:22.332854] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:47:22.817985] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-13T17:47:23.617898] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-13T17:47:23.767350] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:47:24.001266] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:47:24.174995] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T17:47:24.417933] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-13T17:47:25.217986] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-13T17:47:25.861197] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T17:47:26.017913] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-13T17:47:26.421384] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-13T17:47:26.817923] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-13T17:47:27.157561] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:47:27.161205] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36754 records). [2025-10-13T17:47:27.161362] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-13T17:47:27.548347] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-13T17:47:27.548465] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-13T17:47:27.549137] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-13T17:47:27.549202] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-13T17:47:27.550224] [DEBUG] [LOCAL ] BSTZ: Trimmed 36754 records to 25020 (keeping 200 days of data) [2025-10-13T17:47:27.643837] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-13T17:47:27.721307] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25020 records). [2025-10-13T17:47:27.721527] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-13T17:47:27.721637] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSTZ took 42.3s. Estimated remaining: 4h 37m 26s. Rate: 7.3 symbols/min [2025-10-13T17:47:27.890998] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:47:27.927852] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:27.930309] [INFO ] [REMOTE ] BSX: Full fetch complete (77700 records). [2025-10-13T17:47:27.930509] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-13T17:47:28.261107] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T17:47:28.321557] [DEBUG] [LOCAL ] BTE: Loaded 53492 existing records from primary storage. [2025-10-13T17:47:28.343691] [INFO ] [MAIN ] BTE: Loaded 53492 existing records. [2025-10-13T17:47:28.428313] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-13T17:47:28.625988] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-13T17:47:28.631287] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-13T17:47:28.648688] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-13T17:47:28.684151] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-13T17:47:28.728189] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:28.728510] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-13T17:47:28.728582] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-13T17:47:28.729261] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-13T17:47:28.729323] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-13T17:47:28.764084] [DEBUG] [LOCAL ] BSX: Trimmed 77700 records to 53688 (keeping 200 days of data) [2025-10-13T17:47:29.223322] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-13T17:47:29.336500] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:29.581782] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-13T17:47:29.581963] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-13T17:47:29.582064] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 39.0s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-13T17:47:29.769669] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:29.769905] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-13T17:47:29.769944] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-13T17:47:29.770080] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-13T17:47:29.770176] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-13T17:47:29.770234] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-13T17:47:29.770274] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-13T17:47:30.027315] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-13T17:47:30.033891] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:47:30.206514] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:30.236188] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:47:30.817977] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-13T17:47:31.431561] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T17:47:31.617899] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-13T17:47:31.890670] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:47:32.198042] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T17:47:32.417974] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-13T17:47:33.217936] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-13T17:47:34.017940] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-13T17:47:34.089125] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:47:34.541169] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:47:34.817993] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-13T17:47:35.617932] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-13T17:47:36.052316] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:47:36.133186] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:47:36.417977] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-13T17:47:36.940479] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T17:47:37.192350] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T17:47:37.217929] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-13T17:47:38.018016] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-13T17:47:38.573005] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:47:38.575492] [INFO ] [REMOTE ] BTCM: Full fetch complete (19679 records). [2025-10-13T17:47:38.575559] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-13T17:47:38.576013] [FATAL] [VALIDATOR ] BTCM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:47:38.576093] [FATAL] [MAIN ] BTCM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:47:38.576134] [WARN ] [MAIN ] BTCM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:47:38.576214] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-13T17:47:38.576291] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-13T17:47:38.576327] [INFO ] [LOCAL ] BTCM: Starting deletion of derivative data. [2025-10-13T17:47:38.576502] [DEBUG] [LOCAL ] BTCM: Deleted derivative data file. [2025-10-13T17:47:38.576586] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 27.9s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-13T17:47:38.745128] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:38.754611] [DEBUG] [LOCAL ] BTO: Loaded 8861 existing records from primary storage. [2025-10-13T17:47:38.755046] [INFO ] [MAIN ] BTO: Loaded 8861 existing records. [2025-10-13T17:47:38.827741] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-13T17:47:38.930880] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:38.931138] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-13T17:47:38.931185] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-13T17:47:38.931380] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-13T17:47:38.931435] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-13T17:47:39.273609] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:39.403558] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T17:47:39.617956] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-13T17:47:39.954527] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T17:47:40.417901] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-13T17:47:40.473235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T17:47:41.217915] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-13T17:47:42.017887] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-13T17:47:42.271412] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T17:47:42.458575] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T17:47:42.817953] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-13T17:47:42.921084] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T17:47:43.617920] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-13T17:47:43.996692] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T17:47:44.417890] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-13T17:47:44.794592] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T17:47:45.134014] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T17:47:45.217890] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-13T17:47:45.895478] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T17:47:46.017906] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-13T17:47:46.818009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-13T17:47:47.564571] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T17:47:47.566685] [INFO ] [REMOTE ] BTA: Full fetch complete (9495 records). [2025-10-13T17:47:47.566798] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-13T17:47:47.623024] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-13T17:47:47.937198] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-13T17:47:47.937384] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-13T17:47:47.937688] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-13T17:47:47.937770] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-13T17:47:47.948623] [DEBUG] [LOCAL ] BTA: Trimmed 9495 records to 5590 (keeping 200 days of data) [2025-10-13T17:47:47.981468] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:47:48.013966] [DEBUG] [LOCAL ] BTA: Primary data saved (5590 records). [2025-10-13T17:47:48.014098] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-13T17:47:48.014177] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTA took 38.7s. Estimated remaining: 4h 36m 36s. Rate: 7.3 symbols/min [2025-10-13T17:47:48.189282] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:48.204594] [DEBUG] [LOCAL ] BTT: Loaded 16040 existing records from primary storage. [2025-10-13T17:47:48.204841] [INFO ] [MAIN ] BTT: Loaded 16040 existing records. [2025-10-13T17:47:48.380098] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:48.380285] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-13T17:47:48.380332] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-13T17:47:48.380953] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-13T17:47:48.381014] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-13T17:47:48.423144] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-13T17:47:48.550619] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T17:47:48.750276] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:49.217912] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-13T17:47:50.017943] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-13T17:47:50.412835] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:47:50.502502] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-13T17:47:50.817897] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-13T17:47:50.880037] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:47:51.617929] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-13T17:47:52.417910] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-13T17:47:53.087494] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T17:47:53.217914] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-13T17:47:53.318333] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:47:53.462992] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:47:54.017929] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-13T17:47:54.817916] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-13T17:47:54.838367] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:47:55.227813] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T17:47:55.617939] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-13T17:47:56.368235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:47:56.416283] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:47:56.426231] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-13T17:47:57.217912] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-13T17:47:58.018930] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-13T17:47:58.024630] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:47:58.749854] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:47:58.817925] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-13T17:47:59.370439] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T17:47:59.621062] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-13T17:48:00.417991] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-13T17:48:01.041639] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:48:01.217920] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-13T17:48:01.359397] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T17:48:01.359824] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:48:02.018009] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-13T17:48:02.818012] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-13T17:48:03.241430] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T17:48:03.539793] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:48:03.541242] [INFO ] [REMOTE ] BTO: Full fetch complete (13134 records). [2025-10-13T17:48:03.541311] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-13T17:48:03.620557] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-13T17:48:03.910630] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-13T17:48:03.910761] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-13T17:48:03.911242] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-13T17:48:03.911318] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-13T17:48:03.911987] [DEBUG] [LOCAL ] BTO: Trimmed 13134 records to 8741 (keeping 200 days of data) [2025-10-13T17:48:03.985709] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:48:04.011429] [DEBUG] [LOCAL ] BTO: Primary data saved (8741 records). [2025-10-13T17:48:04.011588] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-13T17:48:04.011697] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTO took 25.4s. Estimated remaining: 4h 37m 13s. Rate: 7.3 symbols/min [2025-10-13T17:48:04.184625] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:04.235878] [DEBUG] [LOCAL ] BTU: Loaded 54095 existing records from primary storage. [2025-10-13T17:48:04.236274] [INFO ] [MAIN ] BTU: Loaded 54095 existing records. [2025-10-13T17:48:04.423463] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-13T17:48:04.428519] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:04.429369] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-13T17:48:04.429435] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-13T17:48:04.430399] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-13T17:48:04.430459] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-13T17:48:04.778536] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:05.218010] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-13T17:48:05.414385] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:48:05.420038] [INFO ] [REMOTE ] BTI: Full fetch complete (77471 records). [2025-10-13T17:48:05.420169] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-13T17:48:05.805096] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-13T17:48:05.805215] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-13T17:48:05.806222] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-13T17:48:05.806295] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-13T17:48:05.808047] [DEBUG] [LOCAL ] BTI: Trimmed 77471 records to 53591 (keeping 200 days of data) [2025-10-13T17:48:06.021878] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-13T17:48:06.143713] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:48:06.156421] [INFO ] [REMOTE ] BTE: Full fetch complete (76139 records). [2025-10-13T17:48:06.157044] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-13T17:48:06.233558] [DEBUG] [LOCAL ] BTI: Primary data saved (53591 records). [2025-10-13T17:48:06.257761] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-13T17:48:06.265507] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTI took 36.7s. Estimated remaining: 4h 36m 30s. Rate: 7.3 symbols/min [2025-10-13T17:48:06.400331] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:48:06.702934] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:06.721431] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-13T17:48:06.762014] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-13T17:48:06.758058] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-13T17:48:06.762271] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-13T17:48:06.762130] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-13T17:48:06.762422] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-13T17:48:06.763395] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-13T17:48:06.763549] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-13T17:48:06.763704] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-13T17:48:06.763773] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-13T17:48:06.822929] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-13T17:48:06.874066] [DEBUG] [LOCAL ] BTE: Trimmed 76139 records to 52723 (keeping 200 days of data) [2025-10-13T17:48:07.242985] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:07.463905] [DEBUG] [LOCAL ] BTE: Primary data saved (52723 records). [2025-10-13T17:48:07.464078] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-13T17:48:07.464169] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTE took 39.7s. Estimated remaining: 4h 35m 42s. Rate: 7.3 symbols/min [2025-10-13T17:48:07.618245] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-13T17:48:07.656018] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:07.685039] [DEBUG] [LOCAL ] BTZ: Loaded 23117 existing records from primary storage. [2025-10-13T17:48:07.685347] [INFO ] [MAIN ] BTZ: Loaded 23117 existing records. [2025-10-13T17:48:07.869336] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:48:07.874226] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:07.879952] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-13T17:48:07.885883] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-13T17:48:07.886155] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-13T17:48:07.885456] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:48:07.888135] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T17:48:07.888514] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-13T17:48:07.892124] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-13T17:48:07.892189] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:48:07.892754] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-13T17:48:07.892597] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-13T17:48:07.893623] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-13T17:48:07.899049] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-13T17:48:07.932785] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-13T17:48:07.953335] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTX took 1.7s. Estimated remaining: 4h 34m 50s. Rate: 7.3 symbols/min [2025-10-13T17:48:08.350099] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-13T17:48:08.424752] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-13T17:48:08.454797] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:08.531718] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:08.579155] [DEBUG] [LOCAL ] BUD: Loaded 53443 existing records from primary storage. [2025-10-13T17:48:08.579507] [INFO ] [MAIN ] BUD: Loaded 53443 existing records. [2025-10-13T17:48:08.779444] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:08.779748] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-13T17:48:08.779802] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-13T17:48:08.780127] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-13T17:48:08.780185] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-13T17:48:09.198185] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:09.217896] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-13T17:48:10.017890] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-13T17:48:10.210821] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:48:10.817909] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-13T17:48:10.924365] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:48:11.173571] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:48:11.618011] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-13T17:48:12.084098] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:48:12.417924] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-13T17:48:13.217991] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-13T17:48:13.444191] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T17:48:13.492460] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:48:14.017940] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-13T17:48:14.817927] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-13T17:48:15.019566] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T17:48:15.046811] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:48:15.617916] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-13T17:48:16.417896] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-13T17:48:16.684444] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:48:16.776720] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T17:48:17.217914] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-13T17:48:18.017883] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-13T17:48:18.125296] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:48:18.466481] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:48:18.817953] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-13T17:48:19.617952] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-13T17:48:19.837924] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:48:19.862353] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:48:20.352892] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T17:48:20.417883] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-13T17:48:21.208442] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T17:48:21.217881] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-13T17:48:22.017904] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-13T17:48:22.237695] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:48:22.817932] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-13T17:48:23.617889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-13T17:48:23.836430] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:48:24.417987] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-13T17:48:24.505458] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:48:24.800526] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:48:25.217903] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-13T17:48:25.321294] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T17:48:26.017973] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-13T17:48:26.817908] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-13T17:48:26.911849] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T17:48:27.617915] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-13T17:48:27.925932] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T17:48:27.974263] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:48:28.417980] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-13T17:48:29.217910] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-13T17:48:29.423486] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:48:29.558569] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:48:30.017997] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-13T17:48:30.817901] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-13T17:48:31.043539] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T17:48:31.089708] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T17:48:31.617923] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-13T17:48:32.418007] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-13T17:48:32.704790] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:48:32.708694] [INFO ] [REMOTE ] BTZ: Full fetch complete (33523 records). [2025-10-13T17:48:32.708850] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-13T17:48:32.870076] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-13T17:48:33.162691] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-13T17:48:33.162828] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-13T17:48:33.163631] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-13T17:48:33.163723] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-13T17:48:33.165108] [DEBUG] [LOCAL ] BTZ: Trimmed 33523 records to 22651 (keeping 200 days of data) [2025-10-13T17:48:33.227622] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-13T17:48:33.313942] [DEBUG] [LOCAL ] BTZ: Primary data saved (22651 records). [2025-10-13T17:48:33.314137] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-13T17:48:33.314285] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 25.8s. Estimated remaining: 4h 36m 19s. Rate: 7.3 symbols/min [2025-10-13T17:48:33.514185] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:33.515826] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T17:48:33.535493] [DEBUG] [LOCAL ] BUI: Loaded 12043 existing records from primary storage. [2025-10-13T17:48:33.535851] [INFO ] [MAIN ] BUI: Loaded 12043 existing records. [2025-10-13T17:48:33.774779] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:33.775194] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-13T17:48:33.775258] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-13T17:48:33.776162] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-13T17:48:33.776223] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-13T17:48:34.025038] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-13T17:48:34.147047] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:34.817883] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-13T17:48:34.895146] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:48:34.963490] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:48:34.966296] [INFO ] [REMOTE ] BTT: Full fetch complete (23172 records). [2025-10-13T17:48:34.966365] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-13T17:48:35.323486] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-13T17:48:35.323566] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-13T17:48:35.323951] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-13T17:48:35.324011] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-13T17:48:35.324566] [DEBUG] [LOCAL ] BTT: Trimmed 23172 records to 15801 (keeping 200 days of data) [2025-10-13T17:48:35.419089] [DEBUG] [LOCAL ] BTT: Primary data saved (15801 records). [2025-10-13T17:48:35.419231] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-13T17:48:35.419322] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTT took 47.4s. Estimated remaining: 4h 35m 37s. Rate: 7.3 symbols/min [2025-10-13T17:48:35.585385] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:35.617908] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-13T17:48:35.633186] [DEBUG] [LOCAL ] BUR: Loaded 45896 existing records from primary storage. [2025-10-13T17:48:35.633501] [INFO ] [MAIN ] BUR: Loaded 45896 existing records. [2025-10-13T17:48:35.811091] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:35.811347] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-13T17:48:35.811407] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-13T17:48:35.812219] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-13T17:48:35.812281] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-13T17:48:36.160044] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:36.417914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-13T17:48:36.818748] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T17:48:37.217928] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-13T17:48:37.598345] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:48:37.889109] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:48:38.023120] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-13T17:48:38.039659] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:48:38.818052] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-13T17:48:38.853537] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:48:39.617935] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-13T17:48:40.417932] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-13T17:48:41.018967] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-13T17:48:41.024332] [INFO ] [REMOTE ] BTU: Full fetch complete (77059 records). [2025-10-13T17:48:41.024450] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-13T17:48:41.237261] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-13T17:48:41.435550] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-13T17:48:41.435669] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-13T17:48:41.436563] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-13T17:48:41.436784] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-13T17:48:41.468982] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:48:41.469121] [DEBUG] [LOCAL ] BTU: Trimmed 77059 records to 53318 (keeping 200 days of data) [2025-10-13T17:48:41.824453] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-13T17:48:41.824691] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-13T17:48:41.824799] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTU took 37.8s. Estimated remaining: 4h 35m 18s. Rate: 7.3 symbols/min [2025-10-13T17:48:41.996682] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:42.019399] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-13T17:48:42.023125] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:48:42.073808] [DEBUG] [LOCAL ] BURL: Loaded 46344 existing records from primary storage. [2025-10-13T17:48:42.074123] [INFO ] [MAIN ] BURL: Loaded 46344 existing records. [2025-10-13T17:48:42.260392] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:42.261180] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:48:42.261348] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-13T17:48:42.263726] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-13T17:48:42.265115] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-13T17:48:42.265185] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-13T17:48:42.619742] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:42.817928] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-13T17:48:43.617914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-13T17:48:43.823849] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:48:44.183956] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:48:44.417927] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-13T17:48:45.041105] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:48:45.217972] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-13T17:48:45.936688] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:48:46.017885] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-13T17:48:46.818028] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-13T17:48:47.082028] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T17:48:47.090004] [INFO ] [REMOTE ] BUD: Full fetch complete (76406 records). [2025-10-13T17:48:47.090273] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-13T17:48:47.480232] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-13T17:48:47.480373] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-13T17:48:47.481391] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-13T17:48:47.481518] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-13T17:48:47.483410] [DEBUG] [LOCAL ] BUD: Trimmed 76406 records to 52658 (keeping 200 days of data) [2025-10-13T17:48:47.652138] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-13T17:48:47.719990] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:48:47.825178] [DEBUG] [LOCAL ] BUD: Primary data saved (52658 records). [2025-10-13T17:48:47.825320] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-13T17:48:47.825397] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 39.9s. Estimated remaining: 4h 34m 58s. Rate: 7.3 symbols/min [2025-10-13T17:48:48.075046] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:48:48.417897] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-13T17:48:48.546177] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T17:48:49.217993] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-13T17:48:49.960879] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:48:50.004251] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T17:48:50.017877] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-13T17:48:50.817933] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-13T17:48:51.588070] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:48:51.605588] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T17:48:51.617879] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-13T17:48:52.377749] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:48:52.417890] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-13T17:48:53.217899] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-13T17:48:53.327826] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T17:48:54.017935] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-13T17:48:54.790740] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T17:48:54.817891] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-13T17:48:54.829566] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T17:48:55.617923] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-13T17:48:56.417903] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-13T17:48:56.468833] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:48:57.217914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-13T17:48:57.241504] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T17:48:57.562692] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:48:58.018027] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-13T17:48:58.817992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-13T17:48:58.875543] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:48:59.617894] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-13T17:48:59.752160] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T17:48:59.754017] [INFO ] [REMOTE ] BUI: Full fetch complete (16526 records). [2025-10-13T17:48:59.754087] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-13T17:49:00.072493] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T17:49:00.156287] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-13T17:49:00.156361] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-13T17:49:00.156737] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-13T17:49:00.156798] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-13T17:49:00.157281] [DEBUG] [LOCAL ] BUI: Trimmed 16526 records to 11920 (keeping 200 days of data) [2025-10-13T17:49:00.234052] [DEBUG] [LOCAL ] BUI: Primary data saved (11920 records). [2025-10-13T17:49:00.234178] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-13T17:49:00.234253] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUI took 26.9s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-13T17:49:00.417946] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-13T17:49:01.444968] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T17:49:01.454857] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-13T17:49:02.135780] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:49:02.145868] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-13T17:49:02.969943] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:49:02.974529] [INFO ] [REMOTE ] BUR: Full fetch complete (63772 records). [2025-10-13T17:49:02.974678] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-13T17:49:03.359384] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-13T17:49:03.359485] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-13T17:49:03.360286] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-13T17:49:03.360373] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-13T17:49:03.361699] [DEBUG] [LOCAL ] BUR: Trimmed 63772 records to 45304 (keeping 200 days of data) [2025-10-13T17:49:03.651665] [DEBUG] [LOCAL ] BUR: Primary data saved (45304 records). [2025-10-13T17:49:03.651888] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-13T17:49:03.652008] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 28.2s. Estimated remaining: 4h 34m 38s. Rate: 7.3 symbols/min [2025-10-13T17:49:03.692293] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:49:03.701884] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-13T17:49:05.319739] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:49:05.329524] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-13T17:49:06.957437] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:49:06.967103] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-13T17:49:08.479383] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:49:08.488962] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-13T17:49:10.070691] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:49:10.075783] [INFO ] [REMOTE ] BURL: Full fetch complete (65691 records). [2025-10-13T17:49:10.075907] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-13T17:49:10.466215] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-13T17:49:10.466312] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-13T17:49:10.467082] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-13T17:49:10.467144] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-13T17:49:10.468434] [DEBUG] [LOCAL ] BURL: Trimmed 65691 records to 45749 (keeping 200 days of data) [2025-10-13T17:49:10.748080] [DEBUG] [LOCAL ] BURL: Primary data saved (45749 records). [2025-10-13T17:49:10.748230] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-13T17:49:10.748343] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 28.9s. Estimated remaining: 4h 34m 24s. Rate: 7.3 symbols/min [2025-10-13T17:49:11.374287] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.396250] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.462088] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.461214] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.462704] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-13T17:49:11.462892] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-13T17:49:11.463004] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-13T17:49:11.463047] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-13T17:49:11.463215] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-13T17:49:11.463266] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-13T17:49:11.571795] [DEBUG] [LOCAL ] BUXX: Loaded 15454 existing records from primary storage. [2025-10-13T17:49:11.639626] [INFO ] [MAIN ] BUXX: Loaded 15454 existing records. [2025-10-13T17:49:11.828950] [DEBUG] [LOCAL ] BW: Loaded 40915 existing records from primary storage. [2025-10-13T17:49:11.846306] [DEBUG] [LOCAL ] BV: Loaded 39079 existing records from primary storage. [2025-10-13T17:49:11.906588] [INFO ] [MAIN ] BV: Loaded 39079 existing records. [2025-10-13T17:49:11.906468] [INFO ] [MAIN ] BW: Loaded 40915 existing records. [2025-10-13T17:49:12.224816] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:12.264908] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-13T17:49:12.295205] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.327864] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.372946] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-13T17:49:12.390459] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.413258] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-13T17:49:12.413533] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.413447] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-13T17:49:12.422723] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-13T17:49:12.453084] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.462788] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.478132] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-13T17:49:12.462728] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-13T17:49:12.510947] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-13T17:49:12.563743] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-13T17:49:12.619221] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-13T17:49:13.348184] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.369147] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-13T17:49:13.495850] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.537593] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-13T17:49:13.578896] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.579330] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-13T17:49:13.986162] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:49:14.000006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-13T17:49:14.495407] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T17:49:14.499037] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-13T17:49:14.956193] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:49:14.963091] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-13T17:49:15.067548] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:49:15.087248] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-13T17:49:15.088374] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T17:49:15.092927] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-13T17:49:15.318792] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:49:15.327158] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-13T17:49:15.913871] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:49:15.916584] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-13T17:49:16.182121] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T17:49:16.188877] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-13T17:49:16.326930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:49:16.337133] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-13T17:49:16.436182] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T17:49:16.439623] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-13T17:49:16.717631] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:49:17.217913] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-13T17:49:17.458581] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:49:17.506777] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:49:17.649779] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:49:18.018015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-13T17:49:18.546878] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:49:18.817927] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-13T17:49:19.617902] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-13T17:49:19.773388] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:49:20.424833] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-13T17:49:20.434142] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:49:21.075623] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:49:21.217953] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-13T17:49:22.017929] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-13T17:49:22.051986] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:49:22.514822] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:49:22.817952] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-13T17:49:23.130277] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:49:23.617889] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-13T17:49:23.775158] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:49:24.417940] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-13T17:49:25.141055] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:49:25.217929] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-13T17:49:25.430002] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:49:26.017945] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-13T17:49:26.635520] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:49:26.817950] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-13T17:49:27.617916] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-13T17:49:27.679937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:49:28.230226] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T17:49:28.360337] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T17:49:28.418056] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-13T17:49:29.217949] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-13T17:49:29.968715] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:49:30.017890] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-13T17:49:30.629797] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:49:30.818082] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-13T17:49:31.576368] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:49:31.618056] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-13T17:49:32.266486] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:49:32.312025] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:49:32.417981] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-13T17:49:33.218015] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-13T17:49:33.788899] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:49:33.793630] [INFO ] [REMOTE ] BV: Full fetch complete (54559 records). [2025-10-13T17:49:33.793811] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-13T17:49:34.022292] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-13T17:49:34.161907] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:49:34.255486] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-13T17:49:34.255599] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-13T17:49:34.256436] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-13T17:49:34.256504] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-13T17:49:34.258105] [DEBUG] [LOCAL ] BV: Trimmed 54559 records to 38568 (keeping 200 days of data) [2025-10-13T17:49:34.506239] [DEBUG] [LOCAL ] BV: Primary data saved (38568 records). [2025-10-13T17:49:34.506436] [INFO ] [MAIN ] BV: Full history saved. [2025-10-13T17:49:34.506542] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 23.7s. Estimated remaining: 4h 35m 42s. Rate: 7.3 symbols/min [2025-10-13T17:49:34.696241] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:34.749698] [DEBUG] [LOCAL ] BWA: Loaded 52923 existing records from primary storage. [2025-10-13T17:49:34.750146] [INFO ] [MAIN ] BWA: Loaded 52923 existing records. [2025-10-13T17:49:34.826866] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-13T17:49:34.938465] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:34.938778] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-13T17:49:34.938833] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-13T17:49:34.939307] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-13T17:49:34.939366] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-13T17:49:35.291337] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:35.537452] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:49:35.617913] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-13T17:49:35.870172] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:49:35.872227] [INFO ] [REMOTE ] BUXX: Full fetch complete (20447 records). [2025-10-13T17:49:35.872299] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-13T17:49:36.259192] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-13T17:49:36.259282] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-13T17:49:36.259743] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-13T17:49:36.259805] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-13T17:49:36.260419] [DEBUG] [LOCAL ] BUXX: Trimmed 20447 records to 15320 (keeping 200 days of data) [2025-10-13T17:49:36.359164] [DEBUG] [LOCAL ] BUXX: Primary data saved (15320 records). [2025-10-13T17:49:36.359351] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-13T17:49:36.359455] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BUXX took 25.6s. Estimated remaining: 4h 34m 59s. Rate: 7.3 symbols/min [2025-10-13T17:49:36.424184] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-13T17:49:36.549509] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:36.565456] [DEBUG] [LOCAL ] BWG: Loaded 12767 existing records from primary storage. [2025-10-13T17:49:36.565828] [INFO ] [MAIN ] BWG: Loaded 12767 existing records. [2025-10-13T17:49:36.764943] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:36.765224] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-13T17:49:36.765295] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-13T17:49:36.765603] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-13T17:49:36.765701] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-13T17:49:37.159357] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:37.217928] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-13T17:49:37.457381] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:49:38.017935] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-13T17:49:38.066248] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T17:49:38.811457] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:49:38.820405] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-13T17:49:39.535224] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:49:39.618006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-13T17:49:39.732371] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T17:49:40.417944] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-13T17:49:41.080443] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:49:41.217918] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-13T17:49:42.015038] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:49:42.024440] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-13T17:49:42.817923] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-13T17:49:42.890431] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T17:49:43.617998] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-13T17:49:43.828890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:49:44.417928] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-13T17:49:44.614597] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:49:45.217938] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-13T17:49:45.699709] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T17:49:46.027865] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-13T17:49:46.030930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:49:46.036931] [INFO ] [REMOTE ] BW: Full fetch complete (59083 records). [2025-10-13T17:49:46.037037] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-13T17:49:46.427395] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-13T17:49:46.427593] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-13T17:49:46.428430] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-13T17:49:46.428495] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-13T17:49:46.430288] [DEBUG] [LOCAL ] BW: Trimmed 59083 records to 40411 (keeping 200 days of data) [2025-10-13T17:49:46.675731] [DEBUG] [LOCAL ] BW: Primary data saved (40411 records). [2025-10-13T17:49:46.675914] [INFO ] [MAIN ] BW: Full history saved. [2025-10-13T17:49:46.676029] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BW took 35.9s. Estimated remaining: 4h 35m 2s. Rate: 7.3 symbols/min [2025-10-13T17:49:46.831603] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-13T17:49:46.860172] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:46.899585] [DEBUG] [LOCAL ] BWLP: Loaded 32930 existing records from primary storage. [2025-10-13T17:49:46.899965] [INFO ] [MAIN ] BWLP: Loaded 32930 existing records. [2025-10-13T17:49:47.092063] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:47.106353] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-13T17:49:47.111591] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-13T17:49:47.127409] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-13T17:49:47.128009] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-13T17:49:47.129599] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:49:47.526918] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:47.617943] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-13T17:49:47.647015] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:49:47.652198] [INFO ] [REMOTE ] BVN: Full fetch complete (62904 records). [2025-10-13T17:49:47.652310] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-13T17:49:47.760456] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T17:49:48.055972] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-13T17:49:48.056052] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-13T17:49:48.056821] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-13T17:49:48.056883] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-13T17:49:48.058163] [DEBUG] [LOCAL ] BVN: Trimmed 62904 records to 44224 (keeping 200 days of data) [2025-10-13T17:49:48.316817] [DEBUG] [LOCAL ] BVN: Primary data saved (44224 records). [2025-10-13T17:49:48.316972] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-13T17:49:48.317053] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BVN took 37.6s. Estimated remaining: 4h 34m 18s. Rate: 7.3 symbols/min [2025-10-13T17:49:48.423076] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-13T17:49:48.487692] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:48.496683] [DEBUG] [LOCAL ] BWMX: Loaded 7816 existing records from primary storage. [2025-10-13T17:49:48.497229] [INFO ] [MAIN ] BWMX: Loaded 7816 existing records. [2025-10-13T17:49:48.682772] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:48.683013] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-13T17:49:48.683059] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-13T17:49:48.683241] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-13T17:49:48.683314] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-13T17:49:49.053472] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:49.215575] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:49:49.218327] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-13T17:49:49.559514] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T17:49:50.017896] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-13T17:49:50.156345] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T17:49:50.791164] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T17:49:50.817987] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-13T17:49:51.423525] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:49:51.617932] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-13T17:49:52.417984] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-13T17:49:52.993897] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:49:53.208349] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:49:53.217882] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-13T17:49:54.017917] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-13T17:49:54.467089] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:49:54.817893] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-13T17:49:54.892102] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T17:49:55.617943] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-13T17:49:55.952113] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T17:49:56.417941] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-13T17:49:56.763599] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T17:49:57.217935] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-13T17:49:57.358878] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:49:57.900905] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T17:49:58.017944] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-13T17:49:58.817950] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-13T17:49:59.397882] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T17:49:59.617901] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-13T17:49:59.772243] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:50:00.417998] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-13T17:50:01.187750] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:50:01.217879] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-13T17:50:01.322885] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T17:50:02.017916] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-13T17:50:02.557049] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:50:02.782415] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:50:02.817924] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-13T17:50:03.618021] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-13T17:50:04.417935] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-13T17:50:04.474693] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:50:04.755033] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T17:50:04.984380] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:50:05.217934] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-13T17:50:06.017987] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-13T17:50:06.032415] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T17:50:06.817937] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-13T17:50:07.617908] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-13T17:50:07.657165] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:50:07.768064] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:50:08.299987] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:50:08.417929] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-13T17:50:09.038997] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T17:50:09.040246] [INFO ] [REMOTE ] BWMX: Full fetch complete (10078 records). [2025-10-13T17:50:09.040319] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-13T17:50:09.221801] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-13T17:50:09.438512] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-13T17:50:09.438589] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-13T17:50:09.438894] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-13T17:50:09.438956] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-13T17:50:09.439386] [DEBUG] [LOCAL ] BWMX: Trimmed 10078 records to 7770 (keeping 200 days of data) [2025-10-13T17:50:09.487717] [DEBUG] [LOCAL ] BWMX: Primary data saved (7770 records). [2025-10-13T17:50:09.487867] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-13T17:50:09.487973] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 21.2s. Estimated remaining: 4h 35m 21s. Rate: 7.3 symbols/min [2025-10-13T17:50:09.662680] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:09.662890] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-10-13T17:50:09.662939] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-10-13T17:50:09.663048] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-13T17:50:09.663090] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-13T17:50:09.663130] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-13T17:50:09.663162] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-13T17:50:10.021327] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:10.019892] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-13T17:50:10.674058] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T17:50:10.817940] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-13T17:50:10.951512] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:50:11.465279] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:50:11.617925] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-13T17:50:12.417915] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-13T17:50:12.975878] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T17:50:13.217920] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-13T17:50:14.017912] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-13T17:50:14.069571] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T17:50:14.071510] [INFO ] [REMOTE ] BWG: Full fetch complete (17820 records). [2025-10-13T17:50:14.071589] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-13T17:50:14.394805] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:50:14.491997] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:50:14.518262] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-13T17:50:14.518346] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-13T17:50:14.518937] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-13T17:50:14.519001] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-13T17:50:14.519676] [DEBUG] [LOCAL ] BWG: Trimmed 17820 records to 12657 (keeping 200 days of data) [2025-10-13T17:50:14.593954] [DEBUG] [LOCAL ] BWG: Primary data saved (12657 records). [2025-10-13T17:50:14.594093] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-13T17:50:14.594172] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWG took 38.2s. Estimated remaining: 4h 34m 55s. Rate: 7.3 symbols/min [2025-10-13T17:50:14.768459] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:14.774860] [DEBUG] [LOCAL ] BWSN: Loaded 5205 existing records from primary storage. [2025-10-13T17:50:14.775012] [INFO ] [MAIN ] BWSN: Loaded 5205 existing records. [2025-10-13T17:50:14.826123] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-13T17:50:14.951498] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:14.951749] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-13T17:50:14.951801] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-13T17:50:14.951980] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-13T17:50:14.952035] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-13T17:50:15.301487] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:15.617921] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-13T17:50:16.183576] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:50:16.417915] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-13T17:50:17.217898] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-13T17:50:17.319697] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:50:17.325011] [INFO ] [REMOTE ] BWA: Full fetch complete (75693 records). [2025-10-13T17:50:17.325104] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-13T17:50:17.720812] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:50:17.720634] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-13T17:50:17.722381] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-13T17:50:17.723299] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-13T17:50:17.723371] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-13T17:50:17.724893] [DEBUG] [LOCAL ] BWA: Trimmed 75693 records to 52168 (keeping 200 days of data) [2025-10-13T17:50:18.018204] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-13T17:50:18.038395] [DEBUG] [LOCAL ] BWA: Primary data saved (52168 records). [2025-10-13T17:50:18.038562] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-13T17:50:18.039353] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWA took 43.5s. Estimated remaining: 4h 34m 21s. Rate: 7.3 symbols/min [2025-10-13T17:50:18.196386] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:50:18.233808] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:18.278058] [DEBUG] [LOCAL ] BWXT: Loaded 47543 existing records from primary storage. [2025-10-13T17:50:18.278359] [INFO ] [MAIN ] BWXT: Loaded 47543 existing records. [2025-10-13T17:50:18.452695] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:18.453200] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-13T17:50:18.453249] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-13T17:50:18.453525] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-13T17:50:18.453580] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-13T17:50:18.556766] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T17:50:18.807407] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:18.817885] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-13T17:50:19.617921] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-13T17:50:20.290434] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:50:20.417892] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-13T17:50:20.468285] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:50:20.849054] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:50:21.217916] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-13T17:50:22.017921] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-13T17:50:22.444360] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:50:22.817906] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-13T17:50:22.846351] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:50:23.365421] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:50:23.617978] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-13T17:50:24.417978] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-13T17:50:24.992209] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:50:24.997519] [INFO ] [REMOTE ] BWLP: Full fetch complete (48043 records). [2025-10-13T17:50:24.997720] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-13T17:50:25.223103] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-13T17:50:25.380717] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-13T17:50:25.380811] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-13T17:50:25.381483] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-13T17:50:25.381525] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-13T17:50:25.382596] [DEBUG] [LOCAL ] BWLP: Trimmed 48043 records to 32405 (keeping 200 days of data) [2025-10-13T17:50:25.574310] [DEBUG] [LOCAL ] BWLP: Primary data saved (32405 records). [2025-10-13T17:50:25.574425] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-13T17:50:25.574505] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 38.9s. Estimated remaining: 4h 34m 9s. Rate: 7.3 symbols/min [2025-10-13T17:50:25.741181] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:25.793924] [DEBUG] [LOCAL ] BX: Loaded 54259 existing records from primary storage. [2025-10-13T17:50:25.794273] [INFO ] [MAIN ] BX: Loaded 54259 existing records. [2025-10-13T17:50:25.970232] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:25.970501] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-13T17:50:25.970555] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-13T17:50:25.970875] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-13T17:50:25.970931] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-13T17:50:26.023978] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-13T17:50:26.058100] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T17:50:26.356512] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:26.374087] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T17:50:26.746860] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:50:26.817901] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-13T17:50:27.530528] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:50:27.617897] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-13T17:50:28.203682] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T17:50:28.417906] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-13T17:50:29.217927] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-13T17:50:30.017971] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-13T17:50:30.401200] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:50:30.455834] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T17:50:30.817983] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-13T17:50:30.871362] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:50:31.617983] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-13T17:50:31.724746] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T17:50:32.417894] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-13T17:50:33.058398] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T17:50:33.218006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-13T17:50:33.494769] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:50:33.971406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:50:34.017881] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-13T17:50:34.464439] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-13T17:50:34.817930] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-13T17:50:35.445754] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:50:35.617933] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-13T17:50:36.417943] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-13T17:50:36.862882] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T17:50:37.217913] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-13T17:50:37.594495] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:50:37.767878] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T17:50:37.769023] [INFO ] [REMOTE ] BWSN: Full fetch complete (6286 records). [2025-10-13T17:50:37.769113] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-13T17:50:38.023137] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-13T17:50:38.145925] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-13T17:50:38.146032] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-13T17:50:38.146466] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-13T17:50:38.146535] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-13T17:50:38.147272] [DEBUG] [LOCAL ] BWSN: Trimmed 6286 records to 5132 (keeping 200 days of data) [2025-10-13T17:50:38.187190] [DEBUG] [LOCAL ] BWSN: Primary data saved (5132 records). [2025-10-13T17:50:38.187388] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-13T17:50:38.187591] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 23.6s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-13T17:50:38.376502] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:38.395039] [DEBUG] [LOCAL ] BXC: Loaded 13860 existing records from primary storage. [2025-10-13T17:50:38.395440] [INFO ] [MAIN ] BXC: Loaded 13860 existing records. [2025-10-13T17:50:38.596575] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:38.596920] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-13T17:50:38.596975] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-13T17:50:38.597295] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-13T17:50:38.597377] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-13T17:50:38.823205] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-13T17:50:39.030357] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:39.474629] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:50:39.617927] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-13T17:50:39.924169] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T17:50:40.048028] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-13T17:50:40.049193] [INFO ] [REMOTE ] BWNB: Full fetch complete (5654 records). [2025-10-13T17:50:40.049285] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-13T17:50:40.413589] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-13T17:50:40.413694] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-13T17:50:40.413923] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-13T17:50:40.413964] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-13T17:50:40.414319] [DEBUG] [LOCAL ] BWNB: Trimmed 5654 records to 4239 (keeping 200 days of data) [2025-10-13T17:50:40.426678] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-13T17:50:40.443308] [DEBUG] [LOCAL ] BWNB: Primary data saved (4239 records). [2025-10-13T17:50:40.443394] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-13T17:50:40.443462] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWNB took 31.0s. Estimated remaining: 4h 33m 44s. Rate: 7.3 symbols/min [2025-10-13T17:50:40.609271] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:40.657032] [DEBUG] [LOCAL ] BXMT: Loaded 47937 existing records from primary storage. [2025-10-13T17:50:40.657374] [INFO ] [MAIN ] BXMT: Loaded 47937 existing records. [2025-10-13T17:50:40.831515] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:40.831833] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-13T17:50:40.831880] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-13T17:50:40.832332] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-13T17:50:40.832389] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-13T17:50:41.195747] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:41.217889] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-13T17:50:41.283980] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T17:50:42.017918] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-13T17:50:42.800479] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T17:50:42.817920] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-13T17:50:42.970891] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:50:43.618054] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-13T17:50:43.663377] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:50:44.417929] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-13T17:50:45.217924] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-13T17:50:45.301563] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T17:50:45.372007] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:50:46.017978] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-13T17:50:46.817919] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-13T17:50:47.245634] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T17:50:47.617931] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-13T17:50:47.685697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T17:50:48.417943] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-13T17:50:48.637638] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:50:49.217925] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-13T17:50:49.803192] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T17:50:50.017902] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-13T17:50:50.196111] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:50:50.690516] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:50:50.817915] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-13T17:50:51.617927] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-13T17:50:52.047013] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:50:52.417918] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-13T17:50:52.504165] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:50:52.756331] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:50:53.217936] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-13T17:50:54.017925] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-13T17:50:54.296358] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:50:54.817924] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-13T17:50:55.186573] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T17:50:55.467719] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:50:55.617917] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-13T17:50:56.417899] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-13T17:50:56.934179] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T17:50:57.145787] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T17:50:57.217893] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-13T17:50:57.256239] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:50:58.017947] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-13T17:50:58.822171] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-13T17:50:58.826438] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:50:59.075081] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:50:59.617942] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-13T17:51:00.024211] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:51:00.417903] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-13T17:51:00.689297] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:51:01.217912] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-13T17:51:02.017904] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-13T17:51:02.460408] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T17:51:02.680332] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:51:02.817917] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-13T17:51:02.994757] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:51:03.617930] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-13T17:51:04.052359] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:51:04.417980] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-13T17:51:04.477543] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:51:05.217938] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-13T17:51:06.017943] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-13T17:51:06.302216] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:51:06.817914] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-13T17:51:06.955953] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:51:06.957777] [INFO ] [REMOTE ] BXC: Full fetch complete (18186 records). [2025-10-13T17:51:06.957864] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-13T17:51:07.311535] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T17:51:07.359186] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-13T17:51:07.359045] [INFO ] [REMOTE ] BX: Full fetch complete (77409 records). [2025-10-13T17:51:07.359304] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-13T17:51:07.359462] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-13T17:51:07.359885] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-13T17:51:07.359963] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-13T17:51:07.459950] [DEBUG] [LOCAL ] BXC: Trimmed 18186 records to 13689 (keeping 200 days of data) [2025-10-13T17:51:07.618979] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-13T17:51:07.860125] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-13T17:51:07.860528] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-13T17:51:07.861797] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-13T17:51:07.861876] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-13T17:51:07.864867] [DEBUG] [LOCAL ] BXC: Primary data saved (13689 records). [2025-10-13T17:51:07.865038] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-13T17:51:07.865225] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 29.7s. Estimated remaining: 4h 35m 20s. Rate: 7.3 symbols/min [2025-10-13T17:51:07.929777] [DEBUG] [LOCAL ] BX: Trimmed 77409 records to 53483 (keeping 200 days of data) [2025-10-13T17:51:08.130010] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:08.166826] [DEBUG] [LOCAL ] BXMX: Loaded 19803 existing records from primary storage. [2025-10-13T17:51:08.167560] [INFO ] [MAIN ] BXMX: Loaded 19803 existing records. [2025-10-13T17:51:08.414558] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:08.424558] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-13T17:51:08.458412] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-13T17:51:08.460125] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-13T17:51:08.460633] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-13T17:51:08.859803] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:08.860994] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-13T17:51:08.881087] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T17:51:08.888898] [INFO ] [REMOTE ] BWXT: Full fetch complete (67566 records). [2025-10-13T17:51:08.889513] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-13T17:51:09.231999] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-13T17:51:09.253737] [INFO ] [MAIN ] BX: Full history saved. [2025-10-13T17:51:09.259001] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 43.7s. Estimated remaining: 4h 34m 34s. Rate: 7.3 symbols/min [2025-10-13T17:51:09.501538] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-13T17:51:09.501727] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-13T17:51:09.526247] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-13T17:51:09.548342] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-13T17:51:09.551849] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:09.553486] [DEBUG] [LOCAL ] BWXT: Trimmed 67566 records to 46959 (keeping 200 days of data) [2025-10-13T17:51:09.672846] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T17:51:09.686461] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-13T17:51:09.736134] [DEBUG] [LOCAL ] BXP: Loaded 50547 existing records from primary storage. [2025-10-13T17:51:09.740456] [INFO ] [MAIN ] BXP: Loaded 50547 existing records. [2025-10-13T17:51:09.935069] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:09.937933] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-13T17:51:09.938110] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-13T17:51:09.992046] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-13T17:51:09.992316] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-13T17:51:10.361439] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:51:10.377380] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-13T17:51:10.439465] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:10.500876] [DEBUG] [LOCAL ] BWXT: Primary data saved (46959 records). [2025-10-13T17:51:10.501026] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-13T17:51:10.501849] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BWXT took 52.5s. Estimated remaining: 4h 33m 49s. Rate: 7.3 symbols/min [2025-10-13T17:51:10.667109] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:10.713152] [DEBUG] [LOCAL ] BXSL: Loaded 48607 existing records from primary storage. [2025-10-13T17:51:10.713496] [INFO ] [MAIN ] BXSL: Loaded 48607 existing records. [2025-10-13T17:51:10.823049] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-13T17:51:10.893252] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:10.893515] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-13T17:51:10.893565] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-13T17:51:10.894015] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-13T17:51:10.894072] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-13T17:51:11.251308] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:11.328008] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:51:11.333599] [INFO ] [REMOTE ] BXMT: Full fetch complete (69724 records). [2025-10-13T17:51:11.333754] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-13T17:51:11.622948] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-13T17:51:11.643630] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:51:11.743832] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-13T17:51:11.743911] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-13T17:51:11.744722] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-13T17:51:11.744810] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-13T17:51:11.746162] [DEBUG] [LOCAL ] BXMT: Trimmed 69724 records to 47241 (keeping 200 days of data) [2025-10-13T17:51:12.037175] [DEBUG] [LOCAL ] BXMT: Primary data saved (47241 records). [2025-10-13T17:51:12.037306] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-13T17:51:12.037387] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMT took 31.6s. Estimated remaining: 4h 33m 5s. Rate: 7.3 symbols/min [2025-10-13T17:51:12.209136] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:12.209410] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-13T17:51:12.209481] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-13T17:51:12.209779] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-13T17:51:12.209847] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-13T17:51:12.209950] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-13T17:51:12.210001] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-13T17:51:12.429919] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-13T17:51:12.569986] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:51:12.607487] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:13.217897] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-13T17:51:13.431961] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:51:13.499636] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:51:14.017995] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-13T17:51:14.604210] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T17:51:14.817912] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-13T17:51:15.617983] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-13T17:51:15.828912] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:51:15.927264] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T17:51:16.417939] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-13T17:51:16.644887] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:51:17.218209] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-13T17:51:17.550413] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T17:51:18.017918] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-13T17:51:18.713855] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:51:18.817888] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-13T17:51:19.060411] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:51:19.617990] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-13T17:51:20.422134] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-13T17:51:20.427259] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:51:21.217930] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-13T17:51:21.373602] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:51:21.521224] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:51:22.018006] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-13T17:51:22.830354] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-13T17:51:22.844698] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:51:22.869987] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T17:51:23.617912] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-13T17:51:24.389501] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:51:24.417933] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-13T17:51:24.687912] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:51:25.217996] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-13T17:51:25.869253] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T17:51:26.017920] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-13T17:51:26.132121] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T17:51:26.817916] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-13T17:51:27.617915] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-13T17:51:27.756042] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:51:27.791612] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:51:28.417914] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-13T17:51:28.927450] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:51:29.217906] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-13T17:51:29.587223] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T17:51:29.590533] [INFO ] [REMOTE ] BXMX: Full fetch complete (28788 records). [2025-10-13T17:51:29.590685] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-13T17:51:29.991422] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-13T17:51:29.991516] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-13T17:51:29.992265] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-13T17:51:29.992331] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-13T17:51:29.993213] [DEBUG] [LOCAL ] BXMX: Trimmed 28788 records to 19531 (keeping 200 days of data) [2025-10-13T17:51:30.051576] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-13T17:51:30.134616] [DEBUG] [LOCAL ] BXMX: Primary data saved (19531 records). [2025-10-13T17:51:30.134932] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-13T17:51:30.135071] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXMX took 22.3s. Estimated remaining: 4h 33m 49s. Rate: 7.3 symbols/min [2025-10-13T17:51:30.275697] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:51:30.357395] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:30.403773] [DEBUG] [LOCAL ] BYD: Loaded 45519 existing records from primary storage. [2025-10-13T17:51:30.404110] [INFO ] [MAIN ] BYD: Loaded 45519 existing records. [2025-10-13T17:51:30.581252] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:30.581536] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-13T17:51:30.581614] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-13T17:51:30.582046] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-13T17:51:30.582108] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-13T17:51:30.823281] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-13T17:51:30.938729] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:31.617946] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-13T17:51:32.417927] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-13T17:51:32.538070] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:51:32.853612] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-13T17:51:33.223543] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-13T17:51:33.236386] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:51:33.995838] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:51:34.017886] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-13T17:51:34.638878] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:51:34.817922] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-13T17:51:35.617896] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-13T17:51:35.680235] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:51:36.025828] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:51:36.417938] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-13T17:51:37.166240] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:51:37.217897] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-13T17:51:38.017946] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-13T17:51:38.399979] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:51:38.807149] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:51:38.817884] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-13T17:51:39.219851] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T17:51:39.617927] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-13T17:51:40.410434] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:51:40.416053] [INFO ] [REMOTE ] BXSL: Full fetch complete (69694 records). [2025-10-13T17:51:40.416166] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-13T17:51:40.428066] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-13T17:51:40.815094] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-13T17:51:40.815191] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-13T17:51:40.816017] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-13T17:51:40.816078] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-13T17:51:40.817583] [DEBUG] [LOCAL ] BXSL: Trimmed 69694 records to 48025 (keeping 200 days of data) [2025-10-13T17:51:41.115545] [DEBUG] [LOCAL ] BXSL: Primary data saved (48025 records). [2025-10-13T17:51:41.115707] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-13T17:51:41.116362] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 30.6s. Estimated remaining: 4h 33m 56s. Rate: 7.3 symbols/min [2025-10-13T17:51:41.228226] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-13T17:51:41.289976] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:41.325429] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:51:41.344602] [DEBUG] [LOCAL ] BYM: Loaded 12105 existing records from primary storage. [2025-10-13T17:51:41.344856] [INFO ] [MAIN ] BYM: Loaded 12105 existing records. [2025-10-13T17:51:41.522875] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:41.523129] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-13T17:51:41.523174] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-13T17:51:41.523406] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-13T17:51:41.523462] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-13T17:51:41.879374] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:42.017908] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-13T17:51:42.067363] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:51:42.366398] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:51:42.817905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-13T17:51:43.039887] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T17:51:43.617940] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-13T17:51:43.936746] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:51:44.417912] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-13T17:51:44.471076] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:51:45.217929] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-13T17:51:45.975215] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:51:46.017891] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-13T17:51:46.135592] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:51:46.141134] [INFO ] [REMOTE ] BXP: Full fetch complete (71786 records). [2025-10-13T17:51:46.141270] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-13T17:51:46.546354] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-13T17:51:46.546498] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-13T17:51:46.547823] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-13T17:51:46.547904] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-13T17:51:46.550094] [DEBUG] [LOCAL ] BXP: Trimmed 71786 records to 49840 (keeping 200 days of data) [2025-10-13T17:51:46.819095] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-13T17:51:46.884740] [DEBUG] [LOCAL ] BXP: Primary data saved (49840 records). [2025-10-13T17:51:46.884926] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-13T17:51:46.885025] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BXP took 37.6s. Estimated remaining: 4h 33m 34s. Rate: 7.3 symbols/min [2025-10-13T17:51:47.008142] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:51:47.085768] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:47.119089] [DEBUG] [LOCAL ] BZH: Loaded 32907 existing records from primary storage. [2025-10-13T17:51:47.119451] [INFO ] [MAIN ] BZH: Loaded 32907 existing records. [2025-10-13T17:51:47.304240] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:47.304535] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-13T17:51:47.304594] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-13T17:51:47.304987] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-13T17:51:47.305052] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-13T17:51:47.630181] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-13T17:51:47.671738] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:48.417924] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-13T17:51:48.612123] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:51:48.828452] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T17:51:49.217919] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-13T17:51:49.633337] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:51:50.017912] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-13T17:51:50.172634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:51:50.817882] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-13T17:51:51.225031] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:51:51.617899] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-13T17:51:51.737525] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T17:51:52.417910] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-13T17:51:53.014201] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:51:53.217895] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-13T17:51:53.399692] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:51:54.017927] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-13T17:51:54.579203] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:51:54.817885] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-13T17:51:55.328583] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T17:51:55.617924] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-13T17:51:56.157145] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:51:56.401883] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T17:51:56.404265] [INFO ] [REMOTE ] BY: Full fetch complete (29679 records). [2025-10-13T17:51:56.404335] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-13T17:51:56.424811] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-13T17:51:56.774591] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-13T17:51:56.774683] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-13T17:51:56.775139] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-13T17:51:56.775179] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-13T17:51:56.775898] [DEBUG] [LOCAL ] BY: Trimmed 29679 records to 21757 (keeping 200 days of data) [2025-10-13T17:51:56.906249] [DEBUG] [LOCAL ] BY: Primary data saved (21757 records). [2025-10-13T17:51:56.906385] [INFO ] [MAIN ] BY: Full history saved. [2025-10-13T17:51:56.906456] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 44.9s. Estimated remaining: 4h 33m 35s. Rate: 7.3 symbols/min [2025-10-13T17:51:57.073098] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:57.124228] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-13T17:51:57.124563] [INFO ] [MAIN ] C: Loaded 54520 existing records. [2025-10-13T17:51:57.223006] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-13T17:51:57.314108] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:57.315257] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T17:51:57.315503] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-13T17:51:57.318570] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-13T17:51:57.319635] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-13T17:51:57.319723] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-13T17:51:57.673391] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:58.017937] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-13T17:51:58.817998] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-13T17:51:59.100042] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T17:51:59.370077] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:51:59.617889] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-13T17:52:00.417946] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-13T17:52:00.648096] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:52:01.096836] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:52:01.217886] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-13T17:52:01.230505] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:52:02.018001] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-13T17:52:02.817915] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-13T17:52:03.219958] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T17:52:03.617928] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-13T17:52:03.681580] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T17:52:04.186883] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T17:52:04.417946] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-13T17:52:05.106165] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:52:05.217936] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-13T17:52:05.795163] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:52:06.017934] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-13T17:52:06.817972] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-13T17:52:07.115175] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:52:07.330458] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-13T17:52:07.619134] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-13T17:52:07.624363] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:52:08.417945] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-13T17:52:09.218018] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-13T17:52:09.266538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:52:09.371787] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:52:10.017971] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-13T17:52:10.820048] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-13T17:52:10.822933] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T17:52:10.824801] [INFO ] [REMOTE ] BYM: Full fetch complete (17697 records). [2025-10-13T17:52:10.824872] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-13T17:52:11.203859] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-13T17:52:11.203957] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-13T17:52:11.204411] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-13T17:52:11.204558] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-13T17:52:11.205432] [DEBUG] [LOCAL ] BYM: Trimmed 17697 records to 11777 (keeping 200 days of data) [2025-10-13T17:52:11.306519] [DEBUG] [LOCAL ] BYM: Primary data saved (11777 records). [2025-10-13T17:52:11.306720] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-13T17:52:11.306820] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 30.2s. Estimated remaining: 4h 33m 60s. Rate: 7.3 symbols/min [2025-10-13T17:52:11.330469] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T17:52:11.497197] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:11.515867] [DEBUG] [LOCAL ] CAAP: Loaded 20121 existing records from primary storage. [2025-10-13T17:52:11.516115] [INFO ] [MAIN ] CAAP: Loaded 20121 existing records. [2025-10-13T17:52:11.620127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-13T17:52:11.700619] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:11.701387] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-13T17:52:11.701462] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-13T17:52:11.701738] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-13T17:52:11.701823] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-13T17:52:12.085304] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:12.162012] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:52:12.417950] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-13T17:52:13.213227] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:52:13.222006] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-13T17:52:13.669824] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:52:13.673169] [INFO ] [REMOTE ] BZH: Full fetch complete (47056 records). [2025-10-13T17:52:13.673282] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-13T17:52:14.037094] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-13T17:52:14.055370] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-13T17:52:14.055452] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-13T17:52:14.056111] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-13T17:52:14.056175] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-13T17:52:14.057381] [DEBUG] [LOCAL ] BZH: Trimmed 47056 records to 32456 (keeping 200 days of data) [2025-10-13T17:52:14.240593] [DEBUG] [LOCAL ] BZH: Primary data saved (32456 records). [2025-10-13T17:52:14.240759] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-13T17:52:14.240844] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 27.4s. Estimated remaining: 4h 33m 24s. Rate: 7.3 symbols/min [2025-10-13T17:52:14.411467] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:14.428221] [DEBUG] [LOCAL ] CABO: Loaded 17073 existing records from primary storage. [2025-10-13T17:52:14.428461] [INFO ] [MAIN ] CABO: Loaded 17073 existing records. [2025-10-13T17:52:14.603221] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:14.603450] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-13T17:52:14.603537] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-13T17:52:14.603782] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-13T17:52:14.603840] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-13T17:52:14.840137] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-13T17:52:14.963481] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:15.311537] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T17:52:15.607905] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T17:52:15.612783] [INFO ] [REMOTE ] BYD: Full fetch complete (65101 records). [2025-10-13T17:52:15.612888] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-13T17:52:15.624805] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-13T17:52:15.996329] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-13T17:52:15.996553] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-13T17:52:15.997442] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-13T17:52:15.997500] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-13T17:52:15.998954] [DEBUG] [LOCAL ] BYD: Trimmed 65101 records to 44846 (keeping 200 days of data) [2025-10-13T17:52:16.113043] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:52:16.288513] [DEBUG] [LOCAL ] BYD: Primary data saved (44846 records). [2025-10-13T17:52:16.288679] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-13T17:52:16.288774] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. BYD took 46.2s. Estimated remaining: 4h 32m 43s. Rate: 7.3 symbols/min [2025-10-13T17:52:16.427362] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-13T17:52:16.459302] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:16.481971] [DEBUG] [LOCAL ] CACI: Loaded 24045 existing records from primary storage. [2025-10-13T17:52:16.482213] [INFO ] [MAIN ] CACI: Loaded 24045 existing records. [2025-10-13T17:52:16.663106] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:16.663493] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-13T17:52:16.669873] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T17:52:16.669658] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-13T17:52:16.672723] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-13T17:52:16.672781] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-13T17:52:17.024222] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:17.217904] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-13T17:52:18.017886] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-13T17:52:18.423412] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:52:18.745636] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-13T17:52:18.820348] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-13T17:52:18.823473] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T17:52:19.617998] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-13T17:52:20.149179] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:52:20.257117] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:52:20.417916] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-13T17:52:21.217926] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-13T17:52:21.815057] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:52:22.017918] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-13T17:52:22.817900] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-13T17:52:22.939007] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T17:52:23.188470] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-13T17:52:23.617986] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-13T17:52:24.322270] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:52:24.417903] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-13T17:52:24.766992] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:52:25.218013] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-13T17:52:25.995071] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:52:26.018543] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T17:52:26.018688] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-13T17:52:26.817966] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-13T17:52:27.072823] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:52:27.617922] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-13T17:52:28.417928] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-13T17:52:28.844470] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:52:29.190181] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-13T17:52:29.217906] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-13T17:52:29.256443] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T17:52:30.017919] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-13T17:52:30.248750] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:52:30.753458] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T17:52:30.818035] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-13T17:52:31.617945] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-13T17:52:32.417973] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-13T17:52:32.735951] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T17:52:32.886277] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:52:33.217908] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-13T17:52:33.464697] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T17:52:34.017976] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-13T17:52:34.228917] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:52:34.817902] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-13T17:52:34.982097] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T17:52:35.617918] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-13T17:52:36.417906] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-13T17:52:36.857397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:52:37.002664] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T17:52:37.055349] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T17:52:37.217928] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-13T17:52:38.017896] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-13T17:52:38.390184] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:52:38.817918] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-13T17:52:39.086816] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T17:52:39.617903] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-13T17:52:39.821831] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T17:52:40.417909] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-13T17:52:40.575324] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T17:52:41.217927] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-13T17:52:42.017900] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-13T17:52:42.265513] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T17:52:42.483813] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T17:52:42.489326] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-13T17:52:42.489485] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-13T17:52:42.822991] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-13T17:52:42.904195] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-13T17:52:42.904370] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-13T17:52:42.905369] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-13T17:52:42.905461] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-13T17:52:42.907095] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-13T17:52:43.011156] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:52:43.015233] [INFO ] [REMOTE ] CACI: Full fetch complete (38318 records). [2025-10-13T17:52:43.016506] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-13T17:52:43.542030] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-13T17:52:43.542334] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-13T17:52:43.543161] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-13T17:52:43.543239] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-13T17:52:43.545948] [DEBUG] [LOCAL ] CACI: Trimmed 38318 records to 23367 (keeping 200 days of data) [2025-10-13T17:52:43.638358] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-13T17:52:43.783920] [DEBUG] [LOCAL ] CACI: Primary data saved (23367 records). [2025-10-13T17:52:43.792883] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-13T17:52:43.793617] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CACI took 27.5s. Estimated remaining: 4h 34m 15s. Rate: 7.3 symbols/min [2025-10-13T17:52:43.799835] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T17:52:43.830885] [INFO ] [REMOTE ] CABO: Full fetch complete (23127 records). [2025-10-13T17:52:43.846175] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-13T17:52:44.117616] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:44.235303] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-13T17:52:44.280429] [INFO ] [MAIN ] C: Full history saved. [2025-10-13T17:52:44.308450] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 47.4s. Estimated remaining: 4h 33m 27s. Rate: 7.3 symbols/min [2025-10-13T17:52:44.557933] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-13T17:52:44.564253] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-13T17:52:44.605080] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-13T17:52:44.606991] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-13T17:52:44.610203] [DEBUG] [LOCAL ] CADE: Loaded 49940 existing records from primary storage. [2025-10-13T17:52:44.611226] [INFO ] [MAIN ] CADE: Loaded 49940 existing records. [2025-10-13T17:52:44.606796] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:44.657423] [DEBUG] [LOCAL ] CABO: Trimmed 23127 records to 16807 (keeping 200 days of data) [2025-10-13T17:52:44.779915] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T17:52:44.868874] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-13T17:52:44.910463] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:44.913397] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-13T17:52:44.916311] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-13T17:52:44.920447] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-13T17:52:44.920884] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-13T17:52:45.044392] [DEBUG] [LOCAL ] CAE: Loaded 39779 existing records from primary storage. [2025-10-13T17:52:45.055737] [DEBUG] [LOCAL ] CABO: Primary data saved (16807 records). [2025-10-13T17:52:45.063847] [INFO ] [MAIN ] CAE: Loaded 39779 existing records. [2025-10-13T17:52:45.063094] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-13T17:52:45.080786] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CABO took 30.8s. Estimated remaining: 4h 32m 40s. Rate: 7.3 symbols/min [2025-10-13T17:52:45.662858] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:45.635900] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:45.722667] [DEBUG] [LOCAL ] CAF: Loaded 3477 existing records from primary storage. [2025-10-13T17:52:45.722864] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-13T17:52:45.726978] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:45.727615] [INFO ] [MAIN ] CAF: Loaded 3477 existing records. [2025-10-13T17:52:45.727803] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-13T17:52:45.728121] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-13T17:52:45.749087] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-13T17:52:45.760421] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-13T17:52:46.027458] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:46.027774] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-13T17:52:46.039768] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-13T17:52:46.050236] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-13T17:52:46.055468] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-13T17:52:46.531594] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:46.567177] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-13T17:52:46.569809] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:52:46.706925] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:46.817898] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-13T17:52:47.385524] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:52:47.518396] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T17:52:47.617901] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-13T17:52:47.809259] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:52:48.417918] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-13T17:52:49.217938] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-13T17:52:49.262680] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:52:49.865563] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:52:50.017933] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-13T17:52:50.306681] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:52:50.309719] [INFO ] [REMOTE ] CAAP: Full fetch complete (27792 records). [2025-10-13T17:52:50.309792] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-13T17:52:50.615600] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T17:52:50.690554] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-13T17:52:50.690630] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-13T17:52:50.691154] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-13T17:52:50.691202] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-13T17:52:50.691958] [DEBUG] [LOCAL ] CAAP: Trimmed 27792 records to 19758 (keeping 200 days of data) [2025-10-13T17:52:50.810538] [DEBUG] [LOCAL ] CAAP: Primary data saved (19758 records). [2025-10-13T17:52:50.810710] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-13T17:52:50.810804] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAAP took 39.5s. Estimated remaining: 4h 32m 18s. Rate: 7.3 symbols/min [2025-10-13T17:52:50.823084] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-13T17:52:50.983350] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:51.036519] [DEBUG] [LOCAL ] CAG: Loaded 54444 existing records from primary storage. [2025-10-13T17:52:51.036858] [INFO ] [MAIN ] CAG: Loaded 54444 existing records. [2025-10-13T17:52:51.209827] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:51.210075] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-13T17:52:51.210121] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-13T17:52:51.210757] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-13T17:52:51.210813] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-13T17:52:51.556579] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:51.617895] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-13T17:52:52.245601] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:52:52.417982] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-13T17:52:52.976687] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:52:53.166501] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T17:52:53.217888] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-13T17:52:54.017935] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-13T17:52:54.581277] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T17:52:54.817913] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-13T17:52:54.993054] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:52:55.416348] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:52:55.617924] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-13T17:52:56.199953] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T17:52:56.417948] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-13T17:52:56.899340] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T17:52:57.217905] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-13T17:52:58.017950] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-13T17:52:58.614595] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:52:58.817934] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-13T17:52:59.357627] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T17:52:59.617910] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-13T17:52:59.746248] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:53:00.417931] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-13T17:53:01.207236] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:53:01.217881] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-13T17:53:01.982670] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:53:02.017896] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-13T17:53:02.673048] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:53:02.817895] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-13T17:53:03.617896] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-13T17:53:03.789259] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T17:53:04.225533] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T17:53:04.417930] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-13T17:53:05.217904] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-13T17:53:05.576983] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:53:05.643633] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T17:53:06.017903] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-13T17:53:06.218224] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:53:06.592399] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:53:06.817920] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-13T17:53:07.617934] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-13T17:53:08.204899] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T17:53:08.206270] [INFO ] [REMOTE ] CAF: Full fetch complete (5592 records). [2025-10-13T17:53:08.206341] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-13T17:53:08.365283] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:53:08.427708] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-13T17:53:08.641045] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-13T17:53:08.641122] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-13T17:53:08.641272] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-13T17:53:08.641310] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-13T17:53:08.641690] [DEBUG] [LOCAL ] CAF: Trimmed 5592 records to 3452 (keeping 200 days of data) [2025-10-13T17:53:08.662684] [DEBUG] [LOCAL ] CAF: Primary data saved (3452 records). [2025-10-13T17:53:08.662767] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-13T17:53:08.662837] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAF took 23.5s. Estimated remaining: 4h 32m 60s. Rate: 7.3 symbols/min [2025-10-13T17:53:08.860487] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:08.913487] [DEBUG] [LOCAL ] CAH: Loaded 52215 existing records from primary storage. [2025-10-13T17:53:08.913827] [INFO ] [MAIN ] CAH: Loaded 52215 existing records. [2025-10-13T17:53:09.089428] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:09.089680] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-13T17:53:09.089739] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-13T17:53:09.090070] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-13T17:53:09.090127] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-13T17:53:09.228532] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-13T17:53:09.443370] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:10.017894] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-13T17:53:10.365898] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:53:10.817906] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-13T17:53:11.012188] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:53:11.618019] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-13T17:53:11.876914] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:53:12.349693] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:53:12.417899] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-13T17:53:13.189338] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:53:13.217886] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-13T17:53:13.483183] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:53:13.487589] [INFO ] [REMOTE ] CAE: Full fetch complete (56071 records). [2025-10-13T17:53:13.487772] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-13T17:53:13.871158] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-13T17:53:13.871264] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-13T17:53:13.871962] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-13T17:53:13.872024] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-13T17:53:13.873170] [DEBUG] [LOCAL ] CAE: Trimmed 56071 records to 39244 (keeping 200 days of data) [2025-10-13T17:53:14.032345] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-13T17:53:14.099221] [DEBUG] [LOCAL ] CAE: Primary data saved (39244 records). [2025-10-13T17:53:14.099364] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-13T17:53:14.099447] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 29.8s. Estimated remaining: 4h 32m 37s. Rate: 7.3 symbols/min [2025-10-13T17:53:14.286863] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:14.334697] [DEBUG] [LOCAL ] CAL: Loaded 43674 existing records from primary storage. [2025-10-13T17:53:14.335011] [INFO ] [MAIN ] CAL: Loaded 43674 existing records. [2025-10-13T17:53:14.542450] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:14.542756] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-13T17:53:14.542810] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-13T17:53:14.543138] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-13T17:53:14.543194] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-13T17:53:14.824704] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-13T17:53:14.947189] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:14.979164] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:53:15.386506] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:53:15.617930] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-13T17:53:16.417901] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-13T17:53:16.686357] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T17:53:17.217893] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-13T17:53:17.786785] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T17:53:18.017906] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-13T17:53:18.144299] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:53:18.442347] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:53:18.818017] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-13T17:53:19.617983] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-13T17:53:19.916990] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T17:53:20.418021] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-13T17:53:21.097698] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:53:21.217912] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-13T17:53:21.648581] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:53:22.018027] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-13T17:53:22.817992] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-13T17:53:23.246689] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T17:53:23.617983] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-13T17:53:23.754933] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T17:53:24.417924] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-13T17:53:24.744080] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T17:53:24.981079] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:53:25.196515] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (6.38 seconds). [2025-10-13T17:53:25.217880] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-13T17:53:25.760127] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:53:26.017971] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-13T17:53:26.336196] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T17:53:26.817935] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-13T17:53:27.617943] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-13T17:53:27.920174] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T17:53:28.417929] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-13T17:53:28.779538] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T17:53:28.785116] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-13T17:53:28.785465] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-13T17:53:29.186283] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-13T17:53:29.186409] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-13T17:53:29.187431] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-13T17:53:29.187518] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-13T17:53:29.189543] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53665 (keeping 200 days of data) [2025-10-13T17:53:29.267421] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-13T17:53:29.313771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:53:29.562893] [DEBUG] [LOCAL ] CAG: Primary data saved (53665 records). [2025-10-13T17:53:29.563041] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-13T17:53:29.563932] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 38.8s. Estimated remaining: 4h 33m 6s. Rate: 7.3 symbols/min [2025-10-13T17:53:29.732244] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:29.772081] [DEBUG] [LOCAL ] CALX: Loaded 38212 existing records from primary storage. [2025-10-13T17:53:29.772455] [INFO ] [MAIN ] CALX: Loaded 38212 existing records. [2025-10-13T17:53:29.949107] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:29.949387] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-13T17:53:29.949493] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-13T17:53:29.949749] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-13T17:53:29.949817] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-13T17:53:30.023076] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-13T17:53:30.247062] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:53:30.363057] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:30.817917] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-13T17:53:30.978525] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:53:31.617899] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-13T17:53:31.679980] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:53:31.688008] [INFO ] [REMOTE ] CADE: Full fetch complete (70173 records). [2025-10-13T17:53:31.688185] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-13T17:53:32.091383] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-13T17:53:32.091483] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-13T17:53:32.092381] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-13T17:53:32.092489] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-13T17:53:32.094604] [DEBUG] [LOCAL ] CADE: Trimmed 70173 records to 49361 (keeping 200 days of data) [2025-10-13T17:53:32.200436] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:53:32.416728] [DEBUG] [LOCAL ] CADE: Primary data saved (49361 records). [2025-10-13T17:53:32.416868] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-13T17:53:32.416950] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CADE took 48.6s. Estimated remaining: 4h 32m 30s. Rate: 7.3 symbols/min [2025-10-13T17:53:32.427765] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-13T17:53:32.586233] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:32.586419] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-13T17:53:32.586456] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-13T17:53:32.586564] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-13T17:53:32.586604] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-13T17:53:32.586675] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-13T17:53:32.586728] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-13T17:53:32.936100] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:33.217898] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-13T17:53:33.293383] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:53:33.318813] [DEBUG] [REMOTE ] CANG: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T17:53:33.319100] [WARN ] [REMOTE ] CANG: No data returned for month 2024-12 [2025-10-13T17:53:33.319191] [FATAL] [REMOTE ] CANG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:53:33.319266] [FATAL] [MAIN ] CANG: Failed to fetch primary data. [2025-10-13T17:53:33.319373] [WARN ] [MAIN ] CANG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:53:33.319446] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-13T17:53:33.319510] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-13T17:53:33.319546] [INFO ] [LOCAL ] CANG: Starting deletion of derivative data. [2025-10-13T17:53:33.319585] [DEBUG] [LOCAL ] CANG: No derivative data file found to delete. [2025-10-13T17:53:33.319635] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CANG took 0.9s. Estimated remaining: 4h 31m 44s. Rate: 7.3 symbols/min [2025-10-13T17:53:33.525176] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:33.532520] [DEBUG] [LOCAL ] CAPL: Loaded 5797 existing records from primary storage. [2025-10-13T17:53:33.532712] [INFO ] [MAIN ] CAPL: Loaded 5797 existing records. [2025-10-13T17:53:33.729407] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:33.729702] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-13T17:53:33.729758] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-13T17:53:33.729914] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-13T17:53:33.729994] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-13T17:53:34.017904] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-13T17:53:34.110307] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:34.105048] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:53:34.818032] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-13T17:53:35.617903] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-13T17:53:35.655711] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:53:36.417902] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-13T17:53:36.757828] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:53:37.003295] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:53:37.215803] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T17:53:37.218267] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-13T17:53:37.903773] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:53:38.017914] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-13T17:53:38.622929] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T17:53:38.817928] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-13T17:53:39.618020] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-13T17:53:40.245131] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T17:53:40.417926] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-13T17:53:40.621691] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:53:41.218021] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-13T17:53:41.898814] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T17:53:41.925012] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:53:42.017888] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-13T17:53:42.637453] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:53:42.817915] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-13T17:53:43.617930] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-13T17:53:44.417913] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-13T17:53:44.466778] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:53:45.217904] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-13T17:53:45.279555] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:53:46.017918] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-13T17:53:46.064123] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:53:46.069378] [INFO ] [REMOTE ] CAH: Full fetch complete (74589 records). [2025-10-13T17:53:46.069513] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-13T17:53:46.452823] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-13T17:53:46.452913] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-13T17:53:46.453808] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-13T17:53:46.453874] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-13T17:53:46.455347] [DEBUG] [LOCAL ] CAH: Trimmed 74589 records to 51475 (keeping 200 days of data) [2025-10-13T17:53:46.699995] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:53:46.819194] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-13T17:53:46.830717] [DEBUG] [LOCAL ] CAH: Primary data saved (51475 records). [2025-10-13T17:53:46.831197] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-13T17:53:46.831430] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CAH took 38.2s. Estimated remaining: 4h 32m 3s. Rate: 7.3 symbols/min [2025-10-13T17:53:47.006680] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:47.060618] [DEBUG] [LOCAL ] CARR: Loaded 54377 existing records from primary storage. [2025-10-13T17:53:47.061265] [INFO ] [MAIN ] CARR: Loaded 54377 existing records. [2025-10-13T17:53:47.250612] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:47.251082] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-13T17:53:47.251146] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-13T17:53:47.251534] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-13T17:53:47.251595] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-13T17:53:47.639149] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-13T17:53:47.646517] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:47.690421] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:53:48.263551] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:53:48.349523] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:53:48.417945] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-13T17:53:49.217926] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-13T17:53:49.732043] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T17:53:50.017911] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-13T17:53:50.302062] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:53:50.724229] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T17:53:50.817897] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-13T17:53:51.617921] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-13T17:53:52.417987] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-13T17:53:52.507270] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:53:52.924807] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T17:53:53.214589] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:53:53.223101] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-13T17:53:54.017947] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-13T17:53:54.817899] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-13T17:53:54.925506] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:53:55.425808] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T17:53:55.617890] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-13T17:53:56.284359] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:53:56.288818] [INFO ] [REMOTE ] CAL: Full fetch complete (61743 records). [2025-10-13T17:53:56.288915] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-13T17:53:56.429308] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-13T17:53:56.683937] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-13T17:53:56.684016] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-13T17:53:56.684792] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-13T17:53:56.684854] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-13T17:53:56.686062] [DEBUG] [LOCAL ] CAL: Trimmed 61743 records to 43025 (keeping 200 days of data) [2025-10-13T17:53:56.950417] [DEBUG] [LOCAL ] CAL: Primary data saved (43025 records). [2025-10-13T17:53:56.950555] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-13T17:53:56.950633] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAL took 42.9s. Estimated remaining: 4h 32m 4s. Rate: 7.3 symbols/min [2025-10-13T17:53:57.124692] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:57.160848] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:53:57.205948] [DEBUG] [LOCAL ] CARS: Loaded 40395 existing records from primary storage. [2025-10-13T17:53:57.206233] [INFO ] [MAIN ] CARS: Loaded 40395 existing records. [2025-10-13T17:53:57.226581] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-13T17:53:57.381594] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:57.381813] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-13T17:53:57.381858] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-13T17:53:57.382135] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-13T17:53:57.382194] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-13T17:53:57.726492] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:57.883969] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T17:53:57.885129] [INFO ] [REMOTE ] CAPL: Full fetch complete (8747 records). [2025-10-13T17:53:57.885200] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-13T17:53:58.018106] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-13T17:53:58.274774] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-13T17:53:58.274984] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-13T17:53:58.275443] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-13T17:53:58.275726] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-13T17:53:58.276253] [DEBUG] [LOCAL ] CAPL: Trimmed 8747 records to 5669 (keeping 200 days of data) [2025-10-13T17:53:58.340613] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:53:58.361182] [DEBUG] [LOCAL ] CAPL: Primary data saved (5669 records). [2025-10-13T17:53:58.361390] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-13T17:53:58.361500] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 25.0s. Estimated remaining: 4h 31m 21s. Rate: 7.3 symbols/min [2025-10-13T17:53:58.553540] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:58.605007] [DEBUG] [LOCAL ] CAT: Loaded 53689 existing records from primary storage. [2025-10-13T17:53:58.605470] [INFO ] [MAIN ] CAT: Loaded 53689 existing records. [2025-10-13T17:53:58.782634] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:58.782927] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-13T17:53:58.782976] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-13T17:53:58.783183] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-13T17:53:58.783221] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-13T17:53:58.824728] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-13T17:53:59.136436] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:59.525024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:53:59.617887] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-13T17:54:00.418027] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-13T17:54:00.728903] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T17:54:00.788625] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:54:01.218013] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-13T17:54:01.982450] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:54:02.017911] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-13T17:54:02.817943] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-13T17:54:03.071625] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:54:03.404879] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-13T17:54:03.618031] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-13T17:54:04.417901] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-13T17:54:04.602575] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:54:04.978866] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:54:04.982478] [INFO ] [REMOTE ] CALX: Full fetch complete (54013 records). [2025-10-13T17:54:04.982569] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-13T17:54:05.224145] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-13T17:54:05.358626] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-13T17:54:05.358734] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-13T17:54:05.359399] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-13T17:54:05.359438] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-13T17:54:05.360591] [DEBUG] [LOCAL ] CALX: Trimmed 54013 records to 37689 (keeping 200 days of data) [2025-10-13T17:54:05.575325] [DEBUG] [LOCAL ] CALX: Primary data saved (37689 records). [2025-10-13T17:54:05.575455] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-13T17:54:05.576118] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CALX took 36.0s. Estimated remaining: 4h 31m 8s. Rate: 7.3 symbols/min [2025-10-13T17:54:05.743128] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:05.752467] [DEBUG] [LOCAL ] CATO: Loaded 6958 existing records from primary storage. [2025-10-13T17:54:05.752743] [INFO ] [MAIN ] CATO: Loaded 6958 existing records. [2025-10-13T17:54:05.925567] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:05.925797] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-13T17:54:05.925845] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-13T17:54:05.926064] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-13T17:54:05.926119] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-13T17:54:06.022972] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-13T17:54:06.278966] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:06.492502] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T17:54:06.817902] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-13T17:54:07.150152] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:54:07.420780] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:54:07.618057] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-13T17:54:07.804587] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:54:08.418006] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-13T17:54:09.080984] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T17:54:09.109332] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:54:09.218001] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-13T17:54:10.017922] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-13T17:54:10.817986] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-13T17:54:11.207872] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:54:11.618104] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-13T17:54:11.761902] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:54:12.273343] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:54:12.417986] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-13T17:54:12.868141] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T17:54:13.217978] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-13T17:54:14.017939] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-13T17:54:14.056209] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:54:14.144245] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T17:54:14.817989] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-13T17:54:15.617922] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-13T17:54:16.230692] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:54:16.332058] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-13T17:54:16.417896] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-13T17:54:17.217993] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-13T17:54:17.609874] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T17:54:18.017936] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-13T17:54:18.602364] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T17:54:18.646696] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:54:18.671662] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:54:18.817985] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-13T17:54:19.434412] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:54:19.618040] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-13T17:54:20.276175] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T17:54:20.418006] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-13T17:54:21.217980] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-13T17:54:22.017996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-13T17:54:22.470826] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T17:54:22.635259] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T17:54:22.817981] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-13T17:54:22.945482] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T17:54:22.951528] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-13T17:54:22.951728] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-13T17:54:23.377990] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-13T17:54:23.378143] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-13T17:54:23.379278] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-13T17:54:23.379348] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-13T17:54:23.381479] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53602 (keeping 200 days of data) [2025-10-13T17:54:23.502320] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:54:23.639031] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-13T17:54:23.768130] [DEBUG] [LOCAL ] CARR: Primary data saved (53602 records). [2025-10-13T17:54:23.768341] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-13T17:54:23.768484] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 36.9s. Estimated remaining: 4h 31m 50s. Rate: 7.3 symbols/min [2025-10-13T17:54:23.946956] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:24.001549] [DEBUG] [LOCAL ] CAVA: Loaded 54334 existing records from primary storage. [2025-10-13T17:54:24.001968] [INFO ] [MAIN ] CAVA: Loaded 54334 existing records. [2025-10-13T17:54:24.184291] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:24.184605] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-13T17:54:24.184698] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-13T17:54:24.185125] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-13T17:54:24.185183] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-13T17:54:24.437343] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-13T17:54:24.473019] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:54:24.574724] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:25.217985] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-13T17:54:26.017926] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-13T17:54:26.150306] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:54:26.726677] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:54:26.728087] [INFO ] [REMOTE ] CATO: Full fetch complete (10967 records). [2025-10-13T17:54:26.728217] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-13T17:54:26.826721] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-13T17:54:27.129299] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-13T17:54:27.129402] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-13T17:54:27.129877] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-13T17:54:27.129959] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-13T17:54:27.130925] [DEBUG] [LOCAL ] CATO: Trimmed 10967 records to 6798 (keeping 200 days of data) [2025-10-13T17:54:27.171580] [DEBUG] [LOCAL ] CATO: Primary data saved (6798 records). [2025-10-13T17:54:27.171754] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-13T17:54:27.171916] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CATO took 21.6s. Estimated remaining: 4h 31m 17s. Rate: 7.3 symbols/min [2025-10-13T17:54:27.342952] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T17:54:27.409625] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:27.455334] [DEBUG] [LOCAL ] CB: Loaded 50652 existing records from primary storage. [2025-10-13T17:54:27.455636] [INFO ] [MAIN ] CB: Loaded 50652 existing records. [2025-10-13T17:54:27.624377] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-13T17:54:27.684295] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:27.684591] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-13T17:54:27.684668] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-13T17:54:27.684915] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-13T17:54:27.684954] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-13T17:54:28.039308] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:28.418029] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-13T17:54:28.725677] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T17:54:29.217921] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-13T17:54:29.778399] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-13T17:54:30.017980] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-13T17:54:30.130816] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T17:54:30.818006] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-13T17:54:31.230666] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T17:54:31.617917] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-13T17:54:31.773474] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:54:32.227875] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:54:32.417930] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-13T17:54:33.217919] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-13T17:54:33.540417] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T17:54:34.018013] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-13T17:54:34.591826] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-13T17:54:34.698591] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:54:34.817925] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-13T17:54:35.617905] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-13T17:54:35.887137] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T17:54:36.417894] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-13T17:54:36.857796] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T17:54:37.217930] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-13T17:54:37.674899] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T17:54:38.017906] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-13T17:54:38.345565] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T17:54:38.709783] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:54:38.715764] [INFO ] [REMOTE ] CARS: Full fetch complete (55880 records). [2025-10-13T17:54:38.715924] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-13T17:54:38.823058] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-13T17:54:39.145275] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-13T17:54:39.145364] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-13T17:54:39.146082] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-13T17:54:39.146143] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-13T17:54:39.147355] [DEBUG] [LOCAL ] CARS: Trimmed 55880 records to 39733 (keeping 200 days of data) [2025-10-13T17:54:39.375060] [DEBUG] [LOCAL ] CARS: Primary data saved (39733 records). [2025-10-13T17:54:39.375197] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-13T17:54:39.375275] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CARS took 42.4s. Estimated remaining: 4h 31m 29s. Rate: 7.3 symbols/min [2025-10-13T17:54:39.617914] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-13T17:54:40.176465] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-13T17:54:40.181859] [INFO ] [REMOTE ] CAT: Full fetch complete (76698 records). [2025-10-13T17:54:40.181971] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-13T17:54:40.641404] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-13T17:54:40.641518] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-13T17:54:40.642696] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-13T17:54:40.642784] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-13T17:54:40.654571] [DEBUG] [LOCAL ] CAT: Trimmed 76698 records to 52927 (keeping 200 days of data) [2025-10-13T17:54:40.673970] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T17:54:40.782925] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-13T17:54:41.050620] [DEBUG] [LOCAL ] CAT: Primary data saved (52927 records). [2025-10-13T17:54:41.050898] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-13T17:54:41.051087] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CAT took 42.7s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-10-13T17:54:41.747574] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T17:54:41.758862] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-13T17:54:42.700505] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:54:42.715218] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-13T17:54:43.773847] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T17:54:43.785905] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-13T17:54:44.008052] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:54:44.019558] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-13T17:54:45.726721] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:54:45.738178] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-13T17:54:45.775952] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:54:45.788699] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-13T17:54:47.863711] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-13T17:54:47.875423] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-13T17:54:48.016216] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T17:54:48.027482] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-13T17:54:49.372327] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:54:49.383875] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-13T17:54:49.956949] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T17:54:49.968547] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-13T17:54:50.925150] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:54:50.936202] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-13T17:54:52.035693] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T17:54:52.041192] [INFO ] [REMOTE ] CAVA: Full fetch complete (77335 records). [2025-10-13T17:54:52.041339] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-13T17:54:52.432147] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-13T17:54:52.432492] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-13T17:54:52.433396] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-13T17:54:52.433563] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-13T17:54:52.435742] [DEBUG] [LOCAL ] CAVA: Trimmed 77335 records to 53568 (keeping 200 days of data) [2025-10-13T17:54:52.755474] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:54:52.772058] [INFO ] [REMOTE ] CB: Full fetch complete (72533 records). [2025-10-13T17:54:52.776724] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-13T17:54:52.787177] [DEBUG] [LOCAL ] CAVA: Primary data saved (53568 records). [2025-10-13T17:54:52.787275] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-13T17:54:52.787393] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 29.0s. Estimated remaining: 4h 30m 57s. Rate: 7.3 symbols/min [2025-10-13T17:54:53.178575] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-13T17:54:53.178691] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-13T17:54:53.179586] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-13T17:54:53.179672] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-13T17:54:53.182222] [DEBUG] [LOCAL ] CB: Trimmed 72533 records to 49917 (keeping 200 days of data) [2025-10-13T17:54:53.504871] [DEBUG] [LOCAL ] CB: Primary data saved (49917 records). [2025-10-13T17:54:53.505021] [INFO ] [MAIN ] CB: Full history saved. [2025-10-13T17:54:53.505135] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 26.3s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-13T17:54:54.251685] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.168262] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.239309] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.257842] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.258436] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-13T17:54:54.260187] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-13T17:54:54.260425] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-13T17:54:54.260486] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-13T17:54:54.260532] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-13T17:54:54.260582] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-13T17:54:54.377627] [DEBUG] [LOCAL ] CBNA: Loaded 2931 existing records from primary storage. [2025-10-13T17:54:54.386090] [INFO ] [MAIN ] CBNA: Loaded 2931 existing records. [2025-10-13T17:54:54.392385] [DEBUG] [LOCAL ] CBAN: Loaded 10765 existing records from primary storage. [2025-10-13T17:54:54.413772] [DEBUG] [LOCAL ] CBL: Loaded 16498 existing records from primary storage. [2025-10-13T17:54:54.514470] [INFO ] [MAIN ] CBL: Loaded 16498 existing records. [2025-10-13T17:54:54.522414] [INFO ] [MAIN ] CBAN: Loaded 10765 existing records. [2025-10-13T17:54:54.983034] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.121731] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.177187] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-13T17:54:55.216045] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.209265] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:55.227436] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-13T17:54:55.230311] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-13T17:54:55.229779] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.246824] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-13T17:54:55.261804] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-13T17:54:55.292047] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-13T17:54:55.291946] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.306210] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-13T17:54:55.314495] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.363983] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-13T17:54:55.448242] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-13T17:54:55.453546] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-13T17:54:55.503338] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:54:55.592206] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-13T17:54:55.739137] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:54:55.815394] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-13T17:54:55.886086] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:54:55.977902] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-13T17:54:56.028691] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-13T17:54:56.043622] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-13T17:54:56.099703] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-13T17:54:56.194714] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.7s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-10-13T17:54:56.276880] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.287611] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-13T17:54:56.236713] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.309928] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-13T17:54:56.565523] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.598889] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-13T17:54:56.622329] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:56.681792] [DEBUG] [LOCAL ] CBRE: Loaded 51146 existing records from primary storage. [2025-10-13T17:54:56.682201] [INFO ] [MAIN ] CBRE: Loaded 51146 existing records. [2025-10-13T17:54:56.886782] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:56.887113] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-13T17:54:56.887167] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-13T17:54:56.887695] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-13T17:54:56.887756] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-13T17:54:56.997776] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T17:54:57.000444] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-13T17:54:57.280759] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:57.281129] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-13T17:54:57.431171] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:54:57.434520] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-13T17:54:57.551412] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:54:57.557264] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-13T17:54:57.610169] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:54:57.612034] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-13T17:54:58.151990] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T17:54:58.153552] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-13T17:54:58.220145] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T17:54:58.223546] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-13T17:54:58.405144] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:54:58.589929] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T17:54:58.817919] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-13T17:54:59.051295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T17:54:59.255986] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:54:59.291088] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T17:54:59.618003] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-13T17:55:00.417949] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-13T17:55:00.671076] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:55:00.957723] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:55:01.217979] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-13T17:55:02.017933] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-13T17:55:02.277768] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:55:02.817944] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-13T17:55:03.617922] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-13T17:55:03.625719] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:55:03.900166] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:55:04.418081] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-13T17:55:04.745910] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T17:55:04.893006] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T17:55:05.217938] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-13T17:55:06.017941] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-13T17:55:06.061486] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T17:55:06.817914] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-13T17:55:07.005725] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T17:55:07.617898] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-13T17:55:07.657553] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:55:08.417888] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-13T17:55:08.692611] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T17:55:09.151987] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:55:09.217907] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-13T17:55:10.017890] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-13T17:55:10.207055] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:55:10.643679] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:55:10.817904] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-13T17:55:11.273363] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T17:55:11.617935] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-13T17:55:12.417973] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-13T17:55:13.214985] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T17:55:13.218731] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-13T17:55:13.325774] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:55:13.870188] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T17:55:14.018035] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-13T17:55:14.817943] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-13T17:55:15.012157] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:55:15.373726] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:55:15.617938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-13T17:55:16.417934] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-13T17:55:17.133421] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T17:55:17.217905] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-13T17:55:17.283948] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:55:18.017900] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-13T17:55:18.207485] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:55:18.209856] [INFO ] [REMOTE ] CBL: Full fetch complete (25269 records). [2025-10-13T17:55:18.209928] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-13T17:55:18.566194] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-13T17:55:18.566271] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-13T17:55:18.566702] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-13T17:55:18.566763] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-13T17:55:18.567661] [DEBUG] [LOCAL ] CBL: Trimmed 25269 records to 16249 (keeping 200 days of data) [2025-10-13T17:55:18.670184] [DEBUG] [LOCAL ] CBL: Primary data saved (16249 records). [2025-10-13T17:55:18.670323] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-13T17:55:18.670418] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 25.1s. Estimated remaining: 4h 30m 38s. Rate: 7.3 symbols/min [2025-10-13T17:55:18.840426] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:18.836717] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-13T17:55:18.849159] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:55:18.882947] [DEBUG] [LOCAL ] CBT: Loaded 31283 existing records from primary storage. [2025-10-13T17:55:18.883219] [INFO ] [MAIN ] CBT: Loaded 31283 existing records. [2025-10-13T17:55:19.055394] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:19.055619] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-13T17:55:19.055695] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-13T17:55:19.056037] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-13T17:55:19.056094] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-13T17:55:19.330629] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T17:55:19.352212] [INFO ] [REMOTE ] CBNA: Full fetch complete (4440 records). [2025-10-13T17:55:19.380922] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-13T17:55:19.477339] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:19.624043] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-13T17:55:19.779009] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-13T17:55:19.779090] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-13T17:55:19.779250] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-13T17:55:19.779289] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-13T17:55:19.779711] [DEBUG] [LOCAL ] CBNA: Trimmed 4440 records to 2916 (keeping 200 days of data) [2025-10-13T17:55:19.798148] [DEBUG] [LOCAL ] CBNA: Primary data saved (2916 records). [2025-10-13T17:55:19.798235] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-13T17:55:19.798316] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBNA took 26.3s. Estimated remaining: 4h 29m 55s. Rate: 7.3 symbols/min [2025-10-13T17:55:19.975786] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:19.975949] [DEBUG] [LOCAL ] CBU: No existing data file found in primary storage. [2025-10-13T17:55:19.975987] [WARN ] [MAIN ] CBU: No existing data found, performing full refresh instead. [2025-10-13T17:55:19.976131] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-13T17:55:19.976210] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-13T17:55:19.976281] [DEBUG] [LOCAL ] CBU: No primary data file found to delete. [2025-10-13T17:55:19.976317] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-13T17:55:20.339051] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:20.417905] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-13T17:55:20.464254] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:55:20.465573] [INFO ] [REMOTE ] CBAN: Full fetch complete (16104 records). [2025-10-13T17:55:20.465638] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-13T17:55:20.839885] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-13T17:55:20.839965] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-13T17:55:20.840311] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-13T17:55:20.840350] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-13T17:55:20.840862] [DEBUG] [LOCAL ] CBAN: Trimmed 16104 records to 10523 (keeping 200 days of data) [2025-10-13T17:55:20.903512] [DEBUG] [LOCAL ] CBAN: Primary data saved (10523 records). [2025-10-13T17:55:20.903673] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-13T17:55:20.903774] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBAN took 27.4s. Estimated remaining: 4h 29m 12s. Rate: 7.3 symbols/min [2025-10-13T17:55:21.066662] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:21.066851] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-13T17:55:21.066889] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-13T17:55:21.066999] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-13T17:55:21.067039] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-13T17:55:21.067078] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-13T17:55:21.067109] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-13T17:55:21.243564] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-13T17:55:21.428177] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:21.728579] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:55:22.017932] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-13T17:55:22.817942] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-13T17:55:23.134520] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:55:23.395548] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:55:23.617907] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-13T17:55:23.634965] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T17:55:24.417924] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-13T17:55:25.217985] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-13T17:55:25.447044] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:55:25.447387] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-13T17:55:25.447491] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:55:25.447585] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-13T17:55:25.447695] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:55:25.447787] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-13T17:55:25.447866] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-13T17:55:25.447905] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-13T17:55:25.447946] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-13T17:55:25.448183] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBX took 4.5s. Estimated remaining: 4h 28m 46s. Rate: 7.3 symbols/min [2025-10-13T17:55:25.607381] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:55:25.645379] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:25.680033] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T17:55:25.724028] [DEBUG] [LOCAL ] CBZ: Loaded 34491 existing records from primary storage. [2025-10-13T17:55:25.724422] [INFO ] [MAIN ] CBZ: Loaded 34491 existing records. [2025-10-13T17:55:25.908100] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:25.908402] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-13T17:55:25.908473] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-13T17:55:25.908989] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-13T17:55:25.909046] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-13T17:55:26.023117] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-13T17:55:26.280948] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:26.817947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-13T17:55:27.617943] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-13T17:55:27.863027] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:55:28.118481] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:55:28.417949] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-13T17:55:28.619267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T17:55:29.218061] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-13T17:55:29.961258] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:55:30.017947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-13T17:55:30.411618] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T17:55:30.817934] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-13T17:55:30.958343] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:55:31.617940] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-13T17:55:32.131297] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:55:32.418006] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-13T17:55:33.129965] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:55:33.217922] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-13T17:55:33.619404] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T17:55:34.017947] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-13T17:55:34.817985] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-13T17:55:34.847465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T17:55:35.348683] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:55:35.617890] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-13T17:55:35.987481] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T17:55:36.417981] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-13T17:55:36.840224] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-13T17:55:37.217980] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-13T17:55:37.584279] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T17:55:38.018016] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-13T17:55:38.202267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:55:38.817903] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-13T17:55:39.053364] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:55:39.618011] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-13T17:55:40.170180] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:55:40.417919] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-13T17:55:41.014205] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T17:55:41.217927] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-13T17:55:41.743270] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T17:55:42.017934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-13T17:55:42.817909] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-13T17:55:42.877182] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:55:42.882208] [INFO ] [REMOTE ] CBRE: Full fetch complete (73720 records). [2025-10-13T17:55:42.882319] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-13T17:55:43.281124] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-13T17:55:43.281215] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-13T17:55:43.282055] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-13T17:55:43.282118] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-13T17:55:43.283603] [DEBUG] [LOCAL ] CBRE: Trimmed 73720 records to 50384 (keeping 200 days of data) [2025-10-13T17:55:43.523520] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:55:43.619834] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-13T17:55:43.626038] [DEBUG] [LOCAL ] CBRE: Primary data saved (50384 records). [2025-10-13T17:55:43.627309] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-13T17:55:43.627413] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 47.4s. Estimated remaining: 4h 29m 26s. Rate: 7.3 symbols/min [2025-10-13T17:55:43.810236] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:43.862309] [DEBUG] [LOCAL ] CC: Loaded 53769 existing records from primary storage. [2025-10-13T17:55:43.862622] [INFO ] [MAIN ] CC: Loaded 53769 existing records. [2025-10-13T17:55:44.050154] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:44.050745] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-13T17:55:44.050882] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-13T17:55:44.051630] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-13T17:55:44.051738] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-13T17:55:44.379056] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:55:44.426539] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-13T17:55:44.452107] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:45.013337] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:55:45.217888] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-13T17:55:45.541221] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:55:46.017931] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-13T17:55:46.817934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-13T17:55:47.033125] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T17:55:47.307505] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T17:55:47.617922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-13T17:55:47.840433] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T17:55:47.844344] [INFO ] [REMOTE ] CBZ: Full fetch complete (45755 records). [2025-10-13T17:55:47.844455] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-13T17:55:48.257189] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-13T17:55:48.257281] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-13T17:55:48.257942] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-13T17:55:48.258038] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-13T17:55:48.259257] [DEBUG] [LOCAL ] CBZ: Trimmed 45755 records to 34102 (keeping 200 days of data) [2025-10-13T17:55:48.419027] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-13T17:55:48.469951] [DEBUG] [LOCAL ] CBZ: Primary data saved (34102 records). [2025-10-13T17:55:48.470103] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-13T17:55:48.470185] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 23.0s. Estimated remaining: 4h 29m 1s. Rate: 7.3 symbols/min [2025-10-13T17:55:48.644744] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:48.697529] [DEBUG] [LOCAL ] CCI: Loaded 53905 existing records from primary storage. [2025-10-13T17:55:48.697917] [INFO ] [MAIN ] CCI: Loaded 53905 existing records. [2025-10-13T17:55:48.887430] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:48.887695] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-13T17:55:48.887752] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-13T17:55:48.888164] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-13T17:55:48.888223] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-13T17:55:49.220241] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-13T17:55:49.242211] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:55:49.296533] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:50.018089] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-13T17:55:50.026207] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:55:50.105257] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:55:50.818026] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-13T17:55:51.617908] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-13T17:55:51.897627] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:55:51.994332] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:55:52.417977] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-13T17:55:53.228063] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-13T17:55:53.233422] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:55:53.524596] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T17:55:54.018040] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-13T17:55:54.817979] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-13T17:55:55.151109] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:55:55.154816] [INFO ] [REMOTE ] CBU: Full fetch complete (32386 records). [2025-10-13T17:55:55.154999] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-13T17:55:55.501029] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-13T17:55:55.622409] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-13T17:55:55.622837] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-13T17:55:55.622930] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-13T17:55:55.623787] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-13T17:55:55.623884] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-13T17:55:55.625886] [DEBUG] [LOCAL ] CBU: Trimmed 32386 records to 22651 (keeping 200 days of data) [2025-10-13T17:55:55.786461] [DEBUG] [LOCAL ] CBU: Primary data saved (22651 records). [2025-10-13T17:55:55.786602] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-13T17:55:55.786696] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBU took 36.0s. Estimated remaining: 4h 28m 49s. Rate: 7.3 symbols/min [2025-10-13T17:55:55.979970] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:55.980149] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-13T17:55:55.980190] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-13T17:55:55.980303] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-13T17:55:55.980344] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-13T17:55:55.980395] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-13T17:55:55.980454] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-13T17:55:56.360660] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:55:56.397548] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:56.417882] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-13T17:55:57.218022] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-13T17:55:57.398764] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T17:55:57.648296] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:55:57.665606] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-13T17:55:58.018012] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-13T17:55:58.817948] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-13T17:55:59.617909] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-13T17:55:59.712698] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:56:00.051918] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:56:00.417900] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-13T17:56:00.947697] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T17:56:01.217912] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-13T17:56:01.901147] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:56:01.905324] [INFO ] [REMOTE ] CBT: Full fetch complete (45525 records). [2025-10-13T17:56:01.905490] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-13T17:56:02.023173] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-13T17:56:02.317477] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-13T17:56:02.317566] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-13T17:56:02.318543] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-13T17:56:02.318638] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-13T17:56:02.320185] [DEBUG] [LOCAL ] CBT: Trimmed 45525 records to 30960 (keeping 200 days of data) [2025-10-13T17:56:02.515918] [DEBUG] [LOCAL ] CBT: Primary data saved (30960 records). [2025-10-13T17:56:02.516069] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-13T17:56:02.516151] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBT took 43.8s. Estimated remaining: 4h 28m 34s. Rate: 7.3 symbols/min [2025-10-13T17:56:02.686458] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:02.701979] [DEBUG] [LOCAL ] CCIF: Loaded 15808 existing records from primary storage. [2025-10-13T17:56:02.702192] [INFO ] [MAIN ] CCIF: Loaded 15808 existing records. [2025-10-13T17:56:02.821245] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-13T17:56:02.888619] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:02.889734] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-13T17:56:02.889845] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-13T17:56:02.890190] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-13T17:56:02.890366] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-13T17:56:03.226794] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T17:56:03.318552] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:03.321634] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:56:03.617993] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-13T17:56:03.981282] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:56:04.417944] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-13T17:56:05.217983] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-13T17:56:05.311848] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T17:56:05.412927] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T17:56:05.483530] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-13T17:56:06.017920] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-13T17:56:06.776699] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T17:56:06.817879] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-13T17:56:07.617900] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-13T17:56:07.654889] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T17:56:08.417912] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-13T17:56:09.217918] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-13T17:56:09.363752] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T17:56:09.364946] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:56:10.017931] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-13T17:56:10.788987] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:56:10.817894] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-13T17:56:11.034770] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T17:56:11.617914] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-13T17:56:11.658511] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:56:12.417927] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-13T17:56:13.218021] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-13T17:56:13.237837] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:56:13.656826] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T17:56:14.017981] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-13T17:56:14.817900] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-13T17:56:15.068186] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:56:15.617915] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-13T17:56:15.742460] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:56:15.914151] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:56:16.103065] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:56:16.418051] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-13T17:56:16.892630] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T17:56:17.217923] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-13T17:56:18.017944] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-13T17:56:18.817987] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-13T17:56:18.912753] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:56:19.618026] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-13T17:56:19.844414] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:56:19.878226] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T17:56:20.417894] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-13T17:56:21.217886] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-13T17:56:21.385544] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:56:21.499389] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:56:21.505017] [INFO ] [REMOTE ] CCI: Full fetch complete (76977 records). [2025-10-13T17:56:21.505151] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-13T17:56:21.900077] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-13T17:56:21.900169] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-13T17:56:21.901033] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-13T17:56:21.901143] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-13T17:56:21.902678] [DEBUG] [LOCAL ] CCI: Trimmed 76977 records to 53123 (keeping 200 days of data) [2025-10-13T17:56:22.018189] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-13T17:56:22.235560] [DEBUG] [LOCAL ] CCI: Primary data saved (53123 records). [2025-10-13T17:56:22.235723] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-13T17:56:22.235836] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 33.8s. Estimated remaining: 4h 29m 20s. Rate: 7.3 symbols/min [2025-10-13T17:56:22.393004] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-13T17:56:22.415938] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:22.463985] [DEBUG] [LOCAL ] CCJ: Loaded 54455 existing records from primary storage. [2025-10-13T17:56:22.464325] [INFO ] [MAIN ] CCJ: Loaded 54455 existing records. [2025-10-13T17:56:22.652959] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:22.653222] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-13T17:56:22.653270] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-13T17:56:22.653619] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-13T17:56:22.653711] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-13T17:56:22.821289] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-13T17:56:23.042191] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:23.092469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T17:56:23.237198] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T17:56:23.617942] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-13T17:56:24.417945] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-13T17:56:24.896571] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T17:56:25.217991] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-13T17:56:25.727509] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T17:56:26.017925] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-13T17:56:26.817933] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-13T17:56:27.109469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:56:27.618005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-13T17:56:28.053014] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T17:56:28.079992] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:56:28.082079] [INFO ] [REMOTE ] CCIF: Full fetch complete (21876 records). [2025-10-13T17:56:28.082157] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-13T17:56:28.167895] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T17:56:28.423230] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-13T17:56:28.465955] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-13T17:56:28.466032] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-13T17:56:28.466458] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-13T17:56:28.466497] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-13T17:56:28.467183] [DEBUG] [LOCAL ] CCIF: Trimmed 21876 records to 15647 (keeping 200 days of data) [2025-10-13T17:56:28.558547] [DEBUG] [LOCAL ] CCIF: Primary data saved (15647 records). [2025-10-13T17:56:28.558746] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-13T17:56:28.558850] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 26.0s. Estimated remaining: 4h 29m 3s. Rate: 7.3 symbols/min [2025-10-13T17:56:28.731333] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:28.731532] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-10-13T17:56:28.731570] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-10-13T17:56:28.731707] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-13T17:56:28.731760] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-13T17:56:28.731803] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-13T17:56:28.731836] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-13T17:56:29.092558] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:29.217990] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-13T17:56:30.018151] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-13T17:56:30.369128] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T17:56:30.579340] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:56:30.580165] [INFO ] [REMOTE ] CCIA: Full fetch complete (2164 records). [2025-10-13T17:56:30.580234] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-13T17:56:30.754553] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T17:56:30.754773] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:56:30.754823] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:56:30.754862] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-13T17:56:30.754918] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-13T17:56:30.754955] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-13T17:56:30.754994] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-13T17:56:30.755048] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIA took 35.0s. Estimated remaining: 4h 28m 26s. Rate: 7.3 symbols/min [2025-10-13T17:56:30.827543] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-13T17:56:30.927083] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:30.977204] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-13T17:56:30.977511] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-10-13T17:56:31.153462] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:31.153709] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-13T17:56:31.158952] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-13T17:56:31.166729] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-13T17:56:31.167471] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-13T17:56:31.201117] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T17:56:31.275363] [INFO ] [REMOTE ] CC: Full fetch complete (75768 records). [2025-10-13T17:56:31.278220] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-13T17:56:31.636539] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-13T17:56:31.770728] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:31.924030] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-13T17:56:31.924109] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-13T17:56:31.924920] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-13T17:56:31.924982] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-13T17:56:31.926429] [DEBUG] [LOCAL ] CC: Trimmed 75768 records to 52999 (keeping 200 days of data) [2025-10-13T17:56:32.238669] [DEBUG] [LOCAL ] CC: Primary data saved (52999 records). [2025-10-13T17:56:32.238806] [INFO ] [MAIN ] CC: Full history saved. [2025-10-13T17:56:32.239569] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CC took 48.6s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-13T17:56:32.407936] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:32.418013] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-13T17:56:32.458077] [DEBUG] [LOCAL ] CCO: Loaded 48697 existing records from primary storage. [2025-10-13T17:56:32.458396] [INFO ] [MAIN ] CCO: Loaded 48697 existing records. [2025-10-13T17:56:32.641834] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:32.642254] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-13T17:56:32.642375] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-13T17:56:32.642855] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-13T17:56:32.642912] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-13T17:56:33.035625] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T17:56:33.033826] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:33.217894] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-13T17:56:33.489621] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:56:34.017921] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-13T17:56:34.826388] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-13T17:56:34.831855] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-13T17:56:35.063568] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:56:35.593313] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:56:35.617933] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-13T17:56:36.190583] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T17:56:36.417937] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-13T17:56:37.217926] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-13T17:56:37.927462] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T17:56:37.926429] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-13T17:56:38.017890] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-13T17:56:38.817948] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-13T17:56:39.139386] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T17:56:39.178892] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T17:56:39.617929] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-13T17:56:40.417922] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-13T17:56:40.836906] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-13T17:56:41.217998] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-13T17:56:41.673445] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-13T17:56:42.017942] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-13T17:56:42.131183] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:56:42.817931] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-13T17:56:43.623745] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-13T17:56:43.630513] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-13T17:56:44.200099] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:56:44.303234] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T17:56:44.417895] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-13T17:56:45.217888] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-13T17:56:45.391260] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:56:46.017906] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-13T17:56:46.509770] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T17:56:46.775863] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:56:46.817878] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-13T17:56:47.617890] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-13T17:56:47.662878] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:56:48.177737] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:56:48.417908] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-13T17:56:49.217926] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-13T17:56:50.006585] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-13T17:56:50.017943] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-13T17:56:50.088508] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:56:50.817936] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-13T17:56:51.581807] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-13T17:56:51.617897] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-13T17:56:51.968030] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T17:56:51.973451] [INFO ] [REMOTE ] CCJ: Full fetch complete (77687 records). [2025-10-13T17:56:51.973601] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-13T17:56:52.367115] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-13T17:56:52.367502] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-13T17:56:52.368416] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-13T17:56:52.368482] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-13T17:56:52.369953] [DEBUG] [LOCAL ] CCJ: Trimmed 77687 records to 53684 (keeping 200 days of data) [2025-10-13T17:56:52.418630] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-13T17:56:52.609496] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T17:56:52.729058] [DEBUG] [LOCAL ] CCJ: Primary data saved (53684 records). [2025-10-13T17:56:52.729200] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-13T17:56:52.729320] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCJ took 30.5s. Estimated remaining: 4h 28m 36s. Rate: 7.3 symbols/min [2025-10-13T17:56:52.895707] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:52.905223] [DEBUG] [LOCAL ] CCRD: Loaded 9338 existing records from primary storage. [2025-10-13T17:56:52.905406] [INFO ] [MAIN ] CCRD: Loaded 9338 existing records. [2025-10-13T17:56:53.079092] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:53.079346] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-13T17:56:53.079394] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-13T17:56:53.079780] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-13T17:56:53.079890] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-13T17:56:53.221791] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-13T17:56:53.440428] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:53.944045] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T17:56:54.017909] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-13T17:56:54.106493] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:56:54.817905] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-13T17:56:54.922084] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T17:56:55.617980] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-13T17:56:55.756301] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:56:56.205310] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-13T17:56:56.418053] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-13T17:56:57.133377] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T17:56:57.152101] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T17:56:57.217896] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-13T17:56:58.018002] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-13T17:56:58.675956] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:56:58.762799] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:56:58.768362] [INFO ] [REMOTE ] CCO: Full fetch complete (66830 records). [2025-10-13T17:56:58.768515] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-13T17:56:58.823639] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-13T17:56:59.164284] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-13T17:56:59.164371] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-13T17:56:59.165252] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-13T17:56:59.165317] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-13T17:56:59.166840] [DEBUG] [LOCAL ] CCO: Trimmed 66830 records to 48214 (keeping 200 days of data) [2025-10-13T17:56:59.451615] [DEBUG] [LOCAL ] CCO: Primary data saved (48214 records). [2025-10-13T17:56:59.451854] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-13T17:56:59.452946] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 27.2s. Estimated remaining: 4h 28m 20s. Rate: 7.3 symbols/min [2025-10-13T17:56:59.619522] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-13T17:56:59.641371] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:59.684674] [DEBUG] [LOCAL ] CCS: Loaded 30681 existing records from primary storage. [2025-10-13T17:56:59.685074] [INFO ] [MAIN ] CCS: Loaded 30681 existing records. [2025-10-13T17:56:59.871351] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:59.871787] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-13T17:56:59.871844] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-13T17:56:59.872699] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-13T17:56:59.872761] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-13T17:57:00.238367] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:00.244855] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T17:57:00.418006] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-13T17:57:00.955052] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T17:57:01.217935] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-13T17:57:01.382535] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T17:57:02.017941] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-13T17:57:02.687200] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:57:02.817901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-13T17:57:03.617992] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-13T17:57:04.417998] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-13T17:57:04.480781] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-13T17:57:04.562006] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T17:57:04.823883] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T17:57:04.892082] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:57:05.217927] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-13T17:57:06.018028] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-13T17:57:06.605289] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T17:57:06.817916] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-13T17:57:06.971855] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:57:07.617995] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-13T17:57:08.012188] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:57:08.417929] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-13T17:57:09.217901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-13T17:57:09.281428] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T17:57:09.583788] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:57:10.018015] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-13T17:57:10.456623] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T17:57:10.818026] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-13T17:57:11.289495] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:57:11.617929] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-13T17:57:12.417925] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-13T17:57:12.923191] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:57:12.928939] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-13T17:57:12.929100] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-13T17:57:13.229271] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-13T17:57:13.331204] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-13T17:57:13.331333] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-13T17:57:13.332254] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-13T17:57:13.332330] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-13T17:57:13.334277] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-13T17:57:13.363895] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:57:13.696861] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-13T17:57:13.697100] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-13T17:57:13.697206] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 42.9s. Estimated remaining: 4h 28m 40s. Rate: 7.3 symbols/min [2025-10-13T17:57:13.882609] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:13.904230] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:57:13.934136] [DEBUG] [LOCAL ] CCU: Loaded 23079 existing records from primary storage. [2025-10-13T17:57:13.934407] [INFO ] [MAIN ] CCU: Loaded 23079 existing records. [2025-10-13T17:57:14.023067] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-13T17:57:14.114046] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:14.114452] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-13T17:57:14.114514] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-13T17:57:14.114734] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-13T17:57:14.114790] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-13T17:57:14.213845] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:57:14.483243] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:14.817900] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-13T17:57:15.617918] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-13T17:57:15.671950] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:57:15.679831] [INFO ] [REMOTE ] CCK: Full fetch complete (67547 records). [2025-10-13T17:57:15.679946] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-13T17:57:16.093225] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-13T17:57:16.095095] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-13T17:57:16.096065] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-13T17:57:16.096705] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-13T17:57:16.097263] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T17:57:16.103674] [DEBUG] [LOCAL ] CCK: Trimmed 67547 records to 46359 (keeping 200 days of data) [2025-10-13T17:57:16.398609] [DEBUG] [LOCAL ] CCK: Primary data saved (46359 records). [2025-10-13T17:57:16.398837] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-13T17:57:16.399048] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCK took 47.8s. Estimated remaining: 4h 28m 6s. Rate: 7.3 symbols/min [2025-10-13T17:57:16.426840] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:57:16.426488] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-13T17:57:16.582889] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:16.583094] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-13T17:57:16.583132] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-13T17:57:16.583252] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-13T17:57:16.583314] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-13T17:57:16.583356] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-13T17:57:16.583386] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-13T17:57:16.927732] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:17.217929] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-13T17:57:17.861225] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T17:57:18.017929] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-13T17:57:18.118002] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T17:57:18.120852] [INFO ] [REMOTE ] CCRD: Full fetch complete (11833 records). [2025-10-13T17:57:18.120950] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-13T17:57:18.504252] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-13T17:57:18.504350] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-13T17:57:18.504734] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-13T17:57:18.504805] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-13T17:57:18.505428] [DEBUG] [LOCAL ] CCRD: Trimmed 11833 records to 9386 (keeping 200 days of data) [2025-10-13T17:57:18.572474] [DEBUG] [LOCAL ] CCRD: Primary data saved (9386 records). [2025-10-13T17:57:18.572624] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-13T17:57:18.572741] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCRD took 25.8s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-13T17:57:18.742599] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:18.793856] [DEBUG] [LOCAL ] CDE: Loaded 54422 existing records from primary storage. [2025-10-13T17:57:18.794193] [INFO ] [MAIN ] CDE: Loaded 54422 existing records. [2025-10-13T17:57:18.824345] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-13T17:57:18.972237] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:18.972457] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-13T17:57:18.972503] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-13T17:57:18.973995] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-13T17:57:18.974053] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-13T17:57:19.325733] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:19.343952] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:57:19.617908] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-13T17:57:19.836973] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:57:20.417927] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-13T17:57:20.938029] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:57:21.217941] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-13T17:57:21.611363] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-13T17:57:22.017900] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-13T17:57:22.258989] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:57:22.654450] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:57:22.817931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-13T17:57:23.617897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-13T17:57:24.054313] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T17:57:24.417929] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-13T17:57:24.666814] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-13T17:57:25.217890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-13T17:57:25.407088] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:57:26.017925] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-13T17:57:26.529185] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:57:26.817931] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-13T17:57:27.617903] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-13T17:57:27.691564] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T17:57:28.161909] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:57:28.418008] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-13T17:57:28.713416] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:57:29.217928] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-13T17:57:29.488438] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-13T17:57:30.017933] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-13T17:57:30.347611] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T17:57:30.817944] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-13T17:57:31.136597] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:57:31.618011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-13T17:57:32.417924] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-13T17:57:32.794436] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-13T17:57:32.923632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T17:57:32.943591] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T17:57:32.946469] [INFO ] [REMOTE ] CCS: Full fetch complete (44631 records). [2025-10-13T17:57:32.946695] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-13T17:57:32.947316] [FATAL] [VALIDATOR ] CCS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:57:32.947414] [FATAL] [MAIN ] CCS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:57:32.947486] [WARN ] [MAIN ] CCS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:57:32.947572] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-13T17:57:32.947676] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-13T17:57:32.947747] [INFO ] [LOCAL ] CCS: Starting deletion of derivative data. [2025-10-13T17:57:32.947981] [DEBUG] [LOCAL ] CCS: Deleted derivative data file. [2025-10-13T17:57:32.948801] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 33.5s. Estimated remaining: 4h 27m 50s. Rate: 7.3 symbols/min [2025-10-13T17:57:33.116451] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:33.129317] [DEBUG] [LOCAL ] CDLR: Loaded 10107 existing records from primary storage. [2025-10-13T17:57:33.129542] [INFO ] [MAIN ] CDLR: Loaded 10107 existing records. [2025-10-13T17:57:33.224107] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-13T17:57:33.305452] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:33.305728] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-13T17:57:33.305781] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-13T17:57:33.305921] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-13T17:57:33.305958] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-13T17:57:33.653220] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:34.017987] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-13T17:57:34.318816] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T17:57:34.817917] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-13T17:57:34.852263] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:57:35.617921] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-13T17:57:36.224735] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:57:36.417890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-13T17:57:36.984172] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T17:57:37.217932] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-13T17:57:37.390847] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:57:37.544280] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T17:57:38.017985] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-13T17:57:38.786625] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T17:57:38.817877] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-13T17:57:39.617941] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-13T17:57:39.872877] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-13T17:57:39.907194] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T17:57:40.417926] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-13T17:57:41.217984] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-13T17:57:41.467072] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:57:41.469383] [INFO ] [REMOTE ] CCU: Full fetch complete (32361 records). [2025-10-13T17:57:41.469474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-13T17:57:41.842917] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-13T17:57:41.843038] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-13T17:57:41.843533] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-13T17:57:41.843595] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-13T17:57:41.844317] [DEBUG] [LOCAL ] CCU: Trimmed 32361 records to 22590 (keeping 200 days of data) [2025-10-13T17:57:41.989764] [DEBUG] [LOCAL ] CCU: Primary data saved (22590 records). [2025-10-13T17:57:41.989967] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-13T17:57:41.990112] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 28.3s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-13T17:57:42.023045] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-13T17:57:42.171501] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:42.211844] [DEBUG] [LOCAL ] CDP: Loaded 43086 existing records from primary storage. [2025-10-13T17:57:42.212211] [INFO ] [MAIN ] CDP: Loaded 43086 existing records. [2025-10-13T17:57:42.361765] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:57:42.394052] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-13T17:57:42.401884] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:57:42.401795] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:42.402247] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-13T17:57:42.402118] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-13T17:57:42.402453] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-13T17:57:42.402389] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:57:42.402636] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-13T17:57:42.402773] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-13T17:57:42.402828] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-13T17:57:42.402878] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-13T17:57:42.402931] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CCZ took 26.0s. Estimated remaining: 4h 27m 1s. Rate: 7.3 symbols/min [2025-10-13T17:57:42.408428] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-13T17:57:42.408539] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-13T17:57:42.822169] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-13T17:57:42.822048] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:43.003258] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:43.013431] [DEBUG] [LOCAL ] CDRE: Loaded 25069 existing records from primary storage. [2025-10-13T17:57:43.013724] [INFO ] [MAIN ] CDRE: Loaded 25069 existing records. [2025-10-13T17:57:43.193717] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:43.194074] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-13T17:57:43.194152] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-13T17:57:43.194525] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-13T17:57:43.194583] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-13T17:57:43.474248] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-13T17:57:43.525406] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:57:43.629124] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-13T17:57:43.634182] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:44.417916] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-13T17:57:45.217911] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-13T17:57:45.295517] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:57:46.017907] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-13T17:57:46.079159] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T17:57:46.406699] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:57:46.817923] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-13T17:57:47.518149] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T17:57:47.617949] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-13T17:57:47.954460] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:57:48.417929] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-13T17:57:49.116500] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:57:49.217886] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-13T17:57:49.343693] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T17:57:50.017923] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-13T17:57:50.817934] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-13T17:57:50.872001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:57:51.109927] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:57:51.617905] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-13T17:57:51.961968] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T17:57:52.351848] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:57:52.417888] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-13T17:57:53.180463] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:57:53.217942] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-13T17:57:54.017897] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-13T17:57:54.035421] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:57:54.818018] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-13T17:57:55.121320] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:57:55.617971] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-13T17:57:56.417910] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-13T17:57:56.631074] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:57:56.866172] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:57:57.217904] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-13T17:57:57.243314] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:57:58.017931] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-13T17:57:58.786341] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T17:57:58.829575] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-13T17:57:58.834719] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:57:59.617993] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-13T17:57:59.896757] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:58:00.384119] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T17:58:00.417885] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-13T17:58:01.207004] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T17:58:01.208962] [INFO ] [REMOTE ] CDLR: Full fetch complete (13698 records). [2025-10-13T17:58:01.209039] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-13T17:58:01.223090] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-13T17:58:01.568570] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-13T17:58:01.568673] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-13T17:58:01.568996] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-13T17:58:01.569037] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-13T17:58:01.569570] [DEBUG] [LOCAL ] CDLR: Trimmed 13698 records to 9992 (keeping 200 days of data) [2025-10-13T17:58:01.629318] [DEBUG] [LOCAL ] CDLR: Primary data saved (9992 records). [2025-10-13T17:58:01.629456] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-13T17:58:01.629536] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDLR took 28.7s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-13T17:58:01.794814] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:01.855769] [DEBUG] [LOCAL ] CE: Loaded 52193 existing records from primary storage. [2025-10-13T17:58:01.856100] [INFO ] [MAIN ] CE: Loaded 52193 existing records. [2025-10-13T17:58:02.018029] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-13T17:58:02.038395] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:02.039780] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-13T17:58:02.039833] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-13T17:58:02.040886] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-13T17:58:02.040947] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-13T17:58:02.405806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:58:02.424441] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:02.817984] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-13T17:58:03.617937] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-13T17:58:04.007878] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:58:04.127843] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T17:58:04.417927] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-13T17:58:04.779705] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:58:05.217895] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-13T17:58:05.379934] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T17:58:06.017939] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-13T17:58:06.817940] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-13T17:58:07.253013] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T17:58:07.256235] [INFO ] [REMOTE ] CDRE: Full fetch complete (35111 records). [2025-10-13T17:58:07.256341] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-13T17:58:07.623089] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-13T17:58:07.669915] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-13T17:58:07.670018] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-13T17:58:07.670790] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-13T17:58:07.671137] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-13T17:58:07.672810] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-13T17:58:07.685000] [DEBUG] [LOCAL ] CDRE: Trimmed 35111 records to 24847 (keeping 200 days of data) [2025-10-13T17:58:07.835010] [DEBUG] [LOCAL ] CDRE: Primary data saved (24847 records). [2025-10-13T17:58:07.835149] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-13T17:58:07.835234] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDRE took 25.4s. Estimated remaining: 4h 27m 26s. Rate: 7.3 symbols/min [2025-10-13T17:58:08.006921] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:08.013758] [DEBUG] [LOCAL ] CEE: Loaded 5690 existing records from primary storage. [2025-10-13T17:58:08.013907] [INFO ] [MAIN ] CEE: Loaded 5690 existing records. [2025-10-13T17:58:08.194007] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:08.194283] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-13T17:58:08.194360] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-13T17:58:08.194680] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-13T17:58:08.194797] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-13T17:58:08.449328] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-13T17:58:08.465524] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:58:08.585493] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:09.217920] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-13T17:58:09.654837] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:58:10.018020] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-13T17:58:10.424953] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T17:58:10.430472] [INFO ] [REMOTE ] CDE: Full fetch complete (77599 records). [2025-10-13T17:58:10.430600] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-13T17:58:10.822506] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-13T17:58:10.868431] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:58:10.866441] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-13T17:58:10.877452] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-13T17:58:10.878490] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-13T17:58:10.878580] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-13T17:58:10.880560] [DEBUG] [LOCAL ] CDE: Trimmed 77599 records to 53643 (keeping 200 days of data) [2025-10-13T17:58:11.191861] [DEBUG] [LOCAL ] CDE: Primary data saved (53643 records). [2025-10-13T17:58:11.191999] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-13T17:58:11.192079] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDE took 52.6s. Estimated remaining: 4h 26m 55s. Rate: 7.3 symbols/min [2025-10-13T17:58:11.362406] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:11.387599] [DEBUG] [LOCAL ] CEPU: Loaded 26570 existing records from primary storage. [2025-10-13T17:58:11.388001] [INFO ] [MAIN ] CEPU: Loaded 26570 existing records. [2025-10-13T17:58:11.506086] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T17:58:11.577431] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:11.577786] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-13T17:58:11.577896] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-13T17:58:11.578727] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-13T17:58:11.578787] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-13T17:58:11.620929] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-13T17:58:11.963311] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:11.965765] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T17:58:12.417897] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-13T17:58:13.227430] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-13T17:58:13.232545] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:58:13.979790] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:58:14.017890] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-13T17:58:14.616786] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:58:14.817931] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-13T17:58:15.430918] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:58:15.617908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-13T17:58:16.032833] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T17:58:16.417921] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-13T17:58:17.137888] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:58:17.143041] [INFO ] [REMOTE ] CDP: Full fetch complete (61720 records). [2025-10-13T17:58:17.143211] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-13T17:58:17.223069] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-13T17:58:17.541631] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-13T17:58:17.541740] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-13T17:58:17.542427] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-13T17:58:17.542466] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-13T17:58:17.543703] [DEBUG] [LOCAL ] CDP: Trimmed 61720 records to 42558 (keeping 200 days of data) [2025-10-13T17:58:17.828377] [DEBUG] [LOCAL ] CDP: Primary data saved (42558 records). [2025-10-13T17:58:17.828519] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-13T17:58:17.828607] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDP took 35.8s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-13T17:58:18.030560] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-13T17:58:18.035195] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:18.091342] [DEBUG] [LOCAL ] CF: Loaded 52873 existing records from primary storage. [2025-10-13T17:58:18.091833] [INFO ] [MAIN ] CF: Loaded 52873 existing records. [2025-10-13T17:58:18.287795] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:18.288317] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-13T17:58:18.288395] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-13T17:58:18.300692] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-13T17:58:18.318917] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-13T17:58:18.378784] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:58:18.707927] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:18.726855] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:58:18.742454] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:58:18.817904] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-13T17:58:19.617994] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-13T17:58:20.417989] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-13T17:58:20.715407] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T17:58:21.217910] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-13T17:58:21.497832] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T17:58:21.523279] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T17:58:22.017929] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-13T17:58:22.825537] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-13T17:58:22.844417] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:58:23.052553] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T17:58:23.617979] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-13T17:58:23.758620] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T17:58:24.418008] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-13T17:58:24.783013] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T17:58:25.217977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-13T17:58:25.993330] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:58:26.029700] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-13T17:58:26.035664] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:58:26.817905] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-13T17:58:27.085716] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:58:27.617939] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-13T17:58:28.424150] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-13T17:58:28.430230] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:58:29.043435] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:58:29.217885] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-13T17:58:29.395359] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:58:30.017934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-13T17:58:30.635944] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T17:58:30.817923] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-13T17:58:31.060526] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T17:58:31.617917] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-13T17:58:32.417899] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-13T17:58:32.598891] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:58:32.811932] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:58:33.066307] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:58:33.217887] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-13T17:58:34.017922] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-13T17:58:34.817916] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-13T17:58:34.953613] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:58:35.625156] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-13T17:58:35.631973] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:58:35.660413] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T17:58:36.417924] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-13T17:58:37.217936] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-13T17:58:37.351398] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:58:37.911169] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:58:38.017902] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-13T17:58:38.036550] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:58:38.041915] [INFO ] [REMOTE ] CE: Full fetch complete (74758 records). [2025-10-13T17:58:38.042044] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-13T17:58:38.492507] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-13T17:58:38.492623] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-13T17:58:38.493812] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-13T17:58:38.493890] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-13T17:58:38.495696] [DEBUG] [LOCAL ] CE: Trimmed 74758 records to 51411 (keeping 200 days of data) [2025-10-13T17:58:38.822295] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-13T17:58:38.846788] [DEBUG] [LOCAL ] CE: Primary data saved (51411 records). [2025-10-13T17:58:38.846988] [INFO ] [MAIN ] CE: Full history saved. [2025-10-13T17:58:38.847797] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CE took 37.2s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-13T17:58:39.020220] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:39.020404] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-10-13T17:58:39.020458] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-10-13T17:58:39.020565] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-13T17:58:39.020607] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-13T17:58:39.020675] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-13T17:58:39.020728] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-13T17:58:39.378241] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:39.408097] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:58:39.617892] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-13T17:58:39.903500] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T17:58:40.200800] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T17:58:40.201821] [INFO ] [REMOTE ] CEE: Full fetch complete (10144 records). [2025-10-13T17:58:40.201889] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-13T17:58:40.423849] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-13T17:58:40.578081] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-13T17:58:40.578158] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-13T17:58:40.578403] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-13T17:58:40.578443] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-13T17:58:40.578894] [DEBUG] [LOCAL ] CEE: Trimmed 10144 records to 5436 (keeping 200 days of data) [2025-10-13T17:58:40.611470] [DEBUG] [LOCAL ] CEE: Primary data saved (5436 records). [2025-10-13T17:58:40.611595] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-13T17:58:40.611699] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEE took 32.8s. Estimated remaining: 4h 26m 52s. Rate: 7.3 symbols/min [2025-10-13T17:58:40.786452] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:40.786628] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-13T17:58:40.786700] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-13T17:58:40.786820] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-13T17:58:40.786884] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-13T17:58:40.786928] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-13T17:58:40.786962] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-13T17:58:41.163359] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:41.217933] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-13T17:58:41.970145] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T17:58:42.017895] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-13T17:58:42.817913] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-13T17:58:42.901680] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T17:58:43.617911] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-13T17:58:43.763891] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:58:43.820291] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T17:58:44.417915] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-13T17:58:45.217899] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-13T17:58:45.538230] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:58:46.017900] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-13T17:58:46.158002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:58:46.217421] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T17:58:46.238248] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:58:46.238586] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-13T17:58:46.238716] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:58:46.238805] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-13T17:58:46.238873] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:58:46.238944] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-13T17:58:46.239080] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-13T17:58:46.239123] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-13T17:58:46.239164] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-13T17:58:46.239257] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 5.6s. Estimated remaining: 4h 26m 32s. Rate: 7.3 symbols/min [2025-10-13T17:58:46.407468] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:46.442930] [DEBUG] [LOCAL ] CFR: Loaded 33311 existing records from primary storage. [2025-10-13T17:58:46.443221] [INFO ] [MAIN ] CFR: Loaded 33311 existing records. [2025-10-13T17:58:46.615302] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:46.615490] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-13T17:58:46.615537] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-13T17:58:46.616132] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-13T17:58:46.616198] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-13T17:58:46.823125] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-13T17:58:46.986054] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:47.617915] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-13T17:58:48.176678] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:58:48.417943] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-13T17:58:49.168891] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T17:58:49.174481] [INFO ] [REMOTE ] CF: Full fetch complete (75245 records). [2025-10-13T17:58:49.174638] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-13T17:58:49.223074] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-13T17:58:49.564016] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-13T17:58:49.564103] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-13T17:58:49.564987] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-13T17:58:49.565052] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-13T17:58:49.566978] [DEBUG] [LOCAL ] CF: Trimmed 75245 records to 52116 (keeping 200 days of data) [2025-10-13T17:58:49.912967] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:58:49.934205] [DEBUG] [LOCAL ] CF: Primary data saved (52116 records). [2025-10-13T17:58:49.934738] [INFO ] [MAIN ] CF: Full history saved. [2025-10-13T17:58:49.934866] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 32.1s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-13T17:58:50.026925] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-13T17:58:50.108348] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:50.148177] [DEBUG] [LOCAL ] CGAU: Loaded 43834 existing records from primary storage. [2025-10-13T17:58:50.148477] [INFO ] [MAIN ] CGAU: Loaded 43834 existing records. [2025-10-13T17:58:50.330022] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:50.330238] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-13T17:58:50.330285] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-13T17:58:50.331286] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-13T17:58:50.331348] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-13T17:58:50.708449] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:50.725965] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:58:50.817918] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-13T17:58:51.618031] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-13T17:58:51.677662] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T17:58:52.185096] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:58:52.417934] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-13T17:58:52.813525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:58:53.217937] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-13T17:58:53.453248] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T17:58:54.017929] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-13T17:58:54.694969] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:58:54.700320] [INFO ] [REMOTE ] CEPU: Full fetch complete (39558 records). [2025-10-13T17:58:54.700583] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-13T17:58:54.823102] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-13T17:58:55.172544] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-13T17:58:55.172695] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-13T17:58:55.174131] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-13T17:58:55.174206] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-13T17:58:55.175774] [DEBUG] [LOCAL ] CEPU: Trimmed 39558 records to 26365 (keeping 200 days of data) [2025-10-13T17:58:55.352348] [DEBUG] [LOCAL ] CEPU: Primary data saved (26365 records). [2025-10-13T17:58:55.352557] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-13T17:58:55.352696] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CEPU took 44.2s. Estimated remaining: 4h 25m 43s. Rate: 7.3 symbols/min [2025-10-13T17:58:55.542234] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:55.568748] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T17:58:55.567673] [DEBUG] [LOCAL ] CGV: Loaded 1406 existing records from primary storage. [2025-10-13T17:58:55.576242] [INFO ] [MAIN ] CGV: Loaded 1406 existing records. [2025-10-13T17:58:55.626956] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-13T17:58:55.770020] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:55.770246] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-13T17:58:55.770292] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-13T17:58:55.770458] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-13T17:58:55.770513] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-13T17:58:56.119850] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:56.288797] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:58:56.417974] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-13T17:58:56.956124] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T17:58:57.217943] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-13T17:58:57.283011] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:58:58.017927] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-13T17:58:58.449433] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:58:58.817907] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-13T17:58:58.857277] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:58:59.401077] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:58:59.617925] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-13T17:59:00.417947] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-13T17:59:01.217997] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-13T17:59:01.466365] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:59:01.642866] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T17:59:01.883274] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:59:02.017981] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-13T17:59:02.817939] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-13T17:59:03.338006] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:59:03.589523] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:59:03.617887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-13T17:59:04.417920] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-13T17:59:04.912251] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T17:59:05.218008] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-13T17:59:05.564723] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:59:06.017988] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-13T17:59:06.603794] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:59:06.817906] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-13T17:59:07.355357] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:59:07.358340] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:59:07.617935] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-13T17:59:08.417916] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-13T17:59:08.920352] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T17:59:09.218002] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-13T17:59:09.704216] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T17:59:10.017937] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-13T17:59:10.592164] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T17:59:10.612587] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:59:10.817988] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-13T17:59:11.617945] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-13T17:59:12.417939] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-13T17:59:12.663197] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:59:13.012453] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:59:13.217924] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-13T17:59:14.018003] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-13T17:59:14.068666] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:59:14.817914] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-13T17:59:15.111089] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:59:15.141921] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:59:15.617938] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-13T17:59:16.212790] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:59:16.417916] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-13T17:59:17.163822] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T17:59:17.169350] [INFO ] [REMOTE ] CFG: Full fetch complete (77579 records). [2025-10-13T17:59:17.169478] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-13T17:59:17.224069] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-13T17:59:17.600525] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-13T17:59:17.600618] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-13T17:59:17.601481] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-13T17:59:17.601547] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-13T17:59:17.603284] [DEBUG] [LOCAL ] CFG: Trimmed 77579 records to 53622 (keeping 200 days of data) [2025-10-13T17:59:17.869278] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T17:59:17.959302] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-13T17:59:17.959472] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-13T17:59:17.959553] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFG took 39.1s. Estimated remaining: 4h 26m 39s. Rate: 7.3 symbols/min [2025-10-13T17:59:18.024860] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-13T17:59:18.176176] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:18.173084] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T17:59:18.209095] [DEBUG] [LOCAL ] CHCT: Loaded 24273 existing records from primary storage. [2025-10-13T17:59:18.209372] [INFO ] [MAIN ] CHCT: Loaded 24273 existing records. [2025-10-13T17:59:18.391072] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:18.391325] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-13T17:59:18.391372] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-13T17:59:18.391581] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-13T17:59:18.391637] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-13T17:59:18.757300] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:18.817931] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-13T17:59:19.450416] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:59:19.453575] [INFO ] [REMOTE ] CFR: Full fetch complete (48173 records). [2025-10-13T17:59:19.453681] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-13T17:59:19.632751] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-13T17:59:19.868989] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-13T17:59:19.869119] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-13T17:59:19.869787] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-13T17:59:19.869856] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-13T17:59:19.870976] [DEBUG] [LOCAL ] CFR: Trimmed 48173 records to 32698 (keeping 200 days of data) [2025-10-13T17:59:20.091716] [DEBUG] [LOCAL ] CFR: Primary data saved (32698 records). [2025-10-13T17:59:20.091906] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-13T17:59:20.092001] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CFR took 33.9s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-13T17:59:20.259365] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:20.308365] [DEBUG] [LOCAL ] CHD: Loaded 52964 existing records from primary storage. [2025-10-13T17:59:20.308703] [INFO ] [MAIN ] CHD: Loaded 52964 existing records. [2025-10-13T17:59:20.423052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-13T17:59:20.494150] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:20.507306] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-13T17:59:20.507919] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:59:20.508226] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-13T17:59:20.513487] [INFO ] [REMOTE ] CGAU: Full fetch complete (60800 records). [2025-10-13T17:59:20.513618] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-13T17:59:20.513685] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-13T17:59:20.513959] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-13T17:59:20.519842] [FATAL] [VALIDATOR ] CGAU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:59:20.534820] [FATAL] [MAIN ] CGAU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:59:20.592531] [WARN ] [MAIN ] CGAU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:59:20.603623] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-13T17:59:20.615875] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-13T17:59:20.624188] [INFO ] [LOCAL ] CGAU: Starting deletion of derivative data. [2025-10-13T17:59:20.627129] [DEBUG] [LOCAL ] CGAU: Deleted derivative data file. [2025-10-13T17:59:20.627310] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGAU took 30.7s. Estimated remaining: 4h 25m 21s. Rate: 7.3 symbols/min [2025-10-13T17:59:20.991159] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:20.991340] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T17:59:21.127736] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:21.145517] [DEBUG] [LOCAL ] CHE: Loaded 15536 existing records from primary storage. [2025-10-13T17:59:21.147246] [INFO ] [MAIN ] CHE: Loaded 15536 existing records. [2025-10-13T17:59:21.146923] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:59:21.223052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-13T17:59:21.343792] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:21.344100] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-13T17:59:21.344154] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-13T17:59:21.344441] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-13T17:59:21.344501] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-13T17:59:21.714856] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T17:59:21.729599] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:22.017916] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-13T17:59:22.817941] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-13T17:59:23.139558] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:59:23.617932] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-13T17:59:24.414288] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T17:59:24.424052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-13T17:59:24.690841] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:59:24.846910] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T17:59:24.848111] [INFO ] [REMOTE ] CGV: Full fetch complete (2273 records). [2025-10-13T17:59:24.848208] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-13T17:59:25.205973] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-13T17:59:25.206062] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-13T17:59:25.206178] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-13T17:59:25.206217] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-13T17:59:25.206548] [DEBUG] [LOCAL ] CGV: Trimmed 2273 records to 1391 (keeping 200 days of data) [2025-10-13T17:59:25.215525] [DEBUG] [LOCAL ] CGV: Primary data saved (1391 records). [2025-10-13T17:59:25.215609] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-13T17:59:25.215720] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CGV took 29.9s. Estimated remaining: 4h 24m 56s. Rate: 7.3 symbols/min [2025-10-13T17:59:25.225788] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-13T17:59:25.386790] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:25.433627] [DEBUG] [LOCAL ] CHGG: Loaded 48509 existing records from primary storage. [2025-10-13T17:59:25.434024] [INFO ] [MAIN ] CHGG: Loaded 48509 existing records. [2025-10-13T17:59:25.607591] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:25.607821] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-13T17:59:25.607867] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-13T17:59:25.608181] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-13T17:59:25.608238] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-13T17:59:25.959496] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:26.017931] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-13T17:59:26.220260] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:59:26.817940] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-13T17:59:27.617979] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-13T17:59:27.683170] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T17:59:27.912677] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T17:59:28.417913] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-13T17:59:28.677976] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:59:29.217919] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-13T17:59:29.981162] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:59:30.017918] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-13T17:59:30.102079] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:59:30.817899] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-13T17:59:30.955198] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:59:31.617930] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-13T17:59:32.417920] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-13T17:59:32.540933] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T17:59:32.954435] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:59:33.217922] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-13T17:59:34.024192] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-13T17:59:34.041291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:59:34.103048] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T17:59:34.818037] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-13T17:59:35.116457] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T17:59:35.617928] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-13T17:59:36.417976] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-13T17:59:36.753886] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:59:36.777063] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:59:37.127592] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:59:37.217921] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-13T17:59:38.017925] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-13T17:59:38.817891] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-13T17:59:38.903728] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:59:38.971849] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:59:39.617945] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-13T17:59:40.417908] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-13T17:59:40.662304] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T17:59:41.217902] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-13T17:59:41.472849] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:59:41.637901] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:59:42.017903] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-13T17:59:42.035393] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:59:42.817890] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-13T17:59:43.208882] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:59:43.617925] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-13T17:59:44.377261] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:59:44.417880] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-13T17:59:44.541188] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:59:45.217913] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-13T17:59:46.017896] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-13T17:59:46.049659] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:59:46.817912] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-13T17:59:46.920539] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T17:59:46.985216] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T17:59:47.617902] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-13T17:59:47.670880] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:59:48.417910] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-13T17:59:49.217924] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-13T17:59:49.399249] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:59:49.417021] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T17:59:49.420420] [INFO ] [REMOTE ] CHCT: Full fetch complete (34709 records). [2025-10-13T17:59:49.420519] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-13T17:59:49.787325] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-13T17:59:49.787400] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-13T17:59:49.787894] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-13T17:59:49.787971] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-13T17:59:49.788746] [DEBUG] [LOCAL ] CHCT: Trimmed 34709 records to 24096 (keeping 200 days of data) [2025-10-13T17:59:49.934717] [DEBUG] [LOCAL ] CHCT: Primary data saved (24096 records). [2025-10-13T17:59:49.934862] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-13T17:59:49.934967] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHCT took 32.0s. Estimated remaining: 4h 26m 2s. Rate: 7.3 symbols/min [2025-10-13T17:59:50.023334] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-13T17:59:50.104954] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:50.136367] [DEBUG] [LOCAL ] CHH: Loaded 32827 existing records from primary storage. [2025-10-13T17:59:50.136626] [INFO ] [MAIN ] CHH: Loaded 32827 existing records. [2025-10-13T17:59:50.311229] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:50.311444] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-13T17:59:50.311491] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-13T17:59:50.311782] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-13T17:59:50.311846] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-13T17:59:50.665446] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:50.817945] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-13T17:59:50.940778] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:59:51.191829] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T17:59:51.193994] [INFO ] [REMOTE ] CHE: Full fetch complete (20239 records). [2025-10-13T17:59:51.194064] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-13T17:59:51.557797] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-13T17:59:51.557888] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-13T17:59:51.558296] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-13T17:59:51.558355] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-13T17:59:51.558996] [DEBUG] [LOCAL ] CHE: Trimmed 20239 records to 15364 (keeping 200 days of data) [2025-10-13T17:59:51.631412] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-13T17:59:51.660460] [DEBUG] [LOCAL ] CHE: Primary data saved (15364 records). [2025-10-13T17:59:51.660554] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-13T17:59:51.660627] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHE took 31.0s. Estimated remaining: 4h 25m 25s. Rate: 7.3 symbols/min [2025-10-13T17:59:51.830350] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:51.849564] [DEBUG] [LOCAL ] CHMI: Loaded 21964 existing records from primary storage. [2025-10-13T17:59:51.849858] [INFO ] [MAIN ] CHMI: Loaded 21964 existing records. [2025-10-13T17:59:52.027099] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:52.027313] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-13T17:59:52.027358] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-13T17:59:52.027555] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-13T17:59:52.027610] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-13T17:59:52.406804] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:52.417882] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-13T17:59:52.582608] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T17:59:53.217969] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-13T17:59:53.510273] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:59:53.651503] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:59:54.017924] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-13T17:59:54.527473] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:59:54.817938] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-13T17:59:55.081069] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:59:55.617929] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-13T17:59:55.901739] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:59:56.418004] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-13T17:59:57.217914] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-13T17:59:57.458435] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T17:59:58.017946] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-13T17:59:58.343161] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T17:59:58.395401] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:59:58.817936] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-13T17:59:59.367635] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:59:59.617906] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-13T18:00:00.133053] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:00:00.418069] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-13T18:00:00.642143] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T18:00:01.217989] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-13T18:00:02.018030] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-13T18:00:02.401567] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T18:00:02.817943] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-13T18:00:03.111828] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:00:03.405896] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T18:00:03.618028] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-13T18:00:04.417924] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-13T18:00:04.722323] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:00:05.218035] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-13T18:00:05.760523] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-13T18:00:05.766582] [INFO ] [REMOTE ] CHD: Full fetch complete (74513 records). [2025-10-13T18:00:05.766778] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-13T18:00:06.018433] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-13T18:00:06.146879] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:00:06.200905] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-13T18:00:06.201019] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-13T18:00:06.201906] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-13T18:00:06.201971] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-13T18:00:06.203480] [DEBUG] [LOCAL ] CHD: Trimmed 74513 records to 52293 (keeping 200 days of data) [2025-10-13T18:00:06.524832] [DEBUG] [LOCAL ] CHD: Primary data saved (52293 records). [2025-10-13T18:00:06.524981] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-13T18:00:06.525063] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 46.4s. Estimated remaining: 4h 25m 46s. Rate: 7.3 symbols/min [2025-10-13T18:00:06.818063] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-13T18:00:07.123544] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T18:00:07.128636] [INFO ] [REMOTE ] CHGG: Full fetch complete (70302 records). [2025-10-13T18:00:07.128777] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-13T18:00:07.480482] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:00:07.624134] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-13T18:00:07.625165] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-13T18:00:07.625327] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-13T18:00:07.626494] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-13T18:00:07.627460] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-13T18:00:07.629613] [DEBUG] [LOCAL ] CHGG: Trimmed 70302 records to 47763 (keeping 200 days of data) [2025-10-13T18:00:07.947436] [DEBUG] [LOCAL ] CHGG: Primary data saved (47763 records). [2025-10-13T18:00:07.947688] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-13T18:00:07.947797] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 42.7s. Estimated remaining: 4h 25m 7s. Rate: 7.3 symbols/min [2025-10-13T18:00:08.272631] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:00:08.417989] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-13T18:00:08.809949] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:00:09.217919] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-13T18:00:09.706257] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:00:10.017925] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-13T18:00:10.494622] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:00:10.818003] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-13T18:00:11.279795] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:00:11.617886] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-13T18:00:11.856179] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:00:12.417997] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-13T18:00:12.678619] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:00:13.217910] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-13T18:00:13.943498] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:00:14.017890] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-13T18:00:15.354986] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:00:15.357430] [INFO ] [REMOTE ] CHMI: Full fetch complete (31769 records). [2025-10-13T18:00:15.357505] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-13T18:00:15.721560] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-13T18:00:15.721680] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-13T18:00:15.722177] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-13T18:00:15.722220] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-13T18:00:15.723184] [DEBUG] [LOCAL ] CHMI: Trimmed 31769 records to 21617 (keeping 200 days of data) [2025-10-13T18:00:15.849855] [DEBUG] [LOCAL ] CHMI: Primary data saved (21617 records). [2025-10-13T18:00:15.849998] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-13T18:00:15.850082] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHMI took 24.2s. Estimated remaining: 4h 24m 58s. Rate: 7.3 symbols/min [2025-10-13T18:00:17.647567] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (4.43 seconds). [2025-10-13T18:00:17.651327] [INFO ] [REMOTE ] CHH: Full fetch complete (46980 records). [2025-10-13T18:00:17.651458] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-13T18:00:17.652174] [FATAL] [VALIDATOR ] CHH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:00:17.652263] [FATAL] [MAIN ] CHH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:00:17.652306] [WARN ] [MAIN ] CHH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:00:17.652344] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-13T18:00:17.652399] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-13T18:00:17.652433] [INFO ] [LOCAL ] CHH: Starting deletion of derivative data. [2025-10-13T18:00:17.652621] [DEBUG] [LOCAL ] CHH: Deleted derivative data file. [2025-10-13T18:00:17.653441] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHH took 27.7s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-13T18:00:18.347664] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.328168] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.404138] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.427022] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.432711] [DEBUG] [LOCAL ] CHN: Loaded 4832 existing records from primary storage. [2025-10-13T18:00:18.433004] [INFO ] [MAIN ] CHN: Loaded 4832 existing records. [2025-10-13T18:00:18.551551] [DEBUG] [LOCAL ] CHT: Loaded 19798 existing records from primary storage. [2025-10-13T18:00:18.590350] [INFO ] [MAIN ] CHT: Loaded 19798 existing records. [2025-10-13T18:00:18.700518] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:18.722481] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-13T18:00:18.786493] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-13T18:00:18.797879] [DEBUG] [LOCAL ] CHPT: Loaded 48725 existing records from primary storage. [2025-10-13T18:00:18.810092] [DEBUG] [LOCAL ] CHWY: Loaded 54433 existing records from primary storage. [2025-10-13T18:00:18.815560] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-13T18:00:18.808806] [INFO ] [MAIN ] CHPT: Loaded 48725 existing records. [2025-10-13T18:00:18.830792] [INFO ] [MAIN ] CHWY: Loaded 54433 existing records. [2025-10-13T18:00:18.895914] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-13T18:00:19.016369] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.109591] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.109754] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-13T18:00:19.153471] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-13T18:00:19.244052] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-13T18:00:19.352243] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.472735] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.426332] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.542371] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-13T18:00:19.580207] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.601366] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-13T18:00:19.592882] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-13T18:00:19.611793] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-13T18:00:19.642963] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-13T18:00:19.767255] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-13T18:00:20.070787] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.129398] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-13T18:00:20.493611] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.535509] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-13T18:00:20.670746] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.690220] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-13T18:00:20.725696] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.726025] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-13T18:00:20.997446] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T18:00:20.999369] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-13T18:00:21.651292] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T18:00:21.655151] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-13T18:00:21.756704] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:00:21.758635] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-13T18:00:22.151546] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T18:00:22.153437] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-13T18:00:22.575987] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T18:00:22.579803] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-13T18:00:22.636615] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:00:22.638555] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-13T18:00:22.818084] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:00:22.829169] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-13T18:00:22.914078] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-13T18:00:23.425939] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:00:23.534140] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:00:23.617882] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-13T18:00:24.417928] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-13T18:00:24.668464] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T18:00:24.798974] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T18:00:25.217927] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-13T18:00:26.017894] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-13T18:00:26.290020] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T18:00:26.443177] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T18:00:26.817986] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-13T18:00:27.631546] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-13T18:00:27.662795] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:00:27.954916] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T18:00:28.418000] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-13T18:00:29.217921] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-13T18:00:29.801082] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T18:00:30.012325] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:00:30.022725] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-13T18:00:30.190938] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:00:30.817925] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-13T18:00:31.556760] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T18:00:31.617948] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-13T18:00:32.096005] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T18:00:32.131850] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T18:00:32.418196] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-13T18:00:33.021199] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:00:33.217931] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-13T18:00:33.980885] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T18:00:34.017911] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-13T18:00:34.749906] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T18:00:34.817891] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-13T18:00:35.237541] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T18:00:35.238562] [INFO ] [REMOTE ] CHN: Full fetch complete (7371 records). [2025-10-13T18:00:35.238631] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-13T18:00:35.239065] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:00:35.239148] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:00:35.239190] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:00:35.239229] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-13T18:00:35.239283] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-13T18:00:35.239316] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-13T18:00:35.239436] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-10-13T18:00:35.239504] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHN took 17.6s. Estimated remaining: 4h 24m 54s. Rate: 7.3 symbols/min [2025-10-13T18:00:35.407069] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:35.407241] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-13T18:00:35.407277] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-13T18:00:35.407389] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-13T18:00:35.407428] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-13T18:00:35.407518] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-13T18:00:35.407566] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-13T18:00:35.623040] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-13T18:00:35.763113] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:36.417926] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-13T18:00:36.823041] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:00:37.217932] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-13T18:00:38.017899] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-13T18:00:38.349433] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:00:38.817983] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-13T18:00:39.070592] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:00:39.617934] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-13T18:00:39.944025] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T18:00:40.210062] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T18:00:40.417898] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-13T18:00:41.217978] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-13T18:00:41.348266] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:00:41.389903] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:00:42.017913] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-13T18:00:42.817923] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-13T18:00:42.942547] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T18:00:42.945243] [INFO ] [REMOTE ] CHT: Full fetch complete (27461 records). [2025-10-13T18:00:42.945420] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-13T18:00:43.088441] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:00:43.343297] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-13T18:00:43.343372] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-13T18:00:43.343813] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-13T18:00:43.343873] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-13T18:00:43.344499] [DEBUG] [LOCAL ] CHT: Trimmed 27461 records to 19498 (keeping 200 days of data) [2025-10-13T18:00:43.458916] [DEBUG] [LOCAL ] CHT: Primary data saved (19498 records). [2025-10-13T18:00:43.459076] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-13T18:00:43.459180] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 25.8s. Estimated remaining: 4h 24m 46s. Rate: 7.3 symbols/min [2025-10-13T18:00:43.623132] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-13T18:00:43.626299] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:43.642543] [DEBUG] [LOCAL ] CIA: Loaded 17004 existing records from primary storage. [2025-10-13T18:00:43.642827] [INFO ] [MAIN ] CIA: Loaded 17004 existing records. [2025-10-13T18:00:43.814903] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:43.815111] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-13T18:00:43.815156] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-13T18:00:43.815346] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-13T18:00:43.815402] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-13T18:00:44.169174] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:44.417916] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-13T18:00:44.859066] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T18:00:45.217558] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:00:45.227038] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-13T18:00:46.017975] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-13T18:00:46.236535] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:00:46.817922] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-13T18:00:47.374459] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:00:47.617941] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-13T18:00:47.849505] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:00:47.883737] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T18:00:48.417921] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-13T18:00:49.217920] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-13T18:00:49.934584] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T18:00:50.017889] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-13T18:00:50.405570] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:00:50.817896] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-13T18:00:51.316824] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T18:00:51.617889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-13T18:00:51.650516] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T18:00:51.704561] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:00:52.417926] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-13T18:00:53.218027] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-13T18:00:53.472383] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:00:54.003915] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:00:54.018448] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-13T18:00:54.817915] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-13T18:00:55.060032] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T18:00:55.617933] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-13T18:00:55.966248] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T18:00:55.970495] [INFO ] [REMOTE ] CHPT: Full fetch complete (71928 records). [2025-10-13T18:00:55.970631] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-13T18:00:56.357794] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-13T18:00:56.357966] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-13T18:00:56.358910] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-13T18:00:56.358976] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-13T18:00:56.360401] [DEBUG] [LOCAL ] CHPT: Trimmed 71928 records to 47848 (keeping 200 days of data) [2025-10-13T18:00:56.443884] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-13T18:00:56.488376] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:00:56.656470] [DEBUG] [LOCAL ] CHPT: Primary data saved (47848 records). [2025-10-13T18:00:56.656612] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-13T18:00:56.656724] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 39.0s. Estimated remaining: 4h 24m 59s. Rate: 7.3 symbols/min [2025-10-13T18:00:56.825837] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:56.855760] [DEBUG] [LOCAL ] CIB: Loaded 31088 existing records from primary storage. [2025-10-13T18:00:56.856138] [INFO ] [MAIN ] CIB: Loaded 31088 existing records. [2025-10-13T18:00:57.037909] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:57.038439] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-13T18:00:57.038508] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-13T18:00:57.039293] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-13T18:00:57.039354] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-13T18:00:57.188313] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-13T18:00:57.227002] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-13T18:00:57.465279] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:58.017896] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-13T18:00:58.132402] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:00:58.587840] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T18:00:58.817969] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-13T18:00:59.617924] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-13T18:01:00.011383] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T18:01:00.017392] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-13T18:01:00.017587] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-13T18:01:00.419711] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-13T18:01:00.446517] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-13T18:01:00.446859] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-13T18:01:00.448042] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-13T18:01:00.448453] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-13T18:01:00.450382] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53653 (keeping 200 days of data) [2025-10-13T18:01:00.577846] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:01:00.733626] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:01:00.830858] [DEBUG] [LOCAL ] CHWY: Primary data saved (53653 records). [2025-10-13T18:01:00.831001] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-13T18:01:00.832199] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHWY took 43.2s. Estimated remaining: 4h 24m 33s. Rate: 7.3 symbols/min [2025-10-13T18:01:01.029557] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:01.029757] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-13T18:01:01.029801] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-13T18:01:01.029909] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-13T18:01:01.029950] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-13T18:01:01.029990] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-13T18:01:01.030022] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-13T18:01:01.223122] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-13T18:01:01.407582] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:02.017902] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-13T18:01:02.188400] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T18:01:02.590430] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:01:02.757856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T18:01:02.817992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-13T18:01:03.270948] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T18:01:03.617916] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-13T18:01:04.417897] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-13T18:01:04.562929] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:01:05.051843] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:01:05.218052] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-13T18:01:06.018016] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-13T18:01:06.595708] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:01:06.817895] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-13T18:01:07.188533] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:01:07.617906] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-13T18:01:07.865261] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:01:08.417891] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-13T18:01:08.476330] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:01:09.218006] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-13T18:01:10.017898] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-13T18:01:10.221560] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:01:10.700559] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:01:10.817932] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-13T18:01:10.845782] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:01:11.617924] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-13T18:01:12.418385] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-13T18:01:12.424706] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T18:01:12.984833] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:01:13.217978] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-13T18:01:13.406571] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:01:14.017914] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-13T18:01:14.122096] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T18:01:14.126378] [INFO ] [REMOTE ] CIA: Full fetch complete (23463 records). [2025-10-13T18:01:14.126449] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-13T18:01:14.415949] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-13T18:01:14.499396] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-13T18:01:14.499464] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-13T18:01:14.499940] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-13T18:01:14.500003] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-13T18:01:14.500673] [DEBUG] [LOCAL ] CIA: Trimmed 23463 records to 16686 (keeping 200 days of data) [2025-10-13T18:01:14.591672] [DEBUG] [LOCAL ] CIA: Primary data saved (16686 records). [2025-10-13T18:01:14.591801] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-13T18:01:14.591879] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 31.1s. Estimated remaining: 4h 24m 49s. Rate: 7.3 symbols/min [2025-10-13T18:01:14.761995] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:14.762140] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-13T18:01:14.762175] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-13T18:01:14.762282] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-13T18:01:14.762322] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-13T18:01:14.762382] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-13T18:01:14.762450] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-13T18:01:14.824104] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-13T18:01:15.119262] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:15.618004] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-13T18:01:15.936080] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:01:16.417946] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-13T18:01:17.217886] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-13T18:01:17.316481] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:01:17.583936] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T18:01:17.778746] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:01:18.017937] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-13T18:01:18.773307] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T18:01:18.778777] [INFO ] [REMOTE ] CI: Full fetch complete (72128 records). [2025-10-13T18:01:18.778879] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-13T18:01:18.823099] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-13T18:01:19.162079] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-13T18:01:19.162156] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-13T18:01:19.162932] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-13T18:01:19.162993] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-13T18:01:19.164359] [DEBUG] [LOCAL ] CI: Trimmed 72128 records to 49808 (keeping 200 days of data) [2025-10-13T18:01:19.469941] [DEBUG] [LOCAL ] CI: Primary data saved (49808 records). [2025-10-13T18:01:19.470085] [INFO ] [MAIN ] CI: Full history saved. [2025-10-13T18:01:19.470162] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CI took 44.2s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-13T18:01:19.621851] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-13T18:01:19.642303] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:19.648043] [DEBUG] [LOCAL ] CIF: Loaded 4139 existing records from primary storage. [2025-10-13T18:01:19.648300] [INFO ] [MAIN ] CIF: Loaded 4139 existing records. [2025-10-13T18:01:19.823702] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:01:19.823918] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-13T18:01:19.823973] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-13T18:01:19.824176] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-13T18:01:19.824233] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-13T18:01:20.130169] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T18:01:20.195903] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:20.417901] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-13T18:01:20.973863] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T18:01:21.217903] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-13T18:01:21.400448] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:01:21.863185] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:01:22.017933] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-13T18:01:22.463333] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:01:22.817911] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-13T18:01:23.310092] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T18:01:23.617978] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-13T18:01:24.417933] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-13T18:01:24.947109] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:01:25.060938] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:01:25.217908] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-13T18:01:25.830635] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T18:01:26.017986] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-13T18:01:26.668245] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T18:01:26.817908] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-13T18:01:27.617978] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-13T18:01:28.053897] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:01:28.072883] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T18:01:28.417991] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-13T18:01:29.217926] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-13T18:01:29.656283] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:01:29.664070] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:01:29.666872] [INFO ] [REMOTE ] CIB: Full fetch complete (44591 records). [2025-10-13T18:01:29.666967] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-13T18:01:29.667695] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:01:29.667779] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:01:29.667822] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:01:29.668353] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-13T18:01:29.668496] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-13T18:01:29.668537] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-13T18:01:29.668793] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-13T18:01:29.668960] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 33.0s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-13T18:01:29.837221] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:29.837401] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-13T18:01:29.837445] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-13T18:01:29.837558] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-13T18:01:29.837598] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-13T18:01:29.837637] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-13T18:01:29.837712] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-13T18:01:30.025321] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-13T18:01:30.192160] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:30.758994] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T18:01:30.817879] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-13T18:01:31.319911] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T18:01:31.617930] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-13T18:01:32.239091] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:01:32.417905] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-13T18:01:33.217939] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-13T18:01:34.017907] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-13T18:01:34.243437] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T18:01:34.503543] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T18:01:34.504232] [INFO ] [REMOTE ] CICB: Full fetch complete (1976 records). [2025-10-13T18:01:34.504300] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-13T18:01:34.504626] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:01:34.504731] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:01:34.504804] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:01:34.504885] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-13T18:01:34.504961] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-13T18:01:34.505011] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-13T18:01:34.505067] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-13T18:01:34.505140] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CICB took 33.7s. Estimated remaining: 4h 24m 3s. Rate: 7.3 symbols/min [2025-10-13T18:01:34.677131] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:34.701205] [DEBUG] [LOCAL ] CII: Loaded 15532 existing records from primary storage. [2025-10-13T18:01:34.701434] [INFO ] [MAIN ] CII: Loaded 15532 existing records. [2025-10-13T18:01:34.825397] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-13T18:01:34.904075] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:01:34.904507] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-13T18:01:34.904568] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-13T18:01:34.924044] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-13T18:01:34.924763] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-13T18:01:34.924702] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:01:35.315551] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:35.467574] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T18:01:35.617911] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-13T18:01:36.417929] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-13T18:01:36.691214] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:01:36.922095] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:01:37.217904] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-13T18:01:38.017926] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-13T18:01:38.599946] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:01:38.817905] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-13T18:01:38.918919] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:01:39.617979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-13T18:01:40.184255] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:01:40.417895] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-13T18:01:41.093469] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:01:41.094328] [INFO ] [REMOTE ] CIF: Full fetch complete (6586 records). [2025-10-13T18:01:41.094393] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-13T18:01:41.222686] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-13T18:01:41.461558] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-13T18:01:41.461740] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-13T18:01:41.461987] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-13T18:01:41.462061] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-13T18:01:41.462605] [DEBUG] [LOCAL ] CIF: Trimmed 6586 records to 4061 (keeping 200 days of data) [2025-10-13T18:01:41.508819] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T18:01:41.525313] [DEBUG] [LOCAL ] CIF: Primary data saved (4061 records). [2025-10-13T18:01:41.525393] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-13T18:01:41.525462] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIF took 22.1s. Estimated remaining: 4h 23m 50s. Rate: 7.3 symbols/min [2025-10-13T18:01:41.688486] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:41.688610] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-13T18:01:41.688672] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-13T18:01:41.688780] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-13T18:01:41.688821] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-13T18:01:41.688861] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-13T18:01:41.688893] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-13T18:01:42.039812] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-13T18:01:42.045567] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:42.181031] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:01:42.817914] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-13T18:01:43.499056] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:01:43.617885] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-13T18:01:43.776970] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T18:01:44.417935] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-13T18:01:45.217922] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-13T18:01:45.254457] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:01:45.828810] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:01:46.017938] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-13T18:01:46.817922] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-13T18:01:47.245535] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T18:01:47.618022] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-13T18:01:47.827481] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T18:01:47.849238] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:01:48.418036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-13T18:01:49.218000] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-13T18:01:49.818426] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-13T18:01:50.023019] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-13T18:01:50.041932] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T18:01:50.349093] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:01:50.817944] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-13T18:01:51.516003] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T18:01:51.617942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-13T18:01:52.417983] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-13T18:01:52.483569] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T18:01:53.217934] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-13T18:01:53.294691] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T18:01:53.731703] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T18:01:54.017940] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-13T18:01:54.794163] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:01:54.817914] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-13T18:01:54.949858] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:01:55.617928] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-13T18:01:56.290200] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:01:56.417894] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-13T18:01:57.224518] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-13T18:01:57.239516] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:01:58.017913] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-13T18:01:58.178459] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:01:58.672436] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:01:58.817912] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-13T18:01:58.911004] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T18:01:59.617916] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-13T18:02:00.424115] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-13T18:02:00.440727] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T18:02:00.558189] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T18:02:01.217929] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-13T18:02:02.017993] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-13T18:02:02.117842] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:02:02.817995] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-13T18:02:03.173845] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-13T18:02:03.178274] [INFO ] [REMOTE ] CIG: Full fetch complete (61378 records). [2025-10-13T18:02:03.178364] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-13T18:02:03.178945] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:03.179027] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:03.179069] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:03.179106] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-13T18:02:03.179159] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-13T18:02:03.179193] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-13T18:02:03.179232] [DEBUG] [LOCAL ] CIG: No derivative data file found to delete. [2025-10-13T18:02:03.179286] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIG took 33.5s. Estimated remaining: 4h 24m 39s. Rate: 7.3 symbols/min [2025-10-13T18:02:03.343134] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:03.343267] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-13T18:02:03.343303] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-13T18:02:03.343408] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-13T18:02:03.343449] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-13T18:02:03.343489] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-13T18:02:03.343520] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-13T18:02:03.619741] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-13T18:02:03.709517] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T18:02:03.714597] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:03.720359] [INFO ] [REMOTE ] CIEN: Full fetch complete (75197 records). [2025-10-13T18:02:03.720463] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-13T18:02:03.721262] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:03.721368] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:03.721444] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:03.721528] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-13T18:02:03.721606] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-13T18:02:03.721706] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-13T18:02:03.721813] [DEBUG] [LOCAL ] CIEN: No derivative data file found to delete. [2025-10-13T18:02:03.721890] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIEN took 49.1s. Estimated remaining: 4h 23m 58s. Rate: 7.3 symbols/min [2025-10-13T18:02:03.897149] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:03.897338] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-13T18:02:03.897376] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-13T18:02:03.897489] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-13T18:02:03.897543] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-13T18:02:03.897618] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-13T18:02:03.897706] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-13T18:02:04.256773] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:04.374951] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:02:04.417908] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-13T18:02:04.504732] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T18:02:05.217923] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-13T18:02:05.250909] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:02:06.017913] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-13T18:02:06.029348] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T18:02:06.031530] [INFO ] [REMOTE ] CII: Full fetch complete (22915 records). [2025-10-13T18:02:06.031597] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-13T18:02:06.389273] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-13T18:02:06.389352] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-13T18:02:06.389779] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-13T18:02:06.389839] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-13T18:02:06.390456] [DEBUG] [LOCAL ] CII: Trimmed 22915 records to 15346 (keeping 200 days of data) [2025-10-13T18:02:06.491043] [DEBUG] [LOCAL ] CII: Primary data saved (15346 records). [2025-10-13T18:02:06.491249] [INFO ] [MAIN ] CII: Full history saved. [2025-10-13T18:02:06.491359] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CII took 32.0s. Estimated remaining: 4h 23m 26s. Rate: 7.3 symbols/min [2025-10-13T18:02:06.668606] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:06.668927] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-13T18:02:06.668984] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-13T18:02:06.669116] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-13T18:02:06.669163] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-13T18:02:06.669216] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-13T18:02:06.669253] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-13T18:02:06.823106] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-13T18:02:07.051133] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:07.368265] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:02:07.466797] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:02:07.617923] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-13T18:02:08.417936] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-13T18:02:08.621269] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:02:08.621489] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-13T18:02:08.621580] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:02:08.621625] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-13T18:02:08.621705] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:02:08.621781] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-13T18:02:08.621914] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-13T18:02:08.621971] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-13T18:02:08.622035] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-13T18:02:08.622108] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMP took 2.1s. Estimated remaining: 4h 22m 52s. Rate: 7.3 symbols/min [2025-10-13T18:02:08.793696] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:08.811879] [DEBUG] [LOCAL ] CINT: Loaded 19896 existing records from primary storage. [2025-10-13T18:02:08.812121] [INFO ] [MAIN ] CINT: Loaded 19896 existing records. [2025-10-13T18:02:08.992595] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:08.992928] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-13T18:02:08.993050] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-13T18:02:08.993395] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-13T18:02:08.993452] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-13T18:02:09.114728] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:02:09.222436] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-13T18:02:09.403781] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:09.747499] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T18:02:10.017937] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-13T18:02:10.817935] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-13T18:02:10.935269] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T18:02:11.392333] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:02:11.617929] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-13T18:02:12.153729] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T18:02:12.417937] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-13T18:02:13.218007] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-13T18:02:13.485119] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:02:14.017901] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-13T18:02:14.374789] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T18:02:14.756030] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T18:02:14.817893] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-13T18:02:15.617915] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-13T18:02:15.812626] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T18:02:16.072362] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T18:02:16.417934] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-13T18:02:17.220160] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-13T18:02:17.222268] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:02:17.785937] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:02:18.017922] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-13T18:02:18.692600] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:02:18.817896] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-13T18:02:19.276155] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T18:02:19.617927] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-13T18:02:20.417921] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-13T18:02:20.845229] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:02:21.217898] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-13T18:02:21.294801] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:02:22.017913] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-13T18:02:22.244354] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T18:02:22.674594] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:02:22.818007] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-13T18:02:23.397615] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:02:23.617922] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-13T18:02:24.417928] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-13T18:02:24.708502] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:02:24.742211] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:02:25.217915] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-13T18:02:25.511016] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-13T18:02:26.017936] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-13T18:02:26.817929] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-13T18:02:27.167510] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-13T18:02:27.490557] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:02:27.494674] [INFO ] [REMOTE ] CIM: Full fetch complete (54703 records). [2025-10-13T18:02:27.494780] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-13T18:02:27.495442] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:27.495528] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:27.495572] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:27.495622] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-13T18:02:27.495737] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-13T18:02:27.495799] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-13T18:02:27.495857] [DEBUG] [LOCAL ] CIM: No derivative data file found to delete. [2025-10-13T18:02:27.495933] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 46.0s. Estimated remaining: 4h 23m 29s. Rate: 7.3 symbols/min [2025-10-13T18:02:27.622997] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-13T18:02:27.670768] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:27.689540] [DEBUG] [LOCAL ] CIO: Loaded 20876 existing records from primary storage. [2025-10-13T18:02:27.690107] [INFO ] [MAIN ] CIO: Loaded 20876 existing records. [2025-10-13T18:02:27.868214] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:27.868431] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-13T18:02:27.868482] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-13T18:02:27.868783] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-13T18:02:27.868839] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-13T18:02:28.228831] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:28.417889] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-13T18:02:28.549859] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:02:29.082634] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:02:29.217918] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-13T18:02:29.651800] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T18:02:30.017927] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-13T18:02:30.817977] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-13T18:02:31.205376] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:02:31.617923] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-13T18:02:31.969060] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:02:32.283023] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:02:32.286291] [INFO ] [REMOTE ] CINT: Full fetch complete (27482 records). [2025-10-13T18:02:32.286369] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-13T18:02:32.286870] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:32.286965] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:32.287037] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:32.287129] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-13T18:02:32.287207] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-13T18:02:32.287243] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-13T18:02:32.287397] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-13T18:02:32.287480] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CINT took 23.7s. Estimated remaining: 4h 23m 6s. Rate: 7.3 symbols/min [2025-10-13T18:02:32.430094] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-13T18:02:32.463958] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:32.492117] [DEBUG] [LOCAL ] CION: Loaded 28885 existing records from primary storage. [2025-10-13T18:02:32.492399] [INFO ] [MAIN ] CION: Loaded 28885 existing records. [2025-10-13T18:02:32.666733] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:32.667021] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-13T18:02:32.667098] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-13T18:02:32.667326] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-13T18:02:32.667383] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-13T18:02:33.016675] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:33.217915] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-13T18:02:33.563993] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T18:02:33.564734] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:02:34.017925] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-13T18:02:34.596888] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:02:34.597785] [INFO ] [REMOTE ] CIMN: Full fetch complete (3900 records). [2025-10-13T18:02:34.597855] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-13T18:02:34.823001] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-13T18:02:34.976294] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-13T18:02:34.976376] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-13T18:02:34.976514] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-13T18:02:34.976551] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-13T18:02:34.976988] [DEBUG] [LOCAL ] CIMN: Trimmed 3900 records to 2757 (keeping 200 days of data) [2025-10-13T18:02:34.993764] [DEBUG] [LOCAL ] CIMN: Primary data saved (2757 records). [2025-10-13T18:02:34.993894] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-13T18:02:34.993972] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIMN took 31.8s. Estimated remaining: 4h 22m 35s. Rate: 7.3 symbols/min [2025-10-13T18:02:35.160086] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:35.212366] [DEBUG] [LOCAL ] CIVI: Loaded 53392 existing records from primary storage. [2025-10-13T18:02:35.212716] [INFO ] [MAIN ] CIVI: Loaded 53392 existing records. [2025-10-13T18:02:35.392043] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:35.392290] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-13T18:02:35.392337] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-13T18:02:35.392791] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-13T18:02:35.392850] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-13T18:02:35.628569] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-13T18:02:35.745808] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:36.283410] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:02:36.298967] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T18:02:36.417939] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-13T18:02:37.217982] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-13T18:02:37.241879] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:02:38.017927] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-13T18:02:38.817938] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-13T18:02:39.016479] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:02:39.054900] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:02:39.278126] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T18:02:39.617943] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-13T18:02:40.417922] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-13T18:02:41.217898] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-13T18:02:41.376353] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T18:02:41.496808] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:02:42.017945] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-13T18:02:42.180427] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:02:42.817935] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-13T18:02:43.294147] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:02:43.371435] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T18:02:43.618011] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-13T18:02:44.281051] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T18:02:44.419594] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-13T18:02:45.217921] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-13T18:02:45.842138] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:02:45.843151] [INFO ] [REMOTE ] CIMO: Full fetch complete (5066 records). [2025-10-13T18:02:45.843218] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-13T18:02:46.020768] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-13T18:02:46.026718] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:02:46.027797] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:46.028110] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:46.028204] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-13T18:02:46.028339] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-13T18:02:46.028465] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-13T18:02:46.028711] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-13T18:02:46.028835] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIMO took 42.3s. Estimated remaining: 4h 22m 38s. Rate: 7.3 symbols/min [2025-10-13T18:02:46.206839] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:02:46.229910] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:46.291224] [DEBUG] [LOCAL ] CL: Loaded 54428 existing records from primary storage. [2025-10-13T18:02:46.291577] [INFO ] [MAIN ] CL: Loaded 54428 existing records. [2025-10-13T18:02:46.465155] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:46.465390] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-13T18:02:46.465437] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-13T18:02:46.465778] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-13T18:02:46.465834] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-13T18:02:46.824571] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-13T18:02:46.829049] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:47.109553] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:02:47.617916] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-13T18:02:48.247798] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T18:02:48.417888] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-13T18:02:48.438852] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T18:02:49.217920] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-13T18:02:50.023047] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-13T18:02:50.038166] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:02:50.164737] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:02:50.817924] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-13T18:02:51.617934] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-13T18:02:51.661895] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:02:52.417899] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-13T18:02:52.572991] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T18:02:52.831020] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:02:53.217933] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-13T18:02:53.472454] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:02:54.017973] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-13T18:02:54.817909] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-13T18:02:55.143924] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:02:55.617916] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-13T18:02:55.753800] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:02:55.788108] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:02:56.417887] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-13T18:02:56.445027] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:02:57.217895] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-13T18:02:57.609076] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:02:58.017927] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-13T18:02:58.818036] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-13T18:02:58.833865] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:02:58.837036] [INFO ] [REMOTE ] CIO: Full fetch complete (29338 records). [2025-10-13T18:02:58.837138] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-13T18:02:59.227830] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-13T18:02:59.227971] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-13T18:02:59.228604] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-13T18:02:59.228818] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-13T18:02:59.229802] [DEBUG] [LOCAL ] CIO: Trimmed 29338 records to 20708 (keeping 200 days of data) [2025-10-13T18:02:59.349783] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T18:02:59.397513] [DEBUG] [LOCAL ] CIO: Primary data saved (20708 records). [2025-10-13T18:02:59.397672] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-13T18:02:59.397772] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIO took 31.9s. Estimated remaining: 4h 22m 51s. Rate: 7.3 symbols/min [2025-10-13T18:02:59.567207] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:59.567417] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-13T18:02:59.567454] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-13T18:02:59.567562] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-13T18:02:59.567601] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-13T18:02:59.567662] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-13T18:02:59.567718] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-13T18:02:59.630207] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-13T18:02:59.932929] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:00.417930] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-13T18:03:00.903367] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:03:01.133458] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:03:01.218037] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-13T18:03:02.018025] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-13T18:03:02.509064] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:03:02.818017] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-13T18:03:03.540344] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-13T18:03:03.610302] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:03:03.617873] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-13T18:03:04.417906] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-13T18:03:04.723849] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:03:04.784986] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:03:04.788483] [INFO ] [REMOTE ] CION: Full fetch complete (40242 records). [2025-10-13T18:03:04.788790] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-13T18:03:04.789399] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:04.789488] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:04.789531] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:04.789569] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-13T18:03:04.789624] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-13T18:03:04.789696] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-13T18:03:04.789867] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-13T18:03:04.789952] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CION took 32.5s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-13T18:03:04.976234] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:04.991278] [DEBUG] [LOCAL ] CLCO: Loaded 13109 existing records from primary storage. [2025-10-13T18:03:04.991505] [INFO ] [MAIN ] CLCO: Loaded 13109 existing records. [2025-10-13T18:03:05.183846] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:05.184076] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-13T18:03:05.184159] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-13T18:03:05.184489] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-13T18:03:05.184587] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-13T18:03:05.227724] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-13T18:03:05.560189] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:05.772228] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:03:06.017914] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-13T18:03:06.818021] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-13T18:03:07.123069] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:03:07.242767] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:03:07.618142] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-13T18:03:08.417927] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-13T18:03:08.536760] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:03:09.217946] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-13T18:03:09.475337] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:03:09.675055] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T18:03:10.017905] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-13T18:03:10.823079] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-13T18:03:10.849125] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T18:03:11.391027] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:03:11.617921] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-13T18:03:12.417888] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-13T18:03:12.569754] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:03:12.603292] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:03:13.217901] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-13T18:03:13.323356] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T18:03:14.017942] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-13T18:03:14.817913] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-13T18:03:14.887029] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:03:15.323401] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T18:03:15.618193] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-13T18:03:16.419828] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-13T18:03:16.422468] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T18:03:16.428519] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-13T18:03:16.428725] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-13T18:03:16.856112] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-13T18:03:16.856285] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-13T18:03:16.857291] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-13T18:03:16.857377] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-13T18:03:16.888392] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 53648 (keeping 200 days of data) [2025-10-13T18:03:16.890229] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-13T18:03:17.222685] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-13T18:03:17.247404] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-13T18:03:17.247525] [INFO ] [MAIN ] CL: Full history saved. [2025-10-13T18:03:17.247634] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CL took 31.2s. Estimated remaining: 4h 22m 41s. Rate: 7.3 symbols/min [2025-10-13T18:03:17.414721] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:17.438987] [DEBUG] [LOCAL ] CLDT: Loaded 25799 existing records from primary storage. [2025-10-13T18:03:17.439217] [INFO ] [MAIN ] CLDT: Loaded 25799 existing records. [2025-10-13T18:03:17.623358] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:17.623522] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-13T18:03:17.623568] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-13T18:03:17.623788] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-13T18:03:17.623844] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-13T18:03:18.001409] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:18.003076] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T18:03:18.017891] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-13T18:03:18.360637] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:03:18.817920] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-13T18:03:18.842507] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T18:03:19.617928] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-13T18:03:20.417904] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-13T18:03:20.608880] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:03:20.613715] [INFO ] [REMOTE ] CIVI: Full fetch complete (75375 records). [2025-10-13T18:03:20.613841] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-13T18:03:20.614611] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:20.614724] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:20.614794] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:20.614865] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-13T18:03:20.614959] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-10-13T18:03:20.615014] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-10-13T18:03:20.615171] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-10-13T18:03:20.615261] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CIVI took 45.6s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-13T18:03:20.789763] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:03:20.806510] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:20.864883] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-13T18:03:20.865183] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-10-13T18:03:21.058559] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:21.058827] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-13T18:03:21.058873] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-13T18:03:21.059424] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-13T18:03:21.059480] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-13T18:03:21.221055] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-13T18:03:21.432434] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:03:21.454213] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:22.017905] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-13T18:03:22.405940] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T18:03:22.817944] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-13T18:03:23.495678] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-13T18:03:23.617899] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-13T18:03:24.150326] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T18:03:24.417929] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-13T18:03:24.892491] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:03:25.217934] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-13T18:03:25.768013] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:03:26.017892] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-13T18:03:26.480541] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:03:26.817901] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-13T18:03:26.849537] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T18:03:27.617915] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-13T18:03:28.072482] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:03:28.417914] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-13T18:03:28.645702] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T18:03:29.217916] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-13T18:03:29.878006] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:03:30.017886] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-13T18:03:30.564158] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T18:03:30.786178] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:03:30.817881] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-13T18:03:31.617906] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-13T18:03:31.646019] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:03:32.417897] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-13T18:03:32.648222] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:03:33.217932] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-13T18:03:33.868160] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:03:34.017917] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-13T18:03:34.818002] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-13T18:03:35.048742] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T18:03:35.293540] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:03:35.296736] [INFO ] [REMOTE ] CLB: Full fetch complete (46431 records). [2025-10-13T18:03:35.296850] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-13T18:03:35.297509] [FATAL] [VALIDATOR ] CLB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:35.297623] [FATAL] [MAIN ] CLB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:35.297719] [WARN ] [MAIN ] CLB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:35.297791] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-13T18:03:35.297855] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-13T18:03:35.297891] [INFO ] [LOCAL ] CLB: Starting deletion of derivative data. [2025-10-13T18:03:35.297930] [DEBUG] [LOCAL ] CLB: No derivative data file found to delete. [2025-10-13T18:03:35.298024] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLB took 35.9s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-13T18:03:35.477981] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:35.478181] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-10-13T18:03:35.478218] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-10-13T18:03:35.478327] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-13T18:03:35.478367] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-13T18:03:35.478408] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-13T18:03:35.478439] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-13T18:03:35.620794] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-13T18:03:35.699111] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:03:35.736155] [INFO ] [REMOTE ] CLCO: Full fetch complete (22694 records). [2025-10-13T18:03:35.765796] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-13T18:03:36.034327] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:36.260168] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-13T18:03:36.260247] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-13T18:03:36.260824] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-13T18:03:36.260886] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-13T18:03:36.261470] [DEBUG] [LOCAL ] CLCO: Trimmed 22694 records to 12940 (keeping 200 days of data) [2025-10-13T18:03:36.334035] [DEBUG] [LOCAL ] CLCO: Primary data saved (12940 records). [2025-10-13T18:03:36.334182] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-13T18:03:36.334326] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLCO took 31.5s. Estimated remaining: 4h 21m 53s. Rate: 7.3 symbols/min [2025-10-13T18:03:36.424395] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-13T18:03:36.509149] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:36.519996] [DEBUG] [LOCAL ] CLPR: Loaded 10667 existing records from primary storage. [2025-10-13T18:03:36.520196] [INFO ] [MAIN ] CLPR: Loaded 10667 existing records. [2025-10-13T18:03:36.696703] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:36.696940] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-13T18:03:36.696988] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-13T18:03:36.697212] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-13T18:03:36.697293] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-13T18:03:37.052012] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:37.217903] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-13T18:03:37.389913] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:03:37.728880] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-13T18:03:38.017922] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-13T18:03:38.259476] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T18:03:38.817904] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-13T18:03:39.015197] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T18:03:39.617928] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-13T18:03:39.836907] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:03:40.417909] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-13T18:03:40.827846] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:03:41.217927] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-13T18:03:42.017923] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-13T18:03:42.296252] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T18:03:42.459836] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T18:03:42.817974] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-13T18:03:43.321260] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:03:43.617929] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-13T18:03:44.418092] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-13T18:03:44.719009] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:03:44.905581] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T18:03:45.043872] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-13T18:03:45.217915] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-13T18:03:46.017982] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-13T18:03:46.605357] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:03:46.817937] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-13T18:03:47.326929] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:03:47.330484] [INFO ] [REMOTE ] CLDT: Full fetch complete (37235 records). [2025-10-13T18:03:47.330585] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-13T18:03:47.518762] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T18:03:47.623310] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-13T18:03:47.729011] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-13T18:03:47.729110] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-13T18:03:47.729748] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-13T18:03:47.729813] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-13T18:03:47.730864] [DEBUG] [LOCAL ] CLDT: Trimmed 37235 records to 25453 (keeping 200 days of data) [2025-10-13T18:03:47.878424] [DEBUG] [LOCAL ] CLDT: Primary data saved (25453 records). [2025-10-13T18:03:47.878559] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-13T18:03:47.878695] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLDT took 30.6s. Estimated remaining: 4h 21m 58s. Rate: 7.3 symbols/min [2025-10-13T18:03:48.070548] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:48.124978] [DEBUG] [LOCAL ] CLS: Loaded 54367 existing records from primary storage. [2025-10-13T18:03:48.125348] [INFO ] [MAIN ] CLS: Loaded 54367 existing records. [2025-10-13T18:03:48.311572] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:48.311854] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-13T18:03:48.311903] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-13T18:03:48.312350] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-13T18:03:48.312412] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-13T18:03:48.423166] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-13T18:03:48.726935] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:49.097072] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:03:49.218062] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-13T18:03:50.017943] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-13T18:03:50.752085] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T18:03:50.813217] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T18:03:50.817879] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-13T18:03:51.324429] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T18:03:51.617921] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-13T18:03:51.638006] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:03:52.417912] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-13T18:03:53.218038] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-13T18:03:53.584965] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-13T18:03:53.795197] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:03:54.017905] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-13T18:03:54.484351] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T18:03:54.758699] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T18:03:54.817906] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-13T18:03:55.529496] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:03:55.617932] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-13T18:03:56.417932] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-13T18:03:57.217999] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-13T18:03:57.896382] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-13T18:03:58.008913] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:03:58.017873] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-13T18:03:58.294672] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T18:03:58.697726] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T18:03:58.817993] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-13T18:03:59.617931] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-13T18:03:59.906935] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:04:00.356251] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:04:00.358112] [INFO ] [REMOTE ] CLPR: Full fetch complete (16236 records). [2025-10-13T18:04:00.358204] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-13T18:04:00.358822] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:04:00.358934] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:04:00.358995] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:04:00.359080] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-13T18:04:00.359164] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-13T18:04:00.359250] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-13T18:04:00.359477] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-10-13T18:04:00.359590] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 24.0s. Estimated remaining: 4h 22m 7s. Rate: 7.3 symbols/min [2025-10-13T18:04:00.424053] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-13T18:04:00.546105] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:00.602467] [DEBUG] [LOCAL ] CLVT: Loaded 52731 existing records from primary storage. [2025-10-13T18:04:00.602788] [INFO ] [MAIN ] CLVT: Loaded 52731 existing records. [2025-10-13T18:04:00.790690] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:00.790939] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-13T18:04:00.790987] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-13T18:04:00.791441] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-13T18:04:00.791496] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-13T18:04:01.136451] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:01.217885] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-13T18:04:02.018002] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-13T18:04:02.818000] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-13T18:04:03.063190] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T18:04:03.102330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-13T18:04:03.146920] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T18:04:03.617990] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-13T18:04:04.417924] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-13T18:04:04.992519] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-13T18:04:05.217947] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-13T18:04:05.513732] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:04:06.023131] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-13T18:04:06.044278] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-13T18:04:06.817905] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-13T18:04:07.279404] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:04:07.308725] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:04:07.617929] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-13T18:04:08.271625] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:04:08.417947] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-13T18:04:09.217921] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-13T18:04:09.594797] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T18:04:09.645703] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T18:04:10.017979] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-13T18:04:10.352066] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T18:04:10.817920] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-13T18:04:11.145128] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T18:04:11.148444] [INFO ] [REMOTE ] CLH: Full fetch complete (41821 records). [2025-10-13T18:04:11.148594] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-13T18:04:11.537286] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-13T18:04:11.537372] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-13T18:04:11.538004] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-13T18:04:11.538067] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-13T18:04:11.539172] [DEBUG] [LOCAL ] CLH: Trimmed 41821 records to 27824 (keeping 200 days of data) [2025-10-13T18:04:11.631305] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-13T18:04:11.720449] [DEBUG] [LOCAL ] CLH: Primary data saved (27824 records). [2025-10-13T18:04:11.720597] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-13T18:04:11.720691] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 36.4s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-13T18:04:11.917477] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:11.937539] [DEBUG] [LOCAL ] CLW: Loaded 21986 existing records from primary storage. [2025-10-13T18:04:11.937823] [INFO ] [MAIN ] CLW: Loaded 21986 existing records. [2025-10-13T18:04:12.115263] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:12.115596] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-13T18:04:12.115675] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-13T18:04:12.115871] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-13T18:04:12.115910] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-13T18:04:12.422498] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-13T18:04:12.475660] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:12.530587] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:04:13.218021] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-13T18:04:13.485753] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:04:13.491369] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-13T18:04:13.491516] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-13T18:04:13.888146] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-13T18:04:13.888241] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-13T18:04:13.889225] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-13T18:04:13.889296] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-13T18:04:13.890948] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-10-13T18:04:14.061288] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-13T18:04:14.223444] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-13T18:04:14.223594] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-13T18:04:14.223718] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLF took 53.6s. Estimated remaining: 4h 21m 40s. Rate: 7.3 symbols/min [2025-10-13T18:04:14.395737] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:14.447998] [DEBUG] [LOCAL ] CLX: Loaded 52350 existing records from primary storage. [2025-10-13T18:04:14.448358] [INFO ] [MAIN ] CLX: Loaded 52350 existing records. [2025-10-13T18:04:14.628576] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:14.628858] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-13T18:04:14.628984] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-13T18:04:14.629538] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-13T18:04:14.629613] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-13T18:04:15.018572] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:15.019182] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-13T18:04:15.050419] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-13T18:04:15.092679] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:04:15.263167] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T18:04:15.617907] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-13T18:04:16.417912] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-13T18:04:16.532821] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:04:17.169513] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:04:17.217884] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-13T18:04:18.017908] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-13T18:04:18.745261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-13T18:04:18.790343] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:04:18.817886] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-13T18:04:18.989597] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T18:04:19.618012] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-13T18:04:20.417925] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-13T18:04:20.562429] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:04:21.217978] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-13T18:04:21.441634] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T18:04:22.026589] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-13T18:04:22.032194] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-13T18:04:22.817892] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-13T18:04:22.987380] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T18:04:23.210793] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T18:04:23.617919] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-13T18:04:24.417920] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-13T18:04:25.217890] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-13T18:04:25.350584] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T18:04:25.391639] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:04:25.609592] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:04:26.018016] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-13T18:04:26.786904] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:04:26.814282] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:04:26.817901] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-13T18:04:27.617968] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-13T18:04:28.418002] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-13T18:04:28.634908] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T18:04:29.217899] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-13T18:04:29.313854] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:04:29.319466] [INFO ] [REMOTE ] CLVT: Full fetch complete (75196 records). [2025-10-13T18:04:29.319600] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-13T18:04:29.765214] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-13T18:04:29.765315] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-13T18:04:29.766315] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-13T18:04:29.766382] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-13T18:04:29.768160] [DEBUG] [LOCAL ] CLVT: Trimmed 75196 records to 51978 (keeping 200 days of data) [2025-10-13T18:04:30.043142] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-13T18:04:30.079560] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:04:30.107111] [DEBUG] [LOCAL ] CLVT: Primary data saved (51978 records). [2025-10-13T18:04:30.107231] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-13T18:04:30.108099] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 29.7s. Estimated remaining: 4h 22m 3s. Rate: 7.3 symbols/min [2025-10-13T18:04:30.272569] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:30.319341] [DEBUG] [LOCAL ] CM: Loaded 49467 existing records from primary storage. [2025-10-13T18:04:30.319678] [INFO ] [MAIN ] CM: Loaded 49467 existing records. [2025-10-13T18:04:30.497571] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:30.498088] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-13T18:04:30.498227] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-13T18:04:30.498583] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-13T18:04:30.498676] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-13T18:04:30.772816] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T18:04:30.804686] [INFO ] [REMOTE ] CLS: Full fetch complete (77483 records). [2025-10-13T18:04:30.815120] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-13T18:04:30.820298] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-13T18:04:30.918087] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:31.263538] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-13T18:04:31.263627] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-13T18:04:31.264532] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-13T18:04:31.264587] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-13T18:04:31.266187] [DEBUG] [LOCAL ] CLS: Trimmed 77483 records to 53587 (keeping 200 days of data) [2025-10-13T18:04:31.590854] [DEBUG] [LOCAL ] CLS: Primary data saved (53587 records). [2025-10-13T18:04:31.591006] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-13T18:04:31.591103] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLS took 43.7s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-13T18:04:31.623256] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-13T18:04:31.760081] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:31.810174] [DEBUG] [LOCAL ] CMA: Loaded 50699 existing records from primary storage. [2025-10-13T18:04:31.810502] [INFO ] [MAIN ] CMA: Loaded 50699 existing records. [2025-10-13T18:04:32.016931] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:32.018414] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-13T18:04:32.018787] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-13T18:04:32.019856] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-13T18:04:32.020026] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-13T18:04:32.193290] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T18:04:32.419033] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-13T18:04:32.442924] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:32.474232] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-13T18:04:33.081896] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:04:33.197009] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:04:33.217933] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-13T18:04:34.017923] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-13T18:04:34.783123] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:04:34.817890] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-13T18:04:35.617948] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-13T18:04:35.721137] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:04:36.207693] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:04:36.417886] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-13T18:04:37.217918] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-13T18:04:37.273561] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:04:38.017891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-13T18:04:38.217296] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:04:38.823029] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-13T18:04:38.850762] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:04:39.617977] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-13T18:04:39.684663] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:04:39.824832] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:04:40.417992] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-13T18:04:41.157055] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:04:41.217918] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-13T18:04:41.370441] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:04:41.374199] [INFO ] [REMOTE ] CLW: Full fetch complete (34079 records). [2025-10-13T18:04:41.374446] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-13T18:04:41.885841] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-13T18:04:41.886000] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-13T18:04:41.886796] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-13T18:04:41.886865] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-13T18:04:41.888394] [DEBUG] [LOCAL ] CLW: Trimmed 34079 records to 21621 (keeping 200 days of data) [2025-10-13T18:04:42.020705] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-13T18:04:42.085574] [DEBUG] [LOCAL ] CLW: Primary data saved (21621 records). [2025-10-13T18:04:42.085795] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-13T18:04:42.085916] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLW took 30.4s. Estimated remaining: 4h 21m 28s. Rate: 7.3 symbols/min [2025-10-13T18:04:42.345991] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:42.371300] [DEBUG] [LOCAL ] CMBT: Loaded 25517 existing records from primary storage. [2025-10-13T18:04:42.371628] [INFO ] [MAIN ] CMBT: Loaded 25517 existing records. [2025-10-13T18:04:42.558635] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:42.558929] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-13T18:04:42.558978] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-13T18:04:42.559257] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-13T18:04:42.559314] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-13T18:04:42.820914] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-13T18:04:42.945817] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:42.971573] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:04:43.617900] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-13T18:04:43.669748] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T18:04:44.417914] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-13T18:04:44.470482] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:04:44.567569] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T18:04:45.217894] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-13T18:04:46.017929] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-13T18:04:46.179615] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:04:46.366068] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:04:46.817993] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-13T18:04:47.238180] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T18:04:47.617996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-13T18:04:47.749394] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:04:48.417946] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-13T18:04:49.208781] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:04:49.219340] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-13T18:04:50.017899] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-13T18:04:50.176450] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:04:50.393057] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:04:50.817926] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-13T18:04:51.617935] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-13T18:04:51.702434] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T18:04:51.707704] [INFO ] [REMOTE ] CLX: Full fetch complete (73295 records). [2025-10-13T18:04:51.707821] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-13T18:04:52.094237] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-13T18:04:52.094341] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-13T18:04:52.095212] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-13T18:04:52.095274] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-13T18:04:52.096620] [DEBUG] [LOCAL ] CLX: Trimmed 73295 records to 51636 (keeping 200 days of data) [2025-10-13T18:04:52.418291] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-13T18:04:52.419282] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T18:04:52.469013] [DEBUG] [LOCAL ] CLX: Primary data saved (51636 records). [2025-10-13T18:04:52.469165] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-13T18:04:52.469246] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CLX took 38.2s. Estimated remaining: 4h 21m 28s. Rate: 7.3 symbols/min [2025-10-13T18:04:52.637387] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:52.677339] [DEBUG] [LOCAL ] CMC: Loaded 46065 existing records from primary storage. [2025-10-13T18:04:52.677625] [INFO ] [MAIN ] CMC: Loaded 46065 existing records. [2025-10-13T18:04:52.851909] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:52.852140] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-13T18:04:52.852186] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-13T18:04:52.852374] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-13T18:04:52.852429] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-13T18:04:53.217134] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:53.217882] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-13T18:04:53.229516] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T18:04:53.458764] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:04:54.017999] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-13T18:04:54.763240] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:04:54.818296] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-13T18:04:54.821341] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T18:04:55.617924] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-13T18:04:56.417928] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-13T18:04:56.449293] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T18:04:56.676692] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T18:04:57.217903] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-13T18:04:57.867620] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:04:58.017913] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-13T18:04:58.389141] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T18:04:58.817919] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-13T18:04:59.432738] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:04:59.455747] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T18:04:59.617923] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-13T18:05:00.417926] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-13T18:05:01.218015] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-13T18:05:01.301546] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T18:05:01.642385] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:05:02.018004] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-13T18:05:02.817905] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-13T18:05:03.071227] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:05:03.318076] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:05:03.617935] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-13T18:05:04.398109] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:05:04.417920] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-13T18:05:05.218024] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-13T18:05:05.375583] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:05:06.018035] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-13T18:05:06.201678] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:05:06.492549] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T18:05:06.817940] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-13T18:05:07.419684] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:05:07.424594] [INFO ] [REMOTE ] CMBT: Full fetch complete (32055 records). [2025-10-13T18:05:07.424740] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-13T18:05:07.623598] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-13T18:05:07.804486] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-13T18:05:07.804559] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-13T18:05:07.805085] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-13T18:05:07.805147] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-13T18:05:07.805923] [DEBUG] [LOCAL ] CMBT: Trimmed 32055 records to 25580 (keeping 200 days of data) [2025-10-13T18:05:07.960738] [DEBUG] [LOCAL ] CMBT: Primary data saved (25580 records). [2025-10-13T18:05:07.960879] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-13T18:05:07.960971] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 25.9s. Estimated remaining: 4h 21m 49s. Rate: 7.3 symbols/min [2025-10-13T18:05:08.153068] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:08.158666] [DEBUG] [LOCAL ] CMCM: Loaded 4862 existing records from primary storage. [2025-10-13T18:05:08.158811] [INFO ] [MAIN ] CMCM: Loaded 4862 existing records. [2025-10-13T18:05:08.341804] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:08.342296] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-13T18:05:08.342379] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-13T18:05:08.342777] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-13T18:05:08.342843] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-13T18:05:08.418894] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-13T18:05:08.711826] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:08.744714] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:05:09.217898] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-13T18:05:09.451735] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:05:09.458439] [INFO ] [REMOTE ] CM: Full fetch complete (69539 records). [2025-10-13T18:05:09.458742] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-13T18:05:09.768513] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T18:05:09.859361] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-13T18:05:09.859528] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-13T18:05:09.860486] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-13T18:05:09.860562] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-13T18:05:09.862134] [DEBUG] [LOCAL ] CM: Trimmed 69539 records to 48771 (keeping 200 days of data) [2025-10-13T18:05:10.003037] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:05:10.022717] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-13T18:05:10.217810] [DEBUG] [LOCAL ] CM: Primary data saved (48771 records). [2025-10-13T18:05:10.217997] [INFO ] [MAIN ] CM: Full history saved. [2025-10-13T18:05:10.218740] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CM took 40.1s. Estimated remaining: 4h 21m 17s. Rate: 7.3 symbols/min [2025-10-13T18:05:10.396132] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:10.396312] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-13T18:05:10.396350] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-13T18:05:10.396469] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-13T18:05:10.396510] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-13T18:05:10.396549] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-13T18:05:10.396582] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-13T18:05:10.748258] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:10.817892] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-13T18:05:11.013517] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:05:11.014027] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-13T18:05:11.014130] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:05:11.014180] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-13T18:05:11.014219] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:05:11.014262] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-13T18:05:11.014327] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-13T18:05:11.014365] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-13T18:05:11.014405] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-13T18:05:11.014460] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 0.8s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-13T18:05:11.197104] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:11.252091] [DEBUG] [LOCAL ] CMG: Loaded 54500 existing records from primary storage. [2025-10-13T18:05:11.252425] [INFO ] [MAIN ] CMG: Loaded 54500 existing records. [2025-10-13T18:05:11.427510] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:11.427789] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-13T18:05:11.427836] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-13T18:05:11.428356] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-13T18:05:11.428411] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-13T18:05:11.618373] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-13T18:05:11.809026] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:11.835479] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:05:12.204980] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:05:12.417910] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-13T18:05:13.064589] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T18:05:13.217912] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-13T18:05:14.017945] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-13T18:05:14.514018] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:05:14.606302] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:05:14.817936] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-13T18:05:15.617911] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-13T18:05:16.199674] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:05:16.204465] [INFO ] [REMOTE ] CMA: Full fetch complete (72744 records). [2025-10-13T18:05:16.204600] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-13T18:05:16.205242] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:05:16.205341] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:05:16.205416] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:05:16.205510] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-13T18:05:16.205588] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-13T18:05:16.205624] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-13T18:05:16.205822] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-13T18:05:16.205911] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMA took 44.6s. Estimated remaining: 4h 20m 18s. Rate: 7.3 symbols/min [2025-10-13T18:05:16.374750] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:16.412872] [DEBUG] [LOCAL ] CMI: Loaded 42226 existing records from primary storage. [2025-10-13T18:05:16.413167] [INFO ] [MAIN ] CMI: Loaded 42226 existing records. [2025-10-13T18:05:16.424316] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-13T18:05:16.595884] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:16.596117] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-13T18:05:16.596165] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-13T18:05:16.596462] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-13T18:05:16.596518] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-13T18:05:16.955470] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:17.175450] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:05:17.217934] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-13T18:05:18.017981] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-13T18:05:18.389665] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:05:18.552933] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:05:18.817944] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-13T18:05:19.320722] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T18:05:19.617928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-13T18:05:20.417930] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-13T18:05:20.998436] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T18:05:21.080900] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:05:21.085594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:05:21.217928] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-13T18:05:21.694382] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T18:05:22.017982] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-13T18:05:22.817926] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-13T18:05:23.617927] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-13T18:05:23.818567] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:05:24.150673] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:05:24.417906] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-13T18:05:24.525544] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T18:05:24.935001] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:05:25.218004] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-13T18:05:26.017993] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-13T18:05:26.818017] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-13T18:05:27.316757] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:05:27.321570] [INFO ] [REMOTE ] CMC: Full fetch complete (66841 records). [2025-10-13T18:05:27.321705] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-13T18:05:27.444457] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:05:27.619550] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-13T18:05:27.699342] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-13T18:05:27.785038] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-13T18:05:27.785119] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-13T18:05:27.785895] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-13T18:05:27.785957] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-13T18:05:27.787205] [DEBUG] [LOCAL ] CMC: Trimmed 66841 records to 45377 (keeping 200 days of data) [2025-10-13T18:05:28.054134] [DEBUG] [LOCAL ] CMC: Primary data saved (45377 records). [2025-10-13T18:05:28.054285] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-13T18:05:28.054382] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 35.6s. Estimated remaining: 4h 20m 24s. Rate: 7.3 symbols/min [2025-10-13T18:05:28.220662] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:28.260483] [DEBUG] [LOCAL ] CMP: Loaded 36590 existing records from primary storage. [2025-10-13T18:05:28.261027] [INFO ] [MAIN ] CMP: Loaded 36590 existing records. [2025-10-13T18:05:28.422342] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-13T18:05:28.451388] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:28.453037] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-13T18:05:28.453946] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:05:28.453539] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-13T18:05:28.457161] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-13T18:05:28.457228] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-13T18:05:28.824163] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:29.217928] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-13T18:05:30.019461] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-13T18:05:30.022928] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:05:30.817918] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-13T18:05:31.226046] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:05:31.282221] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T18:05:31.617921] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-13T18:05:32.280352] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:05:32.417935] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-13T18:05:32.496834] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:05:32.498016] [INFO ] [REMOTE ] CMCM: Full fetch complete (6932 records). [2025-10-13T18:05:32.498098] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-13T18:05:32.855408] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-13T18:05:32.855486] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-13T18:05:32.855704] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-13T18:05:32.855767] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-13T18:05:32.856204] [DEBUG] [LOCAL ] CMCM: Trimmed 6932 records to 4858 (keeping 200 days of data) [2025-10-13T18:05:32.885254] [DEBUG] [LOCAL ] CMCM: Primary data saved (4858 records). [2025-10-13T18:05:32.885406] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-13T18:05:32.885537] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMCM took 24.9s. Estimated remaining: 4h 20m 2s. Rate: 7.3 symbols/min [2025-10-13T18:05:33.217944] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-13T18:05:33.939505] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T18:05:34.017932] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-13T18:05:34.681779] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:05:34.818140] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-13T18:05:35.617991] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-13T18:05:36.201163] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-13T18:05:36.423095] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-13T18:05:36.452096] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T18:05:36.956603] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:05:37.217904] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-13T18:05:38.017944] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-13T18:05:38.172305] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:05:38.493806] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:05:38.817928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-13T18:05:39.139516] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:05:39.617938] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-13T18:05:40.417913] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-13T18:05:40.539024] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:05:40.863895] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:05:41.217988] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-13T18:05:42.018031] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-13T18:05:42.484981] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T18:05:42.824086] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-13T18:05:42.847328] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T18:05:43.283310] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:05:43.617936] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-13T18:05:44.417942] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-13T18:05:45.054163] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T18:05:45.231541] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-13T18:05:45.234096] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:05:45.649904] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:05:46.017926] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-13T18:05:46.817932] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-13T18:05:47.485270] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-13T18:05:47.593991] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:05:47.598892] [INFO ] [REMOTE ] CMI: Full fetch complete (60298 records). [2025-10-13T18:05:47.599052] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-13T18:05:47.633354] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-13T18:05:48.016967] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-13T18:05:48.017048] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-13T18:05:48.017784] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-13T18:05:48.017850] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-13T18:05:48.019140] [DEBUG] [LOCAL ] CMI: Trimmed 60298 records to 41651 (keeping 200 days of data) [2025-10-13T18:05:48.306089] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:05:48.323024] [DEBUG] [LOCAL ] CMI: Primary data saved (41651 records). [2025-10-13T18:05:48.323810] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-13T18:05:48.324092] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 32.1s. Estimated remaining: 4h 20m 23s. Rate: 7.3 symbols/min [2025-10-13T18:05:48.324517] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-13T18:05:48.324869] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-13T18:05:48.680749] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:05:48.728530] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-13T18:05:48.823376] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-13T18:05:48.823458] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-13T18:05:48.824406] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-13T18:05:48.824471] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-13T18:05:48.827146] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53720 (keeping 200 days of data) [2025-10-13T18:05:49.143445] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-10-13T18:05:49.143582] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-13T18:05:49.144350] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMG took 38.1s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-13T18:05:50.138729] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:05:50.146079] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-13T18:05:51.406390] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:05:51.414517] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-13T18:05:52.657750] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T18:05:52.661225] [INFO ] [REMOTE ] CMP: Full fetch complete (51717 records). [2025-10-13T18:05:52.661346] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-13T18:05:53.037461] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-13T18:05:53.037552] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-13T18:05:53.038243] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-13T18:05:53.038307] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-13T18:05:53.039477] [DEBUG] [LOCAL ] CMP: Trimmed 51717 records to 35860 (keeping 200 days of data) [2025-10-13T18:05:53.249040] [DEBUG] [LOCAL ] CMP: Primary data saved (35860 records). [2025-10-13T18:05:53.249192] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-13T18:05:53.249291] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMP took 25.2s. Estimated remaining: 4h 19m 20s. Rate: 7.3 symbols/min [2025-10-13T18:05:53.917352] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:53.919044] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:53.914066] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:54.011858] [DEBUG] [LOCAL ] CMSA: Loaded 3556 existing records from primary storage. [2025-10-13T18:05:54.011535] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:54.012279] [INFO ] [MAIN ] CMSA: Loaded 3556 existing records. [2025-10-13T18:05:54.146953] [DEBUG] [LOCAL ] CMPO: Loaded 39544 existing records from primary storage. [2025-10-13T18:05:54.181368] [INFO ] [MAIN ] CMPO: Loaded 39544 existing records. [2025-10-13T18:05:54.272024] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:54.338117] [DEBUG] [LOCAL ] CMRE: Loaded 36148 existing records from primary storage. [2025-10-13T18:05:54.327612] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-13T18:05:54.357632] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-13T18:05:54.379840] [DEBUG] [LOCAL ] CMS: Loaded 53373 existing records from primary storage. [2025-10-13T18:05:54.362955] [INFO ] [MAIN ] CMRE: Loaded 36148 existing records. [2025-10-13T18:05:54.406997] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-13T18:05:54.414228] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-13T18:05:54.455538] [INFO ] [MAIN ] CMS: Loaded 53373 existing records. [2025-10-13T18:05:54.785912] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:54.830145] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-13T18:05:54.861317] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-13T18:05:54.925583] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-13T18:05:55.003232] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-13T18:05:55.040084] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:55.181713] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-13T18:05:55.227315] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:55.237417] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-13T18:05:55.296789] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-13T18:05:55.307290] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-13T18:05:55.318607] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-13T18:05:55.319030] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-13T18:05:55.342466] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-13T18:05:55.337194] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-13T18:05:55.720182] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:55.756708] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-13T18:05:56.226455] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.238804] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-13T18:05:56.469965] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.505233] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-13T18:05:56.526623] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.526955] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-13T18:05:56.663044] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:05:56.665434] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-13T18:05:57.222020] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:05:57.223755] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-13T18:05:57.494826] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:05:57.500298] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-13T18:05:57.618891] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T18:05:57.627224] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-13T18:05:57.690368] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:05:57.691601] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-13T18:05:57.939734] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T18:05:58.018025] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-13T18:05:58.058048] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:05:58.395310] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T18:05:58.817906] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-13T18:05:58.977200] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:05:59.618013] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-13T18:05:59.671895] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:05:59.901355] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:06:00.417929] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-13T18:06:01.115062] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:06:01.217929] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-13T18:06:01.783706] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:06:01.827394] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:06:02.018056] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-13T18:06:02.655194] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:06:02.817923] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-13T18:06:03.425263] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:06:03.617927] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-13T18:06:04.178508] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:06:04.417916] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-13T18:06:05.217928] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-13T18:06:06.019296] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-13T18:06:06.022035] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:06:06.491394] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T18:06:06.561328] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T18:06:06.818158] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-13T18:06:07.617930] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-13T18:06:08.124118] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T18:06:08.403989] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:06:08.417893] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-13T18:06:09.059995] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T18:06:09.061251] [INFO ] [REMOTE ] CMSA: Full fetch complete (5132 records). [2025-10-13T18:06:09.061334] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-13T18:06:09.220841] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-13T18:06:09.434399] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-13T18:06:09.434475] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-13T18:06:09.434638] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-13T18:06:09.434717] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-13T18:06:09.435086] [DEBUG] [LOCAL ] CMSA: Trimmed 5132 records to 3581 (keeping 200 days of data) [2025-10-13T18:06:09.458230] [DEBUG] [LOCAL ] CMSA: Primary data saved (3581 records). [2025-10-13T18:06:09.458376] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-13T18:06:09.458463] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 16.2s. Estimated remaining: 4h 19m 44s. Rate: 7.3 symbols/min [2025-10-13T18:06:09.629808] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:09.636058] [DEBUG] [LOCAL ] CMSC: Loaded 5028 existing records from primary storage. [2025-10-13T18:06:09.636325] [INFO ] [MAIN ] CMSC: Loaded 5028 existing records. [2025-10-13T18:06:09.816984] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:09.817273] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-13T18:06:09.817340] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-13T18:06:09.817516] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-13T18:06:09.817571] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-13T18:06:10.023094] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-13T18:06:10.166422] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:10.818029] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-13T18:06:10.976184] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:06:11.209988] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T18:06:11.617971] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-13T18:06:12.417916] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-13T18:06:12.555293] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:06:12.619333] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T18:06:13.030601] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:06:13.217905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-13T18:06:14.017923] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-13T18:06:14.610021] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:06:14.817899] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-13T18:06:15.057453] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:06:15.617917] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-13T18:06:15.961391] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T18:06:16.418004] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-13T18:06:16.965141] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:06:17.217933] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-13T18:06:17.502735] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T18:06:18.017915] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-13T18:06:18.700725] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T18:06:18.725866] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:06:18.817910] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-13T18:06:19.617994] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-13T18:06:20.417911] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-13T18:06:21.217911] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-13T18:06:21.252518] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:06:21.720278] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T18:06:22.017901] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-13T18:06:22.806252] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T18:06:22.817878] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-13T18:06:23.224184] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (4.41 seconds). [2025-10-13T18:06:23.584401] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:06:23.617934] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-13T18:06:24.057751] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:06:24.157921] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:06:24.417943] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-13T18:06:24.864277] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:06:25.217944] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-13T18:06:26.018011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-13T18:06:26.815382] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T18:06:26.819839] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-13T18:06:27.335050] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:06:27.479635] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:06:27.618031] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-13T18:06:28.097810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T18:06:28.417922] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-13T18:06:28.873636] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T18:06:29.217924] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-13T18:06:29.844567] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:06:29.845524] [INFO ] [REMOTE ] CMSC: Full fetch complete (7131 records). [2025-10-13T18:06:29.845592] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-13T18:06:30.034904] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-13T18:06:30.226374] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-13T18:06:30.226483] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-13T18:06:30.226831] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-13T18:06:30.226897] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-13T18:06:30.227346] [DEBUG] [LOCAL ] CMSC: Trimmed 7131 records to 4921 (keeping 200 days of data) [2025-10-13T18:06:30.257627] [DEBUG] [LOCAL ] CMSC: Primary data saved (4921 records). [2025-10-13T18:06:30.257776] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-13T18:06:30.257870] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 20.8s. Estimated remaining: 4h 20m 25s. Rate: 7.3 symbols/min [2025-10-13T18:06:30.430281] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:30.440196] [DEBUG] [LOCAL ] CMSD: Loaded 8081 existing records from primary storage. [2025-10-13T18:06:30.440419] [INFO ] [MAIN ] CMSD: Loaded 8081 existing records. [2025-10-13T18:06:30.617892] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:30.618219] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-13T18:06:30.618268] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-13T18:06:30.618499] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-13T18:06:30.618557] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-13T18:06:30.823250] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-13T18:06:31.012584] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:31.617904] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-13T18:06:31.698790] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:06:32.051007] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:06:32.054996] [INFO ] [REMOTE ] CMRE: Full fetch complete (50792 records). [2025-10-13T18:06:32.055143] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-13T18:06:32.425757] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-13T18:06:32.446469] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-13T18:06:32.446789] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-13T18:06:32.447517] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-13T18:06:32.447600] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-13T18:06:32.457742] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:06:32.461824] [DEBUG] [LOCAL ] CMRE: Trimmed 50792 records to 35869 (keeping 200 days of data) [2025-10-13T18:06:32.678549] [DEBUG] [LOCAL ] CMRE: Primary data saved (35869 records). [2025-10-13T18:06:32.678728] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-13T18:06:32.678856] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 39.4s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-13T18:06:32.853679] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:32.887212] [DEBUG] [LOCAL ] CMTG: Loaded 36633 existing records from primary storage. [2025-10-13T18:06:32.887529] [INFO ] [MAIN ] CMTG: Loaded 36633 existing records. [2025-10-13T18:06:33.064805] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:33.065065] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-13T18:06:33.065125] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-13T18:06:33.065460] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-13T18:06:33.065528] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-13T18:06:33.224244] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-13T18:06:33.448772] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:33.973561] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T18:06:33.975235] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T18:06:33.984444] [INFO ] [REMOTE ] CMS: Full fetch complete (75994 records). [2025-10-13T18:06:33.984573] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-13T18:06:34.022986] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-13T18:06:34.423166] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-13T18:06:34.423261] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-13T18:06:34.424171] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-13T18:06:34.424236] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-13T18:06:34.425813] [DEBUG] [LOCAL ] CMS: Trimmed 75994 records to 52606 (keeping 200 days of data) [2025-10-13T18:06:34.736196] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T18:06:34.758058] [DEBUG] [LOCAL ] CMS: Primary data saved (52606 records). [2025-10-13T18:06:34.758155] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-13T18:06:34.758990] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 41.5s. Estimated remaining: 4h 19m 21s. Rate: 7.3 symbols/min [2025-10-13T18:06:34.823134] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-13T18:06:34.931823] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:34.940944] [DEBUG] [LOCAL ] CMU: Loaded 6399 existing records from primary storage. [2025-10-13T18:06:34.941181] [INFO ] [MAIN ] CMU: Loaded 6399 existing records. [2025-10-13T18:06:35.131329] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:35.131818] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-13T18:06:35.131876] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-13T18:06:35.132034] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-13T18:06:35.132089] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-13T18:06:35.486737] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:35.617902] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-13T18:06:36.260747] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:06:36.302958] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T18:06:36.417879] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-13T18:06:36.935989] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T18:06:37.217936] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-13T18:06:37.669892] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:06:38.017947] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-13T18:06:38.818014] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-13T18:06:39.168512] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:06:39.486705] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T18:06:39.617936] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-13T18:06:40.394973] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:06:40.417886] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-13T18:06:40.875270] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T18:06:41.217919] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-13T18:06:42.018015] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-13T18:06:42.542179] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:06:42.817926] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-13T18:06:43.377493] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T18:06:43.381312] [INFO ] [REMOTE ] CMPO: Full fetch complete (58631 records). [2025-10-13T18:06:43.381404] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-13T18:06:43.623047] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-13T18:06:43.801809] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-13T18:06:43.801913] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-13T18:06:43.802855] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-13T18:06:43.802935] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-13T18:06:43.804420] [DEBUG] [LOCAL ] CMPO: Trimmed 58631 records to 38915 (keeping 200 days of data) [2025-10-13T18:06:44.031722] [DEBUG] [LOCAL ] CMPO: Primary data saved (38915 records). [2025-10-13T18:06:44.031876] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-13T18:06:44.031961] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMPO took 50.8s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-13T18:06:44.203666] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:44.203966] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-13T18:06:44.204695] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-13T18:06:44.204896] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-13T18:06:44.204968] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-13T18:06:44.218348] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-13T18:06:44.218429] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-13T18:06:44.302218] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:06:44.419697] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-13T18:06:44.530304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T18:06:44.608579] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:45.217917] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-13T18:06:45.566583] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T18:06:45.990017] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:06:46.017918] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-13T18:06:46.662156] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:06:46.817993] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-13T18:06:47.312085] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T18:06:47.617981] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-13T18:06:48.402105] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T18:06:48.418006] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-13T18:06:48.983330] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T18:06:49.217912] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-13T18:06:50.017925] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-13T18:06:50.548424] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:06:50.548238] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:06:50.817940] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-13T18:06:51.617932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-13T18:06:52.193624] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T18:06:52.418009] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-13T18:06:52.549989] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:06:53.217940] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-13T18:06:53.948567] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:06:54.017919] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-13T18:06:54.416058] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:06:54.817924] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-13T18:06:55.274083] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T18:06:55.617943] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-13T18:06:55.703919] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T18:06:56.373221] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:06:56.418012] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-13T18:06:57.217973] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-13T18:06:57.423252] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:06:57.818589] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T18:06:58.017992] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-13T18:06:58.817983] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-13T18:06:59.062309] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:06:59.617899] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-13T18:06:59.903724] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:07:00.142690] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:07:00.417911] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-13T18:07:01.217904] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-13T18:07:01.362953] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:07:01.363940] [INFO ] [REMOTE ] CMU: Full fetch complete (9578 records). [2025-10-13T18:07:01.364007] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-13T18:07:01.743427] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-13T18:07:01.743527] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-13T18:07:01.743832] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-13T18:07:01.743894] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-13T18:07:01.744315] [DEBUG] [LOCAL ] CMU: Trimmed 9578 records to 6355 (keeping 200 days of data) [2025-10-13T18:07:01.785412] [DEBUG] [LOCAL ] CMU: Primary data saved (6355 records). [2025-10-13T18:07:01.785566] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-13T18:07:01.785676] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMU took 27.0s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-13T18:07:01.895560] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:07:01.907986] [INFO ] [REMOTE ] CMSD: Full fetch complete (11917 records). [2025-10-13T18:07:01.918437] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-13T18:07:01.944206] [FATAL] [VALIDATOR ] CMSD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:07:01.971040] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:01.971205] [FATAL] [MAIN ] CMSD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:07:01.971411] [WARN ] [MAIN ] CMSD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:07:01.971498] [DEBUG] [LOCAL ] CNC: No existing data file found in primary storage. [2025-10-13T18:07:01.971631] [WARN ] [MAIN ] CNC: No existing data found, performing full refresh instead. [2025-10-13T18:07:01.971884] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-13T18:07:01.971954] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-13T18:07:01.972044] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-10-13T18:07:01.972117] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-13T18:07:01.971721] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-13T18:07:02.019064] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-13T18:07:02.031717] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-10-13T18:07:02.041371] [INFO ] [LOCAL ] CMSD: Starting deletion of derivative data. [2025-10-13T18:07:02.059353] [DEBUG] [LOCAL ] CMSD: Deleted derivative data file. [2025-10-13T18:07:02.059600] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMSD took 31.8s. Estimated remaining: 4h 19m 6s. Rate: 7.3 symbols/min [2025-10-13T18:07:02.435001] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:02.502783] [DEBUG] [LOCAL ] CNF: Loaded 10690 existing records from primary storage. [2025-10-13T18:07:02.517142] [INFO ] [MAIN ] CNF: Loaded 10690 existing records. [2025-10-13T18:07:02.522484] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:02.694801] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:02.695091] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-13T18:07:02.695137] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-13T18:07:02.695348] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-13T18:07:02.695404] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-13T18:07:02.830607] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-13T18:07:03.042544] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:03.379166] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:07:03.617913] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-13T18:07:04.417930] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-13T18:07:04.612135] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:07:04.879960] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T18:07:05.217935] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-13T18:07:05.780054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:07:05.853597] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:07:06.017932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-13T18:07:06.817934] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-13T18:07:07.450580] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:07:07.617932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-13T18:07:07.975359] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T18:07:08.417935] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-13T18:07:09.054234] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:07:09.218086] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-13T18:07:09.273192] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:07:10.017920] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-13T18:07:10.279402] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:07:10.817999] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-13T18:07:11.314493] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T18:07:11.548514] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T18:07:11.617925] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-13T18:07:12.417926] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-13T18:07:13.217897] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-13T18:07:13.394566] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:07:13.426708] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:07:14.017928] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-13T18:07:14.204295] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T18:07:14.207712] [INFO ] [REMOTE ] CNA: Full fetch complete (45836 records). [2025-10-13T18:07:14.207814] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-13T18:07:14.579382] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-13T18:07:14.579497] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-13T18:07:14.580124] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-13T18:07:14.580208] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-13T18:07:14.589161] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:07:14.592936] [DEBUG] [LOCAL ] CNA: Trimmed 45836 records to 32939 (keeping 200 days of data) [2025-10-13T18:07:14.790295] [DEBUG] [LOCAL ] CNA: Primary data saved (32939 records). [2025-10-13T18:07:14.790443] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-13T18:07:14.790518] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 30.8s. Estimated remaining: 4h 19m 15s. Rate: 7.3 symbols/min [2025-10-13T18:07:14.823045] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-13T18:07:14.961757] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:14.961922] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-13T18:07:14.961961] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-13T18:07:14.962068] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-13T18:07:14.962115] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-13T18:07:14.962196] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-13T18:07:14.962246] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-13T18:07:15.311048] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:15.617915] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-13T18:07:16.005020] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:07:16.008232] [INFO ] [REMOTE ] CMTG: Full fetch complete (53323 records). [2025-10-13T18:07:16.008316] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-13T18:07:16.394140] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-13T18:07:16.394230] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-13T18:07:16.395084] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-13T18:07:16.395165] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-13T18:07:16.396637] [DEBUG] [LOCAL ] CMTG: Trimmed 53323 records to 35912 (keeping 200 days of data) [2025-10-13T18:07:16.440636] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-13T18:07:16.593762] [DEBUG] [LOCAL ] CMTG: Primary data saved (35912 records). [2025-10-13T18:07:16.593899] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-13T18:07:16.593978] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CMTG took 43.9s. Estimated remaining: 4h 18m 42s. Rate: 7.3 symbols/min [2025-10-13T18:07:16.759247] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:16.810917] [DEBUG] [LOCAL ] CNI: Loaded 52437 existing records from primary storage. [2025-10-13T18:07:16.811275] [INFO ] [MAIN ] CNI: Loaded 52437 existing records. [2025-10-13T18:07:16.983375] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:16.983630] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-13T18:07:16.983709] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-13T18:07:16.983976] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-13T18:07:16.984032] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-13T18:07:17.221958] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-13T18:07:17.266174] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T18:07:17.349487] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:17.588930] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T18:07:18.017928] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-13T18:07:18.817904] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-13T18:07:19.106270] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T18:07:19.399862] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:07:19.617943] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-13T18:07:19.862983] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:07:20.418005] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-13T18:07:20.604911] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T18:07:21.217922] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-13T18:07:22.017892] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-13T18:07:22.055246] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:07:22.782779] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:07:22.817935] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-13T18:07:23.145601] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T18:07:23.617977] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-13T18:07:24.275622] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:07:24.276952] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:07:24.417917] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-13T18:07:25.218023] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-13T18:07:25.534264] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:07:26.017941] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-13T18:07:26.824292] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-13T18:07:26.830308] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:07:27.617920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-13T18:07:27.700072] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:07:28.408502] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:07:28.410306] [INFO ] [REMOTE ] CNF: Full fetch complete (13191 records). [2025-10-13T18:07:28.410387] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-13T18:07:28.423001] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-13T18:07:28.559411] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T18:07:28.818911] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-13T18:07:28.819025] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-13T18:07:28.819559] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-13T18:07:28.819689] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-13T18:07:28.820405] [DEBUG] [LOCAL ] CNF: Trimmed 13191 records to 10620 (keeping 200 days of data) [2025-10-13T18:07:28.884768] [DEBUG] [LOCAL ] CNF: Primary data saved (10620 records). [2025-10-13T18:07:28.884921] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-13T18:07:28.885008] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNF took 26.8s. Estimated remaining: 4h 18m 49s. Rate: 7.3 symbols/min [2025-10-13T18:07:29.050815] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:29.051004] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-13T18:07:29.051041] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-13T18:07:29.051148] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-13T18:07:29.051188] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-13T18:07:29.051228] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-13T18:07:29.051259] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-13T18:07:29.224290] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-13T18:07:29.405154] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:30.017942] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-13T18:07:30.230190] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T18:07:30.817920] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-13T18:07:31.543344] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T18:07:31.599721] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:07:31.617892] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-13T18:07:32.417988] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-13T18:07:32.659600] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:07:33.217917] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-13T18:07:33.798266] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T18:07:34.017903] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-13T18:07:34.096485] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:07:34.673186] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:07:34.817913] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-13T18:07:35.617916] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-13T18:07:35.723636] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:07:36.417932] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-13T18:07:36.538601] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:07:37.086376] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:07:37.217912] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-13T18:07:37.889766] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:07:38.017988] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-13T18:07:38.828352] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-13T18:07:38.836945] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T18:07:39.617982] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-13T18:07:40.151599] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:07:40.292149] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-13T18:07:40.417948] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-13T18:07:41.028071] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T18:07:41.034074] [INFO ] [REMOTE ] CNC: Full fetch complete (77676 records). [2025-10-13T18:07:41.034243] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-13T18:07:41.223811] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-13T18:07:41.491098] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-13T18:07:41.491202] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-13T18:07:41.492219] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-13T18:07:41.492333] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-13T18:07:41.494245] [DEBUG] [LOCAL ] CNC: Trimmed 77676 records to 53764 (keeping 200 days of data) [2025-10-13T18:07:41.526621] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T18:07:41.872460] [DEBUG] [LOCAL ] CNC: Primary data saved (53764 records). [2025-10-13T18:07:41.872600] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-13T18:07:41.872695] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNC took 40.1s. Estimated remaining: 4h 18m 59s. Rate: 7.3 symbols/min [2025-10-13T18:07:42.031185] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-13T18:07:42.064801] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:42.112390] [DEBUG] [LOCAL ] CNM: Loaded 51806 existing records from primary storage. [2025-10-13T18:07:42.112920] [INFO ] [MAIN ] CNM: Loaded 51806 existing records. [2025-10-13T18:07:42.285036] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:42.285278] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-13T18:07:42.285325] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-13T18:07:42.285588] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-13T18:07:42.285625] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-13T18:07:42.630346] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:42.817918] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-13T18:07:42.859362] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:07:43.617922] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-13T18:07:43.890777] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T18:07:44.382370] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:07:44.417892] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-13T18:07:45.217987] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-13T18:07:45.280536] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T18:07:45.944519] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:07:46.017988] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-13T18:07:46.829121] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-13T18:07:46.835066] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:07:47.612109] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T18:07:47.617182] [INFO ] [REMOTE ] CNI: Full fetch complete (74567 records). [2025-10-13T18:07:47.617290] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-13T18:07:47.628967] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-13T18:07:48.022603] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-13T18:07:48.022708] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-13T18:07:48.023516] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-13T18:07:48.023557] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-13T18:07:48.024978] [DEBUG] [LOCAL ] CNI: Trimmed 74567 records to 51689 (keeping 200 days of data) [2025-10-13T18:07:48.340947] [DEBUG] [LOCAL ] CNI: Primary data saved (51689 records). [2025-10-13T18:07:48.341071] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-13T18:07:48.341149] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 31.7s. Estimated remaining: 4h 18m 44s. Rate: 7.3 symbols/min [2025-10-13T18:07:48.420190] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-13T18:07:48.511146] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:48.511481] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-13T18:07:48.511548] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-13T18:07:48.511885] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-13T18:07:48.511977] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-13T18:07:48.512111] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-13T18:07:48.512166] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-13T18:07:48.643602] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:07:48.919222] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:49.217970] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-13T18:07:49.322887] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T18:07:50.017933] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-13T18:07:50.404232] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T18:07:50.467507] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:07:50.817938] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-13T18:07:51.617937] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-13T18:07:51.901867] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:07:52.023055] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:07:52.418072] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-13T18:07:53.162034] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T18:07:53.217923] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-13T18:07:53.341157] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T18:07:54.018019] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-13T18:07:54.546784] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T18:07:54.817924] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-13T18:07:55.620878] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-13T18:07:55.626297] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:07:56.417899] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-13T18:07:56.701413] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:07:57.028927] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:07:57.217933] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-13T18:07:58.017983] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-13T18:07:58.104994] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T18:07:58.814192] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:07:58.827365] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-13T18:07:59.274955] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T18:07:59.617933] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-13T18:08:00.417914] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-13T18:08:00.640454] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T18:08:00.646196] [INFO ] [REMOTE ] CNH: Full fetch complete (77540 records). [2025-10-13T18:08:00.646331] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-13T18:08:01.026380] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-13T18:08:01.026462] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-13T18:08:01.027339] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-13T18:08:01.027405] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-13T18:08:01.037103] [DEBUG] [LOCAL ] CNH: Trimmed 77540 records to 53551 (keeping 200 days of data) [2025-10-13T18:08:01.219410] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-13T18:08:01.362043] [DEBUG] [LOCAL ] CNH: Primary data saved (53551 records). [2025-10-13T18:08:01.362180] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-13T18:08:01.362293] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNH took 46.6s. Estimated remaining: 4h 18m 54s. Rate: 7.3 symbols/min [2025-10-13T18:08:01.534378] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:01.572424] [DEBUG] [LOCAL ] CNNE: Loaded 36726 existing records from primary storage. [2025-10-13T18:08:01.572720] [INFO ] [MAIN ] CNNE: Loaded 36726 existing records. [2025-10-13T18:08:01.751420] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:01.751929] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-13T18:08:01.752146] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-13T18:08:01.752884] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-13T18:08:01.753257] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-13T18:08:02.100266] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-13T18:08:02.112301] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:08:02.211701] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:02.212681] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-13T18:08:02.544284] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:08:02.817925] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-13T18:08:03.535058] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:08:03.617943] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-13T18:08:04.417938] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-13T18:08:04.530924] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:08:04.576492] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:08:05.217989] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-13T18:08:05.764623] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:08:06.018032] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-13T18:08:06.823083] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-13T18:08:06.842617] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:08:07.237835] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:08:07.617894] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-13T18:08:08.417915] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-13T18:08:08.598468] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:08:08.959949] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:08:09.218016] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-13T18:08:10.017976] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-13T18:08:10.082710] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:08:10.273988] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:08:10.817984] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-13T18:08:11.052552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:08:11.617931] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-13T18:08:12.196293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:08:12.199628] [INFO ] [REMOTE ] CNMD: Full fetch complete (47223 records). [2025-10-13T18:08:12.199744] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-13T18:08:12.423278] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-13T18:08:12.583187] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-13T18:08:12.583268] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-13T18:08:12.583883] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-13T18:08:12.583947] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-13T18:08:12.584903] [DEBUG] [LOCAL ] CNMD: Trimmed 47223 records to 32170 (keeping 200 days of data) [2025-10-13T18:08:12.785797] [DEBUG] [LOCAL ] CNMD: Primary data saved (32170 records). [2025-10-13T18:08:12.785935] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-13T18:08:12.786007] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 24.4s. Estimated remaining: 4h 18m 58s. Rate: 7.2 symbols/min [2025-10-13T18:08:12.956300] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:12.995218] [DEBUG] [LOCAL ] CNO: Loaded 41472 existing records from primary storage. [2025-10-13T18:08:12.995516] [INFO ] [MAIN ] CNO: Loaded 41472 existing records. [2025-10-13T18:08:13.179301] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:13.179549] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-13T18:08:13.179604] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-13T18:08:13.180189] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-13T18:08:13.180251] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-13T18:08:13.218071] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-13T18:08:13.604416] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:13.643687] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T18:08:14.018012] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-13T18:08:14.087817] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:08:14.726790] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:08:14.732217] [INFO ] [REMOTE ] CNK: Full fetch complete (75897 records). [2025-10-13T18:08:14.732339] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-13T18:08:14.825781] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-13T18:08:15.127591] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-13T18:08:15.127737] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-13T18:08:15.128638] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-13T18:08:15.128741] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-13T18:08:15.130232] [DEBUG] [LOCAL ] CNK: Trimmed 75897 records to 52898 (keeping 200 days of data) [2025-10-13T18:08:15.267999] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:08:15.485308] [DEBUG] [LOCAL ] CNK: Primary data saved (52898 records). [2025-10-13T18:08:15.485439] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-13T18:08:15.485510] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNK took 46.6s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-13T18:08:15.626848] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-13T18:08:15.658393] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:15.706374] [DEBUG] [LOCAL ] CNP: Loaded 54250 existing records from primary storage. [2025-10-13T18:08:15.706706] [INFO ] [MAIN ] CNP: Loaded 54250 existing records. [2025-10-13T18:08:15.879531] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:15.879785] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-13T18:08:15.879833] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-13T18:08:15.880145] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-13T18:08:15.880200] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-13T18:08:16.231741] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:16.275499] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:08:16.417931] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-13T18:08:17.217922] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-13T18:08:17.461730] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:08:17.466936] [INFO ] [REMOTE ] CNM: Full fetch complete (73581 records). [2025-10-13T18:08:17.467060] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-13T18:08:17.865504] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-13T18:08:17.865623] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-13T18:08:17.866627] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-13T18:08:17.866740] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-13T18:08:17.868595] [DEBUG] [LOCAL ] CNM: Trimmed 73581 records to 51013 (keeping 200 days of data) [2025-10-13T18:08:18.007506] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:08:18.020205] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-13T18:08:18.243955] [DEBUG] [LOCAL ] CNM: Primary data saved (51013 records). [2025-10-13T18:08:18.244285] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-13T18:08:18.245427] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNM took 36.4s. Estimated remaining: 4h 17m 59s. Rate: 7.3 symbols/min [2025-10-13T18:08:18.433848] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:18.509597] [DEBUG] [LOCAL ] CNQ: Loaded 54357 existing records from primary storage. [2025-10-13T18:08:18.510083] [INFO ] [MAIN ] CNQ: Loaded 54357 existing records. [2025-10-13T18:08:18.575611] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:08:18.697740] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:18.697961] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-13T18:08:18.698023] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-13T18:08:18.698302] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-13T18:08:18.698358] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-13T18:08:18.823143] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-13T18:08:19.051256] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:19.268316] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:08:19.618017] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-13T18:08:20.417972] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-13T18:08:20.641342] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T18:08:21.055475] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T18:08:21.217973] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-13T18:08:21.771022] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:08:22.017946] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-13T18:08:22.817977] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-13T18:08:22.953228] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:08:23.578081] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:08:23.617912] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-13T18:08:24.218119] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:08:24.417982] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-13T18:08:25.217976] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-13T18:08:25.257736] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:08:26.017915] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-13T18:08:26.104676] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:08:26.646892] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:08:26.817927] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-13T18:08:27.617992] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-13T18:08:27.855482] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T18:08:28.310235] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T18:08:28.417886] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-13T18:08:29.151132] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:08:29.217913] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-13T18:08:29.654343] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:08:30.017923] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-13T18:08:30.817904] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-13T18:08:31.022307] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:08:31.307106] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:08:31.618198] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-13T18:08:32.105610] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:08:32.417938] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-13T18:08:33.218010] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-13T18:08:33.286842] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T18:08:34.018040] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-13T18:08:34.242528] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:08:34.487893] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T18:08:34.817906] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-13T18:08:35.231628] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:08:35.618016] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-13T18:08:36.417941] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-13T18:08:36.587881] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:08:36.976017] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:08:37.218015] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-13T18:08:37.647478] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T18:08:38.017921] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-13T18:08:38.515379] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:08:38.520120] [INFO ] [REMOTE ] CNO: Full fetch complete (60580 records). [2025-10-13T18:08:38.520302] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-13T18:08:38.823188] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-13T18:08:38.931353] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-13T18:08:38.931463] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-13T18:08:38.932528] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-13T18:08:38.932623] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-13T18:08:38.934362] [DEBUG] [LOCAL ] CNO: Trimmed 60580 records to 40746 (keeping 200 days of data) [2025-10-13T18:08:39.199473] [DEBUG] [LOCAL ] CNO: Primary data saved (40746 records). [2025-10-13T18:08:39.199723] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-13T18:08:39.199829] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 26.4s. Estimated remaining: 4h 18m 39s. Rate: 7.2 symbols/min [2025-10-13T18:08:39.377748] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:39.377994] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-13T18:08:39.378050] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-13T18:08:39.378178] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-13T18:08:39.378221] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-13T18:08:39.378265] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-13T18:08:39.378300] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-13T18:08:39.626771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-13T18:08:39.762323] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:39.963684] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:08:40.417944] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-13T18:08:40.623704] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:08:41.040231] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:08:41.043999] [INFO ] [REMOTE ] CNNE: Full fetch complete (50242 records). [2025-10-13T18:08:41.044081] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-13T18:08:41.222422] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-13T18:08:41.429329] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-13T18:08:41.429419] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-13T18:08:41.430078] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-13T18:08:41.430141] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-13T18:08:41.431255] [DEBUG] [LOCAL ] CNNE: Trimmed 50242 records to 35998 (keeping 200 days of data) [2025-10-13T18:08:41.539776] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:08:41.542416] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-13T18:08:41.543520] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:08:41.544109] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-13T18:08:41.544744] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:08:41.545430] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-13T18:08:41.545893] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-13T18:08:41.546434] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-13T18:08:41.547820] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-13T18:08:41.549232] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNR took 2.3s. Estimated remaining: 4h 18m 8s. Rate: 7.3 symbols/min [2025-10-13T18:08:41.839532] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:41.844482] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-13T18:08:41.844637] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-13T18:08:41.844857] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-13T18:08:41.845664] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-13T18:08:41.846448] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-13T18:08:41.846933] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-13T18:08:41.947153] [DEBUG] [LOCAL ] CNNE: Primary data saved (35998 records). [2025-10-13T18:08:41.960018] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-13T18:08:41.960323] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNNE took 40.6s. Estimated remaining: 4h 17m 30s. Rate: 7.3 symbols/min [2025-10-13T18:08:42.026081] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-13T18:08:42.306867] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:42.498569] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T18:08:42.492455] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:42.551811] [DEBUG] [LOCAL ] CNX: Loaded 52074 existing records from primary storage. [2025-10-13T18:08:42.552277] [INFO ] [MAIN ] CNX: Loaded 52074 existing records. [2025-10-13T18:08:42.735508] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:42.735883] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-13T18:08:42.735938] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-13T18:08:42.736443] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-13T18:08:42.736502] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-13T18:08:42.823209] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-13T18:08:43.117620] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:43.617990] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-13T18:08:43.887228] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T18:08:43.909166] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:08:44.417912] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-13T18:08:45.165522] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:08:45.217976] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-13T18:08:46.017886] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-13T18:08:46.210063] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:08:46.817918] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-13T18:08:46.854859] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:08:47.137577] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:08:47.617930] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-13T18:08:48.369068] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:08:48.417893] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-13T18:08:48.684950] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:08:49.217921] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-13T18:08:49.918043] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:08:50.017979] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-13T18:08:50.817911] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-13T18:08:50.915459] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T18:08:51.352044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T18:08:51.617980] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-13T18:08:51.833146] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T18:08:52.417930] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-13T18:08:53.031968] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:08:53.038043] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-10-13T18:08:53.038197] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-13T18:08:53.220059] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-13T18:08:53.433737] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-13T18:08:53.433826] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-13T18:08:53.434714] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-13T18:08:53.434778] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-13T18:08:53.436263] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53480 (keeping 200 days of data) [2025-10-13T18:08:53.811363] [DEBUG] [LOCAL ] CNP: Primary data saved (53480 records). [2025-10-13T18:08:53.811517] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-13T18:08:53.811665] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNP took 38.3s. Estimated remaining: 4h 17m 36s. Rate: 7.3 symbols/min [2025-10-13T18:08:54.014985] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:54.018078] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-13T18:08:54.054418] [DEBUG] [LOCAL ] CODI: Loaded 41380 existing records from primary storage. [2025-10-13T18:08:54.054782] [INFO ] [MAIN ] CODI: Loaded 41380 existing records. [2025-10-13T18:08:54.296631] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:54.297405] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-13T18:08:54.297474] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-13T18:08:54.300270] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-13T18:08:54.300186] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T18:08:54.300458] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-13T18:08:54.698990] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:54.817919] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-13T18:08:54.947971] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T18:08:54.953534] [INFO ] [REMOTE ] CNQ: Full fetch complete (77556 records). [2025-10-13T18:08:54.953732] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-13T18:08:55.153758] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T18:08:55.388581] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-13T18:08:55.388734] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-13T18:08:55.389897] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-13T18:08:55.389964] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-13T18:08:55.392154] [DEBUG] [LOCAL ] CNQ: Trimmed 77556 records to 53583 (keeping 200 days of data) [2025-10-13T18:08:55.618133] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-13T18:08:55.753171] [DEBUG] [LOCAL ] CNQ: Primary data saved (53583 records). [2025-10-13T18:08:55.753435] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-13T18:08:55.754736] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNQ took 37.5s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-13T18:08:55.939775] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:56.007125] [DEBUG] [LOCAL ] COF: Loaded 54392 existing records from primary storage. [2025-10-13T18:08:56.007573] [INFO ] [MAIN ] COF: Loaded 54392 existing records. [2025-10-13T18:08:56.198108] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:56.198379] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-13T18:08:56.198433] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-13T18:08:56.199098] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-13T18:08:56.199158] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-13T18:08:56.420670] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-13T18:08:56.602605] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:56.611586] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:08:56.654138] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:08:57.217936] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-13T18:08:57.714570] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T18:08:58.017901] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-13T18:08:58.078709] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:08:58.817998] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-13T18:08:59.617897] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-13T18:08:59.675461] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:08:59.762912] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:09:00.417940] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-13T18:09:00.708671] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T18:09:01.217919] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-13T18:09:01.396841] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T18:09:02.017944] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-13T18:09:02.817987] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-13T18:09:02.972238] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:09:03.416419] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:09:03.617971] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-13T18:09:03.755909] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T18:09:04.418032] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-13T18:09:05.069080] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:09:05.217920] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-13T18:09:05.811248] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:09:06.017990] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-13T18:09:06.817903] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-13T18:09:06.992615] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:09:07.590509] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:09:07.617898] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-13T18:09:08.191722] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:09:08.417986] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-13T18:09:09.218028] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-13T18:09:09.433560] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T18:09:09.436716] [INFO ] [REMOTE ] CNS: Full fetch complete (30510 records). [2025-10-13T18:09:09.436801] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-13T18:09:09.660221] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T18:09:09.952528] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-13T18:09:09.952634] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-13T18:09:09.953471] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-13T18:09:09.953521] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-13T18:09:09.954587] [DEBUG] [LOCAL ] CNS: Trimmed 30510 records to 21008 (keeping 200 days of data) [2025-10-13T18:09:10.025846] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-13T18:09:10.111109] [DEBUG] [LOCAL ] CNS: Primary data saved (21008 records). [2025-10-13T18:09:10.111310] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-13T18:09:10.111413] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNS took 28.6s. Estimated remaining: 4h 17m 18s. Rate: 7.3 symbols/min [2025-10-13T18:09:10.300769] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:10.360250] [DEBUG] [LOCAL ] COHR: Loaded 54151 existing records from primary storage. [2025-10-13T18:09:10.360772] [INFO ] [MAIN ] COHR: Loaded 54151 existing records. [2025-10-13T18:09:10.562346] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:10.562993] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-13T18:09:10.563177] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-13T18:09:10.563797] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-13T18:09:10.563859] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-13T18:09:10.698330] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:09:10.823147] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-13T18:09:10.964233] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:11.617932] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-13T18:09:11.772470] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:09:12.298482] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:09:12.417910] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-13T18:09:13.217943] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-13T18:09:13.565415] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:09:14.017984] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-13T18:09:14.120127] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:09:14.817932] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-13T18:09:14.847398] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:09:15.617906] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-13T18:09:15.655055] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:09:16.413215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T18:09:16.421974] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-13T18:09:17.217921] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-13T18:09:17.539604] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T18:09:18.017931] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-13T18:09:18.071697] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:09:18.817982] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-13T18:09:19.338084] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T18:09:19.617915] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-13T18:09:19.952206] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T18:09:20.327534] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:09:20.332942] [INFO ] [REMOTE ] CNX: Full fetch complete (74727 records). [2025-10-13T18:09:20.333053] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-13T18:09:20.423853] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-13T18:09:20.725589] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-13T18:09:20.725730] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-13T18:09:20.726669] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-13T18:09:20.726732] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-13T18:09:20.728285] [DEBUG] [LOCAL ] CNX: Trimmed 74727 records to 51343 (keeping 200 days of data) [2025-10-13T18:09:21.025261] [DEBUG] [LOCAL ] CNX: Primary data saved (51343 records). [2025-10-13T18:09:21.025397] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-13T18:09:21.025479] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 39.1s. Estimated remaining: 4h 17m 20s. Rate: 7.3 symbols/min [2025-10-13T18:09:21.194302] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:21.194541] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-13T18:09:21.194635] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-13T18:09:21.194835] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-13T18:09:21.194889] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-13T18:09:21.194933] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-13T18:09:21.194966] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-13T18:09:21.225041] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-13T18:09:21.570018] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:21.628963] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T18:09:21.898033] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T18:09:22.017924] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-13T18:09:22.817890] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-13T18:09:23.243115] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T18:09:23.543682] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T18:09:23.549802] [INFO ] [REMOTE ] CODI: Full fetch complete (52100 records). [2025-10-13T18:09:23.549952] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-13T18:09:23.623051] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-13T18:09:24.031905] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-13T18:09:24.032022] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-13T18:09:24.033038] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-13T18:09:24.033130] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-13T18:09:24.034832] [DEBUG] [LOCAL ] CODI: Trimmed 52100 records to 41051 (keeping 200 days of data) [2025-10-13T18:09:24.346557] [DEBUG] [LOCAL ] CODI: Primary data saved (41051 records). [2025-10-13T18:09:24.346766] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-13T18:09:24.346895] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. CODI took 30.5s. Estimated remaining: 4h 16m 53s. Rate: 7.3 symbols/min [2025-10-13T18:09:24.424562] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-13T18:09:24.583404] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:24.583872] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-13T18:09:24.583943] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-13T18:09:24.584309] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-13T18:09:24.584421] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-13T18:09:24.584746] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-13T18:09:24.584834] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-13T18:09:25.035564] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:25.082729] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-13T18:09:25.217980] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-13T18:09:25.375144] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:09:26.017907] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-13T18:09:26.513168] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:09:26.817999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-13T18:09:26.960361] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:09:27.512444] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:09:27.617925] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-13T18:09:28.417905] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-13T18:09:28.555044] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:09:29.217896] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-13T18:09:29.593015] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:09:30.017970] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-13T18:09:30.160336] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:09:30.453248] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:09:30.818026] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-13T18:09:31.617926] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-13T18:09:31.717613] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:09:32.201890] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T18:09:32.417905] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-13T18:09:33.192931] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T18:09:33.198638] [INFO ] [REMOTE ] COF: Full fetch complete (77447 records). [2025-10-13T18:09:33.198906] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-13T18:09:33.231230] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-13T18:09:33.289540] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:09:33.689065] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-13T18:09:33.689151] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-13T18:09:33.690094] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-13T18:09:33.690160] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-13T18:09:33.691782] [DEBUG] [LOCAL ] COF: Trimmed 77447 records to 53614 (keeping 200 days of data) [2025-10-13T18:09:34.020054] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-13T18:09:34.067614] [DEBUG] [LOCAL ] COF: Primary data saved (53614 records). [2025-10-13T18:09:34.067784] [INFO ] [MAIN ] COF: Full history saved. [2025-10-13T18:09:34.068887] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 38.3s. Estimated remaining: 4h 16m 51s. Rate: 7.3 symbols/min [2025-10-13T18:09:34.268265] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:34.316916] [DEBUG] [LOCAL ] CON: Loaded 39376 existing records from primary storage. [2025-10-13T18:09:34.317232] [INFO ] [MAIN ] CON: Loaded 39376 existing records. [2025-10-13T18:09:34.522132] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:34.522447] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-13T18:09:34.522523] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-13T18:09:34.523000] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-13T18:09:34.523058] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-13T18:09:34.829495] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-13T18:09:34.916163] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:35.165793] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T18:09:35.617932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-13T18:09:35.863008] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T18:09:36.336058] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:09:36.417939] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-13T18:09:37.218055] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-13T18:09:38.020402] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-13T18:09:38.018940] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-13T18:09:38.045803] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:09:38.520254] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T18:09:38.817932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-13T18:09:39.618002] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-13T18:09:39.771266] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:09:40.418000] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-13T18:09:40.917242] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T18:09:41.217923] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-13T18:09:41.480613] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:09:42.017998] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-13T18:09:42.117901] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:09:42.542531] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T18:09:42.818016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-13T18:09:43.617945] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-13T18:09:43.925826] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:09:43.983264] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T18:09:43.988932] [INFO ] [REMOTE ] COHR: Full fetch complete (77210 records). [2025-10-13T18:09:43.989090] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-13T18:09:44.385314] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-13T18:09:44.385442] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-13T18:09:44.386378] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-13T18:09:44.386443] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-13T18:09:44.388038] [DEBUG] [LOCAL ] COHR: Trimmed 77210 records to 53380 (keeping 200 days of data) [2025-10-13T18:09:44.437743] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-13T18:09:44.709863] [DEBUG] [LOCAL ] COHR: Primary data saved (53380 records). [2025-10-13T18:09:44.709989] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-13T18:09:44.710230] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COHR took 34.6s. Estimated remaining: 4h 16m 51s. Rate: 7.3 symbols/min [2025-10-13T18:09:44.880400] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:44.904003] [DEBUG] [LOCAL ] COOK: Loaded 24888 existing records from primary storage. [2025-10-13T18:09:44.904243] [INFO ] [MAIN ] COOK: Loaded 24888 existing records. [2025-10-13T18:09:45.085717] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:45.086095] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-13T18:09:45.086390] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-13T18:09:45.087114] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-13T18:09:45.087279] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-13T18:09:45.220313] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-13T18:09:45.335694] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:09:45.488593] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:45.899787] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:09:46.017916] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-13T18:09:46.688490] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T18:09:46.817909] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-13T18:09:47.471885] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:09:47.617908] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-13T18:09:48.317467] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:09:48.417883] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-13T18:09:49.217974] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-13T18:09:49.329608] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:09:49.575454] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:09:50.018008] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-13T18:09:50.825782] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-13T18:09:50.845856] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:09:51.393090] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:09:51.617936] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-13T18:09:52.417900] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-13T18:09:52.453173] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:09:53.218097] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-13T18:09:53.223751] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:09:53.667924] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:09:54.018008] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-13T18:09:54.755337] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:09:54.760698] [INFO ] [REMOTE ] COLD: Full fetch complete (74509 records). [2025-10-13T18:09:54.760817] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-13T18:09:54.823019] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-13T18:09:55.151451] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-13T18:09:55.151555] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-13T18:09:55.152403] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-13T18:09:55.152467] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-13T18:09:55.153984] [DEBUG] [LOCAL ] COLD: Trimmed 74509 records to 52362 (keeping 200 days of data) [2025-10-13T18:09:55.290796] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:09:55.492589] [DEBUG] [LOCAL ] COLD: Primary data saved (52362 records). [2025-10-13T18:09:55.492745] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-13T18:09:55.492824] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 34.5s. Estimated remaining: 4h 16m 52s. Rate: 7.3 symbols/min [2025-10-13T18:09:55.623093] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-13T18:09:55.665831] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:55.715784] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-13T18:09:55.716094] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-10-13T18:09:55.891836] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:55.892080] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-13T18:09:55.892125] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-13T18:09:55.892520] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-13T18:09:55.892576] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-13T18:09:56.239754] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:56.417946] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-13T18:09:56.770486] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:09:57.031222] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:09:57.217912] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-13T18:09:58.017936] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-13T18:09:58.060264] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:09:58.706534] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:09:58.712814] [INFO ] [REMOTE ] COMP: Full fetch complete (77207 records). [2025-10-13T18:09:58.712989] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-13T18:09:58.823115] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-13T18:09:59.120595] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-13T18:09:59.120744] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-13T18:09:59.121897] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-13T18:09:59.121965] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-13T18:09:59.124029] [DEBUG] [LOCAL ] COMP: Trimmed 77207 records to 53405 (keeping 200 days of data) [2025-10-13T18:09:59.230130] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:09:59.483604] [DEBUG] [LOCAL ] COMP: Primary data saved (53405 records). [2025-10-13T18:09:59.483869] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-13T18:09:59.483967] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COMP took 35.1s. Estimated remaining: 4h 16m 28s. Rate: 7.3 symbols/min [2025-10-13T18:09:59.631138] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-13T18:09:59.665183] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:59.717346] [DEBUG] [LOCAL ] COR: Loaded 47440 existing records from primary storage. [2025-10-13T18:09:59.717887] [INFO ] [MAIN ] COR: Loaded 47440 existing records. [2025-10-13T18:09:59.904142] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:59.904444] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-13T18:09:59.904496] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-13T18:09:59.904990] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-13T18:09:59.905049] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-13T18:10:00.284598] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:00.417926] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-13T18:10:01.067391] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-13T18:10:01.217911] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-13T18:10:01.320032] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:10:01.334283] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T18:10:02.017992] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-13T18:10:02.817998] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-13T18:10:02.986059] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:10:03.617944] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-13T18:10:03.669525] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:10:03.674407] [INFO ] [REMOTE ] CON: Full fetch complete (56662 records). [2025-10-13T18:10:03.674512] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-13T18:10:04.064880] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:10:04.090886] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-13T18:10:04.090992] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-13T18:10:04.091826] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-13T18:10:04.091895] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-13T18:10:04.093327] [DEBUG] [LOCAL ] CON: Trimmed 56662 records to 38882 (keeping 200 days of data) [2025-10-13T18:10:04.331600] [DEBUG] [LOCAL ] CON: Primary data saved (38882 records). [2025-10-13T18:10:04.331776] [INFO ] [MAIN ] CON: Full history saved. [2025-10-13T18:10:04.332521] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. CON took 30.3s. Estimated remaining: 4h 16m 7s. Rate: 7.3 symbols/min [2025-10-13T18:10:04.423047] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-13T18:10:04.517564] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:04.517771] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-13T18:10:04.517816] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-13T18:10:04.517925] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-13T18:10:04.518003] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-13T18:10:04.518061] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-13T18:10:04.518096] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-13T18:10:04.904225] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:05.179417] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T18:10:05.217887] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-13T18:10:06.017931] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-13T18:10:06.795323] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-13T18:10:06.817885] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-13T18:10:07.002790] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:10:07.131465] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:10:07.617918] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-13T18:10:08.417894] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-13T18:10:08.755315] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:10:08.868548] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:10:09.217932] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-13T18:10:10.017985] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-13T18:10:10.200670] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:10:10.818039] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-13T18:10:11.305589] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:10:11.350445] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T18:10:11.618009] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-13T18:10:12.126399] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:10:12.417919] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-13T18:10:12.991761] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:10:13.218051] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-13T18:10:14.017917] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-13T18:10:14.367945] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:10:14.400714] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:10:14.817912] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-13T18:10:15.617934] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-13T18:10:16.012014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T18:10:16.418010] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-13T18:10:16.733082] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T18:10:17.218015] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-13T18:10:17.464385] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:10:18.017928] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-13T18:10:18.322782] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:10:18.740690] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T18:10:18.817901] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-13T18:10:19.484158] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T18:10:19.617921] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-13T18:10:20.417895] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-13T18:10:20.673582] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:10:21.218021] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-13T18:10:21.426501] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:10:22.018016] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-13T18:10:22.266240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:10:22.357143] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T18:10:22.817936] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-13T18:10:23.617910] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-13T18:10:23.824858] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:10:23.855464] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T18:10:24.417916] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-13T18:10:25.141477] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:10:25.217934] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-13T18:10:26.017899] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-13T18:10:26.295958] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:10:26.818006] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-13T18:10:26.887451] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:10:27.618078] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-13T18:10:27.793608] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:10:27.930050] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T18:10:27.933153] [INFO ] [REMOTE ] COOK: Full fetch complete (32906 records). [2025-10-13T18:10:27.933229] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-13T18:10:28.295958] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-13T18:10:28.296058] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-13T18:10:28.296583] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-13T18:10:28.296623] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-13T18:10:28.297378] [DEBUG] [LOCAL ] COOK: Trimmed 32906 records to 24847 (keeping 200 days of data) [2025-10-13T18:10:28.420531] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-13T18:10:28.435070] [DEBUG] [LOCAL ] COOK: Primary data saved (24847 records). [2025-10-13T18:10:28.435195] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-13T18:10:28.435343] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COOK took 43.7s. Estimated remaining: 4h 16m 57s. Rate: 7.2 symbols/min [2025-10-13T18:10:28.600758] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:28.643704] [DEBUG] [LOCAL ] COUR: Loaded 49778 existing records from primary storage. [2025-10-13T18:10:28.644021] [INFO ] [MAIN ] COUR: Loaded 49778 existing records. [2025-10-13T18:10:28.821018] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:28.821230] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-13T18:10:28.821283] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-13T18:10:28.821686] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-13T18:10:28.821742] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-13T18:10:29.178936] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:29.192807] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:10:29.198508] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-13T18:10:29.222333] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-13T18:10:29.214292] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-13T18:10:29.228421] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T18:10:29.620038] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-13T18:10:29.620115] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-13T18:10:29.620975] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-13T18:10:29.621037] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-13T18:10:29.622420] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-10-13T18:10:29.945956] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-13T18:10:29.946088] [INFO ] [MAIN ] COP: Full history saved. [2025-10-13T18:10:29.946164] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COP took 34.5s. Estimated remaining: 4h 16m 24s. Rate: 7.3 symbols/min [2025-10-13T18:10:30.023071] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-13T18:10:30.113116] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:30.163186] [DEBUG] [LOCAL ] CP: Loaded 54043 existing records from primary storage. [2025-10-13T18:10:30.163485] [INFO ] [MAIN ] CP: Loaded 54043 existing records. [2025-10-13T18:10:30.335922] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:30.336098] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-13T18:10:30.336143] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-13T18:10:30.336404] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-13T18:10:30.336459] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-13T18:10:30.685022] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:30.817884] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-13T18:10:30.922024] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:10:31.617899] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-13T18:10:31.645061] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:10:32.417894] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-13T18:10:32.481852] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:10:33.217901] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-13T18:10:33.262405] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:10:33.966185] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:10:34.017915] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-13T18:10:34.817907] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-13T18:10:34.870583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:10:35.496634] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:10:35.617929] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-13T18:10:36.417925] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-13T18:10:36.441627] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T18:10:36.447111] [INFO ] [REMOTE ] COTY: Full fetch complete (77117 records). [2025-10-13T18:10:36.447248] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-13T18:10:36.854968] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-13T18:10:36.855055] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-13T18:10:36.856007] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-13T18:10:36.856099] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-13T18:10:36.857775] [DEBUG] [LOCAL ] COTY: Trimmed 77117 records to 53263 (keeping 200 days of data) [2025-10-13T18:10:37.174112] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T18:10:37.187006] [DEBUG] [LOCAL ] COTY: Primary data saved (53263 records). [2025-10-13T18:10:37.187156] [INFO ] [REMOTE ] COR: Full fetch complete (68238 records). [2025-10-13T18:10:37.187380] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-13T18:10:37.187602] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 32.9s. Estimated remaining: 4h 16m 12s. Rate: 7.3 symbols/min [2025-10-13T18:10:37.187506] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-13T18:10:37.218927] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-13T18:10:37.230636] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:10:37.257693] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:10:37.269714] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:10:37.290821] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-13T18:10:37.293336] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-13T18:10:37.293394] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-13T18:10:37.299173] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-13T18:10:37.299332] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COR took 37.8s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-13T18:10:37.478586] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:37.554881] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:37.555184] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-13T18:10:37.555242] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-13T18:10:37.555354] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-13T18:10:37.555396] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-13T18:10:37.555438] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-13T18:10:37.555472] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-13T18:10:37.751802] [DEBUG] [LOCAL ] CPA: Loaded 28742 existing records from primary storage. [2025-10-13T18:10:37.817471] [INFO ] [MAIN ] CPA: Loaded 28742 existing records. [2025-10-13T18:10:38.090258] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:38.131356] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-13T18:10:38.169820] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:38.170308] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-13T18:10:38.170420] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-13T18:10:38.170832] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-13T18:10:38.171304] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-13T18:10:38.490992] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T18:10:38.627310] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:38.690105] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:10:38.796926] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:10:38.817886] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-13T18:10:39.171619] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T18:10:39.617912] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-13T18:10:40.417931] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-13T18:10:41.127142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:10:41.217891] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-13T18:10:41.866370] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:10:42.017916] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-13T18:10:42.361961] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T18:10:42.785575] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:10:42.817896] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-13T18:10:43.617929] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-13T18:10:43.877572] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-13T18:10:44.226295] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:10:44.417926] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-13T18:10:45.217980] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-13T18:10:45.717001] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:10:45.717533] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:10:46.017924] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-13T18:10:46.817928] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-13T18:10:47.431677] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:10:47.617933] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-13T18:10:47.979776] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T18:10:48.079573] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:10:48.417929] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-13T18:10:48.857328] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T18:10:49.217947] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-13T18:10:50.017984] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-13T18:10:50.817912] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-13T18:10:51.005316] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:10:51.343362] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:10:51.617973] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-13T18:10:52.230977] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:10:52.417906] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-13T18:10:52.939120] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T18:10:53.217929] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-13T18:10:53.563036] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:10:54.017892] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-13T18:10:54.645257] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:10:54.817930] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-13T18:10:55.617983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-13T18:10:55.872976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:10:55.995457] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:10:56.418004] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-13T18:10:57.070502] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:10:57.217901] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-13T18:10:57.587489] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:10:58.017987] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-13T18:10:58.817944] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-13T18:10:58.882142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:10:59.285315] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T18:10:59.617923] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-13T18:10:59.816613] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:11:00.418044] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-13T18:11:00.841248] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:11:01.115215] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:11:01.217940] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-13T18:11:01.713191] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:11:02.017934] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-13T18:11:02.817989] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-13T18:11:03.617899] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-13T18:11:03.762110] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:11:04.094668] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:11:04.095488] [INFO ] [REMOTE ] CPAC: Full fetch complete (1865 records). [2025-10-13T18:11:04.095564] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-13T18:11:04.277507] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:11:04.277719] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:11:04.277790] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:11:04.277866] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-13T18:11:04.277931] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-13T18:11:04.278008] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-13T18:11:04.278066] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-13T18:11:04.278125] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPAC took 27.0s. Estimated remaining: 4h 16m 34s. Rate: 7.2 symbols/min [2025-10-13T18:11:04.421992] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-13T18:11:04.453119] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:04.483048] [DEBUG] [LOCAL ] CPAY: Loaded 30808 existing records from primary storage. [2025-10-13T18:11:04.483303] [INFO ] [MAIN ] CPAY: Loaded 30808 existing records. [2025-10-13T18:11:04.675046] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:04.675433] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-13T18:11:04.675509] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-13T18:11:04.675834] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-13T18:11:04.675890] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-13T18:11:04.992941] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T18:11:05.086267] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:05.217946] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-13T18:11:06.017891] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-13T18:11:06.052212] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:11:06.622874] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:11:06.818013] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-13T18:11:07.425457] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T18:11:07.617937] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-13T18:11:08.417918] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-13T18:11:08.460895] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:11:08.466102] [INFO ] [REMOTE ] COUR: Full fetch complete (70853 records). [2025-10-13T18:11:08.466248] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-13T18:11:08.844125] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-13T18:11:08.844208] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-13T18:11:08.845019] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-13T18:11:08.845081] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-13T18:11:08.846413] [DEBUG] [LOCAL ] COUR: Trimmed 70853 records to 49182 (keeping 200 days of data) [2025-10-13T18:11:09.127671] [DEBUG] [LOCAL ] COUR: Primary data saved (49182 records). [2025-10-13T18:11:09.127835] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-13T18:11:09.127926] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. COUR took 40.7s. Estimated remaining: 4h 16m 13s. Rate: 7.2 symbols/min [2025-10-13T18:11:09.224108] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-13T18:11:09.312522] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:09.328379] [DEBUG] [LOCAL ] CPF: Loaded 15445 existing records from primary storage. [2025-10-13T18:11:09.328629] [INFO ] [MAIN ] CPF: Loaded 15445 existing records. [2025-10-13T18:11:09.521995] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:11:09.558974] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:11:09.552386] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:09.559362] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-13T18:11:09.566200] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-13T18:11:09.567037] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-13T18:11:09.567099] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-13T18:11:09.598959] [INFO ] [REMOTE ] CP: Full fetch complete (77117 records). [2025-10-13T18:11:09.622534] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-13T18:11:10.023456] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-13T18:11:10.223459] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:10.322156] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:11:10.349959] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-13T18:11:10.350216] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-13T18:11:10.351427] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-13T18:11:10.350139] [INFO ] [REMOTE ] CPA: Full fetch complete (41395 records). [2025-10-13T18:11:10.351729] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-13T18:11:10.351583] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-13T18:11:10.461799] [DEBUG] [LOCAL ] CP: Trimmed 77117 records to 53252 (keeping 200 days of data) [2025-10-13T18:11:10.856742] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-13T18:11:10.837719] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-13T18:11:10.862110] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-13T18:11:10.868810] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-13T18:11:10.922371] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-13T18:11:10.961786] [DEBUG] [LOCAL ] CPA: Trimmed 41395 records to 28392 (keeping 200 days of data) [2025-10-13T18:11:11.194311] [DEBUG] [LOCAL ] CP: Primary data saved (53252 records). [2025-10-13T18:11:11.200193] [INFO ] [MAIN ] CP: Full history saved. [2025-10-13T18:11:11.200709] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 41.3s. Estimated remaining: 4h 15m 42s. Rate: 7.3 symbols/min [2025-10-13T18:11:11.352505] [DEBUG] [LOCAL ] CPA: Primary data saved (28392 records). [2025-10-13T18:11:11.367159] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-13T18:11:11.367803] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPA took 34.2s. Estimated remaining: 4h 15m 5s. Rate: 7.3 symbols/min [2025-10-13T18:11:11.439225] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:11.458175] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:11:11.476856] [DEBUG] [LOCAL ] CPK: Loaded 13880 existing records from primary storage. [2025-10-13T18:11:11.477122] [INFO ] [MAIN ] CPK: Loaded 13880 existing records. [2025-10-13T18:11:11.626769] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-13T18:11:11.658077] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:11.658396] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-13T18:11:11.658484] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-13T18:11:11.658754] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-13T18:11:11.658826] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-13T18:11:12.012262] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:12.185571] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:11:12.417905] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-13T18:11:13.156769] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:11:13.225613] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-13T18:11:13.227602] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T18:11:14.017925] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-13T18:11:14.223158] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:11:14.779272] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:11:14.817888] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-13T18:11:15.617918] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-13T18:11:15.663027] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:11:16.417920] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-13T18:11:17.184543] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:11:17.217914] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-13T18:11:17.357565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:11:18.017922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-13T18:11:18.121461] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T18:11:18.817986] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-13T18:11:18.895774] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T18:11:19.617943] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-13T18:11:20.174693] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:11:20.417895] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-13T18:11:20.478449] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T18:11:21.221154] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-13T18:11:22.011989] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:11:22.018454] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-13T18:11:22.110278] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T18:11:22.817894] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-13T18:11:23.004364] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:11:23.617975] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-13T18:11:23.707896] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:11:24.417893] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-13T18:11:24.568531] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:11:25.029913] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:11:25.217923] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-13T18:11:26.018008] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-13T18:11:26.174094] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:11:26.785576] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T18:11:26.818059] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-13T18:11:27.425369] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:11:27.617902] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-13T18:11:28.417926] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-13T18:11:29.044461] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:11:29.217885] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-13T18:11:29.246743] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T18:11:30.017906] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-13T18:11:30.497022] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:11:30.643006] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:11:30.817942] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-13T18:11:31.617922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-13T18:11:32.160986] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T18:11:32.417988] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-13T18:11:32.467579] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T18:11:33.217891] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-13T18:11:33.352538] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:11:33.355408] [INFO ] [REMOTE ] CPAY: Full fetch complete (44666 records). [2025-10-13T18:11:33.355482] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-13T18:11:33.738827] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-13T18:11:33.738947] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-13T18:11:33.739717] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-13T18:11:33.739784] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-13T18:11:33.740898] [DEBUG] [LOCAL ] CPAY: Trimmed 44666 records to 30418 (keeping 200 days of data) [2025-10-13T18:11:33.921113] [DEBUG] [LOCAL ] CPAY: Primary data saved (30418 records). [2025-10-13T18:11:33.921243] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-13T18:11:33.921320] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPAY took 29.6s. Estimated remaining: 4h 15m 48s. Rate: 7.2 symbols/min [2025-10-13T18:11:34.017986] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-13T18:11:34.074355] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:11:34.076402] [INFO ] [REMOTE ] CPF: Full fetch complete (23599 records). [2025-10-13T18:11:34.076469] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-13T18:11:34.434711] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-13T18:11:34.434817] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-13T18:11:34.435260] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-13T18:11:34.435359] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-13T18:11:34.435988] [DEBUG] [LOCAL ] CPF: Trimmed 23599 records to 15233 (keeping 200 days of data) [2025-10-13T18:11:34.525043] [DEBUG] [LOCAL ] CPF: Primary data saved (15233 records). [2025-10-13T18:11:34.525178] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-13T18:11:34.525257] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPF took 25.4s. Estimated remaining: 4h 15m 12s. Rate: 7.3 symbols/min [2025-10-13T18:11:35.055704] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:11:35.057981] [INFO ] [REMOTE ] CPK: Full fetch complete (18206 records). [2025-10-13T18:11:35.058058] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-13T18:11:35.477345] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-13T18:11:35.477434] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-13T18:11:35.477901] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-13T18:11:35.477994] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-13T18:11:35.478566] [DEBUG] [LOCAL ] CPK: Trimmed 18206 records to 13769 (keeping 200 days of data) [2025-10-13T18:11:35.573376] [DEBUG] [LOCAL ] CPK: Primary data saved (13769 records). [2025-10-13T18:11:35.573554] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-13T18:11:35.573712] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPK took 24.4s. Estimated remaining: 4h 14m 38s. Rate: 7.3 symbols/min [2025-10-13T18:11:36.268442] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.230571] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.292253] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.297382] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.298254] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-13T18:11:36.299151] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-13T18:11:36.299284] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-13T18:11:36.299367] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-13T18:11:36.299472] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-13T18:11:36.299531] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-13T18:11:36.670885] [DEBUG] [LOCAL ] CPT: Loaded 45033 existing records from primary storage. [2025-10-13T18:11:36.726162] [INFO ] [MAIN ] CPT: Loaded 45033 existing records. [2025-10-13T18:11:36.780473] [DEBUG] [LOCAL ] CPRI: Loaded 53277 existing records from primary storage. [2025-10-13T18:11:36.775125] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-10-13T18:11:36.796461] [INFO ] [MAIN ] CPRI: Loaded 53277 existing records. [2025-10-13T18:11:36.816533] [INFO ] [MAIN ] CPNG: Loaded 54450 existing records. [2025-10-13T18:11:37.124411] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:37.171912] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-13T18:11:37.361261] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.416208] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.437912] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.443236] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-13T18:11:37.437578] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.458538] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-13T18:11:37.460057] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-13T18:11:37.462022] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-13T18:11:37.483855] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-13T18:11:37.492737] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.512131] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-13T18:11:37.512629] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.556033] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-13T18:11:37.595286] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-13T18:11:37.657296] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-13T18:11:38.511240] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.560446] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-13T18:11:38.680323] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.715069] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-13T18:11:38.715711] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:11:38.731541] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-13T18:11:38.763960] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.765738] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-13T18:11:39.672547] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:11:39.677242] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-13T18:11:40.111127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:11:40.122664] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-13T18:11:40.356526] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:11:40.417988] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-13T18:11:40.641290] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:11:41.135828] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-13T18:11:41.217894] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-13T18:11:41.647346] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:11:41.703569] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:11:42.017976] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-13T18:11:42.817930] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-13T18:11:43.102514] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:11:43.266381] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:11:43.617899] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-13T18:11:44.078081] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T18:11:44.417999] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-13T18:11:45.101029] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:11:45.217881] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-13T18:11:45.502545] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T18:11:46.018077] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-13T18:11:46.585370] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T18:11:46.817915] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-13T18:11:47.362679] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:11:47.618027] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-13T18:11:48.086619] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:11:48.417920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-13T18:11:49.217924] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-13T18:11:49.356372] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:11:49.890955] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T18:11:50.017982] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-13T18:11:50.818061] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-13T18:11:51.096051] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T18:11:51.617901] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-13T18:11:51.685420] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:11:51.815695] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:11:52.418046] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-13T18:11:53.217941] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-13T18:11:53.627861] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T18:11:54.018001] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-13T18:11:54.267744] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:11:54.802308] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:11:54.817886] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-13T18:11:55.617931] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-13T18:11:56.164798] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T18:11:56.210288] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T18:11:56.417987] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-13T18:11:57.217918] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-13T18:11:57.376793] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:11:57.411944] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:11:58.017937] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-13T18:11:58.817989] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-13T18:11:59.517803] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-13T18:11:59.554110] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T18:11:59.617881] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-13T18:11:59.716120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:12:00.417930] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-13T18:12:01.217920] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-13T18:12:01.765062] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:12:02.017906] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-13T18:12:02.206923] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:12:02.211418] [INFO ] [REMOTE ] CPT: Full fetch complete (63991 records). [2025-10-13T18:12:02.211571] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-13T18:12:02.595481] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:12:02.640534] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-13T18:12:02.640629] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-13T18:12:02.641828] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-13T18:12:02.641892] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-13T18:12:02.643149] [DEBUG] [LOCAL ] CPT: Trimmed 63991 records to 44474 (keeping 200 days of data) [2025-10-13T18:12:02.823623] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-13T18:12:02.924933] [DEBUG] [LOCAL ] CPT: Primary data saved (44474 records). [2025-10-13T18:12:02.925063] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-13T18:12:02.925209] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CPT took 27.3s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-13T18:12:03.119917] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:03.145058] [DEBUG] [LOCAL ] CQP: Loaded 19096 existing records from primary storage. [2025-10-13T18:12:03.145364] [INFO ] [MAIN ] CQP: Loaded 19096 existing records. [2025-10-13T18:12:03.321114] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:03.321348] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-13T18:12:03.321394] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-13T18:12:03.321773] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-13T18:12:03.321840] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-13T18:12:03.622962] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-13T18:12:03.677612] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:03.895982] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T18:12:03.898396] [INFO ] [REMOTE ] CPS: Full fetch complete (36277 records). [2025-10-13T18:12:03.898482] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-13T18:12:04.280427] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-13T18:12:04.280518] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-13T18:12:04.281070] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-13T18:12:04.281131] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-13T18:12:04.281941] [DEBUG] [LOCAL ] CPS: Trimmed 36277 records to 25382 (keeping 200 days of data) [2025-10-13T18:12:04.418794] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-13T18:12:04.436330] [DEBUG] [LOCAL ] CPS: Primary data saved (25382 records). [2025-10-13T18:12:04.436471] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-13T18:12:04.450263] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 28.9s. Estimated remaining: 4h 15m 5s. Rate: 7.2 symbols/min [2025-10-13T18:12:04.551963] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-13T18:12:04.670089] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:04.694693] [DEBUG] [LOCAL ] CR: Loaded 24473 existing records from primary storage. [2025-10-13T18:12:04.694948] [INFO ] [MAIN ] CR: Loaded 24473 existing records. [2025-10-13T18:12:04.872063] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:04.872302] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-13T18:12:04.872351] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-13T18:12:04.872559] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-13T18:12:04.872600] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-13T18:12:05.228800] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-13T18:12:05.234963] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:05.303215] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:12:05.596000] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T18:12:06.017939] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-13T18:12:06.817970] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-13T18:12:07.031732] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:12:07.391861] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T18:12:07.618055] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-13T18:12:08.331040] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:12:08.417975] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-13T18:12:09.217941] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-13T18:12:09.543294] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T18:12:09.966404] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:12:10.017933] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-13T18:12:10.060687] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:12:10.818015] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-13T18:12:11.490127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T18:12:11.618024] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-13T18:12:12.418050] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-13T18:12:12.677695] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T18:12:12.857683] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T18:12:12.864389] [INFO ] [REMOTE ] CPNG: Full fetch complete (77678 records). [2025-10-13T18:12:12.864744] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-13T18:12:13.225145] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-13T18:12:13.274268] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-13T18:12:13.274358] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-13T18:12:13.275311] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-13T18:12:13.275388] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-13T18:12:13.276968] [DEBUG] [LOCAL ] CPNG: Trimmed 77678 records to 53679 (keeping 200 days of data) [2025-10-13T18:12:13.601247] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-13T18:12:13.601386] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-13T18:12:13.601478] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPNG took 38.0s. Estimated remaining: 4h 15m 0s. Rate: 7.2 symbols/min [2025-10-13T18:12:13.766379] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:13.776503] [DEBUG] [LOCAL ] CRBD: Loaded 9109 existing records from primary storage. [2025-10-13T18:12:13.776715] [INFO ] [MAIN ] CRBD: Loaded 9109 existing records. [2025-10-13T18:12:13.949776] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:13.950021] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-13T18:12:13.950066] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-13T18:12:13.950291] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-13T18:12:13.950347] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-13T18:12:14.024680] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-13T18:12:14.327369] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:14.341707] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:12:14.359722] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T18:12:14.365629] [INFO ] [REMOTE ] CPRI: Full fetch complete (76088 records). [2025-10-13T18:12:14.365800] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-13T18:12:14.754968] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-13T18:12:14.755061] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-13T18:12:14.755952] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-13T18:12:14.756017] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-13T18:12:14.757488] [DEBUG] [LOCAL ] CPRI: Trimmed 76088 records to 52498 (keeping 200 days of data) [2025-10-13T18:12:14.818559] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-13T18:12:15.066320] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:12:15.114535] [DEBUG] [LOCAL ] CPRI: Primary data saved (52498 records). [2025-10-13T18:12:15.114695] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-13T18:12:15.114797] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 39.5s. Estimated remaining: 4h 14m 28s. Rate: 7.3 symbols/min [2025-10-13T18:12:15.321344] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:15.370057] [DEBUG] [LOCAL ] CRBG: Loaded 53226 existing records from primary storage. [2025-10-13T18:12:15.370402] [INFO ] [MAIN ] CRBG: Loaded 53226 existing records. [2025-10-13T18:12:15.542678] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:15.542902] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-13T18:12:15.542948] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-13T18:12:15.543336] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-13T18:12:15.543391] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-13T18:12:15.623006] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-13T18:12:15.908002] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:15.995540] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:12:16.417931] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-13T18:12:16.831974] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:12:17.217938] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-13T18:12:17.833543] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T18:12:17.984479] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:12:18.017886] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-13T18:12:18.673499] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T18:12:18.817901] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-13T18:12:19.618025] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-13T18:12:19.848557] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:12:20.342209] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T18:12:20.417933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-13T18:12:21.045229] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:12:21.217941] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-13T18:12:22.000766] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:12:22.017933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-13T18:12:22.630752] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:12:22.817915] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-13T18:12:23.617904] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-13T18:12:23.923506] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:12:24.417925] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-13T18:12:25.217936] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-13T18:12:25.254125] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:12:25.360028] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:12:26.017917] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-13T18:12:26.696525] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:12:26.817912] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-13T18:12:27.424096] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T18:12:27.617885] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-13T18:12:27.775476] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:12:28.417926] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-13T18:12:29.206425] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T18:12:29.217876] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-13T18:12:29.351994] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T18:12:29.845138] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:12:30.017894] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-13T18:12:30.817889] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-13T18:12:30.925078] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T18:12:31.617915] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-13T18:12:32.417925] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-13T18:12:32.586628] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:12:32.603674] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T18:12:32.605825] [INFO ] [REMOTE ] CRBD: Full fetch complete (13546 records). [2025-10-13T18:12:32.605916] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-13T18:12:32.988194] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-13T18:12:32.988289] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-13T18:12:32.988623] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-13T18:12:32.988704] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-13T18:12:32.989166] [DEBUG] [LOCAL ] CRBD: Trimmed 13546 records to 8964 (keeping 200 days of data) [2025-10-13T18:12:33.043241] [DEBUG] [LOCAL ] CRBD: Primary data saved (8964 records). [2025-10-13T18:12:33.043379] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-13T18:12:33.043460] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 19.4s. Estimated remaining: 4h 14m 54s. Rate: 7.2 symbols/min [2025-10-13T18:12:33.209532] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:33.218037] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-13T18:12:33.251770] [DEBUG] [LOCAL ] CRC: Loaded 44489 existing records from primary storage. [2025-10-13T18:12:33.252089] [INFO ] [MAIN ] CRC: Loaded 44489 existing records. [2025-10-13T18:12:33.362064] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T18:12:33.441767] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:33.441991] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-13T18:12:33.442037] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-13T18:12:33.442343] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-13T18:12:33.442399] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-13T18:12:33.787550] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:34.018048] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-13T18:12:34.736824] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:12:34.820048] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-13T18:12:34.828103] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:12:35.617908] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-13T18:12:35.785579] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T18:12:35.787298] [INFO ] [REMOTE ] CQP: Full fetch complete (30136 records). [2025-10-13T18:12:35.787367] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-13T18:12:36.163212] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-13T18:12:36.163303] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-13T18:12:36.163964] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-13T18:12:36.164032] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-13T18:12:36.164796] [DEBUG] [LOCAL ] CQP: Trimmed 30136 records to 18920 (keeping 200 days of data) [2025-10-13T18:12:36.281309] [DEBUG] [LOCAL ] CQP: Primary data saved (18920 records). [2025-10-13T18:12:36.281445] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-13T18:12:36.281548] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CQP took 33.4s. Estimated remaining: 4h 14m 28s. Rate: 7.3 symbols/min [2025-10-13T18:12:36.422220] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-13T18:12:36.453562] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:36.454058] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-13T18:12:36.454112] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-13T18:12:36.454229] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-13T18:12:36.454272] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-13T18:12:36.454313] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-13T18:12:36.454345] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-13T18:12:36.816261] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:36.886496] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:12:37.217990] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-13T18:12:37.777829] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:12:38.018025] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-13T18:12:38.727121] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:12:38.817924] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-13T18:12:39.398110] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:12:39.617973] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-13T18:12:40.417913] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-13T18:12:40.669038] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:12:40.986493] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:12:41.217926] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-13T18:12:41.296681] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:12:42.017934] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-13T18:12:42.246773] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:12:42.247211] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-13T18:12:42.247311] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:12:42.247364] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-13T18:12:42.247404] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:12:42.247512] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-13T18:12:42.247594] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-13T18:12:42.247638] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-13T18:12:42.247734] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-13T18:12:42.247794] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRCL took 6.0s. Estimated remaining: 4h 14m 12s. Rate: 7.3 symbols/min [2025-10-13T18:12:42.436421] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:42.495876] [DEBUG] [LOCAL ] CRGY: Loaded 53242 existing records from primary storage. [2025-10-13T18:12:42.496300] [INFO ] [MAIN ] CRGY: Loaded 53242 existing records. [2025-10-13T18:12:42.673249] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:42.673522] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-13T18:12:42.673574] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-13T18:12:42.673956] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-13T18:12:42.674019] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-13T18:12:42.820742] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-13T18:12:43.060272] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:43.094548] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:12:43.617938] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-13T18:12:44.118460] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:12:44.417938] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-13T18:12:45.217979] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-13T18:12:45.276018] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:12:45.954169] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:12:46.014975] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:12:46.020128] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-13T18:12:46.817932] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-13T18:12:47.617940] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-13T18:12:47.649444] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:12:47.657619] [INFO ] [REMOTE ] CRBG: Full fetch complete (75773 records). [2025-10-13T18:12:47.657818] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-13T18:12:48.075542] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-13T18:12:48.075687] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-13T18:12:48.076804] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-13T18:12:48.076889] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-13T18:12:48.094611] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:12:48.100871] [DEBUG] [LOCAL ] CRBG: Trimmed 75773 records to 52546 (keeping 200 days of data) [2025-10-13T18:12:48.417366] [DEBUG] [LOCAL ] CRBG: Primary data saved (52546 records). [2025-10-13T18:12:48.417498] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-13T18:12:48.417573] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 33.3s. Estimated remaining: 4h 13m 56s. Rate: 7.3 symbols/min [2025-10-13T18:12:48.429066] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-13T18:12:48.591093] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:48.639374] [DEBUG] [LOCAL ] CRH: Loaded 54229 existing records from primary storage. [2025-10-13T18:12:48.639734] [INFO ] [MAIN ] CRH: Loaded 54229 existing records. [2025-10-13T18:12:48.822090] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:48.822290] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-13T18:12:48.822337] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-13T18:12:48.822623] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-13T18:12:48.822716] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-13T18:12:49.202231] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:49.217890] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-13T18:12:49.253505] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:12:50.017980] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-13T18:12:50.101707] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:12:50.817929] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-13T18:12:51.137407] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:12:51.564180] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:12:51.586871] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T18:12:51.617884] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-13T18:12:52.417910] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-13T18:12:52.646275] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:12:52.649095] [INFO ] [REMOTE ] CR: Full fetch complete (34636 records). [2025-10-13T18:12:52.649186] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-13T18:12:53.019639] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-13T18:12:53.019802] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-13T18:12:53.020754] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-13T18:12:53.020821] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-13T18:12:53.022285] [DEBUG] [LOCAL ] CR: Trimmed 34636 records to 24133 (keeping 200 days of data) [2025-10-13T18:12:53.184578] [DEBUG] [LOCAL ] CR: Primary data saved (24133 records). [2025-10-13T18:12:53.184804] [INFO ] [MAIN ] CR: Full history saved. [2025-10-13T18:12:53.184914] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CR took 48.7s. Estimated remaining: 4h 13m 35s. Rate: 7.3 symbols/min [2025-10-13T18:12:53.223165] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-13T18:12:53.372289] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:53.424419] [DEBUG] [LOCAL ] CRI: Loaded 50425 existing records from primary storage. [2025-10-13T18:12:53.424924] [INFO ] [MAIN ] CRI: Loaded 50425 existing records. [2025-10-13T18:12:53.622844] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:53.623127] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-13T18:12:53.623179] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-13T18:12:53.623691] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-13T18:12:53.623751] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-13T18:12:53.998138] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:54.022513] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-13T18:12:54.029212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:12:54.723029] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:12:54.817898] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-13T18:12:55.617987] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-13T18:12:55.764690] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:12:56.417947] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-13T18:12:56.514866] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:12:57.067474] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:12:57.217947] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-13T18:12:58.018007] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-13T18:12:58.403193] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T18:12:58.817906] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-13T18:12:59.049018] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:12:59.464023] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:12:59.617909] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-13T18:13:00.227149] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:13:00.418004] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-13T18:13:01.152759] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:13:01.217943] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-13T18:13:02.017922] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-13T18:13:02.817981] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-13T18:13:02.906421] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:13:03.529164] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-13T18:13:03.617918] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-13T18:13:03.718152] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:13:04.428308] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-13T18:13:04.434159] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:13:05.217976] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-13T18:13:05.653240] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T18:13:06.018006] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-13T18:13:06.182194] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T18:13:06.186835] [INFO ] [REMOTE ] CRC: Full fetch complete (62674 records). [2025-10-13T18:13:06.186954] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-13T18:13:06.576088] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-13T18:13:06.576182] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-13T18:13:06.576954] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-13T18:13:06.577018] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-13T18:13:06.578534] [DEBUG] [LOCAL ] CRC: Trimmed 62674 records to 44022 (keeping 200 days of data) [2025-10-13T18:13:06.818584] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-13T18:13:06.842968] [DEBUG] [LOCAL ] CRC: Primary data saved (44022 records). [2025-10-13T18:13:06.843115] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-13T18:13:06.844014] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRC took 33.8s. Estimated remaining: 4h 13m 46s. Rate: 7.3 symbols/min [2025-10-13T18:13:07.012880] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:07.067109] [DEBUG] [LOCAL ] CRK: Loaded 52981 existing records from primary storage. [2025-10-13T18:13:07.067447] [INFO ] [MAIN ] CRK: Loaded 52981 existing records. [2025-10-13T18:13:07.253389] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:07.253730] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-13T18:13:07.253798] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-13T18:13:07.269144] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-13T18:13:07.281451] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-13T18:13:07.361989] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-13T18:13:07.628419] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-13T18:13:07.660582] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:07.751432] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:13:08.417985] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-13T18:13:08.471755] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:13:09.217932] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-13T18:13:09.393517] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:13:10.017902] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-13T18:13:10.300938] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T18:13:10.812256] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:13:10.822060] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-13T18:13:11.513893] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:13:11.617926] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-13T18:13:12.322788] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T18:13:12.418011] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-13T18:13:13.217913] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-13T18:13:13.325979] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:13:14.017975] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-13T18:13:14.224132] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T18:13:14.823169] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-13T18:13:14.839009] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:13:15.617919] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-13T18:13:15.867600] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:13:16.031465] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T18:13:16.417925] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-13T18:13:17.217934] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-13T18:13:17.582716] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T18:13:17.588172] [INFO ] [REMOTE ] CRGY: Full fetch complete (75934 records). [2025-10-13T18:13:17.588306] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-13T18:13:18.002836] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-13T18:13:18.003039] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-13T18:13:18.004203] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-13T18:13:18.004333] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-13T18:13:18.006600] [DEBUG] [LOCAL ] CRGY: Trimmed 75934 records to 52490 (keeping 200 days of data) [2025-10-13T18:13:18.062087] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-13T18:13:18.276943] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:13:18.401591] [DEBUG] [LOCAL ] CRGY: Primary data saved (52490 records). [2025-10-13T18:13:18.401902] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-13T18:13:18.402046] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRGY took 36.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-13T18:13:18.587084] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:18.640608] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T18:13:18.666235] [DEBUG] [LOCAL ] CRL: Loaded 43459 existing records from primary storage. [2025-10-13T18:13:18.666700] [INFO ] [MAIN ] CRL: Loaded 43459 existing records. [2025-10-13T18:13:18.823085] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-13T18:13:18.864189] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:18.864852] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-13T18:13:18.864919] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-13T18:13:18.865411] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-13T18:13:18.865468] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-13T18:13:19.246061] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:19.588987] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:13:19.617884] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-13T18:13:20.417928] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-13T18:13:20.454488] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:13:21.210105] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:13:21.218394] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-13T18:13:21.945419] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:13:22.017891] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-13T18:13:22.750960] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:13:22.817905] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-13T18:13:23.628237] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-13T18:13:23.634699] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:13:24.417985] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-13T18:13:24.518010] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:13:25.218003] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-13T18:13:25.489102] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T18:13:25.494507] [INFO ] [REMOTE ] CRH: Full fetch complete (77297 records). [2025-10-13T18:13:25.494627] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-13T18:13:25.882569] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-13T18:13:25.882734] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-13T18:13:25.883712] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-13T18:13:25.883791] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-13T18:13:25.885404] [DEBUG] [LOCAL ] CRH: Trimmed 77297 records to 53445 (keeping 200 days of data) [2025-10-13T18:13:26.001734] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:13:26.034952] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-13T18:13:26.247474] [DEBUG] [LOCAL ] CRH: Primary data saved (53445 records). [2025-10-13T18:13:26.247609] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-13T18:13:26.247748] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRH took 37.8s. Estimated remaining: 4h 13m 39s. Rate: 7.2 symbols/min [2025-10-13T18:13:26.417836] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:26.468786] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-13T18:13:26.469100] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-10-13T18:13:26.645214] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:26.645484] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-13T18:13:26.645546] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-13T18:13:26.646124] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-13T18:13:26.646181] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-13T18:13:26.818342] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-13T18:13:26.998244] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:27.157044] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T18:13:27.617896] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-13T18:13:27.884869] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:13:28.417883] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-13T18:13:28.870564] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:13:29.217938] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-13T18:13:29.437168] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T18:13:30.024358] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-13T18:13:30.042771] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T18:13:30.674557] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:13:30.817886] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-13T18:13:31.617997] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-13T18:13:32.349389] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T18:13:32.417889] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-13T18:13:32.458586] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-13T18:13:33.041023] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:13:33.217903] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-13T18:13:33.965042] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:13:34.017972] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-13T18:13:34.818001] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-13T18:13:35.555024] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T18:13:35.630241] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-13T18:13:35.637148] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:13:36.275437] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T18:13:36.417929] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-13T18:13:37.037044] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T18:13:37.217926] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-13T18:13:37.876802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:13:37.886597] [INFO ] [REMOTE ] CRK: Full fetch complete (75244 records). [2025-10-13T18:13:37.887081] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-13T18:13:37.888123] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:13:37.888257] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:13:37.888301] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:13:37.888341] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-13T18:13:37.888399] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-13T18:13:37.888434] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-10-13T18:13:37.888861] [DEBUG] [LOCAL ] CRK: Deleted derivative data file. [2025-10-13T18:13:37.889742] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRK took 31.0s. Estimated remaining: 4h 13m 43s. Rate: 7.2 symbols/min [2025-10-13T18:13:38.023070] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-13T18:13:38.091223] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:38.137246] [DEBUG] [LOCAL ] CRS: Loaded 43725 existing records from primary storage. [2025-10-13T18:13:38.137629] [INFO ] [MAIN ] CRS: Loaded 43725 existing records. [2025-10-13T18:13:38.337834] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:38.338078] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-13T18:13:38.338132] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-13T18:13:38.338447] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-13T18:13:38.338510] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-13T18:13:38.717163] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:38.763364] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:13:38.817883] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-13T18:13:39.617894] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-13T18:13:39.919180] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:13:39.924006] [INFO ] [REMOTE ] CRI: Full fetch complete (70777 records). [2025-10-13T18:13:39.924137] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-13T18:13:40.326038] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-13T18:13:40.326138] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-13T18:13:40.327145] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-13T18:13:40.327217] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-13T18:13:40.328836] [DEBUG] [LOCAL ] CRI: Trimmed 70777 records to 49698 (keeping 200 days of data) [2025-10-13T18:13:40.422963] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-13T18:13:40.597546] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:13:40.678202] [DEBUG] [LOCAL ] CRI: Primary data saved (49698 records). [2025-10-13T18:13:40.678394] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-13T18:13:40.678563] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRI took 47.5s. Estimated remaining: 4h 13m 15s. Rate: 7.3 symbols/min [2025-10-13T18:13:40.846960] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:40.853571] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-13T18:13:40.853797] [INFO ] [MAIN ] CRT: Loaded 5025 existing records. [2025-10-13T18:13:41.029604] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:41.029871] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-13T18:13:41.029985] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-13T18:13:41.030196] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-13T18:13:41.030262] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-13T18:13:41.223160] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-13T18:13:41.394704] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:41.861269] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T18:13:41.948750] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:13:42.017904] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-13T18:13:42.749795] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T18:13:42.760078] [INFO ] [REMOTE ] CRL: Full fetch complete (63274 records). [2025-10-13T18:13:42.760194] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-13T18:13:42.825246] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-13T18:13:43.152751] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-13T18:13:43.152886] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-13T18:13:43.153731] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-13T18:13:43.153811] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-13T18:13:43.155407] [DEBUG] [LOCAL ] CRL: Trimmed 63274 records to 42928 (keeping 200 days of data) [2025-10-13T18:13:43.309189] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:13:43.459256] [DEBUG] [LOCAL ] CRL: Primary data saved (42928 records). [2025-10-13T18:13:43.459392] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-13T18:13:43.459470] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRL took 25.1s. Estimated remaining: 4h 12m 48s. Rate: 7.3 symbols/min [2025-10-13T18:13:43.629608] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-13T18:13:43.634147] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:43.675752] [DEBUG] [LOCAL ] CSAN: Loaded 42688 existing records from primary storage. [2025-10-13T18:13:43.676059] [INFO ] [MAIN ] CSAN: Loaded 42688 existing records. [2025-10-13T18:13:43.798163] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:13:43.869620] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:43.869878] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-13T18:13:43.869970] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-13T18:13:43.870499] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-13T18:13:43.870558] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-13T18:13:44.232611] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:44.418012] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-13T18:13:45.217993] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-13T18:13:45.763380] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:13:45.977584] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T18:13:46.017895] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-13T18:13:46.248705] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:13:46.818001] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-13T18:13:47.364429] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:13:47.617988] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-13T18:13:48.152379] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T18:13:48.417980] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-13T18:13:49.109676] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T18:13:49.217914] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-13T18:13:50.018028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-13T18:13:50.546162] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T18:13:50.819075] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-13T18:13:50.825797] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-13T18:13:50.923906] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:13:51.402372] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:13:51.617946] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-13T18:13:52.418008] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-13T18:13:53.100104] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:13:53.217882] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-13T18:13:54.017932] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-13T18:13:54.105780] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:13:54.817907] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-13T18:13:54.916273] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T18:13:55.617607] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:13:55.619764] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-13T18:13:56.280685] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T18:13:56.417941] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-13T18:13:56.606932] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-13T18:13:57.217940] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-13T18:13:57.753126] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T18:13:57.913410] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:13:58.018026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-13T18:13:58.817989] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-13T18:13:59.431289] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:13:59.617913] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-13T18:13:59.680405] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T18:14:00.418033] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-13T18:14:01.218016] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-13T18:14:01.348126] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:14:01.941133] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:14:02.017907] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-13T18:14:02.062090] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T18:14:02.817915] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-13T18:14:03.405968] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T18:14:03.407419] [INFO ] [REMOTE ] CRT: Full fetch complete (7441 records). [2025-10-13T18:14:03.407487] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-13T18:14:03.629920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-13T18:14:03.670189] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:14:03.885167] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-13T18:14:03.885272] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-13T18:14:03.885715] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-13T18:14:03.885783] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-13T18:14:03.886236] [DEBUG] [LOCAL ] CRT: Trimmed 7441 records to 4929 (keeping 200 days of data) [2025-10-13T18:14:03.919918] [DEBUG] [LOCAL ] CRT: Primary data saved (4929 records). [2025-10-13T18:14:03.920109] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-13T18:14:03.920217] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRT took 23.2s. Estimated remaining: 4h 13m 22s. Rate: 7.2 symbols/min [2025-10-13T18:14:04.105134] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:04.146004] [DEBUG] [LOCAL ] CSL: Loaded 31969 existing records from primary storage. [2025-10-13T18:14:04.146397] [INFO ] [MAIN ] CSL: Loaded 31969 existing records. [2025-10-13T18:14:04.383825] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:04.384182] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-13T18:14:04.384241] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-13T18:14:04.384788] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-13T18:14:04.384853] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-13T18:14:04.423212] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-13T18:14:04.926541] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:05.218052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-13T18:14:05.456342] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:14:06.018004] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-13T18:14:06.057380] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:14:06.266508] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:14:06.817919] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-13T18:14:07.564727] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:14:07.617893] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-13T18:14:07.905876] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:14:08.417919] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-13T18:14:08.768824] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T18:14:09.217945] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-13T18:14:09.728349] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:14:10.017937] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-13T18:14:10.573033] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:14:10.817929] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-13T18:14:11.618000] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-13T18:14:12.402245] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:14:12.406251] [INFO ] [REMOTE ] CSAN: Full fetch complete (60238 records). [2025-10-13T18:14:12.406340] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-13T18:14:12.427193] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-13T18:14:12.737604] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-13T18:14:12.842230] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-13T18:14:12.842327] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-13T18:14:12.843122] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-13T18:14:12.843204] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-13T18:14:12.849858] [DEBUG] [LOCAL ] CSAN: Trimmed 60238 records to 42131 (keeping 200 days of data) [2025-10-13T18:14:12.859964] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:14:13.105671] [DEBUG] [LOCAL ] CSAN: Primary data saved (42131 records). [2025-10-13T18:14:13.105811] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-13T18:14:13.105887] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CSAN took 29.6s. Estimated remaining: 4h 13m 17s. Rate: 7.2 symbols/min [2025-10-13T18:14:13.223026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-13T18:14:13.273967] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:13.274113] [DEBUG] [LOCAL ] CSR: No existing data file found in primary storage. [2025-10-13T18:14:13.274149] [WARN ] [MAIN ] CSR: No existing data found, performing full refresh instead. [2025-10-13T18:14:13.274275] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-13T18:14:13.274317] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-13T18:14:13.274358] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-13T18:14:13.274390] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-13T18:14:13.634960] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:14.017896] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-13T18:14:14.190549] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:14:14.195104] [INFO ] [REMOTE ] CRS: Full fetch complete (62499 records). [2025-10-13T18:14:14.195212] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-13T18:14:14.594623] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-13T18:14:14.594811] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-13T18:14:14.595781] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-13T18:14:14.595908] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-13T18:14:14.615321] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:14:14.615434] [DEBUG] [LOCAL ] CRS: Trimmed 62499 records to 43179 (keeping 200 days of data) [2025-10-13T18:14:14.819072] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-13T18:14:14.901057] [DEBUG] [LOCAL ] CRS: Primary data saved (43179 records). [2025-10-13T18:14:14.901200] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-13T18:14:14.902159] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CRS took 37.0s. Estimated remaining: 4h 12m 46s. Rate: 7.3 symbols/min [2025-10-13T18:14:15.071927] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:15.072091] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-13T18:14:15.072128] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-13T18:14:15.072240] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-13T18:14:15.072283] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-13T18:14:15.072324] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-13T18:14:15.072356] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-13T18:14:15.432825] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:15.617903] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-13T18:14:15.674746] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T18:14:16.423059] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-13T18:14:16.436206] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T18:14:17.217904] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-13T18:14:17.276051] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T18:14:17.474458] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:14:18.017944] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-13T18:14:18.676807] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:14:18.817907] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-13T18:14:19.617929] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-13T18:14:20.064164] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:14:20.180193] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T18:14:20.421809] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-13T18:14:20.422666] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:14:21.217924] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-13T18:14:21.929245] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T18:14:21.976791] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:14:22.017895] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-13T18:14:22.817926] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-13T18:14:23.367575] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T18:14:23.391702] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:14:23.398044] [INFO ] [REMOTE ] CRM: Full fetch complete (77845 records). [2025-10-13T18:14:23.398245] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-13T18:14:23.621565] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-13T18:14:23.860949] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-13T18:14:23.861123] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-13T18:14:23.862274] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-13T18:14:23.862341] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-13T18:14:23.864406] [DEBUG] [LOCAL ] CRM: Trimmed 77845 records to 53770 (keeping 200 days of data) [2025-10-13T18:14:24.242626] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-13T18:14:24.242829] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-13T18:14:24.242919] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CRM took 58.0s. Estimated remaining: 4h 12m 42s. Rate: 7.2 symbols/min [2025-10-13T18:14:24.415801] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:24.417930] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-13T18:14:24.429386] [DEBUG] [LOCAL ] CSV: Loaded 12872 existing records from primary storage. [2025-10-13T18:14:24.429625] [INFO ] [MAIN ] CSV: Loaded 12872 existing records. [2025-10-13T18:14:24.617092] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:24.617409] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-13T18:14:24.617464] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-13T18:14:24.617927] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-13T18:14:24.618009] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-13T18:14:24.894423] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:14:24.995288] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:25.217926] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-13T18:14:25.483154] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T18:14:26.017917] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-13T18:14:26.354593] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T18:14:26.817917] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-13T18:14:27.528331] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:14:27.617892] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-13T18:14:27.658293] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:14:28.418007] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-13T18:14:29.217993] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-13T18:14:29.288984] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:14:29.448801] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T18:14:29.962203] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T18:14:30.017887] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-13T18:14:30.817900] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-13T18:14:30.846825] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T18:14:31.617906] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-13T18:14:32.281592] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:14:32.417897] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-13T18:14:32.485264] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T18:14:33.218016] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-13T18:14:33.849467] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:14:34.018006] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-13T18:14:34.187407] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:14:34.817904] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-13T18:14:35.381811] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:14:35.617894] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-13T18:14:35.768760] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:14:36.417889] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-13T18:14:36.557559] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:14:36.559602] [INFO ] [REMOTE ] CSR: Full fetch complete (17790 records). [2025-10-13T18:14:36.559703] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-13T18:14:36.911225] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-13T18:14:36.911306] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-13T18:14:36.911691] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-13T18:14:36.911750] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-13T18:14:36.912255] [DEBUG] [LOCAL ] CSR: Trimmed 17790 records to 13229 (keeping 200 days of data) [2025-10-13T18:14:36.993772] [DEBUG] [LOCAL ] CSR: Primary data saved (13229 records). [2025-10-13T18:14:36.993905] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-13T18:14:36.993973] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSR took 23.9s. Estimated remaining: 4h 12m 49s. Rate: 7.2 symbols/min [2025-10-13T18:14:37.158040] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:37.158206] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-13T18:14:37.158242] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-13T18:14:37.158345] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-13T18:14:37.158384] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-13T18:14:37.158423] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-13T18:14:37.158453] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-13T18:14:37.223207] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-13T18:14:37.510864] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:37.822323] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:14:38.017910] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-13T18:14:38.361837] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:14:38.817933] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-13T18:14:39.017269] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:39.017574] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-13T18:14:39.017697] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:39.017761] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-13T18:14:39.017840] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:39.017922] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-13T18:14:39.018035] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-13T18:14:39.018094] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-13T18:14:39.018198] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-13T18:14:39.018263] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSW took 2.0s. Estimated remaining: 4h 12m 19s. Rate: 7.3 symbols/min [2025-10-13T18:14:39.187045] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:39.212301] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:14:39.224180] [DEBUG] [LOCAL ] CTBB: Loaded 7130 existing records from primary storage. [2025-10-13T18:14:39.224384] [INFO ] [MAIN ] CTBB: Loaded 7130 existing records. [2025-10-13T18:14:39.395196] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:39.395432] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-13T18:14:39.395478] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-13T18:14:39.395693] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-13T18:14:39.395749] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-13T18:14:39.618090] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-13T18:14:39.747531] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:40.417938] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-13T18:14:41.217915] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-13T18:14:41.373499] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T18:14:41.449015] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T18:14:42.017916] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-13T18:14:42.229904] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:14:42.818026] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-13T18:14:43.220981] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T18:14:43.617947] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-13T18:14:44.118832] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:14:44.417939] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-13T18:14:44.637256] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:14:45.217924] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-13T18:14:45.939524] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:14:45.991726] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T18:14:46.017890] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-13T18:14:46.817991] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-13T18:14:47.411604] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:14:47.416404] [INFO ] [REMOTE ] CSTM: Full fetch complete (69310 records). [2025-10-13T18:14:47.416500] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-13T18:14:47.626432] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-13T18:14:47.765917] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:14:47.814636] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-13T18:14:47.814744] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-13T18:14:47.815565] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-13T18:14:47.815606] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-13T18:14:47.816903] [DEBUG] [LOCAL ] CSTM: Trimmed 69310 records to 47634 (keeping 200 days of data) [2025-10-13T18:14:48.088128] [DEBUG] [LOCAL ] CSTM: Primary data saved (47634 records). [2025-10-13T18:14:48.088307] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-13T18:14:48.088384] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 33.2s. Estimated remaining: 4h 12m 13s. Rate: 7.3 symbols/min [2025-10-13T18:14:48.259732] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:48.266172] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:14:48.274260] [DEBUG] [LOCAL ] CTDD: Loaded 5856 existing records from primary storage. [2025-10-13T18:14:48.274444] [INFO ] [MAIN ] CTDD: Loaded 5856 existing records. [2025-10-13T18:14:48.425302] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-13T18:14:48.449769] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:48.450252] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-13T18:14:48.450309] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-13T18:14:48.450449] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-13T18:14:48.450487] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-13T18:14:48.800433] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:49.218023] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-13T18:14:49.461995] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:14:49.851436] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:14:50.017902] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-13T18:14:50.757730] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T18:14:50.817885] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-13T18:14:51.617891] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-13T18:14:51.693809] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T18:14:52.417918] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-13T18:14:52.866699] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T18:14:53.013077] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:14:53.016486] [INFO ] [REMOTE ] CSL: Full fetch complete (45319 records). [2025-10-13T18:14:53.016562] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-13T18:14:53.226336] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-13T18:14:53.410597] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-13T18:14:53.410703] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-13T18:14:53.411387] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-13T18:14:53.411449] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-13T18:14:53.412433] [DEBUG] [LOCAL ] CSL: Trimmed 45319 records to 31512 (keeping 200 days of data) [2025-10-13T18:14:53.608267] [DEBUG] [LOCAL ] CSL: Primary data saved (31512 records). [2025-10-13T18:14:53.608415] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-13T18:14:53.608495] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CSL took 49.7s. Estimated remaining: 4h 11m 56s. Rate: 7.3 symbols/min [2025-10-13T18:14:53.775267] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:53.775454] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-13T18:14:53.775491] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-13T18:14:53.775624] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-13T18:14:53.775697] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-13T18:14:53.775753] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-13T18:14:53.775786] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-13T18:14:54.022092] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-13T18:14:54.090528] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:14:54.173591] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:54.818057] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-13T18:14:54.988638] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:14:55.366730] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:14:55.617940] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-13T18:14:56.265447] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:14:56.417936] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-13T18:14:56.995812] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T18:14:57.217915] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-13T18:14:57.636763] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T18:14:58.017992] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-13T18:14:58.351065] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:58.351541] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-13T18:14:58.351668] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:58.351734] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-13T18:14:58.351777] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:58.351845] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-13T18:14:58.351917] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-13T18:14:58.351955] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-13T18:14:58.351995] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-13T18:14:58.352045] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEST took 4.7s. Estimated remaining: 4h 11m 36s. Rate: 7.3 symbols/min [2025-10-13T18:14:58.533897] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:58.534381] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-13T18:14:58.534441] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-13T18:14:58.534565] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-13T18:14:58.534608] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-13T18:14:58.534687] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-13T18:14:58.534745] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-13T18:14:58.818273] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-13T18:14:58.900769] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:59.618014] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-13T18:14:59.849855] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:59.850591] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-13T18:14:59.850750] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:59.850826] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-13T18:14:59.850896] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:59.850970] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-13T18:14:59.851048] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-13T18:14:59.851138] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-13T18:14:59.851191] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-13T18:14:59.851252] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTEV took 1.5s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-13T18:15:00.031383] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:00.031779] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-13T18:15:00.031871] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-13T18:15:00.032038] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-13T18:15:00.032208] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-13T18:15:00.032340] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-13T18:15:00.041271] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-13T18:15:00.042382] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T18:15:00.423072] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-13T18:15:00.428106] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:01.218005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-13T18:15:01.497419] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T18:15:01.499201] [INFO ] [REMOTE ] CSV: Full fetch complete (19254 records). [2025-10-13T18:15:01.499280] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-13T18:15:01.881290] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-13T18:15:01.881370] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-13T18:15:01.881874] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-13T18:15:01.881935] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-13T18:15:01.882520] [DEBUG] [LOCAL ] CSV: Trimmed 19254 records to 12750 (keeping 200 days of data) [2025-10-13T18:15:01.964815] [DEBUG] [LOCAL ] CSV: Primary data saved (12750 records). [2025-10-13T18:15:01.964973] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-13T18:15:01.965064] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CSV took 37.7s. Estimated remaining: 4h 10m 36s. Rate: 7.3 symbols/min [2025-10-13T18:15:02.023065] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-13T18:15:02.184984] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:02.185204] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-13T18:15:02.185247] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-13T18:15:02.185360] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-13T18:15:02.185401] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-13T18:15:02.185441] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-13T18:15:02.185494] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-13T18:15:02.527857] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:02.817938] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-13T18:15:02.828115] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T18:15:03.303888] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:15:03.617927] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-13T18:15:04.058137] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T18:15:04.417904] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-13T18:15:04.532572] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T18:15:04.996905] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:15:04.998203] [INFO ] [REMOTE ] CTBB: Full fetch complete (10455 records). [2025-10-13T18:15:04.998273] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-13T18:15:05.223271] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-13T18:15:05.361549] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-13T18:15:05.361633] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-13T18:15:05.361942] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-13T18:15:05.361988] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-13T18:15:05.362518] [DEBUG] [LOCAL ] CTBB: Trimmed 10455 records to 6924 (keeping 200 days of data) [2025-10-13T18:15:05.405431] [DEBUG] [LOCAL ] CTBB: Primary data saved (6924 records). [2025-10-13T18:15:05.405572] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-13T18:15:05.405691] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 26.4s. Estimated remaining: 4h 10m 12s. Rate: 7.3 symbols/min [2025-10-13T18:15:05.587261] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:05.587434] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-13T18:15:05.587471] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-13T18:15:05.587582] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-13T18:15:05.587626] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-13T18:15:05.587705] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-13T18:15:05.587750] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-13T18:15:05.990194] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:06.007901] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:15:06.017873] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-13T18:15:06.625016] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T18:15:06.817926] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-13T18:15:07.451357] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T18:15:07.618051] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-13T18:15:08.417922] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-13T18:15:09.217891] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-13T18:15:09.630255] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T18:15:09.701733] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:15:10.017940] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-13T18:15:10.491412] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T18:15:10.818015] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-13T18:15:11.368096] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:15:11.617939] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-13T18:15:11.974121] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:15:12.332349] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:15:12.417888] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-13T18:15:13.082433] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:15:13.217940] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-13T18:15:14.018034] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-13T18:15:14.817911] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-13T18:15:15.140028] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T18:15:15.248022] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:15:15.618014] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-13T18:15:16.057756] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T18:15:16.417902] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-13T18:15:16.461101] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T18:15:17.217922] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-13T18:15:17.405078] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:15:17.728178] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T18:15:17.729143] [INFO ] [REMOTE ] CTDD: Full fetch complete (8190 records). [2025-10-13T18:15:17.729210] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-13T18:15:18.023076] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-13T18:15:18.084167] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-13T18:15:18.084249] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-13T18:15:18.084483] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-13T18:15:18.084522] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-13T18:15:18.084943] [DEBUG] [LOCAL ] CTDD: Trimmed 8190 records to 5638 (keeping 200 days of data) [2025-10-13T18:15:18.120020] [DEBUG] [LOCAL ] CTDD: Primary data saved (5638 records). [2025-10-13T18:15:18.120114] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-13T18:15:18.120192] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTDD took 30.0s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-13T18:15:18.283459] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:18.326556] [DEBUG] [LOCAL ] CTRE: Loaded 50027 existing records from primary storage. [2025-10-13T18:15:18.326893] [INFO ] [MAIN ] CTRE: Loaded 50027 existing records. [2025-10-13T18:15:18.497500] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:18.497712] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-13T18:15:18.497784] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-13T18:15:18.499272] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-13T18:15:18.499334] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-13T18:15:18.849085] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:18.825238] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-13T18:15:19.370162] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:15:19.618006] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-13T18:15:20.417934] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-13T18:15:21.138238] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T18:15:21.230224] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-13T18:15:21.253900] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:15:21.788037] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:15:22.017920] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-13T18:15:22.817910] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-13T18:15:23.154434] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:15:23.610576] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:15:23.621929] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-13T18:15:23.706554] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T18:15:24.417913] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-13T18:15:25.217901] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-13T18:15:25.272227] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:15:26.017916] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-13T18:15:26.224964] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:15:26.317884] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:15:26.817931] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-13T18:15:27.404901] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:15:27.617909] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-13T18:15:28.166559] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T18:15:28.418005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-13T18:15:28.986245] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:15:29.217914] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-13T18:15:29.796322] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:15:29.799945] [INFO ] [REMOTE ] CTO: Full fetch complete (41556 records). [2025-10-13T18:15:29.800035] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-13T18:15:30.023162] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-13T18:15:30.178359] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-13T18:15:30.178434] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-13T18:15:30.179018] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-13T18:15:30.179079] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-13T18:15:30.179967] [DEBUG] [LOCAL ] CTO: Trimmed 41556 records to 27753 (keeping 200 days of data) [2025-10-13T18:15:30.343202] [DEBUG] [LOCAL ] CTO: Primary data saved (27753 records). [2025-10-13T18:15:30.343330] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-13T18:15:30.343401] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 30.5s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-13T18:15:30.517268] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:30.517597] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-13T18:15:30.517707] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-13T18:15:30.517832] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-13T18:15:30.517900] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-13T18:15:30.518006] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-13T18:15:30.518056] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-13T18:15:30.819840] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-13T18:15:30.889404] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:30.916824] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:15:31.475154] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:15:31.617923] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-13T18:15:32.417900] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-13T18:15:32.780975] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T18:15:32.868415] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:15:33.217943] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-13T18:15:34.009384] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:15:34.019049] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-13T18:15:34.817892] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-13T18:15:35.091130] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T18:15:35.148201] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T18:15:35.617916] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-13T18:15:35.965803] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T18:15:36.417969] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-13T18:15:36.987597] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:15:37.217901] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-13T18:15:37.464846] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:15:38.017941] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-13T18:15:38.775486] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:15:38.817913] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-13T18:15:39.617919] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-13T18:15:39.923733] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T18:15:40.417978] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-13T18:15:40.513222] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:15:40.644514] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:15:41.217970] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-13T18:15:42.017923] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-13T18:15:42.243129] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T18:15:42.469924] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:15:42.817983] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-13T18:15:43.592223] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T18:15:43.617893] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-13T18:15:44.417911] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-13T18:15:44.688595] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T18:15:45.042231] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T18:15:45.217922] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-13T18:15:45.573961] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T18:15:46.017937] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-13T18:15:46.518908] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:15:46.523125] [INFO ] [REMOTE ] CTOS: Full fetch complete (53657 records). [2025-10-13T18:15:46.523220] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-13T18:15:46.823031] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-13T18:15:46.903818] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-13T18:15:46.903895] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-13T18:15:46.904553] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-13T18:15:46.904591] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-13T18:15:46.905712] [DEBUG] [LOCAL ] CTOS: Trimmed 53657 records to 37028 (keeping 200 days of data) [2025-10-13T18:15:47.110865] [DEBUG] [LOCAL ] CTOS: Primary data saved (37028 records). [2025-10-13T18:15:47.111002] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-13T18:15:47.111074] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTOS took 45.1s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-13T18:15:47.291269] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:47.311327] [DEBUG] [LOCAL ] CTS: Loaded 19662 existing records from primary storage. [2025-10-13T18:15:47.311608] [INFO ] [MAIN ] CTS: Loaded 19662 existing records. [2025-10-13T18:15:47.455979] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:15:47.522225] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:47.522435] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-13T18:15:47.522496] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-13T18:15:47.522816] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-13T18:15:47.522882] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-13T18:15:47.624042] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-13T18:15:47.874890] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:48.417890] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-13T18:15:48.744415] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T18:15:48.750767] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-13T18:15:48.750922] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-13T18:15:49.145542] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-13T18:15:49.145716] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-13T18:15:49.146685] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-13T18:15:49.146771] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-13T18:15:49.152833] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 53646 (keeping 200 days of data) [2025-10-13T18:15:49.240772] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-13T18:15:49.281785] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:15:49.516243] [DEBUG] [LOCAL ] CTRA: Primary data saved (53646 records). [2025-10-13T18:15:49.516382] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-13T18:15:49.516499] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRA took 44.1s. Estimated remaining: 4h 10m 16s. Rate: 7.3 symbols/min [2025-10-13T18:15:49.687098] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:49.687320] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-13T18:15:49.687442] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-13T18:15:49.687553] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-13T18:15:49.687595] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-13T18:15:49.687635] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-13T18:15:49.687710] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-13T18:15:50.018346] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-13T18:15:50.078727] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:50.051364] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:15:50.256923] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:15:50.817927] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-13T18:15:51.617900] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-13T18:15:51.697623] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T18:15:51.702577] [INFO ] [REMOTE ] CTRE: Full fetch complete (70782 records). [2025-10-13T18:15:51.702750] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-13T18:15:51.703514] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:15:51.703621] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:15:51.703718] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:15:51.703805] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-13T18:15:51.703898] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-13T18:15:51.703954] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-13T18:15:51.704371] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-13T18:15:51.705478] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRE took 33.6s. Estimated remaining: 4h 9m 48s. Rate: 7.3 symbols/min [2025-10-13T18:15:51.878135] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:51.878428] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-13T18:15:51.878480] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-13T18:15:51.878591] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-13T18:15:51.878632] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-13T18:15:51.878727] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-13T18:15:51.878777] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-13T18:15:52.275278] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:15:52.296562] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:52.417910] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-13T18:15:52.953222] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:15:53.217930] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-13T18:15:53.657061] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:15:54.017916] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-13T18:15:54.147541] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:15:54.351821] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-13T18:15:54.817920] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-13T18:15:55.617930] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-13T18:15:56.417919] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-13T18:15:56.471910] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:15:56.588524] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:15:56.649524] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-13T18:15:57.217935] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-13T18:15:58.017917] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-13T18:15:58.654569] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T18:15:58.660569] [INFO ] [REMOTE ] CTRI: Full fetch complete (52991 records). [2025-10-13T18:15:58.660824] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-13T18:15:58.823137] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-13T18:15:59.074837] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-13T18:15:59.074948] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-13T18:15:59.076085] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-13T18:15:59.076154] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-13T18:15:59.077713] [DEBUG] [LOCAL ] CTRI: Trimmed 52991 records to 39822 (keeping 200 days of data) [2025-10-13T18:15:59.327332] [DEBUG] [LOCAL ] CTRI: Primary data saved (39822 records). [2025-10-13T18:15:59.327553] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-13T18:15:59.327760] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRI took 29.0s. Estimated remaining: 4h 9m 37s. Rate: 7.3 symbols/min [2025-10-13T18:15:59.523018] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:59.582216] [DEBUG] [LOCAL ] CUBE: Loaded 51520 existing records from primary storage. [2025-10-13T18:15:59.582637] [INFO ] [MAIN ] CUBE: Loaded 51520 existing records. [2025-10-13T18:15:59.622595] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-13T18:15:59.790320] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:59.791104] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-13T18:15:59.791230] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-13T18:15:59.792073] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-13T18:15:59.792134] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-13T18:15:59.935114] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-13T18:16:00.046079] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:16:00.078240] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-13T18:16:00.263775] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:00.417974] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-13T18:16:01.217919] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-13T18:16:02.023035] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-13T18:16:02.039290] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:16:02.690282] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:16:02.817967] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-13T18:16:03.380836] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:16:03.617941] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-13T18:16:04.417989] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-13T18:16:04.542332] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:16:04.723330] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:16:04.836506] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T18:16:05.217945] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-13T18:16:05.551832] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T18:16:06.018006] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-13T18:16:06.818041] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-13T18:16:07.011393] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T18:16:07.099589] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-13T18:16:07.617999] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-13T18:16:07.849252] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-13T18:16:08.417944] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-13T18:16:09.217987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-13T18:16:09.519590] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:16:10.017995] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-13T18:16:10.817913] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-13T18:16:11.062883] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:16:11.528903] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T18:16:11.617934] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-13T18:16:11.854676] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:16:11.956718] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T18:16:12.417979] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-13T18:16:12.686901] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-13T18:16:13.217937] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-13T18:16:14.017975] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-13T18:16:14.329595] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-13T18:16:14.817905] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-13T18:16:14.963593] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:16:15.313419] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T18:16:15.314187] [INFO ] [REMOTE ] CUBB: Full fetch complete (911 records). [2025-10-13T18:16:15.314256] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-13T18:16:15.510730] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-13T18:16:15.510953] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:16:15.511024] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:16:15.511102] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-13T18:16:15.511164] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-13T18:16:15.511200] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-13T18:16:15.511241] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-13T18:16:15.511296] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 23.8s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-13T18:16:15.623126] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-13T18:16:15.681695] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:15.715385] [DEBUG] [LOCAL ] CUBI: Loaded 27426 existing records from primary storage. [2025-10-13T18:16:15.715686] [INFO ] [MAIN ] CUBI: Loaded 27426 existing records. [2025-10-13T18:16:15.899623] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:15.899905] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-13T18:16:15.899953] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-13T18:16:15.900176] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-13T18:16:15.900233] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-13T18:16:16.280697] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:16.418004] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-13T18:16:17.217895] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-13T18:16:17.365182] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:16:17.450467] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:16:18.018001] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-13T18:16:18.710133] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T18:16:18.817886] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-13T18:16:19.091522] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:16:19.617925] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-13T18:16:20.417892] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-13T18:16:20.541947] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:16:20.623701] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:16:21.217892] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-13T18:16:21.414693] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T18:16:22.017914] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-13T18:16:22.817921] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-13T18:16:22.914600] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:16:23.184719] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T18:16:23.617912] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-13T18:16:23.682479] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:16:23.684779] [INFO ] [REMOTE ] CTS: Full fetch complete (26770 records). [2025-10-13T18:16:23.684897] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-13T18:16:24.065251] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-13T18:16:24.065334] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-13T18:16:24.065808] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-13T18:16:24.065869] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-13T18:16:24.066588] [DEBUG] [LOCAL ] CTS: Trimmed 26770 records to 19511 (keeping 200 days of data) [2025-10-13T18:16:24.187128] [DEBUG] [LOCAL ] CTS: Primary data saved (19511 records). [2025-10-13T18:16:24.187273] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-13T18:16:24.187352] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTS took 37.1s. Estimated remaining: 4h 9m 48s. Rate: 7.3 symbols/min [2025-10-13T18:16:24.378492] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:24.427274] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-13T18:16:24.430790] [DEBUG] [LOCAL ] CUK: Loaded 51722 existing records from primary storage. [2025-10-13T18:16:24.431211] [INFO ] [MAIN ] CUK: Loaded 51722 existing records. [2025-10-13T18:16:24.610958] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:24.611176] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-13T18:16:24.611222] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-13T18:16:24.611599] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-13T18:16:24.611689] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-13T18:16:24.979577] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:25.130502] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:16:25.217907] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-13T18:16:26.017993] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-13T18:16:26.255562] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:16:26.299846] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T18:16:26.817903] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-13T18:16:27.617900] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-13T18:16:27.948235] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T18:16:28.417904] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-13T18:16:28.617303] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:16:29.217938] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-13T18:16:29.610709] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T18:16:29.891632] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T18:16:30.017933] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-13T18:16:30.655539] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:16:30.817910] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-13T18:16:31.617927] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-13T18:16:31.855877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:16:31.963887] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:16:32.417944] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-13T18:16:33.193466] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:16:33.217886] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-13T18:16:34.013427] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:16:34.022562] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-13T18:16:34.794939] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:16:34.817888] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-13T18:16:35.352498] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T18:16:35.617920] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-13T18:16:36.417903] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-13T18:16:36.497684] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T18:16:36.562681] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:16:37.217941] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-13T18:16:38.017922] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-13T18:16:38.182815] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:16:38.817912] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-13T18:16:39.208940] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:16:39.210291] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T18:16:39.617904] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-13T18:16:40.262982] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T18:16:40.268194] [INFO ] [REMOTE ] CUBE: Full fetch complete (73052 records). [2025-10-13T18:16:40.268308] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-13T18:16:40.424669] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-13T18:16:40.659612] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-13T18:16:40.659743] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-13T18:16:40.660579] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-13T18:16:40.660662] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-13T18:16:40.662098] [DEBUG] [LOCAL ] CUBE: Trimmed 73052 records to 50841 (keeping 200 days of data) [2025-10-13T18:16:40.888396] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:16:40.894256] [INFO ] [REMOTE ] CUBI: Full fetch complete (38883 records). [2025-10-13T18:16:40.896186] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-13T18:16:40.901227] [FATAL] [VALIDATOR ] CUBI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:16:40.905222] [FATAL] [MAIN ] CUBI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:16:40.907154] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:16:40.908076] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-13T18:16:40.909260] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-13T18:16:40.910676] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-13T18:16:40.912675] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-13T18:16:40.913279] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 25.4s. Estimated remaining: 4h 10m 8s. Rate: 7.3 symbols/min [2025-10-13T18:16:41.137900] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:41.166429] [DEBUG] [LOCAL ] CULP: Loaded 2919 existing records from primary storage. [2025-10-13T18:16:41.173441] [INFO ] [MAIN ] CULP: Loaded 2919 existing records. [2025-10-13T18:16:41.232408] [DEBUG] [LOCAL ] CUBE: Primary data saved (50841 records). [2025-10-13T18:16:41.240873] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-13T18:16:41.241064] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBE took 41.9s. Estimated remaining: 4h 9m 34s. Rate: 7.3 symbols/min [2025-10-13T18:16:41.225540] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-13T18:16:41.381911] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:41.382258] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-13T18:16:41.382320] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-13T18:16:41.382576] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-13T18:16:41.382635] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-13T18:16:41.779280] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:42.018028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-13T18:16:42.376008] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T18:16:42.381686] [INFO ] [REMOTE ] CTVA: Full fetch complete (77007 records). [2025-10-13T18:16:42.381835] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-13T18:16:42.702893] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T18:16:42.807852] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-13T18:16:42.807973] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-13T18:16:42.808978] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-13T18:16:42.809044] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-13T18:16:42.810728] [DEBUG] [LOCAL ] CTVA: Trimmed 77007 records to 53277 (keeping 200 days of data) [2025-10-13T18:16:42.867075] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-13T18:16:43.175493] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:16:43.207430] [DEBUG] [LOCAL ] CTVA: Primary data saved (53277 records). [2025-10-13T18:16:43.207599] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-13T18:16:43.207705] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CTVA took 53.7s. Estimated remaining: 4h 9m 5s. Rate: 7.3 symbols/min [2025-10-13T18:16:43.501563] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T18:16:43.617943] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-13T18:16:44.168053] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:16:44.417923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-13T18:16:44.880291] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T18:16:45.217942] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-13T18:16:46.017997] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-13T18:16:46.516664] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:16:46.817923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-13T18:16:46.982541] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T18:16:47.139368] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-13T18:16:47.617919] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-13T18:16:48.418018] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-13T18:16:48.954608] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T18:16:49.217923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-13T18:16:49.323412] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:16:49.768854] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:16:50.017939] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-13T18:16:50.524293] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T18:16:50.817986] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-13T18:16:51.618054] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-13T18:16:52.118037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:16:52.304867] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T18:16:52.417926] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-13T18:16:53.217993] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-13T18:16:53.922226] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T18:16:53.923107] [INFO ] [REMOTE ] CULP: Full fetch complete (4588 records). [2025-10-13T18:16:53.923177] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-13T18:16:54.316259] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-13T18:16:54.316380] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-13T18:16:54.316580] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-13T18:16:54.316890] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-13T18:16:54.317607] [DEBUG] [LOCAL ] CULP: Trimmed 4588 records to 2895 (keeping 200 days of data) [2025-10-13T18:16:54.336481] [DEBUG] [LOCAL ] CULP: Primary data saved (2895 records). [2025-10-13T18:16:54.336625] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-13T18:16:54.336863] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 13.4s. Estimated remaining: 4h 9m 6s. Rate: 7.3 symbols/min [2025-10-13T18:16:54.366195] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:16:54.377474] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-13T18:16:56.194251] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T18:16:56.200161] [INFO ] [REMOTE ] CUK: Full fetch complete (74053 records). [2025-10-13T18:16:56.200291] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-13T18:16:56.644631] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-13T18:16:56.644737] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-13T18:16:56.645808] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-13T18:16:56.645873] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-13T18:16:56.647362] [DEBUG] [LOCAL ] CUK: Trimmed 74053 records to 51023 (keeping 200 days of data) [2025-10-13T18:16:56.947388] [DEBUG] [LOCAL ] CUK: Primary data saved (51023 records). [2025-10-13T18:16:56.947498] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-13T18:16:56.947576] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 32.8s. Estimated remaining: 4h 8m 40s. Rate: 7.3 symbols/min [2025-10-13T18:16:57.561687] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.564840] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.631827] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-13T18:16:57.687797] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-13T18:16:57.687732] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.692490] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-13T18:16:57.692766] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-13T18:16:57.713417] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.713808] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-13T18:16:57.713900] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-13T18:16:57.943875] [DEBUG] [LOCAL ] CURV: Loaded 27271 existing records from primary storage. [2025-10-13T18:16:57.954823] [INFO ] [MAIN ] CURV: Loaded 27271 existing records. [2025-10-13T18:16:58.092959] [DEBUG] [LOCAL ] CUZ: Loaded 50127 existing records from primary storage. [2025-10-13T18:16:58.203756] [INFO ] [MAIN ] CUZ: Loaded 50127 existing records. [2025-10-13T18:16:58.297187] [DEBUG] [LOCAL ] CVE: Loaded 54339 existing records from primary storage. [2025-10-13T18:16:58.377740] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:58.400774] [INFO ] [MAIN ] CVE: Loaded 54339 existing records. [2025-10-13T18:16:58.413727] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-13T18:16:58.482956] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.573247] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-13T18:16:58.587121] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-13T18:16:58.653135] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-13T18:16:58.666702] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-13T18:16:58.810674] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.952213] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-13T18:16:58.959418] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.971110] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-13T18:16:58.976630] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-13T18:16:59.009297] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-13T18:16:59.016271] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-13T18:16:59.009532] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-13T18:16:59.102507] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-13T18:16:59.170436] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-13T18:16:59.907776] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:59.959987] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-13T18:17:00.170529] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:00.171207] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-13T18:17:00.230970] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:17:00.276420] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-13T18:17:00.348546] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:00.349161] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-13T18:17:01.405916] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T18:17:01.414381] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-13T18:17:01.632157] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:17:01.639166] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-13T18:17:01.856266] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:17:01.869001] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-13T18:17:01.915420] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:17:01.927978] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-13T18:17:02.544415] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:17:02.550294] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-13T18:17:02.917587] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:17:02.924080] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-13T18:17:03.314933] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T18:17:03.433754] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:17:03.497988] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:17:03.617887] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-13T18:17:04.310401] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:17:04.417913] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-13T18:17:05.223272] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-13T18:17:05.242201] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:17:05.710093] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:17:06.017900] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-13T18:17:06.819676] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-13T18:17:06.824411] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:17:07.617911] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-13T18:17:07.917747] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T18:17:07.969816] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:17:08.417985] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-13T18:17:08.964744] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:17:09.217893] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-13T18:17:09.679292] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:17:10.017927] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-13T18:17:10.716873] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:17:10.817882] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-13T18:17:11.434887] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:17:11.617919] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-13T18:17:12.417902] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-13T18:17:12.543350] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:17:12.757520] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:17:13.217983] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-13T18:17:13.844601] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:17:14.017968] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-13T18:17:14.817896] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-13T18:17:15.206881] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:17:15.230429] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:17:15.617929] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-13T18:17:15.908365] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:17:16.417905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-13T18:17:16.616528] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T18:17:17.217920] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-13T18:17:17.518900] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:17:17.522400] [INFO ] [REMOTE ] CURB: Full fetch complete (46831 records). [2025-10-13T18:17:17.522485] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-13T18:17:17.523175] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:17:17.523259] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:17:17.523301] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:17:17.523339] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-13T18:17:17.523419] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-13T18:17:17.523474] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-13T18:17:17.523517] [DEBUG] [LOCAL ] CURB: No derivative data file found to delete. [2025-10-13T18:17:17.523572] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURB took 20.6s. Estimated remaining: 4h 9m 11s. Rate: 7.3 symbols/min [2025-10-13T18:17:17.691678] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:17.706616] [DEBUG] [LOCAL ] CVEO: Loaded 15540 existing records from primary storage. [2025-10-13T18:17:17.706877] [INFO ] [MAIN ] CVEO: Loaded 15540 existing records. [2025-10-13T18:17:17.884854] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:17.885042] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-13T18:17:17.885087] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-13T18:17:17.885341] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-13T18:17:17.885379] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-13T18:17:18.031960] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-13T18:17:18.255394] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:18.774077] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:17:18.817884] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-13T18:17:19.311133] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:17:19.617918] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-13T18:17:20.414637] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T18:17:20.424272] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-13T18:17:21.206504] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:17:21.217878] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-13T18:17:21.398424] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T18:17:22.017924] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-13T18:17:22.817894] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-13T18:17:22.850328] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:17:22.868345] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T18:17:23.617929] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-13T18:17:24.352569] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:17:24.417940] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-13T18:17:25.217935] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-13T18:17:25.221666] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T18:17:26.017911] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-13T18:17:26.055938] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:17:26.724731] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:17:26.817891] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-13T18:17:27.519850] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:17:27.617884] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-13T18:17:28.187142] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:17:28.190776] [INFO ] [REMOTE ] CURV: Full fetch complete (38897 records). [2025-10-13T18:17:28.190871] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-13T18:17:28.426862] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-13T18:17:28.560284] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-13T18:17:28.560355] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-13T18:17:28.560917] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-13T18:17:28.560977] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-13T18:17:28.561814] [DEBUG] [LOCAL ] CURV: Trimmed 38897 records to 26844 (keeping 200 days of data) [2025-10-13T18:17:28.706694] [DEBUG] [LOCAL ] CURV: Primary data saved (26844 records). [2025-10-13T18:17:28.706824] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-13T18:17:28.706902] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 31.8s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-13T18:17:28.874915] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:28.916411] [DEBUG] [LOCAL ] CVI: Loaded 47237 existing records from primary storage. [2025-10-13T18:17:28.916744] [INFO ] [MAIN ] CVI: Loaded 47237 existing records. [2025-10-13T18:17:29.101250] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:29.101595] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-13T18:17:29.101694] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-13T18:17:29.102081] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-13T18:17:29.102136] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-13T18:17:29.223147] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-13T18:17:29.463707] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:29.493544] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:17:29.735301] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T18:17:30.017937] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-13T18:17:30.066345] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:17:30.817904] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-13T18:17:30.884563] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:17:31.617925] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-13T18:17:32.417976] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-13T18:17:32.624403] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T18:17:33.217892] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-13T18:17:33.260004] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:17:33.265382] [INFO ] [REMOTE ] CVE: Full fetch complete (77563 records). [2025-10-13T18:17:33.265482] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-13T18:17:33.591839] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T18:17:33.693858] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-13T18:17:33.693953] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-13T18:17:33.694840] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-13T18:17:33.694901] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-13T18:17:33.696344] [DEBUG] [LOCAL ] CVE: Trimmed 77563 records to 53561 (keeping 200 days of data) [2025-10-13T18:17:34.014974] [DEBUG] [LOCAL ] CVE: Primary data saved (53561 records). [2025-10-13T18:17:34.015107] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-13T18:17:34.015182] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 37.1s. Estimated remaining: 4h 8m 55s. Rate: 7.3 symbols/min [2025-10-13T18:17:34.026399] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-13T18:17:34.185336] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:34.185484] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-13T18:17:34.185521] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-13T18:17:34.185630] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-13T18:17:34.185704] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-13T18:17:34.185755] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-13T18:17:34.185788] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-13T18:17:34.526996] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:34.817892] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-13T18:17:34.920862] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:17:34.925768] [INFO ] [REMOTE ] CUZ: Full fetch complete (70703 records). [2025-10-13T18:17:34.925869] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-13T18:17:35.207136] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:17:35.322509] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-13T18:17:35.322583] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-13T18:17:35.323384] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-13T18:17:35.323445] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-13T18:17:35.324772] [DEBUG] [LOCAL ] CUZ: Trimmed 70703 records to 49541 (keeping 200 days of data) [2025-10-13T18:17:35.614216] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:17:35.617917] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-13T18:17:35.633172] [DEBUG] [LOCAL ] CUZ: Primary data saved (49541 records). [2025-10-13T18:17:35.633533] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-13T18:17:35.633618] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 38.7s. Estimated remaining: 4h 8m 25s. Rate: 7.3 symbols/min [2025-10-13T18:17:35.798188] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:35.846899] [DEBUG] [LOCAL ] CVNA: Loaded 53666 existing records from primary storage. [2025-10-13T18:17:35.847203] [INFO ] [MAIN ] CVNA: Loaded 53666 existing records. [2025-10-13T18:17:36.020158] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:36.020395] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-13T18:17:36.020441] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-13T18:17:36.021043] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-13T18:17:36.021102] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-13T18:17:36.365639] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:36.417898] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-13T18:17:36.784377] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:17:37.218004] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-13T18:17:38.017978] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-13T18:17:38.223150] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:17:38.488947] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T18:17:38.565771] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:17:38.817935] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-13T18:17:39.617939] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-13T18:17:40.175228] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:17:40.417928] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-13T18:17:41.008792] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:17:41.217987] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-13T18:17:41.783266] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:17:42.017899] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-13T18:17:42.177697] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:17:42.817975] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-13T18:17:43.617934] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-13T18:17:43.668943] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:17:43.793109] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:17:44.417933] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-13T18:17:45.217905] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-13T18:17:45.260451] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T18:17:45.694251] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-13T18:17:46.018007] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-13T18:17:46.191801] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T18:17:46.646802] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:17:46.817923] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-13T18:17:47.584737] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:17:47.586747] [INFO ] [REMOTE ] CVEO: Full fetch complete (20593 records). [2025-10-13T18:17:47.586892] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-13T18:17:47.587383] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:17:47.587468] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:17:47.587512] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:17:47.587558] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-13T18:17:47.587613] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-13T18:17:47.587676] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-13T18:17:47.587859] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-13T18:17:47.587979] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVEO took 30.1s. Estimated remaining: 4h 8m 29s. Rate: 7.3 symbols/min [2025-10-13T18:17:47.619307] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-13T18:17:47.755835] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:47.807667] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-13T18:17:47.808029] [INFO ] [MAIN ] CVS: Loaded 54474 existing records. [2025-10-13T18:17:47.981027] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:47.981260] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-13T18:17:47.981307] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-13T18:17:47.981852] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-13T18:17:47.981910] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-13T18:17:48.327281] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:48.417922] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-13T18:17:49.218016] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-13T18:17:49.390465] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:17:50.017933] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-13T18:17:50.431407] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T18:17:50.828008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-13T18:17:50.835161] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-13T18:17:51.548458] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:17:51.617925] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-13T18:17:52.418014] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-13T18:17:53.046090] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:17:53.104563] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T18:17:53.217935] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-13T18:17:53.525245] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T18:17:54.017998] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-13T18:17:54.817979] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-13T18:17:55.083874] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:17:55.617924] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-13T18:17:55.773462] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:17:56.184582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:17:56.418005] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-13T18:17:57.181960] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:17:57.217900] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-13T18:17:58.017980] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-13T18:17:58.444240] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-13T18:17:58.664141] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:17:58.764095] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:17:58.817935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-13T18:17:59.621729] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-13T18:17:59.625290] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:18:00.417987] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-13T18:18:01.217997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-13T18:18:01.530776] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:18:01.884322] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:18:01.886289] [INFO ] [REMOTE ] CVLG: Full fetch complete (21149 records). [2025-10-13T18:18:01.886369] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-13T18:18:01.887000] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:01.887091] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:01.887140] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:01.887189] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-13T18:18:01.887261] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-13T18:18:01.887301] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-13T18:18:01.887342] [DEBUG] [LOCAL ] CVLG: No derivative data file found to delete. [2025-10-13T18:18:01.887439] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVLG took 27.9s. Estimated remaining: 4h 8m 40s. Rate: 7.3 symbols/min [2025-10-13T18:18:02.033905] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-13T18:18:02.072903] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:02.133393] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-13T18:18:02.133862] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-10-13T18:18:02.327144] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:02.327436] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-13T18:18:02.327486] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-13T18:18:02.328198] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-13T18:18:02.328257] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-13T18:18:02.710514] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:02.817975] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-13T18:18:03.595162] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T18:18:03.617919] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-13T18:18:03.673010] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-13T18:18:04.417984] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-13T18:18:04.969921] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:18:05.161078] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:18:05.166319] [INFO ] [REMOTE ] CVI: Full fetch complete (66893 records). [2025-10-13T18:18:05.166509] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-13T18:18:05.167532] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:05.167626] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:05.167709] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:05.167767] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-13T18:18:05.167831] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-13T18:18:05.167867] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-13T18:18:05.168059] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-13T18:18:05.168163] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVI took 36.5s. Estimated remaining: 4h 8m 16s. Rate: 7.3 symbols/min [2025-10-13T18:18:05.223097] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-13T18:18:05.347007] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:05.369101] [DEBUG] [LOCAL ] CW: Loaded 22494 existing records from primary storage. [2025-10-13T18:18:05.369374] [INFO ] [MAIN ] CW: Loaded 22494 existing records. [2025-10-13T18:18:05.545425] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:05.545693] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-13T18:18:05.545761] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-13T18:18:05.546214] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-13T18:18:05.546251] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-13T18:18:05.906818] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:06.017968] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-13T18:18:06.250429] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T18:18:06.817987] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-13T18:18:07.164590] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T18:18:07.395361] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:18:07.618000] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-13T18:18:08.417978] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-13T18:18:08.684341] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:18:09.155676] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-13T18:18:09.217983] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-13T18:18:10.017996] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-13T18:18:10.439049] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T18:18:10.534230] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:18:10.817975] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-13T18:18:11.618163] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-13T18:18:12.022397] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T18:18:12.417975] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-13T18:18:12.698394] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T18:18:13.217999] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-13T18:18:13.598439] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T18:18:14.017994] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-13T18:18:14.625904] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T18:18:14.817989] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-13T18:18:15.087287] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:18:15.452873] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T18:18:15.617979] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-13T18:18:16.417982] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-13T18:18:16.739883] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T18:18:16.945020] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T18:18:17.217967] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-13T18:18:18.017975] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-13T18:18:18.392099] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:18:18.796122] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:18:18.817903] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-13T18:18:19.617908] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-13T18:18:19.815833] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:18:19.930746] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:18:20.418048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-13T18:18:21.217916] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-13T18:18:21.592616] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:18:22.016280] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-13T18:18:22.027466] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-13T18:18:22.817977] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-13T18:18:23.076023] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:18:23.617984] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-13T18:18:24.011017] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:18:24.417983] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-13T18:18:24.975485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T18:18:24.982266] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-13T18:18:24.982502] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-13T18:18:25.238541] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-13T18:18:25.510496] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-13T18:18:25.510673] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-13T18:18:25.512407] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-13T18:18:25.512750] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-13T18:18:25.515269] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 53694 (keeping 200 days of data) [2025-10-13T18:18:25.556091] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-13T18:18:25.718046] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:18:25.731537] [INFO ] [REMOTE ] CVNA: Full fetch complete (76647 records). [2025-10-13T18:18:25.732346] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-13T18:18:26.036692] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-13T18:18:26.290902] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-13T18:18:26.291016] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-13T18:18:26.293111] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-13T18:18:26.293195] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-13T18:18:26.316023] [DEBUG] [LOCAL ] CVNA: Trimmed 76647 records to 52878 (keeping 200 days of data) [2025-10-13T18:18:26.526155] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:18:26.535241] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-13T18:18:26.536415] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-13T18:18:26.536768] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 38.9s. Estimated remaining: 4h 8m 49s. Rate: 7.2 symbols/min [2025-10-13T18:18:26.743129] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:26.820875] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-13T18:18:26.999205] [DEBUG] [LOCAL ] CWAN: Loaded 53226 existing records from primary storage. [2025-10-13T18:18:27.001219] [INFO ] [MAIN ] CWAN: Loaded 53226 existing records. [2025-10-13T18:18:27.220269] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:27.224462] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-13T18:18:27.227570] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-13T18:18:27.227627] [DEBUG] [LOCAL ] CVNA: Primary data saved (52878 records). [2025-10-13T18:18:27.227834] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-13T18:18:27.228902] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-13T18:18:27.228859] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVNA took 51.6s. Estimated remaining: 4h 8m 17s. Rate: 7.3 symbols/min [2025-10-13T18:18:27.229032] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-13T18:18:27.592789] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:27.839071] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:27.839569] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-13T18:18:27.859765] [DEBUG] [LOCAL ] CWEN: Loaded 45951 existing records from primary storage. [2025-10-13T18:18:27.860135] [INFO ] [MAIN ] CWEN: Loaded 45951 existing records. [2025-10-13T18:18:27.992463] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T18:18:28.076980] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:28.077260] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-13T18:18:28.077312] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-13T18:18:28.077760] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-13T18:18:28.077817] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-13T18:18:28.418904] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-13T18:18:28.512910] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:28.554154] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-13T18:18:29.217988] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-13T18:18:29.585474] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:18:29.588481] [INFO ] [REMOTE ] CW: Full fetch complete (33026 records). [2025-10-13T18:18:29.588581] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-13T18:18:29.926666] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:18:30.021604] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-13T18:18:30.022162] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-13T18:18:30.023386] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-13T18:18:30.024518] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-13T18:18:30.024716] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-13T18:18:30.026635] [DEBUG] [LOCAL ] CW: Trimmed 33026 records to 22235 (keeping 200 days of data) [2025-10-13T18:18:30.178702] [DEBUG] [LOCAL ] CW: Primary data saved (22235 records). [2025-10-13T18:18:30.178882] [INFO ] [MAIN ] CW: Full history saved. [2025-10-13T18:18:30.178981] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 25.0s. Estimated remaining: 4h 7m 52s. Rate: 7.3 symbols/min [2025-10-13T18:18:30.353063] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:30.353274] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-13T18:18:30.353311] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-13T18:18:30.353463] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-13T18:18:30.353507] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-13T18:18:30.353548] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-13T18:18:30.353581] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-13T18:18:30.719989] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:30.748713] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:18:30.817933] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-13T18:18:31.617977] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-13T18:18:32.404348] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:18:32.417881] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-13T18:18:32.505591] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-13T18:18:33.187455] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:18:33.217888] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-13T18:18:33.613756] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:18:34.018020] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-13T18:18:34.819495] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-13T18:18:34.821987] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T18:18:35.367888] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:18:35.617925] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-13T18:18:36.417915] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-13T18:18:36.649354] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T18:18:37.186030] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:18:37.217976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-13T18:18:37.875724] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:18:38.017985] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-13T18:18:38.564333] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:18:38.817992] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-13T18:18:39.618016] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-13T18:18:40.395339] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-13T18:18:40.417889] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-13T18:18:40.599450] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:18:40.937234] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:18:41.146927] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T18:18:41.153199] [INFO ] [REMOTE ] CVX: Full fetch complete (77455 records). [2025-10-13T18:18:41.153419] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-13T18:18:41.154329] [FATAL] [VALIDATOR ] CVX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:41.154433] [FATAL] [MAIN ] CVX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:41.154477] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:41.154519] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-13T18:18:41.154584] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-13T18:18:41.154622] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-13T18:18:41.155093] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-13T18:18:41.155391] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CVX took 39.3s. Estimated remaining: 4h 7m 52s. Rate: 7.3 symbols/min [2025-10-13T18:18:41.223167] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-13T18:18:41.334086] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:41.381563] [DEBUG] [LOCAL ] CWK: Loaded 50175 existing records from primary storage. [2025-10-13T18:18:41.381930] [INFO ] [MAIN ] CWK: Loaded 50175 existing records. [2025-10-13T18:18:41.569524] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:41.569763] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-13T18:18:41.569813] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-13T18:18:41.570065] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-13T18:18:41.570121] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-13T18:18:41.926006] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:42.017965] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-13T18:18:42.801276] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:18:42.817884] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-13T18:18:43.617991] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-13T18:18:43.720522] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:18:44.423042] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-13T18:18:44.444080] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:18:45.156844] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:18:45.217911] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-13T18:18:45.949789] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T18:18:46.017922] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-13T18:18:46.817892] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-13T18:18:47.017442] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:18:47.463033] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:18:47.617888] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-13T18:18:48.417906] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-13T18:18:48.457874] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:18:49.217986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-13T18:18:49.380113] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:18:49.767548] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:18:50.017987] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-13T18:18:50.669338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:18:50.818036] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-13T18:18:51.617910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-13T18:18:51.733016] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:18:52.417993] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-13T18:18:52.579512] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:18:52.943781] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:18:53.217974] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-13T18:18:54.017988] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-13T18:18:54.086416] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T18:18:54.697296] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:18:54.817923] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-13T18:18:55.617925] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-13T18:18:55.812353] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:18:56.280529] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:18:56.285547] [INFO ] [REMOTE ] CWEN: Full fetch complete (65086 records). [2025-10-13T18:18:56.285671] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-13T18:18:56.423043] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-13T18:18:56.666599] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-13T18:18:56.666702] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-13T18:18:56.667459] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-13T18:18:56.667499] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-13T18:18:56.668766] [DEBUG] [LOCAL ] CWEN: Trimmed 65086 records to 45292 (keeping 200 days of data) [2025-10-13T18:18:56.948668] [DEBUG] [LOCAL ] CWEN: Primary data saved (45292 records). [2025-10-13T18:18:56.948807] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-13T18:18:56.948889] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 29.7s. Estimated remaining: 4h 8m 7s. Rate: 7.3 symbols/min [2025-10-13T18:18:57.124181] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:57.153718] [DEBUG] [LOCAL ] CWT: Loaded 28469 existing records from primary storage. [2025-10-13T18:18:57.154065] [INFO ] [MAIN ] CWT: Loaded 28469 existing records. [2025-10-13T18:18:57.223336] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-13T18:18:57.343345] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:57.343799] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-13T18:18:57.343976] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-13T18:18:57.344413] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-13T18:18:57.344501] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-13T18:18:57.533076] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T18:18:57.766674] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:58.017901] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-13T18:18:58.321168] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:18:58.818031] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-13T18:18:58.968820] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:18:59.004936] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:18:59.617975] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-13T18:19:00.414810] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:19:00.418808] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-13T18:19:01.046717] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:19:01.217914] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-13T18:19:02.018028] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-13T18:19:02.131728] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:19:02.818077] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-13T18:19:02.926011] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:19:03.024402] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:19:03.617967] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-13T18:19:04.417903] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-13T18:19:04.607705] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:19:05.099085] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:05.104153] [INFO ] [REMOTE ] CWH: Full fetch complete (73048 records). [2025-10-13T18:19:05.104273] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-13T18:19:05.223090] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-13T18:19:05.504275] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-13T18:19:05.504384] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-13T18:19:05.505261] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-13T18:19:05.505336] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-13T18:19:05.507705] [DEBUG] [LOCAL ] CWH: Trimmed 73048 records to 51335 (keeping 200 days of data) [2025-10-13T18:19:05.616373] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:19:05.853309] [DEBUG] [LOCAL ] CWH: Primary data saved (51335 records). [2025-10-13T18:19:05.853482] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-13T18:19:05.853575] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 35.7s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-13T18:19:06.024853] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:06.023026] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-13T18:19:06.072721] [DEBUG] [LOCAL ] CX: Loaded 53583 existing records from primary storage. [2025-10-13T18:19:06.073032] [INFO ] [MAIN ] CX: Loaded 53583 existing records. [2025-10-13T18:19:06.247697] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:06.247901] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-13T18:19:06.247983] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-13T18:19:06.248351] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-13T18:19:06.248409] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-13T18:19:06.622208] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:06.817962] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-13T18:19:07.066879] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T18:19:07.620191] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-13T18:19:07.625986] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:19:07.679434] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T18:19:08.417976] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-13T18:19:09.217918] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-13T18:19:09.253200] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:19:09.673040] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T18:19:10.017976] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-13T18:19:10.817962] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-13T18:19:10.931763] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:19:10.936906] [INFO ] [REMOTE ] CWAN: Full fetch complete (74839 records). [2025-10-13T18:19:10.937107] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-13T18:19:10.938155] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:19:10.938262] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:19:10.938304] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:19:10.938370] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-13T18:19:10.938435] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-13T18:19:10.938470] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-13T18:19:10.938635] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-10-13T18:19:10.938754] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWAN took 44.4s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-13T18:19:11.107093] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:11.114339] [DEBUG] [LOCAL ] CXE: Loaded 6249 existing records from primary storage. [2025-10-13T18:19:11.114526] [INFO ] [MAIN ] CXE: Loaded 6249 existing records. [2025-10-13T18:19:11.291601] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:11.291859] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-13T18:19:11.291953] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-13T18:19:11.292102] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-13T18:19:11.292177] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-13T18:19:11.618297] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-13T18:19:11.652531] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:11.864473] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T18:19:12.251490] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T18:19:12.417995] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-13T18:19:12.767731] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T18:19:13.217928] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-13T18:19:13.931067] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:19:14.017932] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-13T18:19:14.387850] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:19:14.817922] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-13T18:19:15.499121] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:15.504213] [INFO ] [REMOTE ] CWK: Full fetch complete (71015 records). [2025-10-13T18:19:15.504330] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-13T18:19:15.623128] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-13T18:19:15.896495] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-13T18:19:15.896596] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-13T18:19:15.897472] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-13T18:19:15.897543] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-13T18:19:15.899844] [DEBUG] [LOCAL ] CWK: Trimmed 71015 records to 49523 (keeping 200 days of data) [2025-10-13T18:19:16.182664] [DEBUG] [LOCAL ] CWK: Primary data saved (49523 records). [2025-10-13T18:19:16.182804] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-13T18:19:16.182882] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 35.0s. Estimated remaining: 4h 7m 25s. Rate: 7.3 symbols/min [2025-10-13T18:19:16.352104] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:16.357932] [DEBUG] [LOCAL ] CXH: Loaded 4448 existing records from primary storage. [2025-10-13T18:19:16.358110] [INFO ] [MAIN ] CXH: Loaded 4448 existing records. [2025-10-13T18:19:16.427928] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-13T18:19:16.540547] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:16.540995] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-13T18:19:16.541081] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-13T18:19:16.541390] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-13T18:19:16.541478] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-13T18:19:16.900548] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T18:19:16.941820] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:16.964366] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:19:17.022474] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T18:19:17.217922] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-13T18:19:18.017983] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-13T18:19:18.081200] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T18:19:18.817921] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-13T18:19:19.303161] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:19:19.523777] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T18:19:19.617980] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-13T18:19:20.265550] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T18:19:20.417974] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-13T18:19:21.190517] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T18:19:21.217965] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-13T18:19:21.757353] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T18:19:22.018070] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-13T18:19:22.450191] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T18:19:22.817933] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-13T18:19:23.268881] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:19:23.617927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-13T18:19:24.050231] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:19:24.417924] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-13T18:19:25.217954] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-13T18:19:25.717121] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:19:26.017937] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-13T18:19:26.286043] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:19:26.818619] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-13T18:19:26.820195] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:19:27.617927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-13T18:19:27.955219] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T18:19:27.993112] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:19:28.417915] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-13T18:19:29.008822] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T18:19:29.217924] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-13T18:19:29.817917] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:19:30.018023] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-13T18:19:30.817961] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-13T18:19:31.221309] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:19:31.224780] [INFO ] [REMOTE ] CWT: Full fetch complete (40851 records). [2025-10-13T18:19:31.224865] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-13T18:19:31.416887] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:19:31.641049] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-13T18:19:31.657219] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-13T18:19:31.657283] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-13T18:19:31.657878] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-13T18:19:31.658048] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-13T18:19:31.659068] [DEBUG] [LOCAL ] CWT: Trimmed 40851 records to 28118 (keeping 200 days of data) [2025-10-13T18:19:31.833782] [DEBUG] [LOCAL ] CWT: Primary data saved (28118 records). [2025-10-13T18:19:31.833917] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-13T18:19:31.834744] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CWT took 34.9s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-13T18:19:32.014874] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:32.061160] [DEBUG] [LOCAL ] CXM: Loaded 48285 existing records from primary storage. [2025-10-13T18:19:32.061492] [INFO ] [MAIN ] CXM: Loaded 48285 existing records. [2025-10-13T18:19:32.234087] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:32.234287] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-13T18:19:32.234333] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-13T18:19:32.234783] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-13T18:19:32.234838] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-13T18:19:32.423241] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-13T18:19:32.594517] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:33.217902] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-13T18:19:33.403033] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:19:33.479885] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T18:19:34.017997] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-13T18:19:34.785704] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:19:34.818953] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-13T18:19:34.825813] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:19:35.617987] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-13T18:19:36.418000] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-13T18:19:36.670451] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T18:19:36.998539] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T18:19:37.217930] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-13T18:19:37.329797] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:19:37.861314] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T18:19:38.017989] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-13T18:19:38.817958] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-13T18:19:39.188295] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T18:19:39.617982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-13T18:19:40.417911] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-13T18:19:40.613675] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:19:40.942879] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:19:41.096246] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:19:41.217982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-13T18:19:42.018015] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-13T18:19:42.467330] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:19:42.468500] [INFO ] [REMOTE ] CXH: Full fetch complete (5375 records). [2025-10-13T18:19:42.468587] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-13T18:19:42.827557] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-13T18:19:42.867923] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-13T18:19:42.868118] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-13T18:19:42.868387] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-13T18:19:42.868466] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-13T18:19:42.869561] [DEBUG] [LOCAL ] CXH: Trimmed 5375 records to 4435 (keeping 200 days of data) [2025-10-13T18:19:42.900163] [DEBUG] [LOCAL ] CXH: Primary data saved (4435 records). [2025-10-13T18:19:42.900639] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-13T18:19:42.900797] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 26.7s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-13T18:19:43.004060] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:19:43.133089] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:43.171958] [DEBUG] [LOCAL ] CXT: Loaded 31466 existing records from primary storage. [2025-10-13T18:19:43.172325] [INFO ] [MAIN ] CXT: Loaded 31466 existing records. [2025-10-13T18:19:43.362569] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:43.362921] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-13T18:19:43.362982] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-13T18:19:43.363297] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-13T18:19:43.363356] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-13T18:19:43.624941] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-13T18:19:43.761369] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:44.281021] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:19:44.282920] [INFO ] [REMOTE ] CXE: Full fetch complete (11537 records). [2025-10-13T18:19:44.283032] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-13T18:19:44.423079] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-13T18:19:44.710524] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-13T18:19:44.710701] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-13T18:19:44.711275] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-13T18:19:44.711358] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-13T18:19:44.744528] [DEBUG] [LOCAL ] CXE: Trimmed 11537 records to 6159 (keeping 200 days of data) [2025-10-13T18:19:44.747434] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T18:19:44.798391] [DEBUG] [LOCAL ] CXE: Primary data saved (6159 records). [2025-10-13T18:19:44.798571] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-13T18:19:44.798689] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXE took 33.9s. Estimated remaining: 4h 7m 12s. Rate: 7.3 symbols/min [2025-10-13T18:19:44.975677] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:45.017301] [DEBUG] [LOCAL ] CXW: Loaded 44569 existing records from primary storage. [2025-10-13T18:19:45.017606] [INFO ] [MAIN ] CXW: Loaded 44569 existing records. [2025-10-13T18:19:45.189809] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:45.190067] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-13T18:19:45.190135] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-13T18:19:45.190403] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-13T18:19:45.190459] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-13T18:19:45.223160] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-13T18:19:45.598455] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:45.638605] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:19:46.018024] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-13T18:19:46.817981] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-13T18:19:47.002354] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:19:47.370072] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:19:47.617987] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-13T18:19:48.361412] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:19:48.417892] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-13T18:19:49.099823] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:49.105699] [INFO ] [REMOTE ] CX: Full fetch complete (76384 records). [2025-10-13T18:19:49.105891] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-13T18:19:49.223060] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-13T18:19:49.531979] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-13T18:19:49.532165] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-13T18:19:49.533548] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-13T18:19:49.533638] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-13T18:19:49.535839] [DEBUG] [LOCAL ] CX: Trimmed 76384 records to 52816 (keeping 200 days of data) [2025-10-13T18:19:49.680103] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T18:19:49.929507] [DEBUG] [LOCAL ] CX: Primary data saved (52816 records). [2025-10-13T18:19:49.929735] [INFO ] [MAIN ] CX: Full history saved. [2025-10-13T18:19:49.929890] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CX took 44.1s. Estimated remaining: 4h 6m 54s. Rate: 7.3 symbols/min [2025-10-13T18:19:50.026528] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-13T18:19:50.112598] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:50.140049] [DEBUG] [LOCAL ] CYD: Loaded 26901 existing records from primary storage. [2025-10-13T18:19:50.140393] [INFO ] [MAIN ] CYD: Loaded 26901 existing records. [2025-10-13T18:19:50.332545] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:50.332856] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-13T18:19:50.332911] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-13T18:19:50.333221] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-13T18:19:50.333281] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-13T18:19:50.754400] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:50.756934] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:19:50.817910] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-13T18:19:51.617935] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-13T18:19:51.677710] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:19:51.850232] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T18:19:52.395164] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:19:52.417917] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-13T18:19:53.217989] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-13T18:19:53.823431] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:19:53.824147] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:19:54.017996] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-13T18:19:54.817999] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-13T18:19:54.972634] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:19:55.618063] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-13T18:19:56.423189] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-13T18:19:56.443502] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:19:57.190893] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:19:57.217918] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-13T18:19:57.645039] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:19:58.017974] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-13T18:19:58.591430] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T18:19:58.818008] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-13T18:19:59.617987] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-13T18:19:59.677354] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:20:00.094835] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T18:20:00.417976] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-13T18:20:01.217899] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-13T18:20:01.419539] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:20:02.017987] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-13T18:20:02.447144] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T18:20:02.817937] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-13T18:20:03.425015] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T18:20:03.520836] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:20:03.617984] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-13T18:20:04.414898] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:20:04.424383] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-13T18:20:05.030570] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:20:05.217975] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-13T18:20:05.727114] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T18:20:06.018036] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-13T18:20:06.335618] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:20:06.817996] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-13T18:20:07.234590] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T18:20:07.617968] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-13T18:20:08.275476] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:20:08.417988] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-13T18:20:09.217931] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-13T18:20:09.389533] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T18:20:09.394727] [INFO ] [REMOTE ] CXM: Full fetch complete (68570 records). [2025-10-13T18:20:09.394881] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-13T18:20:09.784798] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-13T18:20:09.785027] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-13T18:20:09.786119] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-13T18:20:09.786218] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-13T18:20:09.787868] [DEBUG] [LOCAL ] CXM: Trimmed 68570 records to 47604 (keeping 200 days of data) [2025-10-13T18:20:09.919045] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:20:10.019721] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-13T18:20:10.088923] [DEBUG] [LOCAL ] CXM: Primary data saved (47604 records). [2025-10-13T18:20:10.089090] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-13T18:20:10.089896] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 38.3s. Estimated remaining: 4h 7m 22s. Rate: 7.2 symbols/min [2025-10-13T18:20:10.258556] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:10.303981] [DEBUG] [LOCAL ] CYH: Loaded 48319 existing records from primary storage. [2025-10-13T18:20:10.304269] [INFO ] [MAIN ] CYH: Loaded 48319 existing records. [2025-10-13T18:20:10.477247] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:10.477449] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-13T18:20:10.477496] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-13T18:20:10.477782] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-13T18:20:10.477838] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-13T18:20:10.829059] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-13T18:20:10.835041] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:10.929879] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:20:11.327057] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:20:11.332986] [INFO ] [REMOTE ] CXT: Full fetch complete (45438 records). [2025-10-13T18:20:11.333144] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-13T18:20:11.623273] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-13T18:20:11.756416] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-13T18:20:11.756520] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-13T18:20:11.757275] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-13T18:20:11.757360] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-13T18:20:11.758485] [DEBUG] [LOCAL ] CXT: Trimmed 45438 records to 30997 (keeping 200 days of data) [2025-10-13T18:20:11.930153] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:20:11.991358] [DEBUG] [LOCAL ] CXT: Primary data saved (30997 records). [2025-10-13T18:20:11.991521] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-13T18:20:11.991620] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXT took 29.1s. Estimated remaining: 4h 6m 55s. Rate: 7.2 symbols/min [2025-10-13T18:20:12.159335] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:12.210607] [DEBUG] [LOCAL ] D: Loaded 54427 existing records from primary storage. [2025-10-13T18:20:12.210982] [INFO ] [MAIN ] D: Loaded 54427 existing records. [2025-10-13T18:20:12.390268] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:12.390489] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-13T18:20:12.390537] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-13T18:20:12.390888] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-13T18:20:12.390945] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-13T18:20:12.423109] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-13T18:20:12.757028] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:13.217933] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-13T18:20:13.865566] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-13T18:20:13.878406] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:20:14.017973] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-13T18:20:14.823178] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-13T18:20:14.851803] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:20:15.383416] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:20:15.617926] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-13T18:20:16.423361] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-13T18:20:16.435395] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T18:20:17.217925] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-13T18:20:17.514823] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:20:18.018004] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-13T18:20:18.588534] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-13T18:20:18.592953] [INFO ] [REMOTE ] CYD: Full fetch complete (34408 records). [2025-10-13T18:20:18.593047] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-13T18:20:18.593767] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:20:18.593866] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:20:18.593918] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:20:18.593995] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-13T18:20:18.594074] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-13T18:20:18.594129] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-13T18:20:18.594325] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-13T18:20:18.594460] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 28.7s. Estimated remaining: 4h 6m 41s. Rate: 7.3 symbols/min [2025-10-13T18:20:18.769899] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:18.782407] [DEBUG] [LOCAL ] DAC: Loaded 12754 existing records from primary storage. [2025-10-13T18:20:18.782675] [INFO ] [MAIN ] DAC: Loaded 12754 existing records. [2025-10-13T18:20:18.824495] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-13T18:20:18.968809] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:18.969274] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-13T18:20:18.969361] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-13T18:20:18.969614] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-13T18:20:18.969806] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-13T18:20:19.122894] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:20:19.391564] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:19.617907] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-13T18:20:19.856278] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T18:20:20.080439] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:20:20.417920] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-13T18:20:20.827467] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:20:21.217992] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-13T18:20:21.819898] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:20:22.017911] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-13T18:20:22.817928] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-13T18:20:23.192304] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T18:20:23.549317] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:20:23.617895] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-13T18:20:24.417905] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-13T18:20:24.476601] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:20:24.611898] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:20:25.217932] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-13T18:20:25.993449] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T18:20:26.017900] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-13T18:20:26.660098] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:20:26.817906] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-13T18:20:27.595067] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:20:27.617996] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-13T18:20:28.363154] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:20:28.417893] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-13T18:20:29.073683] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:20:29.078345] [INFO ] [REMOTE ] CXW: Full fetch complete (64866 records). [2025-10-13T18:20:29.078515] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-13T18:20:29.223171] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-13T18:20:29.471470] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-13T18:20:29.471550] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-13T18:20:29.472323] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-13T18:20:29.472385] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-13T18:20:29.473634] [DEBUG] [LOCAL ] CXW: Trimmed 64866 records to 43921 (keeping 200 days of data) [2025-10-13T18:20:29.741095] [DEBUG] [LOCAL ] CXW: Primary data saved (43921 records). [2025-10-13T18:20:29.741269] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-13T18:20:29.741428] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CXW took 44.9s. Estimated remaining: 4h 6m 42s. Rate: 7.2 symbols/min [2025-10-13T18:20:29.924088] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:29.985739] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-13T18:20:29.986363] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-10-13T18:20:30.036840] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-13T18:20:30.148635] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T18:20:30.257765] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:30.258369] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-13T18:20:30.258492] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-13T18:20:30.267462] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-13T18:20:30.267571] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-13T18:20:30.299302] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:20:30.617986] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:30.817892] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-13T18:20:31.617966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-13T18:20:31.979781] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T18:20:32.418001] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-13T18:20:32.732947] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:20:33.217910] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-13T18:20:33.271933] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T18:20:34.018976] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-13T18:20:34.018845] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T18:20:34.817936] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-13T18:20:35.268822] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T18:20:35.331617] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:20:35.481745] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T18:20:35.617960] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-13T18:20:36.417929] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-13T18:20:37.096892] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:20:37.101600] [INFO ] [REMOTE ] CYH: Full fetch complete (69747 records). [2025-10-13T18:20:37.101780] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-13T18:20:37.223049] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-13T18:20:37.489291] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-13T18:20:37.489373] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-13T18:20:37.490243] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-13T18:20:37.490307] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-13T18:20:37.494247] [DEBUG] [LOCAL ] CYH: Trimmed 69747 records to 47691 (keeping 200 days of data) [2025-10-13T18:20:37.761241] [DEBUG] [LOCAL ] CYH: Primary data saved (47691 records). [2025-10-13T18:20:37.761376] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-13T18:20:37.762152] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 27.7s. Estimated remaining: 4h 6m 33s. Rate: 7.2 symbols/min [2025-10-13T18:20:37.927579] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:37.980028] [DEBUG] [LOCAL ] DAN: Loaded 49881 existing records from primary storage. [2025-10-13T18:20:37.980330] [INFO ] [MAIN ] DAN: Loaded 49881 existing records. [2025-10-13T18:20:38.023126] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-13T18:20:38.165450] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:38.165855] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-13T18:20:38.165925] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-13T18:20:38.166376] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-13T18:20:38.166435] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-13T18:20:38.261178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:20:38.537139] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:38.570116] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T18:20:38.817980] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-13T18:20:39.617895] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-13T18:20:39.758984] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:20:40.418005] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-13T18:20:40.786304] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:20:41.217914] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-13T18:20:41.654776] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-13T18:20:41.989807] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T18:20:42.017882] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-13T18:20:42.429807] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T18:20:42.817888] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-13T18:20:42.973217] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:20:43.617954] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-13T18:20:44.417927] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-13T18:20:45.185182] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:20:45.217883] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-13T18:20:45.259747] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T18:20:45.300513] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T18:20:46.017922] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-13T18:20:46.794955] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:20:46.817962] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-13T18:20:47.617902] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-13T18:20:47.693800] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:20:48.054631] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:20:48.418014] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-13T18:20:48.543182] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T18:20:48.953830] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T18:20:48.961092] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-10-13T18:20:48.961323] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-13T18:20:49.223240] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-13T18:20:49.550274] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-13T18:20:49.550400] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-13T18:20:49.552058] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-13T18:20:49.552159] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-13T18:20:49.554267] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53646 (keeping 200 days of data) [2025-10-13T18:20:49.906986] [DEBUG] [LOCAL ] D: Primary data saved (53646 records). [2025-10-13T18:20:49.907138] [INFO ] [MAIN ] D: Full history saved. [2025-10-13T18:20:49.907226] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 37.9s. Estimated remaining: 4h 6m 36s. Rate: 7.2 symbols/min [2025-10-13T18:20:50.019536] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-13T18:20:50.081710] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:50.081856] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-13T18:20:50.081893] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-13T18:20:50.082016] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-13T18:20:50.082058] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-13T18:20:50.082102] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-13T18:20:50.082135] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-13T18:20:50.195843] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:20:50.447773] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:50.817887] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-13T18:20:51.617893] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-13T18:20:51.623860] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T18:20:51.626153] [INFO ] [REMOTE ] DAC: Full fetch complete (19333 records). [2025-10-13T18:20:51.626232] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-13T18:20:51.983822] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-13T18:20:51.983899] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-13T18:20:51.984307] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-13T18:20:51.984416] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-13T18:20:51.985103] [DEBUG] [LOCAL ] DAC: Trimmed 19333 records to 12609 (keeping 200 days of data) [2025-10-13T18:20:52.069238] [DEBUG] [LOCAL ] DAC: Primary data saved (12609 records). [2025-10-13T18:20:52.069391] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-13T18:20:52.069474] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAC took 33.5s. Estimated remaining: 4h 6m 9s. Rate: 7.3 symbols/min [2025-10-13T18:20:52.236829] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:52.284964] [DEBUG] [LOCAL ] DAR: Loaded 52630 existing records from primary storage. [2025-10-13T18:20:52.285332] [INFO ] [MAIN ] DAR: Loaded 52630 existing records. [2025-10-13T18:20:52.425307] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-13T18:20:52.467160] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:52.468441] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-13T18:20:52.468508] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-13T18:20:52.468892] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-13T18:20:52.468958] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-13T18:20:52.607373] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-13T18:20:52.869023] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:53.105214] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:20:53.217906] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-13T18:20:53.777331] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:20:54.017917] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-13T18:20:54.818008] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-13T18:20:55.399999] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T18:20:55.461979] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-13T18:20:55.617920] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-13T18:20:56.417896] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-13T18:20:56.486763] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T18:20:56.812309] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:20:57.218002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-13T18:20:58.017899] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-13T18:20:58.154773] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:20:58.438895] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T18:20:58.817913] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-13T18:20:59.617888] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-13T18:20:59.729795] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:21:00.417925] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-13T18:21:00.924064] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T18:21:01.100055] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:21:01.217929] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-13T18:21:01.807148] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T18:21:02.017969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-13T18:21:02.332159] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:21:02.817926] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-13T18:21:03.447664] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T18:21:03.617928] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-13T18:21:04.417970] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-13T18:21:05.116950] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-13T18:21:05.217980] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-13T18:21:05.503813] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:21:05.668342] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:21:05.674125] [INFO ] [REMOTE ] DAL: Full fetch complete (77824 records). [2025-10-13T18:21:05.674324] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-13T18:21:06.025239] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-13T18:21:06.075517] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-13T18:21:06.075688] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-13T18:21:06.076687] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-13T18:21:06.076785] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-13T18:21:06.116368] [DEBUG] [LOCAL ] DAL: Trimmed 77824 records to 53753 (keeping 200 days of data) [2025-10-13T18:21:06.118586] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T18:21:06.451142] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-13T18:21:06.451282] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-13T18:21:06.451361] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 36.7s. Estimated remaining: 4h 6m 19s. Rate: 7.2 symbols/min [2025-10-13T18:21:06.634466] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:06.677880] [DEBUG] [LOCAL ] DAVA: Loaded 42130 existing records from primary storage. [2025-10-13T18:21:06.678271] [INFO ] [MAIN ] DAVA: Loaded 42130 existing records. [2025-10-13T18:21:06.823070] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-13T18:21:06.886574] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:06.886817] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-13T18:21:06.886869] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-13T18:21:06.887210] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-13T18:21:06.887275] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-13T18:21:07.307411] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:07.521860] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T18:21:07.527492] [INFO ] [REMOTE ] DAN: Full fetch complete (70920 records). [2025-10-13T18:21:07.527678] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-13T18:21:07.623163] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-13T18:21:07.936169] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-13T18:21:07.936379] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-13T18:21:07.937357] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-13T18:21:07.937465] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-13T18:21:07.955068] [DEBUG] [LOCAL ] DAN: Trimmed 70920 records to 49335 (keeping 200 days of data) [2025-10-13T18:21:07.955621] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:21:08.260737] [DEBUG] [LOCAL ] DAN: Primary data saved (49335 records). [2025-10-13T18:21:08.260878] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-13T18:21:08.261478] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 30.5s. Estimated remaining: 4h 5m 52s. Rate: 7.3 symbols/min [2025-10-13T18:21:08.420896] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-13T18:21:08.431951] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:08.484348] [DEBUG] [LOCAL ] DAY: Loaded 49936 existing records from primary storage. [2025-10-13T18:21:08.484686] [INFO ] [MAIN ] DAY: Loaded 49936 existing records. [2025-10-13T18:21:08.658323] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:08.658558] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-13T18:21:08.658605] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-13T18:21:08.659056] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-13T18:21:08.659125] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-13T18:21:09.014357] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:09.139924] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:21:09.217889] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-13T18:21:09.414409] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:21:10.017921] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-13T18:21:10.135873] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T18:21:10.818002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-13T18:21:11.497677] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:21:11.574316] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:21:11.617867] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-13T18:21:12.417917] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-13T18:21:13.126176] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T18:21:13.217954] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-13T18:21:13.351222] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:21:14.017913] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-13T18:21:14.817999] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-13T18:21:15.004875] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:21:15.363192] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:21:15.475556] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:21:15.617918] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-13T18:21:16.418007] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-13T18:21:17.043063] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:21:17.217984] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-13T18:21:17.958236] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:21:18.017894] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-13T18:21:18.817902] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-13T18:21:18.970147] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:21:19.618026] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-13T18:21:19.718958] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:21:19.724404] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T18:21:20.418012] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-13T18:21:21.217989] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-13T18:21:21.319458] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:21:22.017923] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-13T18:21:22.116973] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:21:22.288026] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T18:21:22.817955] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-13T18:21:23.459974] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:21:23.617920] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-13T18:21:23.716509] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T18:21:24.417929] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-13T18:21:25.217618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T18:21:25.219198] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-13T18:21:25.220362] [INFO ] [REMOTE ] DAO: Full fetch complete (31997 records). [2025-10-13T18:21:25.220430] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-13T18:21:25.220968] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:21:25.221060] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:21:25.221103] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:21:25.221170] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-13T18:21:25.221226] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-13T18:21:25.221262] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-13T18:21:25.221386] [DEBUG] [LOCAL ] DAO: No derivative data file found to delete. [2025-10-13T18:21:25.221474] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAO took 35.3s. Estimated remaining: 4h 6m 10s. Rate: 7.2 symbols/min [2025-10-13T18:21:25.398460] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:21:25.480403] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:25.535815] [DEBUG] [LOCAL ] DB: Loaded 53277 existing records from primary storage. [2025-10-13T18:21:25.536259] [INFO ] [MAIN ] DB: Loaded 53277 existing records. [2025-10-13T18:21:25.729133] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:25.729387] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-13T18:21:25.729435] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-13T18:21:25.729877] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-13T18:21:25.729935] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-13T18:21:26.023185] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-13T18:21:26.080467] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:26.817970] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-13T18:21:26.858634] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:21:27.459903] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T18:21:27.617894] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-13T18:21:28.391768] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:21:28.417883] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-13T18:21:29.191021] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:21:29.217882] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-13T18:21:30.017901] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-13T18:21:30.210191] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:21:30.817903] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-13T18:21:30.908296] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T18:21:31.617897] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-13T18:21:31.968329] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:21:32.423795] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-13T18:21:32.429004] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:21:33.091967] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:21:33.217889] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-13T18:21:33.999816] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:21:34.017881] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-13T18:21:34.818005] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-13T18:21:35.308509] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T18:21:35.622973] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-13T18:21:35.637857] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:21:36.410251] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:21:36.419673] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-13T18:21:37.217898] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-13T18:21:37.404768] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:21:37.739726] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T18:21:38.017925] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-13T18:21:38.799305] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:21:38.804184] [INFO ] [REMOTE ] DAY: Full fetch complete (71512 records). [2025-10-13T18:21:38.804306] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-13T18:21:38.823117] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-13T18:21:39.248507] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-13T18:21:39.248587] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-13T18:21:39.249570] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-13T18:21:39.249685] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-13T18:21:39.251145] [DEBUG] [LOCAL ] DAY: Trimmed 71512 records to 49187 (keeping 200 days of data) [2025-10-13T18:21:39.538199] [DEBUG] [LOCAL ] DAY: Primary data saved (49187 records). [2025-10-13T18:21:39.538341] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-13T18:21:39.538893] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAY took 31.3s. Estimated remaining: 4h 6m 19s. Rate: 7.2 symbols/min [2025-10-13T18:21:39.623068] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-13T18:21:39.712794] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:39.713637] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-13T18:21:39.713739] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-13T18:21:39.713868] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-13T18:21:39.713911] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-13T18:21:39.713952] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-13T18:21:39.713985] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-13T18:21:40.073923] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:40.105629] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:21:40.417914] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-13T18:21:40.521876] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:21:40.527431] [INFO ] [REMOTE ] DAVA: Full fetch complete (56685 records). [2025-10-13T18:21:40.527570] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-13T18:21:40.899505] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-13T18:21:40.899582] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-13T18:21:40.900284] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-13T18:21:40.900345] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-13T18:21:40.901431] [DEBUG] [LOCAL ] DAVA: Trimmed 56685 records to 41698 (keeping 200 days of data) [2025-10-13T18:21:41.171751] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:21:41.184412] [DEBUG] [LOCAL ] DAVA: Primary data saved (41698 records). [2025-10-13T18:21:41.184800] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-13T18:21:41.185015] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAVA took 34.7s. Estimated remaining: 4h 5m 51s. Rate: 7.2 symbols/min [2025-10-13T18:21:41.227854] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-13T18:21:41.402281] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:41.403537] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:21:41.452188] [DEBUG] [LOCAL ] DBI: Loaded 44863 existing records from primary storage. [2025-10-13T18:21:41.452524] [INFO ] [MAIN ] DBI: Loaded 44863 existing records. [2025-10-13T18:21:41.667636] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:41.667847] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-13T18:21:41.667910] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-13T18:21:41.668434] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-13T18:21:41.668493] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-13T18:21:42.028909] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-13T18:21:42.234017] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:42.817962] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-13T18:21:42.989886] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:21:43.014787] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:21:43.021082] [INFO ] [REMOTE ] DAR: Full fetch complete (74641 records). [2025-10-13T18:21:43.021228] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-13T18:21:43.414767] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-13T18:21:43.414881] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-13T18:21:43.415777] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-13T18:21:43.415844] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-13T18:21:43.417272] [DEBUG] [LOCAL ] DAR: Trimmed 74641 records to 51978 (keeping 200 days of data) [2025-10-13T18:21:43.619921] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-13T18:21:43.710996] [DEBUG] [LOCAL ] DAR: Primary data saved (51978 records). [2025-10-13T18:21:43.711131] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-13T18:21:43.711210] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DAR took 51.6s. Estimated remaining: 4h 5m 26s. Rate: 7.2 symbols/min [2025-10-13T18:21:43.875261] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:43.875474] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-13T18:21:43.875516] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-13T18:21:43.875623] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-13T18:21:43.875715] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-13T18:21:43.875770] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-13T18:21:43.875803] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-13T18:21:44.232231] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:44.406592] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:21:44.417871] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-13T18:21:44.457349] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:21:45.217985] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-13T18:21:45.871912] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:21:46.018063] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-13T18:21:46.817962] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-13T18:21:46.896409] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T18:21:47.158255] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T18:21:47.617922] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-13T18:21:48.404895] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:21:48.417887] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-13T18:21:48.869053] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:21:49.217928] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-13T18:21:49.926518] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:21:50.017907] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-13T18:21:50.061964] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:21:50.652748] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:21:50.817907] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-13T18:21:51.452608] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:21:51.617910] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-13T18:21:52.377566] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T18:21:52.417971] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-13T18:21:53.217948] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-13T18:21:54.017917] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-13T18:21:54.402485] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:21:54.772808] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:21:54.803622] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:21:54.817880] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-13T18:21:55.617995] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-13T18:21:55.946514] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:21:56.417969] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-13T18:21:57.121193] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:21:57.217895] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-13T18:21:57.572990] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:21:58.018018] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-13T18:21:58.662235] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:21:58.818016] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-13T18:21:59.617897] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-13T18:21:59.628580] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T18:21:59.739725] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T18:22:00.418031] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-13T18:22:01.101276] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:22:01.217931] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-13T18:22:01.955671] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T18:22:01.979934] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:22:02.017973] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-13T18:22:02.817926] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-13T18:22:03.460198] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:22:03.617957] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-13T18:22:04.214000] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:22:04.331616] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:22:04.340588] [INFO ] [REMOTE ] DB: Full fetch complete (74943 records). [2025-10-13T18:22:04.340830] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-13T18:22:04.423131] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-13T18:22:04.758241] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-13T18:22:04.758331] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-13T18:22:04.759225] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-13T18:22:04.759289] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-13T18:22:04.760669] [DEBUG] [LOCAL ] DB: Trimmed 74943 records to 52505 (keeping 200 days of data) [2025-10-13T18:22:05.080602] [DEBUG] [LOCAL ] DB: Primary data saved (52505 records). [2025-10-13T18:22:05.080781] [INFO ] [MAIN ] DB: Full history saved. [2025-10-13T18:22:05.080888] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DB took 39.9s. Estimated remaining: 4h 5m 56s. Rate: 7.2 symbols/min [2025-10-13T18:22:05.223242] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-13T18:22:05.285479] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:05.349348] [DEBUG] [LOCAL ] DBRG: Loaded 50515 existing records from primary storage. [2025-10-13T18:22:05.349873] [INFO ] [MAIN ] DBRG: Loaded 50515 existing records. [2025-10-13T18:22:05.554420] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:05.554748] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-13T18:22:05.554808] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-13T18:22:05.555388] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-13T18:22:05.555448] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-13T18:22:05.987442] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:06.017955] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-13T18:22:06.177272] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:22:06.242981] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T18:22:06.817921] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-13T18:22:07.592928] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:22:07.617889] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-13T18:22:07.671196] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:22:08.417969] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-13T18:22:08.547889] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T18:22:08.903717] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T18:22:09.217962] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-13T18:22:10.017915] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-13T18:22:10.079589] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T18:22:10.817921] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-13T18:22:10.898893] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:22:10.900020] [INFO ] [REMOTE ] DBL: Full fetch complete (12508 records). [2025-10-13T18:22:10.900085] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-13T18:22:11.271573] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-13T18:22:11.271672] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-13T18:22:11.271972] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-13T18:22:11.272012] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-13T18:22:11.272472] [DEBUG] [LOCAL ] DBL: Trimmed 12508 records to 9289 (keeping 200 days of data) [2025-10-13T18:22:11.331718] [DEBUG] [LOCAL ] DBL: Primary data saved (9289 records). [2025-10-13T18:22:11.331847] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-13T18:22:11.331915] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 27.6s. Estimated remaining: 4h 5m 42s. Rate: 7.2 symbols/min [2025-10-13T18:22:11.505580] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:11.539454] [DEBUG] [LOCAL ] DCI: Loaded 37528 existing records from primary storage. [2025-10-13T18:22:11.539794] [INFO ] [MAIN ] DCI: Loaded 37528 existing records. [2025-10-13T18:22:11.623057] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-13T18:22:11.731830] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:11.732096] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-13T18:22:11.732159] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-13T18:22:11.732469] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-13T18:22:11.732545] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-13T18:22:12.100421] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:12.167107] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:22:12.171386] [INFO ] [REMOTE ] DBI: Full fetch complete (65301 records). [2025-10-13T18:22:12.171498] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-13T18:22:12.430730] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-13T18:22:12.569613] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-13T18:22:12.569733] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-13T18:22:12.570552] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-13T18:22:12.570594] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-13T18:22:12.572014] [DEBUG] [LOCAL ] DBI: Trimmed 65301 records to 44091 (keeping 200 days of data) [2025-10-13T18:22:12.829187] [DEBUG] [LOCAL ] DBI: Primary data saved (44091 records). [2025-10-13T18:22:12.829319] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-13T18:22:12.829400] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 31.6s. Estimated remaining: 4h 5m 13s. Rate: 7.2 symbols/min [2025-10-13T18:22:13.000786] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:13.015378] [DEBUG] [LOCAL ] DCO: Loaded 14259 existing records from primary storage. [2025-10-13T18:22:13.015611] [INFO ] [MAIN ] DCO: Loaded 14259 existing records. [2025-10-13T18:22:13.197624] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:13.197990] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-13T18:22:13.198075] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-13T18:22:13.198522] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-13T18:22:13.198592] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-13T18:22:13.233900] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-13T18:22:13.488109] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:22:13.621077] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:13.977949] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:22:14.017900] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-13T18:22:14.248125] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T18:22:14.250866] [INFO ] [REMOTE ] DBD: Full fetch complete (31249 records). [2025-10-13T18:22:14.251012] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-13T18:22:14.251713] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:22:14.251814] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:22:14.251858] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:22:14.251900] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-13T18:22:14.251956] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-13T18:22:14.251990] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-13T18:22:14.252031] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-13T18:22:14.252092] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBD took 34.7s. Estimated remaining: 4h 4m 45s. Rate: 7.3 symbols/min [2025-10-13T18:22:14.429147] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:14.482513] [DEBUG] [LOCAL ] DD: Loaded 53623 existing records from primary storage. [2025-10-13T18:22:14.482853] [INFO ] [MAIN ] DD: Loaded 53623 existing records. [2025-10-13T18:22:14.659925] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:14.660162] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-13T18:22:14.660209] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-13T18:22:14.660734] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-13T18:22:14.660791] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-13T18:22:14.821631] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-13T18:22:15.035367] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:15.612701] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:22:15.626735] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-13T18:22:15.963949] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T18:22:16.418105] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-13T18:22:17.217927] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-13T18:22:17.360343] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:22:17.404747] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:22:18.017988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-13T18:22:18.035629] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T18:22:18.817927] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-13T18:22:19.617911] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-13T18:22:19.660924] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:22:20.051155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:22:20.418007] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-13T18:22:21.128614] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:22:21.217932] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-13T18:22:22.017899] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-13T18:22:22.058312] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:22:22.292077] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T18:22:22.817998] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-13T18:22:23.494928] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T18:22:23.617898] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-13T18:22:24.417901] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-13T18:22:24.621449] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:22:24.890030] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:22:25.217906] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-13T18:22:25.496944] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T18:22:26.018021] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-13T18:22:26.822577] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-13T18:22:26.826235] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:22:26.861596] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:22:27.617988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-13T18:22:28.340009] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T18:22:28.417959] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-13T18:22:29.217894] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-13T18:22:29.620352] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:22:29.923806] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:22:30.017909] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-13T18:22:30.551705] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T18:22:30.818021] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-13T18:22:30.911969] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:22:31.617910] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-13T18:22:32.418001] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-13T18:22:32.481008] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:22:32.891102] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:22:33.217926] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-13T18:22:33.813846] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T18:22:34.017924] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-13T18:22:34.169106] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:22:34.817980] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-13T18:22:35.617920] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-13T18:22:35.700253] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:22:36.105001] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:22:36.421450] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-13T18:22:37.217975] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-13T18:22:37.571619] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T18:22:37.845064] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T18:22:37.850236] [INFO ] [REMOTE ] DBRG: Full fetch complete (72286 records). [2025-10-13T18:22:37.850477] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-13T18:22:38.026457] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-13T18:22:38.235530] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-13T18:22:38.235609] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-13T18:22:38.236445] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-13T18:22:38.236509] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-13T18:22:38.237904] [DEBUG] [LOCAL ] DBRG: Trimmed 72286 records to 49849 (keeping 200 days of data) [2025-10-13T18:22:38.537863] [DEBUG] [LOCAL ] DBRG: Primary data saved (49849 records). [2025-10-13T18:22:38.538050] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-13T18:22:38.538193] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 33.5s. Estimated remaining: 4h 5m 24s. Rate: 7.2 symbols/min [2025-10-13T18:22:38.817990] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-13T18:22:38.860551] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:22:38.880753] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:22:39.617910] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-13T18:22:40.418007] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-13T18:22:40.788724] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T18:22:40.821826] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T18:22:41.217909] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-13T18:22:41.475691] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:22:42.017961] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-13T18:22:42.817904] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-13T18:22:43.082605] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T18:22:43.193619] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:22:43.197209] [INFO ] [REMOTE ] DCI: Full fetch complete (53554 records). [2025-10-13T18:22:43.197312] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-13T18:22:43.573181] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-13T18:22:43.573497] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-13T18:22:43.574256] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-13T18:22:43.574318] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-13T18:22:43.576986] [DEBUG] [LOCAL ] DCI: Trimmed 53554 records to 37041 (keeping 200 days of data) [2025-10-13T18:22:43.630631] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-13T18:22:43.809098] [DEBUG] [LOCAL ] DCI: Primary data saved (37041 records). [2025-10-13T18:22:43.809251] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-13T18:22:43.809352] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCI took 32.5s. Estimated remaining: 4h 5m 7s. Rate: 7.2 symbols/min [2025-10-13T18:22:43.908280] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:22:44.417924] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-13T18:22:45.451239] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T18:22:45.456205] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-13T18:22:45.651871] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T18:22:46.017924] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-13T18:22:46.196079] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:22:46.198942] [INFO ] [REMOTE ] DCO: Full fetch complete (19268 records). [2025-10-13T18:22:46.199029] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-13T18:22:46.608114] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-13T18:22:46.608195] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-13T18:22:46.608749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-13T18:22:46.608813] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-13T18:22:46.609379] [DEBUG] [LOCAL ] DCO: Trimmed 19268 records to 14327 (keeping 200 days of data) [2025-10-13T18:22:46.700898] [DEBUG] [LOCAL ] DCO: Primary data saved (14327 records). [2025-10-13T18:22:46.701038] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-13T18:22:46.701135] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DCO took 33.9s. Estimated remaining: 4h 4m 43s. Rate: 7.2 symbols/min [2025-10-13T18:22:47.748855] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T18:22:47.755715] [INFO ] [REMOTE ] DD: Full fetch complete (76380 records). [2025-10-13T18:22:47.755849] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-13T18:22:48.188390] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-13T18:22:48.188471] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-13T18:22:48.189339] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-13T18:22:48.189402] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-13T18:22:48.190945] [DEBUG] [LOCAL ] DD: Trimmed 76380 records to 52897 (keeping 200 days of data) [2025-10-13T18:22:48.508845] [DEBUG] [LOCAL ] DD: Primary data saved (52897 records). [2025-10-13T18:22:48.508980] [INFO ] [MAIN ] DD: Full history saved. [2025-10-13T18:22:48.509684] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DD took 34.3s. Estimated remaining: 4h 4m 15s. Rate: 7.3 symbols/min [2025-10-13T18:22:49.255282] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.250900] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.256783] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.267791] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-13T18:22:49.284997] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-13T18:22:49.285109] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-13T18:22:49.316751] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.285213] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-13T18:22:49.317413] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.318885] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.316895] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-13T18:22:49.319124] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-13T18:22:49.319848] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-13T18:22:49.319893] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-13T18:22:49.320675] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-13T18:22:49.320859] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-13T18:22:49.407911] [DEBUG] [LOCAL ] DDT: Loaded 2119 existing records from primary storage. [2025-10-13T18:22:49.422371] [INFO ] [MAIN ] DDT: Loaded 2119 existing records. [2025-10-13T18:22:49.962954] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:49.947994] [DEBUG] [LOCAL ] DDD: Loaded 51691 existing records from primary storage. [2025-10-13T18:22:49.985522] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.995580] [INFO ] [MAIN ] DDD: Loaded 51691 existing records. [2025-10-13T18:22:50.005901] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-13T18:22:50.146798] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-13T18:22:50.197143] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-13T18:22:50.420889] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:50.466395] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-13T18:22:50.614181] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:50.653352] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:50.674117] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-13T18:22:50.674441] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-13T18:22:50.674621] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-13T18:22:50.687311] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-13T18:22:50.697790] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-13T18:22:51.281030] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:51.303700] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-13T18:22:51.521372] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:51.521761] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-13T18:23:05.625831] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (14.32 seconds). [2025-10-13T18:23:05.627106] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-13T18:23:06.326300] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (14.80 seconds). [2025-10-13T18:23:06.337114] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-13T18:23:06.867971] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:23:06.869087] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-13T18:23:07.228307] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (16.76 seconds). [2025-10-13T18:23:07.231615] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-13T18:23:07.337585] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:23:07.338622] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-13T18:23:07.867363] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T18:23:07.868578] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-13T18:23:08.403410] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T18:23:08.405009] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-13T18:23:08.609599] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (17.94 seconds). [2025-10-13T18:23:08.618537] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-13T18:23:09.143829] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T18:23:09.144910] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-13T18:23:09.189461] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-13T18:23:09.200180] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-13T18:23:09.599214] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:23:09.600390] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-13T18:23:09.796975] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:23:09.804445] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-13T18:23:10.084189] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T18:23:10.085479] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-13T18:23:10.530321] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:23:10.531843] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-13T18:23:10.999512] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T18:23:11.000578] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-13T18:23:11.366114] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (4.13 seconds). [2025-10-13T18:23:11.369301] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-13T18:23:11.479974] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:23:11.480726] [INFO ] [REMOTE ] DDT: Full fetch complete (2845 records). [2025-10-13T18:23:11.480792] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-13T18:23:11.829347] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-13T18:23:11.829420] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-13T18:23:11.829524] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-13T18:23:11.829560] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-13T18:23:11.829913] [DEBUG] [LOCAL ] DDT: Trimmed 2845 records to 2104 (keeping 200 days of data) [2025-10-13T18:23:11.843351] [DEBUG] [LOCAL ] DDT: Primary data saved (2104 records). [2025-10-13T18:23:11.843409] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-13T18:23:11.843473] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 23.3s. Estimated remaining: 4h 4m 51s. Rate: 7.2 symbols/min [2025-10-13T18:23:12.010697] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:12.055278] [DEBUG] [LOCAL ] DE: Loaded 48254 existing records from primary storage. [2025-10-13T18:23:12.055612] [INFO ] [MAIN ] DE: Loaded 48254 existing records. [2025-10-13T18:23:12.240276] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:12.240683] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-13T18:23:12.240857] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-13T18:23:12.250555] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-13T18:23:12.250729] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-13T18:23:12.295479] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:23:12.350042] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-13T18:23:12.647521] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:12.648049] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-13T18:23:12.849276] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (3.65 seconds). [2025-10-13T18:23:12.858946] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-13T18:23:13.417522] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:23:13.421357] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-13T18:23:14.120107] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (4.32 seconds). [2025-10-13T18:23:14.128045] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-13T18:23:14.344026] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:23:14.354071] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-13T18:23:14.404245] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:23:14.415951] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-13T18:23:15.367929] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:23:15.377111] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-13T18:23:15.848687] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-13T18:23:15.852750] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-13T18:23:16.152321] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:23:16.163251] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-13T18:23:16.984373] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:23:16.988244] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-13T18:23:17.897700] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T18:23:17.901169] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-13T18:23:18.037021] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T18:23:18.047623] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-13T18:23:18.702802] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (4.29 seconds). [2025-10-13T18:23:18.714147] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-13T18:23:18.826860] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T18:23:18.830494] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-13T18:23:19.824209] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T18:23:19.828124] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-13T18:23:20.093829] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:23:20.105498] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-13T18:23:20.358250] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:23:20.369757] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-13T18:23:20.543141] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:23:20.546494] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-13T18:23:22.082715] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T18:23:22.094329] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-13T18:23:22.217343] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (6.84 seconds). [2025-10-13T18:23:22.228304] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-13T18:23:22.724459] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-13T18:23:22.726231] [INFO ] [REMOTE ] DDS: Full fetch complete (18716 records). [2025-10-13T18:23:22.726309] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-13T18:23:23.123072] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-13T18:23:23.123201] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-13T18:23:23.123883] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-13T18:23:23.123949] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-13T18:23:23.124690] [DEBUG] [LOCAL ] DDS: Trimmed 18716 records to 12758 (keeping 200 days of data) [2025-10-13T18:23:23.217208] [DEBUG] [LOCAL ] DDS: Primary data saved (12758 records). [2025-10-13T18:23:23.217403] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-13T18:23:23.217494] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 34.7s. Estimated remaining: 4h 4m 52s. Rate: 7.2 symbols/min [2025-10-13T18:23:23.402029] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:23.448566] [DEBUG] [LOCAL ] DEA: Loaded 41091 existing records from primary storage. [2025-10-13T18:23:23.448964] [INFO ] [MAIN ] DEA: Loaded 41091 existing records. [2025-10-13T18:23:23.636875] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:23.637383] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-13T18:23:23.637464] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-13T18:23:23.638155] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-13T18:23:23.638221] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-13T18:23:24.015434] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:23:24.065676] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-13T18:23:24.087356] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:24.088525] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-13T18:23:25.121132] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:23:25.128517] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-13T18:23:25.582216] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (5.21 seconds). [2025-10-13T18:23:25.594120] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-13T18:23:25.806774] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:23:25.817272] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-13T18:23:26.317860] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:23:26.324779] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-13T18:23:27.362373] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T18:23:27.372998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-13T18:23:27.516101] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:23:27.528343] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-13T18:23:27.754765] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:23:27.762429] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-13T18:23:28.962831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:23:28.973141] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-13T18:23:29.200810] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (7.11 seconds). [2025-10-13T18:23:29.213119] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-13T18:23:29.401791] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:23:29.431209] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-13T18:23:29.432270] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:23:29.445851] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-13T18:23:30.565076] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:23:30.576323] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-13T18:23:30.697405] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:23:30.797382] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:23:30.802391] [INFO ] [REMOTE ] DDL: Full fetch complete (53321 records). [2025-10-13T18:23:30.802513] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-13T18:23:30.825634] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-13T18:23:31.221620] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:23:31.257244] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-13T18:23:31.257360] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-13T18:23:31.258330] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-13T18:23:31.258419] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-13T18:23:31.261217] [DEBUG] [LOCAL ] DDL: Trimmed 53321 records to 36862 (keeping 200 days of data) [2025-10-13T18:23:31.489491] [DEBUG] [LOCAL ] DDL: Primary data saved (36862 records). [2025-10-13T18:23:31.489782] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-13T18:23:31.489923] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 42.9s. Estimated remaining: 4h 4m 44s. Rate: 7.2 symbols/min [2025-10-13T18:23:31.623104] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-13T18:23:31.668693] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:31.704767] [DEBUG] [LOCAL ] DEC: Loaded 30887 existing records from primary storage. [2025-10-13T18:23:31.705121] [INFO ] [MAIN ] DEC: Loaded 30887 existing records. [2025-10-13T18:23:31.892289] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:31.892895] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-13T18:23:31.893070] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-13T18:23:31.893700] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-13T18:23:31.893770] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-13T18:23:32.276506] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:32.315966] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:23:32.417902] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-13T18:23:32.498458] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T18:23:33.205883] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:23:33.214223] [INFO ] [REMOTE ] DDD: Full fetch complete (73752 records). [2025-10-13T18:23:33.214388] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-13T18:23:33.229339] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-13T18:23:33.629761] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-13T18:23:33.629962] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-13T18:23:33.631212] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-13T18:23:33.631305] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-13T18:23:33.633553] [DEBUG] [LOCAL ] DDD: Trimmed 73752 records to 50954 (keeping 200 days of data) [2025-10-13T18:23:33.869586] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:23:33.977711] [DEBUG] [LOCAL ] DDD: Primary data saved (50954 records). [2025-10-13T18:23:33.977902] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-13T18:23:33.978063] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DDD took 45.5s. Estimated remaining: 4h 4m 18s. Rate: 7.2 symbols/min [2025-10-13T18:23:34.023132] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-13T18:23:34.152307] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:34.152535] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-13T18:23:34.152575] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-13T18:23:34.152725] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-13T18:23:34.152775] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-13T18:23:34.152817] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-13T18:23:34.152850] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-13T18:23:34.521713] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:34.817959] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-13T18:23:35.159921] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:23:35.293811] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:23:35.617928] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-13T18:23:36.417911] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-13T18:23:36.725313] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T18:23:37.217964] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-13T18:23:37.861699] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:23:38.017909] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-13T18:23:38.609308] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:23:38.817971] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-13T18:23:39.361437] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:23:39.617975] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-13T18:23:40.276962] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:23:40.426839] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-13T18:23:40.445409] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (5.63 seconds). [2025-10-13T18:23:41.150612] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:23:41.218014] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-13T18:23:42.017899] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-13T18:23:42.259468] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:23:42.265142] [INFO ] [REMOTE ] DE: Full fetch complete (69527 records). [2025-10-13T18:23:42.265363] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-13T18:23:42.696837] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-13T18:23:42.697180] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-13T18:23:42.698433] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-13T18:23:42.698626] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-13T18:23:42.727400] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:23:42.736964] [DEBUG] [LOCAL ] DE: Trimmed 69527 records to 47658 (keeping 200 days of data) [2025-10-13T18:23:42.836207] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-13T18:23:43.068303] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T18:23:43.167305] [DEBUG] [LOCAL ] DE: Primary data saved (47658 records). [2025-10-13T18:23:43.167551] [INFO ] [MAIN ] DE: Full history saved. [2025-10-13T18:23:43.168800] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DE took 31.3s. Estimated remaining: 4h 4m 13s. Rate: 7.2 symbols/min [2025-10-13T18:23:43.429116] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:43.492450] [DEBUG] [LOCAL ] DEI: Loaded 49010 existing records from primary storage. [2025-10-13T18:23:43.493061] [INFO ] [MAIN ] DEI: Loaded 49010 existing records. [2025-10-13T18:23:43.625427] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-13T18:23:43.803151] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:43.803780] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-13T18:23:43.803858] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-13T18:23:43.804610] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-13T18:23:43.804736] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-13T18:23:44.245679] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:44.420977] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-13T18:23:44.423781] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:23:45.069278] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:23:45.217922] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-13T18:23:45.924756] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:23:46.017989] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-13T18:23:46.602726] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:23:46.817922] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-13T18:23:47.173836] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:23:47.178197] [INFO ] [REMOTE ] DEA: Full fetch complete (62019 records). [2025-10-13T18:23:47.178292] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-13T18:23:47.558778] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-13T18:23:47.558873] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-13T18:23:47.559672] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-13T18:23:47.559794] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-13T18:23:47.561040] [DEBUG] [LOCAL ] DEA: Trimmed 62019 records to 40492 (keeping 200 days of data) [2025-10-13T18:23:47.622732] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-13T18:23:47.802681] [DEBUG] [LOCAL ] DEA: Primary data saved (40492 records). [2025-10-13T18:23:47.802810] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-13T18:23:47.802882] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEA took 24.6s. Estimated remaining: 4h 3m 54s. Rate: 7.2 symbols/min [2025-10-13T18:23:47.969937] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:48.023187] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-13T18:23:48.023540] [INFO ] [MAIN ] DELL: Loaded 54516 existing records. [2025-10-13T18:23:48.195733] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:48.195986] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-13T18:23:48.196034] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-13T18:23:48.196575] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-13T18:23:48.196631] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-13T18:23:48.431102] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-13T18:23:48.547222] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:48.872854] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T18:23:49.217996] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-13T18:23:49.357441] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:23:49.529525] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:23:50.017964] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-13T18:23:50.817953] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-13T18:23:51.111999] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T18:23:51.618027] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-13T18:23:52.339956] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:23:52.417954] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-13T18:23:52.703623] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-13T18:23:53.217971] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-13T18:23:53.268198] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:23:53.878829] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:23:54.017945] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-13T18:23:54.412483] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:23:54.818070] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-13T18:23:55.617927] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-13T18:23:55.939764] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:23:56.421799] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-13T18:23:56.427818] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:23:57.217928] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-13T18:23:57.573802] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:23:57.956209] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T18:23:58.017928] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-13T18:23:58.645903] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T18:23:58.817925] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-13T18:23:59.617924] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-13T18:24:00.018603] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:24:00.022387] [INFO ] [REMOTE ] DEC: Full fetch complete (43982 records). [2025-10-13T18:24:00.022475] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-13T18:24:00.425899] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-13T18:24:00.463846] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-13T18:24:00.474609] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-13T18:24:00.475261] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-13T18:24:00.476338] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-13T18:24:00.476458] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-13T18:24:00.478582] [DEBUG] [LOCAL ] DEC: Trimmed 43982 records to 30365 (keeping 200 days of data) [2025-10-13T18:24:00.676796] [DEBUG] [LOCAL ] DEC: Primary data saved (30365 records). [2025-10-13T18:24:00.677047] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-13T18:24:00.677257] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEC took 29.2s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:00.859916] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:00.860119] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-13T18:24:00.860164] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-13T18:24:00.860289] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-13T18:24:00.860331] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-13T18:24:00.860371] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-13T18:24:00.860403] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-13T18:24:01.212337] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:01.217888] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-13T18:24:01.763228] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:24:02.017972] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-13T18:24:02.351285] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T18:24:02.814330] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T18:24:02.825339] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-13T18:24:03.617906] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-13T18:24:03.782507] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:24:04.022470] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T18:24:04.417966] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-13T18:24:05.217966] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-13T18:24:05.280760] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:24:06.017899] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-13T18:24:06.098038] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T18:24:06.817903] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-13T18:24:07.603462] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-13T18:24:07.617882] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-13T18:24:07.680067] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:24:08.417973] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-13T18:24:08.631603] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:24:09.217989] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-13T18:24:10.018071] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-13T18:24:10.084091] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-13T18:24:10.135047] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:24:10.817968] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-13T18:24:11.290925] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T18:24:11.296485] [INFO ] [REMOTE ] DECK: Full fetch complete (76805 records). [2025-10-13T18:24:11.296637] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-13T18:24:11.622002] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-13T18:24:11.701158] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-13T18:24:11.701336] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-13T18:24:11.702278] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-13T18:24:11.702357] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-13T18:24:11.731873] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:24:11.730518] [DEBUG] [LOCAL ] DECK: Trimmed 76805 records to 53297 (keeping 200 days of data) [2025-10-13T18:24:12.064664] [DEBUG] [LOCAL ] DECK: Primary data saved (53297 records). [2025-10-13T18:24:12.064808] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-13T18:24:12.064880] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 38.1s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:12.235821] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:12.265214] [DEBUG] [LOCAL ] DFH: Loaded 32600 existing records from primary storage. [2025-10-13T18:24:12.265474] [INFO ] [MAIN ] DFH: Loaded 32600 existing records. [2025-10-13T18:24:12.423064] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-13T18:24:12.458101] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:12.458361] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-13T18:24:12.458408] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-13T18:24:12.458757] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-13T18:24:12.458814] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-13T18:24:12.838132] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:13.187589] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-13T18:24:13.217897] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-13T18:24:13.452515] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T18:24:14.017969] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-13T18:24:14.174047] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:24:14.818009] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-13T18:24:15.399945] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-13T18:24:15.475785] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:24:15.617965] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-13T18:24:16.123066] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:24:16.417951] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-13T18:24:17.217914] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-13T18:24:17.317540] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:24:17.933347] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:24:18.017900] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-13T18:24:18.758789] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:24:18.763855] [INFO ] [REMOTE ] DEI: Full fetch complete (69697 records). [2025-10-13T18:24:18.763974] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-13T18:24:18.823365] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-13T18:24:19.178969] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-13T18:24:19.179049] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-13T18:24:19.179846] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-13T18:24:19.179910] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-13T18:24:19.181357] [DEBUG] [LOCAL ] DEI: Trimmed 69697 records to 48334 (keeping 200 days of data) [2025-10-13T18:24:19.310232] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:24:19.502501] [DEBUG] [LOCAL ] DEI: Primary data saved (48334 records). [2025-10-13T18:24:19.502687] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-13T18:24:19.503467] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DEI took 36.3s. Estimated remaining: 4h 3m 48s. Rate: 7.2 symbols/min [2025-10-13T18:24:19.623020] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-13T18:24:19.675236] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:19.698034] [DEBUG] [LOCAL ] DFIN: Loaded 23143 existing records from primary storage. [2025-10-13T18:24:19.698322] [INFO ] [MAIN ] DFIN: Loaded 23143 existing records. [2025-10-13T18:24:19.881018] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:19.881263] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-13T18:24:19.881317] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-13T18:24:19.881536] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-13T18:24:19.881594] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-13T18:24:20.231456] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:20.418019] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-13T18:24:20.963789] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T18:24:21.136244] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:24:21.217926] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-13T18:24:21.568606] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T18:24:22.017916] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-13T18:24:22.504833] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:24:22.818015] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-13T18:24:23.617911] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-13T18:24:24.022086] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T18:24:24.417963] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-13T18:24:24.783880] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:24:25.163394] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:24:25.217899] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-13T18:24:25.459973] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:24:26.017957] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-13T18:24:26.492057] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:24:26.817957] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-13T18:24:27.115339] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:24:27.617920] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-13T18:24:28.412503] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:24:28.422392] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-13T18:24:28.876124] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:24:29.217994] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-13T18:24:29.642044] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:24:30.017978] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-13T18:24:30.818040] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-13T18:24:31.591144] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-13T18:24:31.617898] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-13T18:24:31.835520] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:24:31.895869] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T18:24:32.418000] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-13T18:24:33.217971] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-13T18:24:33.928932] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-13T18:24:33.934415] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-13T18:24:33.934595] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-13T18:24:34.023208] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-13T18:24:34.159823] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T18:24:34.390305] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-13T18:24:34.390426] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-13T18:24:34.391467] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-13T18:24:34.391532] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-13T18:24:34.393088] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53736 (keeping 200 days of data) [2025-10-13T18:24:34.526065] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T18:24:34.539541] [INFO ] [REMOTE ] DEO: Full fetch complete (71531 records). [2025-10-13T18:24:34.539711] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-13T18:24:34.855901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-13T18:24:35.153608] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-13T18:24:35.153879] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-13T18:24:35.154009] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-13T18:24:35.154281] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-13T18:24:35.154204] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DELL took 47.4s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-13T18:24:35.155257] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-13T18:24:35.155353] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-13T18:24:35.257516] [DEBUG] [LOCAL ] DEO: Trimmed 71531 records to 49199 (keeping 200 days of data) [2025-10-13T18:24:35.421738] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:35.422856] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-13T18:24:35.423542] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-13T18:24:35.426455] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-13T18:24:35.427014] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-13T18:24:35.428792] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-13T18:24:35.429486] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-13T18:24:35.565096] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:24:35.632192] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-13T18:24:36.116417] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:36.146017] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T18:24:36.248416] [DEBUG] [LOCAL ] DEO: Primary data saved (49199 records). [2025-10-13T18:24:36.248606] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-13T18:24:36.248787] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DEO took 35.6s. Estimated remaining: 4h 3m 32s. Rate: 7.2 symbols/min [2025-10-13T18:24:36.423039] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-13T18:24:36.452260] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:36.453304] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-13T18:24:36.453384] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-13T18:24:36.453591] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-13T18:24:36.453694] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-13T18:24:36.453779] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-13T18:24:36.453826] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-13T18:24:36.838205] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:37.077041] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:24:37.213405] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T18:24:37.218092] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-13T18:24:38.017898] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-13T18:24:38.253672] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:24:38.797371] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:24:38.817878] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-13T18:24:39.572043] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T18:24:39.617883] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-13T18:24:40.417949] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-13T18:24:40.436798] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:24:41.217963] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-13T18:24:42.018049] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-13T18:24:42.373694] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:24:42.474911] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T18:24:42.817983] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-13T18:24:43.279503] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:24:43.508492] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:24:43.617951] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-13T18:24:44.417970] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-13T18:24:44.722492] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:24:44.725879] [INFO ] [REMOTE ] DFH: Full fetch complete (48055 records). [2025-10-13T18:24:44.725955] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-13T18:24:45.095001] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-13T18:24:45.095080] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-13T18:24:45.095691] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-13T18:24:45.095752] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-13T18:24:45.097700] [DEBUG] [LOCAL ] DFH: Trimmed 48055 records to 32203 (keeping 200 days of data) [2025-10-13T18:24:45.240422] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-13T18:24:45.283480] [DEBUG] [LOCAL ] DFH: Primary data saved (32203 records). [2025-10-13T18:24:45.283618] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-13T18:24:45.283750] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 33.2s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-13T18:24:45.451334] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:45.451520] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-13T18:24:45.451558] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-13T18:24:45.451689] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-13T18:24:45.451742] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-13T18:24:45.451784] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-13T18:24:45.451817] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-13T18:24:45.805159] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:46.017927] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-13T18:24:46.298517] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:24:46.395742] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:24:46.398594] [INFO ] [REMOTE ] DFIN: Full fetch complete (33362 records). [2025-10-13T18:24:46.398711] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-13T18:24:46.776370] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-13T18:24:46.776450] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-13T18:24:46.777023] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-13T18:24:46.777086] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-13T18:24:46.778057] [DEBUG] [LOCAL ] DFIN: Trimmed 33362 records to 22684 (keeping 200 days of data) [2025-10-13T18:24:46.827395] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-13T18:24:46.917238] [DEBUG] [LOCAL ] DFIN: Primary data saved (22684 records). [2025-10-13T18:24:46.917366] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-13T18:24:46.917479] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 27.4s. Estimated remaining: 4h 2m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:47.103465] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:47.122779] [DEBUG] [LOCAL ] DHF: Loaded 21463 existing records from primary storage. [2025-10-13T18:24:47.123024] [INFO ] [MAIN ] DHF: Loaded 21463 existing records. [2025-10-13T18:24:47.300677] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:47.300903] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-13T18:24:47.300950] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-13T18:24:47.301253] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-13T18:24:47.301311] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-13T18:24:47.629953] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-13T18:24:47.673071] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:47.738935] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:24:48.417897] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-13T18:24:48.493126] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T18:24:48.878522] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T18:24:49.217926] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-13T18:24:50.021834] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-13T18:24:50.157703] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:24:50.788901] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T18:24:50.817882] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-13T18:24:51.051775] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T18:24:51.617929] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-13T18:24:51.823674] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:24:52.417962] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-13T18:24:52.508357] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:24:53.217961] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-13T18:24:54.017953] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-13T18:24:54.684089] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T18:24:54.721762] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:24:54.817928] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-13T18:24:54.845162] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T18:24:55.617921] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-13T18:24:56.316112] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T18:24:56.417902] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-13T18:24:56.860333] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T18:24:57.217896] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-13T18:24:57.380781] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:24:58.017964] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-13T18:24:58.698577] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:24:58.818008] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-13T18:24:59.145563] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T18:24:59.533243] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:24:59.617921] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-13T18:25:00.348031] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T18:25:00.349794] [INFO ] [REMOTE ] DFP: Full fetch complete (15864 records). [2025-10-13T18:25:00.349960] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-13T18:25:00.423093] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-13T18:25:00.738950] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-13T18:25:00.739094] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-13T18:25:00.739891] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-13T18:25:00.739965] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-13T18:25:00.741376] [DEBUG] [LOCAL ] DFP: Trimmed 15864 records to 11208 (keeping 200 days of data) [2025-10-13T18:25:00.823985] [DEBUG] [LOCAL ] DFP: Primary data saved (11208 records). [2025-10-13T18:25:00.824193] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-13T18:25:00.824289] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DFP took 25.7s. Estimated remaining: 4h 3m 6s. Rate: 7.2 symbols/min [2025-10-13T18:25:01.001937] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:01.073350] [DEBUG] [LOCAL ] DHI: Loaded 54122 existing records from primary storage. [2025-10-13T18:25:01.073868] [INFO ] [MAIN ] DHI: Loaded 54122 existing records. [2025-10-13T18:25:01.226926] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-13T18:25:01.309467] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:01.309800] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-13T18:25:01.309870] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-13T18:25:01.310561] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-13T18:25:01.310618] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-13T18:25:01.707492] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:02.017997] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-13T18:25:02.302628] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T18:25:02.817922] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-13T18:25:03.158101] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T18:25:03.617906] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-13T18:25:04.166841] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:25:04.417917] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-13T18:25:05.217911] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-13T18:25:05.341308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-13T18:25:05.347787] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:25:05.384846] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T18:25:06.018025] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-13T18:25:06.817903] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-13T18:25:07.014816] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:25:07.130737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:25:07.617921] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-13T18:25:08.417980] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-13T18:25:08.542971] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:25:09.217895] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-13T18:25:09.254252] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:25:09.476737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T18:25:10.017923] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-13T18:25:10.817910] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-13T18:25:11.066512] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T18:25:11.467623] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:25:11.617950] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-13T18:25:11.895407] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T18:25:12.417998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-13T18:25:13.047490] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:25:13.218031] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-13T18:25:14.017963] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-13T18:25:14.554508] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T18:25:14.817907] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-13T18:25:14.882120] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T18:25:15.018356] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T18:25:15.024096] [INFO ] [REMOTE ] DG: Full fetch complete (77208 records). [2025-10-13T18:25:15.024234] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-13T18:25:15.410840] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-13T18:25:15.410945] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-13T18:25:15.411812] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-13T18:25:15.411873] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-13T18:25:15.413394] [DEBUG] [LOCAL ] DG: Trimmed 77208 records to 53278 (keeping 200 days of data) [2025-10-13T18:25:15.625096] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-13T18:25:15.747718] [DEBUG] [LOCAL ] DG: Primary data saved (53278 records). [2025-10-13T18:25:15.747854] [INFO ] [MAIN ] DG: Full history saved. [2025-10-13T18:25:15.747923] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DG took 39.5s. Estimated remaining: 4h 3m 17s. Rate: 7.2 symbols/min [2025-10-13T18:25:15.911940] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:15.963256] [DEBUG] [LOCAL ] DHR: Loaded 54151 existing records from primary storage. [2025-10-13T18:25:15.963575] [INFO ] [MAIN ] DHR: Loaded 54151 existing records. [2025-10-13T18:25:16.139067] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:16.139346] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-13T18:25:16.139412] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-13T18:25:16.140189] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-13T18:25:16.140248] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-13T18:25:16.422186] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-13T18:25:16.500406] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:16.888505] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:25:16.913363] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-13T18:25:17.217956] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-13T18:25:17.971340] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:25:18.018000] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-13T18:25:18.817926] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-13T18:25:19.045362] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:25:19.617968] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-13T18:25:19.755193] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:25:20.107833] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T18:25:20.247801] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:25:20.417925] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-13T18:25:21.218035] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-13T18:25:22.005137] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:25:22.017886] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-13T18:25:22.219519] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:25:22.222982] [INFO ] [REMOTE ] DHF: Full fetch complete (30089 records). [2025-10-13T18:25:22.223161] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-13T18:25:22.635956] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-13T18:25:22.636080] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-13T18:25:22.637291] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-13T18:25:22.637374] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-13T18:25:22.638976] [DEBUG] [LOCAL ] DHF: Trimmed 30089 records to 21235 (keeping 200 days of data) [2025-10-13T18:25:22.773909] [DEBUG] [LOCAL ] DHF: Primary data saved (21235 records). [2025-10-13T18:25:22.774148] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-13T18:25:22.774258] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 35.9s. Estimated remaining: 4h 3m 5s. Rate: 7.2 symbols/min [2025-10-13T18:25:22.828563] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-13T18:25:22.953268] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:23.004891] [DEBUG] [LOCAL ] DHT: Loaded 48622 existing records from primary storage. [2025-10-13T18:25:23.005316] [INFO ] [MAIN ] DHT: Loaded 48622 existing records. [2025-10-13T18:25:23.185506] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:23.185834] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-13T18:25:23.185884] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-13T18:25:23.186304] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-13T18:25:23.186362] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-13T18:25:23.570005] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:23.617961] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-13T18:25:23.686725] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:25:24.418006] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-13T18:25:24.727493] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:25:25.223117] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-13T18:25:25.250877] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:25:26.017910] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-13T18:25:26.061878] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:25:26.066442] [INFO ] [REMOTE ] DGX: Full fetch complete (65128 records). [2025-10-13T18:25:26.066542] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-13T18:25:26.444849] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-13T18:25:26.444926] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-13T18:25:26.445697] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-13T18:25:26.445760] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-13T18:25:26.447035] [DEBUG] [LOCAL ] DGX: Trimmed 65128 records to 44805 (keeping 200 days of data) [2025-10-13T18:25:26.736874] [DEBUG] [LOCAL ] DGX: Primary data saved (44805 records). [2025-10-13T18:25:26.737003] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-13T18:25:26.737074] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DGX took 41.5s. Estimated remaining: 4h 2m 44s. Rate: 7.2 symbols/min [2025-10-13T18:25:26.822939] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-13T18:25:26.937331] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:26.951475] [DEBUG] [LOCAL ] DHX: Loaded 13393 existing records from primary storage. [2025-10-13T18:25:26.951739] [INFO ] [MAIN ] DHX: Loaded 13393 existing records. [2025-10-13T18:25:27.165694] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:27.166039] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-13T18:25:27.166311] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-13T18:25:27.168845] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:25:27.168917] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-13T18:25:27.180225] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-13T18:25:27.534284] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:27.617927] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-13T18:25:27.910709] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T18:25:28.418061] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-13T18:25:28.548843] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:25:28.722624] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:25:29.217972] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-13T18:25:30.017908] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-13T18:25:30.428675] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:25:30.471749] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:25:30.817927] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-13T18:25:30.997465] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T18:25:31.617917] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-13T18:25:32.418048] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-13T18:25:32.801445] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T18:25:32.813691] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T18:25:33.217999] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-13T18:25:34.017912] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-13T18:25:34.146987] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T18:25:34.408334] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T18:25:34.817903] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-13T18:25:35.530130] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:25:35.617909] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-13T18:25:36.417904] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-13T18:25:36.521161] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T18:25:37.018696] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T18:25:37.217951] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-13T18:25:37.741745] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:25:38.017993] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-13T18:25:38.818007] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-13T18:25:39.128059] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T18:25:39.133520] [INFO ] [REMOTE ] DHI: Full fetch complete (77216 records). [2025-10-13T18:25:39.133690] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-13T18:25:39.519058] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-13T18:25:39.519132] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-13T18:25:39.519991] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-13T18:25:39.520054] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-13T18:25:39.521534] [DEBUG] [LOCAL ] DHI: Trimmed 77216 records to 53356 (keeping 200 days of data) [2025-10-13T18:25:39.622016] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-13T18:25:39.853540] [DEBUG] [LOCAL ] DHI: Primary data saved (53356 records). [2025-10-13T18:25:39.853728] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-13T18:25:39.853830] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 39.0s. Estimated remaining: 4h 2m 50s. Rate: 7.2 symbols/min [2025-10-13T18:25:40.025108] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:40.039870] [DEBUG] [LOCAL ] DIAX: Loaded 13282 existing records from primary storage. [2025-10-13T18:25:40.040349] [INFO ] [MAIN ] DIAX: Loaded 13282 existing records. [2025-10-13T18:25:40.172799] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T18:25:40.273195] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:40.273440] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-13T18:25:40.273502] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-13T18:25:40.273786] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-13T18:25:40.273850] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-13T18:25:40.423722] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-13T18:25:40.643937] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:40.649860] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:25:40.695889] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T18:25:41.217973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-13T18:25:42.017904] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-13T18:25:42.064425] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:25:42.115090] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T18:25:42.621105] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:25:42.817924] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-13T18:25:43.617907] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-13T18:25:44.417984] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-13T18:25:44.446915] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T18:25:44.680339] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:25:45.128760] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:25:45.217911] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-13T18:25:46.017990] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-13T18:25:46.072035] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T18:25:46.560717] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T18:25:46.566271] [INFO ] [REMOTE ] DHR: Full fetch complete (77263 records). [2025-10-13T18:25:46.566420] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-13T18:25:46.823078] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-13T18:25:46.957261] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-13T18:25:46.957335] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-13T18:25:46.958207] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-13T18:25:46.958269] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-13T18:25:46.959691] [DEBUG] [LOCAL ] DHR: Trimmed 77263 records to 53378 (keeping 200 days of data) [2025-10-13T18:25:47.293364] [DEBUG] [LOCAL ] DHR: Primary data saved (53378 records). [2025-10-13T18:25:47.293686] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-13T18:25:47.293794] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 31.5s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-13T18:25:47.458849] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:47.494057] [DEBUG] [LOCAL ] DIN: Loaded 37849 existing records from primary storage. [2025-10-13T18:25:47.494329] [INFO ] [MAIN ] DIN: Loaded 37849 existing records. [2025-10-13T18:25:47.630778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-13T18:25:47.676234] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:47.676622] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-13T18:25:47.676739] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-13T18:25:47.677200] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-13T18:25:47.677259] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-13T18:25:47.813585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T18:25:48.047424] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:48.417980] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-13T18:25:48.446923] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:25:49.217997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-13T18:25:49.352109] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:25:49.354310] [INFO ] [REMOTE ] DHX: Full fetch complete (21126 records). [2025-10-13T18:25:49.354376] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-13T18:25:49.707863] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-13T18:25:49.707958] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-13T18:25:49.708429] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-13T18:25:49.708470] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-13T18:25:49.709107] [DEBUG] [LOCAL ] DHX: Trimmed 21126 records to 13254 (keeping 200 days of data) [2025-10-13T18:25:49.780086] [DEBUG] [LOCAL ] DHX: Primary data saved (13254 records). [2025-10-13T18:25:49.780226] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-13T18:25:49.780301] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHX took 23.0s. Estimated remaining: 4h 2m 14s. Rate: 7.2 symbols/min [2025-10-13T18:25:49.945574] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:49.945811] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-13T18:25:49.945853] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-13T18:25:49.945960] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-13T18:25:49.946000] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-13T18:25:49.946040] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-13T18:25:49.946071] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-13T18:25:50.023114] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-13T18:25:50.295999] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:50.797151] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T18:25:50.817920] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-13T18:25:51.563464] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:25:51.617916] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-13T18:25:52.277724] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:25:52.417885] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-13T18:25:53.217988] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-13T18:25:53.350122] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T18:25:53.908668] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T18:25:53.925029] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T18:25:54.017922] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-13T18:25:54.817971] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-13T18:25:54.948818] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T18:25:55.618013] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-13T18:25:56.382497] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:25:56.417886] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-13T18:25:57.070535] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:25:57.217962] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-13T18:25:57.926002] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:25:58.017881] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-13T18:25:58.673480] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:25:58.817902] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-13T18:25:59.565049] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T18:25:59.617874] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-13T18:25:59.810340] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:26:00.397153] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:26:00.417883] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-13T18:26:01.217986] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-13T18:26:01.258601] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T18:26:02.017920] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-13T18:26:02.601051] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T18:26:02.817955] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-13T18:26:03.457776] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T18:26:03.617914] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-13T18:26:03.698417] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:26:04.417970] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-13T18:26:04.619330] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:26:05.217970] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-13T18:26:06.021059] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-13T18:26:06.371522] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T18:26:06.787263] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:26:06.792364] [INFO ] [REMOTE ] DHT: Full fetch complete (69956 records). [2025-10-13T18:26:06.792483] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-13T18:26:06.823783] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-13T18:26:07.253323] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-13T18:26:07.253439] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-13T18:26:07.254394] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-13T18:26:07.254477] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-13T18:26:07.256010] [DEBUG] [LOCAL ] DHT: Trimmed 69956 records to 47907 (keeping 200 days of data) [2025-10-13T18:26:07.481921] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:26:07.525705] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T18:26:07.530409] [INFO ] [REMOTE ] DIAX: Full fetch complete (17748 records). [2025-10-13T18:26:07.532053] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-13T18:26:07.621268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-13T18:26:07.746348] [DEBUG] [LOCAL ] DHT: Primary data saved (47907 records). [2025-10-13T18:26:07.771125] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-13T18:26:07.810186] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHT took 45.0s. Estimated remaining: 4h 2m 33s. Rate: 7.2 symbols/min [2025-10-13T18:26:08.171043] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:08.188794] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-13T18:26:08.188877] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-13T18:26:08.189339] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-13T18:26:08.189510] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-13T18:26:08.190118] [DEBUG] [LOCAL ] DIAX: Trimmed 17748 records to 13102 (keeping 200 days of data) [2025-10-13T18:26:08.270505] [DEBUG] [LOCAL ] DIAX: Primary data saved (13102 records). [2025-10-13T18:26:08.270681] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-13T18:26:08.270856] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIAX took 28.4s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-10-13T18:26:08.424257] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-13T18:26:08.457826] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:08.458219] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-13T18:26:08.473474] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-13T18:26:08.475233] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-13T18:26:08.475324] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-13T18:26:08.475439] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-13T18:26:08.475498] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-13T18:26:08.519848] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-13T18:26:08.551706] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-10-13T18:26:08.894063] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:08.906032] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-13T18:26:08.916483] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-13T18:26:08.959057] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-13T18:26:08.959239] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-13T18:26:09.200374] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:09.234422] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-13T18:26:09.373087] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:26:09.480987] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:09.710576] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-13T18:26:09.881742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:26:10.017895] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-13T18:26:10.817925] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-13T18:26:11.618002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-13T18:26:11.718616] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:26:12.034448] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T18:26:12.260210] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:26:12.417919] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-13T18:26:12.752025] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T18:26:13.218028] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-13T18:26:14.017921] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-13T18:26:14.817905] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-13T18:26:15.105238] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:26:15.188271] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:26:15.378736] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:26:15.617921] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-13T18:26:16.039598] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:26:16.417969] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-13T18:26:17.217952] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-13T18:26:18.017962] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-13T18:26:18.420590] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:26:18.424708] [INFO ] [REMOTE ] DIN: Full fetch complete (55181 records). [2025-10-13T18:26:18.424809] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-13T18:26:18.526398] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T18:26:18.803807] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-13T18:26:18.803884] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-13T18:26:18.804702] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-13T18:26:18.804763] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-13T18:26:18.805949] [DEBUG] [LOCAL ] DIN: Trimmed 55181 records to 37419 (keeping 200 days of data) [2025-10-13T18:26:18.860914] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-13T18:26:19.042444] [DEBUG] [LOCAL ] DIN: Primary data saved (37419 records). [2025-10-13T18:26:19.042583] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-13T18:26:19.042695] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIN took 31.7s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-13T18:26:19.223454] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:19.254533] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T18:26:19.257613] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-13T18:26:19.308242] [DEBUG] [LOCAL ] DK: Loaded 50055 existing records from primary storage. [2025-10-13T18:26:19.308553] [INFO ] [MAIN ] DK: Loaded 50055 existing records. [2025-10-13T18:26:19.483534] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:19.483753] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-13T18:26:19.483805] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-13T18:26:19.484294] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-13T18:26:19.484357] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-13T18:26:19.623450] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-13T18:26:19.854923] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:20.186569] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:26:20.417985] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-13T18:26:21.217978] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-13T18:26:21.546752] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T18:26:22.018011] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-13T18:26:22.377799] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T18:26:22.733193] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-13T18:26:22.817887] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-13T18:26:23.216839] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T18:26:23.217537] [INFO ] [REMOTE ] DIVY: Full fetch complete (1699 records). [2025-10-13T18:26:23.217605] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-13T18:26:23.393803] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T18:26:23.394025] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:26:23.394095] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:26:23.394147] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-13T18:26:23.394204] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-13T18:26:23.394239] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-13T18:26:23.394279] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-13T18:26:23.394336] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 15.1s. Estimated remaining: 4h 1m 42s. Rate: 7.2 symbols/min [2025-10-13T18:26:23.561746] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:23.561941] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-13T18:26:23.561978] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-13T18:26:23.562090] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-13T18:26:23.562131] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-13T18:26:23.562171] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-13T18:26:23.562204] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-13T18:26:23.623192] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-13T18:26:23.941831] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:24.417924] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-13T18:26:25.217982] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-13T18:26:25.854534] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T18:26:25.984502] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-13T18:26:26.017900] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-13T18:26:26.817925] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-13T18:26:26.910977] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:26:27.618051] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-13T18:26:28.386738] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:26:28.417948] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-13T18:26:28.484208] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-13T18:26:29.217974] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-13T18:26:29.357017] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T18:26:29.866098] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T18:26:30.018012] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-13T18:26:30.817909] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-13T18:26:31.239475] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:26:31.617900] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-13T18:26:31.659530] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-13T18:26:32.417913] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-13T18:26:32.456866] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:26:33.179939] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:26:33.217891] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-13T18:26:33.287508] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T18:26:34.017974] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-13T18:26:34.818023] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-13T18:26:34.893302] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T18:26:34.993697] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:26:35.617954] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-13T18:26:36.417966] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-13T18:26:36.466752] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:26:37.217958] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-13T18:26:38.017922] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-13T18:26:38.072556] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T18:26:38.299546] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:26:38.332882] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:26:38.818067] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-13T18:26:39.498478] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:26:39.618049] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-13T18:26:40.418030] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-13T18:26:40.465345] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:26:40.471468] [INFO ] [REMOTE ] DINO: Full fetch complete (76568 records). [2025-10-13T18:26:40.471735] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-13T18:26:40.931334] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-13T18:26:40.931468] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-13T18:26:40.932726] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-13T18:26:40.932797] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-13T18:26:40.935383] [DEBUG] [LOCAL ] DINO: Trimmed 76568 records to 52852 (keeping 200 days of data) [2025-10-13T18:26:41.021912] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T18:26:41.218001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-13T18:26:41.327610] [DEBUG] [LOCAL ] DINO: Primary data saved (52852 records). [2025-10-13T18:26:41.327876] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-13T18:26:41.328072] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DINO took 51.5s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-13T18:26:41.509575] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:41.568793] [DEBUG] [LOCAL ] DKS: Loaded 50431 existing records from primary storage. [2025-10-13T18:26:41.569260] [INFO ] [MAIN ] DKS: Loaded 50431 existing records. [2025-10-13T18:26:41.773549] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:41.773895] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-13T18:26:41.773947] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-13T18:26:41.774497] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-13T18:26:41.774567] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-13T18:26:42.033488] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-13T18:26:42.172998] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:42.346084] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:26:42.635355] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T18:26:42.817968] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-13T18:26:43.617954] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-13T18:26:43.683164] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:26:44.417981] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-13T18:26:45.222540] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-13T18:26:45.225894] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T18:26:45.275805] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-13T18:26:45.348720] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:26:46.017976] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-13T18:26:46.817994] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-13T18:26:47.179910] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T18:26:47.617885] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-13T18:26:47.727684] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T18:26:47.727399] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:26:48.418003] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-13T18:26:49.217901] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-13T18:26:49.292435] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:26:49.795346] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T18:26:50.018054] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-13T18:26:50.076239] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:26:50.817964] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-13T18:26:51.619313] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-13T18:26:51.622143] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T18:26:51.837022] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T18:26:52.417956] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-13T18:26:53.148406] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:26:53.217901] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-13T18:26:53.359235] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:26:53.361039] [INFO ] [REMOTE ] DKL: Full fetch complete (27957 records). [2025-10-13T18:26:53.361111] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-13T18:26:53.717357] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-13T18:26:53.717431] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-13T18:26:53.717905] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-13T18:26:53.717988] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-13T18:26:53.718630] [DEBUG] [LOCAL ] DKL: Trimmed 27957 records to 17768 (keeping 200 days of data) [2025-10-13T18:26:53.824935] [DEBUG] [LOCAL ] DKL: Primary data saved (17768 records). [2025-10-13T18:26:53.825076] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-13T18:26:53.825173] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DKL took 30.4s. Estimated remaining: 4h 2m 4s. Rate: 7.2 symbols/min [2025-10-13T18:26:53.988822] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:53.989022] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-13T18:26:53.989061] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-13T18:26:53.989174] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-13T18:26:53.989216] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-13T18:26:53.989258] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-13T18:26:53.989290] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-13T18:26:54.023133] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-13T18:26:54.339959] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:54.817925] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-13T18:26:55.191554] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:26:55.617948] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-13T18:26:55.786447] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:26:55.792613] [INFO ] [REMOTE ] DK: Full fetch complete (70864 records). [2025-10-13T18:26:55.792870] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-13T18:26:56.216743] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-13T18:26:56.216882] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-13T18:26:56.218248] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-13T18:26:56.218487] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-13T18:26:56.239334] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:26:56.247701] [DEBUG] [LOCAL ] DK: Trimmed 70864 records to 49383 (keeping 200 days of data) [2025-10-13T18:26:56.435602] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-13T18:26:56.578347] [DEBUG] [LOCAL ] DK: Primary data saved (49383 records). [2025-10-13T18:26:56.578484] [INFO ] [MAIN ] DK: Full history saved. [2025-10-13T18:26:56.578587] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DK took 37.5s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-13T18:26:56.753332] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:56.760493] [DEBUG] [LOCAL ] DLNG: Loaded 6234 existing records from primary storage. [2025-10-13T18:26:56.760755] [INFO ] [MAIN ] DLNG: Loaded 6234 existing records. [2025-10-13T18:26:56.934461] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:56.934690] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-13T18:26:56.934746] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-13T18:26:56.934958] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-13T18:26:56.935013] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-13T18:26:57.223051] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-13T18:26:57.291344] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:57.560978] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:26:57.847061] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:26:58.017947] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-13T18:26:58.817979] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-13T18:26:59.499985] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T18:26:59.617889] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-13T18:26:59.758844] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:27:00.178897] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:27:00.336010] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:27:00.343119] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-13T18:27:00.343346] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-13T18:27:00.423091] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-13T18:27:00.754120] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-13T18:27:00.754205] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-13T18:27:00.755190] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-13T18:27:00.755253] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-13T18:27:00.756851] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 53788 (keeping 200 days of data) [2025-10-13T18:27:01.085964] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-13T18:27:01.086107] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-13T18:27:01.087209] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DIS took 53.3s. Estimated remaining: 4h 1m 21s. Rate: 7.2 symbols/min [2025-10-13T18:27:01.227031] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-13T18:27:01.259688] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:01.319287] [DEBUG] [LOCAL ] DLR: Loaded 51583 existing records from primary storage. [2025-10-13T18:27:01.319606] [INFO ] [MAIN ] DLR: Loaded 51583 existing records. [2025-10-13T18:27:01.516208] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:01.516448] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-13T18:27:01.516497] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-13T18:27:01.517152] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-13T18:27:01.517212] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-13T18:27:01.952174] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:02.017974] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-13T18:27:02.116850] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:27:02.623438] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:27:02.817995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-13T18:27:03.618013] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-13T18:27:03.736047] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:27:03.756554] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:27:04.417977] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-13T18:27:05.217995] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-13T18:27:05.413738] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:27:05.454964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T18:27:06.017990] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-13T18:27:06.730743] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:27:06.817964] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-13T18:27:07.617913] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-13T18:27:07.781825] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:27:08.417918] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-13T18:27:08.659857] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:27:08.719862] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T18:27:09.217983] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-13T18:27:10.018040] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-13T18:27:10.242981] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:27:10.658730] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:27:10.694855] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:27:10.817888] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-13T18:27:11.617992] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-13T18:27:12.417982] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-13T18:27:12.613807] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:27:13.113499] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:27:13.217927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-13T18:27:13.358273] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T18:27:13.363553] [INFO ] [REMOTE ] DKS: Full fetch complete (71648 records). [2025-10-13T18:27:13.363728] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-13T18:27:13.754420] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-13T18:27:13.754503] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-13T18:27:13.755335] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-13T18:27:13.755398] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-13T18:27:13.756817] [DEBUG] [LOCAL ] DKS: Trimmed 71648 records to 49726 (keeping 200 days of data) [2025-10-13T18:27:14.037778] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-13T18:27:14.073552] [DEBUG] [LOCAL ] DKS: Primary data saved (49726 records). [2025-10-13T18:27:14.073717] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-13T18:27:14.073820] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 32.7s. Estimated remaining: 4h 1m 26s. Rate: 7.2 symbols/min [2025-10-13T18:27:14.243012] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:14.243288] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-13T18:27:14.243333] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-13T18:27:14.243438] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-13T18:27:14.243478] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-13T18:27:14.243518] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-13T18:27:14.243550] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-13T18:27:14.351933] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:27:14.601806] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:14.817909] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-13T18:27:15.289240] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:27:15.617924] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-13T18:27:16.050887] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:27:16.417915] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-13T18:27:17.217982] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-13T18:27:17.539117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T18:27:17.907529] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:27:18.017911] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-13T18:27:18.283074] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:27:18.818001] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-13T18:27:19.097446] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T18:27:19.273928] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T18:27:19.617955] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-13T18:27:20.417978] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-13T18:27:20.993162] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:27:21.217918] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-13T18:27:22.017974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-13T18:27:22.081819] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:27:22.585165] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:27:22.683555] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:27:22.817960] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-13T18:27:23.398115] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T18:27:23.617997] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-13T18:27:24.417988] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-13T18:27:25.128978] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:27:25.217974] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-13T18:27:25.966999] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T18:27:25.972229] [INFO ] [REMOTE ] DLB: Full fetch complete (47042 records). [2025-10-13T18:27:25.972361] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-13T18:27:26.023185] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-13T18:27:26.365914] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-13T18:27:26.366015] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-13T18:27:26.366835] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-13T18:27:26.366908] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-13T18:27:26.368209] [DEBUG] [LOCAL ] DLB: Trimmed 47042 records to 32122 (keeping 200 days of data) [2025-10-13T18:27:26.572052] [DEBUG] [LOCAL ] DLB: Primary data saved (32122 records). [2025-10-13T18:27:26.572193] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-13T18:27:26.572269] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 32.7s. Estimated remaining: 4h 1m 29s. Rate: 7.2 symbols/min [2025-10-13T18:27:26.752420] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:26.774731] [DEBUG] [LOCAL ] DLY: Loaded 20638 existing records from primary storage. [2025-10-13T18:27:26.775057] [INFO ] [MAIN ] DLY: Loaded 20638 existing records. [2025-10-13T18:27:26.823095] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-13T18:27:26.978195] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:26.979386] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-13T18:27:26.979537] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-13T18:27:26.979966] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-13T18:27:26.980110] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-13T18:27:27.431551] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:27.447296] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T18:27:27.467908] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T18:27:27.617969] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-13T18:27:27.624920] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:27:28.417994] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-13T18:27:28.804919] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:27:29.217974] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-13T18:27:30.018015] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-13T18:27:30.150354] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:27:30.208192] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:27:30.539964] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:27:30.817995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-13T18:27:31.527902] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:27:31.530023] [INFO ] [REMOTE ] DLNG: Full fetch complete (11854 records). [2025-10-13T18:27:31.530185] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-13T18:27:31.623412] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-13T18:27:32.089363] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-13T18:27:32.089448] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-13T18:27:32.089736] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-13T18:27:32.089797] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-13T18:27:32.090364] [DEBUG] [LOCAL ] DLNG: Trimmed 11854 records to 6171 (keeping 200 days of data) [2025-10-13T18:27:32.129252] [DEBUG] [LOCAL ] DLNG: Primary data saved (6171 records). [2025-10-13T18:27:32.129598] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-13T18:27:32.129708] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLNG took 35.6s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-13T18:27:32.302232] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:32.308396] [DEBUG] [LOCAL ] DMA: Loaded 4760 existing records from primary storage. [2025-10-13T18:27:32.308544] [INFO ] [MAIN ] DMA: Loaded 4760 existing records. [2025-10-13T18:27:32.423053] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-13T18:27:32.498146] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:32.498482] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-13T18:27:32.498556] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-13T18:27:32.498871] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-13T18:27:32.498933] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-13T18:27:32.868722] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:33.218029] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-13T18:27:33.472442] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T18:27:33.497743] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:27:34.018013] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-13T18:27:34.240795] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T18:27:34.691871] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:27:34.817977] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-13T18:27:35.617948] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-13T18:27:35.814130] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:27:36.417956] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-13T18:27:37.217896] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-13T18:27:37.290136] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:27:37.295220] [INFO ] [REMOTE ] DLR: Full fetch complete (73970 records). [2025-10-13T18:27:37.295400] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-13T18:27:37.689671] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-13T18:27:37.689836] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-13T18:27:37.690833] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-13T18:27:37.690944] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-13T18:27:37.704896] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:27:37.710166] [DEBUG] [LOCAL ] DLR: Trimmed 73970 records to 50768 (keeping 200 days of data) [2025-10-13T18:27:38.020121] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-13T18:27:38.037428] [DEBUG] [LOCAL ] DLR: Primary data saved (50768 records). [2025-10-13T18:27:38.037556] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-13T18:27:38.038243] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLR took 37.0s. Estimated remaining: 4h 0m 58s. Rate: 7.2 symbols/min [2025-10-13T18:27:38.232267] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:38.244726] [DEBUG] [LOCAL ] DMB: Loaded 10356 existing records from primary storage. [2025-10-13T18:27:38.244961] [INFO ] [MAIN ] DMB: Loaded 10356 existing records. [2025-10-13T18:27:38.424611] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:38.424851] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-13T18:27:38.424920] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-13T18:27:38.425261] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-13T18:27:38.425366] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-13T18:27:38.585526] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:27:38.819020] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-13T18:27:38.900138] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:38.941067] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T18:27:39.360785] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T18:27:39.617967] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-13T18:27:40.417911] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-13T18:27:40.549337] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:27:41.217912] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-13T18:27:41.390131] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:27:41.868672] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:27:42.017950] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-13T18:27:42.817981] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-13T18:27:43.055481] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T18:27:43.443687] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:27:43.617919] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-13T18:27:44.197487] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:27:44.417953] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-13T18:27:45.221107] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-13T18:27:45.530938] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T18:27:46.017923] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-13T18:27:46.502027] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:27:46.817926] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-13T18:27:47.049088] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T18:27:47.617908] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-13T18:27:48.124806] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T18:27:48.417922] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-13T18:27:48.933259] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:27:49.217999] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-13T18:27:49.408339] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T18:27:49.702196] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:27:50.017970] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-13T18:27:50.817916] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-13T18:27:50.953519] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T18:27:51.617995] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-13T18:27:51.723200] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T18:27:51.726012] [INFO ] [REMOTE ] DLX: Full fetch complete (41196 records). [2025-10-13T18:27:51.726097] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-13T18:27:52.126836] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-13T18:27:52.127183] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-13T18:27:52.128467] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-13T18:27:52.128578] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-13T18:27:52.130349] [DEBUG] [LOCAL ] DLX: Trimmed 41196 records to 28464 (keeping 200 days of data) [2025-10-13T18:27:52.233041] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:27:52.327236] [DEBUG] [LOCAL ] DLX: Primary data saved (28464 records). [2025-10-13T18:27:52.327446] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-13T18:27:52.327541] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 38.3s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-13T18:27:52.423234] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-13T18:27:52.507374] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:52.519844] [DEBUG] [LOCAL ] DMO: Loaded 10068 existing records from primary storage. [2025-10-13T18:27:52.520130] [INFO ] [MAIN ] DMO: Loaded 10068 existing records. [2025-10-13T18:27:52.702212] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:52.702496] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-13T18:27:52.702548] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-13T18:27:52.702837] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-13T18:27:52.702896] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-13T18:27:53.075944] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:53.217971] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-13T18:27:53.705849] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:27:53.711084] [INFO ] [REMOTE ] DLY: Full fetch complete (28280 records). [2025-10-13T18:27:53.711215] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-13T18:27:53.835198] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T18:27:54.023100] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-13T18:27:54.127515] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-13T18:27:54.127610] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-13T18:27:54.128411] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-13T18:27:54.128476] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-13T18:27:54.130190] [DEBUG] [LOCAL ] DLY: Trimmed 28280 records to 20376 (keeping 200 days of data) [2025-10-13T18:27:54.255578] [DEBUG] [LOCAL ] DLY: Primary data saved (20376 records). [2025-10-13T18:27:54.255738] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-13T18:27:54.255828] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 27.7s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-13T18:27:54.428905] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:54.475621] [DEBUG] [LOCAL ] DNA: Loaded 49242 existing records from primary storage. [2025-10-13T18:27:54.475946] [INFO ] [MAIN ] DNA: Loaded 49242 existing records. [2025-10-13T18:27:54.653291] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:54.653507] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-13T18:27:54.653557] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-13T18:27:54.654058] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-13T18:27:54.654117] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-13T18:27:54.828535] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-13T18:27:54.960091] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:27:55.026199] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:55.523157] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T18:27:55.617952] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-13T18:27:56.417981] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-13T18:27:57.202576] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:27:57.217889] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-13T18:27:57.421679] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:27:57.684103] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T18:27:58.017925] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-13T18:27:58.764438] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:27:58.817878] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-13T18:27:59.617953] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-13T18:27:59.629012] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:28:00.251412] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T18:28:00.418006] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-13T18:28:01.217978] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-13T18:28:01.680593] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T18:28:02.017914] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-13T18:28:02.279443] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T18:28:02.817959] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-13T18:28:02.828474] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:28:03.333458] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:28:03.618005] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-13T18:28:04.383387] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T18:28:04.417889] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-13T18:28:05.217910] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-13T18:28:05.287012] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T18:28:06.018019] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-13T18:28:06.823041] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-13T18:28:06.829258] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:28:07.180400] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T18:28:07.596156] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:28:07.597613] [INFO ] [REMOTE ] DMB: Full fetch complete (14762 records). [2025-10-13T18:28:07.597713] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-13T18:28:07.623047] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-13T18:28:07.988923] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-13T18:28:07.989006] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-13T18:28:07.989328] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-13T18:28:07.989367] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-13T18:28:07.989872] [DEBUG] [LOCAL ] DMB: Trimmed 14762 records to 10219 (keeping 200 days of data) [2025-10-13T18:28:08.050769] [DEBUG] [LOCAL ] DMB: Primary data saved (10219 records). [2025-10-13T18:28:08.050904] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-13T18:28:08.050982] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 30.0s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-13T18:28:08.229173] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:08.274148] [DEBUG] [LOCAL ] DNOW: Loaded 44295 existing records from primary storage. [2025-10-13T18:28:08.274478] [INFO ] [MAIN ] DNOW: Loaded 44295 existing records. [2025-10-13T18:28:08.396167] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:28:08.423093] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-13T18:28:08.482599] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:08.483041] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-13T18:28:08.483139] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-13T18:28:08.483875] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-13T18:28:08.483932] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-13T18:28:08.842261] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:09.217917] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-13T18:28:09.243753] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T18:28:10.017968] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-13T18:28:10.641531] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:28:10.817956] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-13T18:28:11.066522] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:28:11.617923] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-13T18:28:11.647529] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T18:28:12.214901] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T18:28:12.417975] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-13T18:28:13.217968] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-13T18:28:13.992704] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:28:14.017904] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-13T18:28:14.065322] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:28:14.777859] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T18:28:14.817959] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-13T18:28:15.617962] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-13T18:28:16.372450] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:28:16.417908] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-13T18:28:16.577723] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T18:28:16.578874] [INFO ] [REMOTE ] DMA: Full fetch complete (6769 records). [2025-10-13T18:28:16.578942] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-13T18:28:16.949985] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-13T18:28:16.950081] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-13T18:28:16.950338] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-13T18:28:16.950380] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-13T18:28:16.950849] [DEBUG] [LOCAL ] DMA: Trimmed 6769 records to 4704 (keeping 200 days of data) [2025-10-13T18:28:16.981528] [DEBUG] [LOCAL ] DMA: Primary data saved (4704 records). [2025-10-13T18:28:16.981754] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-13T18:28:16.981869] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMA took 44.9s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-13T18:28:17.154325] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:17.185570] [DEBUG] [LOCAL ] DNP: Loaded 33717 existing records from primary storage. [2025-10-13T18:28:17.185896] [INFO ] [MAIN ] DNP: Loaded 33717 existing records. [2025-10-13T18:28:17.228201] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-13T18:28:17.365559] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:17.365822] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-13T18:28:17.365870] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-13T18:28:17.366124] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-13T18:28:17.366182] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-13T18:28:17.722916] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:18.017903] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-13T18:28:18.159938] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:28:18.230892] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:28:18.232409] [INFO ] [REMOTE ] DMO: Full fetch complete (14532 records). [2025-10-13T18:28:18.232478] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-13T18:28:18.608158] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-13T18:28:18.608240] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-13T18:28:18.608611] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-13T18:28:18.608698] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-13T18:28:18.609203] [DEBUG] [LOCAL ] DMO: Trimmed 14532 records to 9990 (keeping 200 days of data) [2025-10-13T18:28:18.669281] [DEBUG] [LOCAL ] DMO: Primary data saved (9990 records). [2025-10-13T18:28:18.669405] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-13T18:28:18.669484] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DMO took 26.3s. Estimated remaining: 4h 0m 14s. Rate: 7.2 symbols/min [2025-10-13T18:28:18.817927] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-13T18:28:19.466131] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:28:19.618029] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-13T18:28:20.210953] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:28:20.418011] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-13T18:28:21.148741] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:28:21.217956] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-13T18:28:22.018075] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-13T18:28:22.241789] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:28:22.551110] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:28:22.817922] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-13T18:28:23.396470] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:28:23.617957] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-13T18:28:24.312751] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:28:24.418076] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-13T18:28:25.217959] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-13T18:28:25.701146] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:28:25.817838] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-13T18:28:26.017957] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-13T18:28:26.632771] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:28:26.817900] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-13T18:28:27.421440] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:28:27.617915] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-13T18:28:28.007673] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:28:28.417979] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-13T18:28:29.146952] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:28:29.217925] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-13T18:28:30.017904] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-13T18:28:30.287521] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:28:30.724739] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T18:28:30.818027] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-13T18:28:31.448460] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:28:31.618049] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-13T18:28:32.417967] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-13T18:28:32.571930] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:28:33.150242] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:28:33.217967] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-13T18:28:33.550153] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:28:34.017969] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-13T18:28:34.817976] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-13T18:28:35.222079] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T18:28:35.228245] [INFO ] [REMOTE ] DNA: Full fetch complete (71056 records). [2025-10-13T18:28:35.228425] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-13T18:28:35.594573] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:28:35.632630] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-13T18:28:35.713038] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-13T18:28:35.713156] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-13T18:28:35.714230] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-13T18:28:35.714300] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-13T18:28:35.715882] [DEBUG] [LOCAL ] DNA: Trimmed 71056 records to 48522 (keeping 200 days of data) [2025-10-13T18:28:35.998744] [DEBUG] [LOCAL ] DNA: Primary data saved (48522 records). [2025-10-13T18:28:35.998876] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-13T18:28:35.999025] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 41.7s. Estimated remaining: 4h 0m 30s. Rate: 7.2 symbols/min [2025-10-13T18:28:36.215708] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T18:28:36.417984] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-13T18:28:36.792543] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T18:28:37.217958] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-13T18:28:37.665490] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:28:37.670109] [INFO ] [REMOTE ] DNOW: Full fetch complete (62878 records). [2025-10-13T18:28:37.670214] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-13T18:28:38.104553] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-13T18:28:38.104677] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-13T18:28:38.105594] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-13T18:28:38.105741] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-13T18:28:38.107368] [DEBUG] [LOCAL ] DNOW: Trimmed 62878 records to 43595 (keeping 200 days of data) [2025-10-13T18:28:38.391829] [DEBUG] [LOCAL ] DNOW: Primary data saved (43595 records). [2025-10-13T18:28:38.392069] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-13T18:28:38.392943] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNOW took 30.3s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-13T18:28:38.429507] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T18:28:38.437098] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-13T18:28:39.667982] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:28:39.671766] [INFO ] [REMOTE ] DNP: Full fetch complete (48573 records). [2025-10-13T18:28:39.671940] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-13T18:28:39.672628] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:28:39.672856] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:28:39.672900] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:28:39.672941] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-13T18:28:39.673078] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-13T18:28:39.673130] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-10-13T18:28:39.673372] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-10-13T18:28:39.673514] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DNP took 22.7s. Estimated remaining: 3h 59m 39s. Rate: 7.2 symbols/min [2025-10-13T18:28:40.264292] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.374910] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.463209] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.465572] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.468102] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-13T18:28:40.468302] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-13T18:28:40.470247] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-13T18:28:40.470331] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-13T18:28:40.470389] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-13T18:28:40.470434] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-13T18:28:40.754615] [DEBUG] [LOCAL ] DOC: Loaded 54327 existing records from primary storage. [2025-10-13T18:28:40.805858] [INFO ] [MAIN ] DOC: Loaded 54327 existing records. [2025-10-13T18:28:40.915294] [DEBUG] [LOCAL ] DOLE: Loaded 39510 existing records from primary storage. [2025-10-13T18:28:40.953829] [DEBUG] [LOCAL ] DOCN: Loaded 51555 existing records from primary storage. [2025-10-13T18:28:40.954066] [INFO ] [MAIN ] DOLE: Loaded 39510 existing records. [2025-10-13T18:28:41.011145] [INFO ] [MAIN ] DOCN: Loaded 51555 existing records. [2025-10-13T18:28:41.102142] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:41.162532] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-13T18:28:41.365440] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.400337] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.435597] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-13T18:28:41.456022] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.456819] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.462305] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-13T18:28:41.483174] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-13T18:28:41.503774] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-13T18:28:41.554931] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.513140] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-13T18:28:41.555198] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-13T18:28:41.622390] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.654908] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-13T18:28:41.683338] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-13T18:28:41.701207] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-13T18:28:42.594970] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.645804] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-13T18:28:42.640252] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.677111] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-13T18:28:42.708200] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.708764] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-13T18:28:42.908763] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:28:42.919182] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-13T18:28:44.127178] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:28:44.136911] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-13T18:28:44.138269] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:28:44.146610] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-13T18:28:44.509052] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:28:44.519841] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-13T18:28:44.554919] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T18:28:45.217908] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-13T18:28:45.546410] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T18:28:45.712998] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:28:45.987077] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:28:46.017883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-13T18:28:46.817997] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-13T18:28:46.894241] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:28:47.617907] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-13T18:28:47.843777] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T18:28:48.417912] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-13T18:28:48.533347] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:28:49.033234] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:28:49.217900] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-13T18:28:49.701014] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:28:50.017911] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-13T18:28:50.817909] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-13T18:28:50.993274] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:28:51.209591] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:28:51.617927] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-13T18:28:52.417906] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-13T18:28:52.678225] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:28:53.071628] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:28:53.217976] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-13T18:28:54.017954] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-13T18:28:54.436981] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T18:28:54.817448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:28:54.825889] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-13T18:28:55.617897] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-13T18:28:55.746725] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:28:56.053795] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T18:28:56.417921] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-13T18:28:57.217893] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-13T18:28:57.529969] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:28:57.588736] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T18:28:58.018008] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-13T18:28:58.817903] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-13T18:28:58.983002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:28:59.617899] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-13T18:28:59.663968] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:29:00.316113] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T18:29:00.417893] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-13T18:29:01.218008] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-13T18:29:01.371056] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:29:01.926110] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:29:02.017924] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-13T18:29:02.471801] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:29:02.817987] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-13T18:29:03.617905] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-13T18:29:03.920780] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:29:04.366587] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:29:04.417883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-13T18:29:04.673899] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:29:05.217955] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-13T18:29:05.963172] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:29:06.017909] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-13T18:29:06.627254] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:29:06.817962] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-13T18:29:07.617966] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-13T18:29:07.870477] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:29:07.875553] [INFO ] [REMOTE ] DOCS: Full fetch complete (74037 records). [2025-10-13T18:29:07.875697] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-13T18:29:08.277593] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-13T18:29:08.277723] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-13T18:29:08.278633] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-13T18:29:08.278716] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-13T18:29:08.280444] [DEBUG] [LOCAL ] DOCS: Trimmed 74037 records to 50877 (keeping 200 days of data) [2025-10-13T18:29:08.450467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-13T18:29:08.585686] [DEBUG] [LOCAL ] DOCS: Primary data saved (50877 records). [2025-10-13T18:29:08.585836] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-13T18:29:08.585923] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOCS took 28.9s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-13T18:29:08.765326] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:08.803042] [DEBUG] [LOCAL ] DOUG: Loaded 34887 existing records from primary storage. [2025-10-13T18:29:08.803337] [INFO ] [MAIN ] DOUG: Loaded 34887 existing records. [2025-10-13T18:29:09.019345] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T18:29:09.029158] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:09.029424] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-13T18:29:09.029473] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-13T18:29:09.036491] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-13T18:29:09.037336] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-13T18:29:09.195503] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:29:09.223229] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-13T18:29:09.437048] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:10.017899] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-13T18:29:10.540127] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T18:29:10.817905] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-13T18:29:10.987044] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:29:10.992443] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-10-13T18:29:10.992581] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-13T18:29:11.390917] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-13T18:29:11.391100] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-13T18:29:11.392265] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-13T18:29:11.392367] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-13T18:29:11.394032] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 53550 (keeping 200 days of data) [2025-10-13T18:29:11.524630] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:29:11.620418] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-13T18:29:11.767331] [DEBUG] [LOCAL ] DOC: Primary data saved (53550 records). [2025-10-13T18:29:11.767494] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-13T18:29:11.767585] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOC took 32.1s. Estimated remaining: 4h 0m 4s. Rate: 7.2 symbols/min [2025-10-13T18:29:11.934131] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:11.981212] [DEBUG] [LOCAL ] DOV: Loaded 46220 existing records from primary storage. [2025-10-13T18:29:11.981590] [INFO ] [MAIN ] DOV: Loaded 46220 existing records. [2025-10-13T18:29:12.157110] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:12.157328] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-13T18:29:12.157384] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-13T18:29:12.157873] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-13T18:29:12.157941] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-13T18:29:12.424604] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-13T18:29:12.512720] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:12.723030] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:29:13.218004] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-13T18:29:13.299733] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:29:13.664736] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T18:29:13.669969] [INFO ] [REMOTE ] DOLE: Full fetch complete (54510 records). [2025-10-13T18:29:13.670090] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-13T18:29:14.031223] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-13T18:29:14.050150] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-13T18:29:14.050235] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-13T18:29:14.050941] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-13T18:29:14.051004] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-13T18:29:14.052288] [DEBUG] [LOCAL ] DOLE: Trimmed 54510 records to 39143 (keeping 200 days of data) [2025-10-13T18:29:14.291625] [DEBUG] [LOCAL ] DOLE: Primary data saved (39143 records). [2025-10-13T18:29:14.291849] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-13T18:29:14.291980] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOLE took 34.5s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-10-13T18:29:14.468111] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:14.520891] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-13T18:29:14.521238] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-10-13T18:29:14.702929] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:14.703148] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-13T18:29:14.703195] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-13T18:29:14.703794] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-13T18:29:14.703852] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-13T18:29:14.822119] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-13T18:29:15.069678] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:15.106879] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:29:15.617993] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-13T18:29:15.813288] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:29:16.313336] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:29:16.418004] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-13T18:29:17.218069] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-13T18:29:17.679066] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T18:29:17.832507] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:29:18.017999] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-13T18:29:18.145366] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:29:18.818036] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-13T18:29:19.623016] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-13T18:29:19.637107] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:29:20.224056] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:29:20.417982] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-13T18:29:21.217923] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-13T18:29:21.413632] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:29:21.418925] [INFO ] [REMOTE ] DOCN: Full fetch complete (72222 records). [2025-10-13T18:29:21.419036] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-13T18:29:21.830066] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-13T18:29:21.830154] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-13T18:29:21.830972] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-13T18:29:21.831035] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-13T18:29:21.832421] [DEBUG] [LOCAL ] DOCN: Trimmed 72222 records to 50954 (keeping 200 days of data) [2025-10-13T18:29:22.034413] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-13T18:29:22.155525] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:29:22.181128] [DEBUG] [LOCAL ] DOCN: Primary data saved (50954 records). [2025-10-13T18:29:22.181328] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-13T18:29:22.181469] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 42.5s. Estimated remaining: 3h 59m 30s. Rate: 7.2 symbols/min [2025-10-13T18:29:22.380037] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:22.396863] [DEBUG] [LOCAL ] DPG: Loaded 13769 existing records from primary storage. [2025-10-13T18:29:22.397222] [INFO ] [MAIN ] DPG: Loaded 13769 existing records. [2025-10-13T18:29:22.599972] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:22.600446] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-13T18:29:22.600682] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-13T18:29:22.601168] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-13T18:29:22.601258] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-13T18:29:22.744304] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:29:22.821703] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-13T18:29:23.048338] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:23.467452] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:29:23.618008] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-13T18:29:24.417974] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-13T18:29:24.612989] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:29:24.658154] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T18:29:25.218010] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-13T18:29:25.856901] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:29:26.017965] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-13T18:29:26.817914] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-13T18:29:26.830660] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:29:27.014989] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:29:27.617909] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-13T18:29:27.825283] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T18:29:28.417982] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-13T18:29:29.093408] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T18:29:29.218005] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-13T18:29:29.464546] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:29:30.017950] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-13T18:29:30.332885] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T18:29:30.817900] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-13T18:29:30.892951] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T18:29:31.617974] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-13T18:29:31.993583] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T18:29:32.417962] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-13T18:29:33.218370] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-13T18:29:33.691455] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T18:29:33.925457] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T18:29:34.017919] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-13T18:29:34.081313] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T18:29:34.817919] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-13T18:29:35.617926] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-13T18:29:36.046497] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T18:29:36.098095] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:29:36.101448] [INFO ] [REMOTE ] DOUG: Full fetch complete (50623 records). [2025-10-13T18:29:36.101537] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-13T18:29:36.430074] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-13T18:29:36.487029] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-13T18:29:36.487155] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-13T18:29:36.487861] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-13T18:29:36.487927] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-13T18:29:36.489408] [DEBUG] [LOCAL ] DOUG: Trimmed 50623 records to 34290 (keeping 200 days of data) [2025-10-13T18:29:36.684512] [DEBUG] [LOCAL ] DOUG: Primary data saved (34290 records). [2025-10-13T18:29:36.684668] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-13T18:29:36.685470] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOUG took 28.1s. Estimated remaining: 3h 59m 39s. Rate: 7.2 symbols/min [2025-10-13T18:29:36.861744] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:36.861893] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-13T18:29:36.861932] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-13T18:29:36.862128] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-13T18:29:36.862182] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-13T18:29:36.862242] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-13T18:29:36.862307] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-13T18:29:37.228002] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:37.223503] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-13T18:29:37.267123] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:29:37.554565] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T18:29:38.017944] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-13T18:29:38.817976] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-13T18:29:39.108893] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T18:29:39.391919] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T18:29:39.617887] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-13T18:29:39.715152] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:29:40.417925] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-13T18:29:41.063083] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:29:41.217900] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-13T18:29:41.886118] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:29:42.017920] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-13T18:29:42.659619] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T18:29:42.817924] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-13T18:29:43.540901] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T18:29:43.617912] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-13T18:29:43.806386] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T18:29:44.417951] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-13T18:29:44.914457] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T18:29:45.217927] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-13T18:29:46.017980] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-13T18:29:46.081747] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:29:46.443540] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:29:46.817899] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-13T18:29:46.967965] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T18:29:47.618017] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-13T18:29:47.978044] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:29:48.418021] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-13T18:29:48.896224] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T18:29:49.217961] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-13T18:29:49.465483] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:29:50.017966] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-13T18:29:50.707719] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T18:29:50.817922] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-13T18:29:51.617973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-13T18:29:52.421786] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-13T18:29:52.443267] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-13T18:29:52.582339] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:29:53.048894] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:29:53.051424] [INFO ] [REMOTE ] DPG: Full fetch complete (18965 records). [2025-10-13T18:29:53.051601] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-13T18:29:53.229163] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-13T18:29:53.314749] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:29:53.363896] [INFO ] [REMOTE ] DOV: Full fetch complete (65377 records). [2025-10-13T18:29:53.371060] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-13T18:29:53.665414] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-13T18:29:53.684765] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-13T18:29:53.687177] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-13T18:29:53.687270] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-13T18:29:53.756441] [DEBUG] [LOCAL ] DPG: Trimmed 18965 records to 13590 (keeping 200 days of data) [2025-10-13T18:29:53.986754] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-13T18:29:53.989486] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-13T18:29:53.990822] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-13T18:29:53.991200] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-13T18:29:54.012702] [DEBUG] [LOCAL ] DOV: Trimmed 65377 records to 45577 (keeping 200 days of data) [2025-10-13T18:29:54.014857] [DEBUG] [LOCAL ] DPG: Primary data saved (13590 records). [2025-10-13T18:29:54.015512] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-13T18:29:54.015918] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 31.8s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-13T18:29:54.090985] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-13T18:29:54.306203] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:54.469938] [DEBUG] [LOCAL ] DRD: Loaded 37897 existing records from primary storage. [2025-10-13T18:29:54.472933] [INFO ] [MAIN ] DRD: Loaded 37897 existing records. [2025-10-13T18:29:54.689584] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:54.693824] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-13T18:29:54.694572] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-13T18:29:54.696839] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-13T18:29:54.697607] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-13T18:29:54.706436] [DEBUG] [LOCAL ] DOV: Primary data saved (45577 records). [2025-10-13T18:29:54.738086] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-13T18:29:54.774861] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOV took 43.0s. Estimated remaining: 3h 59m 26s. Rate: 7.2 symbols/min [2025-10-13T18:29:55.185871] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:55.240413] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-13T18:29:55.272340] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:55.272425] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-13T18:29:55.273172] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-13T18:29:55.274431] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-13T18:29:55.274609] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-13T18:29:55.274812] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-13T18:29:55.274887] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-13T18:29:55.354579] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T18:29:55.623090] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-13T18:29:55.683186] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:56.364402] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T18:29:56.417892] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-13T18:29:56.665133] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:29:57.217894] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-13T18:29:57.479331] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:29:58.017968] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-13T18:29:58.374630] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:29:58.498060] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:29:58.817963] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-13T18:29:59.617992] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-13T18:29:59.804773] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:29:59.809838] [INFO ] [REMOTE ] DQ: Full fetch complete (63430 records). [2025-10-13T18:29:59.809976] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-13T18:30:00.199192] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-13T18:30:00.199277] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-13T18:30:00.200068] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-13T18:30:00.200133] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-13T18:30:00.201408] [DEBUG] [LOCAL ] DQ: Trimmed 63430 records to 43622 (keeping 200 days of data) [2025-10-13T18:30:00.419197] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-13T18:30:00.460111] [DEBUG] [LOCAL ] DQ: Primary data saved (43622 records). [2025-10-13T18:30:00.460225] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-13T18:30:00.460295] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 23.8s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-13T18:30:00.629165] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:00.675553] [DEBUG] [LOCAL ] DRI: Loaded 48366 existing records from primary storage. [2025-10-13T18:30:00.675896] [INFO ] [MAIN ] DRI: Loaded 48366 existing records. [2025-10-13T18:30:00.860203] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:00.860513] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-13T18:30:00.860584] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-13T18:30:00.873736] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-13T18:30:00.874350] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-13T18:30:00.874853] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T18:30:00.944793] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-13T18:30:00.962107] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-13T18:30:01.524472] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T18:30:01.589886] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:01.614193] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-13T18:30:01.769269] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-13T18:30:01.769365] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-13T18:30:01.770238] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-13T18:30:01.770314] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-13T18:30:01.772165] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-13T18:30:02.019031] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-13T18:30:02.114472] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-13T18:30:02.114668] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-13T18:30:02.115020] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DOW took 47.8s. Estimated remaining: 3h 58m 44s. Rate: 7.2 symbols/min [2025-10-13T18:30:02.289764] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:02.331964] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T18:30:02.347839] [DEBUG] [LOCAL ] DRLL: Loaded 9406 existing records from primary storage. [2025-10-13T18:30:02.348155] [INFO ] [MAIN ] DRLL: Loaded 9406 existing records. [2025-10-13T18:30:02.525239] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:02.525544] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-13T18:30:02.525592] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-13T18:30:02.525809] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-13T18:30:02.525865] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-13T18:30:02.823270] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-13T18:30:02.902250] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:03.617972] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-13T18:30:03.665691] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:30:03.891368] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T18:30:04.271888] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:30:04.418018] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-13T18:30:04.538450] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T18:30:05.217921] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-13T18:30:06.017993] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-13T18:30:06.116373] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:30:06.295736] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:30:06.817951] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-13T18:30:07.352296] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T18:30:07.618210] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-13T18:30:08.419935] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-13T18:30:08.422823] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:30:08.470169] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:30:09.218129] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-13T18:30:09.926527] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:30:10.017916] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-13T18:30:10.776921] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T18:30:10.818004] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-13T18:30:11.617916] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-13T18:30:11.756011] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:30:11.790560] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:30:12.417971] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-13T18:30:12.947154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:30:13.217969] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-13T18:30:13.969113] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:30:14.018013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-13T18:30:14.817911] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-13T18:30:15.021245] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:30:15.617924] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-13T18:30:15.757189] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:30:16.417952] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-13T18:30:17.012668] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T18:30:17.048911] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-13T18:30:17.217966] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-13T18:30:17.246483] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T18:30:18.018042] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-13T18:30:18.532954] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T18:30:18.818023] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-13T18:30:19.532139] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T18:30:19.617952] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-13T18:30:19.768001] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:30:20.413162] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:30:20.417871] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-13T18:30:21.014639] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:30:21.217963] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-13T18:30:22.017956] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-13T18:30:22.817990] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-13T18:30:22.991100] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:30:23.441718] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:30:23.564282] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:30:23.617887] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-13T18:30:24.313065] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T18:30:24.417990] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-13T18:30:25.218034] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-13T18:30:25.877243] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:30:25.879112] [INFO ] [REMOTE ] DRLL: Full fetch complete (14822 records). [2025-10-13T18:30:25.879210] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-13T18:30:25.880516] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:25.880886] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:25.880958] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:25.881035] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-13T18:30:25.881119] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-13T18:30:25.881159] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-13T18:30:25.881638] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-13T18:30:25.881847] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRLL took 23.8s. Estimated remaining: 3h 59m 17s. Rate: 7.2 symbols/min [2025-10-13T18:30:26.023165] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-13T18:30:26.106154] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:26.153193] [DEBUG] [LOCAL ] DSL: Loaded 29051 existing records from primary storage. [2025-10-13T18:30:26.153956] [INFO ] [MAIN ] DSL: Loaded 29051 existing records. [2025-10-13T18:30:26.432189] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:26.432884] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-13T18:30:26.453137] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-13T18:30:26.468482] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-13T18:30:26.468692] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-13T18:30:26.625191] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T18:30:26.827972] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-13T18:30:26.992822] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:27.529035] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:30:27.618035] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-13T18:30:28.417916] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-13T18:30:28.670460] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T18:30:29.146793] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:30:29.217890] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-13T18:30:30.017908] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-13T18:30:30.212426] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:30:30.817926] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-13T18:30:30.941224] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T18:30:31.571292] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:30:31.617899] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-13T18:30:32.148551] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:30:32.417929] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-13T18:30:33.217892] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-13T18:30:33.292229] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:30:33.297376] [INFO ] [REMOTE ] DRD: Full fetch complete (50863 records). [2025-10-13T18:30:33.297537] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-13T18:30:33.711859] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-13T18:30:33.712228] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-13T18:30:33.713509] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-13T18:30:33.713610] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-13T18:30:33.714706] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:30:33.725477] [DEBUG] [LOCAL ] DRD: Trimmed 50863 records to 37620 (keeping 200 days of data) [2025-10-13T18:30:33.951613] [DEBUG] [LOCAL ] DRD: Primary data saved (37620 records). [2025-10-13T18:30:33.951772] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-13T18:30:33.951859] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRD took 39.9s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-13T18:30:34.023620] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-13T18:30:34.076209] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:30:34.126500] [INFO ] [REMOTE ] DRI: Full fetch complete (69018 records). [2025-10-13T18:30:34.144745] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-13T18:30:34.144639] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:34.145821] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:34.146161] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:34.146231] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:34.146301] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-13T18:30:34.146367] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-13T18:30:34.146512] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-13T18:30:34.146735] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-13T18:30:34.146830] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 33.7s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-13T18:30:34.326769] [DEBUG] [LOCAL ] DSM: Loaded 14743 existing records from primary storage. [2025-10-13T18:30:34.329727] [INFO ] [MAIN ] DSM: Loaded 14743 existing records. [2025-10-13T18:30:34.329441] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:34.474353] [DEBUG] [LOCAL ] DSMC: Loaded 1870 existing records from primary storage. [2025-10-13T18:30:34.486780] [INFO ] [MAIN ] DSMC: Loaded 1870 existing records. [2025-10-13T18:30:34.557280] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:34.579954] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-13T18:30:34.608220] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-13T18:30:34.619865] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-13T18:30:34.635464] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-13T18:30:34.821007] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-13T18:30:34.826623] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:34.842465] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-13T18:30:34.865495] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-13T18:30:34.892550] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-13T18:30:34.919472] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-13T18:30:35.265860] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:35.462504] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:35.563932] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:30:35.568727] [INFO ] [REMOTE ] DRH: Full fetch complete (71535 records). [2025-10-13T18:30:35.568854] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-13T18:30:35.569618] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:35.569757] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:35.569828] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:35.569918] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-13T18:30:35.570022] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-13T18:30:35.570100] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-13T18:30:35.570189] [DEBUG] [LOCAL ] DRH: No derivative data file found to delete. [2025-10-13T18:30:35.570297] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DRH took 40.8s. Estimated remaining: 3h 58m 11s. Rate: 7.2 symbols/min [2025-10-13T18:30:35.625673] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-13T18:30:35.747473] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:35.769394] [DEBUG] [LOCAL ] DSU: Loaded 23217 existing records from primary storage. [2025-10-13T18:30:35.769668] [INFO ] [MAIN ] DSU: Loaded 23217 existing records. [2025-10-13T18:30:35.954512] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:35.954878] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-13T18:30:35.954954] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-13T18:30:35.955283] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-13T18:30:35.955344] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-13T18:30:36.249568] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:30:36.269340] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T18:30:36.343342] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:36.417887] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-13T18:30:37.217987] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-13T18:30:37.503674] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:30:38.017964] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-13T18:30:38.430795] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T18:30:38.817973] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-13T18:30:39.198160] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T18:30:39.218843] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T18:30:39.617897] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-13T18:30:39.986323] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T18:30:40.417916] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-13T18:30:41.218050] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-13T18:30:41.582339] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T18:30:41.632210] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T18:30:42.017925] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-13T18:30:42.798231] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T18:30:42.817880] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-13T18:30:43.617904] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-13T18:30:43.936447] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T18:30:44.417969] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-13T18:30:44.574687] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:30:45.217985] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-13T18:30:45.685846] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:30:46.018017] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-13T18:30:46.064881] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:30:46.728308] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T18:30:46.817921] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-13T18:30:47.617915] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-13T18:30:47.934919] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T18:30:47.967602] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:30:48.417957] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-13T18:30:48.735973] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:30:49.217918] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-13T18:30:50.017966] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-13T18:30:50.509998] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:30:50.817927] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-13T18:30:51.195834] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:30:51.617998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-13T18:30:51.971615] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T18:30:52.417896] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-13T18:30:52.756341] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T18:30:52.840604] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T18:30:53.217930] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-13T18:30:53.654062] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:30:54.017951] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-13T18:30:54.394578] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T18:30:54.817920] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-13T18:30:55.617919] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-13T18:30:56.058279] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:30:56.418000] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-13T18:30:57.095108] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:30:57.217922] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-13T18:30:57.440467] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:30:58.017896] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-13T18:30:58.123053] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T18:30:58.817960] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-13T18:30:59.041613] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T18:30:59.616669] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:30:59.619840] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-13T18:31:00.417982] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-13T18:31:00.768359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T18:31:00.771756] [INFO ] [REMOTE ] DSL: Full fetch complete (41516 records). [2025-10-13T18:31:00.771834] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-13T18:31:01.147032] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-13T18:31:01.147113] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-13T18:31:01.147754] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-13T18:31:01.147815] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-13T18:31:01.148810] [DEBUG] [LOCAL ] DSL: Trimmed 41516 records to 28681 (keeping 200 days of data) [2025-10-13T18:31:01.235833] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-13T18:31:01.328040] [DEBUG] [LOCAL ] DSL: Primary data saved (28681 records). [2025-10-13T18:31:01.328203] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-13T18:31:01.328309] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 35.4s. Estimated remaining: 3h 58m 49s. Rate: 7.2 symbols/min [2025-10-13T18:31:01.506583] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:01.531110] [DEBUG] [LOCAL ] DSX: Loaded 24407 existing records from primary storage. [2025-10-13T18:31:01.531435] [INFO ] [MAIN ] DSX: Loaded 24407 existing records. [2025-10-13T18:31:01.682021] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:31:01.765871] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:01.766139] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-13T18:31:01.766188] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-13T18:31:01.766394] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-13T18:31:01.766450] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-13T18:31:02.023281] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-13T18:31:02.094783] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:31:02.096578] [INFO ] [REMOTE ] DSMC: Full fetch complete (2839 records). [2025-10-13T18:31:02.102429] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-13T18:31:02.279057] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:02.620844] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-13T18:31:02.620943] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-13T18:31:02.621066] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-13T18:31:02.621106] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-13T18:31:02.621532] [DEBUG] [LOCAL ] DSMC: Trimmed 2839 records to 1838 (keeping 200 days of data) [2025-10-13T18:31:02.633606] [DEBUG] [LOCAL ] DSMC: Primary data saved (1838 records). [2025-10-13T18:31:02.633764] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-13T18:31:02.633863] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 28.5s. Estimated remaining: 3h 58m 22s. Rate: 7.2 symbols/min [2025-10-13T18:31:02.811964] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:02.817965] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-13T18:31:02.878070] [DEBUG] [LOCAL ] DT: Loaded 53704 existing records from primary storage. [2025-10-13T18:31:02.878485] [INFO ] [MAIN ] DT: Loaded 53704 existing records. [2025-10-13T18:31:03.069518] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:03.069857] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-13T18:31:03.069909] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-13T18:31:03.070534] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-13T18:31:03.070595] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-13T18:31:03.303710] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:31:03.527052] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:03.617923] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-13T18:31:04.290056] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:31:04.417922] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-13T18:31:05.218158] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-13T18:31:05.221772] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:31:05.257120] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:31:06.017986] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-13T18:31:06.232287] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T18:31:06.817909] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-13T18:31:07.176208] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:31:07.617982] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-13T18:31:07.796694] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T18:31:08.418017] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-13T18:31:08.679678] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:31:09.218007] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-13T18:31:09.606100] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T18:31:09.609021] [INFO ] [REMOTE ] DSU: Full fetch complete (32920 records). [2025-10-13T18:31:09.609147] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-13T18:31:09.971634] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-13T18:31:09.971744] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-13T18:31:09.972288] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-13T18:31:09.972349] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-13T18:31:09.973116] [DEBUG] [LOCAL ] DSU: Trimmed 32920 records to 22953 (keeping 200 days of data) [2025-10-13T18:31:10.023983] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-13T18:31:10.121897] [DEBUG] [LOCAL ] DSU: Primary data saved (22953 records). [2025-10-13T18:31:10.122062] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-13T18:31:10.122204] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 34.6s. Estimated remaining: 3h 58m 12s. Rate: 7.2 symbols/min [2025-10-13T18:31:10.234394] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T18:31:10.308420] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:10.308591] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-13T18:31:10.308628] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-13T18:31:10.308761] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-13T18:31:10.308801] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-13T18:31:10.308840] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-13T18:31:10.308888] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-13T18:31:10.659292] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:10.817997] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-13T18:31:11.244759] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T18:31:11.608641] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T18:31:11.617869] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-13T18:31:12.182386] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:31:12.417970] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-13T18:31:13.217965] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-13T18:31:13.694893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:31:14.017990] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-13T18:31:14.817916] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-13T18:31:14.841394] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:31:14.863804] [INFO ] [REMOTE ] DSM: Full fetch complete (23921 records). [2025-10-13T18:31:14.883145] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-13T18:31:14.951408] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T18:31:15.287190] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-13T18:31:15.287295] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-13T18:31:15.288190] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-13T18:31:15.288259] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-13T18:31:15.289079] [DEBUG] [LOCAL ] DSM: Trimmed 23921 records to 14307 (keeping 200 days of data) [2025-10-13T18:31:15.378950] [DEBUG] [LOCAL ] DSM: Primary data saved (14307 records). [2025-10-13T18:31:15.379191] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-13T18:31:15.379324] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSM took 41.4s. Estimated remaining: 3h 57m 55s. Rate: 7.2 symbols/min [2025-10-13T18:31:15.560998] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:15.617128] [DEBUG] [LOCAL ] DTE: Loaded 48226 existing records from primary storage. [2025-10-13T18:31:15.617577] [INFO ] [MAIN ] DTE: Loaded 48226 existing records. [2025-10-13T18:31:15.623253] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-13T18:31:15.804190] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:15.804588] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-13T18:31:15.804661] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-13T18:31:15.805427] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-13T18:31:15.805486] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-13T18:31:16.204959] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:16.221965] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T18:31:16.417926] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-13T18:31:17.217905] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-13T18:31:17.643174] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-13T18:31:17.680350] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T18:31:18.017913] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-13T18:31:18.120627] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:31:18.800553] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:31:18.817911] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-13T18:31:19.618016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-13T18:31:20.095035] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:31:20.162451] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:31:20.418003] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-13T18:31:20.989530] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:31:21.217962] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-13T18:31:22.017962] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-13T18:31:22.336444] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:31:22.817984] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-13T18:31:23.617902] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-13T18:31:23.720568] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T18:31:24.046142] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T18:31:24.329898] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:31:24.417923] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-13T18:31:25.217920] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-13T18:31:26.017901] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-13T18:31:26.282592] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:31:26.817895] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-13T18:31:26.851416] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:31:27.254686] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:31:27.474937] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T18:31:27.617913] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-13T18:31:28.417916] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-13T18:31:29.217904] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-13T18:31:29.511207] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T18:31:29.553908] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T18:31:30.018022] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-13T18:31:30.817984] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-13T18:31:31.030044] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T18:31:31.408790] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T18:31:31.617914] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-13T18:31:31.728830] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:31:32.208758] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T18:31:32.417988] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-13T18:31:33.218006] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-13T18:31:33.952452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:31:34.017880] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-13T18:31:34.817913] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-13T18:31:35.010571] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:31:35.447429] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:31:35.492438] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:31:35.617888] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-13T18:31:36.417954] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-13T18:31:37.217897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-13T18:31:37.314067] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:31:37.711823] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T18:31:37.714575] [INFO ] [REMOTE ] DSX: Full fetch complete (35943 records). [2025-10-13T18:31:37.714670] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-13T18:31:37.890456] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:31:37.903708] [INFO ] [REMOTE ] DTB: Full fetch complete (6685 records). [2025-10-13T18:31:37.946902] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-13T18:31:37.973167] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:31:38.004521] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:31:38.004627] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:31:38.004980] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-13T18:31:38.015487] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-13T18:31:38.021762] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-13T18:31:38.022634] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-13T18:31:38.049159] [DEBUG] [LOCAL ] DTB: No derivative data file found to delete. [2025-10-13T18:31:38.067846] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 27.9s. Estimated remaining: 3h 58m 24s. Rate: 7.2 symbols/min [2025-10-13T18:31:38.127159] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-13T18:31:38.158606] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-13T18:31:38.159323] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-13T18:31:38.164927] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-13T18:31:38.202961] [DEBUG] [LOCAL ] DSX: Trimmed 35943 records to 24104 (keeping 200 days of data) [2025-10-13T18:31:38.349425] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:38.352147] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-13T18:31:38.352478] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-13T18:31:38.356367] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-13T18:31:38.356726] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-13T18:31:38.359670] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-13T18:31:38.362435] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-13T18:31:38.744522] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:38.758559] [DEBUG] [LOCAL ] DSX: Primary data saved (24104 records). [2025-10-13T18:31:38.758630] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-13T18:31:38.758746] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DSX took 37.4s. Estimated remaining: 3h 57m 56s. Rate: 7.2 symbols/min [2025-10-13T18:31:38.823021] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-13T18:31:38.924687] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:38.932051] [DEBUG] [LOCAL ] DTG: Loaded 5919 existing records from primary storage. [2025-10-13T18:31:38.932200] [INFO ] [MAIN ] DTG: Loaded 5919 existing records. [2025-10-13T18:31:39.103224] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:39.103449] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-13T18:31:39.103495] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-13T18:31:39.103699] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-13T18:31:39.103755] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-13T18:31:39.216288] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-13T18:31:39.462041] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:39.617880] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-13T18:31:39.662075] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:31:40.417900] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-13T18:31:40.450808] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:31:41.217959] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-13T18:31:41.926614] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:31:42.017888] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-13T18:31:42.817899] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-13T18:31:43.013584] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:31:43.277399] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T18:31:43.617955] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-13T18:31:43.670980] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:31:43.676864] [INFO ] [REMOTE ] DT: Full fetch complete (76662 records). [2025-10-13T18:31:43.677021] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-13T18:31:44.085972] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-13T18:31:44.086052] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-13T18:31:44.086918] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-13T18:31:44.086981] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-13T18:31:44.088732] [DEBUG] [LOCAL ] DT: Trimmed 76662 records to 52943 (keeping 200 days of data) [2025-10-13T18:31:44.197978] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:31:44.402396] [DEBUG] [LOCAL ] DT: Primary data saved (52943 records). [2025-10-13T18:31:44.402537] [INFO ] [MAIN ] DT: Full history saved. [2025-10-13T18:31:44.403483] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DT took 41.8s. Estimated remaining: 3h 57m 41s. Rate: 7.2 symbols/min [2025-10-13T18:31:44.423181] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-13T18:31:44.575092] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:44.575241] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-13T18:31:44.575277] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-13T18:31:44.575383] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-13T18:31:44.575423] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-13T18:31:44.575504] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-13T18:31:44.575557] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-13T18:31:44.927742] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:45.217923] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-13T18:31:45.914993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:31:46.017897] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-13T18:31:46.199131] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:31:46.658439] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:31:46.817920] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-13T18:31:47.451131] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:31:47.617917] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-13T18:31:48.162031] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T18:31:48.417926] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-13T18:31:48.974688] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:31:49.217973] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-13T18:31:49.407210] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:31:49.407533] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-13T18:31:49.407621] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:31:49.407715] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-13T18:31:49.407779] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:31:49.407866] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-13T18:31:49.407928] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-13T18:31:49.408027] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-13T18:31:49.408111] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-13T18:31:49.408204] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 5.0s. Estimated remaining: 3h 57m 24s. Rate: 7.2 symbols/min [2025-10-13T18:31:49.573737] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:49.573907] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-13T18:31:49.573944] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-13T18:31:49.574051] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-13T18:31:49.574090] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-13T18:31:49.574130] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-13T18:31:49.574161] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-13T18:31:49.923623] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:50.017886] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-13T18:31:50.817988] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-13T18:31:51.617901] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-13T18:31:51.724811] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:31:52.250161] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:31:52.417896] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-13T18:31:52.548119] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:31:52.793303] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T18:31:53.217963] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-13T18:31:54.017969] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-13T18:31:54.376878] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T18:31:54.796560] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:31:54.817896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-13T18:31:55.617923] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-13T18:31:56.147408] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T18:31:56.239776] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:31:56.244717] [INFO ] [REMOTE ] DTE: Full fetch complete (68804 records). [2025-10-13T18:31:56.244837] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-13T18:31:56.420349] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-13T18:31:56.661456] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-13T18:31:56.661596] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-13T18:31:56.662593] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-13T18:31:56.662682] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-13T18:31:56.664478] [DEBUG] [LOCAL ] DTE: Trimmed 68804 records to 47508 (keeping 200 days of data) [2025-10-13T18:31:56.964053] [DEBUG] [LOCAL ] DTE: Primary data saved (47508 records). [2025-10-13T18:31:56.964195] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-13T18:31:56.964291] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 41.6s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-13T18:31:57.129150] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:57.135859] [DEBUG] [LOCAL ] DTW: Loaded 4937 existing records from primary storage. [2025-10-13T18:31:57.136056] [INFO ] [MAIN ] DTW: Loaded 4937 existing records. [2025-10-13T18:31:57.225807] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-13T18:31:57.314982] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:57.315217] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-13T18:31:57.315264] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-13T18:31:57.315486] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-13T18:31:57.315543] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-13T18:31:57.661567] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:57.798158] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:31:58.017955] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-13T18:31:58.195947] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:31:58.796018] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:31:58.817897] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-13T18:31:59.617891] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-13T18:32:00.054787] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:32:00.425381] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-13T18:32:00.444049] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:32:01.079989] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T18:32:01.217890] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-13T18:32:01.934364] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:32:01.935627] [INFO ] [REMOTE ] DTG: Full fetch complete (8780 records). [2025-10-13T18:32:01.935766] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-13T18:32:02.023189] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-13T18:32:02.329549] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-13T18:32:02.329633] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-13T18:32:02.329883] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-13T18:32:02.329928] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-13T18:32:02.330323] [DEBUG] [LOCAL ] DTG: Trimmed 8780 records to 5799 (keeping 200 days of data) [2025-10-13T18:32:02.366604] [DEBUG] [LOCAL ] DTG: Primary data saved (5799 records). [2025-10-13T18:32:02.366755] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-13T18:32:02.366841] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTG took 23.6s. Estimated remaining: 3h 56m 58s. Rate: 7.2 symbols/min [2025-10-13T18:32:02.523169] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T18:32:02.558321] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:02.619407] [DEBUG] [LOCAL ] DUK: Loaded 54219 existing records from primary storage. [2025-10-13T18:32:02.619820] [INFO ] [MAIN ] DUK: Loaded 54219 existing records. [2025-10-13T18:32:02.823952] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-13T18:32:02.840325] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:02.841246] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-13T18:32:02.841314] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-13T18:32:02.841628] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-13T18:32:02.841720] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-13T18:32:03.200034] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:03.617930] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-13T18:32:04.417925] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-13T18:32:04.509889] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:32:04.968682] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:32:05.217915] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-13T18:32:05.575962] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T18:32:05.787412] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T18:32:06.017923] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-13T18:32:06.360690] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T18:32:06.817926] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-13T18:32:07.171983] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T18:32:07.617965] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-13T18:32:08.121702] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T18:32:08.417995] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-13T18:32:09.049258] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:32:09.217965] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-13T18:32:09.567385] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T18:32:10.017927] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-13T18:32:10.817899] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-13T18:32:11.316134] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T18:32:11.316889] [INFO ] [REMOTE ] DTF: Full fetch complete (1842 records). [2025-10-13T18:32:11.316956] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-13T18:32:11.317289] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:32:11.317372] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:32:11.317415] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:32:11.317477] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-13T18:32:11.317539] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-13T18:32:11.317574] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-13T18:32:11.317613] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-13T18:32:11.317691] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTF took 33.2s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-13T18:32:11.525361] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:11.525575] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-13T18:32:11.525625] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-13T18:32:11.525835] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-13T18:32:11.525930] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-13T18:32:11.526030] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-13T18:32:11.526071] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-13T18:32:11.618833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-13T18:32:11.700456] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:32:12.039249] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:12.295516] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T18:32:12.417963] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-13T18:32:13.218057] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-13T18:32:13.954468] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T18:32:14.024687] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-13T18:32:14.041168] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:32:14.629230] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T18:32:14.817990] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-13T18:32:15.617930] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-13T18:32:16.235492] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T18:32:16.417966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-13T18:32:16.720753] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:32:17.009818] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T18:32:17.217958] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-13T18:32:18.017955] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-13T18:32:18.550974] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:32:18.817965] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-13T18:32:18.978945] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T18:32:19.524354] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:32:19.617994] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-13T18:32:20.274346] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:32:20.417975] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-13T18:32:21.045321] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:32:21.217990] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-13T18:32:22.007203] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:32:22.017870] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-13T18:32:22.765031] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T18:32:22.817974] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-13T18:32:23.411825] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T18:32:23.618001] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-13T18:32:24.276603] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:32:24.277915] [INFO ] [REMOTE ] DTW: Full fetch complete (7272 records). [2025-10-13T18:32:24.278018] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-13T18:32:24.278504] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:32:24.278659] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:32:24.278718] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:32:24.278789] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-13T18:32:24.278897] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-13T18:32:24.278980] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-13T18:32:24.279381] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-13T18:32:24.279775] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 27.3s. Estimated remaining: 3h 56m 54s. Rate: 7.2 symbols/min [2025-10-13T18:32:24.423142] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-13T18:32:24.457203] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:24.509146] [DEBUG] [LOCAL ] DV: Loaded 52041 existing records from primary storage. [2025-10-13T18:32:24.509484] [INFO ] [MAIN ] DV: Loaded 52041 existing records. [2025-10-13T18:32:24.685263] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:24.685497] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-13T18:32:24.685544] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-13T18:32:24.686033] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-13T18:32:24.686090] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-13T18:32:25.040040] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:25.217921] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-13T18:32:25.948420] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T18:32:26.017924] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-13T18:32:26.197223] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:32:26.817925] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-13T18:32:27.335158] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:32:27.618020] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-13T18:32:28.048333] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:32:28.418001] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-13T18:32:28.965235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:32:29.217928] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-13T18:32:29.269924] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:32:30.017922] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-13T18:32:30.648296] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T18:32:30.817928] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-13T18:32:31.497691] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:32:31.617898] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-13T18:32:32.179953] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T18:32:32.417989] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-13T18:32:32.787078] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T18:32:33.136938] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T18:32:33.217889] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-13T18:32:33.886693] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:32:33.887740] [INFO ] [REMOTE ] DUKB: Full fetch complete (9312 records). [2025-10-13T18:32:33.887811] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-13T18:32:34.029415] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-13T18:32:34.267065] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-13T18:32:34.267148] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-13T18:32:34.267450] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-13T18:32:34.267490] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-13T18:32:34.267970] [DEBUG] [LOCAL ] DUKB: Trimmed 9312 records to 6319 (keeping 200 days of data) [2025-10-13T18:32:34.310050] [DEBUG] [LOCAL ] DUKB: Primary data saved (6319 records). [2025-10-13T18:32:34.310219] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-13T18:32:34.310321] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 23.0s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-13T18:32:34.485906] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:34.530709] [DEBUG] [LOCAL ] DVA: Loaded 41566 existing records from primary storage. [2025-10-13T18:32:34.531008] [INFO ] [MAIN ] DVA: Loaded 41566 existing records. [2025-10-13T18:32:34.707581] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:34.708140] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-13T18:32:34.709017] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-13T18:32:34.709584] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-13T18:32:34.709679] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-13T18:32:34.823134] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-13T18:32:35.060111] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:35.617896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-13T18:32:35.813438] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:32:36.417960] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-13T18:32:36.471477] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:32:36.745282] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T18:32:36.750295] [INFO ] [REMOTE ] DTM: Full fetch complete (64747 records). [2025-10-13T18:32:36.750412] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-13T18:32:37.127486] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-13T18:32:37.127567] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-13T18:32:37.128353] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-13T18:32:37.128414] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-13T18:32:37.129685] [DEBUG] [LOCAL ] DTM: Trimmed 64747 records to 43975 (keeping 200 days of data) [2025-10-13T18:32:37.222045] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-13T18:32:37.410355] [DEBUG] [LOCAL ] DTM: Primary data saved (43975 records). [2025-10-13T18:32:37.410492] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-13T18:32:37.410560] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DTM took 48.0s. Estimated remaining: 3h 56m 29s. Rate: 7.2 symbols/min [2025-10-13T18:32:37.577087] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:37.627690] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-13T18:32:37.628043] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-10-13T18:32:37.802095] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:37.802296] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-13T18:32:37.802343] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-13T18:32:37.802940] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-13T18:32:37.802996] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-13T18:32:38.021485] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-13T18:32:38.187434] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:38.319126] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:32:38.826612] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-13T18:32:38.832696] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:32:39.617903] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-13T18:32:39.704849] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:32:40.417971] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-13T18:32:41.217920] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-13T18:32:41.597020] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-13T18:32:41.872528] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-13T18:32:42.017968] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-13T18:32:42.292520] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:32:42.817904] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-13T18:32:43.035164] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T18:32:43.617963] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-13T18:32:43.825174] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:32:44.348482] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:32:44.417924] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-13T18:32:45.220250] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-13T18:32:45.435462] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:32:45.747771] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:32:45.753296] [INFO ] [REMOTE ] DUK: Full fetch complete (77390 records). [2025-10-13T18:32:45.753423] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-13T18:32:46.023164] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-13T18:32:46.136299] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-13T18:32:46.136379] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-13T18:32:46.137291] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-13T18:32:46.137355] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-13T18:32:46.138907] [DEBUG] [LOCAL ] DUK: Trimmed 77390 records to 53437 (keeping 200 days of data) [2025-10-13T18:32:46.467484] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-13T18:32:46.467625] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-13T18:32:46.467739] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DUK took 44.1s. Estimated remaining: 3h 56m 22s. Rate: 7.2 symbols/min [2025-10-13T18:32:46.637422] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:46.637792] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-13T18:32:46.637880] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-13T18:32:46.638168] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-13T18:32:46.638213] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-13T18:32:46.638254] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-13T18:32:46.638286] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-13T18:32:46.824398] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-13T18:32:47.024105] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:32:47.028243] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:47.617919] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-13T18:32:47.990562] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T18:32:48.417902] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-13T18:32:48.544004] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:32:49.217982] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-13T18:32:49.463161] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:32:50.017972] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-13T18:32:50.350602] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T18:32:50.470706] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:32:50.817929] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-13T18:32:51.617926] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-13T18:32:51.695374] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:32:52.420800] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-13T18:32:52.425436] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:32:53.217907] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-13T18:32:53.430619] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:32:54.017988] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-13T18:32:54.384189] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T18:32:54.745137] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T18:32:54.817978] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-13T18:32:55.408445] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:32:55.617969] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-13T18:32:56.423622] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-13T18:32:56.429947] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T18:32:57.217910] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-13T18:32:57.396945] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:32:58.017979] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-13T18:32:58.591786] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T18:32:58.818027] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-13T18:32:58.981471] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:32:59.617926] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-13T18:32:59.860254] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:33:00.368030] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:33:00.417915] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-13T18:33:01.218000] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-13T18:33:01.358246] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:33:02.017982] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-13T18:33:02.289395] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T18:33:02.817923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-13T18:33:02.872349] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:33:03.388801] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:33:03.394692] [INFO ] [REMOTE ] DV: Full fetch complete (73572 records). [2025-10-13T18:33:03.394902] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-13T18:33:03.628745] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-13T18:33:03.805619] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-13T18:33:03.805758] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-13T18:33:03.806869] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-13T18:33:03.806936] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-13T18:33:03.808900] [DEBUG] [LOCAL ] DV: Trimmed 73572 records to 51298 (keeping 200 days of data) [2025-10-13T18:33:04.130737] [DEBUG] [LOCAL ] DV: Primary data saved (51298 records). [2025-10-13T18:33:04.130930] [INFO ] [MAIN ] DV: Full history saved. [2025-10-13T18:33:04.131033] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 39.9s. Estimated remaining: 3h 56m 38s. Rate: 7.2 symbols/min [2025-10-13T18:33:04.311909] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:04.371186] [DEBUG] [LOCAL ] DXC: Loaded 50583 existing records from primary storage. [2025-10-13T18:33:04.371772] [INFO ] [MAIN ] DXC: Loaded 50583 existing records. [2025-10-13T18:33:04.423805] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-13T18:33:04.578245] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:04.578512] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-13T18:33:04.578565] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-13T18:33:04.579017] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-13T18:33:04.579078] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-13T18:33:05.035754] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:05.104278] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T18:33:05.157984] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:33:05.218030] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-13T18:33:06.017985] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-13T18:33:06.325879] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:33:06.817883] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-13T18:33:06.912062] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:33:07.540569] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T18:33:07.617907] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-13T18:33:07.712112] [DEBUG] [REMOTE ] DVA: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T18:33:07.712437] [WARN ] [REMOTE ] DVA: No data returned for month 2025-10 [2025-10-13T18:33:07.712529] [FATAL] [REMOTE ] DVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:33:07.712623] [FATAL] [MAIN ] DVA: Failed to fetch primary data. [2025-10-13T18:33:07.712720] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:33:07.712803] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-13T18:33:07.712881] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-13T18:33:07.712929] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-13T18:33:07.713144] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-10-13T18:33:07.713256] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVA took 33.4s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-13T18:33:07.878200] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:07.913427] [DEBUG] [LOCAL ] DXYZ: Loaded 37713 existing records from primary storage. [2025-10-13T18:33:07.913740] [INFO ] [MAIN ] DXYZ: Loaded 37713 existing records. [2025-10-13T18:33:08.086617] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:08.086869] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-13T18:33:08.086931] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-13T18:33:08.087400] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-13T18:33:08.087456] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-13T18:33:08.425127] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-13T18:33:08.452300] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:08.686956] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T18:33:09.217966] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-13T18:33:09.824772] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:33:10.017965] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-13T18:33:10.817960] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-13T18:33:11.009929] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:33:11.617961] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-13T18:33:12.058193] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T18:33:12.417956] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-13T18:33:13.010687] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:33:13.042823] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:33:13.047707] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-10-13T18:33:13.047825] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-13T18:33:13.048669] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:33:13.048759] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:33:13.048802] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:33:13.048841] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-13T18:33:13.048899] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-13T18:33:13.048935] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-13T18:33:13.049095] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-13T18:33:13.049833] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DVN took 35.6s. Estimated remaining: 3h 56m 1s. Rate: 7.2 symbols/min [2025-10-13T18:33:13.220727] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-13T18:33:13.224319] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:13.225377] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-10-13T18:33:13.225423] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-10-13T18:33:13.225535] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-13T18:33:13.225577] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-13T18:33:13.225626] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-13T18:33:13.225696] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-13T18:33:13.586459] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:13.720511] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-10-13T18:33:14.017929] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-13T18:33:14.461404] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T18:33:14.817911] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-13T18:33:15.617977] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-13T18:33:15.865558] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T18:33:16.418018] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-13T18:33:16.894694] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T18:33:17.145917] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:33:17.217889] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-13T18:33:18.008313] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:33:18.018303] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-13T18:33:18.515130] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:33:18.817926] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-13T18:33:19.465682] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T18:33:19.617971] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-13T18:33:20.417920] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-13T18:33:20.555236] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T18:33:20.560886] [INFO ] [REMOTE ] DX: Full fetch complete (75564 records). [2025-10-13T18:33:20.561031] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-13T18:33:20.956999] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-13T18:33:20.957078] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-13T18:33:20.957933] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-13T18:33:20.958020] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-13T18:33:20.959537] [DEBUG] [LOCAL ] DX: Trimmed 75564 records to 52474 (keeping 200 days of data) [2025-10-13T18:33:21.237439] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-13T18:33:21.284173] [DEBUG] [LOCAL ] DX: Primary data saved (52474 records). [2025-10-13T18:33:21.284369] [INFO ] [MAIN ] DX: Full history saved. [2025-10-13T18:33:21.284533] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DX took 34.8s. Estimated remaining: 3h 55m 53s. Rate: 7.2 symbols/min [2025-10-13T18:33:21.456075] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:21.489983] [DEBUG] [LOCAL ] E: Loaded 33622 existing records from primary storage. [2025-10-13T18:33:21.490313] [INFO ] [MAIN ] E: Loaded 33622 existing records. [2025-10-13T18:33:21.692979] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:21.695436] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T18:33:21.695723] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-13T18:33:21.704390] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-13T18:33:21.704813] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-13T18:33:21.704881] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-13T18:33:22.025859] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-13T18:33:22.072145] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:22.102545] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T18:33:22.304441] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:33:22.817952] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-13T18:33:23.617997] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-13T18:33:24.094324] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:33:24.136370] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T18:33:24.417988] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-13T18:33:25.040349] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T18:33:25.217987] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-13T18:33:25.314080] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:33:26.017955] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-13T18:33:26.751710] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:33:26.817990] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-13T18:33:27.325037] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:33:27.617926] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-13T18:33:28.417900] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-13T18:33:28.487495] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T18:33:29.217927] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-13T18:33:29.570599] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:33:29.870107] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:33:30.018008] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-13T18:33:30.717718] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:33:30.817896] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-13T18:33:31.139567] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T18:33:31.617961] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-13T18:33:32.417930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-13T18:33:32.539684] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:33:32.659893] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:33:33.217952] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-13T18:33:34.018003] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-13T18:33:34.111623] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:33:34.817982] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-13T18:33:35.392288] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T18:33:35.488408] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:33:35.617922] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-13T18:33:35.991707] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:33:36.417932] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-13T18:33:37.009754] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:33:37.218001] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-13T18:33:37.920770] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:33:38.017893] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-13T18:33:38.624035] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:33:38.817899] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-13T18:33:39.617908] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-13T18:33:39.894322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T18:33:39.920555] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:33:40.417925] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-13T18:33:41.217958] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-13T18:33:42.017945] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-13T18:33:42.056812] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:33:42.817991] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-13T18:33:43.041816] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (3.42 seconds). [2025-10-13T18:33:43.255102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:33:43.315587] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:33:43.320144] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57335 records). [2025-10-13T18:33:43.320262] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-13T18:33:43.623082] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-13T18:33:43.692487] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-13T18:33:43.692575] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-13T18:33:43.693378] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-13T18:33:43.693825] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-13T18:33:43.695007] [DEBUG] [LOCAL ] DXYZ: Trimmed 57335 records to 37107 (keeping 200 days of data) [2025-10-13T18:33:43.912771] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37107 records). [2025-10-13T18:33:43.912918] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-13T18:33:43.913019] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 36.2s. Estimated remaining: 3h 56m 21s. Rate: 7.2 symbols/min [2025-10-13T18:33:44.076202] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:44.119695] [DEBUG] [LOCAL ] EAF: Loaded 42686 existing records from primary storage. [2025-10-13T18:33:44.120131] [INFO ] [MAIN ] EAF: Loaded 42686 existing records. [2025-10-13T18:33:44.319322] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:44.320002] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-13T18:33:44.332437] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-13T18:33:44.333385] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:33:44.338033] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-13T18:33:44.338677] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-13T18:33:44.344345] [INFO ] [REMOTE ] DXC: Full fetch complete (69761 records). [2025-10-13T18:33:44.374022] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-13T18:33:44.435564] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-13T18:33:45.110585] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:45.166044] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-13T18:33:45.166129] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-13T18:33:45.167060] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-13T18:33:45.167126] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-13T18:33:45.172073] [DEBUG] [LOCAL ] DXC: Trimmed 69761 records to 49851 (keeping 200 days of data) [2025-10-13T18:33:45.219314] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-13T18:33:45.464308] [DEBUG] [LOCAL ] DXC: Primary data saved (49851 records). [2025-10-13T18:33:45.464450] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-13T18:33:45.464529] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXC took 41.3s. Estimated remaining: 3h 55m 55s. Rate: 7.2 symbols/min [2025-10-13T18:33:45.647175] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:45.682995] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:33:45.686396] [DEBUG] [LOCAL ] EAI: Loaded 4046 existing records from primary storage. [2025-10-13T18:33:45.697124] [INFO ] [MAIN ] EAI: Loaded 4046 existing records. [2025-10-13T18:33:45.880461] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:45.880809] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-13T18:33:45.880904] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-13T18:33:45.881115] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-13T18:33:45.881172] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-13T18:33:46.027278] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-13T18:33:46.255935] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:46.499515] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T18:33:46.817909] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-13T18:33:46.952181] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T18:33:46.955063] [INFO ] [REMOTE ] DY: Full fetch complete (43575 records). [2025-10-13T18:33:46.955141] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-13T18:33:47.341372] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-13T18:33:47.341473] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-13T18:33:47.342150] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-13T18:33:47.342325] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-13T18:33:47.369726] [DEBUG] [LOCAL ] DY: Trimmed 43575 records to 28501 (keeping 200 days of data) [2025-10-13T18:33:47.369555] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:33:47.554369] [DEBUG] [LOCAL ] DY: Primary data saved (28501 records). [2025-10-13T18:33:47.554520] [INFO ] [MAIN ] DY: Full history saved. [2025-10-13T18:33:47.554595] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. DY took 34.5s. Estimated remaining: 3h 55m 31s. Rate: 7.2 symbols/min [2025-10-13T18:33:47.627858] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-13T18:33:47.726872] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:47.759351] [DEBUG] [LOCAL ] EARN: Loaded 29576 existing records from primary storage. [2025-10-13T18:33:47.759636] [INFO ] [MAIN ] EARN: Loaded 29576 existing records. [2025-10-13T18:33:47.944507] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:47.944777] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-13T18:33:47.944862] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-13T18:33:47.945241] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-13T18:33:47.945299] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-13T18:33:48.310665] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:48.328036] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:33:48.417884] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-13T18:33:49.217982] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-13T18:33:49.287465] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:33:49.691147] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:33:49.694486] [INFO ] [REMOTE ] E: Full fetch complete (47834 records). [2025-10-13T18:33:49.694608] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-13T18:33:50.023139] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-13T18:33:50.073144] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-13T18:33:50.073232] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-13T18:33:50.073981] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-13T18:33:50.074044] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-13T18:33:50.076370] [DEBUG] [LOCAL ] E: Trimmed 47834 records to 33186 (keeping 200 days of data) [2025-10-13T18:33:50.284292] [DEBUG] [LOCAL ] E: Primary data saved (33186 records). [2025-10-13T18:33:50.284482] [INFO ] [MAIN ] E: Full history saved. [2025-10-13T18:33:50.284602] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. E took 29.0s. Estimated remaining: 3h 55m 9s. Rate: 7.2 symbols/min [2025-10-13T18:33:50.466319] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:50.517575] [DEBUG] [LOCAL ] EAT: Loaded 50552 existing records from primary storage. [2025-10-13T18:33:50.517920] [INFO ] [MAIN ] EAT: Loaded 50552 existing records. [2025-10-13T18:33:50.697771] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:50.698128] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-13T18:33:50.698209] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-13T18:33:50.699001] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-13T18:33:50.699062] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-13T18:33:50.824530] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-13T18:33:50.862267] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:33:50.996430] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:33:51.114769] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:51.617973] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-13T18:33:52.284192] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:33:52.417966] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-13T18:33:52.989806] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:33:53.217915] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-13T18:33:54.017930] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-13T18:33:54.566207] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:33:54.670125] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:33:54.714793] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:33:54.817914] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-13T18:33:55.617927] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-13T18:33:56.417977] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-13T18:33:56.503352] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:33:56.753208] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T18:33:57.201429] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:33:57.217897] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-13T18:33:58.018013] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-13T18:33:58.464754] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T18:33:58.817990] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-13T18:33:58.972385] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:33:59.617915] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-13T18:34:00.412550] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:34:00.422898] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-13T18:34:01.188156] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:34:01.226547] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-13T18:34:01.247904] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:34:02.017973] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-13T18:34:02.509804] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T18:34:02.817933] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-13T18:34:02.850188] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:34:03.617979] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-13T18:34:04.354370] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:34:04.417903] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-13T18:34:05.217968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-13T18:34:05.317037] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:34:05.816187] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:34:05.958281] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:34:06.017904] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-13T18:34:06.817965] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-13T18:34:07.575293] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:34:07.617909] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-13T18:34:08.417915] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-13T18:34:08.536937] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:34:08.663002] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:34:08.927902] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T18:34:09.217998] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-13T18:34:10.017980] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-13T18:34:10.818000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-13T18:34:10.975335] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T18:34:11.403290] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T18:34:11.617923] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-13T18:34:12.118476] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:34:12.121964] [INFO ] [REMOTE ] EAF: Full fetch complete (62847 records). [2025-10-13T18:34:12.122076] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-13T18:34:12.423112] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-13T18:34:12.502312] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-13T18:34:12.502402] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-13T18:34:12.503195] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-13T18:34:12.503259] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-13T18:34:12.504479] [DEBUG] [LOCAL ] EAF: Trimmed 62847 records to 41883 (keeping 200 days of data) [2025-10-13T18:34:12.739840] [DEBUG] [LOCAL ] EAF: Primary data saved (41883 records). [2025-10-13T18:34:12.739975] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-13T18:34:12.740054] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAF took 28.8s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-13T18:34:13.221575] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-13T18:34:13.223784] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:34:13.972711] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:34:14.024631] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-13T18:34:14.049067] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:34:14.514313] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T18:34:14.818045] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-13T18:34:15.617923] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-13T18:34:16.417906] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-13T18:34:16.457306] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T18:34:16.787616] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:34:16.990714] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:34:16.991754] [INFO ] [REMOTE ] EAI: Full fetch complete (6079 records). [2025-10-13T18:34:16.991831] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-13T18:34:17.229107] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-13T18:34:17.344006] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-13T18:34:17.344083] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-13T18:34:17.344243] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-13T18:34:17.344281] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-13T18:34:17.344632] [DEBUG] [LOCAL ] EAI: Trimmed 6079 records to 4003 (keeping 200 days of data) [2025-10-13T18:34:17.368411] [DEBUG] [LOCAL ] EAI: Primary data saved (4003 records). [2025-10-13T18:34:17.368529] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-13T18:34:17.368615] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EAI took 31.9s. Estimated remaining: 3h 55m 18s. Rate: 7.2 symbols/min [2025-10-13T18:34:18.017961] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-13T18:34:18.166211] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T18:34:18.817921] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-13T18:34:19.884187] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:34:19.910169] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-13T18:34:19.912063] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:34:20.417926] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-13T18:34:21.422401] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:34:21.427889] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-13T18:34:21.741089] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:34:22.017929] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-13T18:34:22.826709] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:34:22.829960] [INFO ] [REMOTE ] EARN: Full fetch complete (45449 records). [2025-10-13T18:34:22.830041] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-13T18:34:22.830577] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:34:22.830684] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:34:22.830736] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:34:22.830778] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-13T18:34:22.830833] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-13T18:34:22.830867] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-13T18:34:22.831046] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-13T18:34:22.831888] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EARN took 35.3s. Estimated remaining: 3h 55m 3s. Rate: 7.2 symbols/min [2025-10-13T18:34:23.723780] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:34:23.728765] [INFO ] [REMOTE ] EAT: Full fetch complete (71813 records). [2025-10-13T18:34:23.728861] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-13T18:34:23.729581] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:34:23.729698] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:34:23.729747] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:34:23.729785] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-13T18:34:23.729839] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-13T18:34:23.729872] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-13T18:34:23.730043] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-13T18:34:23.730131] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 33.4s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-13T18:34:24.386388] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.385590] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.382471] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.393064] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-13T18:34:24.393131] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-13T18:34:24.422124] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-13T18:34:24.422195] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-13T18:34:24.422241] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-13T18:34:24.422274] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-13T18:34:24.432615] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.574369] [DEBUG] [LOCAL ] EBF: Loaded 19352 existing records from primary storage. [2025-10-13T18:34:24.585117] [INFO ] [MAIN ] EBF: Loaded 19352 existing records. [2025-10-13T18:34:24.847141] [DEBUG] [LOCAL ] EBR: Loaded 43824 existing records from primary storage. [2025-10-13T18:34:24.972633] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:24.978018] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-13T18:34:24.935991] [DEBUG] [LOCAL ] EB: Loaded 37311 existing records from primary storage. [2025-10-13T18:34:24.978118] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-13T18:34:24.992233] [INFO ] [MAIN ] EB: Loaded 37311 existing records. [2025-10-13T18:34:24.992009] [INFO ] [MAIN ] EBR: Loaded 43824 existing records. [2025-10-13T18:34:25.008746] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-13T18:34:25.081709] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-13T18:34:25.245097] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:25.266178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-13T18:34:25.503926] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:25.538152] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:25.544101] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-13T18:34:25.544309] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-13T18:34:25.549543] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-13T18:34:25.549696] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-13T18:34:25.578157] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-13T18:34:25.565465] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-13T18:34:25.578352] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-13T18:34:25.578503] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-13T18:34:26.092714] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.196556] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-13T18:34:26.506970] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.530054] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-13T18:34:26.573538] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.573927] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-13T18:34:27.119941] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:34:27.129313] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-13T18:34:27.502430] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T18:34:27.506784] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-13T18:34:28.168903] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:34:28.178252] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-13T18:34:28.216044] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:34:28.354687] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:34:28.417887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-13T18:34:28.750259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:34:29.217889] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-13T18:34:29.484001] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T18:34:30.017902] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-13T18:34:30.065421] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:34:30.276001] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T18:34:30.817920] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-13T18:34:31.547494] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:34:31.617893] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-13T18:34:31.975453] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:34:32.417921] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-13T18:34:33.227217] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-13T18:34:33.249399] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:34:33.284343] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T18:34:34.017923] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-13T18:34:34.659153] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:34:34.817957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-13T18:34:35.617899] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-13T18:34:35.711532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:34:36.343723] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:34:36.417960] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-13T18:34:37.020892] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:34:37.217922] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-13T18:34:38.017349] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:34:38.025926] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-13T18:34:38.789107] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T18:34:38.817881] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-13T18:34:39.064011] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:34:39.617927] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-13T18:34:40.417913] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-13T18:34:40.450703] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:34:41.133144] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:34:41.217954] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-13T18:34:42.017911] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-13T18:34:42.128817] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:34:42.412835] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:34:42.817932] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-13T18:34:43.439759] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:34:43.617922] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-13T18:34:44.168240] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:34:44.417965] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-13T18:34:45.217925] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-13T18:34:45.289004] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:34:45.666232] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:34:46.021755] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-13T18:34:46.263872] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T18:34:46.817963] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-13T18:34:47.410156] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:34:47.617981] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-13T18:34:47.936426] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:34:48.417975] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-13T18:34:49.217909] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-13T18:34:49.292857] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:34:49.298093] [INFO ] [REMOTE ] EBS: Full fetch complete (67311 records). [2025-10-13T18:34:49.298204] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-13T18:34:49.680681] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-13T18:34:49.680797] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-13T18:34:49.681667] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-13T18:34:49.681745] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-13T18:34:49.683269] [DEBUG] [LOCAL ] EBS: Trimmed 67311 records to 46756 (keeping 200 days of data) [2025-10-13T18:34:49.783302] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:34:49.967994] [DEBUG] [LOCAL ] EBS: Primary data saved (46756 records). [2025-10-13T18:34:49.968144] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-13T18:34:49.968222] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBS took 26.2s. Estimated remaining: 3h 55m 12s. Rate: 7.2 symbols/min [2025-10-13T18:34:50.024864] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-13T18:34:50.143789] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:50.144171] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-13T18:34:50.144287] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-13T18:34:50.144440] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-13T18:34:50.144598] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-13T18:34:50.144704] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-13T18:34:50.144754] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-13T18:34:50.273846] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:34:50.513600] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:50.817927] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-13T18:34:51.291515] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:34:51.295566] [INFO ] [REMOTE ] EB: Full fetch complete (55574 records). [2025-10-13T18:34:51.295711] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-13T18:34:51.619243] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-13T18:34:51.716008] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-13T18:34:51.716130] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-13T18:34:51.717086] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-13T18:34:51.717161] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-13T18:34:51.718993] [DEBUG] [LOCAL ] EB: Trimmed 55574 records to 36701 (keeping 200 days of data) [2025-10-13T18:34:51.945602] [DEBUG] [LOCAL ] EB: Primary data saved (36701 records). [2025-10-13T18:34:51.945820] [INFO ] [MAIN ] EB: Full history saved. [2025-10-13T18:34:51.945930] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EB took 28.2s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-13T18:34:52.150279] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:52.188277] [DEBUG] [LOCAL ] ECAT: Loaded 29861 existing records from primary storage. [2025-10-13T18:34:52.188716] [INFO ] [MAIN ] ECAT: Loaded 29861 existing records. [2025-10-13T18:34:52.385783] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:52.386048] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-13T18:34:52.386098] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-13T18:34:52.386343] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-13T18:34:52.386406] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-13T18:34:52.421541] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-13T18:34:52.710274] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:34:52.798542] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T18:34:52.803053] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:53.217913] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-13T18:34:54.020437] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-13T18:34:54.214084] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:34:54.445871] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:34:54.817934] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-13T18:34:54.992757] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:34:55.617927] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-13T18:34:56.249623] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:34:56.417984] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-13T18:34:57.085351] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:34:57.217923] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-13T18:34:57.615026] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T18:34:58.017969] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-13T18:34:58.644327] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:34:58.817977] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-13T18:34:59.617929] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-13T18:34:59.661477] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:35:00.382294] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:35:00.417904] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-13T18:35:00.726064] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T18:35:00.728839] [INFO ] [REMOTE ] EBF: Full fetch complete (27542 records). [2025-10-13T18:35:00.728933] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-13T18:35:00.729492] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:35:00.729613] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:35:00.729727] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:35:00.729819] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-13T18:35:00.729919] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-13T18:35:00.729985] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-13T18:35:00.730211] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-13T18:35:00.730322] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBF took 37.0s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-13T18:35:00.911309] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:00.954390] [DEBUG] [LOCAL ] ECC: Loaded 43742 existing records from primary storage. [2025-10-13T18:35:00.954789] [INFO ] [MAIN ] ECC: Loaded 43742 existing records. [2025-10-13T18:35:01.137500] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:01.137834] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-13T18:35:01.137897] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-13T18:35:01.138313] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-13T18:35:01.138374] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-13T18:35:01.225687] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-13T18:35:01.547882] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:02.018050] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-13T18:35:02.087204] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:35:02.530970] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:35:02.817986] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-13T18:35:03.627416] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-13T18:35:03.651733] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:35:03.809413] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T18:35:04.417997] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-13T18:35:05.217974] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-13T18:35:05.411412] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T18:35:05.417213] [INFO ] [REMOTE ] EBR: Full fetch complete (62468 records). [2025-10-13T18:35:05.417421] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-13T18:35:05.856221] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-13T18:35:05.856342] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-13T18:35:05.857348] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-13T18:35:05.857421] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-13T18:35:05.859976] [DEBUG] [LOCAL ] EBR: Trimmed 62468 records to 43212 (keeping 200 days of data) [2025-10-13T18:35:06.047087] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-13T18:35:06.132437] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:35:06.205939] [DEBUG] [LOCAL ] EBR: Primary data saved (43212 records). [2025-10-13T18:35:06.206144] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-13T18:35:06.207185] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBR took 42.5s. Estimated remaining: 3h 54m 25s. Rate: 7.2 symbols/min [2025-10-13T18:35:06.430590] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:06.430920] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-13T18:35:06.431115] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-13T18:35:06.431300] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-13T18:35:06.431376] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-13T18:35:06.431562] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-13T18:35:06.431630] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-13T18:35:06.659260] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:35:06.823435] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-13T18:35:07.011447] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:07.618056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-13T18:35:07.970060] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T18:35:08.097511] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T18:35:08.164451] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T18:35:08.417993] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-13T18:35:09.218203] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-13T18:35:10.017996] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-13T18:35:10.265382] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:35:10.817926] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-13T18:35:10.905706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T18:35:11.124979] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:35:11.617979] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-13T18:35:12.418044] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-13T18:35:12.470761] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:35:12.752184] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T18:35:12.849044] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:35:13.217957] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-13T18:35:14.018000] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-13T18:35:14.560772] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:35:14.818017] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-13T18:35:15.173044] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T18:35:15.617992] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-13T18:35:16.001001] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T18:35:16.417988] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-13T18:35:17.032494] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:35:17.217994] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-13T18:35:18.017921] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-13T18:35:18.219480] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:35:18.514823] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:35:18.817919] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-13T18:35:18.946797] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:35:19.617977] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-13T18:35:20.107911] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T18:35:20.418008] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-13T18:35:21.217990] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-13T18:35:21.371262] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:35:21.778769] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T18:35:21.782355] [INFO ] [REMOTE ] ECAT: Full fetch complete (42923 records). [2025-10-13T18:35:21.782457] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-13T18:35:22.023167] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-13T18:35:22.190305] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-13T18:35:22.190427] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-13T18:35:22.191334] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-13T18:35:22.191409] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-13T18:35:22.193096] [DEBUG] [LOCAL ] ECAT: Trimmed 42923 records to 29435 (keeping 200 days of data) [2025-10-13T18:35:22.387879] [DEBUG] [LOCAL ] ECAT: Primary data saved (29435 records). [2025-10-13T18:35:22.388101] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-13T18:35:22.388207] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 30.4s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-13T18:35:22.581880] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:22.587399] [DEBUG] [LOCAL ] ECCU: Loaded 2271 existing records from primary storage. [2025-10-13T18:35:22.587629] [INFO ] [MAIN ] ECCU: Loaded 2271 existing records. [2025-10-13T18:35:22.787503] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:22.787793] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-13T18:35:22.787847] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-13T18:35:22.788049] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-13T18:35:22.788107] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-13T18:35:22.830109] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-13T18:35:23.194978] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:23.210041] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T18:35:23.224769] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T18:35:23.461614] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:35:23.617973] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-13T18:35:23.995358] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:35:24.417992] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-13T18:35:25.217977] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-13T18:35:25.576844] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T18:35:25.967984] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:35:26.021145] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-13T18:35:26.593811] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:35:26.818025] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-13T18:35:27.210373] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T18:35:27.617982] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-13T18:35:28.418027] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-13T18:35:29.188545] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T18:35:29.217904] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-13T18:35:30.017925] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-13T18:35:30.124584] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:35:30.419869] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T18:35:30.486336] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:35:30.494393] [INFO ] [REMOTE ] EC: Full fetch complete (71818 records). [2025-10-13T18:35:30.494627] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-13T18:35:30.818425] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-13T18:35:30.927604] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-13T18:35:30.927747] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-13T18:35:30.928988] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-13T18:35:30.929056] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-13T18:35:30.931233] [DEBUG] [LOCAL ] EC: Trimmed 71818 records to 49023 (keeping 200 days of data) [2025-10-13T18:35:31.238242] [DEBUG] [LOCAL ] EC: Primary data saved (49023 records). [2025-10-13T18:35:31.238516] [INFO ] [MAIN ] EC: Full history saved. [2025-10-13T18:35:31.238638] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. EC took 41.3s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-13T18:35:31.412099] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:31.412311] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-13T18:35:31.412349] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-13T18:35:31.412490] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-13T18:35:31.412531] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-13T18:35:31.412572] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-13T18:35:31.412605] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-13T18:35:31.522444] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T18:35:31.623090] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-13T18:35:31.832478] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:32.417988] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-13T18:35:33.127341] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:35:33.217977] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-13T18:35:33.425078] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:35:34.017911] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-13T18:35:34.481964] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:35:34.482744] [INFO ] [REMOTE ] ECCC: Full fetch complete (1314 records). [2025-10-13T18:35:34.482811] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-13T18:35:34.702012] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T18:35:34.705518] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:35:34.705777] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:35:34.710355] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:35:34.710815] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-13T18:35:34.711072] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-13T18:35:34.711122] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-13T18:35:34.711165] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-13T18:35:34.711243] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 28.5s. Estimated remaining: 3h 54m 9s. Rate: 7.2 symbols/min [2025-10-13T18:35:34.716699] [INFO ] [REMOTE ] ECC: Full fetch complete (61095 records). [2025-10-13T18:35:34.745629] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-13T18:35:34.818728] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-13T18:35:35.031065] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:35.060905] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-13T18:35:35.078002] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-13T18:35:35.112632] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-13T18:35:35.150400] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-13T18:35:35.203459] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-13T18:35:35.211512] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-13T18:35:35.333421] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T18:35:35.469279] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-13T18:35:35.469789] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-13T18:35:35.476282] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-13T18:35:35.481490] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-13T18:35:35.623359] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-13T18:35:35.623214] [DEBUG] [LOCAL ] ECC: Trimmed 61095 records to 43166 (keeping 200 days of data) [2025-10-13T18:35:35.824789] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:35.990234] [DEBUG] [LOCAL ] ECC: Primary data saved (43166 records). [2025-10-13T18:35:35.990382] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-13T18:35:35.990510] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECC took 35.3s. Estimated remaining: 3h 53m 43s. Rate: 7.2 symbols/min [2025-10-13T18:35:36.170825] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:36.171044] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-10-13T18:35:36.171089] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-10-13T18:35:36.171201] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-13T18:35:36.171243] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-13T18:35:36.171285] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-13T18:35:36.171327] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-13T18:35:36.421550] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-13T18:35:36.455174] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T18:35:36.543627] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:37.072610] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T18:35:37.217910] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-13T18:35:37.988743] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:35:38.017887] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-13T18:35:38.485386] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T18:35:38.817915] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-13T18:35:39.232558] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T18:35:39.617922] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-13T18:35:40.378295] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T18:35:40.417892] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-13T18:35:41.217924] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-13T18:35:41.582525] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T18:35:41.868813] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T18:35:42.017931] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-13T18:35:42.395836] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:35:42.817920] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-13T18:35:43.617931] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-13T18:35:44.030131] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T18:35:44.227785] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:35:44.418034] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-13T18:35:44.746503] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T18:35:45.217927] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-13T18:35:46.018001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-13T18:35:46.459025] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:35:46.692108] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:35:46.817904] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-13T18:35:47.617922] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-13T18:35:48.231183] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:35:48.272500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:35:48.417898] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-13T18:35:49.217921] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-13T18:35:49.592991] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T18:35:49.593956] [INFO ] [REMOTE ] ECCU: Full fetch complete (4408 records). [2025-10-13T18:35:49.594027] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-13T18:35:50.003468] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-13T18:35:50.004361] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-13T18:35:50.006005] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-13T18:35:50.005634] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:35:50.006121] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-13T18:35:50.015772] [DEBUG] [LOCAL ] ECCU: Trimmed 4408 records to 2215 (keeping 200 days of data) [2025-10-13T18:35:50.017879] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-13T18:35:50.033795] [DEBUG] [LOCAL ] ECCU: Primary data saved (2215 records). [2025-10-13T18:35:50.033990] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-13T18:35:50.034121] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 27.6s. Estimated remaining: 3h 53m 49s. Rate: 7.2 symbols/min [2025-10-13T18:35:50.211935] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:50.265542] [DEBUG] [LOCAL ] ECL: Loaded 47324 existing records from primary storage. [2025-10-13T18:35:50.265976] [INFO ] [MAIN ] ECL: Loaded 47324 existing records. [2025-10-13T18:35:50.449752] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:50.450016] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-13T18:35:50.450066] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-13T18:35:50.450636] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-13T18:35:50.450727] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-13T18:35:50.804143] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:50.817894] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-13T18:35:51.128781] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:35:51.617930] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-13T18:35:52.283224] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:35:52.417903] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-13T18:35:52.868521] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:35:52.986633] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:35:53.218004] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-13T18:35:54.017935] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-13T18:35:54.502702] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T18:35:54.617713] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:35:54.817950] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-13T18:35:55.195178] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T18:35:55.617926] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-13T18:35:56.417927] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-13T18:35:56.771507] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:35:57.218000] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-13T18:35:57.329144] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:35:58.017979] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-13T18:35:58.273113] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:35:58.340703] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:35:58.817966] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-13T18:35:59.144039] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-13T18:35:59.618009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-13T18:36:00.006165] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T18:36:00.418061] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-13T18:36:01.217990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-13T18:36:01.819036] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:36:01.863177] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:36:02.018026] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-13T18:36:02.817933] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-13T18:36:03.241299] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:36:03.617988] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-13T18:36:03.809109] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:36:04.418002] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-13T18:36:05.125900] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:36:05.129375] [INFO ] [REMOTE ] ECG: Full fetch complete (50840 records). [2025-10-13T18:36:05.129473] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-13T18:36:05.223009] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-13T18:36:05.512662] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-13T18:36:05.512752] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-13T18:36:05.513388] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-13T18:36:05.513429] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-13T18:36:05.514381] [DEBUG] [LOCAL ] ECG: Trimmed 50840 records to 33411 (keeping 200 days of data) [2025-10-13T18:36:05.692912] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T18:36:05.715903] [DEBUG] [LOCAL ] ECG: Primary data saved (33411 records). [2025-10-13T18:36:05.716003] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-13T18:36:05.716092] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECG took 29.7s. Estimated remaining: 3h 53m 58s. Rate: 7.2 symbols/min [2025-10-13T18:36:05.884580] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:05.902611] [DEBUG] [LOCAL ] ECO: Loaded 18639 existing records from primary storage. [2025-10-13T18:36:05.902893] [INFO ] [MAIN ] ECO: Loaded 18639 existing records. [2025-10-13T18:36:06.018774] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-13T18:36:06.087138] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:06.087357] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-13T18:36:06.087514] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-13T18:36:06.087909] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-13T18:36:06.087996] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-13T18:36:06.464826] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:36:06.469995] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:06.497475] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:36:06.498154] [INFO ] [REMOTE ] ECCX: Full fetch complete (1451 records). [2025-10-13T18:36:06.498221] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-13T18:36:06.674447] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-13T18:36:06.674634] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:36:06.674728] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:36:06.674778] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-13T18:36:06.674836] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-13T18:36:06.674872] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-13T18:36:06.674912] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-13T18:36:06.674966] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECCX took 32.0s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-13T18:36:06.819737] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-13T18:36:06.843252] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:06.844104] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-13T18:36:06.844149] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-13T18:36:06.844257] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-13T18:36:06.844299] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-13T18:36:06.844341] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-13T18:36:06.844374] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-13T18:36:07.217232] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:07.379194] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T18:36:07.617930] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-13T18:36:08.417986] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-13T18:36:08.750265] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T18:36:09.199735] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T18:36:09.217933] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-13T18:36:10.017977] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-13T18:36:10.367071] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T18:36:10.615736] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:36:10.817933] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-13T18:36:11.196450] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T18:36:11.617919] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-13T18:36:12.417958] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-13T18:36:12.714874] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T18:36:12.745368] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-13T18:36:13.217903] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-13T18:36:14.018043] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-13T18:36:14.817887] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-13T18:36:14.887399] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T18:36:15.107309] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T18:36:15.617925] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-13T18:36:15.976108] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:36:16.417929] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-13T18:36:16.870933] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:36:16.871681] [INFO ] [REMOTE ] ECCW: Full fetch complete (1437 records). [2025-10-13T18:36:16.871748] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-13T18:36:17.036917] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:36:17.089350] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-13T18:36:17.089549] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:36:17.089619] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:36:17.089724] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-13T18:36:17.089802] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-13T18:36:17.089840] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-13T18:36:17.089880] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-13T18:36:17.089940] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECCW took 45.9s. Estimated remaining: 3h 53m 29s. Rate: 7.2 symbols/min [2025-10-13T18:36:17.229104] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-13T18:36:17.263539] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:17.330678] [DEBUG] [LOCAL ] ED: Loaded 53462 existing records from primary storage. [2025-10-13T18:36:17.331040] [INFO ] [MAIN ] ED: Loaded 53462 existing records. [2025-10-13T18:36:17.506603] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:17.506823] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-13T18:36:17.506868] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-13T18:36:17.507321] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-13T18:36:17.507376] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-13T18:36:17.856058] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:18.017910] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-13T18:36:18.475958] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:36:18.817988] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-13T18:36:19.617989] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-13T18:36:19.773232] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:36:19.949331] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T18:36:20.417961] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-13T18:36:21.116286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:36:21.217904] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-13T18:36:22.027098] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-13T18:36:22.046496] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T18:36:22.307805] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:36:22.817924] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-13T18:36:23.617987] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-13T18:36:23.677811] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:36:24.389274] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T18:36:24.420013] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-13T18:36:24.423875] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:36:25.217930] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-13T18:36:26.011830] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:36:26.020513] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-13T18:36:26.757108] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T18:36:26.817909] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-13T18:36:27.476930] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:36:27.617917] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-13T18:36:28.417918] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-13T18:36:28.609462] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:36:29.217912] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-13T18:36:29.557283] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:36:30.023284] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-13T18:36:30.028312] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:36:30.631990] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:36:30.817986] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-13T18:36:31.617892] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-13T18:36:31.697617] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T18:36:31.872261] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:36:32.417986] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-13T18:36:33.217904] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-13T18:36:33.416245] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:36:33.955525] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:36:34.017993] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-13T18:36:34.527634] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:36:34.817933] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-13T18:36:35.621151] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-13T18:36:35.624949] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:36:35.630668] [INFO ] [REMOTE ] ECL: Full fetch complete (67968 records). [2025-10-13T18:36:35.630805] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-13T18:36:36.015814] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-13T18:36:36.015959] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-13T18:36:36.016767] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-13T18:36:36.016829] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-13T18:36:36.018173] [DEBUG] [LOCAL ] ECL: Trimmed 67968 records to 46627 (keeping 200 days of data) [2025-10-13T18:36:36.282747] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:36:36.357688] [DEBUG] [LOCAL ] ECL: Primary data saved (46627 records). [2025-10-13T18:36:36.357890] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-13T18:36:36.358026] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 46.3s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-13T18:36:36.421928] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-13T18:36:36.530575] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:36.556908] [DEBUG] [LOCAL ] EDD: Loaded 27263 existing records from primary storage. [2025-10-13T18:36:36.557186] [INFO ] [MAIN ] EDD: Loaded 27263 existing records. [2025-10-13T18:36:36.676943] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:36:36.757926] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:36.758195] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-13T18:36:36.758250] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-13T18:36:36.758561] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-13T18:36:36.758617] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-13T18:36:37.098313] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:37.217963] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-13T18:36:38.017913] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-13T18:36:38.188047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:36:38.817898] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-13T18:36:38.843298] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:36:39.148706] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:36:39.617923] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-13T18:36:40.267815] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:36:40.417923] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-13T18:36:40.869130] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:36:40.871406] [INFO ] [REMOTE ] ECO: Full fetch complete (28527 records). [2025-10-13T18:36:40.871478] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-13T18:36:41.225492] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-13T18:36:41.239402] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-13T18:36:41.239483] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-13T18:36:41.240057] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-13T18:36:41.240119] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-13T18:36:41.240930] [DEBUG] [LOCAL ] ECO: Trimmed 28527 records to 18380 (keeping 200 days of data) [2025-10-13T18:36:41.354269] [DEBUG] [LOCAL ] ECO: Primary data saved (18380 records). [2025-10-13T18:36:41.354423] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-13T18:36:41.354507] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECO took 35.6s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-13T18:36:41.569410] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:41.566187] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:36:41.587887] [DEBUG] [LOCAL ] EDF: Loaded 13415 existing records from primary storage. [2025-10-13T18:36:41.588186] [INFO ] [MAIN ] EDF: Loaded 13415 existing records. [2025-10-13T18:36:41.766899] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:41.767170] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-13T18:36:41.767219] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-13T18:36:41.767437] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-13T18:36:41.767476] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-13T18:36:42.023042] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-13T18:36:42.135205] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:42.817911] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-13T18:36:42.921953] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T18:36:43.272175] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:36:43.617959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-13T18:36:44.417975] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-13T18:36:44.567208] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:36:44.734575] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:36:45.221587] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-13T18:36:46.017969] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-13T18:36:46.103732] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T18:36:46.108311] [INFO ] [REMOTE ] ECVT: Full fetch complete (60011 records). [2025-10-13T18:36:46.108415] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-13T18:36:46.485710] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:36:46.535371] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-13T18:36:46.535485] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-13T18:36:46.536349] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-13T18:36:46.536670] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-13T18:36:46.538870] [DEBUG] [LOCAL ] ECVT: Trimmed 60011 records to 43268 (keeping 200 days of data) [2025-10-13T18:36:46.787362] [DEBUG] [LOCAL ] ECVT: Primary data saved (43268 records). [2025-10-13T18:36:46.787506] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-13T18:36:46.787577] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ECVT took 40.1s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-13T18:36:46.831471] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-13T18:36:46.948626] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:36:47.005551] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:47.025372] [DEBUG] [LOCAL ] EDN: Loaded 18681 existing records from primary storage. [2025-10-13T18:36:47.025693] [INFO ] [MAIN ] EDN: Loaded 18681 existing records. [2025-10-13T18:36:47.210969] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:47.211225] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-13T18:36:47.211271] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-13T18:36:47.211596] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-13T18:36:47.211694] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-13T18:36:47.556251] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:47.617905] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-13T18:36:48.062232] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T18:36:48.417924] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-13T18:36:49.127604] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:36:49.217917] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-13T18:36:49.593982] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T18:36:50.017933] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-13T18:36:50.204591] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:36:50.817925] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-13T18:36:51.617895] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-13T18:36:51.851800] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:36:51.896937] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:36:52.417971] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-13T18:36:53.119037] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:36:53.218026] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-13T18:36:54.017916] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-13T18:36:54.138385] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:36:54.144246] [INFO ] [REMOTE ] ED: Full fetch complete (76271 records). [2025-10-13T18:36:54.144409] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-13T18:36:54.530832] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:36:54.656239] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-13T18:36:54.656351] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-13T18:36:54.657578] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-13T18:36:54.657704] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-13T18:36:54.660169] [DEBUG] [LOCAL ] ED: Trimmed 76271 records to 52680 (keeping 200 days of data) [2025-10-13T18:36:54.867105] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-13T18:36:55.024007] [DEBUG] [LOCAL ] ED: Primary data saved (52680 records). [2025-10-13T18:36:55.024191] [INFO ] [MAIN ] ED: Full history saved. [2025-10-13T18:36:55.024302] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 37.9s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-13T18:36:55.194896] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:55.219699] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:36:55.265196] [DEBUG] [LOCAL ] EDU: Loaded 45535 existing records from primary storage. [2025-10-13T18:36:55.265528] [INFO ] [MAIN ] EDU: Loaded 45535 existing records. [2025-10-13T18:36:55.438430] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:55.438680] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-13T18:36:55.438740] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-13T18:36:55.439152] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-13T18:36:55.439210] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-13T18:36:55.624157] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-13T18:36:55.766898] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T18:36:55.833102] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:56.417905] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-13T18:36:56.807690] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T18:36:57.217998] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-13T18:36:57.474472] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T18:36:58.017907] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-13T18:36:58.160017] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T18:36:58.817959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-13T18:36:59.033525] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:36:59.617975] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-13T18:37:00.006016] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T18:37:00.009116] [INFO ] [REMOTE ] EDD: Full fetch complete (38491 records). [2025-10-13T18:37:00.009194] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-13T18:37:00.376978] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-13T18:37:00.377080] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-13T18:37:00.377696] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-13T18:37:00.377756] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-13T18:37:00.378587] [DEBUG] [LOCAL ] EDD: Trimmed 38491 records to 26815 (keeping 200 days of data) [2025-10-13T18:37:00.425856] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-13T18:37:00.534632] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:37:00.548980] [DEBUG] [LOCAL ] EDD: Primary data saved (26815 records). [2025-10-13T18:37:00.549071] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-13T18:37:00.549138] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 24.2s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-13T18:37:00.716049] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:00.747875] [DEBUG] [LOCAL ] EE: Loaded 33445 existing records from primary storage. [2025-10-13T18:37:00.748193] [INFO ] [MAIN ] EE: Loaded 33445 existing records. [2025-10-13T18:37:00.923290] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:00.923563] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-13T18:37:00.923611] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-13T18:37:00.924007] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-13T18:37:00.924065] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-13T18:37:01.223006] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-13T18:37:01.280701] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:01.703712] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:37:02.018013] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-13T18:37:02.274696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:37:02.817972] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-13T18:37:03.299171] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:37:03.617901] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-13T18:37:03.846200] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:37:04.417907] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-13T18:37:04.509092] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T18:37:05.217887] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-13T18:37:05.538143] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:37:06.017918] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-13T18:37:06.213586] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:37:06.817894] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-13T18:37:07.123318] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:37:07.617981] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-13T18:37:07.962865] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T18:37:07.965482] [INFO ] [REMOTE ] EDN: Full fetch complete (29700 records). [2025-10-13T18:37:07.965553] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-13T18:37:08.322528] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-13T18:37:08.322604] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-13T18:37:08.323206] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-13T18:37:08.323266] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-13T18:37:08.323963] [DEBUG] [LOCAL ] EDN: Trimmed 29700 records to 18698 (keeping 200 days of data) [2025-10-13T18:37:08.418803] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-13T18:37:08.430413] [DEBUG] [LOCAL ] EDN: Primary data saved (18698 records). [2025-10-13T18:37:08.430560] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-13T18:37:08.430672] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 21.6s. Estimated remaining: 3h 52m 42s. Rate: 7.2 symbols/min [2025-10-13T18:37:08.599152] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:08.599362] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-13T18:37:08.599406] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-13T18:37:08.599514] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-13T18:37:08.599555] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-13T18:37:08.599594] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-13T18:37:08.599625] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-13T18:37:08.957606] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:08.970300] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:37:09.217927] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-13T18:37:10.017935] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-13T18:37:10.578477] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-13T18:37:10.817923] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-13T18:37:10.846024] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:37:11.129188] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:37:11.617933] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-13T18:37:12.072153] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:37:12.417963] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-13T18:37:12.769125] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T18:37:13.217914] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-13T18:37:13.385561] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:37:14.018001] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-13T18:37:14.523675] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T18:37:14.817989] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-13T18:37:15.008995] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:37:15.198924] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:37:15.617999] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-13T18:37:16.041183] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T18:37:16.417960] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-13T18:37:17.217969] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-13T18:37:17.800469] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:37:18.017936] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-13T18:37:18.742235] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T18:37:18.817993] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-13T18:37:18.887068] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:37:19.299409] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T18:37:19.617913] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-13T18:37:20.121986] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T18:37:20.417928] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-13T18:37:20.974690] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:37:21.217930] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-13T18:37:22.017925] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-13T18:37:22.423820] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T18:37:22.817969] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-13T18:37:22.949886] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T18:37:23.618015] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-13T18:37:24.053467] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:37:24.417929] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-13T18:37:25.082466] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:37:25.218006] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-13T18:37:25.281412] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:37:26.017989] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-13T18:37:26.817909] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-13T18:37:26.855340] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:37:27.065777] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:37:27.617924] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-13T18:37:27.670137] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T18:37:28.417932] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-13T18:37:29.083423] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T18:37:29.106843] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T18:37:29.108443] [INFO ] [REMOTE ] EDF: Full fetch complete (20398 records). [2025-10-13T18:37:29.108512] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-13T18:37:29.109038] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:37:29.109122] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:29.109163] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:29.109225] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-13T18:37:29.109311] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-13T18:37:29.109367] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-13T18:37:29.109534] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-10-13T18:37:29.109622] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDF took 47.8s. Estimated remaining: 3h 53m 3s. Rate: 7.2 symbols/min [2025-10-13T18:37:29.223081] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-13T18:37:29.296389] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:29.309399] [DEBUG] [LOCAL ] EEX: Loaded 10898 existing records from primary storage. [2025-10-13T18:37:29.309762] [INFO ] [MAIN ] EEX: Loaded 10898 existing records. [2025-10-13T18:37:29.496601] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:29.496885] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-13T18:37:29.496939] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-13T18:37:29.497545] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-13T18:37:29.497603] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-13T18:37:29.911243] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:30.017984] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-13T18:37:30.542991] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T18:37:30.817912] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-13T18:37:30.947536] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:37:31.617928] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-13T18:37:32.417912] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-13T18:37:32.539236] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:37:32.972572] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:37:32.972922] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T18:37:32.979728] [INFO ] [REMOTE ] EE: Full fetch complete (43968 records). [2025-10-13T18:37:32.979913] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-13T18:37:33.223221] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-13T18:37:33.378839] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-13T18:37:33.378947] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-13T18:37:33.379866] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-13T18:37:33.379934] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-13T18:37:33.381311] [DEBUG] [LOCAL ] EE: Trimmed 43968 records to 33066 (keeping 200 days of data) [2025-10-13T18:37:33.578480] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T18:37:33.598611] [DEBUG] [LOCAL ] EE: Primary data saved (33066 records). [2025-10-13T18:37:33.598866] [INFO ] [MAIN ] EE: Full history saved. [2025-10-13T18:37:33.598980] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 33.0s. Estimated remaining: 3h 52m 45s. Rate: 7.2 symbols/min [2025-10-13T18:37:33.783559] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:33.833531] [DEBUG] [LOCAL ] EFC: Loaded 47108 existing records from primary storage. [2025-10-13T18:37:33.834054] [INFO ] [MAIN ] EFC: Loaded 47108 existing records. [2025-10-13T18:37:34.019131] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-13T18:37:34.023395] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:34.024736] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-13T18:37:34.024797] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-13T18:37:34.025339] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-13T18:37:34.025413] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-13T18:37:34.384705] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:34.817920] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-13T18:37:35.293787] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:37:35.294608] [INFO ] [REMOTE ] EEA: Full fetch complete (3855 records). [2025-10-13T18:37:35.294700] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-13T18:37:35.473314] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:37:35.473708] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:35.473889] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:35.474047] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-13T18:37:35.474144] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-13T18:37:35.474260] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-13T18:37:35.474371] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-13T18:37:35.474524] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 27.0s. Estimated remaining: 3h 52m 21s. Rate: 7.2 symbols/min [2025-10-13T18:37:35.621965] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-13T18:37:35.677708] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:35.681661] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:37:35.704943] [DEBUG] [LOCAL ] EFR: Loaded 15218 existing records from primary storage. [2025-10-13T18:37:35.705183] [INFO ] [MAIN ] EFR: Loaded 15218 existing records. [2025-10-13T18:37:35.887383] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:35.887673] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-13T18:37:35.887741] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-13T18:37:35.888063] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-13T18:37:35.888127] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-13T18:37:36.246479] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:36.418033] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-13T18:37:36.632989] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:37:37.217906] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-13T18:37:38.017931] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-13T18:37:38.146520] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:37:38.278328] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T18:37:38.817902] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-13T18:37:38.982590] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:37:39.562085] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:37:39.617937] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-13T18:37:40.336989] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T18:37:40.417894] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-13T18:37:41.222283] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-13T18:37:41.540304] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:37:42.017989] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-13T18:37:42.817919] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-13T18:37:42.981543] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:37:43.047175] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:37:43.617916] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-13T18:37:44.067743] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:37:44.072152] [INFO ] [REMOTE ] EDU: Full fetch complete (66289 records). [2025-10-13T18:37:44.072275] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-13T18:37:44.073038] [FATAL] [VALIDATOR ] EDU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:37:44.073150] [FATAL] [MAIN ] EDU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:44.073219] [WARN ] [MAIN ] EDU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:44.073298] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-13T18:37:44.073361] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-10-13T18:37:44.073397] [INFO ] [LOCAL ] EDU: Starting deletion of derivative data. [2025-10-13T18:37:44.073580] [DEBUG] [LOCAL ] EDU: Deleted derivative data file. [2025-10-13T18:37:44.073705] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EDU took 49.0s. Estimated remaining: 3h 52m 14s. Rate: 7.2 symbols/min [2025-10-13T18:37:44.240806] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:44.241065] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-13T18:37:44.241192] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-13T18:37:44.241303] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-13T18:37:44.241344] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-13T18:37:44.241385] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-13T18:37:44.241416] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-13T18:37:44.423191] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-13T18:37:44.499141] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:37:44.611918] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:45.217920] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-13T18:37:45.911449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:37:46.017998] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-13T18:37:46.086669] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:37:46.817984] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-13T18:37:46.885219] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T18:37:47.617982] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-13T18:37:48.372121] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:37:48.417907] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-13T18:37:49.217965] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-13T18:37:49.255513] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T18:37:49.342414] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:37:49.978280] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T18:37:50.017925] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-13T18:37:50.817925] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-13T18:37:50.969941] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:37:51.618022] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-13T18:37:52.418000] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-13T18:37:52.468062] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:37:52.542400] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:37:53.145525] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T18:37:53.218006] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-13T18:37:53.974774] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:37:54.017965] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-13T18:37:54.673391] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:37:54.817982] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-13T18:37:55.378290] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T18:37:55.617974] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-13T18:37:56.183822] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T18:37:56.418025] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-13T18:37:57.018495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T18:37:57.217963] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-13T18:37:58.018017] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-13T18:37:58.817935] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-13T18:37:58.878996] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:37:59.203096] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:37:59.369518] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T18:37:59.371029] [INFO ] [REMOTE ] EEX: Full fetch complete (18654 records). [2025-10-13T18:37:59.371175] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-13T18:37:59.623176] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-13T18:37:59.748346] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-13T18:37:59.748454] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-13T18:37:59.749359] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-13T18:37:59.749428] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-13T18:37:59.750091] [DEBUG] [LOCAL ] EEX: Trimmed 18654 records to 10407 (keeping 200 days of data) [2025-10-13T18:37:59.814835] [DEBUG] [LOCAL ] EEX: Primary data saved (10407 records). [2025-10-13T18:37:59.815020] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-13T18:37:59.815181] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EEX took 30.7s. Estimated remaining: 3h 52m 23s. Rate: 7.2 symbols/min [2025-10-13T18:38:00.002500] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:00.054168] [DEBUG] [LOCAL ] EFX: Loaded 45270 existing records from primary storage. [2025-10-13T18:38:00.054553] [INFO ] [MAIN ] EFX: Loaded 45270 existing records. [2025-10-13T18:38:00.239505] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:00.239746] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-13T18:38:00.239805] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-13T18:38:00.240875] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-13T18:38:00.240948] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-13T18:38:00.426403] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-13T18:38:00.595261] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:01.035617] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:38:01.218050] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-13T18:38:02.017971] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-13T18:38:02.377161] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:38:02.817974] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-13T18:38:02.912101] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:38:03.167724] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:38:03.617922] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-13T18:38:03.678271] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T18:38:04.417981] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-13T18:38:05.217914] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-13T18:38:05.415060] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:38:05.417539] [INFO ] [REMOTE ] EFR: Full fetch complete (19284 records). [2025-10-13T18:38:05.417619] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-13T18:38:05.707267] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T18:38:05.868923] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-13T18:38:05.869025] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-13T18:38:05.869718] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-13T18:38:05.869784] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-13T18:38:05.870699] [DEBUG] [LOCAL ] EFR: Trimmed 19284 records to 15082 (keeping 200 days of data) [2025-10-13T18:38:05.972261] [DEBUG] [LOCAL ] EFR: Primary data saved (15082 records). [2025-10-13T18:38:05.972477] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-13T18:38:05.972598] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFR took 30.5s. Estimated remaining: 3h 52m 9s. Rate: 7.2 symbols/min [2025-10-13T18:38:06.029152] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-13T18:38:06.146038] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:06.183219] [DEBUG] [LOCAL ] EFXT: Loaded 29929 existing records from primary storage. [2025-10-13T18:38:06.183592] [INFO ] [MAIN ] EFXT: Loaded 29929 existing records. [2025-10-13T18:38:06.373284] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:06.373599] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-13T18:38:06.373682] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-13T18:38:06.374088] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-13T18:38:06.374145] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-13T18:38:06.757282] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:06.786242] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:38:06.817912] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-13T18:38:07.088805] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:38:07.618002] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-13T18:38:08.417908] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-13T18:38:08.518901] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:38:09.164143] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T18:38:09.217935] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-13T18:38:09.271056] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:38:10.008185] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:38:10.017871] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-13T18:38:10.765455] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T18:38:10.817888] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-13T18:38:11.617906] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-13T18:38:11.744208] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:38:11.746348] [INFO ] [REMOTE ] EFT: Full fetch complete (18015 records). [2025-10-13T18:38:11.746421] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-13T18:38:12.108137] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-13T18:38:12.108212] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-13T18:38:12.108627] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-13T18:38:12.108709] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-13T18:38:12.109300] [DEBUG] [LOCAL ] EFT: Trimmed 18015 records to 13195 (keeping 200 days of data) [2025-10-13T18:38:12.195630] [DEBUG] [LOCAL ] EFT: Primary data saved (13195 records). [2025-10-13T18:38:12.195804] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-13T18:38:12.195876] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFT took 28.1s. Estimated remaining: 3h 51m 56s. Rate: 7.2 symbols/min [2025-10-13T18:38:12.362775] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:12.390430] [DEBUG] [LOCAL ] EG: Loaded 28194 existing records from primary storage. [2025-10-13T18:38:12.390746] [INFO ] [MAIN ] EG: Loaded 28194 existing records. [2025-10-13T18:38:12.423205] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-13T18:38:12.568387] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:12.568640] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-13T18:38:12.568726] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-13T18:38:12.569170] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-13T18:38:12.569238] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-13T18:38:12.918534] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:13.059247] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T18:38:13.217923] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-13T18:38:14.017922] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-13T18:38:14.503098] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T18:38:14.817985] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-13T18:38:14.966119] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:38:15.617911] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-13T18:38:15.648423] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:38:16.309599] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:38:16.417882] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-13T18:38:16.853482] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T18:38:17.218017] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-13T18:38:17.803826] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:38:18.017934] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-13T18:38:18.398458] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:38:18.817910] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-13T18:38:19.497295] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:38:19.617928] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-13T18:38:19.903081] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T18:38:20.417909] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-13T18:38:21.056147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:38:21.218000] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-13T18:38:21.897833] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:38:21.902829] [INFO ] [REMOTE ] EFC: Full fetch complete (66618 records). [2025-10-13T18:38:21.902938] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-13T18:38:22.023084] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-13T18:38:22.277515] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-13T18:38:22.277598] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-13T18:38:22.278488] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-13T18:38:22.278553] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-13T18:38:22.279898] [DEBUG] [LOCAL ] EFC: Trimmed 66618 records to 46412 (keeping 200 days of data) [2025-10-13T18:38:22.559730] [DEBUG] [LOCAL ] EFC: Primary data saved (46412 records). [2025-10-13T18:38:22.559862] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-13T18:38:22.559940] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFC took 49.0s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-13T18:38:22.724330] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:22.774182] [DEBUG] [LOCAL ] EGO: Loaded 52453 existing records from primary storage. [2025-10-13T18:38:22.774518] [INFO ] [MAIN ] EGO: Loaded 52453 existing records. [2025-10-13T18:38:22.827410] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-13T18:38:22.952304] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:22.952632] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-13T18:38:22.952723] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-13T18:38:22.953270] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-13T18:38:22.953327] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-13T18:38:23.157347] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T18:38:23.293259] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:38:23.375888] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:23.617888] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-13T18:38:24.072928] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:38:24.417997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-13T18:38:25.165306] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:38:25.217981] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-13T18:38:26.017985] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-13T18:38:26.042925] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:38:26.494087] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T18:38:26.817919] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-13T18:38:27.617917] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-13T18:38:27.813951] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:38:27.911507] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:38:28.417915] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-13T18:38:28.934081] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:38:29.217892] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-13T18:38:29.906856] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:38:30.017890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-13T18:38:30.172916] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:38:30.817918] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-13T18:38:31.617895] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-13T18:38:31.692404] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:38:32.417889] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-13T18:38:32.459807] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:38:32.464266] [INFO ] [REMOTE ] EFX: Full fetch complete (64244 records). [2025-10-13T18:38:32.464352] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-13T18:38:32.465152] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:38:32.465236] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:38:32.465277] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:38:32.465314] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-13T18:38:32.465367] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-13T18:38:32.465402] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-13T18:38:32.465569] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-13T18:38:32.465712] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 32.7s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-13T18:38:32.625715] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T18:38:32.649990] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:32.687400] [DEBUG] [LOCAL ] EGP: Loaded 31009 existing records from primary storage. [2025-10-13T18:38:32.687684] [INFO ] [MAIN ] EGP: Loaded 31009 existing records. [2025-10-13T18:38:32.860958] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:32.861166] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-13T18:38:32.861211] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-13T18:38:32.861601] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-13T18:38:32.861690] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-13T18:38:33.208842] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:33.217885] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-13T18:38:33.880240] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:38:34.017882] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-13T18:38:34.628071] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:38:34.817970] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-13T18:38:35.579984] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:38:35.617909] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-13T18:38:36.238279] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:38:36.417903] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-13T18:38:37.227759] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-13T18:38:37.247022] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:38:37.970293] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:38:38.017883] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-13T18:38:38.547603] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:38:38.817918] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-13T18:38:39.396885] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:38:39.617901] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-13T18:38:40.160690] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:38:40.164245] [INFO ] [REMOTE ] EFXT: Full fetch complete (44063 records). [2025-10-13T18:38:40.164316] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-13T18:38:40.423089] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-13T18:38:40.537914] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-13T18:38:40.538035] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-13T18:38:40.538637] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-13T18:38:40.538727] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-13T18:38:40.539621] [DEBUG] [LOCAL ] EFXT: Trimmed 44063 records to 29521 (keeping 200 days of data) [2025-10-13T18:38:40.710248] [DEBUG] [LOCAL ] EFXT: Primary data saved (29521 records). [2025-10-13T18:38:40.710375] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-13T18:38:40.711239] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EFXT took 34.7s. Estimated remaining: 3h 51m 39s. Rate: 7.2 symbols/min [2025-10-13T18:38:40.898741] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:40.940325] [DEBUG] [LOCAL ] EGY: Loaded 42345 existing records from primary storage. [2025-10-13T18:38:40.940781] [INFO ] [MAIN ] EGY: Loaded 42345 existing records. [2025-10-13T18:38:41.037730] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:38:41.138681] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:41.138907] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-13T18:38:41.138952] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-13T18:38:41.139344] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-13T18:38:41.139399] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-13T18:38:41.227356] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-13T18:38:41.490018] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:42.017978] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-13T18:38:42.309075] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T18:38:42.590312] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:38:42.817933] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-13T18:38:43.618006] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-13T18:38:43.763561] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:38:44.184342] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:38:44.417905] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-13T18:38:44.741792] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:38:45.218037] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-13T18:38:46.017912] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-13T18:38:46.136504] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:38:46.670144] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:38:46.817908] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-13T18:38:47.480955] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:38:47.617918] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-13T18:38:48.147723] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:38:48.154726] [INFO ] [REMOTE ] EG: Full fetch complete (43078 records). [2025-10-13T18:38:48.154898] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-13T18:38:48.423109] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-13T18:38:48.530690] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-13T18:38:48.530776] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-13T18:38:48.531383] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-13T18:38:48.531423] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-13T18:38:48.532308] [DEBUG] [LOCAL ] EG: Trimmed 43078 records to 27796 (keeping 200 days of data) [2025-10-13T18:38:48.703972] [DEBUG] [LOCAL ] EG: Primary data saved (27796 records). [2025-10-13T18:38:48.704116] [INFO ] [MAIN ] EG: Full history saved. [2025-10-13T18:38:48.704193] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EG took 36.5s. Estimated remaining: 3h 51m 30s. Rate: 7.2 symbols/min [2025-10-13T18:38:48.897075] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:48.927498] [DEBUG] [LOCAL ] EHAB: Loaded 29667 existing records from primary storage. [2025-10-13T18:38:48.927808] [INFO ] [MAIN ] EHAB: Loaded 29667 existing records. [2025-10-13T18:38:49.105854] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:49.106220] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-13T18:38:49.106269] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-13T18:38:49.106612] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-13T18:38:49.106702] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-13T18:38:49.222565] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-13T18:38:49.450366] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T18:38:49.498887] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:50.018006] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-13T18:38:50.371023] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:38:50.638005] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:38:50.817972] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-13T18:38:51.178076] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:38:51.617969] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-13T18:38:52.098967] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T18:38:52.417986] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-13T18:38:52.954604] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:38:53.217981] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-13T18:38:54.017910] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-13T18:38:54.281731] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T18:38:54.308959] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T18:38:54.818027] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-13T18:38:55.617910] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-13T18:38:55.701897] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:38:56.236801] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:38:56.417908] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-13T18:38:56.695719] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T18:38:57.217973] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-13T18:38:57.669571] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:38:58.017929] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-13T18:38:58.356136] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T18:38:58.817986] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-13T18:38:59.606297] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:38:59.617931] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-13T18:39:00.153778] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T18:39:00.417936] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-13T18:39:00.950288] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:39:01.217989] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-13T18:39:01.596750] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:39:02.017930] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-13T18:39:02.554220] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T18:39:02.817996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-13T18:39:03.514576] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:39:03.617911] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-13T18:39:04.178123] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:39:04.418013] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-13T18:39:04.933423] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:39:05.217935] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-13T18:39:06.018032] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-13T18:39:06.311886] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T18:39:06.317364] [INFO ] [REMOTE ] EGO: Full fetch complete (73985 records). [2025-10-13T18:39:06.317501] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-13T18:39:06.496060] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:39:06.730470] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-13T18:39:06.730556] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-13T18:39:06.731439] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-13T18:39:06.731507] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-13T18:39:06.733010] [DEBUG] [LOCAL ] EGO: Trimmed 73985 records to 51689 (keeping 200 days of data) [2025-10-13T18:39:06.819960] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-13T18:39:07.042105] [DEBUG] [LOCAL ] EGO: Primary data saved (51689 records). [2025-10-13T18:39:07.042267] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-13T18:39:07.042383] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGO took 44.5s. Estimated remaining: 3h 51m 45s. Rate: 7.2 symbols/min [2025-10-13T18:39:07.209623] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:07.250915] [DEBUG] [LOCAL ] EHC: Loaded 41702 existing records from primary storage. [2025-10-13T18:39:07.251228] [INFO ] [MAIN ] EHC: Loaded 41702 existing records. [2025-10-13T18:39:07.429511] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:07.429936] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-13T18:39:07.430147] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-13T18:39:07.430732] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-13T18:39:07.430797] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-13T18:39:07.619481] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-13T18:39:07.725214] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:39:07.849402] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:08.417981] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-13T18:39:08.460457] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T18:39:08.899024] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:39:08.902362] [INFO ] [REMOTE ] EGP: Full fetch complete (45278 records). [2025-10-13T18:39:08.902496] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-13T18:39:09.225564] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-13T18:39:09.331852] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-13T18:39:09.331995] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-13T18:39:09.333037] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-13T18:39:09.333103] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-13T18:39:09.334409] [DEBUG] [LOCAL ] EGP: Trimmed 45278 records to 30338 (keeping 200 days of data) [2025-10-13T18:39:09.548626] [DEBUG] [LOCAL ] EGP: Primary data saved (30338 records). [2025-10-13T18:39:09.548854] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-13T18:39:09.548960] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGP took 37.1s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-13T18:39:09.748230] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:09.762556] [DEBUG] [LOCAL ] EHI: Loaded 10815 existing records from primary storage. [2025-10-13T18:39:09.762852] [INFO ] [MAIN ] EHI: Loaded 10815 existing records. [2025-10-13T18:39:09.970734] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:09.971274] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-13T18:39:09.971336] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-13T18:39:09.983127] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-13T18:39:09.988504] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-13T18:39:10.023246] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-13T18:39:10.080581] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:39:10.380946] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:10.823030] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-13T18:39:10.837308] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:39:11.454265] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:39:11.617935] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-13T18:39:12.039526] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:39:12.417939] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-13T18:39:12.778571] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:39:13.217912] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-13T18:39:13.425872] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:39:14.018025] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-13T18:39:14.817918] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-13T18:39:14.843225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:39:14.971024] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:39:14.973689] [INFO ] [REMOTE ] EHAB: Full fetch complete (40916 records). [2025-10-13T18:39:14.973765] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-13T18:39:15.337304] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-13T18:39:15.337383] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-13T18:39:15.337998] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-13T18:39:15.338062] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-13T18:39:15.338992] [DEBUG] [LOCAL ] EHAB: Trimmed 40916 records to 29307 (keeping 200 days of data) [2025-10-13T18:39:15.502809] [DEBUG] [LOCAL ] EHAB: Primary data saved (29307 records). [2025-10-13T18:39:15.502970] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-13T18:39:15.503058] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 26.8s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-13T18:39:15.623279] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-13T18:39:15.674522] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:15.695572] [DEBUG] [LOCAL ] EIC: Loaded 23309 existing records from primary storage. [2025-10-13T18:39:15.695832] [INFO ] [MAIN ] EIC: Loaded 23309 existing records. [2025-10-13T18:39:15.809764] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:39:15.890749] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:15.891073] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-13T18:39:15.891139] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-13T18:39:15.891495] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-13T18:39:15.891551] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-13T18:39:16.261445] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:16.417990] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-13T18:39:17.217968] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-13T18:39:17.310506] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:39:17.697440] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:39:18.018011] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-13T18:39:18.713225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:39:18.817928] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-13T18:39:19.586822] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:39:19.590803] [INFO ] [REMOTE ] EGY: Full fetch complete (60727 records). [2025-10-13T18:39:19.590890] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-13T18:39:19.591571] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:39:19.591696] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:39:19.591768] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:39:19.591854] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-13T18:39:19.591921] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-13T18:39:19.591964] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-13T18:39:19.592157] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-13T18:39:19.592918] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EGY took 38.9s. Estimated remaining: 3h 50m 50s. Rate: 7.2 symbols/min [2025-10-13T18:39:19.623119] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-13T18:39:19.763764] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:19.763977] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-13T18:39:19.764017] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-13T18:39:19.764129] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-13T18:39:19.764193] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-13T18:39:19.764235] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-13T18:39:19.764268] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-13T18:39:20.120716] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:20.219189] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T18:39:20.256232] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:39:20.417924] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-13T18:39:21.217970] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-13T18:39:21.588322] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:39:21.904014] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:39:22.017989] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-13T18:39:22.817923] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-13T18:39:23.521162] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:39:23.607009] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:39:23.617888] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-13T18:39:24.417900] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-13T18:39:24.664150] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:39:25.217919] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-13T18:39:25.828707] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:39:26.017990] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-13T18:39:26.255104] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:39:26.474703] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-13T18:39:26.817912] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-13T18:39:27.230133] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T18:39:27.617928] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-13T18:39:28.417929] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-13T18:39:29.201116] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:39:29.217876] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-13T18:39:29.767144] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T18:39:30.018008] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-13T18:39:30.666176] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:39:30.817927] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-13T18:39:31.129126] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:39:31.617971] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-13T18:39:32.198628] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:39:32.411944] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:39:32.417880] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-13T18:39:33.217902] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-13T18:39:33.230002] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T18:39:33.473101] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-13T18:39:34.017934] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-13T18:39:34.341398] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-13T18:39:34.817918] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-13T18:39:35.617922] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-13T18:39:35.998925] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:39:36.417970] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-13T18:39:37.138765] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:39:37.142819] [INFO ] [REMOTE ] EHC: Full fetch complete (58649 records). [2025-10-13T18:39:37.142913] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-13T18:39:37.223117] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-13T18:39:37.540394] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-13T18:39:37.540506] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-13T18:39:37.541370] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-13T18:39:37.541436] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-13T18:39:37.542620] [DEBUG] [LOCAL ] EHC: Trimmed 58649 records to 41048 (keeping 200 days of data) [2025-10-13T18:39:37.657712] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:39:37.788328] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:39:37.828022] [DEBUG] [LOCAL ] EHC: Primary data saved (41048 records). [2025-10-13T18:39:37.828163] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-13T18:39:37.828238] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 30.8s. Estimated remaining: 3h 51m 5s. Rate: 7.2 symbols/min [2025-10-13T18:39:37.993016] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:37.993226] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-13T18:39:37.993268] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-13T18:39:37.993376] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-13T18:39:37.993418] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-13T18:39:37.993458] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-13T18:39:37.993490] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-13T18:39:38.023127] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-13T18:39:38.348518] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:38.358622] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T18:39:38.817910] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-13T18:39:39.617927] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-13T18:39:39.935249] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:39:40.198515] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T18:39:40.417935] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-13T18:39:41.217926] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-13T18:39:41.400475] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T18:39:41.733890] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:39:42.017918] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-13T18:39:42.627182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:39:42.817914] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-13T18:39:43.253808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T18:39:43.617934] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-13T18:39:43.975214] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T18:39:44.417929] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-13T18:39:44.747609] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T18:39:45.217925] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-13T18:39:45.632284] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-13T18:39:46.018058] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-13T18:39:46.453215] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T18:39:46.818013] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-13T18:39:47.617983] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-13T18:39:47.738356] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T18:39:48.030126] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-13T18:39:48.417930] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-13T18:39:48.830314] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T18:39:48.831025] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-10-13T18:39:48.831091] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-13T18:39:49.003638] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-13T18:39:49.003889] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:39:49.003971] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:39:49.004019] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-13T18:39:49.004076] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-13T18:39:49.004109] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-13T18:39:49.004148] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-13T18:39:49.004203] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICA took 29.4s. Estimated remaining: 3h 51m 3s. Rate: 7.2 symbols/min [2025-10-13T18:39:49.169720] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:49.169932] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-13T18:39:49.169969] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-13T18:39:49.170076] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-13T18:39:49.170115] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-13T18:39:49.170154] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-13T18:39:49.170184] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-13T18:39:49.223389] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-13T18:39:49.526568] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:50.017924] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-13T18:39:50.041379] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:39:50.043920] [INFO ] [REMOTE ] EHI: Full fetch complete (16164 records). [2025-10-13T18:39:50.044030] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-13T18:39:50.434267] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-13T18:39:50.434937] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:39:50.435007] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-13T18:39:50.436848] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-13T18:39:50.436915] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-13T18:39:50.437477] [DEBUG] [LOCAL ] EHI: Trimmed 16164 records to 10658 (keeping 200 days of data) [2025-10-13T18:39:50.499457] [DEBUG] [LOCAL ] EHI: Primary data saved (10658 records). [2025-10-13T18:39:50.499602] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-13T18:39:50.499701] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EHI took 41.0s. Estimated remaining: 3h 50m 39s. Rate: 7.2 symbols/min [2025-10-13T18:39:50.669962] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:50.689019] [DEBUG] [LOCAL ] EIG: Loaded 20468 existing records from primary storage. [2025-10-13T18:39:50.689264] [INFO ] [MAIN ] EIG: Loaded 20468 existing records. [2025-10-13T18:39:50.830214] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-13T18:39:50.871862] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:50.872072] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-13T18:39:50.872117] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-13T18:39:50.872389] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-13T18:39:50.872427] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-13T18:39:51.221673] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:51.617939] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-13T18:39:51.949744] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:39:51.982797] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T18:39:52.417989] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-13T18:39:52.930364] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T18:39:53.217970] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-13T18:39:54.017900] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-13T18:39:54.166079] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T18:39:54.817912] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-13T18:39:54.836825] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:39:54.839071] [INFO ] [REMOTE ] EIC: Full fetch complete (34430 records). [2025-10-13T18:39:54.839143] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-13T18:39:55.213754] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-13T18:39:55.213845] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-13T18:39:55.214372] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-13T18:39:55.214413] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-13T18:39:55.215183] [DEBUG] [LOCAL ] EIC: Trimmed 34430 records to 22931 (keeping 200 days of data) [2025-10-13T18:39:55.354676] [DEBUG] [LOCAL ] EIC: Primary data saved (22931 records). [2025-10-13T18:39:55.354812] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-13T18:39:55.354890] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIC took 39.9s. Estimated remaining: 3h 50m 22s. Rate: 7.2 symbols/min [2025-10-13T18:39:55.390551] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T18:39:55.617934] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-13T18:39:56.179906] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:39:56.417991] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-13T18:39:56.977801] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T18:39:57.217937] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-13T18:39:57.838701] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:39:58.017930] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-13T18:39:58.579335] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:39:58.817922] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-13T18:39:59.405697] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T18:39:59.617986] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-13T18:40:00.201174] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:40:00.417992] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-13T18:40:01.088362] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:40:01.218029] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-13T18:40:01.868349] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:40:02.018005] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-13T18:40:02.817933] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-13T18:40:03.072409] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:40:03.279310] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T18:40:03.618030] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-13T18:40:04.417978] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-13T18:40:04.840574] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T18:40:04.881888] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T18:40:05.217917] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-13T18:40:06.018053] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-13T18:40:06.296091] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T18:40:06.700066] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:40:06.817897] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-13T18:40:07.576577] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T18:40:07.617904] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-13T18:40:08.172938] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T18:40:08.174149] [INFO ] [REMOTE ] EICC: Full fetch complete (8402 records). [2025-10-13T18:40:08.174242] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-13T18:40:08.174615] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:40:08.174713] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:40:08.174756] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:40:08.174793] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-13T18:40:08.174846] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-13T18:40:08.174879] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-13T18:40:08.174918] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-13T18:40:08.175054] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 19.2s. Estimated remaining: 3h 50m 24s. Rate: 7.2 symbols/min [2025-10-13T18:40:08.417991] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-13T18:40:09.013770] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T18:40:09.014559] [INFO ] [REMOTE ] EICB: Full fetch complete (2707 records). [2025-10-13T18:40:09.014626] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-13T18:40:09.188445] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T18:40:09.188691] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:40:09.188760] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:40:09.188829] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-13T18:40:09.188898] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-13T18:40:09.188933] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-13T18:40:09.188971] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-13T18:40:09.189045] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICB took 31.4s. Estimated remaining: 3h 49m 59s. Rate: 7.2 symbols/min [2025-10-13T18:40:09.217912] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-13T18:40:10.193818] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T18:40:10.198502] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-13T18:40:11.359495] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:40:11.364687] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-13T18:40:12.230874] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T18:40:12.235513] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-13T18:40:13.370283] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T18:40:13.375311] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-13T18:40:14.494416] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:40:14.500698] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-13T18:40:15.466510] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:40:15.471192] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-13T18:40:16.413739] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:40:16.416021] [INFO ] [REMOTE ] EIG: Full fetch complete (26987 records). [2025-10-13T18:40:16.416103] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-13T18:40:16.797884] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-13T18:40:16.798257] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-13T18:40:16.799008] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-13T18:40:16.799074] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-13T18:40:16.801345] [DEBUG] [LOCAL ] EIG: Trimmed 26987 records to 20178 (keeping 200 days of data) [2025-10-13T18:40:16.943940] [DEBUG] [LOCAL ] EIG: Primary data saved (20178 records). [2025-10-13T18:40:16.944091] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-13T18:40:16.944212] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIG took 26.4s. Estimated remaining: 3h 49m 49s. Rate: 7.2 symbols/min [2025-10-13T18:40:17.605676] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.740014] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.722542] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.743110] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.756219] [DEBUG] [LOCAL ] ELC: Loaded 3552 existing records from primary storage. [2025-10-13T18:40:17.756530] [INFO ] [MAIN ] ELC: Loaded 3552 existing records. [2025-10-13T18:40:17.990543] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:18.024145] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-13T18:40:18.024264] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-13T18:40:18.025281] [DEBUG] [LOCAL ] EL: Loaded 54147 existing records from primary storage. [2025-10-13T18:40:18.026215] [INFO ] [MAIN ] EL: Loaded 54147 existing records. [2025-10-13T18:40:18.049093] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-13T18:40:18.063395] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-13T18:40:18.232430] [DEBUG] [LOCAL ] ELAN: Loaded 54069 existing records from primary storage. [2025-10-13T18:40:18.258353] [INFO ] [MAIN ] ELAN: Loaded 54069 existing records. [2025-10-13T18:40:18.320999] [DEBUG] [LOCAL ] EIX: Loaded 54125 existing records from primary storage. [2025-10-13T18:40:18.379081] [INFO ] [MAIN ] EIX: Loaded 54125 existing records. [2025-10-13T18:40:18.403721] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:18.489718] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-13T18:40:18.525280] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-13T18:40:18.688105] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-13T18:40:18.791026] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-13T18:40:18.936733] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:19.040968] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:19.094193] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-13T18:40:19.056050] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-13T18:40:19.123177] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-13T18:40:19.123047] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-13T18:40:19.155716] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-13T18:40:19.162442] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-13T18:40:19.162302] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:19.163418] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-13T18:40:19.202023] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-13T18:40:19.221481] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-13T18:40:19.960939] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.006510] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-13T18:40:20.168921] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.207636] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-13T18:40:20.230730] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.231123] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-13T18:40:20.337113] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:40:20.338973] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-13T18:40:20.903296] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:40:20.904920] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-13T18:40:21.438428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T18:40:21.439947] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-13T18:40:21.864948] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:40:21.876571] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-13T18:40:21.928673] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:40:21.940616] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-13T18:40:22.024783] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T18:40:22.029945] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-13T18:40:22.033179] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T18:40:22.610703] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:40:22.817997] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-13T18:40:23.333338] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T18:40:23.608785] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:40:23.619059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-13T18:40:23.812861] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T18:40:23.970624] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T18:40:24.418015] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-13T18:40:25.000124] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T18:40:25.217925] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-13T18:40:26.017939] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-13T18:40:26.817972] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-13T18:40:26.900334] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:40:27.294415] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T18:40:27.617906] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-13T18:40:27.653302] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:40:28.124196] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T18:40:28.417930] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-13T18:40:29.217977] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-13T18:40:29.735321] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T18:40:29.736483] [INFO ] [REMOTE ] ELC: Full fetch complete (5043 records). [2025-10-13T18:40:29.736556] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-13T18:40:30.019737] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-13T18:40:30.120635] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-13T18:40:30.120786] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-13T18:40:30.121093] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-13T18:40:30.121136] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-13T18:40:30.121568] [DEBUG] [LOCAL ] ELC: Trimmed 5043 records to 3505 (keeping 200 days of data) [2025-10-13T18:40:30.144809] [DEBUG] [LOCAL ] ELC: Primary data saved (3505 records). [2025-10-13T18:40:30.144928] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-13T18:40:30.145040] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 13.2s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-13T18:40:30.327615] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:30.361944] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T18:40:30.428326] [DEBUG] [LOCAL ] ELF: Loaded 52787 existing records from primary storage. [2025-10-13T18:40:30.428787] [INFO ] [MAIN ] ELF: Loaded 52787 existing records. [2025-10-13T18:40:30.610173] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:30.610481] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-13T18:40:30.610534] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-13T18:40:30.611118] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-13T18:40:30.611176] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-13T18:40:30.823159] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-13T18:40:30.979563] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:31.617918] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-13T18:40:31.763659] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:40:32.418002] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-13T18:40:32.917991] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:40:33.217896] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-13T18:40:33.543639] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T18:40:34.017937] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-13T18:40:34.232871] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:40:34.817935] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-13T18:40:34.874118] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:40:35.617923] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-13T18:40:35.865967] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T18:40:36.417894] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-13T18:40:36.798320] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T18:40:37.217915] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-13T18:40:37.531723] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T18:40:38.017981] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-13T18:40:38.107717] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:40:38.817905] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-13T18:40:39.203889] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T18:40:39.618016] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-13T18:40:40.057758] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T18:40:40.425412] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-13T18:40:40.454318] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:40:41.217990] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-13T18:40:41.953689] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-13T18:40:42.017967] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-13T18:40:42.403360] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:40:42.817968] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-13T18:40:43.403249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-13T18:40:43.617933] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-13T18:40:44.164031] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T18:40:44.418002] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-13T18:40:45.002627] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T18:40:45.217918] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-13T18:40:45.736231] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T18:40:46.018005] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-13T18:40:46.450227] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T18:40:46.783816] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:40:46.817991] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-13T18:40:47.617990] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-13T18:40:48.177303] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-13T18:40:48.418000] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-13T18:40:48.914915] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T18:40:49.217921] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-13T18:40:49.537408] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T18:40:49.889167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:40:50.017959] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-13T18:40:50.817940] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-13T18:40:51.312562] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T18:40:51.617978] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-13T18:40:51.841882] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:40:52.410559] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:40:52.416036] [INFO ] [REMOTE ] EIX: Full fetch complete (77149 records). [2025-10-13T18:40:52.416163] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-13T18:40:52.428175] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-13T18:40:52.815528] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-13T18:40:52.815764] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-13T18:40:52.816801] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-13T18:40:52.816885] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-13T18:40:52.818578] [DEBUG] [LOCAL ] EIX: Trimmed 77149 records to 53364 (keeping 200 days of data) [2025-10-13T18:40:52.953102] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T18:40:53.190796] [DEBUG] [LOCAL ] EIX: Primary data saved (53364 records). [2025-10-13T18:40:53.190936] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-13T18:40:53.191011] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EIX took 36.2s. Estimated remaining: 3h 50m 17s. Rate: 7.2 symbols/min [2025-10-13T18:40:53.223018] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-13T18:40:53.358471] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:53.358673] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-13T18:40:53.358727] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-13T18:40:53.358832] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-13T18:40:53.358873] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-13T18:40:53.358928] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-13T18:40:53.358961] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-13T18:40:53.704906] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:54.017969] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-13T18:40:54.141934] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:40:54.147783] [INFO ] [REMOTE ] ELAN: Full fetch complete (76873 records). [2025-10-13T18:40:54.147978] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-13T18:40:54.547270] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-13T18:40:54.547387] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-13T18:40:54.548330] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-13T18:40:54.548394] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-13T18:40:54.549864] [DEBUG] [LOCAL ] ELAN: Trimmed 76873 records to 53299 (keeping 200 days of data) [2025-10-13T18:40:54.822602] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-13T18:40:54.864525] [DEBUG] [LOCAL ] ELAN: Primary data saved (53299 records). [2025-10-13T18:40:54.864633] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-13T18:40:54.864760] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 37.9s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-13T18:40:55.036635] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:55.060151] [DEBUG] [LOCAL ] ELP: Loaded 25987 existing records from primary storage. [2025-10-13T18:40:55.060414] [INFO ] [MAIN ] ELP: Loaded 25987 existing records. [2025-10-13T18:40:55.246290] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:55.246688] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-13T18:40:55.246848] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-13T18:40:55.247815] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-13T18:40:55.247878] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-13T18:40:55.553450] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T18:40:55.626148] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-13T18:40:55.669837] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:55.918526] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:40:56.375701] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T18:40:56.381582] [INFO ] [REMOTE ] EL: Full fetch complete (77270 records). [2025-10-13T18:40:56.381753] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-13T18:40:56.423561] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-13T18:40:56.450008] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:40:56.804528] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-13T18:40:56.804630] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-13T18:40:56.805515] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-13T18:40:56.805562] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-13T18:40:56.807020] [DEBUG] [LOCAL ] EL: Trimmed 77270 records to 53376 (keeping 200 days of data) [2025-10-13T18:40:57.133941] [DEBUG] [LOCAL ] EL: Primary data saved (53376 records). [2025-10-13T18:40:57.134098] [INFO ] [MAIN ] EL: Full history saved. [2025-10-13T18:40:57.134925] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 40.2s. Estimated remaining: 3h 49m 31s. Rate: 7.2 symbols/min [2025-10-13T18:40:57.223109] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-13T18:40:57.326367] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:57.326546] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-13T18:40:57.326582] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-13T18:40:57.326720] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-13T18:40:57.326767] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-13T18:40:57.326808] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-13T18:40:57.326841] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-13T18:40:57.675317] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:57.807365] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T18:40:58.021689] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-13T18:40:58.192117] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T18:40:58.817979] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-13T18:40:59.186839] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:40:59.617982] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-13T18:41:00.418011] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-13T18:41:00.894487] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-13T18:41:01.094217] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T18:41:01.219755] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-13T18:41:01.223353] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:41:02.018002] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-13T18:41:02.383381] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:41:02.817973] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-13T18:41:03.526767] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:41:03.559510] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:41:03.617901] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-13T18:41:03.951788] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T18:41:04.417924] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-13T18:41:05.218000] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-13T18:41:06.017919] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-13T18:41:06.323681] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:41:06.334910] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-13T18:41:06.568259] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-13T18:41:06.817907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-13T18:41:07.290732] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T18:41:07.617930] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-13T18:41:08.417926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-13T18:41:09.217940] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-13T18:41:09.473979] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:41:09.615969] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:41:10.017978] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-13T18:41:10.639152] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:41:10.817910] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-13T18:41:11.303369] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:41:11.617925] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-13T18:41:12.230604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:41:12.417894] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-13T18:41:12.763967] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:41:12.797536] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:41:13.217926] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-13T18:41:14.018014] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-13T18:41:14.817909] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-13T18:41:15.125533] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T18:41:15.257482] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T18:41:15.263325] [INFO ] [REMOTE ] ELF: Full fetch complete (75300 records). [2025-10-13T18:41:15.263491] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-13T18:41:15.611473] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:41:15.624477] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-13T18:41:15.724926] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-13T18:41:15.725029] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-13T18:41:15.726015] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-13T18:41:15.726082] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-13T18:41:15.727708] [DEBUG] [LOCAL ] ELF: Trimmed 75300 records to 52038 (keeping 200 days of data) [2025-10-13T18:41:16.037807] [DEBUG] [LOCAL ] ELF: Primary data saved (52038 records). [2025-10-13T18:41:16.038002] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-13T18:41:16.038122] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 45.9s. Estimated remaining: 3h 49m 47s. Rate: 7.2 symbols/min [2025-10-13T18:41:16.130288] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T18:41:16.210100] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:16.254282] [DEBUG] [LOCAL ] ELS: Loaded 50519 existing records from primary storage. [2025-10-13T18:41:16.254615] [INFO ] [MAIN ] ELS: Loaded 50519 existing records. [2025-10-13T18:41:16.423595] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-13T18:41:16.428113] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:16.428313] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-13T18:41:16.428383] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-13T18:41:16.429459] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-13T18:41:16.429515] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-13T18:41:16.796565] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:16.843909] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:41:17.217940] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-13T18:41:18.017923] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-13T18:41:18.693458] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:41:18.817936] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-13T18:41:19.339939] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T18:41:19.617926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-13T18:41:20.417904] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-13T18:41:20.504356] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:41:20.853937] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:41:21.217935] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-13T18:41:21.477594] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-13T18:41:21.936520] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T18:41:22.017887] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-13T18:41:22.817921] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-13T18:41:23.564735] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:41:23.617884] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-13T18:41:24.267144] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:41:24.417899] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-13T18:41:25.142839] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:41:25.147118] [INFO ] [REMOTE ] ELME: Full fetch complete (55962 records). [2025-10-13T18:41:25.147259] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-13T18:41:25.223140] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-13T18:41:25.562279] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-13T18:41:25.562382] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-13T18:41:25.563231] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-13T18:41:25.563298] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-13T18:41:25.564773] [DEBUG] [LOCAL ] ELME: Trimmed 55962 records to 39410 (keeping 200 days of data) [2025-10-13T18:41:25.805029] [DEBUG] [LOCAL ] ELME: Primary data saved (39410 records). [2025-10-13T18:41:25.805174] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-13T18:41:25.805266] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELME took 32.6s. Estimated remaining: 3h 49m 42s. Rate: 7.2 symbols/min [2025-10-13T18:41:25.976793] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:26.011166] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:41:26.024214] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-13T18:41:26.034820] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:41:26.085603] [DEBUG] [LOCAL ] ELV: Loaded 51348 existing records from primary storage. [2025-10-13T18:41:26.085983] [INFO ] [MAIN ] ELV: Loaded 51348 existing records. [2025-10-13T18:41:26.258500] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:26.258822] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-13T18:41:26.258877] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-13T18:41:26.259563] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-13T18:41:26.259621] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-13T18:41:26.608827] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:41:26.613225] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:26.613959] [INFO ] [REMOTE ] ELPC: Full fetch complete (1412 records). [2025-10-13T18:41:26.614236] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-13T18:41:26.789145] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-13T18:41:26.789344] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:41:26.789388] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:41:26.789427] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-13T18:41:26.789482] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-13T18:41:26.789517] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-13T18:41:26.789555] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-13T18:41:26.789609] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELPC took 29.7s. Estimated remaining: 3h 49m 16s. Rate: 7.2 symbols/min [2025-10-13T18:41:26.823151] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-13T18:41:26.961265] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:26.961483] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-13T18:41:26.961518] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-13T18:41:26.961661] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-13T18:41:26.961718] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-13T18:41:26.961762] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-13T18:41:26.961795] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-13T18:41:27.351253] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:27.617923] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-13T18:41:28.417909] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-13T18:41:28.496111] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:41:29.217903] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-13T18:41:29.466863] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:41:29.467248] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-13T18:41:29.467361] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:41:29.467438] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-13T18:41:29.467513] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:41:29.467614] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-13T18:41:29.467744] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-13T18:41:29.467817] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-13T18:41:29.467924] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-13T18:41:29.468044] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. EMA took 2.7s. Estimated remaining: 3h 48m 55s. Rate: 7.2 symbols/min [2025-10-13T18:41:29.654826] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:29.701117] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-13T18:41:29.719133] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:41:29.723355] [INFO ] [REMOTE ] ELP: Full fetch complete (36692 records). [2025-10-13T18:41:29.723475] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-13T18:41:29.780010] [DEBUG] [LOCAL ] EMD: Loaded 21449 existing records from primary storage. [2025-10-13T18:41:29.800029] [INFO ] [MAIN ] EMD: Loaded 21449 existing records. [2025-10-13T18:41:30.043263] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-13T18:41:30.139370] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:30.164705] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-13T18:41:30.203819] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-13T18:41:30.230476] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-13T18:41:30.240613] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-13T18:41:30.484500] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-13T18:41:30.494739] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-13T18:41:30.495407] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-13T18:41:30.509430] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-13T18:41:30.528100] [DEBUG] [LOCAL ] ELP: Trimmed 36692 records to 25644 (keeping 200 days of data) [2025-10-13T18:41:30.796437] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:30.818077] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-13T18:41:30.859326] [DEBUG] [LOCAL ] ELP: Primary data saved (25644 records). [2025-10-13T18:41:30.859481] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-13T18:41:30.859573] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELP took 36.0s. Estimated remaining: 3h 48m 31s. Rate: 7.2 symbols/min [2025-10-13T18:41:31.024675] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:31.024889] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-13T18:41:31.024932] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-13T18:41:31.025041] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-13T18:41:31.025083] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-13T18:41:31.025123] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-13T18:41:31.025155] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-13T18:41:31.370450] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:31.617896] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-13T18:41:32.053409] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:41:32.348449] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:41:32.417918] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-13T18:41:32.715976] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T18:41:33.217916] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-13T18:41:33.447193] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T18:41:34.017924] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-13T18:41:34.606820] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:41:34.817925] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-13T18:41:35.096977] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:41:35.617929] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-13T18:41:36.331065] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:41:36.417922] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-13T18:41:37.217928] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-13T18:41:37.387245] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T18:41:38.019071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-13T18:41:38.020815] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T18:41:38.817984] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-13T18:41:38.916083] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:41:39.054183] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:41:39.617937] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-13T18:41:40.227519] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:41:40.417927] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-13T18:41:40.709009] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T18:41:41.218014] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-13T18:41:41.899865] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:41:42.017918] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-13T18:41:42.739142] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:41:42.817978] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-13T18:41:43.542131] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:41:43.617929] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-13T18:41:44.386671] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:41:44.417888] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-13T18:41:44.626363] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:41:45.217984] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-13T18:41:45.831083] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:41:46.018054] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-13T18:41:46.197287] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T18:41:46.817991] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-13T18:41:47.617973] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-13T18:41:47.775076] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:41:47.966786] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T18:41:48.417983] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-13T18:41:48.865610] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:41:49.218023] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-13T18:41:49.467593] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:41:50.018031] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-13T18:41:50.817905] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-13T18:41:50.872778] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:41:50.878290] [INFO ] [REMOTE ] ELS: Full fetch complete (71009 records). [2025-10-13T18:41:50.878430] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-13T18:41:51.262545] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-13T18:41:51.262624] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-13T18:41:51.263541] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-13T18:41:51.263599] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-13T18:41:51.265120] [DEBUG] [LOCAL ] ELS: Trimmed 71009 records to 49898 (keeping 200 days of data) [2025-10-13T18:41:51.602201] [DEBUG] [LOCAL ] ELS: Primary data saved (49898 records). [2025-10-13T18:41:51.604165] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:41:51.603103] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-13T18:41:51.613935] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELS took 35.6s. Estimated remaining: 3h 48m 51s. Rate: 7.2 symbols/min [2025-10-13T18:41:51.625554] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-13T18:41:51.810612] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:51.815544] [DEBUG] [LOCAL ] EMF: Loaded 3314 existing records from primary storage. [2025-10-13T18:41:51.815775] [INFO ] [MAIN ] EMF: Loaded 3314 existing records. [2025-10-13T18:41:51.993997] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:51.994410] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-13T18:41:51.994568] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-13T18:41:51.994781] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-13T18:41:51.994850] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-13T18:41:52.372920] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:52.375481] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:41:52.417888] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-13T18:41:52.537441] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T18:41:53.217938] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-13T18:41:53.509115] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:41:54.018018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-13T18:41:54.263244] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T18:41:54.265715] [INFO ] [REMOTE ] EMD: Full fetch complete (32048 records). [2025-10-13T18:41:54.265794] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-13T18:41:54.266317] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:41:54.266406] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:41:54.266484] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:41:54.266574] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-13T18:41:54.266687] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-13T18:41:54.266798] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-13T18:41:54.266969] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-13T18:41:54.267058] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 24.8s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-13T18:41:54.438639] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:54.491366] [DEBUG] [LOCAL ] EMN: Loaded 51344 existing records from primary storage. [2025-10-13T18:41:54.491776] [INFO ] [MAIN ] EMN: Loaded 51344 existing records. [2025-10-13T18:41:54.670515] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:54.670751] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-13T18:41:54.670813] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-13T18:41:54.671462] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-13T18:41:54.671522] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-13T18:41:54.823078] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-13T18:41:55.081207] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:55.617899] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-13T18:41:55.671753] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:41:56.418030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-13T18:41:56.451176] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:41:56.967481] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:41:57.217987] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-13T18:41:57.441903] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:41:58.017925] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-13T18:41:58.817920] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-13T18:41:59.132222] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T18:41:59.295124] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T18:41:59.313320] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T18:41:59.617925] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-13T18:42:00.418040] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-13T18:42:01.054153] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T18:42:01.057452] [INFO ] [REMOTE ] EME: Full fetch complete (46874 records). [2025-10-13T18:42:01.057555] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-13T18:42:01.226162] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-13T18:42:01.440914] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-13T18:42:01.440988] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-13T18:42:01.441564] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-13T18:42:01.441603] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-13T18:42:01.442523] [DEBUG] [LOCAL ] EME: Trimmed 46874 records to 31109 (keeping 200 days of data) [2025-10-13T18:42:01.636767] [DEBUG] [LOCAL ] EME: Primary data saved (31109 records). [2025-10-13T18:42:01.636898] [INFO ] [MAIN ] EME: Full history saved. [2025-10-13T18:42:01.636967] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 30.8s. Estimated remaining: 3h 48m 19s. Rate: 7.2 symbols/min [2025-10-13T18:42:01.806523] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:01.821199] [DEBUG] [LOCAL ] EMO: Loaded 13185 existing records from primary storage. [2025-10-13T18:42:01.821382] [INFO ] [MAIN ] EMO: Loaded 13185 existing records. [2025-10-13T18:42:01.996379] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:01.996575] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-13T18:42:01.996620] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-13T18:42:01.996825] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-13T18:42:01.996871] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-13T18:42:02.026809] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-13T18:42:02.358349] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:02.388091] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T18:42:02.620513] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:42:02.817903] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-13T18:42:03.316822] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:42:03.388370] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:42:03.617943] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-13T18:42:04.417995] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-13T18:42:04.550173] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:42:05.217923] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-13T18:42:05.910138] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T18:42:06.018133] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-13T18:42:06.095017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:42:06.817909] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-13T18:42:07.540027] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:42:07.617899] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-13T18:42:08.417977] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-13T18:42:08.821269] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:42:08.914580] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:42:09.217922] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-13T18:42:09.885043] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T18:42:10.017917] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-13T18:42:10.817901] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-13T18:42:10.830285] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:42:10.925306] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T18:42:11.618007] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-13T18:42:12.417907] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-13T18:42:12.665859] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:42:12.910452] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T18:42:13.024568] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:42:13.217935] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-13T18:42:14.017936] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-13T18:42:14.029037] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T18:42:14.490805] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T18:42:14.817927] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-13T18:42:15.617923] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-13T18:42:16.418036] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-13T18:42:16.899471] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:42:17.217943] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-13T18:42:17.369972] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:42:17.776764] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:42:18.017975] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-13T18:42:18.817969] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-13T18:42:18.892012] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:42:18.897934] [INFO ] [REMOTE ] ELV: Full fetch complete (73050 records). [2025-10-13T18:42:18.898126] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-13T18:42:19.161936] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:42:19.322073] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-13T18:42:19.322163] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-13T18:42:19.323206] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-13T18:42:19.323272] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-13T18:42:19.324770] [DEBUG] [LOCAL ] ELV: Trimmed 73050 records to 50650 (keeping 200 days of data) [2025-10-13T18:42:19.421291] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:42:19.630164] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-13T18:42:19.650771] [DEBUG] [LOCAL ] ELV: Primary data saved (50650 records). [2025-10-13T18:42:19.650922] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-13T18:42:19.651009] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. ELV took 53.8s. Estimated remaining: 3h 48m 32s. Rate: 7.2 symbols/min [2025-10-13T18:42:19.850246] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:19.856393] [DEBUG] [LOCAL ] EMP: Loaded 3112 existing records from primary storage. [2025-10-13T18:42:19.856778] [INFO ] [MAIN ] EMP: Loaded 3112 existing records. [2025-10-13T18:42:20.038514] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:20.038799] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-13T18:42:20.038848] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-13T18:42:20.039034] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-13T18:42:20.039089] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-13T18:42:20.396724] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:42:20.402108] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:20.417880] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-13T18:42:21.217899] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-13T18:42:21.519878] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T18:42:21.831054] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:42:22.017931] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-13T18:42:22.817965] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-13T18:42:23.073129] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T18:42:23.075413] [INFO ] [REMOTE ] EMO: Full fetch complete (17674 records). [2025-10-13T18:42:23.075495] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-13T18:42:23.444885] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-13T18:42:23.445006] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-13T18:42:23.445475] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-13T18:42:23.445547] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-13T18:42:23.447110] [DEBUG] [LOCAL ] EMO: Trimmed 17674 records to 13184 (keeping 200 days of data) [2025-10-13T18:42:23.528535] [DEBUG] [LOCAL ] EMO: Primary data saved (13184 records). [2025-10-13T18:42:23.528711] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-13T18:42:23.528946] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 21.9s. Estimated remaining: 3h 48m 14s. Rate: 7.2 symbols/min [2025-10-13T18:42:23.625100] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-13T18:42:23.702183] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:23.757033] [DEBUG] [LOCAL ] EMR: Loaded 53997 existing records from primary storage. [2025-10-13T18:42:23.757373] [INFO ] [MAIN ] EMR: Loaded 53997 existing records. [2025-10-13T18:42:23.933670] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:23.933915] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-13T18:42:23.933963] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-13T18:42:23.934554] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-13T18:42:23.934621] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-13T18:42:24.309523] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:24.317891] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T18:42:24.417900] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-13T18:42:24.604536] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:42:24.882369] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T18:42:25.217938] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-13T18:42:26.017941] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-13T18:42:26.453549] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T18:42:26.817896] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-13T18:42:27.153730] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:42:27.617918] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-13T18:42:28.417941] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-13T18:42:28.565443] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:42:28.957120] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T18:42:29.217936] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-13T18:42:29.681890] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T18:42:29.713319] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T18:42:30.017917] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-13T18:42:30.650438] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:42:30.817903] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-13T18:42:31.617983] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-13T18:42:32.162300] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T18:42:32.417928] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-13T18:42:32.639126] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T18:42:33.173311] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T18:42:33.217887] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-13T18:42:33.674135] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T18:42:34.017927] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-13T18:42:34.817920] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-13T18:42:35.435152] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:42:35.619105] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T18:42:35.617994] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-13T18:42:36.417922] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-13T18:42:36.939473] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:42:37.217924] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-13T18:42:37.334551] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:42:37.342165] [INFO ] [REMOTE ] EMN: Full fetch complete (72120 records). [2025-10-13T18:42:37.342289] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-13T18:42:37.721550] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-13T18:42:37.721634] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-13T18:42:37.722497] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-13T18:42:37.722562] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-13T18:42:37.724165] [DEBUG] [LOCAL ] EMN: Trimmed 72120 records to 50714 (keeping 200 days of data) [2025-10-13T18:42:38.018489] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-13T18:42:38.033563] [DEBUG] [LOCAL ] EMN: Primary data saved (50714 records). [2025-10-13T18:42:38.033713] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-13T18:42:38.034541] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 43.8s. Estimated remaining: 3h 48m 19s. Rate: 7.2 symbols/min [2025-10-13T18:42:38.202332] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:38.259455] [DEBUG] [LOCAL ] ENB: Loaded 54289 existing records from primary storage. [2025-10-13T18:42:38.259890] [INFO ] [MAIN ] ENB: Loaded 54289 existing records. [2025-10-13T18:42:38.452934] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:38.453210] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-13T18:42:38.453259] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-13T18:42:38.453865] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-13T18:42:38.453922] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-13T18:42:38.812587] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:38.817920] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-13T18:42:39.049351] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:42:39.050888] [INFO ] [REMOTE ] EMF: Full fetch complete (6717 records). [2025-10-13T18:42:39.050995] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-13T18:42:39.195499] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T18:42:39.414938] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T18:42:39.509177] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-13T18:42:39.509282] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-13T18:42:39.509573] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-13T18:42:39.509617] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-13T18:42:39.510082] [DEBUG] [LOCAL ] EMF: Trimmed 6717 records to 3279 (keeping 200 days of data) [2025-10-13T18:42:39.533079] [DEBUG] [LOCAL ] EMF: Primary data saved (3279 records). [2025-10-13T18:42:39.533287] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-13T18:42:39.533428] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMF took 47.9s. Estimated remaining: 3h 47m 55s. Rate: 7.2 symbols/min [2025-10-13T18:42:39.623138] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-13T18:42:39.719489] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:39.726402] [DEBUG] [LOCAL ] ENFY: Loaded 3344 existing records from primary storage. [2025-10-13T18:42:39.726684] [INFO ] [MAIN ] ENFY: Loaded 3344 existing records. [2025-10-13T18:42:39.912018] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:39.912321] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-13T18:42:39.912371] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-13T18:42:39.912575] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-13T18:42:39.912627] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-13T18:42:40.304045] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:40.417926] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-13T18:42:40.948343] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T18:42:40.949224] [INFO ] [REMOTE ] EMP: Full fetch complete (4259 records). [2025-10-13T18:42:40.949295] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-13T18:42:41.223101] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-13T18:42:41.316971] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-13T18:42:41.317051] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-13T18:42:41.317226] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-13T18:42:41.317288] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-13T18:42:41.317698] [DEBUG] [LOCAL ] EMP: Trimmed 4259 records to 3063 (keeping 200 days of data) [2025-10-13T18:42:41.337338] [DEBUG] [LOCAL ] EMP: Primary data saved (3063 records). [2025-10-13T18:42:41.337479] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-13T18:42:41.337580] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMP took 21.7s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-13T18:42:41.522426] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:41.571800] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T18:42:41.627576] [DEBUG] [LOCAL ] ENIC: Loaded 36820 existing records from primary storage. [2025-10-13T18:42:41.628166] [INFO ] [MAIN ] ENIC: Loaded 36820 existing records. [2025-10-13T18:42:41.839916] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:41.840208] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-13T18:42:41.840256] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-13T18:42:41.840890] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-13T18:42:41.840951] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-13T18:42:42.018423] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-13T18:42:42.255615] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:42:42.307583] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:42.817996] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-13T18:42:43.595439] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T18:42:43.617877] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-13T18:42:43.805341] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:42:44.012202] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T18:42:44.417927] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-13T18:42:45.217943] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-13T18:42:45.756594] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:42:46.017895] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-13T18:42:46.817986] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-13T18:42:47.293989] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:42:47.296853] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-13T18:42:47.410151] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:42:47.617899] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-13T18:42:48.417938] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-13T18:42:49.217917] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-13T18:42:49.372700] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:42:50.017916] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-13T18:42:50.214243] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T18:42:50.239715] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T18:42:50.817919] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-13T18:42:51.617979] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-13T18:42:51.817556] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:42:52.417978] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-13T18:42:52.909442] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T18:42:52.935436] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T18:42:53.223095] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-13T18:42:53.235597] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:42:53.786772] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T18:42:54.017913] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-13T18:42:54.818006] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-13T18:42:55.617997] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-13T18:42:55.857435] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:42:56.303584] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:42:56.418041] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-13T18:42:57.217928] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-13T18:42:57.574788] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T18:42:57.597253] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-13T18:42:57.819529] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:42:58.017909] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-13T18:42:58.817998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-13T18:42:59.617997] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-13T18:42:59.845979] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:43:00.405996] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:43:00.417889] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-13T18:43:01.160795] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:43:01.217926] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-13T18:43:01.882169] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:43:02.017984] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-13T18:43:02.078000] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T18:43:02.082918] [INFO ] [REMOTE ] EMR: Full fetch complete (76699 records). [2025-10-13T18:43:02.083045] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-13T18:43:02.083806] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:43:02.083895] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:43:02.083937] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:43:02.083975] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-13T18:43:02.084029] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-13T18:43:02.084064] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-13T18:43:02.084268] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-13T18:43:02.084380] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 38.6s. Estimated remaining: 3h 47m 52s. Rate: 7.2 symbols/min [2025-10-13T18:43:02.252603] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:02.256252] [DEBUG] [LOCAL ] ENO: Loaded 1913 existing records from primary storage. [2025-10-13T18:43:02.256404] [INFO ] [MAIN ] ENO: Loaded 1913 existing records. [2025-10-13T18:43:02.431225] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:02.431468] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-13T18:43:02.431514] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-13T18:43:02.431688] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-13T18:43:02.431744] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-13T18:43:02.792908] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:02.817892] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-13T18:43:03.620009] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-13T18:43:03.620211] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:43:04.044920] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T18:43:04.417941] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-13T18:43:05.020215] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T18:43:05.041134] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T18:43:05.217979] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-13T18:43:05.692779] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:43:06.017901] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-13T18:43:06.519330] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:43:06.818002] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-13T18:43:07.617935] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-13T18:43:08.197202] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:43:08.417937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-13T18:43:08.704311] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T18:43:08.857234] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:43:09.218006] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-13T18:43:09.834117] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T18:43:10.017911] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-13T18:43:10.462496] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T18:43:10.817899] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-13T18:43:11.426874] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:43:11.617896] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-13T18:43:12.418012] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-13T18:43:13.169782] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:43:13.217894] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-13T18:43:14.017929] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-13T18:43:14.409688] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T18:43:14.411362] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T18:43:14.553096] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:43:14.817924] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-13T18:43:15.617985] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-13T18:43:16.207827] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:43:16.295747] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:43:16.297189] [INFO ] [REMOTE ] ENFY: Full fetch complete (5886 records). [2025-10-13T18:43:16.297261] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-13T18:43:16.433162] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-13T18:43:16.647529] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-13T18:43:16.647612] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-13T18:43:16.647815] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-13T18:43:16.647874] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-13T18:43:16.648264] [DEBUG] [LOCAL ] ENFY: Trimmed 5886 records to 3596 (keeping 200 days of data) [2025-10-13T18:43:16.668522] [DEBUG] [LOCAL ] ENFY: Primary data saved (3596 records). [2025-10-13T18:43:16.668591] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-13T18:43:16.668687] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENFY took 37.1s. Estimated remaining: 3h 47m 57s. Rate: 7.2 symbols/min [2025-10-13T18:43:16.838091] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:16.882523] [DEBUG] [LOCAL ] ENOV: Loaded 45382 existing records from primary storage. [2025-10-13T18:43:16.882894] [INFO ] [MAIN ] ENOV: Loaded 45382 existing records. [2025-10-13T18:43:17.062945] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:17.063156] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-13T18:43:17.063201] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-13T18:43:17.063775] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-13T18:43:17.063831] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-13T18:43:17.222715] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-13T18:43:17.437447] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:18.017902] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-13T18:43:18.143164] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:43:18.148211] [INFO ] [REMOTE ] ENB: Full fetch complete (77099 records). [2025-10-13T18:43:18.148357] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-13T18:43:18.149206] [FATAL] [VALIDATOR ] ENB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:43:18.149297] [FATAL] [MAIN ] ENB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:43:18.149338] [WARN ] [MAIN ] ENB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:43:18.149377] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-13T18:43:18.149432] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-13T18:43:18.149466] [INFO ] [LOCAL ] ENB: Starting deletion of derivative data. [2025-10-13T18:43:18.149677] [DEBUG] [LOCAL ] ENB: Deleted derivative data file. [2025-10-13T18:43:18.150462] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 40.1s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-13T18:43:18.316924] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:18.319772] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T18:43:18.362858] [DEBUG] [LOCAL ] ENR: Loaded 43873 existing records from primary storage. [2025-10-13T18:43:18.363141] [INFO ] [MAIN ] ENR: Loaded 43873 existing records. [2025-10-13T18:43:18.541428] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:18.549001] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-13T18:43:18.549816] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:43:18.549518] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-13T18:43:18.550929] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-13T18:43:18.553105] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-13T18:43:18.584423] [INFO ] [REMOTE ] ENIC: Full fetch complete (51405 records). [2025-10-13T18:43:18.616212] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-13T18:43:18.833467] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-13T18:43:19.280791] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:19.294108] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-13T18:43:19.294222] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-13T18:43:19.294989] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-13T18:43:19.295052] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-13T18:43:19.296253] [DEBUG] [LOCAL ] ENIC: Trimmed 51405 records to 36489 (keeping 200 days of data) [2025-10-13T18:43:19.386148] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T18:43:19.501841] [DEBUG] [LOCAL ] ENIC: Primary data saved (36489 records). [2025-10-13T18:43:19.501978] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-13T18:43:19.502054] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENIC took 38.2s. Estimated remaining: 3h 47m 10s. Rate: 7.2 symbols/min [2025-10-13T18:43:19.623190] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-13T18:43:19.670197] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:19.701222] [DEBUG] [LOCAL ] ENS: Loaded 29670 existing records from primary storage. [2025-10-13T18:43:19.701484] [INFO ] [MAIN ] ENS: Loaded 29670 existing records. [2025-10-13T18:43:19.875860] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:19.876097] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-13T18:43:19.876143] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-13T18:43:19.876538] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-13T18:43:19.876594] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-13T18:43:20.224398] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:20.417888] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-13T18:43:21.192718] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:43:21.217915] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-13T18:43:21.590816] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:43:22.017971] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-13T18:43:22.679581] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:43:22.817920] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-13T18:43:23.092309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:43:23.275326] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:43:23.276101] [INFO ] [REMOTE ] ENO: Full fetch complete (3079 records). [2025-10-13T18:43:23.276166] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-13T18:43:23.621303] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-13T18:43:23.621890] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-13T18:43:23.622032] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-13T18:43:23.622182] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-13T18:43:23.622258] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-13T18:43:23.623955] [DEBUG] [LOCAL ] ENO: Trimmed 3079 records to 1870 (keeping 200 days of data) [2025-10-13T18:43:23.636034] [DEBUG] [LOCAL ] ENO: Primary data saved (1870 records). [2025-10-13T18:43:23.636117] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-13T18:43:23.636194] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENO took 21.6s. Estimated remaining: 3h 46m 52s. Rate: 7.2 symbols/min [2025-10-13T18:43:23.803510] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:23.831638] [DEBUG] [LOCAL ] ENVA: Loaded 25677 existing records from primary storage. [2025-10-13T18:43:23.831949] [INFO ] [MAIN ] ENVA: Loaded 25677 existing records. [2025-10-13T18:43:24.015029] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:24.015327] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-13T18:43:24.015384] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-13T18:43:24.015749] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-13T18:43:24.015806] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-13T18:43:24.363329] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:24.417928] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-13T18:43:24.787985] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:43:25.217932] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-13T18:43:25.751478] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T18:43:26.017924] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-13T18:43:26.328189] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:43:26.817924] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-13T18:43:27.416870] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:43:27.617917] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-13T18:43:28.094356] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:43:28.417886] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-13T18:43:28.809898] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:43:29.217928] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-13T18:43:29.689314] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:43:30.017910] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-13T18:43:30.303100] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T18:43:30.817944] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-13T18:43:31.617925] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-13T18:43:31.659865] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:43:32.003093] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:43:32.417911] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-13T18:43:33.001139] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T18:43:33.217979] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-13T18:43:33.736470] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T18:43:34.017942] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-13T18:43:34.226564] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T18:43:34.817941] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-13T18:43:35.459707] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:43:35.617889] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-13T18:43:36.198062] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T18:43:36.417980] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-13T18:43:36.751580] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:43:37.218004] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-13T18:43:37.556322] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:43:38.018015] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-13T18:43:38.819508] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-13T18:43:38.822355] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:43:39.627677] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-13T18:43:39.633907] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T18:43:40.220113] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:43:40.417919] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-13T18:43:40.724032] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:43:41.217924] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-13T18:43:41.724511] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T18:43:42.017996] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-13T18:43:42.817906] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-13T18:43:42.858196] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:43:43.424087] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T18:43:43.617901] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-13T18:43:44.417916] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-13T18:43:44.509323] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:43:44.794685] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:43:44.798193] [INFO ] [REMOTE ] ENS: Full fetch complete (42142 records). [2025-10-13T18:43:44.798276] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-13T18:43:45.174950] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-13T18:43:45.175108] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-13T18:43:45.175764] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-13T18:43:45.175826] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-13T18:43:45.176767] [DEBUG] [LOCAL ] ENS: Trimmed 42142 records to 29433 (keeping 200 days of data) [2025-10-13T18:43:45.231107] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-13T18:43:45.379565] [DEBUG] [LOCAL ] ENS: Primary data saved (29433 records). [2025-10-13T18:43:45.379889] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-13T18:43:45.379998] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENS took 25.9s. Estimated remaining: 3h 47m 13s. Rate: 7.2 symbols/min [2025-10-13T18:43:45.578665] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:45.599860] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T18:43:45.617747] [DEBUG] [LOCAL ] EOD: Loaded 15098 existing records from primary storage. [2025-10-13T18:43:45.618019] [INFO ] [MAIN ] EOD: Loaded 15098 existing records. [2025-10-13T18:43:45.822104] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:45.822372] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-13T18:43:45.822420] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-13T18:43:45.822760] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-13T18:43:45.822820] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-13T18:43:46.021174] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-13T18:43:46.228955] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:46.817993] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-13T18:43:46.973529] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:43:47.326990] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:43:47.617944] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-13T18:43:48.312452] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:43:48.417907] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-13T18:43:48.971063] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:43:49.217919] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-13T18:43:49.648127] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:43:50.017940] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-13T18:43:50.315773] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:43:50.817993] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-13T18:43:51.605724] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:43:51.617886] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-13T18:43:51.936012] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:43:52.417982] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-13T18:43:53.157308] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:43:53.162259] [INFO ] [REMOTE ] ENOV: Full fetch complete (63293 records). [2025-10-13T18:43:53.162418] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-13T18:43:53.227193] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-13T18:43:53.499848] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T18:43:53.593862] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-13T18:43:53.593978] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-13T18:43:53.595368] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-13T18:43:53.595446] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-13T18:43:53.597314] [DEBUG] [LOCAL ] ENOV: Trimmed 63293 records to 44876 (keeping 200 days of data) [2025-10-13T18:43:53.883277] [DEBUG] [LOCAL ] ENOV: Primary data saved (44876 records). [2025-10-13T18:43:53.883469] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-13T18:43:53.883578] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENOV took 37.2s. Estimated remaining: 3h 47m 5s. Rate: 7.2 symbols/min [2025-10-13T18:43:54.023184] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-13T18:43:54.072736] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:54.132368] [DEBUG] [LOCAL ] EOG: Loaded 54124 existing records from primary storage. [2025-10-13T18:43:54.132872] [INFO ] [MAIN ] EOG: Loaded 54124 existing records. [2025-10-13T18:43:54.332439] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:54.332789] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-13T18:43:54.332848] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-13T18:43:54.333522] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-13T18:43:54.333602] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-13T18:43:54.478258] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:43:54.516025] [INFO ] [REMOTE ] ENVA: Full fetch complete (36651 records). [2025-10-13T18:43:54.526447] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-13T18:43:54.849406] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-13T18:43:55.053856] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:55.081630] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:43:55.179993] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-13T18:43:55.180073] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-13T18:43:55.180722] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-13T18:43:55.180785] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-13T18:43:55.181636] [DEBUG] [LOCAL ] ENVA: Trimmed 36651 records to 25436 (keeping 200 days of data) [2025-10-13T18:43:55.329711] [DEBUG] [LOCAL ] ENVA: Primary data saved (25436 records). [2025-10-13T18:43:55.329841] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-13T18:43:55.329917] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 31.7s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-13T18:43:55.493097] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:55.504159] [DEBUG] [LOCAL ] EOI: Loaded 10972 existing records from primary storage. [2025-10-13T18:43:55.504335] [INFO ] [MAIN ] EOI: Loaded 10972 existing records. [2025-10-13T18:43:55.623059] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-13T18:43:55.683474] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:55.683707] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-13T18:43:55.683765] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-13T18:43:55.683946] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-13T18:43:55.683985] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-13T18:43:56.030220] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:56.415374] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T18:43:56.424621] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-13T18:43:57.217915] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-13T18:43:57.228577] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:43:57.698989] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-13T18:43:58.017968] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-13T18:43:58.526431] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:43:58.817916] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-13T18:43:59.071028] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:43:59.617969] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-13T18:44:00.342597] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:44:00.417990] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-13T18:44:00.641511] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T18:44:01.062901] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:44:01.218034] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-13T18:44:02.018021] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-13T18:44:02.209442] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T18:44:02.817999] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-13T18:44:03.617978] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-13T18:44:03.805821] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:44:04.153004] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:44:04.157345] [INFO ] [REMOTE ] ENR: Full fetch complete (59085 records). [2025-10-13T18:44:04.157454] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-13T18:44:04.423091] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-13T18:44:04.548459] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-13T18:44:04.548554] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-13T18:44:04.549583] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-13T18:44:04.549697] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-13T18:44:04.551200] [DEBUG] [LOCAL ] ENR: Trimmed 59085 records to 43561 (keeping 200 days of data) [2025-10-13T18:44:04.662855] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:44:04.861006] [DEBUG] [LOCAL ] ENR: Primary data saved (43561 records). [2025-10-13T18:44:04.861147] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-13T18:44:04.861970] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. ENR took 46.7s. Estimated remaining: 3h 46m 35s. Rate: 7.2 symbols/min [2025-10-13T18:44:05.034799] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:05.051536] [DEBUG] [LOCAL ] EOS: Loaded 15639 existing records from primary storage. [2025-10-13T18:44:05.051811] [INFO ] [MAIN ] EOS: Loaded 15639 existing records. [2025-10-13T18:44:05.226465] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-13T18:44:05.229446] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:05.238847] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-13T18:44:05.238940] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-13T18:44:05.239796] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:44:05.239516] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-13T18:44:05.242920] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-13T18:44:05.648175] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:06.017930] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-13T18:44:06.817890] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-13T18:44:06.947816] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:44:07.392624] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:44:07.603665] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:44:07.617892] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-13T18:44:08.417976] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-13T18:44:09.217938] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-13T18:44:09.360031] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:44:09.547487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:44:10.017927] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-13T18:44:10.347785] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:44:10.817906] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-13T18:44:11.617923] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-13T18:44:11.936706] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:44:12.417936] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-13T18:44:13.217895] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-13T18:44:13.420970] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-13T18:44:13.870188] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T18:44:14.017911] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-13T18:44:14.374449] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-13T18:44:14.397081] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T18:44:14.817896] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-13T18:44:14.921763] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:44:15.617916] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-13T18:44:16.418053] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-13T18:44:16.705268] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T18:44:17.198085] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:44:17.218012] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-13T18:44:17.308088] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T18:44:18.017927] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-13T18:44:18.694269] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T18:44:18.817974] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-13T18:44:19.103634] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T18:44:19.617895] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-13T18:44:19.809265] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:44:20.263343] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:44:20.417920] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-13T18:44:21.217925] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-13T18:44:21.678631] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T18:44:21.823002] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:44:22.017915] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-13T18:44:22.817891] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-13T18:44:22.907399] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T18:44:22.910172] [INFO ] [REMOTE ] EOD: Full fetch complete (20931 records). [2025-10-13T18:44:22.910250] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-13T18:44:23.301697] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-13T18:44:23.301821] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-13T18:44:23.302544] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-13T18:44:23.302590] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-13T18:44:23.303430] [DEBUG] [LOCAL ] EOD: Trimmed 20931 records to 14986 (keeping 200 days of data) [2025-10-13T18:44:23.388812] [DEBUG] [LOCAL ] EOD: Primary data saved (14986 records). [2025-10-13T18:44:23.388975] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-13T18:44:23.389086] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOD took 38.0s. Estimated remaining: 3h 46m 49s. Rate: 7.2 symbols/min [2025-10-13T18:44:23.556693] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:23.564552] [DEBUG] [LOCAL ] EOT: Loaded 6907 existing records from primary storage. [2025-10-13T18:44:23.564730] [INFO ] [MAIN ] EOT: Loaded 6907 existing records. [2025-10-13T18:44:23.625482] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-13T18:44:23.740446] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:23.740691] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-13T18:44:23.740747] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-13T18:44:23.740917] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-13T18:44:23.740973] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-13T18:44:24.105467] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:24.417937] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-13T18:44:24.796695] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:44:24.837976] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:44:25.217913] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-13T18:44:25.348269] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:44:25.935544] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:44:25.937515] [INFO ] [REMOTE ] EOI: Full fetch complete (16217 records). [2025-10-13T18:44:25.937592] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-13T18:44:26.023174] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-13T18:44:26.358366] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-13T18:44:26.358469] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-13T18:44:26.359271] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-13T18:44:26.359337] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-13T18:44:26.359969] [DEBUG] [LOCAL ] EOI: Trimmed 16217 records to 10791 (keeping 200 days of data) [2025-10-13T18:44:26.432595] [DEBUG] [LOCAL ] EOI: Primary data saved (10791 records). [2025-10-13T18:44:26.432822] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-13T18:44:26.432930] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOI took 31.1s. Estimated remaining: 3h 46m 29s. Rate: 7.2 symbols/min [2025-10-13T18:44:26.612394] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:26.639560] [DEBUG] [LOCAL ] EPAC: Loaded 27074 existing records from primary storage. [2025-10-13T18:44:26.639859] [INFO ] [MAIN ] EPAC: Loaded 27074 existing records. [2025-10-13T18:44:26.782981] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:44:26.824150] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-13T18:44:26.872342] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:26.873014] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-13T18:44:26.873090] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-13T18:44:26.873639] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-13T18:44:26.873748] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-13T18:44:27.359748] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:27.617988] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-13T18:44:27.708117] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:44:28.367320] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T18:44:28.373134] [INFO ] [REMOTE ] EOG: Full fetch complete (77282 records). [2025-10-13T18:44:28.373269] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-13T18:44:28.427041] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-13T18:44:28.763578] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-13T18:44:28.763678] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-13T18:44:28.764501] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-13T18:44:28.764543] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-13T18:44:28.765908] [DEBUG] [LOCAL ] EOG: Trimmed 77282 records to 53349 (keeping 200 days of data) [2025-10-13T18:44:29.106066] [DEBUG] [LOCAL ] EOG: Primary data saved (53349 records). [2025-10-13T18:44:29.106208] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-13T18:44:29.106309] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOG took 35.2s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-13T18:44:29.222096] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-13T18:44:29.245024] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:44:29.293921] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:29.331391] [DEBUG] [LOCAL ] EPAM: Loaded 39938 existing records from primary storage. [2025-10-13T18:44:29.331724] [INFO ] [MAIN ] EPAM: Loaded 39938 existing records. [2025-10-13T18:44:29.508812] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:29.509060] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-13T18:44:29.509107] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-13T18:44:29.509588] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-13T18:44:29.509683] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-13T18:44:29.865529] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:30.018082] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-13T18:44:30.247662] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T18:44:30.739726] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T18:44:30.817919] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-13T18:44:31.617915] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-13T18:44:32.137095] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:44:32.424380] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-13T18:44:32.426075] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T18:44:33.126597] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T18:44:33.217986] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-13T18:44:33.892759] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T18:44:34.017932] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-13T18:44:34.817983] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-13T18:44:35.316438] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:44:35.516254] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T18:44:35.617922] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-13T18:44:36.417930] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-13T18:44:36.716021] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:44:37.217947] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-13T18:44:37.344067] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:44:38.017928] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-13T18:44:38.573486] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T18:44:38.817939] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-13T18:44:38.997486] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T18:44:39.000375] [INFO ] [REMOTE ] EOS: Full fetch complete (23207 records). [2025-10-13T18:44:39.000770] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-13T18:44:39.373491] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-13T18:44:39.373567] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-13T18:44:39.374017] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-13T18:44:39.374079] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-13T18:44:39.374698] [DEBUG] [LOCAL ] EOS: Trimmed 23207 records to 15359 (keeping 200 days of data) [2025-10-13T18:44:39.468906] [DEBUG] [LOCAL ] EOS: Primary data saved (15359 records). [2025-10-13T18:44:39.469046] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-13T18:44:39.469189] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 34.6s. Estimated remaining: 3h 46m 4s. Rate: 7.2 symbols/min [2025-10-13T18:44:39.618457] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-13T18:44:39.636541] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:39.677147] [DEBUG] [LOCAL ] EPC: Loaded 40337 existing records from primary storage. [2025-10-13T18:44:39.677431] [INFO ] [MAIN ] EPC: Loaded 40337 existing records. [2025-10-13T18:44:39.851914] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:39.852110] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-13T18:44:39.852154] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-13T18:44:39.852686] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-13T18:44:39.852803] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-13T18:44:40.229192] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:40.224631] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:44:40.421068] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-13T18:44:40.421988] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:44:41.217911] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-13T18:44:41.654480] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:44:41.956013] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T18:44:42.017991] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-13T18:44:42.818005] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-13T18:44:43.617908] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-13T18:44:43.667566] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:44:44.225812] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:44:44.342847] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T18:44:44.417880] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-13T18:44:45.217918] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-13T18:44:46.017942] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-13T18:44:46.098912] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:44:46.344178] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:44:46.817939] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-13T18:44:46.918126] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T18:44:47.617924] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-13T18:44:47.740988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:44:48.406515] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:44:48.407910] [INFO ] [REMOTE ] EOT: Full fetch complete (10716 records). [2025-10-13T18:44:48.408010] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-13T18:44:48.423087] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-13T18:44:48.772142] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-13T18:44:48.772219] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-13T18:44:48.772482] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-13T18:44:48.772519] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-13T18:44:48.772958] [DEBUG] [LOCAL ] EOT: Trimmed 10716 records to 6803 (keeping 200 days of data) [2025-10-13T18:44:48.821036] [DEBUG] [LOCAL ] EOT: Primary data saved (6803 records). [2025-10-13T18:44:48.821155] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-13T18:44:48.821239] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EOT took 25.4s. Estimated remaining: 3h 45m 58s. Rate: 7.2 symbols/min [2025-10-13T18:44:48.988889] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:48.989069] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-13T18:44:48.989113] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-13T18:44:48.989241] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-13T18:44:48.989282] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-13T18:44:48.989322] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-13T18:44:48.989353] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-13T18:44:49.229789] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-13T18:44:49.361956] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:50.007041] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:44:50.017910] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-13T18:44:50.368295] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:44:50.817936] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-13T18:44:51.617932] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-13T18:44:51.919442] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T18:44:52.051720] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:44:52.417899] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-13T18:44:53.217911] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-13T18:44:53.288119] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:44:53.600774] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T18:44:54.017926] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-13T18:44:54.790169] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T18:44:54.817895] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-13T18:44:55.618615] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-13T18:44:55.623294] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T18:44:56.395222] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:44:56.417894] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-13T18:44:57.217918] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-13T18:44:57.624796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T18:44:57.624525] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-13T18:44:57.643321] [INFO ] [REMOTE ] EPAC: Full fetch complete (38593 records). [2025-10-13T18:44:57.643494] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-13T18:44:58.022340] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-13T18:44:58.023747] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-13T18:44:58.023844] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-13T18:44:58.024531] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-13T18:44:58.024685] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-13T18:44:58.025726] [DEBUG] [LOCAL ] EPAC: Trimmed 38593 records to 26461 (keeping 200 days of data) [2025-10-13T18:44:58.200881] [DEBUG] [LOCAL ] EPAC: Primary data saved (26461 records). [2025-10-13T18:44:58.201071] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-13T18:44:58.201189] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAC took 31.8s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-13T18:44:58.371090] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:58.412109] [DEBUG] [LOCAL ] EPR: Loaded 44579 existing records from primary storage. [2025-10-13T18:44:58.412441] [INFO ] [MAIN ] EPR: Loaded 44579 existing records. [2025-10-13T18:44:58.586838] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:58.587175] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-13T18:44:58.587232] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-13T18:44:58.587721] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-13T18:44:58.587778] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-13T18:44:58.826357] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-13T18:44:58.940984] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:44:58.978797] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:59.617935] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-13T18:44:59.781008] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T18:45:00.417986] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-13T18:45:00.537742] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T18:45:01.217907] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-13T18:45:01.617670] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T18:45:01.774887] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:45:02.017931] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-13T18:45:02.583398] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:45:02.817984] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-13T18:45:03.617884] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-13T18:45:03.805585] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:45:04.417936] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-13T18:45:04.482278] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:45:05.217910] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-13T18:45:05.453534] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T18:45:05.560584] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:45:06.017977] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-13T18:45:06.817945] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-13T18:45:07.214561] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:45:07.578284] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T18:45:07.617889] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-13T18:45:08.168373] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:45:08.417933] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-13T18:45:09.217982] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-13T18:45:09.496065] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T18:45:09.661260] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:45:10.017904] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-13T18:45:10.701347] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T18:45:10.817978] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-13T18:45:11.617907] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-13T18:45:11.785279] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:45:12.374480] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:45:12.417926] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-13T18:45:13.151261] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:45:13.217913] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-13T18:45:14.018042] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-13T18:45:14.454522] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T18:45:14.484597] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:45:14.490969] [INFO ] [REMOTE ] EPC: Full fetch complete (57077 records). [2025-10-13T18:45:14.491199] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-13T18:45:14.825782] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-13T18:45:14.880613] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-13T18:45:14.880746] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-13T18:45:14.881578] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-13T18:45:14.881622] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-13T18:45:14.883026] [DEBUG] [LOCAL ] EPC: Trimmed 57077 records to 39804 (keeping 200 days of data) [2025-10-13T18:45:15.124664] [DEBUG] [LOCAL ] EPC: Primary data saved (39804 records). [2025-10-13T18:45:15.124822] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-13T18:45:15.125581] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 35.7s. Estimated remaining: 3h 46m 2s. Rate: 7.2 symbols/min [2025-10-13T18:45:15.305314] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:15.353053] [DEBUG] [LOCAL ] EPRT: Loaded 49155 existing records from primary storage. [2025-10-13T18:45:15.353363] [INFO ] [MAIN ] EPRT: Loaded 49155 existing records. [2025-10-13T18:45:15.537709] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:45:15.538246] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-13T18:45:15.538306] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-13T18:45:15.538857] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-13T18:45:15.538914] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-13T18:45:15.628224] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-13T18:45:15.918553] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:45:15.924418] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:16.429763] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-13T18:45:16.432121] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:45:17.217896] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-13T18:45:17.596520] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:45:18.018040] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-13T18:45:18.173283] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:45:18.818042] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-13T18:45:18.890700] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:45:19.618047] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-13T18:45:19.672548] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:45:20.417909] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-13T18:45:20.893081] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:45:21.136530] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:45:21.217890] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-13T18:45:22.017983] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-13T18:45:22.204950] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:45:22.503090] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T18:45:22.817920] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-13T18:45:23.617911] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-13T18:45:23.810869] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:45:23.818750] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-13T18:45:23.818981] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-13T18:45:24.224241] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-13T18:45:24.224346] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-13T18:45:24.225322] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-13T18:45:24.225406] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-13T18:45:24.250364] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53611 (keeping 200 days of data) [2025-10-13T18:45:24.252210] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:45:24.435435] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-13T18:45:24.595234] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-13T18:45:24.595414] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-13T18:45:24.595510] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 35.8s. Estimated remaining: 3h 45m 56s. Rate: 7.2 symbols/min [2025-10-13T18:45:24.775779] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:24.775955] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-13T18:45:24.776004] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-13T18:45:24.776113] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-13T18:45:24.776156] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-13T18:45:24.776246] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-13T18:45:24.776300] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-13T18:45:25.095039] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:45:25.126222] [INFO ] [REMOTE ] EPAM: Full fetch complete (56085 records). [2025-10-13T18:45:25.137869] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-13T18:45:25.181529] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:25.231844] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-13T18:45:25.554575] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-13T18:45:25.554690] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-13T18:45:25.555446] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-13T18:45:25.555489] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-13T18:45:25.560319] [DEBUG] [LOCAL ] EPAM: Trimmed 56085 records to 39518 (keeping 200 days of data) [2025-10-13T18:45:25.806260] [DEBUG] [LOCAL ] EPAM: Primary data saved (39518 records). [2025-10-13T18:45:25.806424] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-13T18:45:25.806521] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPAM took 56.7s. Estimated remaining: 3h 45m 32s. Rate: 7.2 symbols/min [2025-10-13T18:45:25.979103] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:26.030036] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-13T18:45:26.033718] [DEBUG] [LOCAL ] EQH: Loaded 53424 existing records from primary storage. [2025-10-13T18:45:26.034096] [INFO ] [MAIN ] EQH: Loaded 53424 existing records. [2025-10-13T18:45:26.215347] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:45:26.215720] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-13T18:45:26.215821] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-13T18:45:26.216384] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-13T18:45:26.216451] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-13T18:45:26.500153] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T18:45:26.629865] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:26.803985] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T18:45:26.817878] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-13T18:45:26.858098] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:45:27.617901] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-13T18:45:27.676979] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T18:45:28.417920] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-13T18:45:29.217909] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-13T18:45:29.381733] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:45:29.961034] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T18:45:30.017933] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-13T18:45:30.049397] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:45:30.055454] [INFO ] [REMOTE ] EPR: Full fetch complete (63034 records). [2025-10-13T18:45:30.055605] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-13T18:45:30.433756] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-13T18:45:30.433847] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-13T18:45:30.434620] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-13T18:45:30.434694] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-13T18:45:30.436020] [DEBUG] [LOCAL ] EPR: Trimmed 63034 records to 43903 (keeping 200 days of data) [2025-10-13T18:45:30.703054] [DEBUG] [LOCAL ] EPR: Primary data saved (43903 records). [2025-10-13T18:45:30.703191] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-13T18:45:30.703329] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 32.5s. Estimated remaining: 3h 45m 16s. Rate: 7.2 symbols/min [2025-10-13T18:45:30.823169] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-13T18:45:30.873962] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:30.874155] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-10-13T18:45:30.874198] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-10-13T18:45:30.874333] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-13T18:45:30.874375] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-13T18:45:30.874414] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-13T18:45:30.874448] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-13T18:45:31.219732] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:31.561548] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:45:31.617883] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-13T18:45:32.417919] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-13T18:45:32.631130] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T18:45:33.199486] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T18:45:33.217878] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-13T18:45:34.017927] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-13T18:45:34.140697] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:45:34.583880] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:45:34.827180] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-13T18:45:34.846254] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:45:35.617926] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-13T18:45:36.417989] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-13T18:45:36.641364] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T18:45:37.140310] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T18:45:37.210560] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:45:37.220002] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-13T18:45:37.950512] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T18:45:38.018025] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-13T18:45:38.818038] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-13T18:45:38.863942] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:45:39.618011] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-13T18:45:40.428219] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-13T18:45:40.451741] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:45:40.599667] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:45:41.218028] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-13T18:45:42.018102] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-13T18:45:42.021072] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:45:42.402126] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T18:45:42.818011] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-13T18:45:43.617903] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-13T18:45:43.769238] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:45:44.239453] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T18:45:44.417897] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-13T18:45:44.744490] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T18:45:45.217945] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-13T18:45:46.017903] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-13T18:45:46.103093] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T18:45:46.712662] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:45:46.717515] [INFO ] [REMOTE ] EPRT: Full fetch complete (68665 records). [2025-10-13T18:45:46.717621] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-13T18:45:46.718378] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:45:46.718464] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:45:46.718508] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:45:46.718581] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-13T18:45:46.718687] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-13T18:45:46.718807] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-10-13T18:45:46.719053] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-10-13T18:45:46.719956] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 31.6s. Estimated remaining: 3h 45m 24s. Rate: 7.2 symbols/min [2025-10-13T18:45:46.817894] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-13T18:45:47.617904] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-13T18:45:47.698479] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:45:47.700186] [INFO ] [REMOTE ] EQBK: Full fetch complete (15411 records). [2025-10-13T18:45:47.700260] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-13T18:45:48.071193] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-13T18:45:48.071320] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-13T18:45:48.071797] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-13T18:45:48.071880] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-13T18:45:48.072825] [DEBUG] [LOCAL ] EQBK: Trimmed 15411 records to 11061 (keeping 200 days of data) [2025-10-13T18:45:48.158579] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T18:45:48.186342] [DEBUG] [LOCAL ] EQBK: Primary data saved (11061 records). [2025-10-13T18:45:48.186492] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-13T18:45:48.186570] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQBK took 23.6s. Estimated remaining: 3h 45m 1s. Rate: 7.2 symbols/min [2025-10-13T18:45:48.417912] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-13T18:45:49.340160] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:45:49.351334] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-13T18:45:50.248386] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:45:50.259617] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-13T18:45:51.106140] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:45:51.117124] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-13T18:45:52.254419] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T18:45:52.265275] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-13T18:45:53.066724] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:45:53.077703] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-13T18:45:54.291661] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T18:45:54.303620] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-13T18:45:54.887288] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:45:54.897990] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-13T18:45:56.109356] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T18:45:56.120944] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-13T18:45:56.667058] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:45:56.678488] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-13T18:45:58.022939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:45:58.036129] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-13T18:45:58.544694] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:45:58.556142] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-13T18:45:59.641316] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:45:59.647269] [INFO ] [REMOTE ] EQNR: Full fetch complete (76815 records). [2025-10-13T18:45:59.647467] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-13T18:46:00.056035] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-13T18:46:00.056145] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-13T18:46:00.057304] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-13T18:46:00.057372] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-13T18:46:00.059914] [DEBUG] [LOCAL ] EQNR: Trimmed 76815 records to 53028 (keeping 200 days of data) [2025-10-13T18:46:00.398431] [DEBUG] [LOCAL ] EQNR: Primary data saved (53028 records). [2025-10-13T18:46:00.398809] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-13T18:46:00.398920] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 29.7s. Estimated remaining: 3h 45m 1s. Rate: 7.2 symbols/min [2025-10-13T18:46:00.509281] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:46:00.524545] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-13T18:46:02.248506] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:46:02.254239] [INFO ] [REMOTE ] EQH: Full fetch complete (76393 records). [2025-10-13T18:46:02.254429] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-13T18:46:02.667181] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-13T18:46:02.667301] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-13T18:46:02.668846] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-13T18:46:02.668919] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-13T18:46:02.670934] [DEBUG] [LOCAL ] EQH: Trimmed 76393 records to 52685 (keeping 200 days of data) [2025-10-13T18:46:03.029570] [DEBUG] [LOCAL ] EQH: Primary data saved (52685 records). [2025-10-13T18:46:03.029911] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-13T18:46:03.030097] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQH took 37.2s. Estimated remaining: 3h 44m 41s. Rate: 7.2 symbols/min [2025-10-13T18:46:03.629632] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.663137] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.711812] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.720496] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-13T18:46:03.739713] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.740442] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-13T18:46:03.741696] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-13T18:46:03.741932] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-13T18:46:03.741992] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-13T18:46:03.742028] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-13T18:46:03.813921] [DEBUG] [LOCAL ] EQV: Loaded 2727 existing records from primary storage. [2025-10-13T18:46:03.841349] [INFO ] [MAIN ] EQV: Loaded 2727 existing records. [2025-10-13T18:46:04.191598] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-10-13T18:46:04.240611] [INFO ] [MAIN ] EQT: Loaded 54462 existing records. [2025-10-13T18:46:04.317148] [DEBUG] [LOCAL ] EQR: Loaded 52374 existing records from primary storage. [2025-10-13T18:46:04.354436] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:04.461127] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-13T18:46:04.472318] [INFO ] [MAIN ] EQR: Loaded 52374 existing records. [2025-10-13T18:46:04.504902] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-13T18:46:04.550000] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:04.565500] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-13T18:46:04.570998] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-13T18:46:04.628735] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-13T18:46:04.730287] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:04.791178] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-13T18:46:04.817678] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-13T18:46:04.884605] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-13T18:46:04.899083] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-13T18:46:04.888542] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:05.070503] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-13T18:46:05.108399] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-13T18:46:05.184885] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-13T18:46:05.228728] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-13T18:46:05.520563] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.514445] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:46:05.560525] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-13T18:46:05.566300] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-13T18:46:05.758948] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.808710] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-13T18:46:05.921392] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.921736] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-13T18:46:06.142856] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T18:46:06.143958] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-13T18:46:06.237990] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:46:06.240022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-13T18:46:06.514040] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T18:46:06.514920] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-13T18:46:06.995096] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:46:06.997438] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-13T18:46:07.129712] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T18:46:07.130619] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-13T18:46:07.344882] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:46:07.355384] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-13T18:46:07.435141] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-13T18:46:07.605635] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T18:46:07.617878] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-13T18:46:07.774907] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:46:08.161029] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:46:08.417910] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-13T18:46:08.829736] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T18:46:09.040222] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:46:09.217926] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-13T18:46:09.656946] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:46:10.018001] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-13T18:46:10.818002] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-13T18:46:11.598474] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:46:11.617878] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-13T18:46:12.417905] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-13T18:46:12.756774] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T18:46:12.853301] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T18:46:13.217890] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-13T18:46:13.323690] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:46:13.789336] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T18:46:14.017924] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-13T18:46:14.470131] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-13T18:46:14.817924] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-13T18:46:15.617924] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-13T18:46:16.272001] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:46:16.320610] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:46:16.417894] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-13T18:46:16.975340] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:46:17.217932] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-13T18:46:18.017938] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-13T18:46:18.817994] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-13T18:46:19.030615] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T18:46:19.378046] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T18:46:19.618010] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-13T18:46:19.914378] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T18:46:20.075736] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:46:20.076479] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-13T18:46:20.076544] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-13T18:46:20.251542] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-13T18:46:20.251788] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:46:20.251837] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:46:20.251876] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-13T18:46:20.251937] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-13T18:46:20.251970] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-13T18:46:20.252007] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-13T18:46:20.252061] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 17.2s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-13T18:46:20.420673] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-13T18:46:20.420606] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:20.471302] [DEBUG] [LOCAL ] ERJ: Loaded 51129 existing records from primary storage. [2025-10-13T18:46:20.471709] [INFO ] [MAIN ] ERJ: Loaded 51129 existing records. [2025-10-13T18:46:20.664483] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:20.664674] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-13T18:46:20.664735] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-13T18:46:20.665023] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-13T18:46:20.665080] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-13T18:46:20.943895] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:46:21.020996] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:21.217926] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-13T18:46:22.017908] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-13T18:46:22.806106] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:46:22.817885] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-13T18:46:23.626318] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-13T18:46:23.633411] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:46:24.321092] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:46:24.417935] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-13T18:46:25.217973] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-13T18:46:25.302639] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:46:26.017890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-13T18:46:26.423970] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:46:26.473794] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:46:26.817916] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-13T18:46:27.617943] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-13T18:46:27.757534] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:46:28.036019] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:46:28.417898] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-13T18:46:28.732304] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:46:28.936622] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:46:29.217910] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-13T18:46:29.659196] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T18:46:29.660504] [INFO ] [REMOTE ] EQV: Full fetch complete (5721 records). [2025-10-13T18:46:29.660601] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-13T18:46:30.029890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-13T18:46:30.085152] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-13T18:46:30.085257] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-13T18:46:30.085577] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-13T18:46:30.085686] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-13T18:46:30.086408] [DEBUG] [LOCAL ] EQV: Trimmed 5721 records to 2666 (keeping 200 days of data) [2025-10-13T18:46:30.114444] [DEBUG] [LOCAL ] EQV: Primary data saved (2666 records). [2025-10-13T18:46:30.114631] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-13T18:46:30.114809] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 27.1s. Estimated remaining: 3h 44m 46s. Rate: 7.2 symbols/min [2025-10-13T18:46:30.404561] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:30.465980] [DEBUG] [LOCAL ] ERO: Loaded 42268 existing records from primary storage. [2025-10-13T18:46:30.466366] [INFO ] [MAIN ] ERO: Loaded 42268 existing records. [2025-10-13T18:46:30.713711] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:30.714000] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-13T18:46:30.714074] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-13T18:46:30.714626] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-13T18:46:30.714778] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-13T18:46:30.823146] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-13T18:46:31.134947] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:31.617917] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-13T18:46:31.812362] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:46:32.417980] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-13T18:46:32.865123] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T18:46:33.217921] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-13T18:46:33.257378] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:46:34.017932] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-13T18:46:34.189951] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:46:34.817932] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-13T18:46:35.175402] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:46:35.233246] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T18:46:35.617987] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-13T18:46:36.418008] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-13T18:46:36.886918] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T18:46:36.892369] [INFO ] [REMOTE ] EQR: Full fetch complete (74156 records). [2025-10-13T18:46:36.892484] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-13T18:46:37.227293] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-13T18:46:37.285040] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-13T18:46:37.285114] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-13T18:46:37.286000] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-13T18:46:37.286061] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-13T18:46:37.287441] [DEBUG] [LOCAL ] EQR: Trimmed 74156 records to 51677 (keeping 200 days of data) [2025-10-13T18:46:37.615289] [DEBUG] [LOCAL ] EQR: Primary data saved (51677 records). [2025-10-13T18:46:37.615435] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-13T18:46:37.616221] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQR took 34.6s. Estimated remaining: 3h 44m 35s. Rate: 7.2 symbols/min [2025-10-13T18:46:37.790686] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:37.823195] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-13T18:46:37.881408] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:46:37.908053] [DEBUG] [LOCAL ] ES: Loaded 53386 existing records from primary storage. [2025-10-13T18:46:37.908425] [INFO ] [MAIN ] ES: Loaded 53386 existing records. [2025-10-13T18:46:38.023083] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-13T18:46:38.084475] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:38.084739] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-13T18:46:38.084791] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-13T18:46:38.085379] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-13T18:46:38.085434] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-13T18:46:38.428723] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:38.817913] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-13T18:46:39.116522] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:46:39.599623] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:46:39.617876] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-13T18:46:40.417897] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-13T18:46:40.524832] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T18:46:40.853898] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:46:41.217931] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-13T18:46:41.816984] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:46:42.017938] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-13T18:46:42.577704] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:46:42.817946] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-13T18:46:43.617948] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-13T18:46:43.950932] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-13T18:46:43.957482] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-13T18:46:43.957607] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-13T18:46:44.355730] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-13T18:46:44.355913] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-13T18:46:44.356821] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-13T18:46:44.356936] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-13T18:46:44.358580] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 53685 (keeping 200 days of data) [2025-10-13T18:46:44.419300] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-13T18:46:44.597202] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:46:44.715365] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-13T18:46:44.715480] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-13T18:46:44.715604] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 41.7s. Estimated remaining: 3h 44m 24s. Rate: 7.2 symbols/min [2025-10-13T18:46:44.883699] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:44.909953] [DEBUG] [LOCAL ] ESAB: Loaded 26416 existing records from primary storage. [2025-10-13T18:46:44.910200] [INFO ] [MAIN ] ESAB: Loaded 26416 existing records. [2025-10-13T18:46:45.091237] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:45.092192] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-13T18:46:45.092250] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-13T18:46:45.092924] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-13T18:46:45.092991] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-13T18:46:45.218241] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-13T18:46:45.382401] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:46:45.488299] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:45.823453] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:46:46.017918] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-13T18:46:46.817901] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-13T18:46:46.880139] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:46:47.241796] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:46:47.617921] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-13T18:46:48.417901] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-13T18:46:48.600031] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:46:49.217939] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-13T18:46:49.417531] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:46:49.471242] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:46:50.017947] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-13T18:46:50.817980] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-13T18:46:50.901790] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:46:51.617900] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-13T18:46:51.832358] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:46:51.859384] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T18:46:52.418022] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-13T18:46:53.217932] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-13T18:46:53.493895] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T18:46:53.795577] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:46:53.800694] [INFO ] [REMOTE ] ERJ: Full fetch complete (72443 records). [2025-10-13T18:46:53.800814] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-13T18:46:54.023076] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-13T18:46:54.185361] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-13T18:46:54.185452] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-13T18:46:54.186677] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-13T18:46:54.186825] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-13T18:46:54.190409] [DEBUG] [LOCAL ] ERJ: Trimmed 72443 records to 50324 (keeping 200 days of data) [2025-10-13T18:46:54.330506] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:46:54.510855] [DEBUG] [LOCAL ] ERJ: Primary data saved (50324 records). [2025-10-13T18:46:54.511015] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-13T18:46:54.511144] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERJ took 34.3s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-13T18:46:54.675439] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:54.691831] [DEBUG] [LOCAL ] ESE: Loaded 16766 existing records from primary storage. [2025-10-13T18:46:54.692037] [INFO ] [MAIN ] ESE: Loaded 16766 existing records. [2025-10-13T18:46:54.834315] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-13T18:46:54.885983] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:54.886225] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-13T18:46:54.886271] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-13T18:46:54.886546] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-13T18:46:54.886601] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-13T18:46:55.233995] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:55.575286] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:46:55.617902] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-13T18:46:56.315718] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T18:46:56.417898] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-13T18:46:56.596489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:46:57.217892] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-13T18:46:57.648471] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:46:58.018007] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-13T18:46:58.817914] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-13T18:46:58.865034] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T18:46:58.993873] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T18:46:59.617948] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-13T18:46:59.770797] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T18:47:00.417930] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-13T18:47:00.647895] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:47:01.217941] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-13T18:47:02.018052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-13T18:47:02.154841] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:47:02.308792] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T18:47:02.817928] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-13T18:47:03.116335] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:47:03.617899] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-13T18:47:04.011566] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:47:04.417940] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-13T18:47:05.217917] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-13T18:47:05.299606] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:47:05.461390] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:47:06.017922] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-13T18:47:06.478485] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:47:06.679693] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T18:47:06.817898] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-13T18:47:07.617914] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-13T18:47:07.856250] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T18:47:08.417943] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-13T18:47:09.217899] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-13T18:47:09.462489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T18:47:09.715985] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:47:10.017889] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-13T18:47:10.283096] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T18:47:10.817887] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-13T18:47:11.617902] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-13T18:47:11.751914] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T18:47:11.774916] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T18:47:12.418039] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-13T18:47:13.217898] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-13T18:47:13.328315] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T18:47:14.017998] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-13T18:47:14.189937] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:47:14.496269] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T18:47:14.817938] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-13T18:47:15.527243] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:47:15.532754] [INFO ] [REMOTE ] ES: Full fetch complete (76259 records). [2025-10-13T18:47:15.532871] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-13T18:47:15.623126] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-13T18:47:15.722553] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:47:15.816416] [INFO ] [REMOTE ] ERO: Full fetch complete (59925 records). [2025-10-13T18:47:15.837740] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-13T18:47:16.102078] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-13T18:47:16.111378] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-13T18:47:16.128302] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-13T18:47:16.130624] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-13T18:47:16.230116] [DEBUG] [LOCAL ] ES: Trimmed 76259 records to 52672 (keeping 200 days of data) [2025-10-13T18:47:16.433366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-13T18:47:16.439845] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-13T18:47:16.441685] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-13T18:47:16.442777] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-13T18:47:16.446229] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-13T18:47:16.460782] [DEBUG] [LOCAL ] ERO: Trimmed 59925 records to 41700 (keeping 200 days of data) [2025-10-13T18:47:16.809310] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T18:47:16.916984] [DEBUG] [LOCAL ] ES: Primary data saved (52672 records). [2025-10-13T18:47:16.917895] [INFO ] [MAIN ] ES: Full history saved. [2025-10-13T18:47:16.919241] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 39.3s. Estimated remaining: 3h 44m 40s. Rate: 7.1 symbols/min [2025-10-13T18:47:17.107491] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:17.109538] [DEBUG] [LOCAL ] ERO: Primary data saved (41700 records). [2025-10-13T18:47:17.110036] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-13T18:47:17.110145] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ERO took 47.0s. Estimated remaining: 3h 44m 14s. Rate: 7.2 symbols/min [2025-10-13T18:47:17.222281] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-13T18:47:17.283470] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:17.321984] [DEBUG] [LOCAL ] ESI: Loaded 51434 existing records from primary storage. [2025-10-13T18:47:17.322322] [INFO ] [MAIN ] ESI: Loaded 51434 existing records. [2025-10-13T18:47:17.542357] [DEBUG] [LOCAL ] ESNT: Loaded 38858 existing records from primary storage. [2025-10-13T18:47:17.547102] [INFO ] [MAIN ] ESNT: Loaded 38858 existing records. [2025-10-13T18:47:17.546498] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:17.584551] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-13T18:47:17.615904] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-13T18:47:17.656184] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-13T18:47:17.656487] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-13T18:47:17.802586] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:47:17.830610] [INFO ] [REMOTE ] ESAB: Full fetch complete (35775 records). [2025-10-13T18:47:17.871265] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-13T18:47:17.865985] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:17.901739] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-13T18:47:17.901834] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-13T18:47:17.931009] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-13T18:47:17.941525] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-13T18:47:18.609805] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:47:18.623001] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:18.653177] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-13T18:47:18.697758] [INFO ] [REMOTE ] ESE: Full fetch complete (22500 records). [2025-10-13T18:47:18.737385] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-13T18:47:18.964142] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-13T18:47:18.980562] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-13T18:47:19.034587] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:19.035326] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-13T18:47:19.039319] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-13T18:47:19.039462] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-13T18:47:19.115296] [DEBUG] [LOCAL ] ESAB: Trimmed 35775 records to 26029 (keeping 200 days of data) [2025-10-13T18:47:19.412494] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-13T18:47:19.416401] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-13T18:47:19.420807] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-13T18:47:19.420887] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-13T18:47:19.429130] [DEBUG] [LOCAL ] ESE: Trimmed 22500 records to 16500 (keeping 200 days of data) [2025-10-13T18:47:19.569749] [DEBUG] [LOCAL ] ESE: Primary data saved (16500 records). [2025-10-13T18:47:19.570436] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-13T18:47:19.570821] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESE took 25.1s. Estimated remaining: 3h 43m 54s. Rate: 7.2 symbols/min [2025-10-13T18:47:19.688674] [DEBUG] [LOCAL ] ESAB: Primary data saved (26029 records). [2025-10-13T18:47:19.699046] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-13T18:47:19.704278] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESAB took 35.0s. Estimated remaining: 3h 43m 28s. Rate: 7.2 symbols/min [2025-10-13T18:47:19.817238] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:19.925573] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:19.966546] [DEBUG] [LOCAL ] ESRT: Loaded 46989 existing records from primary storage. [2025-10-13T18:47:19.966932] [INFO ] [MAIN ] ESRT: Loaded 46989 existing records. [2025-10-13T18:47:20.077932] [DEBUG] [LOCAL ] ESS: Loaded 30192 existing records from primary storage. [2025-10-13T18:47:20.093831] [INFO ] [MAIN ] ESS: Loaded 30192 existing records. [2025-10-13T18:47:20.214704] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:20.245450] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-13T18:47:20.264758] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-13T18:47:20.271180] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-13T18:47:20.276505] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-13T18:47:20.420719] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:20.436853] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-13T18:47:20.458000] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-13T18:47:20.484673] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-13T18:47:20.517694] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-13T18:47:20.704524] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T18:47:20.770167] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-13T18:47:20.965778] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T18:47:21.006962] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-13T18:47:21.087142] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:21.227019] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-13T18:47:21.232255] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:22.017994] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-13T18:47:22.373883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:47:22.524186] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:47:22.766107] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:47:22.817879] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-13T18:47:23.252129] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:47:23.618050] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-13T18:47:24.390075] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:47:24.417990] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-13T18:47:25.217916] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-13T18:47:25.299614] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:47:25.917304] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:47:26.017926] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-13T18:47:26.817998] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:47:26.818080] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-13T18:47:27.157521] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T18:47:27.617978] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-13T18:47:28.140471] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:47:28.417985] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-13T18:47:29.180417] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:47:29.217890] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-13T18:47:29.606128] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:47:30.017918] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-13T18:47:30.730371] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:47:30.817920] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-13T18:47:31.526085] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:47:31.617949] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-13T18:47:32.313917] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:47:32.418004] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-13T18:47:32.936309] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:47:33.218059] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-13T18:47:33.386792] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:47:34.018007] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-13T18:47:34.786034] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T18:47:34.817882] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-13T18:47:35.623037] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-13T18:47:35.646922] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:47:36.417906] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-13T18:47:36.556593] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:47:36.626575] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:47:37.217938] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-13T18:47:38.017918] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-13T18:47:38.161832] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:47:38.632241] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T18:47:38.818053] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-13T18:47:39.564996] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:47:39.617932] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-13T18:47:40.418919] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-13T18:47:40.424738] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:47:41.217979] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-13T18:47:41.267222] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:47:41.783036] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:47:42.017919] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-13T18:47:42.798596] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:47:42.817887] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-13T18:47:43.144971] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:47:43.617970] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-13T18:47:44.266003] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:47:44.417939] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-13T18:47:44.787706] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:47:44.790930] [INFO ] [REMOTE ] ESS: Full fetch complete (43271 records). [2025-10-13T18:47:44.791012] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-13T18:47:45.157765] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-13T18:47:45.157844] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-13T18:47:45.158503] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-13T18:47:45.158566] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-13T18:47:45.159461] [DEBUG] [LOCAL ] ESS: Trimmed 43271 records to 29854 (keeping 200 days of data) [2025-10-13T18:47:45.222987] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-13T18:47:45.350630] [DEBUG] [LOCAL ] ESS: Primary data saved (29854 records). [2025-10-13T18:47:45.350795] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-13T18:47:45.350878] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESS took 25.6s. Estimated remaining: 3h 43m 56s. Rate: 7.1 symbols/min [2025-10-13T18:47:45.513724] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:45.559676] [DEBUG] [LOCAL ] ESTC: Loaded 50869 existing records from primary storage. [2025-10-13T18:47:45.559980] [INFO ] [MAIN ] ESTC: Loaded 50869 existing records. [2025-10-13T18:47:45.731239] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:45.731793] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-13T18:47:45.731843] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-13T18:47:45.732831] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-13T18:47:45.732887] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-13T18:47:46.022998] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-13T18:47:46.084361] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:46.213519] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:47:46.348964] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:47:46.818018] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-13T18:47:47.486047] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:47:47.617918] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-13T18:47:48.353268] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T18:47:48.417895] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-13T18:47:49.218015] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-13T18:47:49.353605] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:47:49.920582] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:47:50.017949] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-13T18:47:50.605177] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:47:50.611258] [INFO ] [REMOTE ] ESNT: Full fetch complete (57103 records). [2025-10-13T18:47:50.611429] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-13T18:47:50.824108] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-13T18:47:51.006355] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-13T18:47:51.006445] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-13T18:47:51.007242] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-13T18:47:51.007305] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-13T18:47:51.009880] [DEBUG] [LOCAL ] ESNT: Trimmed 57103 records to 38336 (keeping 200 days of data) [2025-10-13T18:47:51.249843] [DEBUG] [LOCAL ] ESNT: Primary data saved (38336 records). [2025-10-13T18:47:51.249998] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-13T18:47:51.250094] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESNT took 34.1s. Estimated remaining: 3h 43m 42s. Rate: 7.2 symbols/min [2025-10-13T18:47:51.423355] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:51.490487] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:47:51.491895] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-13T18:47:51.497060] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-10-13T18:47:51.528793] [INFO ] [REMOTE ] ESRT: Full fetch complete (66442 records). [2025-10-13T18:47:51.572260] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-13T18:47:51.623060] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-13T18:47:51.795274] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:51.817801] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-13T18:47:51.823050] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-13T18:47:51.850157] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-13T18:47:51.857567] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-13T18:47:52.311164] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-13T18:47:52.320913] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-13T18:47:52.344119] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-13T18:47:52.344434] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-13T18:47:52.389063] [DEBUG] [LOCAL ] ESRT: Trimmed 66442 records to 46391 (keeping 200 days of data) [2025-10-13T18:47:52.539420] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:52.549254] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-13T18:47:52.628056] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:47:52.828966] [DEBUG] [LOCAL ] ESRT: Primary data saved (46391 records). [2025-10-13T18:47:52.829169] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-13T18:47:52.829273] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESRT took 33.3s. Estimated remaining: 3h 43m 20s. Rate: 7.2 symbols/min [2025-10-13T18:47:53.006457] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:53.023084] [DEBUG] [LOCAL ] ETB: Loaded 12334 existing records from primary storage. [2025-10-13T18:47:53.023384] [INFO ] [MAIN ] ETB: Loaded 12334 existing records. [2025-10-13T18:47:53.215235] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:53.215622] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-13T18:47:53.215773] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-13T18:47:53.216189] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-13T18:47:53.216254] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-13T18:47:53.229087] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-13T18:47:53.610147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T18:47:53.643775] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:54.018025] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-13T18:47:54.553975] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T18:47:54.817947] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-13T18:47:55.069254] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T18:47:55.618000] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-13T18:47:55.804949] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:47:56.417922] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-13T18:47:56.994012] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T18:47:57.198980] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:47:57.204243] [INFO ] [REMOTE ] ESI: Full fetch complete (72890 records). [2025-10-13T18:47:57.204371] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-13T18:47:57.225523] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-13T18:47:57.598938] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-13T18:47:57.599125] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-13T18:47:57.600139] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-13T18:47:57.600223] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-13T18:47:57.601947] [DEBUG] [LOCAL ] ESI: Trimmed 72890 records to 50681 (keeping 200 days of data) [2025-10-13T18:47:57.730194] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:47:57.950846] [DEBUG] [LOCAL ] ESI: Primary data saved (50681 records). [2025-10-13T18:47:57.951003] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-13T18:47:57.951091] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESI took 41.0s. Estimated remaining: 3h 43m 4s. Rate: 7.2 symbols/min [2025-10-13T18:47:58.024168] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-13T18:47:58.121189] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:58.146709] [DEBUG] [LOCAL ] ETD: Loaded 27732 existing records from primary storage. [2025-10-13T18:47:58.147001] [INFO ] [MAIN ] ETD: Loaded 27732 existing records. [2025-10-13T18:47:58.319937] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:58.320181] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-13T18:47:58.320226] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-13T18:47:58.320485] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-13T18:47:58.320540] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-13T18:47:58.677432] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:58.817998] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-13T18:47:58.921858] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T18:47:59.172369] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T18:47:59.617926] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-13T18:48:00.386345] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T18:48:00.417926] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-13T18:48:01.217949] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-13T18:48:01.785630] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-13T18:48:01.810452] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:48:02.021556] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-13T18:48:02.817990] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-13T18:48:03.057581] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:48:03.557285] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:48:03.617880] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-13T18:48:04.103548] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:48:04.273968] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T18:48:04.417877] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-13T18:48:05.217898] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-13T18:48:05.422506] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:48:06.017948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-13T18:48:06.665440] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T18:48:06.818011] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-13T18:48:07.034292] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:48:07.617913] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-13T18:48:07.803289] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:48:08.417898] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-13T18:48:08.803769] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T18:48:09.217943] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-13T18:48:10.017915] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-13T18:48:10.130895] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:48:10.772401] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T18:48:10.817883] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-13T18:48:11.333557] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T18:48:11.446990] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:48:11.617934] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-13T18:48:12.417904] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-13T18:48:13.217928] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-13T18:48:13.354668] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:48:13.703285] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T18:48:13.995793] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:48:14.017918] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-13T18:48:14.818013] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-13T18:48:14.841894] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T18:48:15.617930] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-13T18:48:16.418016] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-13T18:48:17.026906] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-13T18:48:17.217935] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-13T18:48:17.484441] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:48:17.688625] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:48:18.017985] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-13T18:48:18.817994] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-13T18:48:19.388964] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T18:48:19.497364] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-13T18:48:19.617983] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-13T18:48:19.644741] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T18:48:19.646708] [INFO ] [REMOTE ] ETB: Full fetch complete (18294 records). [2025-10-13T18:48:19.646777] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-13T18:48:20.014503] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-13T18:48:20.014627] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-13T18:48:20.015068] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-13T18:48:20.015114] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-13T18:48:20.015638] [DEBUG] [LOCAL ] ETB: Trimmed 18294 records to 12121 (keeping 200 days of data) [2025-10-13T18:48:20.089020] [DEBUG] [LOCAL ] ETB: Primary data saved (12121 records). [2025-10-13T18:48:20.089156] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-13T18:48:20.089251] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETB took 27.3s. Estimated remaining: 3h 43m 24s. Rate: 7.1 symbols/min [2025-10-13T18:48:20.258507] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:20.276067] [DEBUG] [LOCAL ] ETG: Loaded 16762 existing records from primary storage. [2025-10-13T18:48:20.276290] [INFO ] [MAIN ] ETG: Loaded 16762 existing records. [2025-10-13T18:48:20.424964] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-13T18:48:20.458745] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:20.459033] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-13T18:48:20.459082] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-13T18:48:20.459337] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-13T18:48:20.459394] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-13T18:48:20.820471] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:20.911137] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:48:21.218003] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-13T18:48:22.017932] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-13T18:48:22.153777] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:48:22.321102] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T18:48:22.817939] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-13T18:48:22.930337] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:48:23.617930] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-13T18:48:24.417927] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-13T18:48:24.838075] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T18:48:24.860793] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T18:48:25.218005] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-13T18:48:26.017940] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-13T18:48:26.055616] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:48:26.060904] [INFO ] [REMOTE ] ESTC: Full fetch complete (72146 records). [2025-10-13T18:48:26.061022] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-13T18:48:26.448955] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-13T18:48:26.449026] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-13T18:48:26.449920] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-13T18:48:26.449984] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-13T18:48:26.451387] [DEBUG] [LOCAL ] ESTC: Trimmed 72146 records to 50268 (keeping 200 days of data) [2025-10-13T18:48:26.753615] [DEBUG] [LOCAL ] ESTC: Primary data saved (50268 records). [2025-10-13T18:48:26.753780] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-13T18:48:26.753863] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ESTC took 41.4s. Estimated remaining: 3h 43m 13s. Rate: 7.2 symbols/min [2025-10-13T18:48:26.826126] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-13T18:48:26.976460] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:26.993680] [DEBUG] [LOCAL ] ETJ: Loaded 17190 existing records from primary storage. [2025-10-13T18:48:26.993939] [INFO ] [MAIN ] ETJ: Loaded 17190 existing records. [2025-10-13T18:48:27.138623] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:48:27.202158] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:27.202757] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-13T18:48:27.202882] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-13T18:48:27.203344] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-13T18:48:27.203484] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-13T18:48:27.516732] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-13T18:48:27.619011] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-13T18:48:27.631822] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:28.116298] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:48:28.417984] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-13T18:48:28.613265] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:48:29.218005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-13T18:48:29.575320] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:48:30.017937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-13T18:48:30.103851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T18:48:30.818009] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-13T18:48:31.617893] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-13T18:48:31.921029] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:48:32.121808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:48:32.128996] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-13T18:48:32.129145] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-13T18:48:32.419486] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-13T18:48:32.520359] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-13T18:48:32.520437] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-13T18:48:32.521321] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-13T18:48:32.521386] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-13T18:48:32.522908] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-13T18:48:32.834398] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T18:48:32.839291] [INFO ] [REMOTE ] ETD: Full fetch complete (38472 records). [2025-10-13T18:48:32.840468] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-13T18:48:32.965903] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-13T18:48:32.981358] [INFO ] [MAIN ] ET: Full history saved. [2025-10-13T18:48:32.986587] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ET took 41.7s. Estimated remaining: 3h 42m 60s. Rate: 7.2 symbols/min [2025-10-13T18:48:33.221244] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-13T18:48:33.331992] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:33.438760] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-13T18:48:33.439049] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-13T18:48:33.439855] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-13T18:48:33.439973] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-13T18:48:33.440930] [DEBUG] [LOCAL ] ETD: Trimmed 38472 records to 27310 (keeping 200 days of data) [2025-10-13T18:48:33.542752] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:48:33.612828] [DEBUG] [LOCAL ] ETN: Loaded 53462 existing records from primary storage. [2025-10-13T18:48:33.613187] [INFO ] [MAIN ] ETN: Loaded 53462 existing records. [2025-10-13T18:48:33.773043] [DEBUG] [LOCAL ] ETD: Primary data saved (27310 records). [2025-10-13T18:48:33.783422] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-13T18:48:33.796037] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETD took 35.8s. Estimated remaining: 3h 42m 36s. Rate: 7.2 symbols/min [2025-10-13T18:48:33.920690] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:33.944589] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-13T18:48:33.946728] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-13T18:48:33.952455] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-13T18:48:33.957637] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-13T18:48:34.039497] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-13T18:48:34.114919] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:34.291161] [DEBUG] [LOCAL ] ETO: Loaded 6988 existing records from primary storage. [2025-10-13T18:48:34.329808] [INFO ] [MAIN ] ETO: Loaded 6988 existing records. [2025-10-13T18:48:34.343347] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T18:48:34.518033] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:34.593157] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:34.593378] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-13T18:48:34.593424] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-13T18:48:34.593627] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-13T18:48:34.593717] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-13T18:48:34.830846] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-13T18:48:34.947419] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:35.089851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:48:35.617927] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-13T18:48:35.884052] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:48:36.243135] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T18:48:36.417895] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-13T18:48:37.089433] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T18:48:37.218013] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-13T18:48:38.017993] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-13T18:48:38.299531] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T18:48:38.818008] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-13T18:48:39.617912] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-13T18:48:39.962117] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:48:39.983978] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:48:40.417897] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-13T18:48:40.659617] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:48:40.999508] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:48:41.218027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-13T18:48:42.017893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-13T18:48:42.321034] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:48:42.817915] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-13T18:48:43.593677] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:48:43.617884] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-13T18:48:44.052559] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T18:48:44.161060] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:48:44.417928] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-13T18:48:45.217921] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-13T18:48:45.953941] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T18:48:46.017900] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-13T18:48:46.358933] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T18:48:46.783343] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T18:48:46.817928] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-13T18:48:47.542317] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:48:47.617911] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-13T18:48:48.417989] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-13T18:48:48.579911] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:48:49.074619] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:48:49.217930] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-13T18:48:49.846056] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:48:50.018013] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-13T18:48:50.626914] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:48:50.817934] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-13T18:48:51.617926] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-13T18:48:51.853434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T18:48:52.417979] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-13T18:48:53.209755] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:48:53.217875] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-13T18:48:53.609666] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T18:48:54.017937] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-13T18:48:54.047801] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:48:54.817891] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-13T18:48:54.998501] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T18:48:55.617921] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-13T18:48:56.417983] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-13T18:48:56.660597] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:48:56.662597] [INFO ] [REMOTE ] ETG: Full fetch complete (24733 records). [2025-10-13T18:48:56.662704] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-13T18:48:56.986610] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:48:57.018476] [INFO ] [REMOTE ] ETO: Full fetch complete (9691 records). [2025-10-13T18:48:57.020699] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-13T18:48:57.091926] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-13T18:48:57.103723] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-13T18:48:57.134538] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-13T18:48:57.175547] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-13T18:48:57.230479] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-13T18:48:57.240540] [DEBUG] [LOCAL ] ETG: Trimmed 24733 records to 16585 (keeping 200 days of data) [2025-10-13T18:48:57.197247] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-13T18:48:57.539559] [DEBUG] [LOCAL ] ETG: Primary data saved (16585 records). [2025-10-13T18:48:57.556202] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-13T18:48:57.557167] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 37.5s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-13T18:48:57.596393] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-13T18:48:57.608113] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-13T18:48:57.629477] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-13T18:48:57.635199] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-13T18:48:57.658002] [DEBUG] [LOCAL ] ETO: Trimmed 9691 records to 6923 (keeping 200 days of data) [2025-10-13T18:48:57.780158] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:57.786680] [DEBUG] [LOCAL ] ETO: Primary data saved (6923 records). [2025-10-13T18:48:57.786768] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-13T18:48:57.786951] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 24.0s. Estimated remaining: 3h 42m 34s. Rate: 7.2 symbols/min [2025-10-13T18:48:57.959681] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:57.973119] [DEBUG] [LOCAL ] ETSY: No existing data file found in primary storage. [2025-10-13T18:48:57.973212] [WARN ] [MAIN ] ETSY: No existing data found, performing full refresh instead. [2025-10-13T18:48:57.973337] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-13T18:48:57.973380] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-13T18:48:57.973422] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-13T18:48:57.973453] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-13T18:48:58.028899] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-13T18:48:58.101912] [DEBUG] [LOCAL ] ETR: Loaded 53997 existing records from primary storage. [2025-10-13T18:48:58.140525] [INFO ] [MAIN ] ETR: Loaded 53997 existing records. [2025-10-13T18:48:58.498212] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:58.540444] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:58.537190] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:48:58.540697] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-13T18:48:58.540837] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-13T18:48:58.546211] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-13T18:48:58.546277] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-13T18:48:58.826222] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-13T18:48:58.918711] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:59.617991] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-13T18:48:59.822753] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:48:59.825059] [INFO ] [REMOTE ] ETJ: Full fetch complete (25535 records). [2025-10-13T18:48:59.825128] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-13T18:49:00.196285] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-13T18:49:00.196522] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-13T18:49:00.197114] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-13T18:49:00.197195] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-13T18:49:00.229861] [DEBUG] [LOCAL ] ETJ: Trimmed 25535 records to 16965 (keeping 200 days of data) [2025-10-13T18:49:00.235818] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T18:49:00.349689] [DEBUG] [LOCAL ] ETJ: Primary data saved (16965 records). [2025-10-13T18:49:00.349832] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-13T18:49:00.349916] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETJ took 33.6s. Estimated remaining: 3h 42m 14s. Rate: 7.2 symbols/min [2025-10-13T18:49:00.423539] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-13T18:49:00.519831] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:00.541370] [DEBUG] [LOCAL ] ETV: Loaded 22566 existing records from primary storage. [2025-10-13T18:49:00.541690] [INFO ] [MAIN ] ETV: Loaded 22566 existing records. [2025-10-13T18:49:00.721501] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:00.721765] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-13T18:49:00.721814] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-13T18:49:00.722126] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-13T18:49:00.722182] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-13T18:49:01.086281] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:01.217907] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-13T18:49:01.537557] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:49:02.017912] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-13T18:49:02.310397] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T18:49:02.311592] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:49:02.817936] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-13T18:49:03.617898] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-13T18:49:03.708912] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:49:04.417989] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-13T18:49:04.803911] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T18:49:04.992567] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T18:49:05.217920] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-13T18:49:06.018005] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-13T18:49:06.215199] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:49:06.434778] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T18:49:06.817906] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-13T18:49:06.858087] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:49:07.617935] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-13T18:49:08.417917] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-13T18:49:08.715123] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:49:08.910828] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T18:49:09.218014] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-13T18:49:10.017951] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-13T18:49:10.065349] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:49:10.503763] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:49:10.817945] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-13T18:49:11.617901] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-13T18:49:11.680316] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:49:12.274776] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:49:12.417890] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-13T18:49:12.493173] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:49:13.217933] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-13T18:49:14.017993] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-13T18:49:14.344366] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:49:14.603361] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T18:49:14.817942] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-13T18:49:15.617894] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-13T18:49:15.830604] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T18:49:15.940796] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T18:49:16.417922] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-13T18:49:17.217946] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-13T18:49:17.515758] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:49:17.523792] [INFO ] [REMOTE ] ETN: Full fetch complete (76516 records). [2025-10-13T18:49:17.524011] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-13T18:49:17.917053] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-13T18:49:17.917137] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-13T18:49:17.918096] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-13T18:49:17.918162] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-13T18:49:17.919615] [DEBUG] [LOCAL ] ETN: Trimmed 76516 records to 52670 (keeping 200 days of data) [2025-10-13T18:49:18.021680] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-13T18:49:18.284273] [DEBUG] [LOCAL ] ETN: Primary data saved (52670 records). [2025-10-13T18:49:18.285058] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-13T18:49:18.286379] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETN took 45.3s. Estimated remaining: 3h 42m 25s. Rate: 7.1 symbols/min [2025-10-13T18:49:18.286165] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T18:49:18.483696] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:18.507676] [DEBUG] [LOCAL ] ETW: Loaded 25898 existing records from primary storage. [2025-10-13T18:49:18.507951] [INFO ] [MAIN ] ETW: Loaded 25898 existing records. [2025-10-13T18:49:18.705186] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:18.705613] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-13T18:49:18.705722] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-13T18:49:18.706853] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-13T18:49:18.706929] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-13T18:49:18.818795] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-13T18:49:19.051152] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:49:19.123112] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:19.137291] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:49:19.617917] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-13T18:49:20.418018] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-13T18:49:20.760409] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:49:20.774270] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:49:21.218010] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-13T18:49:22.017915] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-13T18:49:22.332106] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T18:49:22.364000] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:49:22.817919] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-13T18:49:22.975148] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:49:23.617928] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-13T18:49:24.417938] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-13T18:49:24.684103] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T18:49:24.849851] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:49:24.853305] [INFO ] [REMOTE ] ETV: Full fetch complete (32408 records). [2025-10-13T18:49:24.853384] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-13T18:49:25.223051] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-13T18:49:25.283289] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-13T18:49:25.283473] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-13T18:49:25.284376] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-13T18:49:25.284461] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-13T18:49:25.285762] [DEBUG] [LOCAL ] ETV: Trimmed 32408 records to 22265 (keeping 200 days of data) [2025-10-13T18:49:25.483279] [DEBUG] [LOCAL ] ETV: Primary data saved (22265 records). [2025-10-13T18:49:25.483469] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-13T18:49:25.483594] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 25.1s. Estimated remaining: 3h 42m 14s. Rate: 7.2 symbols/min [2025-10-13T18:49:25.755904] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:25.757609] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:49:25.770005] [DEBUG] [LOCAL ] ETX: Loaded 5251 existing records from primary storage. [2025-10-13T18:49:25.770276] [INFO ] [MAIN ] ETX: Loaded 5251 existing records. [2025-10-13T18:49:25.999745] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:26.000027] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-13T18:49:26.000078] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-13T18:49:26.000315] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-13T18:49:26.000406] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-13T18:49:26.023090] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-13T18:49:26.407300] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:26.817915] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-13T18:49:27.350817] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T18:49:27.617903] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-13T18:49:27.937605] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:49:27.982434] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:49:28.417923] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-13T18:49:29.217894] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-13T18:49:29.284408] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:49:30.015057] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:49:30.017879] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-13T18:49:30.237466] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:49:30.339015] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T18:49:30.817923] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-13T18:49:31.617978] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-13T18:49:32.206525] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:49:32.225969] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:49:32.417896] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-13T18:49:32.832284] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T18:49:33.217924] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-13T18:49:34.017904] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-13T18:49:34.818027] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-13T18:49:35.091214] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T18:49:35.197363] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T18:49:35.203300] [INFO ] [REMOTE ] ETSY: Full fetch complete (77534 records). [2025-10-13T18:49:35.203455] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-13T18:49:35.605090] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-13T18:49:35.605181] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-13T18:49:35.606133] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-13T18:49:35.606203] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-13T18:49:35.607622] [DEBUG] [LOCAL ] ETSY: Trimmed 77534 records to 53582 (keeping 200 days of data) [2025-10-13T18:49:35.660115] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-13T18:49:35.924419] [DEBUG] [LOCAL ] ETSY: Primary data saved (53582 records). [2025-10-13T18:49:35.924558] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-13T18:49:35.924631] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETSY took 38.1s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-13T18:49:36.091460] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:36.112918] [DEBUG] [LOCAL ] ETY: Loaded 23411 existing records from primary storage. [2025-10-13T18:49:36.113172] [INFO ] [MAIN ] ETY: Loaded 23411 existing records. [2025-10-13T18:49:36.244732] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:49:36.306434] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:36.306873] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-13T18:49:36.306930] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-13T18:49:36.307693] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-13T18:49:36.307755] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-13T18:49:36.423093] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-13T18:49:36.720052] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:36.768330] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:49:37.217923] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-13T18:49:37.587597] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:49:37.910686] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T18:49:38.017931] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-13T18:49:38.817984] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-13T18:49:39.535153] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:49:39.617896] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-13T18:49:39.691854] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:49:40.020468] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T18:49:40.417930] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-13T18:49:41.217903] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-13T18:49:41.627192] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T18:49:42.017946] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-13T18:49:42.292096] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:49:42.817915] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-13T18:49:43.617936] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-13T18:49:43.665399] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:49:43.989314] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:49:44.417912] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-13T18:49:44.720049] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:49:45.217950] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-13T18:49:45.397390] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T18:49:46.017904] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-13T18:49:46.377797] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:49:46.817933] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-13T18:49:47.090143] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:49:47.617986] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-13T18:49:47.916504] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:49:47.919715] [INFO ] [REMOTE ] ETW: Full fetch complete (36788 records). [2025-10-13T18:49:47.919787] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-13T18:49:48.297587] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-13T18:49:48.297686] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-13T18:49:48.298273] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-13T18:49:48.298332] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-13T18:49:48.299181] [DEBUG] [LOCAL ] ETW: Trimmed 36788 records to 25671 (keeping 200 days of data) [2025-10-13T18:49:48.430984] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-13T18:49:48.450916] [DEBUG] [LOCAL ] ETW: Primary data saved (25671 records). [2025-10-13T18:49:48.451059] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-13T18:49:48.451142] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 30.2s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-13T18:49:48.618443] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:48.636073] [DEBUG] [LOCAL ] EVC: Loaded 18400 existing records from primary storage. [2025-10-13T18:49:48.636314] [INFO ] [MAIN ] EVC: Loaded 18400 existing records. [2025-10-13T18:49:48.814237] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:48.814477] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-13T18:49:48.814523] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-13T18:49:48.815209] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-13T18:49:48.815266] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-13T18:49:49.170924] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:49.217886] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-13T18:49:49.228252] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:49:49.378753] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:49:49.384938] [INFO ] [REMOTE ] ETR: Full fetch complete (77084 records). [2025-10-13T18:49:49.385149] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-13T18:49:49.812265] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-13T18:49:49.812366] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-13T18:49:49.813393] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-13T18:49:49.813459] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-13T18:49:49.815179] [DEBUG] [LOCAL ] ETR: Trimmed 77084 records to 53213 (keeping 200 days of data) [2025-10-13T18:49:50.032593] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-13T18:49:50.149192] [DEBUG] [LOCAL ] ETR: Primary data saved (53213 records). [2025-10-13T18:49:50.149336] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-13T18:49:50.149429] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETR took 52.6s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-13T18:49:50.313567] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:50.345502] [DEBUG] [LOCAL ] EVEX: Loaded 32070 existing records from primary storage. [2025-10-13T18:49:50.345815] [INFO ] [MAIN ] EVEX: Loaded 32070 existing records. [2025-10-13T18:49:50.522500] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:50.522767] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-13T18:49:50.522817] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-13T18:49:50.523144] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-13T18:49:50.523202] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-13T18:49:50.746592] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T18:49:50.823302] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-13T18:49:50.868246] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:49:50.933267] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:51.505415] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:49:51.506516] [INFO ] [REMOTE ] ETX: Full fetch complete (6968 records). [2025-10-13T18:49:51.506584] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-13T18:49:51.623284] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-13T18:49:51.882615] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-13T18:49:51.882721] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-13T18:49:51.882913] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-13T18:49:51.882973] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-13T18:49:51.883349] [DEBUG] [LOCAL ] ETX: Trimmed 6968 records to 5243 (keeping 200 days of data) [2025-10-13T18:49:51.914702] [DEBUG] [LOCAL ] ETX: Primary data saved (5243 records). [2025-10-13T18:49:51.914838] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-13T18:49:51.914964] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. ETX took 26.4s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-13T18:49:52.081056] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:52.091247] [DEBUG] [LOCAL ] EVF: Loaded 10057 existing records from primary storage. [2025-10-13T18:49:52.091436] [INFO ] [MAIN ] EVF: Loaded 10057 existing records. [2025-10-13T18:49:52.264661] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:52.264886] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-13T18:49:52.264935] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-13T18:49:52.265136] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-13T18:49:52.265174] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-13T18:49:52.424351] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-13T18:49:52.623296] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:53.094850] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:49:53.217923] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-13T18:49:53.656519] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:49:54.017918] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-13T18:49:54.335297] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:49:54.818022] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-13T18:49:55.055840] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:49:55.617953] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-13T18:49:55.727799] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:49:56.417987] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-13T18:49:56.728962] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T18:49:57.217937] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-13T18:49:57.649254] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:49:57.763807] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:49:58.017925] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-13T18:49:58.817947] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-13T18:49:58.983019] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:49:59.423083] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T18:49:59.617923] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-13T18:50:00.417992] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-13T18:50:00.680720] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:50:01.217919] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-13T18:50:01.737113] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:50:02.017896] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-13T18:50:02.267430] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:50:02.640497] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:50:02.818007] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-13T18:50:03.618023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-13T18:50:03.745105] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T18:50:04.418046] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-13T18:50:04.822318] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:50:05.217940] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-13T18:50:05.394350] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T18:50:06.017881] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-13T18:50:06.332032] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:50:06.817916] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-13T18:50:06.953698] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:50:06.956485] [INFO ] [REMOTE ] ETY: Full fetch complete (34276 records). [2025-10-13T18:50:06.956557] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-13T18:50:07.362119] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-13T18:50:07.362223] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-13T18:50:07.362874] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-13T18:50:07.362940] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-13T18:50:07.363933] [DEBUG] [LOCAL ] ETY: Trimmed 34276 records to 23106 (keeping 200 days of data) [2025-10-13T18:50:07.464094] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T18:50:07.517096] [DEBUG] [LOCAL ] ETY: Primary data saved (23106 records). [2025-10-13T18:50:07.517244] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-13T18:50:07.517327] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. ETY took 31.6s. Estimated remaining: 3h 41m 32s. Rate: 7.2 symbols/min [2025-10-13T18:50:07.621377] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-13T18:50:07.693974] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:07.701830] [DEBUG] [LOCAL ] EVG: Loaded 6047 existing records from primary storage. [2025-10-13T18:50:07.702034] [INFO ] [MAIN ] EVG: Loaded 6047 existing records. [2025-10-13T18:50:07.877162] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:07.877388] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-13T18:50:07.877435] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-13T18:50:07.877635] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-13T18:50:07.877728] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-13T18:50:08.224259] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:08.378877] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:50:08.417927] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-13T18:50:09.128866] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T18:50:09.217925] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-13T18:50:09.825971] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:50:10.017904] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-13T18:50:10.584872] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T18:50:10.817924] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-13T18:50:11.617993] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-13T18:50:11.759049] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:50:12.417915] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-13T18:50:12.671755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:50:13.217897] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-13T18:50:13.595843] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:50:14.017944] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-13T18:50:14.466301] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:50:14.644084] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:50:14.817942] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-13T18:50:15.302527] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:50:15.617927] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-13T18:50:16.332921] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T18:50:16.417909] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-13T18:50:17.187563] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T18:50:17.217887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-13T18:50:17.963677] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:50:18.017887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-13T18:50:18.794330] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T18:50:18.817918] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-13T18:50:19.617949] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-13T18:50:19.905849] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T18:50:20.417906] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-13T18:50:20.659848] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:50:20.661877] [INFO ] [REMOTE ] EVF: Full fetch complete (12841 records). [2025-10-13T18:50:20.661944] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-13T18:50:21.010849] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-13T18:50:21.010926] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-13T18:50:21.011204] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-13T18:50:21.011241] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-13T18:50:21.011744] [DEBUG] [LOCAL ] EVF: Trimmed 12841 records to 9881 (keeping 200 days of data) [2025-10-13T18:50:21.066979] [DEBUG] [LOCAL ] EVF: Primary data saved (9881 records). [2025-10-13T18:50:21.067100] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-13T18:50:21.067176] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 29.2s. Estimated remaining: 3h 41m 34s. Rate: 7.1 symbols/min [2025-10-13T18:50:21.218062] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-13T18:50:21.235077] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:21.284365] [DEBUG] [LOCAL ] EVH: Loaded 50292 existing records from primary storage. [2025-10-13T18:50:21.284692] [INFO ] [MAIN ] EVH: Loaded 50292 existing records. [2025-10-13T18:50:21.398985] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T18:50:21.479237] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:21.479441] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-13T18:50:21.479489] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-13T18:50:21.479965] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-13T18:50:21.480044] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-13T18:50:21.827113] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:22.017908] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-13T18:50:22.170927] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T18:50:22.660324] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:50:22.817913] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-13T18:50:23.340206] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T18:50:23.617938] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-13T18:50:24.417904] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-13T18:50:24.754945] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T18:50:25.217904] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-13T18:50:25.258307] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T18:50:25.260822] [INFO ] [REMOTE ] EVC: Full fetch complete (29117 records). [2025-10-13T18:50:25.260915] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-13T18:50:25.642797] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-13T18:50:25.642882] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-13T18:50:25.643459] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-13T18:50:25.643534] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-13T18:50:25.644297] [DEBUG] [LOCAL ] EVC: Trimmed 29117 records to 18112 (keeping 200 days of data) [2025-10-13T18:50:25.749295] [DEBUG] [LOCAL ] EVC: Primary data saved (18112 records). [2025-10-13T18:50:25.749443] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-13T18:50:25.749528] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVC took 37.3s. Estimated remaining: 3h 41m 18s. Rate: 7.1 symbols/min [2025-10-13T18:50:25.915240] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:25.927209] [DEBUG] [LOCAL ] EVN: Loaded 11233 existing records from primary storage. [2025-10-13T18:50:25.927425] [INFO ] [MAIN ] EVN: Loaded 11233 existing records. [2025-10-13T18:50:26.023300] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-13T18:50:26.104165] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:26.104390] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-13T18:50:26.104436] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-13T18:50:26.104667] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-13T18:50:26.104726] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-13T18:50:26.458570] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:26.675917] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:50:26.704790] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:50:26.817871] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-13T18:50:27.339847] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:50:27.618016] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-13T18:50:28.417901] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-13T18:50:29.063475] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T18:50:29.102572] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:50:29.217887] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-13T18:50:30.017951] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-13T18:50:30.787274] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:50:30.817883] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-13T18:50:31.620952] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-13T18:50:31.623519] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:50:32.396494] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:50:32.416335] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:50:32.419631] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-13T18:50:33.217928] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-13T18:50:33.999820] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:50:34.017884] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-13T18:50:34.369447] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T18:50:34.817928] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-13T18:50:35.608751] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:50:35.610156] [INFO ] [REMOTE ] EVG: Full fetch complete (8149 records). [2025-10-13T18:50:35.610422] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-13T18:50:35.623177] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-13T18:50:35.689062] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:50:35.744265] [INFO ] [REMOTE ] EVEX: Full fetch complete (43024 records). [2025-10-13T18:50:35.760099] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-13T18:50:36.205114] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-13T18:50:36.238676] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-13T18:50:36.265972] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-13T18:50:36.275475] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-13T18:50:36.307899] [DEBUG] [LOCAL ] EVG: Trimmed 8149 records to 5949 (keeping 200 days of data) [2025-10-13T18:50:36.423685] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-13T18:50:36.463752] [DEBUG] [LOCAL ] EVG: Primary data saved (5949 records). [2025-10-13T18:50:36.466286] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-13T18:50:36.466431] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVG took 28.9s. Estimated remaining: 3h 41m 14s. Rate: 7.1 symbols/min [2025-10-13T18:50:36.466687] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-13T18:50:36.467019] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-13T18:50:36.479853] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-13T18:50:36.511792] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-13T18:50:36.576002] [DEBUG] [LOCAL ] EVEX: Trimmed 43024 records to 31962 (keeping 200 days of data) [2025-10-13T18:50:36.690751] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:36.836676] [DEBUG] [LOCAL ] EVR: Loaded 35113 existing records from primary storage. [2025-10-13T18:50:36.838929] [INFO ] [MAIN ] EVR: Loaded 35113 existing records. [2025-10-13T18:50:36.949133] [DEBUG] [LOCAL ] EVEX: Primary data saved (31962 records). [2025-10-13T18:50:36.955017] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-13T18:50:36.960284] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVEX took 46.8s. Estimated remaining: 3h 40m 50s. Rate: 7.2 symbols/min [2025-10-13T18:50:37.065295] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:37.085800] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-13T18:50:37.085967] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-13T18:50:37.111338] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-13T18:50:37.122360] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-13T18:50:37.305476] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:37.428446] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:50:37.480742] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-13T18:50:37.527063] [DEBUG] [LOCAL ] EVT: Loaded 17083 existing records from primary storage. [2025-10-13T18:50:37.565125] [INFO ] [MAIN ] EVT: Loaded 17083 existing records. [2025-10-13T18:50:37.637618] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:50:37.672796] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:37.816981] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:37.817174] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-13T18:50:37.817220] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-13T18:50:37.817521] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-13T18:50:37.817577] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-13T18:50:38.023062] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-13T18:50:38.167509] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:38.419439] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T18:50:38.817978] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-13T18:50:39.498607] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:50:39.617937] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-13T18:50:40.242377] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:50:40.388716] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T18:50:40.417893] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-13T18:50:41.217933] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-13T18:50:41.995472] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T18:50:42.017902] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-13T18:50:42.035874] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:50:42.817915] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-13T18:50:43.358670] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:50:43.617921] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-13T18:50:43.830443] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T18:50:44.322975] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T18:50:44.417898] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-13T18:50:45.217910] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-13T18:50:45.906910] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:50:46.017880] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-13T18:50:46.538884] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T18:50:46.817984] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-13T18:50:47.439248] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:50:47.460174] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:50:47.617889] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-13T18:50:48.417267] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:50:48.418337] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-13T18:50:49.217931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-13T18:50:50.001361] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:50:50.017878] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-13T18:50:50.132877] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T18:50:50.817918] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-13T18:50:51.617905] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-13T18:50:51.731041] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:50:51.774936] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:50:52.417892] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-13T18:50:53.217906] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-13T18:50:53.270625] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:50:53.628322] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T18:50:54.011706] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T18:50:54.017876] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-13T18:50:54.817981] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-13T18:50:54.847728] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T18:50:54.849461] [INFO ] [REMOTE ] EVN: Full fetch complete (17496 records). [2025-10-13T18:50:54.849528] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-13T18:50:55.204754] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-13T18:50:55.204846] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-13T18:50:55.205343] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-13T18:50:55.205407] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-13T18:50:55.206101] [DEBUG] [LOCAL ] EVN: Trimmed 17496 records to 10781 (keeping 200 days of data) [2025-10-13T18:50:55.281490] [DEBUG] [LOCAL ] EVN: Primary data saved (10781 records). [2025-10-13T18:50:55.281639] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-13T18:50:55.281763] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVN took 29.5s. Estimated remaining: 3h 41m 2s. Rate: 7.1 symbols/min [2025-10-13T18:50:55.475857] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:55.500884] [DEBUG] [LOCAL ] EVTC: Loaded 26811 existing records from primary storage. [2025-10-13T18:50:55.501146] [INFO ] [MAIN ] EVTC: Loaded 26811 existing records. [2025-10-13T18:50:55.623038] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-13T18:50:55.679432] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:55.679683] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-13T18:50:55.679741] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-13T18:50:55.680137] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-13T18:50:55.680194] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-13T18:50:56.036414] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:56.179588] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:50:56.255263] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:50:56.417936] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-13T18:50:57.218045] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-13T18:50:57.577971] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:50:58.017914] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-13T18:50:58.774589] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:50:58.822970] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-13T18:50:58.831965] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:50:59.617921] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-13T18:51:00.347760] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:51:00.352974] [INFO ] [REMOTE ] EVH: Full fetch complete (71718 records). [2025-10-13T18:51:00.353091] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-13T18:51:00.423175] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-13T18:51:00.777685] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:51:00.807474] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-13T18:51:00.808082] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-13T18:51:00.809232] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-13T18:51:00.809319] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-13T18:51:00.810964] [DEBUG] [LOCAL ] EVH: Trimmed 71718 records to 49622 (keeping 200 days of data) [2025-10-13T18:51:01.110819] [DEBUG] [LOCAL ] EVH: Primary data saved (49622 records). [2025-10-13T18:51:01.110975] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-13T18:51:01.111056] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVH took 40.0s. Estimated remaining: 3h 40m 48s. Rate: 7.1 symbols/min [2025-10-13T18:51:01.223165] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-13T18:51:01.298925] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:01.336724] [DEBUG] [LOCAL ] EVTL: Loaded 40001 existing records from primary storage. [2025-10-13T18:51:01.337092] [INFO ] [MAIN ] EVTL: Loaded 40001 existing records. [2025-10-13T18:51:01.527531] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:01.527777] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-13T18:51:01.527826] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-13T18:51:01.528219] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-13T18:51:01.528275] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-13T18:51:01.936746] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:02.017897] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-13T18:51:02.244160] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T18:51:02.616827] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:51:02.817942] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-13T18:51:03.281339] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T18:51:03.617933] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-13T18:51:04.234573] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T18:51:04.417970] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-13T18:51:05.222529] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-13T18:51:05.238562] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:51:05.240296] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:51:06.017933] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-13T18:51:06.597324] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:51:06.602556] [INFO ] [REMOTE ] EVR: Full fetch complete (50696 records). [2025-10-13T18:51:06.602727] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-13T18:51:06.824064] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-13T18:51:07.018508] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-13T18:51:07.018746] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-13T18:51:07.019711] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-13T18:51:07.019836] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-13T18:51:07.021054] [DEBUG] [LOCAL ] EVR: Trimmed 50696 records to 34612 (keeping 200 days of data) [2025-10-13T18:51:07.245429] [DEBUG] [LOCAL ] EVR: Primary data saved (34612 records). [2025-10-13T18:51:07.245605] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-13T18:51:07.245800] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVR took 30.8s. Estimated remaining: 3h 40m 35s. Rate: 7.1 symbols/min [2025-10-13T18:51:07.381918] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:51:07.459809] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:07.485744] [DEBUG] [LOCAL ] EVTR: Loaded 24696 existing records from primary storage. [2025-10-13T18:51:07.486055] [INFO ] [MAIN ] EVTR: Loaded 24696 existing records. [2025-10-13T18:51:07.625624] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-13T18:51:07.668054] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:07.668360] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-13T18:51:07.668429] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-13T18:51:07.668792] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-13T18:51:07.668860] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-13T18:51:07.806425] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T18:51:08.045523] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:08.417937] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-13T18:51:08.728104] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:51:09.217920] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-13T18:51:09.319068] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T18:51:10.017890] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-13T18:51:10.160172] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:51:10.817900] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-13T18:51:10.879743] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T18:51:11.617991] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-13T18:51:11.837000] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:51:12.418155] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-13T18:51:12.889327] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:51:13.217926] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-13T18:51:13.530241] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T18:51:14.017931] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-13T18:51:14.328332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:51:14.817933] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-13T18:51:15.019423] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:51:15.617993] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-13T18:51:15.804807] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:51:16.417935] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-13T18:51:16.833808] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T18:51:17.217902] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-13T18:51:17.348950] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:51:18.017915] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-13T18:51:18.091119] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T18:51:18.817986] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-13T18:51:19.617893] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-13T18:51:19.717749] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:51:19.784070] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:51:20.238541] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:51:20.242401] [INFO ] [REMOTE ] EVT: Full fetch complete (25189 records). [2025-10-13T18:51:20.242718] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-13T18:51:20.424697] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-13T18:51:20.624590] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-13T18:51:20.624834] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-13T18:51:20.625382] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-13T18:51:20.625422] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-13T18:51:20.626164] [DEBUG] [LOCAL ] EVT: Trimmed 25189 records to 16812 (keeping 200 days of data) [2025-10-13T18:51:20.728629] [DEBUG] [LOCAL ] EVT: Primary data saved (16812 records). [2025-10-13T18:51:20.728811] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-13T18:51:20.728950] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVT took 43.8s. Estimated remaining: 3h 40m 37s. Rate: 7.1 symbols/min [2025-10-13T18:51:20.896253] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:20.949685] [DEBUG] [LOCAL ] EW: Loaded 54178 existing records from primary storage. [2025-10-13T18:51:20.949996] [INFO ] [MAIN ] EW: Loaded 54178 existing records. [2025-10-13T18:51:21.130059] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:21.130325] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-13T18:51:21.130413] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-13T18:51:21.131078] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-13T18:51:21.131135] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-13T18:51:21.226377] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-13T18:51:21.482686] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:21.960964] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:51:22.017880] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-13T18:51:22.817923] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-13T18:51:23.211898] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:51:23.390925] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T18:51:23.617905] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-13T18:51:23.870360] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T18:51:24.417975] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-13T18:51:25.217900] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-13T18:51:25.282316] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:51:26.017915] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-13T18:51:26.188016] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T18:51:26.249828] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:51:26.817906] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-13T18:51:26.844822] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:51:27.617936] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-13T18:51:27.850507] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:51:28.418010] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-13T18:51:29.217922] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-13T18:51:29.365687] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:51:29.389498] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:51:30.017912] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-13T18:51:30.450121] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:51:30.453595] [INFO ] [REMOTE ] EVTC: Full fetch complete (38148 records). [2025-10-13T18:51:30.453698] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-13T18:51:30.823269] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-13T18:51:30.838509] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-13T18:51:30.838591] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-13T18:51:30.839376] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-13T18:51:30.839440] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-13T18:51:30.840368] [DEBUG] [LOCAL ] EVTC: Trimmed 38148 records to 26524 (keeping 200 days of data) [2025-10-13T18:51:31.015197] [DEBUG] [LOCAL ] EVTC: Primary data saved (26524 records). [2025-10-13T18:51:31.015388] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-13T18:51:31.015555] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTC took 35.7s. Estimated remaining: 3h 40m 32s. Rate: 7.1 symbols/min [2025-10-13T18:51:31.155710] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:51:31.218514] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:31.254190] [DEBUG] [LOCAL ] EXG: Loaded 34701 existing records from primary storage. [2025-10-13T18:51:31.254472] [INFO ] [MAIN ] EXG: Loaded 34701 existing records. [2025-10-13T18:51:31.425948] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:31.426186] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-13T18:51:31.426233] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-13T18:51:31.426615] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-13T18:51:31.426709] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-13T18:51:31.623220] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-13T18:51:31.777249] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:32.418009] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-13T18:51:32.676169] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:51:32.681708] [INFO ] [REMOTE ] EVTL: Full fetch complete (54041 records). [2025-10-13T18:51:32.681842] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-13T18:51:33.058432] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-13T18:51:33.058537] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-13T18:51:33.059491] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-13T18:51:33.059557] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-13T18:51:33.060872] [DEBUG] [LOCAL ] EVTL: Trimmed 54041 records to 39852 (keeping 200 days of data) [2025-10-13T18:51:33.218453] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-13T18:51:33.291156] [DEBUG] [LOCAL ] EVTL: Primary data saved (39852 records). [2025-10-13T18:51:33.291335] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-13T18:51:33.291510] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EVTL took 32.2s. Estimated remaining: 3h 40m 12s. Rate: 7.1 symbols/min [2025-10-13T18:51:33.323505] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:51:33.499384] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:51:34.017919] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-13T18:51:34.520492] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:51:34.818017] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-13T18:51:35.631919] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-13T18:51:35.658687] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:51:36.159098] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T18:51:36.418005] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-13T18:51:36.670943] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:51:37.217935] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-13T18:51:37.753935] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:51:37.757421] [INFO ] [REMOTE ] EVTR: Full fetch complete (33059 records). [2025-10-13T18:51:37.757496] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-13T18:51:38.026828] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-13T18:51:38.122960] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-13T18:51:38.123044] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-13T18:51:38.123713] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-13T18:51:38.123778] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-13T18:51:38.124539] [DEBUG] [LOCAL ] EVTR: Trimmed 33059 records to 24474 (keeping 200 days of data) [2025-10-13T18:51:38.270723] [DEBUG] [LOCAL ] EVTR: Primary data saved (24474 records). [2025-10-13T18:51:38.270856] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-13T18:51:38.270933] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EVTR took 31.0s. Estimated remaining: 3h 39m 57s. Rate: 7.2 symbols/min [2025-10-13T18:51:38.732088] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:51:38.817912] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-13T18:51:39.381695] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:51:39.617974] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-13T18:51:40.258071] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:51:40.417895] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-13T18:51:40.729681] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:51:41.217914] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-13T18:51:41.978316] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:51:42.017881] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-13T18:51:42.313990] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:51:42.818035] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-13T18:51:43.803826] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T18:51:43.814960] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-13T18:51:43.872278] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:51:44.418008] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-13T18:51:45.586981] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:51:45.599219] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-13T18:51:45.926122] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:51:46.017900] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-13T18:51:47.158853] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:51:47.170238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-13T18:51:47.220350] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:51:47.618004] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-13T18:51:48.590010] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T18:51:48.596884] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-13T18:51:48.907897] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:51:49.221707] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-13T18:51:49.520242] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T18:51:49.946050] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:51:49.951817] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-10-13T18:51:49.951964] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-13T18:51:50.027302] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-13T18:51:50.341219] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-13T18:51:50.341300] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-13T18:51:50.342309] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-13T18:51:50.342372] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-13T18:51:50.343856] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 53401 (keeping 200 days of data) [2025-10-13T18:51:50.657457] [DEBUG] [LOCAL ] EW: Primary data saved (53401 records). [2025-10-13T18:51:50.657599] [INFO ] [MAIN ] EW: Full history saved. [2025-10-13T18:51:50.657700] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EW took 29.9s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-13T18:51:51.181030] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T18:51:51.184961] [INFO ] [REMOTE ] EXG: Full fetch complete (49783 records). [2025-10-13T18:51:51.185058] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-13T18:51:51.584230] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-13T18:51:51.584314] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-13T18:51:51.585186] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-13T18:51:51.585249] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-13T18:51:51.586491] [DEBUG] [LOCAL ] EXG: Trimmed 49783 records to 34103 (keeping 200 days of data) [2025-10-13T18:51:51.804881] [DEBUG] [LOCAL ] EXG: Primary data saved (34103 records). [2025-10-13T18:51:51.805033] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-13T18:51:51.805116] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXG took 20.8s. Estimated remaining: 3h 39m 33s. Rate: 7.2 symbols/min [2025-10-13T18:51:52.461958] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.519490] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.562395] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.580925] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.640744] [DEBUG] [LOCAL ] EXP: Loaded 30076 existing records from primary storage. [2025-10-13T18:51:52.641627] [INFO ] [MAIN ] EXP: Loaded 30076 existing records. [2025-10-13T18:51:52.770624] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-13T18:51:52.785772] [INFO ] [MAIN ] EXR: Loaded 45888 existing records. [2025-10-13T18:51:52.804787] [DEBUG] [LOCAL ] EXK: Loaded 53922 existing records from primary storage. [2025-10-13T18:51:52.882757] [INFO ] [MAIN ] EXK: Loaded 53922 existing records. [2025-10-13T18:51:52.985458] [DEBUG] [LOCAL ] EXPD: Loaded 48593 existing records from primary storage. [2025-10-13T18:51:53.023048] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.034144] [INFO ] [MAIN ] EXPD: Loaded 48593 existing records. [2025-10-13T18:51:53.034364] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.045318] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-13T18:51:53.106289] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-13T18:51:53.229710] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-13T18:51:53.266476] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.326458] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.346832] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-13T18:51:53.501422] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.480013] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-13T18:51:53.550257] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-13T18:51:53.550147] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.600078] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-13T18:51:53.619772] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.640866] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.634499] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-13T18:51:53.662142] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-13T18:51:53.667436] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-13T18:51:53.817668] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-13T18:51:53.914554] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-13T18:51:54.531211] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:54.578358] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-13T18:51:54.939025] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:54.966974] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-13T18:51:55.089088] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:55.094617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-13T18:51:55.160908] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:55.161220] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-13T18:51:56.119761] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:51:56.125754] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-13T18:51:56.581721] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:51:56.590859] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-13T18:51:56.785772] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:51:56.794799] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-13T18:51:56.833099] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:51:56.843633] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-13T18:51:57.502701] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:51:57.508829] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-13T18:51:57.887270] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:51:58.017896] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-13T18:51:58.124110] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T18:51:58.193068] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T18:51:58.793473] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:51:58.817895] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-13T18:51:59.299540] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:51:59.617928] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-13T18:52:00.006752] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:52:00.418043] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-13T18:52:01.217984] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-13T18:52:01.336599] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:52:01.894014] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T18:52:02.017920] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-13T18:52:02.822474] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-13T18:52:02.828458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:52:03.617898] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-13T18:52:03.876803] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:52:04.164292] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:52:04.418010] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-13T18:52:05.031965] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:52:05.217939] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-13T18:52:06.017927] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-13T18:52:06.320833] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T18:52:06.614800] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:52:06.817978] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-13T18:52:07.314317] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:52:07.617940] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-13T18:52:08.313458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:52:08.417910] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-13T18:52:08.745462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T18:52:09.217928] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-13T18:52:09.919825] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:52:10.017915] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-13T18:52:10.406537] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:52:10.817974] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-13T18:52:11.496598] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:52:11.617922] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-13T18:52:12.379175] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:52:12.418000] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-13T18:52:13.219417] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-13T18:52:13.225114] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T18:52:14.017968] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-13T18:52:14.149020] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T18:52:14.240210] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T18:52:14.818014] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-13T18:52:15.617896] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-13T18:52:15.714257] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:52:16.418000] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-13T18:52:16.553764] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:52:17.217983] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-13T18:52:17.535216] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:52:17.554153] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T18:52:17.557152] [INFO ] [REMOTE ] EXP: Full fetch complete (42790 records). [2025-10-13T18:52:17.557227] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-13T18:52:17.925630] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-13T18:52:17.925738] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-13T18:52:17.926376] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-13T18:52:17.926435] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-13T18:52:17.927304] [DEBUG] [LOCAL ] EXP: Trimmed 42790 records to 29534 (keeping 200 days of data) [2025-10-13T18:52:18.021162] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-13T18:52:18.115670] [DEBUG] [LOCAL ] EXP: Primary data saved (29534 records). [2025-10-13T18:52:18.115816] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-13T18:52:18.116625] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXP took 26.3s. Estimated remaining: 3h 40m 0s. Rate: 7.1 symbols/min [2025-10-13T18:52:18.283586] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:18.337763] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-13T18:52:18.338106] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-10-13T18:52:18.522959] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:18.523254] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-13T18:52:18.523329] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-13T18:52:18.523962] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-13T18:52:18.524024] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-13T18:52:18.819174] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-13T18:52:18.888070] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:18.916267] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:52:19.567918] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:52:19.617884] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-13T18:52:20.417956] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-13T18:52:20.665119] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:52:21.217919] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-13T18:52:21.689923] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T18:52:22.017925] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-13T18:52:22.253915] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-13T18:52:22.817891] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-13T18:52:22.954032] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:52:23.325058] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:52:23.330480] [INFO ] [REMOTE ] EXR: Full fetch complete (65876 records). [2025-10-13T18:52:23.330602] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-13T18:52:23.623125] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-13T18:52:23.771810] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-13T18:52:23.771934] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-13T18:52:23.773349] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-13T18:52:23.773418] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-13T18:52:23.774999] [DEBUG] [LOCAL ] EXR: Trimmed 65876 records to 45363 (keeping 200 days of data) [2025-10-13T18:52:24.061797] [DEBUG] [LOCAL ] EXR: Primary data saved (45363 records). [2025-10-13T18:52:24.061933] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-13T18:52:24.062015] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 32.2s. Estimated remaining: 3h 39m 47s. Rate: 7.1 symbols/min [2025-10-13T18:52:24.230559] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:24.268887] [DEBUG] [LOCAL ] FAF: Loaded 42098 existing records from primary storage. [2025-10-13T18:52:24.269175] [INFO ] [MAIN ] FAF: Loaded 42098 existing records. [2025-10-13T18:52:24.420867] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-13T18:52:24.444424] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:24.444788] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-13T18:52:24.444839] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-13T18:52:24.445303] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-13T18:52:24.445359] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-13T18:52:24.801601] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:24.971531] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-13T18:52:25.217932] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-13T18:52:25.708929] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T18:52:25.714868] [INFO ] [REMOTE ] EXK: Full fetch complete (76608 records). [2025-10-13T18:52:25.715056] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-13T18:52:26.027964] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-13T18:52:26.135623] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-13T18:52:26.135732] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-13T18:52:26.136804] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-13T18:52:26.136868] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-13T18:52:26.138399] [DEBUG] [LOCAL ] EXK: Trimmed 76608 records to 53166 (keeping 200 days of data) [2025-10-13T18:52:26.281298] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:52:26.488207] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:52:26.512422] [DEBUG] [LOCAL ] EXK: Primary data saved (53166 records). [2025-10-13T18:52:26.512521] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-13T18:52:26.512592] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXK took 34.7s. Estimated remaining: 3h 39m 27s. Rate: 7.1 symbols/min [2025-10-13T18:52:26.678602] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:26.725811] [DEBUG] [LOCAL ] FBIN: Loaded 51053 existing records from primary storage. [2025-10-13T18:52:26.726123] [INFO ] [MAIN ] FBIN: Loaded 51053 existing records. [2025-10-13T18:52:26.825443] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-13T18:52:26.914141] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:26.914400] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-13T18:52:26.914467] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-13T18:52:26.915046] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-13T18:52:26.915111] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-13T18:52:27.275821] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:27.617960] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-13T18:52:28.364788] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-13T18:52:28.417895] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-13T18:52:28.460793] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:52:28.736561] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:52:29.217920] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-13T18:52:30.017928] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-13T18:52:30.808519] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:52:30.819711] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-13T18:52:30.912231] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-13T18:52:31.619697] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-13T18:52:31.621902] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:52:32.188838] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:52:32.417926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-13T18:52:33.217923] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-13T18:52:34.017897] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-13T18:52:34.191304] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:52:34.193107] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T18:52:34.556547] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:52:34.738787] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:52:34.743785] [INFO ] [REMOTE ] EXPD: Full fetch complete (69339 records). [2025-10-13T18:52:34.743896] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-13T18:52:34.823182] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-13T18:52:35.157996] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-13T18:52:35.158087] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-13T18:52:35.159144] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-13T18:52:35.159209] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-13T18:52:35.160582] [DEBUG] [LOCAL ] EXPD: Trimmed 69339 records to 47915 (keeping 200 days of data) [2025-10-13T18:52:35.451873] [DEBUG] [LOCAL ] EXPD: Primary data saved (47915 records). [2025-10-13T18:52:35.452014] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-13T18:52:35.452099] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. EXPD took 43.6s. Estimated remaining: 3h 39m 20s. Rate: 7.1 symbols/min [2025-10-13T18:52:35.629867] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-13T18:52:35.634893] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:35.666001] [DEBUG] [LOCAL ] FBK: Loaded 27187 existing records from primary storage. [2025-10-13T18:52:35.666348] [INFO ] [MAIN ] FBK: Loaded 27187 existing records. [2025-10-13T18:52:35.849732] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:35.850051] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-13T18:52:35.850100] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-13T18:52:35.850438] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-13T18:52:35.850495] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-13T18:52:36.224050] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:36.417898] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-13T18:52:36.482487] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:52:37.217910] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-13T18:52:37.350366] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:52:37.911961] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-13T18:52:38.017896] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-13T18:52:38.762415] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:52:38.817974] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-13T18:52:39.534026] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:52:39.617967] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-13T18:52:40.411062] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-13T18:52:40.421683] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-13T18:52:41.218023] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-13T18:52:41.261895] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:52:41.733877] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T18:52:42.017935] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-13T18:52:42.818008] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-13T18:52:43.623085] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-13T18:52:43.649615] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T18:52:43.773502] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T18:52:43.819744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T18:52:44.418015] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-13T18:52:45.202728] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:52:45.217974] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-13T18:52:46.018012] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-13T18:52:46.809191] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:52:46.818135] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-13T18:52:46.835457] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:52:46.941998] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-13T18:52:47.617969] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-13T18:52:48.423039] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-13T18:52:48.441168] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T18:52:49.217985] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-13T18:52:49.838741] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:52:49.947137] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T18:52:50.017914] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-13T18:52:50.728097] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:52:50.733980] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-13T18:52:50.734125] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-13T18:52:50.822136] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-13T18:52:51.169908] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-13T18:52:51.170074] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-13T18:52:51.171277] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-13T18:52:51.171367] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-13T18:52:51.209418] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T18:52:51.220303] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-13T18:52:51.578538] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-13T18:52:51.578772] [INFO ] [MAIN ] F: Full history saved. [2025-10-13T18:52:51.580112] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. F took 33.5s. Estimated remaining: 3h 39m 26s. Rate: 7.1 symbols/min [2025-10-13T18:52:51.623795] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-13T18:52:51.758252] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:51.813835] [DEBUG] [LOCAL ] FBP: Loaded 46453 existing records from primary storage. [2025-10-13T18:52:51.814220] [INFO ] [MAIN ] FBP: Loaded 46453 existing records. [2025-10-13T18:52:52.015049] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:52.015301] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-13T18:52:52.015349] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-13T18:52:52.015727] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-13T18:52:52.015784] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-13T18:52:52.372809] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:52.417884] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-13T18:52:52.491299] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T18:52:52.577438] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:52:53.217926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-13T18:52:53.737136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:52:54.017982] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-13T18:52:54.761479] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T18:52:54.817983] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-13T18:52:55.050321] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T18:52:55.617984] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-13T18:52:56.302309] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:52:56.417896] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-13T18:52:57.052573] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:52:57.217997] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-13T18:52:57.860684] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:52:58.018025] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-13T18:52:58.580895] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:52:58.817984] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-13T18:52:59.103365] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:52:59.617972] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-13T18:53:00.417979] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-13T18:53:00.463831] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T18:53:01.217986] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-13T18:53:01.343112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:53:02.017916] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-13T18:53:02.216781] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:53:02.671136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:53:02.817932] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-13T18:53:03.436452] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T18:53:03.440668] [INFO ] [REMOTE ] FAF: Full fetch complete (57708 records). [2025-10-13T18:53:03.440794] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-13T18:53:03.623234] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-13T18:53:03.891029] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-13T18:53:03.891134] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-13T18:53:03.892322] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-13T18:53:03.892591] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-13T18:53:03.894318] [DEBUG] [LOCAL ] FAF: Trimmed 57708 records to 41545 (keeping 200 days of data) [2025-10-13T18:53:04.165903] [DEBUG] [LOCAL ] FAF: Primary data saved (41545 records). [2025-10-13T18:53:04.166070] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-13T18:53:04.166169] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FAF took 40.1s. Estimated remaining: 3h 39m 26s. Rate: 7.1 symbols/min [2025-10-13T18:53:04.352127] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:04.381325] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:53:04.423887] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-13T18:53:04.426960] [DEBUG] [LOCAL ] FBRT: Loaded 35702 existing records from primary storage. [2025-10-13T18:53:04.427240] [INFO ] [MAIN ] FBRT: Loaded 35702 existing records. [2025-10-13T18:53:04.611154] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:04.611442] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-13T18:53:04.611494] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-13T18:53:04.611982] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-13T18:53:04.612071] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-13T18:53:04.984593] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:05.198134] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:53:05.204000] [INFO ] [REMOTE ] FBIN: Full fetch complete (72742 records). [2025-10-13T18:53:05.204213] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-13T18:53:05.226886] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-13T18:53:05.635536] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-13T18:53:05.635801] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-13T18:53:05.637176] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-13T18:53:05.637254] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-13T18:53:05.639482] [DEBUG] [LOCAL ] FBIN: Trimmed 72742 records to 50364 (keeping 200 days of data) [2025-10-13T18:53:05.985364] [DEBUG] [LOCAL ] FBIN: Primary data saved (50364 records). [2025-10-13T18:53:05.985582] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-13T18:53:05.985717] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBIN took 39.5s. Estimated remaining: 3h 39m 5s. Rate: 7.1 symbols/min [2025-10-13T18:53:06.021143] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-13T18:53:06.140377] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:53:06.212985] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:06.230772] [DEBUG] [LOCAL ] FC: Loaded 15309 existing records from primary storage. [2025-10-13T18:53:06.231093] [INFO ] [MAIN ] FC: Loaded 15309 existing records. [2025-10-13T18:53:06.411239] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:06.411514] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-13T18:53:06.411588] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-13T18:53:06.412056] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-13T18:53:06.412117] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-13T18:53:06.539366] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:53:06.797067] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:06.817915] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-13T18:53:07.142308] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T18:53:07.428378] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:53:07.617986] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-13T18:53:08.417910] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-13T18:53:08.974325] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:53:09.217989] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-13T18:53:09.413804] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:53:10.017982] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-13T18:53:10.245492] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:53:10.249448] [INFO ] [REMOTE ] FBK: Full fetch complete (34440 records). [2025-10-13T18:53:10.249559] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-13T18:53:10.642102] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-13T18:53:10.642293] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-13T18:53:10.643172] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-13T18:53:10.643241] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-13T18:53:10.646268] [DEBUG] [LOCAL ] FBK: Trimmed 34440 records to 27039 (keeping 200 days of data) [2025-10-13T18:53:10.818362] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-13T18:53:10.831957] [DEBUG] [LOCAL ] FBK: Primary data saved (27039 records). [2025-10-13T18:53:10.832155] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-13T18:53:10.832378] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBK took 35.4s. Estimated remaining: 3h 38m 49s. Rate: 7.1 symbols/min [2025-10-13T18:53:11.009053] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:53:11.027433] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:11.081785] [DEBUG] [LOCAL ] FCF: Loaded 39746 existing records from primary storage. [2025-10-13T18:53:11.082208] [INFO ] [MAIN ] FCF: Loaded 39746 existing records. [2025-10-13T18:53:11.263960] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:11.264334] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-13T18:53:11.264409] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-13T18:53:11.265034] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-13T18:53:11.265109] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-13T18:53:11.623082] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-13T18:53:11.688175] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:12.177034] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:53:12.418034] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-13T18:53:12.553002] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T18:53:13.218034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-13T18:53:13.877986] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:53:14.018017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-13T18:53:14.236290] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T18:53:14.817928] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-13T18:53:15.599501] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:53:15.617881] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-13T18:53:15.641412] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T18:53:16.417959] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-13T18:53:17.127367] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:53:17.217886] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-13T18:53:17.556422] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:53:18.017930] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-13T18:53:18.765960] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:53:18.817962] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-13T18:53:19.494227] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:53:19.617929] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-13T18:53:20.029789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T18:53:20.034422] [INFO ] [REMOTE ] FBP: Full fetch complete (66388 records). [2025-10-13T18:53:20.034518] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-13T18:53:20.422101] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-13T18:53:20.421933] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-13T18:53:20.423350] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-13T18:53:20.424348] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-13T18:53:20.424437] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-13T18:53:20.428119] [DEBUG] [LOCAL ] FBP: Trimmed 66388 records to 45728 (keeping 200 days of data) [2025-10-13T18:53:20.698516] [DEBUG] [LOCAL ] FBP: Primary data saved (45728 records). [2025-10-13T18:53:20.698677] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-13T18:53:20.699475] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FBP took 29.1s. Estimated remaining: 3h 38m 44s. Rate: 7.1 symbols/min [2025-10-13T18:53:20.867175] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:20.898053] [DEBUG] [LOCAL ] FCN: Loaded 26406 existing records from primary storage. [2025-10-13T18:53:20.898342] [INFO ] [MAIN ] FCN: Loaded 26406 existing records. [2025-10-13T18:53:21.081871] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:21.082177] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-13T18:53:21.082277] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-13T18:53:21.082956] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-13T18:53:21.083022] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-13T18:53:21.224514] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-13T18:53:21.213816] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:53:21.479900] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:21.718276] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T18:53:22.017902] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-13T18:53:22.074173] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:53:22.817982] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-13T18:53:23.070747] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:53:23.617962] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-13T18:53:23.865280] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:53:24.417953] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-13T18:53:25.163703] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:53:25.217885] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-13T18:53:25.700197] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T18:53:26.017910] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-13T18:53:26.813119] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:53:26.822549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-13T18:53:27.243325] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:53:27.617922] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-13T18:53:27.882826] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:53:28.301613] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:53:28.417968] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-13T18:53:29.218024] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-13T18:53:29.950765] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:53:30.017917] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-13T18:53:30.284893] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:53:30.628927] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:53:30.818008] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-13T18:53:31.617897] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-13T18:53:31.663091] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T18:53:31.664989] [INFO ] [REMOTE ] FC: Full fetch complete (21737 records). [2025-10-13T18:53:31.665057] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-13T18:53:32.028467] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-13T18:53:32.028543] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-13T18:53:32.029102] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-13T18:53:32.029164] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-13T18:53:32.029751] [DEBUG] [LOCAL ] FC: Trimmed 21737 records to 14956 (keeping 200 days of data) [2025-10-13T18:53:32.115326] [DEBUG] [LOCAL ] FC: Primary data saved (14956 records). [2025-10-13T18:53:32.115463] [INFO ] [MAIN ] FC: Full history saved. [2025-10-13T18:53:32.115554] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FC took 26.1s. Estimated remaining: 3h 38m 41s. Rate: 7.1 symbols/min [2025-10-13T18:53:32.281355] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:32.321193] [DEBUG] [LOCAL ] FCPT: Loaded 37878 existing records from primary storage. [2025-10-13T18:53:32.321495] [INFO ] [MAIN ] FCPT: Loaded 37878 existing records. [2025-10-13T18:53:32.420927] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-13T18:53:32.501012] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:32.501240] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-13T18:53:32.501294] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-13T18:53:32.501771] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-13T18:53:32.501828] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-13T18:53:32.859591] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:32.919618] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:53:33.218022] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-13T18:53:33.574129] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T18:53:34.017988] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-13T18:53:34.627106] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:53:34.817911] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-13T18:53:35.113167] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T18:53:35.617967] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-13T18:53:36.252797] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:53:36.417996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-13T18:53:36.818496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:53:36.823215] [INFO ] [REMOTE ] FBRT: Full fetch complete (49286 records). [2025-10-13T18:53:36.823340] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-13T18:53:37.215234] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-13T18:53:37.215338] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-13T18:53:37.216242] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-13T18:53:37.216309] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-13T18:53:37.217722] [DEBUG] [LOCAL ] FBRT: Trimmed 49286 records to 35334 (keeping 200 days of data) [2025-10-13T18:53:37.222103] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-13T18:53:37.455265] [DEBUG] [LOCAL ] FBRT: Primary data saved (35334 records). [2025-10-13T18:53:37.455471] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-13T18:53:37.455607] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FBRT took 33.3s. Estimated remaining: 3h 38m 27s. Rate: 7.1 symbols/min [2025-10-13T18:53:37.629301] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:37.629559] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-13T18:53:37.629624] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-13T18:53:37.629774] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-13T18:53:37.629815] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-13T18:53:37.629855] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-13T18:53:37.629888] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-13T18:53:38.010551] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:53:38.033945] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:38.029704] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-13T18:53:38.588973] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:53:38.818007] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-13T18:53:39.371218] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T18:53:39.617974] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-13T18:53:40.076844] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T18:53:40.418000] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-13T18:53:40.946776] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T18:53:41.217900] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-13T18:53:41.567248] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:53:42.017945] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-13T18:53:42.497512] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:53:42.818017] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-13T18:53:43.099725] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:53:43.617921] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-13T18:53:43.958931] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T18:53:44.302881] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:53:44.417923] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-13T18:53:44.836867] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T18:53:45.217959] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-13T18:53:46.017954] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-13T18:53:46.550018] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:53:46.817894] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-13T18:53:47.239026] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T18:53:47.274500] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T18:53:47.617962] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-13T18:53:48.417918] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-13T18:53:49.085805] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:53:49.090345] [INFO ] [REMOTE ] FCF: Full fetch complete (58001 records). [2025-10-13T18:53:49.090464] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-13T18:53:49.223098] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-13T18:53:49.481049] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-13T18:53:49.481131] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-13T18:53:49.481957] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-13T18:53:49.482019] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-13T18:53:49.483167] [DEBUG] [LOCAL ] FCF: Trimmed 58001 records to 39256 (keeping 200 days of data) [2025-10-13T18:53:49.723185] [DEBUG] [LOCAL ] FCF: Primary data saved (39256 records). [2025-10-13T18:53:49.723372] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-13T18:53:49.723482] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCF took 38.9s. Estimated remaining: 3h 38m 26s. Rate: 7.1 symbols/min [2025-10-13T18:53:49.893745] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:49.908079] [DEBUG] [LOCAL ] FCT: Loaded 14947 existing records from primary storage. [2025-10-13T18:53:49.908295] [INFO ] [MAIN ] FCT: Loaded 14947 existing records. [2025-10-13T18:53:50.018820] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-13T18:53:50.167263] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:50.168531] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-13T18:53:50.172141] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:53:50.169153] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-13T18:53:50.182104] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-13T18:53:50.182471] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-13T18:53:50.320844] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:53:50.512765] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T18:53:50.596718] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:50.817979] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-13T18:53:51.617953] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-13T18:53:52.261032] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:53:52.417912] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-13T18:53:52.726775] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T18:53:52.988311] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:53:53.218002] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-13T18:53:54.017991] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-13T18:53:54.216862] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:53:54.817959] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-13T18:53:55.242612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:53:55.294618] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:53:55.617993] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-13T18:53:56.417946] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-13T18:53:56.447528] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T18:53:57.217985] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-13T18:53:57.479499] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T18:53:57.509160] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T18:53:57.512144] [INFO ] [REMOTE ] FCN: Full fetch complete (35742 records). [2025-10-13T18:53:57.512226] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-13T18:53:57.880714] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-13T18:53:57.880846] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-13T18:53:57.881460] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-13T18:53:57.881508] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-13T18:53:57.882317] [DEBUG] [LOCAL ] FCN: Trimmed 35742 records to 26021 (keeping 200 days of data) [2025-10-13T18:53:58.024763] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-13T18:53:58.048970] [DEBUG] [LOCAL ] FCN: Primary data saved (26021 records). [2025-10-13T18:53:58.049307] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-13T18:53:58.049535] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCN took 37.3s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-13T18:53:58.218553] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:58.270930] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-10-13T18:53:58.271267] [INFO ] [MAIN ] FCX: Loaded 54480 existing records. [2025-10-13T18:53:58.464274] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:58.464487] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-13T18:53:58.464533] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-13T18:53:58.465075] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-13T18:53:58.465132] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-13T18:53:58.546597] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T18:53:58.823166] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-13T18:53:58.828813] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:59.617951] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-13T18:54:00.304304] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:54:00.417983] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-13T18:54:00.576299] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T18:54:00.778202] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T18:54:01.217989] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-13T18:54:01.611668] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T18:54:02.018036] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-13T18:54:02.817953] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-13T18:54:03.162437] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T18:54:03.617977] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-13T18:54:04.417998] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-13T18:54:04.753326] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:54:04.855030] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:54:04.881109] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:54:05.217970] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-13T18:54:06.017995] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-13T18:54:06.365495] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T18:54:06.366859] [INFO ] [REMOTE ] FCRX: Full fetch complete (1672 records). [2025-10-13T18:54:06.366952] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-13T18:54:06.639733] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-13T18:54:06.640116] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:54:06.640208] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:54:06.640301] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-13T18:54:06.640421] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-13T18:54:06.640496] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-13T18:54:06.640577] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-13T18:54:06.640694] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCRX took 29.2s. Estimated remaining: 3h 38m 9s. Rate: 7.1 symbols/min [2025-10-13T18:54:06.818972] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-13T18:54:06.933435] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:06.991639] [DEBUG] [LOCAL ] FDP: Loaded 30435 existing records from primary storage. [2025-10-13T18:54:06.992194] [INFO ] [MAIN ] FDP: Loaded 30435 existing records. [2025-10-13T18:54:07.246441] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:07.247111] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-13T18:54:07.247240] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-13T18:54:07.247891] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-13T18:54:07.248189] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-13T18:54:07.502535] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-13T18:54:07.623276] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-13T18:54:07.791417] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:08.387744] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:54:08.392135] [INFO ] [REMOTE ] FCPT: Full fetch complete (53715 records). [2025-10-13T18:54:08.392247] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-13T18:54:08.423383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-13T18:54:08.779137] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-13T18:54:08.779222] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-13T18:54:08.780065] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-13T18:54:08.780130] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-13T18:54:08.781269] [DEBUG] [LOCAL ] FCPT: Trimmed 53715 records to 37317 (keeping 200 days of data) [2025-10-13T18:54:09.012914] [DEBUG] [LOCAL ] FCPT: Primary data saved (37317 records). [2025-10-13T18:54:09.013070] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-13T18:54:09.013154] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FCPT took 36.9s. Estimated remaining: 3h 37m 50s. Rate: 7.1 symbols/min [2025-10-13T18:54:09.185517] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:09.214105] [DEBUG] [LOCAL ] FDS: Loaded 27620 existing records from primary storage. [2025-10-13T18:54:09.214376] [INFO ] [MAIN ] FDS: Loaded 27620 existing records. [2025-10-13T18:54:09.245527] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-13T18:54:09.403321] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:09.403806] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-13T18:54:09.404011] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-13T18:54:09.404513] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-13T18:54:09.404574] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-13T18:54:09.691951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:54:09.801239] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:09.835234] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-13T18:54:10.024216] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-13T18:54:10.030014] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:54:10.817969] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-13T18:54:11.156546] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:54:11.617980] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-13T18:54:11.644547] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T18:54:12.417922] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-13T18:54:12.875917] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:54:13.217918] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-13T18:54:14.017985] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-13T18:54:14.429678] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:54:14.626976] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T18:54:14.801851] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:54:14.817904] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-13T18:54:15.617922] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-13T18:54:16.417978] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-13T18:54:16.563741] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:54:16.756479] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:54:17.217904] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-13T18:54:17.624144] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:54:17.747419] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T18:54:18.017922] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-13T18:54:18.817949] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-13T18:54:19.303198] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:54:19.617952] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-13T18:54:20.418012] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-13T18:54:20.678849] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:54:21.035201] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:54:21.217988] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-13T18:54:21.612601] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T18:54:22.017945] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-13T18:54:22.823411] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-13T18:54:22.832811] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:54:23.027767] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:54:23.617913] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-13T18:54:24.252819] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:54:24.418011] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-13T18:54:24.575968] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T18:54:24.578286] [INFO ] [REMOTE ] FCT: Full fetch complete (21021 records). [2025-10-13T18:54:24.578356] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-13T18:54:24.935883] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-13T18:54:24.935957] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-13T18:54:24.936358] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-13T18:54:24.936396] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-13T18:54:24.936963] [DEBUG] [LOCAL ] FCT: Trimmed 21021 records to 14759 (keeping 200 days of data) [2025-10-13T18:54:25.023153] [DEBUG] [LOCAL ] FCT: Primary data saved (14759 records). [2025-10-13T18:54:25.023288] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-13T18:54:25.023366] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCT took 35.3s. Estimated remaining: 3h 37m 56s. Rate: 7.1 symbols/min [2025-10-13T18:54:25.198223] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:25.227123] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-13T18:54:25.248595] [DEBUG] [LOCAL ] FDX: Loaded 52203 existing records from primary storage. [2025-10-13T18:54:25.248926] [INFO ] [MAIN ] FDX: Loaded 52203 existing records. [2025-10-13T18:54:25.426670] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:25.426933] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-13T18:54:25.427198] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-13T18:54:25.435518] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-13T18:54:25.446979] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-13T18:54:25.513059] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:54:25.801954] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:26.017959] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-13T18:54:26.818005] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-13T18:54:27.529917] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T18:54:27.617884] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-13T18:54:27.905314] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T18:54:28.088756] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T18:54:28.417901] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-13T18:54:29.217953] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-13T18:54:29.632072] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T18:54:29.735189] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T18:54:30.017960] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-13T18:54:30.258289] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T18:54:30.817964] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-13T18:54:31.460059] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:54:31.617939] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-13T18:54:31.775388] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:54:32.417981] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-13T18:54:33.217893] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-13T18:54:33.369970] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T18:54:34.017896] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-13T18:54:34.310139] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:54:34.421057] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T18:54:34.818030] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-13T18:54:35.277031] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:54:35.282362] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-13T18:54:35.282466] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-13T18:54:35.623257] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-13T18:54:35.673106] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-13T18:54:35.673296] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-13T18:54:35.674381] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-13T18:54:35.674502] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-13T18:54:35.676002] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-13T18:54:36.010140] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:54:36.039979] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-13T18:54:36.040084] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-13T18:54:36.040793] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FCX took 38.0s. Estimated remaining: 3h 37m 52s. Rate: 7.1 symbols/min [2025-10-13T18:54:36.205561] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:36.258738] [DEBUG] [LOCAL ] FE: Loaded 54212 existing records from primary storage. [2025-10-13T18:54:36.259045] [INFO ] [MAIN ] FE: Loaded 54212 existing records. [2025-10-13T18:54:36.427310] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-13T18:54:36.432326] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:36.432678] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-13T18:54:36.432805] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-13T18:54:36.434217] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-13T18:54:36.434294] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-13T18:54:36.802844] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:36.816189] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T18:54:37.217984] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-13T18:54:38.017893] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-13T18:54:38.346675] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:54:38.490960] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T18:54:38.817973] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-13T18:54:39.332472] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:54:39.617904] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-13T18:54:40.417901] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-13T18:54:40.527587] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:54:40.779749] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:54:40.782958] [INFO ] [REMOTE ] FDP: Full fetch complete (42638 records). [2025-10-13T18:54:40.783074] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-13T18:54:41.154733] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-13T18:54:41.154834] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-13T18:54:41.155500] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-13T18:54:41.155669] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-13T18:54:41.156607] [DEBUG] [LOCAL ] FDP: Trimmed 42638 records to 29912 (keeping 200 days of data) [2025-10-13T18:54:41.218430] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-13T18:54:41.324013] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T18:54:41.364523] [DEBUG] [LOCAL ] FDP: Primary data saved (29912 records). [2025-10-13T18:54:41.364664] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-13T18:54:41.364758] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FDP took 34.7s. Estimated remaining: 3h 37m 38s. Rate: 7.1 symbols/min [2025-10-13T18:54:41.530283] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:41.530506] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-13T18:54:41.530561] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-13T18:54:41.530696] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-13T18:54:41.530764] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-13T18:54:41.530808] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-13T18:54:41.530841] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-13T18:54:41.877789] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:42.017910] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-13T18:54:42.817986] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-13T18:54:42.909934] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:54:42.981156] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T18:54:43.617910] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-13T18:54:44.417903] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-13T18:54:44.800276] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:54:44.843070] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:54:45.217892] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-13T18:54:46.017895] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-13T18:54:46.236495] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:54:46.436303] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T18:54:46.817903] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-13T18:54:46.899275] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:54:47.244622] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T18:54:47.617952] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-13T18:54:48.417958] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-13T18:54:49.217908] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-13T18:54:49.414516] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T18:54:49.418844] [INFO ] [REMOTE ] FDS: Full fetch complete (38193 records). [2025-10-13T18:54:49.418943] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-13T18:54:49.799514] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-13T18:54:49.799614] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-13T18:54:49.800227] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-13T18:54:49.800353] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-13T18:54:49.801558] [DEBUG] [LOCAL ] FDS: Trimmed 38193 records to 27413 (keeping 200 days of data) [2025-10-13T18:54:49.927870] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:54:50.017012] [DEBUG] [LOCAL ] FDS: Primary data saved (27413 records). [2025-10-13T18:54:50.017164] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-13T18:54:50.017270] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDS took 41.0s. Estimated remaining: 3h 37m 30s. Rate: 7.1 symbols/min [2025-10-13T18:54:50.028603] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-13T18:54:50.188184] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:50.236896] [DEBUG] [LOCAL ] FERG: Loaded 49475 existing records from primary storage. [2025-10-13T18:54:50.237225] [INFO ] [MAIN ] FERG: Loaded 49475 existing records. [2025-10-13T18:54:50.412669] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:50.412915] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-13T18:54:50.412963] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-13T18:54:50.413483] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-13T18:54:50.413541] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-13T18:54:50.650440] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T18:54:50.779578] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:50.817918] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-13T18:54:50.979378] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:54:51.621001] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-13T18:54:52.044578] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:54:52.417906] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-13T18:54:52.514365] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:54:53.217948] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-13T18:54:54.017963] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-13T18:54:54.387046] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T18:54:54.495294] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T18:54:54.817977] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-13T18:54:55.051714] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:54:55.617950] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-13T18:54:56.417961] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-13T18:54:56.668733] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:54:56.675987] [INFO ] [REMOTE ] FDX: Full fetch complete (74323 records). [2025-10-13T18:54:56.676170] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-13T18:54:56.790788] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T18:54:57.084753] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-13T18:54:57.084937] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-13T18:54:57.085828] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-13T18:54:57.085889] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-13T18:54:57.087258] [DEBUG] [LOCAL ] FDX: Trimmed 74323 records to 51396 (keeping 200 days of data) [2025-10-13T18:54:57.268495] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-13T18:54:57.414932] [DEBUG] [LOCAL ] FDX: Primary data saved (51396 records). [2025-10-13T18:54:57.415105] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-13T18:54:57.415345] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 32.4s. Estimated remaining: 3h 37m 20s. Rate: 7.1 symbols/min [2025-10-13T18:54:57.561502] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T18:54:57.631423] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:57.645080] [DEBUG] [LOCAL ] FET: Loaded 12967 existing records from primary storage. [2025-10-13T18:54:57.645298] [INFO ] [MAIN ] FET: Loaded 12967 existing records. [2025-10-13T18:54:57.823526] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:57.823771] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-13T18:54:57.823822] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-13T18:54:57.824149] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-13T18:54:57.824207] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-13T18:54:58.028124] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-13T18:54:58.174561] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:58.362905] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T18:54:58.817915] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-13T18:54:59.112211] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:54:59.617997] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-13T18:54:59.650507] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:55:00.417967] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-13T18:55:01.217993] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-13T18:55:01.452993] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:55:01.583908] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-13T18:55:02.018018] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-13T18:55:02.105210] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T18:55:02.384806] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T18:55:02.817974] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-13T18:55:03.617995] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-13T18:55:04.418710] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-13T18:55:04.419635] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T18:55:04.583362] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:55:05.217965] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-13T18:55:06.018005] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-13T18:55:06.368618] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:55:06.385891] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T18:55:06.817908] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-13T18:55:07.080609] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:55:07.279611] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:55:07.280411] [INFO ] [REMOTE ] FENG: Full fetch complete (2278 records). [2025-10-13T18:55:07.280477] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-13T18:55:07.454193] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:55:07.454412] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:55:07.454481] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:55:07.454532] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-13T18:55:07.454620] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-13T18:55:07.454702] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-13T18:55:07.454760] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-13T18:55:07.454822] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FENG took 26.1s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-13T18:55:07.620209] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:07.619336] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-13T18:55:07.642796] [DEBUG] [LOCAL ] FF: Loaded 24777 existing records from primary storage. [2025-10-13T18:55:07.643049] [INFO ] [MAIN ] FF: Loaded 24777 existing records. [2025-10-13T18:55:07.825673] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:07.825916] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-13T18:55:07.825967] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-13T18:55:07.826559] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-13T18:55:07.826619] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-13T18:55:08.186033] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:08.417943] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-13T18:55:09.217970] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-13T18:55:09.476780] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:55:09.522992] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T18:55:09.812880] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:55:10.017943] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-13T18:55:10.817967] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-13T18:55:11.617971] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-13T18:55:11.823103] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T18:55:11.941148] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:55:12.417954] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-13T18:55:12.554252] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:55:13.217959] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-13T18:55:14.017956] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-13T18:55:14.135948] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T18:55:14.219489] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:55:14.817976] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-13T18:55:15.132050] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:55:15.618172] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-13T18:55:15.672487] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T18:55:16.417995] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-13T18:55:17.219821] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-13T18:55:17.222245] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:55:17.312801] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:55:17.563470] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T18:55:17.569051] [INFO ] [REMOTE ] FE: Full fetch complete (77288 records). [2025-10-13T18:55:17.569193] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-13T18:55:17.978462] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-13T18:55:17.978588] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-13T18:55:17.979824] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-13T18:55:17.979894] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-13T18:55:17.981540] [DEBUG] [LOCAL ] FE: Trimmed 77288 records to 53432 (keeping 200 days of data) [2025-10-13T18:55:18.036707] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-13T18:55:18.340932] [DEBUG] [LOCAL ] FE: Primary data saved (53432 records). [2025-10-13T18:55:18.341089] [INFO ] [MAIN ] FE: Full history saved. [2025-10-13T18:55:18.342043] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FE took 42.3s. Estimated remaining: 3h 37m 11s. Rate: 7.1 symbols/min [2025-10-13T18:55:18.524665] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:18.537075] [DEBUG] [LOCAL ] FFA: Loaded 6187 existing records from primary storage. [2025-10-13T18:55:18.537376] [INFO ] [MAIN ] FFA: Loaded 6187 existing records. [2025-10-13T18:55:18.716255] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:18.716514] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-13T18:55:18.716562] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-13T18:55:18.716891] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-13T18:55:18.716960] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-13T18:55:18.823079] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-13T18:55:19.075029] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:19.617915] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-13T18:55:19.850152] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:55:20.253260] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:55:20.269879] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:55:20.417950] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-13T18:55:21.217965] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-13T18:55:21.622087] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:55:22.017899] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-13T18:55:22.099886] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T18:55:22.626960] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:55:22.817963] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-13T18:55:23.617949] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-13T18:55:23.901335] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T18:55:24.413907] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T18:55:24.418053] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-13T18:55:25.217970] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-13T18:55:25.315025] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T18:55:25.316892] [INFO ] [REMOTE ] FET: Full fetch complete (18273 records). [2025-10-13T18:55:25.316965] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-13T18:55:25.674106] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-13T18:55:25.674188] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-13T18:55:25.674742] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-13T18:55:25.674806] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-13T18:55:25.675416] [DEBUG] [LOCAL ] FET: Trimmed 18273 records to 12840 (keeping 200 days of data) [2025-10-13T18:55:25.758389] [DEBUG] [LOCAL ] FET: Primary data saved (12840 records). [2025-10-13T18:55:25.758538] [INFO ] [MAIN ] FET: Full history saved. [2025-10-13T18:55:25.758639] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FET took 28.3s. Estimated remaining: 3h 37m 0s. Rate: 7.1 symbols/min [2025-10-13T18:55:25.931204] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:25.938570] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:55:25.956390] [DEBUG] [LOCAL ] FFC: Loaded 17022 existing records from primary storage. [2025-10-13T18:55:25.956622] [INFO ] [MAIN ] FFC: Loaded 17022 existing records. [2025-10-13T18:55:26.023037] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-13T18:55:26.138605] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:26.138861] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-13T18:55:26.138908] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-13T18:55:26.139304] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-13T18:55:26.139363] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-13T18:55:26.490984] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:26.817948] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-13T18:55:27.025777] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:55:27.453603] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T18:55:27.617895] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-13T18:55:28.203436] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:55:28.417963] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-13T18:55:29.218034] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-13T18:55:29.542051] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:55:29.910987] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:55:30.017980] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-13T18:55:30.817944] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-13T18:55:31.137697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:55:31.617977] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-13T18:55:32.249596] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:55:32.410228] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:55:32.419110] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-13T18:55:32.858044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:55:33.217945] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-13T18:55:33.886402] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:55:34.018026] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-13T18:55:34.818005] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-13T18:55:35.070402] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:55:35.411137] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T18:55:35.617911] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-13T18:55:36.223258] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:55:36.417910] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-13T18:55:36.913227] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:55:37.218006] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-13T18:55:38.017892] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-13T18:55:38.054516] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T18:55:38.817981] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-13T18:55:39.617912] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-13T18:55:39.785285] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:55:39.818106] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:55:40.417970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-13T18:55:40.459316] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T18:55:40.460815] [INFO ] [REMOTE ] FFA: Full fetch complete (8779 records). [2025-10-13T18:55:40.460882] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-13T18:55:40.811486] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-13T18:55:40.811559] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-13T18:55:40.811794] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-13T18:55:40.811854] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-13T18:55:40.812244] [DEBUG] [LOCAL ] FFA: Trimmed 8779 records to 6060 (keeping 200 days of data) [2025-10-13T18:55:40.849366] [DEBUG] [LOCAL ] FFA: Primary data saved (6060 records). [2025-10-13T18:55:40.849492] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-13T18:55:40.849608] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFA took 22.5s. Estimated remaining: 3h 37m 4s. Rate: 7.1 symbols/min [2025-10-13T18:55:41.013843] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:41.052914] [DEBUG] [LOCAL ] FFWM: Loaded 36288 existing records from primary storage. [2025-10-13T18:55:41.053177] [INFO ] [MAIN ] FFWM: Loaded 36288 existing records. [2025-10-13T18:55:41.228686] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:41.223976] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-13T18:55:41.229719] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-13T18:55:41.230086] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-13T18:55:41.230403] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-13T18:55:41.230459] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-13T18:55:41.418091] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:55:41.601164] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:42.017944] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-13T18:55:42.265883] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:55:42.268250] [INFO ] [REMOTE ] FF: Full fetch complete (36338 records). [2025-10-13T18:55:42.268344] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-13T18:55:42.635497] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-13T18:55:42.635578] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-13T18:55:42.636151] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-13T18:55:42.636215] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-13T18:55:42.637144] [DEBUG] [LOCAL ] FF: Trimmed 36338 records to 24334 (keeping 200 days of data) [2025-10-13T18:55:42.778588] [DEBUG] [LOCAL ] FF: Primary data saved (24334 records). [2025-10-13T18:55:42.778748] [INFO ] [MAIN ] FF: Full history saved. [2025-10-13T18:55:42.778837] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FF took 35.3s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-13T18:55:42.823088] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-13T18:55:42.955378] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:42.982615] [DEBUG] [LOCAL ] FG: Loaded 23056 existing records from primary storage. [2025-10-13T18:55:42.982948] [INFO ] [MAIN ] FG: Loaded 23056 existing records. [2025-10-13T18:55:43.163189] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:43.163527] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-13T18:55:43.163588] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-13T18:55:43.163984] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-13T18:55:43.164276] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-13T18:55:43.474822] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:55:43.560175] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:43.617889] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-13T18:55:44.417942] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-13T18:55:44.438070] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:55:44.443382] [INFO ] [REMOTE ] FERG: Full fetch complete (70791 records). [2025-10-13T18:55:44.443542] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-13T18:55:44.866895] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-13T18:55:44.867070] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-13T18:55:44.868456] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-13T18:55:44.868626] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-13T18:55:44.870871] [DEBUG] [LOCAL ] FERG: Trimmed 70791 records to 48791 (keeping 200 days of data) [2025-10-13T18:55:44.961226] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T18:55:45.144730] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T18:55:45.218130] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-13T18:55:45.231149] [DEBUG] [LOCAL ] FERG: Primary data saved (48791 records). [2025-10-13T18:55:45.231535] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-13T18:55:45.231633] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FERG took 55.2s. Estimated remaining: 3h 36m 24s. Rate: 7.1 symbols/min [2025-10-13T18:55:45.394852] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:45.400007] [DEBUG] [LOCAL ] FGN: Loaded 3821 existing records from primary storage. [2025-10-13T18:55:45.400167] [INFO ] [MAIN ] FGN: Loaded 3821 existing records. [2025-10-13T18:55:45.570062] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:45.570272] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-13T18:55:45.570351] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-13T18:55:45.570496] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-13T18:55:45.570534] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-13T18:55:45.918535] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:46.017895] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-13T18:55:46.543178] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T18:55:46.564448] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:55:46.817963] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-13T18:55:47.618014] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-13T18:55:48.209620] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:55:48.232425] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:55:48.417942] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-13T18:55:49.217990] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-13T18:55:49.596136] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:55:49.931271] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:55:50.017930] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-13T18:55:50.517484] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-13T18:55:50.817945] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-13T18:55:51.617892] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-13T18:55:51.776075] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T18:55:52.417948] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-13T18:55:52.946511] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:55:53.208248] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T18:55:53.217986] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-13T18:55:54.017980] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-13T18:55:54.213382] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:55:54.600418] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T18:55:54.817906] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-13T18:55:55.617902] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-13T18:55:56.060535] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:55:56.235049] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:55:56.417935] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-13T18:55:56.969399] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T18:55:57.217961] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-13T18:55:57.825422] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T18:55:58.017968] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-13T18:55:58.817941] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-13T18:55:59.501583] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:55:59.617963] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-13T18:55:59.813159] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T18:56:00.417980] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-13T18:56:00.485224] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:56:01.217965] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-13T18:56:01.527149] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T18:56:02.017907] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-13T18:56:02.342057] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:56:02.818017] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-13T18:56:02.953590] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T18:56:03.436323] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:56:03.617943] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-13T18:56:04.417944] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-13T18:56:04.847893] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:56:04.851849] [INFO ] [REMOTE ] FFWM: Full fetch complete (51722 records). [2025-10-13T18:56:04.851964] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-13T18:56:05.223843] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-13T18:56:05.269887] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-13T18:56:05.269983] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-13T18:56:05.270803] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-13T18:56:05.270866] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-13T18:56:05.272341] [DEBUG] [LOCAL ] FFWM: Trimmed 51722 records to 35828 (keeping 200 days of data) [2025-10-13T18:56:05.389701] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:56:05.488962] [DEBUG] [LOCAL ] FFWM: Primary data saved (35828 records). [2025-10-13T18:56:05.489133] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-13T18:56:05.489901] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFWM took 24.6s. Estimated remaining: 3h 36m 38s. Rate: 7.1 symbols/min [2025-10-13T18:56:05.655948] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:05.656160] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-13T18:56:05.656198] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-13T18:56:05.656310] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-13T18:56:05.656352] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-13T18:56:05.656397] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-13T18:56:05.656429] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-13T18:56:06.002925] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:06.017889] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-13T18:56:06.225545] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:56:06.225907] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-13T18:56:06.226001] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:56:06.226049] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-13T18:56:06.226105] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:56:06.226177] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-13T18:56:06.226282] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-13T18:56:06.226325] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-13T18:56:06.226366] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-13T18:56:06.226426] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGSN took 0.7s. Estimated remaining: 3h 36m 15s. Rate: 7.1 symbols/min [2025-10-13T18:56:06.409881] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:06.413767] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:56:06.460000] [DEBUG] [LOCAL ] FHI: Loaded 40451 existing records from primary storage. [2025-10-13T18:56:06.460295] [INFO ] [MAIN ] FHI: Loaded 40451 existing records. [2025-10-13T18:56:06.633967] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:06.634177] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-13T18:56:06.634224] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-13T18:56:06.634720] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-13T18:56:06.634778] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-13T18:56:06.825720] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-13T18:56:06.986613] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:07.617949] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-13T18:56:08.151239] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:56:08.417986] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-13T18:56:09.105784] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:56:09.217959] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-13T18:56:09.422744] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:56:10.017949] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-13T18:56:10.448595] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:56:10.580127] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:56:10.817935] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-13T18:56:11.617949] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-13T18:56:12.356704] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:56:12.380791] [INFO ] [REMOTE ] FFC: Full fetch complete (24579 records). [2025-10-13T18:56:12.391544] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-13T18:56:12.394180] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:56:12.425733] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-13T18:56:12.784873] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-13T18:56:12.784954] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-13T18:56:12.785539] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-13T18:56:12.785579] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-13T18:56:12.786224] [DEBUG] [LOCAL ] FFC: Trimmed 24579 records to 16800 (keeping 200 days of data) [2025-10-13T18:56:12.889515] [DEBUG] [LOCAL ] FFC: Primary data saved (16800 records). [2025-10-13T18:56:12.889691] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-13T18:56:12.889791] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FFC took 47.1s. Estimated remaining: 3h 36m 4s. Rate: 7.1 symbols/min [2025-10-13T18:56:13.058119] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:13.109335] [DEBUG] [LOCAL ] FHN: Loaded 54153 existing records from primary storage. [2025-10-13T18:56:13.109667] [INFO ] [MAIN ] FHN: Loaded 54153 existing records. [2025-10-13T18:56:13.223038] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-13T18:56:13.286434] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:13.286817] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-13T18:56:13.286866] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-13T18:56:13.287369] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-13T18:56:13.287425] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-13T18:56:13.672028] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:13.683919] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T18:56:14.017937] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-13T18:56:14.603084] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T18:56:14.818020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-13T18:56:15.500609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:56:15.617931] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-13T18:56:15.717171] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:56:16.417938] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-13T18:56:16.616750] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:56:17.218032] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-13T18:56:17.973913] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:56:18.017891] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-13T18:56:18.817890] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-13T18:56:18.925178] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:56:19.617952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-13T18:56:19.690777] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:56:19.764919] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:56:19.767391] [INFO ] [REMOTE ] FG: Full fetch complete (28287 records). [2025-10-13T18:56:19.767466] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-13T18:56:20.129581] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-13T18:56:20.129692] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-13T18:56:20.130194] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-13T18:56:20.130260] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-13T18:56:20.130955] [DEBUG] [LOCAL ] FG: Trimmed 28287 records to 22312 (keeping 200 days of data) [2025-10-13T18:56:20.266294] [DEBUG] [LOCAL ] FG: Primary data saved (22312 records). [2025-10-13T18:56:20.266426] [INFO ] [MAIN ] FG: Full history saved. [2025-10-13T18:56:20.266504] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FG took 37.5s. Estimated remaining: 3h 35m 53s. Rate: 7.1 symbols/min [2025-10-13T18:56:20.429457] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-13T18:56:20.433197] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:20.489602] [DEBUG] [LOCAL ] FI: Loaded 54313 existing records from primary storage. [2025-10-13T18:56:20.489966] [INFO ] [MAIN ] FI: Loaded 54313 existing records. [2025-10-13T18:56:20.667409] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:20.667661] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-13T18:56:20.667730] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-13T18:56:20.668854] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-13T18:56:20.668918] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-13T18:56:21.040473] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:21.064034] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:56:21.217964] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-13T18:56:22.017905] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-13T18:56:22.186943] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:56:22.817978] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-13T18:56:22.949743] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:56:23.175035] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:56:23.617931] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-13T18:56:24.417900] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-13T18:56:24.552239] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:56:24.803531] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T18:56:25.141226] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:56:25.217958] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-13T18:56:26.017988] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-13T18:56:26.550756] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T18:56:26.817902] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-13T18:56:26.963409] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:56:27.283856] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T18:56:27.284692] [INFO ] [REMOTE ] FGN: Full fetch complete (5655 records). [2025-10-13T18:56:27.284759] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-13T18:56:27.618238] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-13T18:56:27.642535] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-13T18:56:27.642625] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-13T18:56:27.642944] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-13T18:56:27.642997] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-13T18:56:27.643575] [DEBUG] [LOCAL ] FGN: Trimmed 5655 records to 3758 (keeping 200 days of data) [2025-10-13T18:56:27.669410] [DEBUG] [LOCAL ] FGN: Primary data saved (3758 records). [2025-10-13T18:56:27.669531] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-13T18:56:27.669662] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FGN took 42.4s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-13T18:56:27.843286] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:27.866556] [DEBUG] [LOCAL ] FICO: Loaded 21793 existing records from primary storage. [2025-10-13T18:56:27.866839] [INFO ] [MAIN ] FICO: Loaded 21793 existing records. [2025-10-13T18:56:28.039381] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:28.039603] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-13T18:56:28.039673] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-13T18:56:28.040028] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-13T18:56:28.040084] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-13T18:56:28.388055] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:28.417894] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-13T18:56:29.152111] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:56:29.217900] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-13T18:56:29.441880] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:56:30.017981] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-13T18:56:30.817990] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-13T18:56:30.905933] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:56:31.505936] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T18:56:31.617972] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-13T18:56:31.956294] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:56:32.417946] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-13T18:56:32.976927] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:56:33.216750] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:56:33.220963] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-13T18:56:34.021788] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-13T18:56:34.817924] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-13T18:56:34.999085] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:56:35.521080] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:56:35.617985] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-13T18:56:36.288466] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:56:36.292319] [INFO ] [REMOTE ] FHI: Full fetch complete (57511 records). [2025-10-13T18:56:36.292418] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-13T18:56:36.428746] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-13T18:56:36.672996] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-13T18:56:36.673091] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-13T18:56:36.673885] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-13T18:56:36.673949] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-13T18:56:36.675165] [DEBUG] [LOCAL ] FHI: Trimmed 57511 records to 39869 (keeping 200 days of data) [2025-10-13T18:56:36.913151] [DEBUG] [LOCAL ] FHI: Primary data saved (39869 records). [2025-10-13T18:56:36.913302] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-13T18:56:36.914053] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FHI took 30.7s. Estimated remaining: 3h 35m 36s. Rate: 7.1 symbols/min [2025-10-13T18:56:37.110132] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:37.110452] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-13T18:56:37.110533] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-13T18:56:37.110755] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-13T18:56:37.110819] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-13T18:56:37.110875] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-13T18:56:37.110917] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-13T18:56:37.221672] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-13T18:56:37.502470] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:37.544516] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:56:37.606546] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T18:56:38.017991] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-13T18:56:38.817957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-13T18:56:38.959163] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:56:39.130460] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-13T18:56:39.617971] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-13T18:56:39.689880] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:56:39.855813] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-13T18:56:40.417982] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-13T18:56:41.217983] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-13T18:56:42.017984] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-13T18:56:42.366044] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T18:56:42.396974] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:56:42.817967] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-13T18:56:43.244734] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T18:56:43.618006] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-13T18:56:43.713931] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:56:43.720159] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-13T18:56:43.720293] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-13T18:56:43.883799] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-13T18:56:44.112355] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-13T18:56:44.112441] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-13T18:56:44.113411] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-13T18:56:44.113479] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-13T18:56:44.114966] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53388 (keeping 200 days of data) [2025-10-13T18:56:44.418627] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-13T18:56:44.443834] [DEBUG] [LOCAL ] FHN: Primary data saved (53388 records). [2025-10-13T18:56:44.443996] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-13T18:56:44.444096] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 31.6s. Estimated remaining: 3h 35m 26s. Rate: 7.1 symbols/min [2025-10-13T18:56:44.616245] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:44.659778] [DEBUG] [LOCAL ] FIGS: Loaded 49411 existing records from primary storage. [2025-10-13T18:56:44.660160] [INFO ] [MAIN ] FIGS: Loaded 49411 existing records. [2025-10-13T18:56:44.766942] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-13T18:56:44.856411] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:44.856668] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-13T18:56:44.856727] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-13T18:56:44.857496] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-13T18:56:44.857553] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-13T18:56:45.209088] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:45.217888] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-13T18:56:46.017946] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-13T18:56:46.289726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-13T18:56:46.817964] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-13T18:56:46.875711] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:56:47.009394] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:56:47.009863] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-13T18:56:47.009979] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:56:47.010075] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-13T18:56:47.010159] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:56:47.010247] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-13T18:56:47.010335] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-13T18:56:47.010387] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-13T18:56:47.010450] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-13T18:56:47.010540] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 10.1s. Estimated remaining: 3h 35m 7s. Rate: 7.1 symbols/min [2025-10-13T18:56:47.194430] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:47.239889] [DEBUG] [LOCAL ] FIHL: Loaded 40181 existing records from primary storage. [2025-10-13T18:56:47.240198] [INFO ] [MAIN ] FIHL: Loaded 40181 existing records. [2025-10-13T18:56:47.429094] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:47.429316] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-13T18:56:47.429368] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-13T18:56:47.430304] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-13T18:56:47.430368] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-13T18:56:47.623050] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-13T18:56:47.808551] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:48.418009] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-13T18:56:49.017744] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:56:49.217945] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-13T18:56:49.790536] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:56:50.018006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-13T18:56:50.057388] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T18:56:50.817947] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-13T18:56:50.961177] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:56:51.617934] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-13T18:56:51.736675] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:56:52.417971] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-13T18:56:53.200779] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:56:53.217885] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-13T18:56:54.010742] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:56:54.023027] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-13T18:56:54.817933] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-13T18:56:54.924207] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:56:55.366357] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:56:55.617942] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-13T18:56:56.417942] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-13T18:56:56.519348] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:56:56.754120] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:56:57.218015] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-13T18:56:57.980314] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:56:58.017882] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-13T18:56:58.817925] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-13T18:56:58.906861] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:56:59.191724] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T18:56:59.617959] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-13T18:57:00.048939] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:57:00.417981] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-13T18:57:01.044988] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:57:01.217892] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-13T18:57:01.299522] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T18:57:02.017954] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-13T18:57:02.652061] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:57:02.817979] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-13T18:57:03.617966] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-13T18:57:04.290303] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T18:57:04.417950] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-13T18:57:04.495369] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T18:57:04.966134] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:57:04.974636] [INFO ] [REMOTE ] FICO: Full fetch complete (29619 records). [2025-10-13T18:57:04.974895] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-13T18:57:05.223161] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-13T18:57:05.345167] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-13T18:57:05.345253] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-13T18:57:05.345779] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-13T18:57:05.345842] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-13T18:57:05.346693] [DEBUG] [LOCAL ] FICO: Trimmed 29619 records to 21625 (keeping 200 days of data) [2025-10-13T18:57:05.479171] [DEBUG] [LOCAL ] FICO: Primary data saved (21625 records). [2025-10-13T18:57:05.479297] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-13T18:57:05.479373] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FICO took 37.8s. Estimated remaining: 3h 35m 17s. Rate: 7.1 symbols/min [2025-10-13T18:57:05.645669] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:05.655184] [DEBUG] [LOCAL ] FINS: Loaded 8390 existing records from primary storage. [2025-10-13T18:57:05.655399] [INFO ] [MAIN ] FINS: Loaded 8390 existing records. [2025-10-13T18:57:05.833472] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:05.833707] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-13T18:57:05.833762] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-13T18:57:05.833944] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-13T18:57:05.833981] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-13T18:57:06.042132] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-13T18:57:06.191708] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:06.468756] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T18:57:06.817918] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-13T18:57:06.969935] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:57:07.539165] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:57:07.617889] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-13T18:57:08.417974] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-13T18:57:08.490060] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:57:09.217964] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-13T18:57:09.505794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:57:09.728955] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T18:57:09.923595] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:57:09.929096] [INFO ] [REMOTE ] FI: Full fetch complete (77228 records). [2025-10-13T18:57:09.929235] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-13T18:57:10.023057] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-13T18:57:10.321836] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-13T18:57:10.321914] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-13T18:57:10.322795] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-13T18:57:10.322894] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-13T18:57:10.324345] [DEBUG] [LOCAL ] FI: Trimmed 77228 records to 53574 (keeping 200 days of data) [2025-10-13T18:57:10.653062] [DEBUG] [LOCAL ] FI: Primary data saved (53574 records). [2025-10-13T18:57:10.653415] [INFO ] [MAIN ] FI: Full history saved. [2025-10-13T18:57:10.653506] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FI took 50.4s. Estimated remaining: 3h 35m 3s. Rate: 7.1 symbols/min [2025-10-13T18:57:10.819562] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-13T18:57:10.824941] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:10.833106] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:57:10.881757] [DEBUG] [LOCAL ] FINV: Loaded 45966 existing records from primary storage. [2025-10-13T18:57:10.882158] [INFO ] [MAIN ] FINV: Loaded 45966 existing records. [2025-10-13T18:57:11.064707] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:11.065014] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-13T18:57:11.065065] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-13T18:57:11.066173] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-13T18:57:11.066232] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-13T18:57:11.433972] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:11.617985] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-13T18:57:12.417983] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-13T18:57:12.647210] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T18:57:13.031317] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:57:13.217952] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-13T18:57:13.819680] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T18:57:14.017896] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-13T18:57:14.817894] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-13T18:57:14.985169] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T18:57:15.474531] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:57:15.483925] [INFO ] [REMOTE ] FIHL: Full fetch complete (56157 records). [2025-10-13T18:57:15.484735] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T18:57:15.484841] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-13T18:57:15.623023] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-13T18:57:15.870753] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-13T18:57:15.870844] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-13T18:57:15.871559] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-13T18:57:15.871602] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-13T18:57:15.872839] [DEBUG] [LOCAL ] FIHL: Trimmed 56157 records to 39496 (keeping 200 days of data) [2025-10-13T18:57:16.110383] [DEBUG] [LOCAL ] FIHL: Primary data saved (39496 records). [2025-10-13T18:57:16.110590] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-13T18:57:16.111367] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 29.1s. Estimated remaining: 3h 34m 49s. Rate: 7.1 symbols/min [2025-10-13T18:57:16.324481] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:57:16.417942] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-13T18:57:17.149740] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T18:57:17.217897] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-13T18:57:18.004282] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:57:18.017874] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-13T18:57:18.779153] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:57:18.817926] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-13T18:57:19.554262] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T18:57:19.617943] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-13T18:57:20.417999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-13T18:57:21.217920] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-13T18:57:21.243825] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T18:57:21.281199] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:57:22.017940] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-13T18:57:22.699536] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:57:22.817960] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-13T18:57:23.564745] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T18:57:23.617966] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-13T18:57:23.656392] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:57:23.662452] [INFO ] [REMOTE ] FIGS: Full fetch complete (70793 records). [2025-10-13T18:57:23.662630] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-13T18:57:24.067726] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-13T18:57:24.067854] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-13T18:57:24.069192] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-13T18:57:24.069266] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-13T18:57:24.071240] [DEBUG] [LOCAL ] FIGS: Trimmed 70793 records to 48637 (keeping 200 days of data) [2025-10-13T18:57:24.286217] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:57:24.291013] [INFO ] [REMOTE ] FINS: Full fetch complete (11846 records). [2025-10-13T18:57:24.300073] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-13T18:57:24.420102] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-13T18:57:24.705706] [DEBUG] [LOCAL ] FIGS: Primary data saved (48637 records). [2025-10-13T18:57:24.724474] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-13T18:57:24.734572] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIGS took 40.3s. Estimated remaining: 3h 34m 41s. Rate: 7.1 symbols/min [2025-10-13T18:57:24.768916] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-13T18:57:24.769020] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-13T18:57:24.769558] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-13T18:57:24.769601] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-13T18:57:24.770163] [DEBUG] [LOCAL ] FINS: Trimmed 11846 records to 8300 (keeping 200 days of data) [2025-10-13T18:57:24.825262] [DEBUG] [LOCAL ] FINS: Primary data saved (8300 records). [2025-10-13T18:57:24.825459] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-13T18:57:24.825608] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FINS took 19.3s. Estimated remaining: 3h 34m 17s. Rate: 7.1 symbols/min [2025-10-13T18:57:25.899844] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:57:25.909343] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-13T18:57:27.456617] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:57:27.466302] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-13T18:57:29.071148] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:57:29.081034] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-13T18:57:30.585916] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:57:30.595164] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-13T18:57:32.079878] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:57:32.090265] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-13T18:57:33.608237] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T18:57:33.618808] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-13T18:57:35.069743] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:57:35.081232] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-13T18:57:36.765567] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:57:36.776339] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-13T18:57:38.409262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:57:38.414263] [INFO ] [REMOTE ] FINV: Full fetch complete (64218 records). [2025-10-13T18:57:38.414380] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-13T18:57:38.813521] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-13T18:57:38.813607] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-13T18:57:38.814457] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-13T18:57:38.814523] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-13T18:57:38.815906] [DEBUG] [LOCAL ] FINV: Trimmed 64218 records to 45299 (keeping 200 days of data) [2025-10-13T18:57:39.073275] [DEBUG] [LOCAL ] FINV: Primary data saved (45299 records). [2025-10-13T18:57:39.073408] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-13T18:57:39.073490] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FINV took 28.4s. Estimated remaining: 3h 34m 20s. Rate: 7.1 symbols/min [2025-10-13T18:57:39.775144] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.733251] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.814098] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.886353] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.886972] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-13T18:57:39.887025] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-13T18:57:39.887138] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-13T18:57:39.887182] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-13T18:57:39.887228] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-13T18:57:39.887267] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-13T18:57:40.012210] [DEBUG] [LOCAL ] FLC: Loaded 5479 existing records from primary storage. [2025-10-13T18:57:40.029733] [INFO ] [MAIN ] FLC: Loaded 5479 existing records. [2025-10-13T18:57:40.121746] [DEBUG] [LOCAL ] FIX: Loaded 29642 existing records from primary storage. [2025-10-13T18:57:40.172114] [INFO ] [MAIN ] FIX: Loaded 29642 existing records. [2025-10-13T18:57:40.469362] [DEBUG] [LOCAL ] FIS: Loaded 54124 existing records from primary storage. [2025-10-13T18:57:40.481957] [INFO ] [MAIN ] FIS: Loaded 54124 existing records. [2025-10-13T18:57:40.800306] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:40.851053] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:40.853831] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-13T18:57:40.853988] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-13T18:57:40.879696] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-13T18:57:40.879572] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-13T18:57:40.885564] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-13T18:57:40.899787] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-13T18:57:40.922363] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-13T18:57:40.889350] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:41.006920] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-13T18:57:41.006210] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-13T18:57:41.132744] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:41.184877] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-13T18:57:41.191673] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-13T18:57:41.221147] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-13T18:57:41.246570] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-13T18:57:41.492161] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:57:41.568773] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-13T18:57:41.631903] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:57:41.684833] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-13T18:57:41.715314] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:57:41.746410] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-13T18:57:41.749847] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:41.762433] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-13T18:57:41.762835] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-13T18:57:41.774612] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-13T18:57:41.785502] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-13T18:57:41.843445] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 34m 1s. Rate: 7.1 symbols/min [2025-10-13T18:57:42.142367] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:42.222957] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-13T18:57:42.366917] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:42.383254] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-13T18:57:42.407931] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:42.476810] [DEBUG] [LOCAL ] FLG: Loaded 54092 existing records from primary storage. [2025-10-13T18:57:42.477313] [INFO ] [MAIN ] FLG: Loaded 54092 existing records. [2025-10-13T18:57:42.663321] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:42.663822] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-13T18:57:42.663921] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-13T18:57:42.664496] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-13T18:57:42.664554] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-13T18:57:42.936630] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:57:42.948957] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-13T18:57:43.029283] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:43.029592] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-13T18:57:43.591041] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:57:43.596964] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-13T18:57:43.710448] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:57:43.712297] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-13T18:57:44.177159] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T18:57:44.191867] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-13T18:57:44.272096] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T18:57:44.273703] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-13T18:57:44.816552] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:57:44.819199] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-13T18:57:44.853463] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:57:44.865137] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-13T18:57:45.097599] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:57:45.105317] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-13T18:57:45.263741] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:57:45.266601] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-13T18:57:45.714170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:57:45.724714] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-13T18:57:45.868389] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T18:57:45.870220] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-13T18:57:46.234634] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T18:57:46.236623] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-13T18:57:46.340133] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:57:46.348003] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-13T18:57:46.547636] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:57:46.559009] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-13T18:57:46.852829] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:57:46.854626] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-13T18:57:47.145516] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:57:47.573336] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T18:57:47.618001] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-13T18:57:47.967213] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T18:57:48.109945] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:57:48.196812] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:57:48.417950] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-13T18:57:49.218023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-13T18:57:50.017983] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-13T18:57:50.268364] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:57:50.643199] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:57:50.644229] [INFO ] [REMOTE ] FLC: Full fetch complete (7844 records). [2025-10-13T18:57:50.644296] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-13T18:57:50.829817] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-13T18:57:51.001345] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:57:51.041387] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-13T18:57:51.041478] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-13T18:57:51.042012] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-13T18:57:51.042063] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-13T18:57:51.042474] [DEBUG] [LOCAL ] FLC: Trimmed 7844 records to 5442 (keeping 200 days of data) [2025-10-13T18:57:51.075114] [DEBUG] [LOCAL ] FLC: Primary data saved (5442 records). [2025-10-13T18:57:51.075230] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-13T18:57:51.075313] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 12.0s. Estimated remaining: 3h 33m 54s. Rate: 7.1 symbols/min [2025-10-13T18:57:51.250398] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:51.282488] [DEBUG] [LOCAL ] FLNG: Loaded 34064 existing records from primary storage. [2025-10-13T18:57:51.282782] [INFO ] [MAIN ] FLNG: Loaded 34064 existing records. [2025-10-13T18:57:51.460312] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:51.460533] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-13T18:57:51.460582] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-13T18:57:51.461404] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-13T18:57:51.461462] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-13T18:57:51.630741] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-13T18:57:51.813117] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:52.417964] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-13T18:57:52.650381] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T18:57:53.087965] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:57:53.217973] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-13T18:57:53.938792] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:57:54.017930] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-13T18:57:54.817926] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-13T18:57:55.191530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T18:57:55.511695] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:57:55.617970] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-13T18:57:56.417961] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-13T18:57:56.724491] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T18:57:57.037679] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:57:57.218024] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-13T18:57:58.018004] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-13T18:57:58.218677] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:57:58.610637] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:57:58.817952] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-13T18:57:59.259503] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:57:59.617948] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-13T18:58:00.005823] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:58:00.417985] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-13T18:58:01.217974] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-13T18:58:01.536215] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:58:02.018056] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-13T18:58:02.260578] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T18:58:02.454858] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T18:58:02.817963] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-13T18:58:03.361338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:58:03.618003] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-13T18:58:04.417992] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-13T18:58:04.580171] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T18:58:05.217993] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-13T18:58:05.335589] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T18:58:05.410632] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:58:06.021472] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-13T18:58:06.542595] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T18:58:06.817954] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-13T18:58:07.618014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-13T18:58:07.818991] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:58:07.890773] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T18:58:08.417954] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-13T18:58:08.982756] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:58:09.217964] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-13T18:58:10.017894] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-13T18:58:10.128236] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:58:10.681596] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:58:10.817937] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-13T18:58:11.614473] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:58:11.625238] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-13T18:58:11.995067] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T18:58:12.417965] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-13T18:58:13.223086] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-13T18:58:13.237754] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T18:58:13.811807] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:58:13.815181] [INFO ] [REMOTE ] FLNG: Full fetch complete (50224 records). [2025-10-13T18:58:13.815275] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-13T18:58:14.028735] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-13T18:58:14.213558] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-13T18:58:14.213684] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-13T18:58:14.214357] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-13T18:58:14.214528] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-13T18:58:14.215586] [DEBUG] [LOCAL ] FLNG: Trimmed 50224 records to 33739 (keeping 200 days of data) [2025-10-13T18:58:14.345854] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:58:14.444221] [DEBUG] [LOCAL ] FLNG: Primary data saved (33739 records). [2025-10-13T18:58:14.444365] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-13T18:58:14.444464] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLNG took 23.4s. Estimated remaining: 3h 34m 13s. Rate: 7.1 symbols/min [2025-10-13T18:58:14.612115] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:14.662396] [DEBUG] [LOCAL ] FLO: Loaded 52720 existing records from primary storage. [2025-10-13T18:58:14.662726] [INFO ] [MAIN ] FLO: Loaded 52720 existing records. [2025-10-13T18:58:14.821665] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-13T18:58:14.848736] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:14.849102] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-13T18:58:14.849175] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-13T18:58:14.855624] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-13T18:58:14.864964] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-13T18:58:14.879268] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T18:58:14.942016] [INFO ] [REMOTE ] FIS: Full fetch complete (77187 records). [2025-10-13T18:58:14.963289] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-13T18:58:15.536807] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:15.622858] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-13T18:58:15.679603] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-13T18:58:15.679730] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-13T18:58:15.680771] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-13T18:58:15.680840] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-13T18:58:15.682533] [DEBUG] [LOCAL ] FIS: Trimmed 77187 records to 53345 (keeping 200 days of data) [2025-10-13T18:58:16.017394] [DEBUG] [LOCAL ] FIS: Primary data saved (53345 records). [2025-10-13T18:58:16.017548] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-13T18:58:16.017670] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FIS took 36.9s. Estimated remaining: 3h 33m 52s. Rate: 7.1 symbols/min [2025-10-13T18:58:16.189886] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:16.190091] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-13T18:58:16.190134] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-13T18:58:16.190242] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-13T18:58:16.190283] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-13T18:58:16.190325] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-13T18:58:16.190357] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-13T18:58:16.308569] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:58:16.355987] [INFO ] [REMOTE ] FIX: Full fetch complete (45196 records). [2025-10-13T18:58:16.365170] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-13T18:58:16.442363] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-13T18:58:16.859695] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:16.955469] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-13T18:58:16.955552] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-13T18:58:16.956206] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-13T18:58:16.956272] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-13T18:58:16.957437] [DEBUG] [LOCAL ] FIX: Trimmed 45196 records to 29043 (keeping 200 days of data) [2025-10-13T18:58:17.144082] [DEBUG] [LOCAL ] FIX: Primary data saved (29043 records). [2025-10-13T18:58:17.144241] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-13T18:58:17.144354] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FIX took 38.1s. Estimated remaining: 3h 33m 31s. Rate: 7.1 symbols/min [2025-10-13T18:58:17.224065] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-13T18:58:17.331975] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:17.387402] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:58:17.418791] [DEBUG] [LOCAL ] FLR: Loaded 53945 existing records from primary storage. [2025-10-13T18:58:17.419226] [INFO ] [MAIN ] FLR: Loaded 53945 existing records. [2025-10-13T18:58:17.497186] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:58:17.520397] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-13T18:58:17.530728] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:58:17.530868] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-13T18:58:17.536734] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:58:17.547114] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-13T18:58:17.547255] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-13T18:58:17.552496] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-13T18:58:17.571262] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-13T18:58:17.582252] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLOC took 1.6s. Estimated remaining: 3h 33m 8s. Rate: 7.2 symbols/min [2025-10-13T18:58:17.693497] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:17.734092] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-13T18:58:17.739940] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-13T18:58:17.750774] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-13T18:58:17.750861] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-13T18:58:17.897428] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:18.023354] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-13T18:58:18.213068] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:18.214300] [DEBUG] [LOCAL ] FLS: Loaded 51020 existing records from primary storage. [2025-10-13T18:58:18.215023] [INFO ] [MAIN ] FLS: Loaded 51020 existing records. [2025-10-13T18:58:18.379998] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T18:58:18.416795] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:18.417112] [INFO ] [REMOTE ] FLG: Full fetch complete (77280 records). [2025-10-13T18:58:18.417433] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-13T18:58:18.417532] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-13T18:58:18.417636] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-13T18:58:18.451122] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-13T18:58:18.484290] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-13T18:58:18.824268] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-13T18:58:19.169391] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-13T18:58:19.182467] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-13T18:58:19.204435] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-13T18:58:19.204565] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-13T18:58:19.225772] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:19.226931] [DEBUG] [LOCAL ] FLG: Trimmed 77280 records to 53323 (keeping 200 days of data) [2025-10-13T18:58:19.560491] [DEBUG] [LOCAL ] FLG: Primary data saved (53323 records). [2025-10-13T18:58:19.560677] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-13T18:58:19.560792] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLG took 37.6s. Estimated remaining: 3h 32m 48s. Rate: 7.2 symbols/min [2025-10-13T18:58:19.627284] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-13T18:58:19.775869] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:19.804393] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:58:19.856853] [DEBUG] [LOCAL ] FLUT: Loaded 51543 existing records from primary storage. [2025-10-13T18:58:19.857162] [INFO ] [MAIN ] FLUT: Loaded 51543 existing records. [2025-10-13T18:58:20.033629] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:20.033835] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-13T18:58:20.033881] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-13T18:58:20.034939] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-13T18:58:20.034999] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-13T18:58:20.391188] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:20.417885] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-13T18:58:20.665043] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T18:58:21.217939] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-13T18:58:21.303028] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:58:22.017933] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-13T18:58:22.198746] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:58:22.761937] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T18:58:22.817881] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-13T18:58:23.167495] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:58:23.617956] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-13T18:58:24.417928] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-13T18:58:24.572778] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T18:58:25.217944] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-13T18:58:25.283352] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:58:26.017955] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-13T18:58:26.051602] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:58:26.818011] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-13T18:58:26.865910] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:58:27.618039] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-13T18:58:27.689478] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:58:28.417983] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-13T18:58:28.608229] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:58:29.027889] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:58:29.217998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-13T18:58:30.017938] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-13T18:58:30.269876] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:58:30.818018] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-13T18:58:30.873384] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:58:31.617943] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-13T18:58:31.707041] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:58:32.417947] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-13T18:58:32.778807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T18:58:33.041253] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T18:58:33.217975] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-13T18:58:34.018046] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-13T18:58:34.178934] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:58:34.817894] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-13T18:58:34.971548] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:58:35.311615] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:58:35.617991] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-13T18:58:36.417939] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-13T18:58:36.463980] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:58:37.217940] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-13T18:58:37.422630] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:58:38.020999] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-13T18:58:38.280700] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:58:38.563011] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:58:38.818015] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-13T18:58:39.406697] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:58:39.617895] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-13T18:58:40.417938] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-13T18:58:40.700585] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:58:41.096468] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:58:41.217993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-13T18:58:42.017929] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-13T18:58:42.112908] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:58:42.614965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T18:58:42.817957] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-13T18:58:43.617921] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-13T18:58:43.842851] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:58:44.336268] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T18:58:44.417895] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-13T18:58:45.217945] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-13T18:58:45.407231] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:58:46.017956] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-13T18:58:46.396117] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:58:46.554109] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:58:46.560387] [INFO ] [REMOTE ] FLO: Full fetch complete (75081 records). [2025-10-13T18:58:46.560626] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-13T18:58:46.824853] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-13T18:58:46.971485] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-13T18:58:46.971726] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-13T18:58:46.972962] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-13T18:58:46.973029] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-13T18:58:46.974825] [DEBUG] [LOCAL ] FLO: Trimmed 75081 records to 52028 (keeping 200 days of data) [2025-10-13T18:58:47.291516] [DEBUG] [LOCAL ] FLO: Primary data saved (52028 records). [2025-10-13T18:58:47.291677] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-13T18:58:47.291777] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLO took 32.8s. Estimated remaining: 3h 33m 14s. Rate: 7.1 symbols/min [2025-10-13T18:58:47.458763] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:47.479842] [DEBUG] [LOCAL ] FLXR: Loaded 21118 existing records from primary storage. [2025-10-13T18:58:47.480087] [INFO ] [MAIN ] FLXR: Loaded 21118 existing records. [2025-10-13T18:58:47.628104] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-13T18:58:47.661182] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:47.661750] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-13T18:58:47.661802] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-13T18:58:47.662108] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-13T18:58:47.662164] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-13T18:58:48.043330] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:48.076423] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:58:48.418017] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-13T18:58:48.615390] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:58:49.218016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-13T18:58:49.683380] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T18:58:49.889852] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:58:49.895292] [INFO ] [REMOTE ] FLUT: Full fetch complete (73054 records). [2025-10-13T18:58:49.895405] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-13T18:58:50.032612] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-13T18:58:50.280015] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-13T18:58:50.280103] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-13T18:58:50.280980] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-13T18:58:50.281044] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-13T18:58:50.282441] [DEBUG] [LOCAL ] FLUT: Trimmed 73054 records to 50771 (keeping 200 days of data) [2025-10-13T18:58:50.582664] [DEBUG] [LOCAL ] FLUT: Primary data saved (50771 records). [2025-10-13T18:58:50.582817] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-13T18:58:50.582901] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 31.0s. Estimated remaining: 3h 32m 57s. Rate: 7.1 symbols/min [2025-10-13T18:58:50.752493] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:50.801584] [DEBUG] [LOCAL ] FMC: Loaded 52580 existing records from primary storage. [2025-10-13T18:58:50.801974] [INFO ] [MAIN ] FMC: Loaded 52580 existing records. [2025-10-13T18:58:50.825054] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-13T18:58:50.912821] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T18:58:50.993443] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:50.993757] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-13T18:58:50.993813] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-13T18:58:50.994173] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-13T18:58:50.994229] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-13T18:58:51.124369] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T18:58:51.381706] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:51.617927] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-13T18:58:52.417961] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-13T18:58:52.681627] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:58:52.944952] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:58:53.157804] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:58:53.217949] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-13T18:58:54.017950] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-13T18:58:54.052965] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:58:54.817948] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-13T18:58:55.617935] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-13T18:58:55.767163] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T18:58:55.866127] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:58:55.871943] [INFO ] [REMOTE ] FLR: Full fetch complete (76532 records). [2025-10-13T18:58:55.872118] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-13T18:58:56.279135] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-13T18:58:56.279211] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-13T18:58:56.280093] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-13T18:58:56.280161] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-13T18:58:56.281529] [DEBUG] [LOCAL ] FLR: Trimmed 76532 records to 53204 (keeping 200 days of data) [2025-10-13T18:58:56.441554] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-13T18:58:56.587229] [DEBUG] [LOCAL ] FLR: Primary data saved (53204 records). [2025-10-13T18:58:56.587363] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-13T18:58:56.587442] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLR took 39.4s. Estimated remaining: 3h 32m 44s. Rate: 7.1 symbols/min [2025-10-13T18:58:56.753852] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:56.760271] [DEBUG] [LOCAL ] FMN: Loaded 5439 existing records from primary storage. [2025-10-13T18:58:56.760431] [INFO ] [MAIN ] FMN: Loaded 5439 existing records. [2025-10-13T18:58:56.938379] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:56.938607] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-13T18:58:56.938685] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-13T18:58:56.938988] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-13T18:58:56.939046] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-13T18:58:57.219915] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-13T18:58:57.310353] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:57.391449] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T18:58:57.899112] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:58:57.905150] [INFO ] [REMOTE ] FLS: Full fetch complete (72006 records). [2025-10-13T18:58:57.905268] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-13T18:58:58.020956] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-13T18:58:58.195612] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T18:58:58.325709] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-13T18:58:58.325820] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-13T18:58:58.326795] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-13T18:58:58.326860] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-13T18:58:58.328548] [DEBUG] [LOCAL ] FLS: Trimmed 72006 records to 50339 (keeping 200 days of data) [2025-10-13T18:58:58.643696] [DEBUG] [LOCAL ] FLS: Primary data saved (50339 records). [2025-10-13T18:58:58.643835] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-13T18:58:58.643941] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FLS took 41.1s. Estimated remaining: 3h 32m 24s. Rate: 7.2 symbols/min [2025-10-13T18:58:58.813240] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:58.817998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-13T18:58:58.844364] [DEBUG] [LOCAL ] FMS: Loaded 30508 existing records from primary storage. [2025-10-13T18:58:58.844665] [INFO ] [MAIN ] FMS: Loaded 30508 existing records. [2025-10-13T18:58:59.015961] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:59.016203] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-13T18:58:59.016250] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-13T18:58:59.016691] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-13T18:58:59.016748] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-13T18:58:59.364956] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:59.623083] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-13T18:58:59.644507] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:58:59.827272] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:59:00.417959] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-13T18:59:01.217960] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-13T18:59:01.260366] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:59:01.945548] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:59:02.017941] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-13T18:59:02.214338] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:59:02.818051] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-13T18:59:03.617925] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-13T18:59:03.832277] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:59:04.002328] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:59:04.284004] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:59:04.417939] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-13T18:59:05.217945] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-13T18:59:05.592336] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:59:05.745906] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T18:59:06.017992] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-13T18:59:06.817897] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-13T18:59:07.099589] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T18:59:07.617984] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-13T18:59:07.970635] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T18:59:08.157325] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T18:59:08.417939] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-13T18:59:09.217963] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-13T18:59:09.988415] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T18:59:10.017888] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-13T18:59:10.073856] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:59:10.758334] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T18:59:10.817895] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-13T18:59:11.617918] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-13T18:59:12.218190] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T18:59:12.417982] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-13T18:59:12.537571] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:59:13.217992] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-13T18:59:13.947008] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:59:13.947751] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T18:59:14.017891] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-13T18:59:14.643843] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:59:14.817936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-13T18:59:15.617944] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-13T18:59:16.024007] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T18:59:16.238548] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T18:59:16.417956] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-13T18:59:16.937195] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:59:17.217982] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-13T18:59:17.958158] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:59:17.959741] [INFO ] [REMOTE ] FMN: Full fetch complete (10054 records). [2025-10-13T18:59:17.959834] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-13T18:59:18.025017] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-13T18:59:18.340882] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-13T18:59:18.340969] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-13T18:59:18.341231] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-13T18:59:18.341271] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-13T18:59:18.341706] [DEBUG] [LOCAL ] FMN: Trimmed 10054 records to 5362 (keeping 200 days of data) [2025-10-13T18:59:18.373613] [DEBUG] [LOCAL ] FMN: Primary data saved (5362 records). [2025-10-13T18:59:18.373731] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-13T18:59:18.373817] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMN took 21.8s. Estimated remaining: 3h 32m 36s. Rate: 7.1 symbols/min [2025-10-13T18:59:18.548192] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:18.592525] [DEBUG] [LOCAL ] FMX: Loaded 41027 existing records from primary storage. [2025-10-13T18:59:18.592957] [INFO ] [MAIN ] FMX: Loaded 41027 existing records. [2025-10-13T18:59:18.775659] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:18.775966] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-13T18:59:18.776020] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-13T18:59:18.777064] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-13T18:59:18.777126] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-13T18:59:18.825081] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-13T18:59:19.156503] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:19.617983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-13T18:59:19.992997] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T18:59:20.030094] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:59:20.418021] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-13T18:59:21.009386] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:59:21.217990] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-13T18:59:22.018017] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-13T18:59:22.109557] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:59:22.654398] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:59:22.817986] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-13T18:59:23.427475] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:59:23.617965] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-13T18:59:24.131745] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:59:24.417998] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-13T18:59:25.217987] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-13T18:59:25.405803] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:59:25.636102] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:59:26.018002] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-13T18:59:26.445943] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:59:26.817976] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-13T18:59:27.377612] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:59:27.617955] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-13T18:59:27.947266] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T18:59:28.418015] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-13T18:59:28.706010] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:59:29.218006] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-13T18:59:29.573967] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:59:29.577230] [INFO ] [REMOTE ] FLXR: Full fetch complete (26512 records). [2025-10-13T18:59:29.577317] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-13T18:59:29.969974] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-13T18:59:29.970078] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-13T18:59:29.970661] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-13T18:59:29.970725] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-13T18:59:29.971405] [DEBUG] [LOCAL ] FLXR: Trimmed 26512 records to 20860 (keeping 200 days of data) [2025-10-13T18:59:30.026096] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-13T18:59:30.107627] [DEBUG] [LOCAL ] FLXR: Primary data saved (20860 records). [2025-10-13T18:59:30.107797] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-13T18:59:30.107957] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FLXR took 42.8s. Estimated remaining: 3h 32m 34s. Rate: 7.1 symbols/min [2025-10-13T18:59:30.288185] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:30.292543] [DEBUG] [LOCAL ] FMY: Loaded 1408 existing records from primary storage. [2025-10-13T18:59:30.292782] [INFO ] [MAIN ] FMY: Loaded 1408 existing records. [2025-10-13T18:59:30.475979] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:30.476345] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-13T18:59:30.476397] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-13T18:59:30.476553] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-13T18:59:30.476623] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-13T18:59:30.626823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:59:30.679474] [INFO ] [REMOTE ] FMS: Full fetch complete (42365 records). [2025-10-13T18:59:30.745209] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-13T18:59:30.823860] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-13T18:59:30.981799] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:31.272679] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-13T18:59:31.272789] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-13T18:59:31.273672] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-13T18:59:31.273736] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-13T18:59:31.274989] [DEBUG] [LOCAL ] FMS: Trimmed 42365 records to 30169 (keeping 200 days of data) [2025-10-13T18:59:31.472329] [DEBUG] [LOCAL ] FMS: Primary data saved (30169 records). [2025-10-13T18:59:31.472506] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-13T18:59:31.473416] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMS took 32.8s. Estimated remaining: 3h 32m 13s. Rate: 7.1 symbols/min [2025-10-13T18:59:31.618072] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-13T18:59:31.651270] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:31.673508] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:59:31.681195] [INFO ] [REMOTE ] FMC: Full fetch complete (75156 records). [2025-10-13T18:59:31.681482] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-13T18:59:31.895423] [DEBUG] [LOCAL ] FN: Loaded 38595 existing records from primary storage. [2025-10-13T18:59:31.948523] [INFO ] [MAIN ] FN: Loaded 38595 existing records. [2025-10-13T18:59:32.046712] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-13T18:59:32.338113] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-13T18:59:32.362626] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:32.363398] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-13T18:59:32.365030] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-13T18:59:32.365297] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-13T18:59:32.365176] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-13T18:59:32.365567] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-13T18:59:32.367746] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-13T18:59:32.367830] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-13T18:59:32.401357] [DEBUG] [LOCAL ] FMC: Trimmed 75156 records to 51819 (keeping 200 days of data) [2025-10-13T18:59:32.426998] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-13T18:59:33.006004] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T18:59:33.003538] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:33.037073] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:59:33.169796] [DEBUG] [LOCAL ] FMC: Primary data saved (51819 records). [2025-10-13T18:59:33.170037] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-13T18:59:33.170172] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMC took 42.6s. Estimated remaining: 3h 31m 53s. Rate: 7.2 symbols/min [2025-10-13T18:59:33.225142] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-13T18:59:33.349744] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:33.404493] [DEBUG] [LOCAL ] FNB: Loaded 53309 existing records from primary storage. [2025-10-13T18:59:33.404953] [INFO ] [MAIN ] FNB: Loaded 53309 existing records. [2025-10-13T18:59:33.585748] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:33.586053] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-13T18:59:33.586119] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-13T18:59:33.587618] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-13T18:59:33.587730] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-13T18:59:33.978220] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:34.017886] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-13T18:59:34.804888] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:59:34.817933] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-13T18:59:35.623212] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-13T18:59:35.635496] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:59:36.240828] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:59:36.418003] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-13T18:59:36.867612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:59:37.015404] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T18:59:37.217955] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-13T18:59:38.017946] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-13T18:59:38.754565] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T18:59:38.817929] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-13T18:59:39.520866] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:59:39.617978] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-13T18:59:39.991163] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:59:40.396238] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:59:40.417896] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-13T18:59:41.218010] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-13T18:59:41.711957] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T18:59:42.017928] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-13T18:59:42.156436] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:59:42.360745] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T18:59:42.817973] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-13T18:59:43.617972] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-13T18:59:44.392715] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:59:44.417890] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-13T18:59:45.217897] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-13T18:59:45.400097] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:59:45.502704] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-13T18:59:46.017934] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-13T18:59:46.072775] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T18:59:46.817972] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-13T18:59:47.602506] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:59:47.617876] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-13T18:59:48.170465] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T18:59:48.417952] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-13T18:59:48.840109] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T18:59:49.089476] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T18:59:49.217946] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-13T18:59:49.671242] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T18:59:50.017925] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-13T18:59:50.453811] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:59:50.817974] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-13T18:59:51.617973] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-13T18:59:52.417979] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-13T18:59:52.505288] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:59:52.811808] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T18:59:52.812490] [INFO ] [REMOTE ] FMY: Full fetch complete (1969 records). [2025-10-13T18:59:52.812557] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-13T18:59:53.170238] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-13T18:59:53.170409] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-13T18:59:53.170516] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-13T18:59:53.170554] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-13T18:59:53.170903] [DEBUG] [LOCAL ] FMY: Trimmed 1969 records to 1389 (keeping 200 days of data) [2025-10-13T18:59:53.179714] [DEBUG] [LOCAL ] FMY: Primary data saved (1389 records). [2025-10-13T18:59:53.179775] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-13T18:59:53.179880] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FMY took 23.1s. Estimated remaining: 3h 32m 5s. Rate: 7.1 symbols/min [2025-10-13T18:59:53.221801] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-13T18:59:53.352701] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:53.384878] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T18:59:53.445897] [DEBUG] [LOCAL ] FND: Loaded 52882 existing records from primary storage. [2025-10-13T18:59:53.446256] [INFO ] [MAIN ] FND: Loaded 52882 existing records. [2025-10-13T18:59:53.621910] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:53.622130] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-13T18:59:53.622205] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-13T18:59:53.623247] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-13T18:59:53.623304] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-13T18:59:53.962191] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:54.017885] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-13T18:59:54.675325] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T18:59:54.679023] [INFO ] [REMOTE ] FMX: Full fetch complete (57468 records). [2025-10-13T18:59:54.679114] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-13T18:59:54.826054] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-13T18:59:55.058282] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-13T18:59:55.058364] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-13T18:59:55.059141] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-13T18:59:55.059202] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-13T18:59:55.060922] [DEBUG] [LOCAL ] FMX: Trimmed 57468 records to 40458 (keeping 200 days of data) [2025-10-13T18:59:55.309485] [DEBUG] [LOCAL ] FMX: Primary data saved (40458 records). [2025-10-13T18:59:55.309634] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-13T18:59:55.309758] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FMX took 36.9s. Estimated remaining: 3h 31m 45s. Rate: 7.1 symbols/min [2025-10-13T18:59:55.494821] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:55.547965] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:59:55.573507] [DEBUG] [LOCAL ] FNF: Loaded 49668 existing records from primary storage. [2025-10-13T18:59:55.573811] [INFO ] [MAIN ] FNF: Loaded 49668 existing records. [2025-10-13T18:59:55.627860] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-13T18:59:55.754389] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:55.754610] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-13T18:59:55.754683] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-13T18:59:55.755125] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-13T18:59:55.755181] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-13T18:59:56.108428] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:56.417959] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-13T18:59:56.473359] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:59:57.086055] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:59:57.217990] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-13T18:59:57.931319] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:59:58.018002] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-13T18:59:58.746370] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T18:59:58.817922] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-13T18:59:59.592395] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T18:59:59.617886] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-13T19:00:00.174305] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:00:00.417959] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-13T19:00:01.218019] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-13T19:00:01.591990] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:00:02.022999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-13T19:00:02.039998] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:00:02.653436] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:00:02.817948] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-13T19:00:03.617897] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-13T19:00:03.918777] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:00:04.418002] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-13T19:00:05.042509] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T19:00:05.217969] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-13T19:00:05.303884] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:00:06.017939] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-13T19:00:06.310514] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T19:00:06.817936] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-13T19:00:07.013713] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T19:00:07.617929] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-13T19:00:07.777606] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:00:07.906903] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:00:08.417947] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-13T19:00:09.217936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-13T19:00:09.266061] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:00:10.017943] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-13T19:00:10.061436] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T19:00:10.817974] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-13T19:00:11.004191] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:00:11.617952] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-13T19:00:11.756753] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:00:11.951753] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T19:00:12.417962] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-13T19:00:13.217999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-13T19:00:13.333311] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T19:00:13.850061] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:00:13.855773] [INFO ] [REMOTE ] FNB: Full fetch complete (75905 records). [2025-10-13T19:00:13.855947] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-13T19:00:14.032978] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-13T19:00:14.277934] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-13T19:00:14.278047] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-13T19:00:14.279091] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-13T19:00:14.279155] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-13T19:00:14.280682] [DEBUG] [LOCAL ] FNB: Trimmed 75905 records to 52572 (keeping 200 days of data) [2025-10-13T19:00:14.634473] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:00:14.667664] [DEBUG] [LOCAL ] FNB: Primary data saved (52572 records). [2025-10-13T19:00:14.667845] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-13T19:00:14.667952] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNB took 41.5s. Estimated remaining: 3h 31m 56s. Rate: 7.1 symbols/min [2025-10-13T19:00:14.834181] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-13T19:00:14.836900] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:14.880235] [DEBUG] [LOCAL ] FNV: Loaded 46876 existing records from primary storage. [2025-10-13T19:00:14.880566] [INFO ] [MAIN ] FNV: Loaded 46876 existing records. [2025-10-13T19:00:15.052199] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:15.052421] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-13T19:00:15.052467] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-13T19:00:15.053461] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-13T19:00:15.053519] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-13T19:00:15.400718] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:15.537596] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:00:15.541110] [INFO ] [REMOTE ] FN: Full fetch complete (55998 records). [2025-10-13T19:00:15.541206] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-13T19:00:15.623199] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-13T19:00:15.921948] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-13T19:00:15.922042] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-13T19:00:15.922882] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-13T19:00:15.922952] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-13T19:00:15.924186] [DEBUG] [LOCAL ] FN: Trimmed 55998 records to 37947 (keeping 200 days of data) [2025-10-13T19:00:16.148355] [DEBUG] [LOCAL ] FN: Primary data saved (37947 records). [2025-10-13T19:00:16.148503] [INFO ] [MAIN ] FN: Full history saved. [2025-10-13T19:00:16.149065] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FN took 44.7s. Estimated remaining: 3h 31m 36s. Rate: 7.1 symbols/min [2025-10-13T19:00:16.317680] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:16.333599] [DEBUG] [LOCAL ] FOA: Loaded 13275 existing records from primary storage. [2025-10-13T19:00:16.333863] [INFO ] [MAIN ] FOA: Loaded 13275 existing records. [2025-10-13T19:00:16.423173] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-13T19:00:16.513059] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:16.513429] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-13T19:00:16.513496] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-13T19:00:16.513720] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-13T19:00:16.513786] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-13T19:00:16.667587] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:00:16.925566] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:16.960936] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:00:17.217978] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-13T19:00:18.024458] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-13T19:00:18.029576] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:00:18.817934] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-13T19:00:18.905112] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T19:00:18.910530] [INFO ] [REMOTE ] FND: Full fetch complete (74771 records). [2025-10-13T19:00:18.910696] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-13T19:00:19.230408] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:00:19.327996] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-13T19:00:19.328105] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-13T19:00:19.329105] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-13T19:00:19.329193] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-13T19:00:19.330872] [DEBUG] [LOCAL ] FND: Trimmed 74771 records to 52147 (keeping 200 days of data) [2025-10-13T19:00:19.617947] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-13T19:00:19.640874] [DEBUG] [LOCAL ] FND: Primary data saved (52147 records). [2025-10-13T19:00:19.641007] [INFO ] [MAIN ] FND: Full history saved. [2025-10-13T19:00:19.641088] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FND took 26.5s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-10-13T19:00:19.811550] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:19.821317] [DEBUG] [LOCAL ] FOF: Loaded 8672 existing records from primary storage. [2025-10-13T19:00:19.821574] [INFO ] [MAIN ] FOF: Loaded 8672 existing records. [2025-10-13T19:00:19.993878] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:19.994139] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-13T19:00:19.994200] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-13T19:00:19.994372] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-13T19:00:19.994456] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-13T19:00:20.374751] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:20.417954] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-13T19:00:20.574476] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:00:20.685993] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:00:21.134836] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:00:21.217942] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-13T19:00:22.017942] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-13T19:00:22.119366] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:00:22.728019] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:00:22.817992] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-13T19:00:23.617965] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-13T19:00:24.417925] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-13T19:00:24.454157] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T19:00:24.835417] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:00:25.051669] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:00:25.217948] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-13T19:00:26.017956] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-13T19:00:26.745196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:00:26.817896] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-13T19:00:27.617948] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-13T19:00:27.702233] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T19:00:28.247892] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:00:28.417930] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-13T19:00:28.574789] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:00:29.065632] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:00:29.217936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-13T19:00:30.017940] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-13T19:00:30.801381] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:00:30.806598] [INFO ] [REMOTE ] FNF: Full fetch complete (69691 records). [2025-10-13T19:00:30.806827] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-13T19:00:30.823123] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-13T19:00:31.197809] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-13T19:00:31.197896] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-13T19:00:31.198807] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-13T19:00:31.198870] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-13T19:00:31.200247] [DEBUG] [LOCAL ] FNF: Trimmed 69691 records to 48986 (keeping 200 days of data) [2025-10-13T19:00:31.496114] [DEBUG] [LOCAL ] FNF: Primary data saved (48986 records). [2025-10-13T19:00:31.496276] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-13T19:00:31.496356] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FNF took 36.2s. Estimated remaining: 3h 31m 16s. Rate: 7.1 symbols/min [2025-10-13T19:00:31.622513] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-13T19:00:31.668907] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:31.698020] [DEBUG] [LOCAL ] FOR: Loaded 19970 existing records from primary storage. [2025-10-13T19:00:31.699057] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T19:00:31.699598] [INFO ] [MAIN ] FOR: Loaded 19970 existing records. [2025-10-13T19:00:31.883744] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:31.884170] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-13T19:00:31.884364] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-13T19:00:31.884623] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-13T19:00:31.884723] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-13T19:00:32.282195] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:32.286489] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T19:00:32.314357] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:00:32.417966] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-13T19:00:32.975874] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T19:00:33.217935] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-13T19:00:34.017973] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-13T19:00:34.277622] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T19:00:34.808117] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:00:34.817873] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-13T19:00:35.580029] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T19:00:35.617993] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-13T19:00:36.417971] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-13T19:00:37.217944] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-13T19:00:37.505638] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T19:00:37.541935] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T19:00:38.012522] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:00:38.017876] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-13T19:00:38.817894] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-13T19:00:39.022136] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:00:39.617956] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-13T19:00:40.240341] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:00:40.417960] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-13T19:00:40.519134] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T19:00:41.217965] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-13T19:00:42.017951] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-13T19:00:42.064892] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:00:42.353392] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T19:00:42.820768] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:00:42.818771] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-13T19:00:43.617931] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-13T19:00:43.856818] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T19:00:44.417951] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-13T19:00:45.192491] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:00:45.219713] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-13T19:00:45.222895] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:00:46.017936] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-13T19:00:46.192679] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T19:00:46.732441] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T19:00:46.817928] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-13T19:00:47.617992] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-13T19:00:47.885633] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:00:48.417895] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-13T19:00:48.732369] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T19:00:49.225047] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-13T19:00:49.227976] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:00:50.018004] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-13T19:00:50.817990] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-13T19:00:50.875094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:00:51.007255] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:00:51.570899] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T19:00:51.617939] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-13T19:00:52.417936] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-13T19:00:52.633172] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T19:00:52.635327] [INFO ] [REMOTE ] FOR: Full fetch complete (29765 records). [2025-10-13T19:00:52.635397] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-13T19:00:52.992590] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-13T19:00:52.992693] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-13T19:00:52.993191] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-13T19:00:52.993282] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-13T19:00:52.994009] [DEBUG] [LOCAL ] FOR: Trimmed 29765 records to 19785 (keeping 200 days of data) [2025-10-13T19:00:53.104054] [DEBUG] [LOCAL ] FOR: Primary data saved (19785 records). [2025-10-13T19:00:53.104191] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-13T19:00:53.104265] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 21.6s. Estimated remaining: 3h 31m 31s. Rate: 7.1 symbols/min [2025-10-13T19:00:53.223108] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-13T19:00:53.277476] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:53.322445] [DEBUG] [LOCAL ] FOUR: Loaded 50337 existing records from primary storage. [2025-10-13T19:00:53.322820] [INFO ] [MAIN ] FOUR: Loaded 50337 existing records. [2025-10-13T19:00:53.494385] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:53.494616] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-13T19:00:53.494707] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-13T19:00:53.495210] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-13T19:00:53.495269] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-13T19:00:53.843871] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:54.017897] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-13T19:00:54.056167] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T19:00:54.073747] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:00:54.078971] [INFO ] [REMOTE ] FNV: Full fetch complete (66506 records). [2025-10-13T19:00:54.079125] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-13T19:00:54.476256] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-13T19:00:54.476345] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-13T19:00:54.477211] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-13T19:00:54.477275] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-13T19:00:54.478639] [DEBUG] [LOCAL ] FNV: Trimmed 66506 records to 46111 (keeping 200 days of data) [2025-10-13T19:00:54.765906] [DEBUG] [LOCAL ] FNV: Primary data saved (46111 records). [2025-10-13T19:00:54.766047] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-13T19:00:54.766137] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FNV took 40.1s. Estimated remaining: 3h 31m 11s. Rate: 7.1 symbols/min [2025-10-13T19:00:54.828243] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-13T19:00:54.935509] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:54.958456] [DEBUG] [LOCAL ] FPF: Loaded 18898 existing records from primary storage. [2025-10-13T19:00:54.958740] [INFO ] [MAIN ] FPF: Loaded 18898 existing records. [2025-10-13T19:00:55.134108] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:55.134311] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-13T19:00:55.134356] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-13T19:00:55.134622] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-13T19:00:55.134705] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-13T19:00:55.481430] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:55.617962] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-13T19:00:55.650865] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:00:55.652381] [INFO ] [REMOTE ] FOF: Full fetch complete (11889 records). [2025-10-13T19:00:55.652452] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-13T19:00:56.035543] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-13T19:00:56.035704] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-13T19:00:56.036005] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-13T19:00:56.036146] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-13T19:00:56.046300] [DEBUG] [LOCAL ] FOF: Trimmed 11889 records to 8585 (keeping 200 days of data) [2025-10-13T19:00:56.104806] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:00:56.130216] [DEBUG] [LOCAL ] FOF: Primary data saved (8585 records). [2025-10-13T19:00:56.130367] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-13T19:00:56.130453] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FOF took 36.5s. Estimated remaining: 3h 30m 50s. Rate: 7.1 symbols/min [2025-10-13T19:00:56.305911] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:56.324862] [DEBUG] [LOCAL ] FPH: Loaded 19617 existing records from primary storage. [2025-10-13T19:00:56.325154] [INFO ] [MAIN ] FPH: Loaded 19617 existing records. [2025-10-13T19:00:56.420508] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-13T19:00:56.516067] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:56.516252] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-13T19:00:56.516299] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-13T19:00:56.516560] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-13T19:00:56.516599] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-13T19:00:56.658535] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:00:56.693820] [INFO ] [REMOTE ] FOA: Full fetch complete (21924 records). [2025-10-13T19:00:56.711041] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-13T19:00:57.077070] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:57.232136] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-13T19:00:57.284908] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-13T19:00:57.285005] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-13T19:00:57.285711] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-13T19:00:57.285776] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-13T19:00:57.286440] [DEBUG] [LOCAL ] FOA: Trimmed 21924 records to 13120 (keeping 200 days of data) [2025-10-13T19:00:57.366358] [DEBUG] [LOCAL ] FOA: Primary data saved (13120 records). [2025-10-13T19:00:57.366525] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-13T19:00:57.366618] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOA took 41.2s. Estimated remaining: 3h 30m 29s. Rate: 7.2 symbols/min [2025-10-13T19:00:57.544571] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:57.559313] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:00:57.595723] [DEBUG] [LOCAL ] FPI: Loaded 31503 existing records from primary storage. [2025-10-13T19:00:57.596043] [INFO ] [MAIN ] FPI: Loaded 31503 existing records. [2025-10-13T19:00:57.771331] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:57.771596] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-13T19:00:57.771667] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-13T19:00:57.772075] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-13T19:00:57.772132] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-13T19:00:58.023091] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-13T19:00:58.122905] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:58.297268] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:00:58.817953] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-13T19:00:59.617899] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-13T19:00:59.667139] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:00:59.778750] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:01:00.417954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-13T19:01:00.972505] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:01:01.217934] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-13T19:01:02.018015] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-13T19:01:02.216394] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:01:02.629002] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:01:02.817978] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-13T19:01:02.997076] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:01:03.617989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-13T19:01:03.783489] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T19:01:04.417994] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-13T19:01:04.554975] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:01:05.217934] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-13T19:01:06.017892] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-13T19:01:06.130186] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:01:06.155103] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T19:01:06.817942] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-13T19:01:07.067717] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:01:07.617938] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-13T19:01:08.194132] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:01:08.417930] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-13T19:01:08.758907] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T19:01:09.217896] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-13T19:01:09.434034] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T19:01:10.017951] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-13T19:01:10.817927] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-13T19:01:10.910375] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:01:11.018764] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:01:11.617966] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-13T19:01:11.981776] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T19:01:12.417989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-13T19:01:12.748635] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T19:01:13.217954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-13T19:01:13.928686] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:01:14.017995] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-13T19:01:14.574701] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:01:14.818058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-13T19:01:14.999682] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:01:15.617992] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-13T19:01:15.995750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:01:16.418010] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-13T19:01:17.218030] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-13T19:01:17.371937] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:01:17.820994] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:01:18.017895] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-13T19:01:18.173734] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:01:18.817925] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-13T19:01:19.456724] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:01:19.617945] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-13T19:01:19.768750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T19:01:20.417941] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-13T19:01:21.218002] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-13T19:01:21.333474] [DEBUG] [REMOTE ] FPI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-13T19:01:21.333907] [WARN ] [REMOTE ] FPI: No data returned for month 2025-09 [2025-10-13T19:01:21.334044] [FATAL] [REMOTE ] FPI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:01:21.334147] [FATAL] [MAIN ] FPI: Failed to fetch primary data. [2025-10-13T19:01:21.334188] [WARN ] [MAIN ] FPI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:01:21.334227] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-13T19:01:21.334285] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-10-13T19:01:21.334321] [INFO ] [LOCAL ] FPI: Starting deletion of derivative data. [2025-10-13T19:01:21.334663] [DEBUG] [LOCAL ] FPI: Deleted derivative data file. [2025-10-13T19:01:21.335689] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPI took 24.0s. Estimated remaining: 3h 30m 48s. Rate: 7.1 symbols/min [2025-10-13T19:01:21.582564] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:21.598115] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:01:21.638625] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T19:01:21.692868] [DEBUG] [LOCAL ] FR: Loaded 47016 existing records from primary storage. [2025-10-13T19:01:21.693225] [INFO ] [MAIN ] FR: Loaded 47016 existing records. [2025-10-13T19:01:21.900501] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:21.900785] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-13T19:01:21.900845] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-13T19:01:21.901482] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-13T19:01:21.901540] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-13T19:01:22.019477] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-13T19:01:22.277267] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:22.817896] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-13T19:01:23.212478] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:01:23.617988] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-13T19:01:23.684744] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T19:01:24.417951] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-13T19:01:25.149113] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T19:01:25.217897] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-13T19:01:25.418737] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:01:26.017954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-13T19:01:26.817889] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-13T19:01:27.082015] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T19:01:27.617976] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-13T19:01:27.806484] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:01:27.855157] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:01:28.417976] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-13T19:01:28.689722] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:01:29.217944] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-13T19:01:30.017945] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-13T19:01:30.285225] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:01:30.290633] [INFO ] [REMOTE ] FOUR: Full fetch complete (72034 records). [2025-10-13T19:01:30.290804] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-13T19:01:30.681029] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-13T19:01:30.681259] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-13T19:01:30.682155] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-13T19:01:30.682232] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-13T19:01:30.686064] [DEBUG] [LOCAL ] FOUR: Trimmed 72034 records to 49672 (keeping 200 days of data) [2025-10-13T19:01:30.820344] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-13T19:01:30.823979] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:01:31.014088] [DEBUG] [LOCAL ] FOUR: Primary data saved (49672 records). [2025-10-13T19:01:31.014242] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-13T19:01:31.014374] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FOUR took 37.9s. Estimated remaining: 3h 30m 42s. Rate: 7.1 symbols/min [2025-10-13T19:01:31.121955] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T19:01:31.151569] [INFO ] [REMOTE ] FPH: Full fetch complete (31173 records). [2025-10-13T19:01:31.188356] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-13T19:01:31.197571] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:31.377925] [DEBUG] [LOCAL ] FRA: Loaded 14769 existing records from primary storage. [2025-10-13T19:01:31.398088] [INFO ] [MAIN ] FRA: Loaded 14769 existing records. [2025-10-13T19:01:31.628272] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-13T19:01:31.789215] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-13T19:01:31.789565] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-13T19:01:31.790159] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-13T19:01:31.790459] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-13T19:01:31.788794] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:31.790736] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-13T19:01:31.791003] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-13T19:01:31.791511] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-13T19:01:31.791479] [DEBUG] [LOCAL ] FPH: Trimmed 31173 records to 19370 (keeping 200 days of data) [2025-10-13T19:01:31.791666] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-13T19:01:32.064251] [DEBUG] [LOCAL ] FPH: Primary data saved (19370 records). [2025-10-13T19:01:32.090476] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-13T19:01:32.107786] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FPH took 36.0s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-13T19:01:32.100692] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:01:32.419879] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-13T19:01:32.436771] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:32.449096] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:32.467446] [DEBUG] [LOCAL ] FRGE: Loaded 17061 existing records from primary storage. [2025-10-13T19:01:32.467716] [INFO ] [MAIN ] FRGE: Loaded 17061 existing records. [2025-10-13T19:01:32.639505] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:32.639776] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-13T19:01:32.639825] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-13T19:01:32.640092] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-13T19:01:32.640147] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-13T19:01:32.991636] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:33.217932] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-13T19:01:33.444600] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:01:33.486779] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:01:33.489409] [INFO ] [REMOTE ] FPF: Full fetch complete (26624 records). [2025-10-13T19:01:33.489480] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-13T19:01:33.850588] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-13T19:01:33.850752] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-13T19:01:33.851275] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-13T19:01:33.851473] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-13T19:01:33.867414] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T19:01:33.872776] [DEBUG] [LOCAL ] FPF: Trimmed 26624 records to 18766 (keeping 200 days of data) [2025-10-13T19:01:33.982920] [DEBUG] [LOCAL ] FPF: Primary data saved (18766 records). [2025-10-13T19:01:33.983069] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-13T19:01:33.983185] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FPF took 39.2s. Estimated remaining: 3h 30m 1s. Rate: 7.2 symbols/min [2025-10-13T19:01:34.023106] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-13T19:01:34.150387] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:34.204749] [DEBUG] [LOCAL ] FRO: Loaded 52446 existing records from primary storage. [2025-10-13T19:01:34.205118] [INFO ] [MAIN ] FRO: Loaded 52446 existing records. [2025-10-13T19:01:34.379639] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:34.379910] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-13T19:01:34.379956] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-13T19:01:34.380686] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-13T19:01:34.380743] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-13T19:01:34.723112] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:34.817883] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-13T19:01:35.602420] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T19:01:35.617884] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-13T19:01:36.414213] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:01:36.424225] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-13T19:01:37.103828] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:01:37.217886] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-13T19:01:37.725485] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:01:38.017996] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-13T19:01:38.547101] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:01:38.817983] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-13T19:01:39.617938] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-13T19:01:40.107133] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T19:01:40.204975] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:01:40.417973] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-13T19:01:40.627863] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:01:41.217984] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-13T19:01:41.281434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:01:42.017969] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-13T19:01:42.189287] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:01:42.740502] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:01:42.817967] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-13T19:01:43.411496] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:01:43.617978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-13T19:01:44.417953] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-13T19:01:44.579910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:01:45.217987] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-13T19:01:45.589674] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:01:46.017942] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-13T19:01:46.788028] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:01:46.817901] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-13T19:01:47.009566] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:01:47.617962] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-13T19:01:48.417985] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-13T19:01:48.547531] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T19:01:48.582389] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:01:49.217931] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-13T19:01:49.302450] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:01:50.017980] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-13T19:01:50.142934] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:01:50.817954] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-13T19:01:51.587977] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:01:51.623086] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-13T19:01:51.647972] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:01:52.417992] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-13T19:01:52.523284] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:01:53.217999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-13T19:01:54.017987] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-13T19:01:54.330293] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:01:54.332686] [INFO ] [REMOTE ] FRA: Full fetch complete (23783 records). [2025-10-13T19:01:54.332834] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-13T19:01:54.461429] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T19:01:54.744439] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-13T19:01:54.744523] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-13T19:01:54.745022] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-13T19:01:54.745084] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-13T19:01:54.745675] [DEBUG] [LOCAL ] FRA: Trimmed 23783 records to 14428 (keeping 200 days of data) [2025-10-13T19:01:54.819976] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-13T19:01:54.835586] [DEBUG] [LOCAL ] FRA: Primary data saved (14428 records). [2025-10-13T19:01:54.835776] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-13T19:01:54.835877] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRA took 23.8s. Estimated remaining: 3h 30m 14s. Rate: 7.1 symbols/min [2025-10-13T19:01:55.005792] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:55.044796] [DEBUG] [LOCAL ] FRT: Loaded 42422 existing records from primary storage. [2025-10-13T19:01:55.045081] [INFO ] [MAIN ] FRT: Loaded 42422 existing records. [2025-10-13T19:01:55.224176] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:55.224437] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-13T19:01:55.224494] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-13T19:01:55.225007] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-13T19:01:55.225064] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-13T19:01:55.589074] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:55.617888] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-13T19:01:55.669942] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T19:01:56.133722] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:01:56.139080] [INFO ] [REMOTE ] FR: Full fetch complete (66703 records). [2025-10-13T19:01:56.139209] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-13T19:01:56.422533] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-13T19:01:56.516279] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-13T19:01:56.516369] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-13T19:01:56.517193] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-13T19:01:56.517257] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-13T19:01:56.518578] [DEBUG] [LOCAL ] FR: Trimmed 66703 records to 46458 (keeping 200 days of data) [2025-10-13T19:01:56.812080] [DEBUG] [LOCAL ] FR: Primary data saved (46458 records). [2025-10-13T19:01:56.812222] [INFO ] [MAIN ] FR: Full history saved. [2025-10-13T19:01:56.812998] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FR took 35.5s. Estimated remaining: 3h 29m 55s. Rate: 7.1 symbols/min [2025-10-13T19:01:56.982332] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:57.021717] [DEBUG] [LOCAL ] FSCO: Loaded 38653 existing records from primary storage. [2025-10-13T19:01:57.022188] [INFO ] [MAIN ] FSCO: Loaded 38653 existing records. [2025-10-13T19:01:57.203463] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:57.203906] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-13T19:01:57.203983] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-13T19:01:57.204416] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-13T19:01:57.204476] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-13T19:01:57.234930] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-13T19:01:57.509545] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:01:57.594101] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:58.017954] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-13T19:01:58.247586] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T19:01:58.343368] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:01:58.817970] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-13T19:01:59.464950] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:01:59.617956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-13T19:02:00.057730] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T19:02:00.418001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-13T19:02:01.223012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-13T19:02:01.238116] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:02:02.017927] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-13T19:02:02.082198] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:02:02.817890] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-13T19:02:03.071322] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:02:03.287974] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:02:03.617963] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-13T19:02:04.417889] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-13T19:02:04.467056] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:02:04.825120] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T19:02:05.217933] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-13T19:02:06.017894] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-13T19:02:06.405157] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:02:06.622599] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T19:02:06.817920] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-13T19:02:07.563748] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:02:07.617877] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-13T19:02:07.657494] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T19:02:08.417898] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-13T19:02:08.494036] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T19:02:08.495618] [INFO ] [REMOTE ] FRGE: Full fetch complete (31316 records). [2025-10-13T19:02:08.495715] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-13T19:02:08.855428] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-13T19:02:08.855516] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-13T19:02:08.856107] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-13T19:02:08.856169] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-13T19:02:08.856981] [DEBUG] [LOCAL ] FRGE: Trimmed 31316 records to 16319 (keeping 200 days of data) [2025-10-13T19:02:08.952854] [DEBUG] [LOCAL ] FRGE: Primary data saved (16319 records). [2025-10-13T19:02:08.952998] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-13T19:02:08.953074] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRGE took 36.8s. Estimated remaining: 3h 29m 53s. Rate: 7.1 symbols/min [2025-10-13T19:02:09.119783] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:09.168300] [DEBUG] [LOCAL ] FSK: Loaded 50179 existing records from primary storage. [2025-10-13T19:02:09.168612] [INFO ] [MAIN ] FSK: Loaded 50179 existing records. [2025-10-13T19:02:09.231093] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-13T19:02:09.351988] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:09.352295] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-13T19:02:09.352360] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-13T19:02:09.352939] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-13T19:02:09.352998] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-13T19:02:09.717531] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:10.017943] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-13T19:02:10.321844] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T19:02:10.817961] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-13T19:02:11.028705] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:02:11.617982] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-13T19:02:11.683566] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T19:02:12.417917] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-13T19:02:12.687307] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T19:02:12.721502] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:02:13.217947] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-13T19:02:14.017890] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-13T19:02:14.125459] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:02:14.729158] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:02:14.817884] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-13T19:02:15.617829] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-13T19:02:15.966355] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:02:16.281977] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:02:16.417984] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-13T19:02:17.101840] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:02:17.217927] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-13T19:02:17.674431] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:02:18.017959] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-13T19:02:18.822531] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-13T19:02:18.825315] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:02:19.617997] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-13T19:02:19.805920] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:02:20.332210] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:02:20.417966] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-13T19:02:20.906386] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T19:02:21.218027] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-13T19:02:22.017941] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-13T19:02:22.211996] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:02:22.457974] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:02:22.817993] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-13T19:02:23.482390] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:02:23.617938] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-13T19:02:24.417939] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-13T19:02:24.488435] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:02:25.110064] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:02:25.114853] [INFO ] [REMOTE ] FRT: Full fetch complete (60295 records). [2025-10-13T19:02:25.115059] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-13T19:02:25.222777] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-13T19:02:25.538714] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-13T19:02:25.538835] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-13T19:02:25.540034] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-13T19:02:25.540103] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-13T19:02:25.541960] [DEBUG] [LOCAL ] FRT: Trimmed 60295 records to 41675 (keeping 200 days of data) [2025-10-13T19:02:25.872092] [DEBUG] [LOCAL ] FRT: Primary data saved (41675 records). [2025-10-13T19:02:25.872264] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-13T19:02:25.872363] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRT took 31.0s. Estimated remaining: 3h 29m 59s. Rate: 7.1 symbols/min [2025-10-13T19:02:26.022751] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-13T19:02:26.052637] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:26.109273] [DEBUG] [LOCAL ] FSLY: Loaded 52002 existing records from primary storage. [2025-10-13T19:02:26.109753] [INFO ] [MAIN ] FSLY: Loaded 52002 existing records. [2025-10-13T19:02:26.304202] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:26.304717] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-13T19:02:26.304799] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-13T19:02:26.305439] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-13T19:02:26.334231] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-13T19:02:26.399811] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T19:02:26.751953] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:26.817953] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-13T19:02:26.862379] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:02:27.378833] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:02:27.618001] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-13T19:02:28.417898] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-13T19:02:28.744904] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-13T19:02:28.751244] [INFO ] [REMOTE ] FRO: Full fetch complete (75205 records). [2025-10-13T19:02:28.751483] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-13T19:02:29.101377] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:02:29.135429] [INFO ] [REMOTE ] FSCO: Full fetch complete (54945 records). [2025-10-13T19:02:29.155435] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-13T19:02:29.228598] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-13T19:02:29.233985] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-13T19:02:29.248042] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-13T19:02:29.228326] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-13T19:02:29.258097] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-13T19:02:29.328464] [DEBUG] [LOCAL ] FRO: Trimmed 75205 records to 51695 (keeping 200 days of data) [2025-10-13T19:02:29.701565] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-13T19:02:29.701952] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-13T19:02:29.702849] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-13T19:02:29.702934] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-13T19:02:29.708394] [DEBUG] [LOCAL ] FSCO: Trimmed 54945 records to 38370 (keeping 200 days of data) [2025-10-13T19:02:30.085611] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:02:30.106003] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-13T19:02:30.170736] [DEBUG] [LOCAL ] FSCO: Primary data saved (38370 records). [2025-10-13T19:02:30.171337] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-13T19:02:30.188367] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSCO took 33.4s. Estimated remaining: 3h 29m 44s. Rate: 7.1 symbols/min [2025-10-13T19:02:30.383963] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:30.389469] [DEBUG] [LOCAL ] FRO: Primary data saved (51695 records). [2025-10-13T19:02:30.390056] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-13T19:02:30.390195] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FRO took 56.4s. Estimated remaining: 3h 29m 21s. Rate: 7.1 symbols/min [2025-10-13T19:02:30.581904] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:30.619350] [DEBUG] [LOCAL ] FSM: Loaded 54076 existing records from primary storage. [2025-10-13T19:02:30.619706] [INFO ] [MAIN ] FSM: Loaded 54076 existing records. [2025-10-13T19:02:30.825275] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:30.826629] [DEBUG] [LOCAL ] FSS: Loaded 34290 existing records from primary storage. [2025-10-13T19:02:30.827012] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-13T19:02:30.827119] [INFO ] [MAIN ] FSS: Loaded 34290 existing records. [2025-10-13T19:02:30.840060] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-13T19:02:30.873122] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-13T19:02:30.878454] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-13T19:02:31.155366] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:31.236914] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-13T19:02:31.261175] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-13T19:02:31.310125] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-13T19:02:31.310406] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-13T19:02:31.546099] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-13T19:02:31.623261] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-13T19:02:31.612148] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:31.652260] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-13T19:02:31.836219] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:32.011435] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:02:32.417945] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-13T19:02:33.217951] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-13T19:02:33.359997] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:02:33.437136] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:02:33.466411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T19:02:34.017956] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-13T19:02:34.817940] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-13T19:02:35.051993] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:02:35.617987] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-13T19:02:35.797748] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:02:36.418028] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-13T19:02:36.676006] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:02:37.217946] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-13T19:02:37.460164] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:02:37.467930] [INFO ] [REMOTE ] FSK: Full fetch complete (71757 records). [2025-10-13T19:02:37.468116] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-13T19:02:37.840624] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T19:02:37.892492] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-13T19:02:37.892567] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-13T19:02:37.893449] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-13T19:02:37.893521] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-13T19:02:37.895019] [DEBUG] [LOCAL ] FSK: Trimmed 71757 records to 49449 (keeping 200 days of data) [2025-10-13T19:02:38.067615] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-13T19:02:38.200456] [DEBUG] [LOCAL ] FSK: Primary data saved (49449 records). [2025-10-13T19:02:38.200607] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-13T19:02:38.200722] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSK took 29.2s. Estimated remaining: 3h 29m 12s. Rate: 7.1 symbols/min [2025-10-13T19:02:38.365700] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:38.375581] [DEBUG] [LOCAL ] FT: Loaded 6823 existing records from primary storage. [2025-10-13T19:02:38.375819] [INFO ] [MAIN ] FT: Loaded 6823 existing records. [2025-10-13T19:02:38.586318] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:38.586706] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-13T19:02:38.586768] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-13T19:02:38.587038] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-13T19:02:38.587097] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-13T19:02:38.817986] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-13T19:02:39.002092] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:39.035196] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:02:39.487986] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:02:39.617944] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-13T19:02:40.308716] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:02:40.417960] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-13T19:02:41.217957] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-13T19:02:41.475004] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:02:41.928273] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T19:02:41.954378] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T19:02:42.017922] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-13T19:02:42.817977] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-13T19:02:43.283444] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:02:43.617965] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-13T19:02:43.784466] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:02:44.314695] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T19:02:44.417950] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-13T19:02:45.217952] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-13T19:02:46.018024] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-13T19:02:46.035387] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:02:46.070465] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:02:46.817952] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-13T19:02:47.564836] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:02:47.601823] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:02:47.617893] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-13T19:02:48.391142] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T19:02:48.417890] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-13T19:02:48.871634] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T19:02:49.217936] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-13T19:02:49.984765] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:02:50.017950] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-13T19:02:50.817959] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-13T19:02:51.485471] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:02:51.549218] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:02:51.617958] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-13T19:02:52.417955] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-13T19:02:53.217958] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-13T19:02:53.483422] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T19:02:53.662880] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:02:53.991275] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:02:54.017953] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-13T19:02:54.786507] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:02:54.787974] [INFO ] [REMOTE ] FT: Full fetch complete (9226 records). [2025-10-13T19:02:54.788046] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-13T19:02:54.823181] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-13T19:02:55.148037] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-13T19:02:55.148122] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-13T19:02:55.148412] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-13T19:02:55.148459] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-13T19:02:55.148906] [DEBUG] [LOCAL ] FT: Trimmed 9226 records to 6748 (keeping 200 days of data) [2025-10-13T19:02:55.186907] [DEBUG] [LOCAL ] FT: Primary data saved (6748 records). [2025-10-13T19:02:55.187021] [INFO ] [MAIN ] FT: Full history saved. [2025-10-13T19:02:55.187100] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FT took 17.0s. Estimated remaining: 3h 29m 18s. Rate: 7.1 symbols/min [2025-10-13T19:02:55.617895] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-13T19:02:56.320299] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:02:56.417962] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-13T19:02:57.217963] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-13T19:02:57.436470] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:02:58.017958] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-13T19:02:58.138291] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:02:58.311865] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T19:02:58.817943] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-13T19:02:59.457127] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:02:59.617978] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-13T19:03:00.148947] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:03:00.418002] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-13T19:03:01.217973] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-13T19:03:01.507968] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:03:02.017982] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-13T19:03:02.203464] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:03:02.209059] [INFO ] [REMOTE ] FSLY: Full fetch complete (74862 records). [2025-10-13T19:03:02.209215] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-13T19:03:02.629890] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-13T19:03:02.626286] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:03:02.630046] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-13T19:03:02.633706] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-13T19:03:02.633923] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-13T19:03:02.634986] [INFO ] [REMOTE ] FSS: Full fetch complete (48418 records). [2025-10-13T19:03:02.635211] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-13T19:03:02.666792] [DEBUG] [LOCAL ] FSLY: Trimmed 74862 records to 51276 (keeping 200 days of data) [2025-10-13T19:03:03.115153] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-13T19:03:03.116768] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-13T19:03:03.118390] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-13T19:03:03.118473] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-13T19:03:03.129730] [DEBUG] [LOCAL ] FSS: Trimmed 48418 records to 33816 (keeping 200 days of data) [2025-10-13T19:03:03.508490] [DEBUG] [LOCAL ] FSLY: Primary data saved (51276 records). [2025-10-13T19:03:03.509766] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-13T19:03:03.510146] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSLY took 37.6s. Estimated remaining: 3h 29m 9s. Rate: 7.1 symbols/min [2025-10-13T19:03:03.526607] [DEBUG] [LOCAL ] FSS: Primary data saved (33816 records). [2025-10-13T19:03:03.526810] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-13T19:03:03.526904] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FSS took 33.1s. Estimated remaining: 3h 28m 47s. Rate: 7.1 symbols/min [2025-10-13T19:03:03.871673] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T19:03:03.883277] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-13T19:03:05.687946] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:03:05.698883] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-13T19:03:07.594430] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T19:03:07.606452] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-13T19:03:09.368957] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:03:09.380210] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-13T19:03:11.297229] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:03:11.309030] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-13T19:03:13.111022] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T19:03:13.116622] [INFO ] [REMOTE ] FSM: Full fetch complete (76868 records). [2025-10-13T19:03:13.116793] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-13T19:03:13.510366] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-13T19:03:13.510450] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-13T19:03:13.511333] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-13T19:03:13.511396] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-13T19:03:13.512962] [DEBUG] [LOCAL ] FSM: Trimmed 76868 records to 53298 (keeping 200 days of data) [2025-10-13T19:03:13.817123] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-13T19:03:13.817284] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-13T19:03:13.818191] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FSM took 43.6s. Estimated remaining: 3h 28m 42s. Rate: 7.1 symbols/min [2025-10-13T19:03:14.459206] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.529792] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.522512] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.616825] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.629737] [DEBUG] [LOCAL ] FTHY: Loaded 12479 existing records from primary storage. [2025-10-13T19:03:14.630229] [INFO ] [MAIN ] FTHY: Loaded 12479 existing records. [2025-10-13T19:03:14.786455] [DEBUG] [LOCAL ] FTS: Loaded 43045 existing records from primary storage. [2025-10-13T19:03:14.843154] [INFO ] [MAIN ] FTS: Loaded 43045 existing records. [2025-10-13T19:03:14.896733] [DEBUG] [LOCAL ] FTK: Loaded 33004 existing records from primary storage. [2025-10-13T19:03:14.900700] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:14.925162] [INFO ] [MAIN ] FTK: Loaded 33004 existing records. [2025-10-13T19:03:14.953192] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-13T19:03:14.936226] [DEBUG] [LOCAL ] FTI: Loaded 54071 existing records from primary storage. [2025-10-13T19:03:14.997772] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-13T19:03:15.014034] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-13T19:03:15.019340] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-13T19:03:15.003299] [INFO ] [MAIN ] FTI: Loaded 54071 existing records. [2025-10-13T19:03:15.488437] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.536085] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.577809] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.611260] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.640854] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-13T19:03:15.644208] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.644510] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-13T19:03:15.667400] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-13T19:03:15.667738] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-13T19:03:15.667622] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.683773] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-13T19:03:15.693039] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-13T19:03:15.724031] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-13T19:03:15.792479] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-13T19:03:15.886742] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-13T19:03:16.078722] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.130055] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-13T19:03:16.817106] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.864456] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-13T19:03:16.912357] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.913479] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-13T19:03:16.991877] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.992175] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-13T19:03:17.353256] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T19:03:17.357293] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-13T19:03:18.063483] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:03:18.068558] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-13T19:03:18.133188] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T19:03:18.136499] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-13T19:03:18.476676] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:03:18.485265] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-13T19:03:18.739636] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T19:03:18.740083] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:03:18.753354] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-13T19:03:18.755128] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-13T19:03:19.195044] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T19:03:19.201147] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-13T19:03:19.509046] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T19:03:19.511433] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-13T19:03:19.564936] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:03:19.573321] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-13T19:03:20.195598] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T19:03:20.200633] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-13T19:03:20.272068] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T19:03:20.276848] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-13T19:03:20.395245] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:03:20.405669] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-13T19:03:20.745621] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T19:03:20.748954] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-13T19:03:20.841713] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T19:03:20.850098] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-13T19:03:21.512520] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:03:21.518694] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-13T19:03:21.565121] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:03:21.829592] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:03:22.017900] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-13T19:03:22.408745] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:03:22.519774] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:03:22.817902] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-13T19:03:23.618069] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-13T19:03:23.686607] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:03:23.957485] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:03:24.091277] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T19:03:24.417983] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-13T19:03:25.204248] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:03:25.217872] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-13T19:03:26.017946] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-13T19:03:26.070174] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T19:03:26.817961] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-13T19:03:27.606556] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:03:27.617878] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-13T19:03:28.364367] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:03:28.417999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-13T19:03:29.186886] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:03:29.217981] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-13T19:03:29.874579] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T19:03:30.017960] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-13T19:03:30.579266] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:03:30.817992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-13T19:03:31.618075] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-13T19:03:31.733675] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:03:32.417978] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-13T19:03:32.472568] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:03:33.217989] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-13T19:03:33.426545] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:03:33.522392] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T19:03:34.018040] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-13T19:03:34.805600] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:03:34.817881] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-13T19:03:35.191602] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T19:03:35.618001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-13T19:03:36.241403] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:03:36.417951] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-13T19:03:36.962955] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:03:36.967373] [INFO ] [REMOTE ] FTK: Full fetch complete (44109 records). [2025-10-13T19:03:36.967558] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-13T19:03:37.229841] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-13T19:03:37.373629] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-13T19:03:37.373753] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-13T19:03:37.374437] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-13T19:03:37.374479] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-13T19:03:37.375527] [DEBUG] [LOCAL ] FTK: Trimmed 44109 records to 32807 (keeping 200 days of data) [2025-10-13T19:03:37.564494] [DEBUG] [LOCAL ] FTK: Primary data saved (32807 records). [2025-10-13T19:03:37.564708] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-13T19:03:37.564833] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTK took 23.7s. Estimated remaining: 3h 28m 59s. Rate: 7.1 symbols/min [2025-10-13T19:03:37.741913] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:37.797181] [DEBUG] [LOCAL ] FTV: Loaded 53761 existing records from primary storage. [2025-10-13T19:03:37.797582] [INFO ] [MAIN ] FTV: Loaded 53761 existing records. [2025-10-13T19:03:37.995392] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:37.996639] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-13T19:03:37.996470] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:03:37.996811] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-13T19:03:38.001368] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-13T19:03:38.001490] [INFO ] [REMOTE ] FTS: Full fetch complete (60218 records). [2025-10-13T19:03:38.001696] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-13T19:03:38.001829] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-13T19:03:38.022411] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-13T19:03:38.135741] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T19:03:38.217218] [INFO ] [REMOTE ] FTHY: Full fetch complete (17499 records). [2025-10-13T19:03:38.226331] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-13T19:03:39.080763] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:39.091619] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-13T19:03:39.102117] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-13T19:03:39.131701] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-13T19:03:39.152509] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-13T19:03:39.157738] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-13T19:03:39.168958] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-13T19:03:39.169243] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-13T19:03:39.169550] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-13T19:03:39.169685] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-13T19:03:39.170003] [DEBUG] [LOCAL ] FTS: Trimmed 60218 records to 42510 (keeping 200 days of data) [2025-10-13T19:03:39.171030] [DEBUG] [LOCAL ] FTHY: Trimmed 17499 records to 12332 (keeping 200 days of data) [2025-10-13T19:03:39.473688] [DEBUG] [LOCAL ] FTHY: Primary data saved (12332 records). [2025-10-13T19:03:39.483915] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-13T19:03:39.486504] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTHY took 25.7s. Estimated remaining: 3h 28m 40s. Rate: 7.1 symbols/min [2025-10-13T19:03:39.691079] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:39.692114] [DEBUG] [LOCAL ] FTS: Primary data saved (42510 records). [2025-10-13T19:03:39.693100] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-13T19:03:39.694414] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 25.9s. Estimated remaining: 3h 28m 18s. Rate: 7.1 symbols/min [2025-10-13T19:03:39.784542] [DEBUG] [LOCAL ] FTWO: Loaded 1910 existing records from primary storage. [2025-10-13T19:03:39.801505] [INFO ] [MAIN ] FTWO: Loaded 1910 existing records. [2025-10-13T19:03:39.908802] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:40.057606] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:40.058163] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-13T19:03:40.058235] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-13T19:03:40.058578] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-13T19:03:40.059100] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-13T19:03:40.222543] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-13T19:03:40.292506] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-13T19:03:40.292215] [DEBUG] [LOCAL ] FUBO: Loaded 54485 existing records from primary storage. [2025-10-13T19:03:40.348872] [INFO ] [MAIN ] FUBO: Loaded 54485 existing records. [2025-10-13T19:03:40.641880] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:40.659806] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-13T19:03:40.682598] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:40.683394] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-13T19:03:40.683440] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-13T19:03:40.683930] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-13T19:03:40.683999] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-13T19:03:41.037724] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:41.065405] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T19:03:41.217958] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-13T19:03:41.248529] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:03:42.017983] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-13T19:03:42.094590] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T19:03:42.424682] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T19:03:42.817948] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-13T19:03:43.325154] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T19:03:43.617942] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-13T19:03:44.417957] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-13T19:03:44.523050] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:03:44.942728] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T19:03:45.217941] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-13T19:03:46.017970] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-13T19:03:46.093198] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-13T19:03:46.455891] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T19:03:46.817961] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-13T19:03:46.935110] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:03:47.617955] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-13T19:03:48.417954] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-13T19:03:49.075046] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T19:03:49.217897] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-13T19:03:49.488544] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:03:50.017937] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-13T19:03:50.106057] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:03:50.817964] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-13T19:03:51.121889] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-13T19:03:51.415339] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-13T19:03:51.445083] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:03:51.450775] [INFO ] [REMOTE ] FTI: Full fetch complete (77129 records). [2025-10-13T19:03:51.450916] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-13T19:03:51.622778] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-13T19:03:51.841445] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-13T19:03:51.841545] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-13T19:03:51.842508] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-13T19:03:51.842579] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-13T19:03:51.846989] [DEBUG] [LOCAL ] FTI: Trimmed 77129 records to 53299 (keeping 200 days of data) [2025-10-13T19:03:52.164853] [DEBUG] [LOCAL ] FTI: Primary data saved (53299 records). [2025-10-13T19:03:52.164997] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-13T19:03:52.165593] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTI took 38.3s. Estimated remaining: 3h 28m 16s. Rate: 7.1 symbols/min [2025-10-13T19:03:52.330514] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:52.364957] [DEBUG] [LOCAL ] FUL: Loaded 33279 existing records from primary storage. [2025-10-13T19:03:52.365240] [INFO ] [MAIN ] FUL: Loaded 33279 existing records. [2025-10-13T19:03:52.426636] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-13T19:03:52.545382] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:52.545679] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-13T19:03:52.545750] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-13T19:03:52.546508] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-13T19:03:52.546581] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-13T19:03:52.891718] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:53.217958] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-13T19:03:53.545786] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:03:54.017937] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-13T19:03:54.427355] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:03:54.611528] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T19:03:54.817899] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-13T19:03:55.617896] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-13T19:03:55.873236] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:03:56.082605] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T19:03:56.417940] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-13T19:03:57.040936] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-13T19:03:57.217969] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-13T19:03:57.792771] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:03:58.017972] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-13T19:03:58.460811] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T19:03:58.817898] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-13T19:03:59.154905] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T19:03:59.617938] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-13T19:04:00.417941] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-13T19:04:00.596204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:04:00.859984] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:04:01.217963] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-13T19:04:02.017952] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-13T19:04:02.572052] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:04:02.578991] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T19:04:02.817940] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-13T19:04:02.985279] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T19:04:03.118227] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T19:04:03.617945] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-13T19:04:04.417904] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-13T19:04:05.217957] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-13T19:04:05.512551] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T19:04:05.668085] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:04:06.017997] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-13T19:04:06.323850] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:04:06.568567] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T19:04:06.569462] [INFO ] [REMOTE ] FTWO: Full fetch complete (3313 records). [2025-10-13T19:04:06.569529] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-13T19:04:06.823097] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-13T19:04:06.928377] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-13T19:04:06.928455] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-13T19:04:06.928575] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-13T19:04:06.928613] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-13T19:04:06.929009] [DEBUG] [LOCAL ] FTWO: Trimmed 3313 records to 1896 (keeping 200 days of data) [2025-10-13T19:04:06.940692] [DEBUG] [LOCAL ] FTWO: Primary data saved (1896 records). [2025-10-13T19:04:06.940751] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-13T19:04:06.940852] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FTWO took 27.5s. Estimated remaining: 3h 28m 18s. Rate: 7.1 symbols/min [2025-10-13T19:04:07.133533] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:07.194149] [DEBUG] [LOCAL ] FUN: Loaded 52553 existing records from primary storage. [2025-10-13T19:04:07.194503] [INFO ] [MAIN ] FUN: Loaded 52553 existing records. [2025-10-13T19:04:07.373363] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:07.373592] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-13T19:04:07.373638] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-13T19:04:07.374181] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-13T19:04:07.374238] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-13T19:04:07.624549] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-13T19:04:07.748425] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:08.345841] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:04:08.417940] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-13T19:04:09.217987] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-13T19:04:09.929775] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:04:10.023052] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-13T19:04:10.038744] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-13T19:04:10.817897] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-13T19:04:10.985206] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:04:11.436005] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:04:11.617979] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-13T19:04:12.417888] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-13T19:04:12.584859] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:04:13.217896] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-13T19:04:13.392998] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:04:13.599478] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T19:04:14.018018] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-13T19:04:14.818051] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-13T19:04:15.346585] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-13T19:04:15.352636] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-13T19:04:15.352809] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-13T19:04:15.619410] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-13T19:04:15.760848] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:04:15.792629] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-13T19:04:15.793091] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-13T19:04:15.794013] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-13T19:04:15.794077] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-13T19:04:15.795537] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 53715 (keeping 200 days of data) [2025-10-13T19:04:16.097534] [DEBUG] [LOCAL ] FUBO: Primary data saved (53715 records). [2025-10-13T19:04:16.097706] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-13T19:04:16.097797] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 36.4s. Estimated remaining: 3h 28m 11s. Rate: 7.1 symbols/min [2025-10-13T19:04:16.271951] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:16.286372] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:04:16.292015] [INFO ] [REMOTE ] FTV: Full fetch complete (76416 records). [2025-10-13T19:04:16.292184] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-13T19:04:16.427508] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-13T19:04:16.463006] [DEBUG] [LOCAL ] FVR: Loaded 21773 existing records from primary storage. [2025-10-13T19:04:16.505335] [INFO ] [MAIN ] FVR: Loaded 21773 existing records. [2025-10-13T19:04:16.859609] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-13T19:04:16.866346] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-13T19:04:16.902417] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-13T19:04:16.902533] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-13T19:04:16.901368] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:16.902949] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-13T19:04:16.903417] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-13T19:04:16.903948] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-13T19:04:16.904012] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-13T19:04:16.909266] [DEBUG] [LOCAL ] FTV: Trimmed 76416 records to 53035 (keeping 200 days of data) [2025-10-13T19:04:17.256551] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:04:17.306888] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-13T19:04:17.501976] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:17.659819] [DEBUG] [LOCAL ] FTV: Primary data saved (53035 records). [2025-10-13T19:04:17.660001] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-13T19:04:17.660145] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FTV took 40.1s. Estimated remaining: 3h 27m 51s. Rate: 7.1 symbols/min [2025-10-13T19:04:17.851575] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:17.892719] [DEBUG] [LOCAL ] FVRR: Loaded 40837 existing records from primary storage. [2025-10-13T19:04:17.893063] [INFO ] [MAIN ] FVRR: Loaded 40837 existing records. [2025-10-13T19:04:18.018289] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-13T19:04:18.071013] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:18.071444] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-13T19:04:18.071490] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-13T19:04:18.071934] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-13T19:04:18.071991] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-13T19:04:18.427699] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:18.461320] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T19:04:18.823142] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-13T19:04:18.835712] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:04:18.896370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:04:19.617963] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-13T19:04:20.317225] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:04:20.417899] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-13T19:04:20.603702] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:04:21.217992] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-13T19:04:22.005847] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:04:22.017873] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-13T19:04:22.523630] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:04:22.817966] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-13T19:04:23.564807] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:04:23.617896] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-13T19:04:23.787847] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T19:04:24.417965] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-13T19:04:25.108901] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T19:04:25.217900] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-13T19:04:25.831444] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:04:26.017957] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-13T19:04:26.817896] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-13T19:04:26.918746] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:04:27.363923] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:04:27.367501] [INFO ] [REMOTE ] FUL: Full fetch complete (47743 records). [2025-10-13T19:04:27.367597] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-13T19:04:27.623080] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-13T19:04:27.745055] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-13T19:04:27.745197] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-13T19:04:27.745878] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-13T19:04:27.745944] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-13T19:04:27.746966] [DEBUG] [LOCAL ] FUL: Trimmed 47743 records to 32704 (keeping 200 days of data) [2025-10-13T19:04:27.935924] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:04:27.961635] [DEBUG] [LOCAL ] FUL: Primary data saved (32704 records). [2025-10-13T19:04:27.961753] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-13T19:04:27.961838] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUL took 35.8s. Estimated remaining: 3h 27m 46s. Rate: 7.1 symbols/min [2025-10-13T19:04:28.133190] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:28.136735] [DEBUG] [LOCAL ] FXED: Loaded 1266 existing records from primary storage. [2025-10-13T19:04:28.136873] [INFO ] [MAIN ] FXED: Loaded 1266 existing records. [2025-10-13T19:04:28.309360] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:28.309586] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-13T19:04:28.309633] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-13T19:04:28.309831] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-13T19:04:28.309886] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-13T19:04:28.423045] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-13T19:04:28.657466] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:29.107614] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T19:04:29.217927] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-13T19:04:29.523196] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T19:04:30.018006] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-13T19:04:30.725100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:04:30.817894] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-13T19:04:31.052415] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T19:04:31.159445] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T19:04:31.617963] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-13T19:04:31.937125] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T19:04:32.417961] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-13T19:04:33.217942] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-13T19:04:33.963507] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:04:34.017892] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-13T19:04:34.447857] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T19:04:34.817982] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-13T19:04:35.083758] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:04:35.617899] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-13T19:04:36.417899] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-13T19:04:36.477409] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:04:36.808577] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T19:04:37.217972] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-13T19:04:37.283908] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:04:38.017957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-13T19:04:38.818014] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-13T19:04:39.032217] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:04:39.548383] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T19:04:39.617944] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-13T19:04:39.823365] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T19:04:40.417952] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-13T19:04:40.758965] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-13T19:04:41.217971] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-13T19:04:41.454013] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:04:41.875624] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T19:04:42.017939] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-13T19:04:42.817955] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-13T19:04:43.230710] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-13T19:04:43.617976] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-13T19:04:43.760367] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T19:04:43.963789] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T19:04:44.417952] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-13T19:04:45.217939] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-13T19:04:45.554790] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T19:04:46.017951] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-13T19:04:46.128553] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:04:46.136773] [INFO ] [REMOTE ] FUN: Full fetch complete (73094 records). [2025-10-13T19:04:46.137005] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-13T19:04:46.479156] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T19:04:46.537202] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-13T19:04:46.537291] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-13T19:04:46.538321] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-13T19:04:46.538387] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-13T19:04:46.539793] [DEBUG] [LOCAL ] FUN: Trimmed 73094 records to 51875 (keeping 200 days of data) [2025-10-13T19:04:46.828387] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-13T19:04:46.851179] [DEBUG] [LOCAL ] FUN: Primary data saved (51875 records). [2025-10-13T19:04:46.851323] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-13T19:04:46.851449] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FUN took 39.9s. Estimated remaining: 3h 27m 55s. Rate: 7.1 symbols/min [2025-10-13T19:04:47.039444] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:47.089859] [DEBUG] [LOCAL ] G: Loaded 50737 existing records from primary storage. [2025-10-13T19:04:47.090213] [INFO ] [MAIN ] G: Loaded 50737 existing records. [2025-10-13T19:04:47.279568] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T19:04:47.308976] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:47.311527] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-13T19:04:47.311614] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-13T19:04:47.312062] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-13T19:04:47.312131] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-13T19:04:47.623088] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-13T19:04:47.678183] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:48.099441] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T19:04:48.417949] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-13T19:04:49.217974] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-13T19:04:50.017347] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:04:50.027310] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-13T19:04:50.216068] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:04:50.475384] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T19:04:50.476155] [INFO ] [REMOTE ] FXED: Full fetch complete (1807 records). [2025-10-13T19:04:50.476221] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-13T19:04:50.823074] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-13T19:04:50.867304] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-13T19:04:50.867419] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-13T19:04:50.867541] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-13T19:04:50.867605] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-13T19:04:50.868070] [DEBUG] [LOCAL ] FXED: Trimmed 1807 records to 1252 (keeping 200 days of data) [2025-10-13T19:04:50.877610] [DEBUG] [LOCAL ] FXED: Primary data saved (1252 records). [2025-10-13T19:04:50.877707] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-13T19:04:50.877792] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 22.9s. Estimated remaining: 3h 27m 39s. Rate: 7.1 symbols/min [2025-10-13T19:04:51.067316] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:51.096424] [DEBUG] [LOCAL ] GAB: Loaded 28235 existing records from primary storage. [2025-10-13T19:04:51.096748] [INFO ] [MAIN ] GAB: Loaded 28235 existing records. [2025-10-13T19:04:51.279284] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:51.279565] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-13T19:04:51.279614] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-13T19:04:51.279936] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-13T19:04:51.280007] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-13T19:04:51.626944] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-13T19:04:51.631621] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:52.345615] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:04:52.417882] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-13T19:04:53.129207] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T19:04:53.217891] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-13T19:04:53.989096] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:04:53.993629] [INFO ] [REMOTE ] FVRR: Full fetch complete (59265 records). [2025-10-13T19:04:53.993800] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-13T19:04:54.026275] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-13T19:04:54.376317] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-13T19:04:54.376395] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-13T19:04:54.377152] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-13T19:04:54.377241] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-13T19:04:54.378406] [DEBUG] [LOCAL ] FVRR: Trimmed 59265 records to 40494 (keeping 200 days of data) [2025-10-13T19:04:54.612362] [DEBUG] [LOCAL ] FVRR: Primary data saved (40494 records). [2025-10-13T19:04:54.612515] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-13T19:04:54.612752] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. FVRR took 37.0s. Estimated remaining: 3h 27m 23s. Rate: 7.1 symbols/min [2025-10-13T19:04:54.788602] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:54.819023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-13T19:04:54.823141] [DEBUG] [LOCAL ] GAM: Loaded 4102 existing records from primary storage. [2025-10-13T19:04:54.825638] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:04:54.826204] [INFO ] [MAIN ] GAM: Loaded 4102 existing records. [2025-10-13T19:04:55.013043] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:55.013288] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-13T19:04:55.013337] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-13T19:04:55.013513] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-13T19:04:55.013579] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-13T19:04:55.366985] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:55.415624] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:04:55.475161] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:04:55.477747] [INFO ] [REMOTE ] FVR: Full fetch complete (29483 records). [2025-10-13T19:04:55.477836] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-13T19:04:55.623061] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-13T19:04:55.856989] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-13T19:04:55.857098] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-13T19:04:55.857897] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-13T19:04:55.857991] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-13T19:04:55.859240] [DEBUG] [LOCAL ] FVR: Trimmed 29483 records to 21321 (keeping 200 days of data) [2025-10-13T19:04:56.000932] [DEBUG] [LOCAL ] FVR: Primary data saved (21321 records). [2025-10-13T19:04:56.001109] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-13T19:04:56.001208] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. FVR took 39.9s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-13T19:04:56.183294] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:56.237414] [DEBUG] [LOCAL ] GAP: Loaded 54432 existing records from primary storage. [2025-10-13T19:04:56.237814] [INFO ] [MAIN ] GAP: Loaded 54432 existing records. [2025-10-13T19:04:56.423163] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:04:56.422114] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:56.417987] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-13T19:04:56.425944] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-13T19:04:56.426841] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-13T19:04:56.427411] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-13T19:04:56.427468] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-13T19:04:56.783132] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:57.217934] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-13T19:04:57.639139] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:04:58.017935] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-13T19:04:58.657834] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:04:58.792632] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T19:04:58.817877] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-13T19:04:59.618003] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-13T19:05:00.053610] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T19:05:00.236602] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T19:05:00.417942] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-13T19:05:01.218007] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-13T19:05:01.966283] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:05:02.017927] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-13T19:05:02.327012] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T19:05:02.817896] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-13T19:05:03.528714] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T19:05:03.617968] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-13T19:05:03.952534] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T19:05:04.417993] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-13T19:05:04.971338] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:05:05.053781] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T19:05:05.217888] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-13T19:05:05.786936] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:05:06.017950] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-13T19:05:06.562203] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:05:06.818069] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-13T19:05:07.618003] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-13T19:05:08.237287] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:05:08.417952] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-13T19:05:08.650622] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:05:09.217900] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-13T19:05:09.673965] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:05:10.017960] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-13T19:05:10.817936] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-13T19:05:10.878748] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T19:05:11.617967] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-13T19:05:11.701073] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:05:12.041102] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T19:05:12.417985] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-13T19:05:13.163241] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:05:13.217877] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-13T19:05:13.598742] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:05:14.017964] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-13T19:05:14.818086] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-13T19:05:14.910084] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:05:15.617977] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-13T19:05:15.945567] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:05:16.131396] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T19:05:16.202869] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T19:05:16.417950] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-13T19:05:17.218004] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-13T19:05:17.760875] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T19:05:18.017991] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-13T19:05:18.320829] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:05:18.470592] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T19:05:18.471550] [INFO ] [REMOTE ] GAM: Full fetch complete (6563 records). [2025-10-13T19:05:18.471615] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-13T19:05:18.835178] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-13T19:05:18.827436] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-13T19:05:18.836083] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-13T19:05:18.836276] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-13T19:05:18.836317] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-13T19:05:18.836716] [DEBUG] [LOCAL ] GAM: Trimmed 6563 records to 3987 (keeping 200 days of data) [2025-10-13T19:05:18.862595] [DEBUG] [LOCAL ] GAM: Primary data saved (3987 records). [2025-10-13T19:05:18.862722] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-13T19:05:18.862807] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAM took 24.2s. Estimated remaining: 3h 27m 19s. Rate: 7.1 symbols/min [2025-10-13T19:05:19.030939] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:19.052319] [DEBUG] [LOCAL ] GATX: Loaded 18334 existing records from primary storage. [2025-10-13T19:05:19.052577] [INFO ] [MAIN ] GATX: Loaded 18334 existing records. [2025-10-13T19:05:19.226493] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:19.226752] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-13T19:05:19.226806] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-13T19:05:19.227161] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-13T19:05:19.227217] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-13T19:05:19.574476] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:19.617880] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-13T19:05:20.417929] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-13T19:05:20.650587] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:05:20.831911] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:05:21.217950] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-13T19:05:22.017937] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-13T19:05:22.238922] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:05:22.818001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-13T19:05:23.000541] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:05:23.071794] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T19:05:23.618021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-13T19:05:23.884669] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:05:24.417956] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-13T19:05:25.217939] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-13T19:05:25.606103] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:05:25.609243] [INFO ] [REMOTE ] GAB: Full fetch complete (39335 records). [2025-10-13T19:05:25.609361] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-13T19:05:25.757696] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T19:05:26.022259] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-13T19:05:26.037892] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-13T19:05:26.038033] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-13T19:05:26.039690] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-13T19:05:26.039757] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-13T19:05:26.040604] [DEBUG] [LOCAL ] GAB: Trimmed 39335 records to 27677 (keeping 200 days of data) [2025-10-13T19:05:26.132268] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T19:05:26.210710] [DEBUG] [LOCAL ] GAB: Primary data saved (27677 records). [2025-10-13T19:05:26.210850] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-13T19:05:26.210932] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAB took 35.3s. Estimated remaining: 3h 27m 8s. Rate: 7.1 symbols/min [2025-10-13T19:05:26.375066] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:26.388781] [DEBUG] [LOCAL ] GBAB: Loaded 13161 existing records from primary storage. [2025-10-13T19:05:26.389001] [INFO ] [MAIN ] GBAB: Loaded 13161 existing records. [2025-10-13T19:05:26.559181] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:26.559393] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-13T19:05:26.559441] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-13T19:05:26.559689] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-13T19:05:26.559745] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-13T19:05:26.824397] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-13T19:05:26.904742] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:27.617902] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-13T19:05:27.694340] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:05:28.417963] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-13T19:05:28.661064] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T19:05:28.926748] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-13T19:05:29.217945] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-13T19:05:30.017988] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-13T19:05:30.100855] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:05:30.106290] [INFO ] [REMOTE ] G: Full fetch complete (71766 records). [2025-10-13T19:05:30.106409] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-13T19:05:30.495046] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-13T19:05:30.495129] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-13T19:05:30.496111] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-13T19:05:30.496176] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-13T19:05:30.497485] [DEBUG] [LOCAL ] G: Trimmed 71766 records to 50010 (keeping 200 days of data) [2025-10-13T19:05:30.801287] [DEBUG] [LOCAL ] G: Primary data saved (50010 records). [2025-10-13T19:05:30.801438] [INFO ] [MAIN ] G: Full history saved. [2025-10-13T19:05:30.801521] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. G took 43.9s. Estimated remaining: 3h 26m 54s. Rate: 7.1 symbols/min [2025-10-13T19:05:30.834058] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-13T19:05:31.010430] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:31.032495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:05:31.061134] [DEBUG] [LOCAL ] GBCI: Loaded 41170 existing records from primary storage. [2025-10-13T19:05:31.061474] [INFO ] [MAIN ] GBCI: Loaded 41170 existing records. [2025-10-13T19:05:31.246733] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:31.247042] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-13T19:05:31.247212] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-13T19:05:31.257637] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-13T19:05:31.274957] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-13T19:05:31.345447] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-13T19:05:31.620521] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-13T19:05:31.662117] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:31.742594] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T19:05:32.418154] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-13T19:05:33.217944] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-13T19:05:33.451436] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T19:05:33.457874] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-13T19:05:33.458174] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-13T19:05:33.813684] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T19:05:33.895621] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-13T19:05:33.895746] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-13T19:05:33.896746] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-13T19:05:33.896841] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-13T19:05:33.898336] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 53653 (keeping 200 days of data) [2025-10-13T19:05:34.017984] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-13T19:05:34.219748] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-13T19:05:34.219905] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-13T19:05:34.220814] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GAP took 38.2s. Estimated remaining: 3h 26m 37s. Rate: 7.1 symbols/min [2025-10-13T19:05:34.392243] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:34.392546] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-13T19:05:34.392618] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-13T19:05:34.392807] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-13T19:05:34.392852] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-13T19:05:34.392893] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-13T19:05:34.392924] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-13T19:05:34.681519] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:05:34.790806] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:34.817898] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-13T19:05:35.175851] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T19:05:35.256310] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T19:05:35.617949] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-13T19:05:36.378915] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:05:36.418002] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-13T19:05:36.762395] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-13T19:05:37.218038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-13T19:05:37.461929] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-13T19:05:38.017946] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-13T19:05:38.446480] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T19:05:38.817958] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-13T19:05:39.561502] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T19:05:39.617963] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-13T19:05:40.417981] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-13T19:05:40.635313] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:05:41.217964] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-13T19:05:41.300449] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T19:05:42.017979] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-13T19:05:42.315047] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T19:05:42.760207] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T19:05:42.817997] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-13T19:05:43.617894] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-13T19:05:43.762799] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:05:43.976875] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-13T19:05:44.417945] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-13T19:05:45.136945] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T19:05:45.217887] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-13T19:05:46.017939] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-13T19:05:46.775175] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:05:46.817880] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-13T19:05:47.070535] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:05:47.617981] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-13T19:05:47.978580] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:05:48.006968] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T19:05:48.417926] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-13T19:05:49.217982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-13T19:05:49.379230] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:05:49.381001] [INFO ] [REMOTE ] GATX: Full fetch complete (24857 records). [2025-10-13T19:05:49.381069] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-13T19:05:49.783668] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-13T19:05:49.783781] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-13T19:05:49.784366] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-13T19:05:49.784407] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-13T19:05:49.785117] [DEBUG] [LOCAL ] GATX: Trimmed 24857 records to 18135 (keeping 200 days of data) [2025-10-13T19:05:49.898921] [DEBUG] [LOCAL ] GATX: Primary data saved (18135 records). [2025-10-13T19:05:49.899060] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-13T19:05:49.899143] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GATX took 31.0s. Estimated remaining: 3h 26m 41s. Rate: 7.1 symbols/min [2025-10-13T19:05:50.023137] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-13T19:05:50.070161] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:50.107634] [DEBUG] [LOCAL ] GBTG: Loaded 40575 existing records from primary storage. [2025-10-13T19:05:50.108078] [INFO ] [MAIN ] GBTG: Loaded 40575 existing records. [2025-10-13T19:05:50.216768] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T19:05:50.295680] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:50.295896] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-13T19:05:50.295944] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-13T19:05:50.296332] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-13T19:05:50.296387] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-13T19:05:50.434716] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T19:05:50.647977] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:50.817900] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-13T19:05:51.617963] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-13T19:05:51.945233] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:05:52.272268] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:05:52.417926] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-13T19:05:53.217960] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-13T19:05:53.659921] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T19:05:53.794095] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:05:54.017958] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-13T19:05:54.385719] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T19:05:54.817967] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-13T19:05:55.617982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-13T19:05:56.373398] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:05:56.422029] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-13T19:05:56.424211] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:05:57.217939] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-13T19:05:57.933244] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:05:58.017960] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-13T19:05:58.068812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T19:05:58.817968] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-13T19:05:59.203372] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T19:05:59.204220] [INFO ] [REMOTE ] GBLI: Full fetch complete (1303 records). [2025-10-13T19:05:59.204292] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-13T19:05:59.396444] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-13T19:05:59.396883] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:05:59.397070] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:05:59.397238] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-13T19:05:59.397354] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-13T19:05:59.397607] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-13T19:05:59.397786] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-13T19:05:59.397903] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 25.2s. Estimated remaining: 3h 26m 34s. Rate: 7.1 symbols/min [2025-10-13T19:05:59.548871] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:05:59.626526] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-13T19:05:59.630608] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:59.666057] [DEBUG] [LOCAL ] GBX: Loaded 29532 existing records from primary storage. [2025-10-13T19:05:59.666394] [INFO ] [MAIN ] GBX: Loaded 29532 existing records. [2025-10-13T19:05:59.850117] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:59.850380] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-13T19:05:59.850428] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-13T19:05:59.850827] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-13T19:05:59.850888] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-13T19:06:00.220564] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:00.417959] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-13T19:06:00.434341] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:06:00.436371] [INFO ] [REMOTE ] GBAB: Full fetch complete (19126 records). [2025-10-13T19:06:00.436467] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-13T19:06:00.829717] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-13T19:06:00.829869] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-13T19:06:00.830564] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-13T19:06:00.830609] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-13T19:06:00.831769] [DEBUG] [LOCAL ] GBAB: Trimmed 19126 records to 13018 (keeping 200 days of data) [2025-10-13T19:06:00.917179] [DEBUG] [LOCAL ] GBAB: Primary data saved (13018 records). [2025-10-13T19:06:00.917373] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-13T19:06:00.917473] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBAB took 34.7s. Estimated remaining: 3h 26m 14s. Rate: 7.1 symbols/min [2025-10-13T19:06:01.101900] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:01.149532] [DEBUG] [LOCAL ] GCI: Loaded 44675 existing records from primary storage. [2025-10-13T19:06:01.149983] [INFO ] [MAIN ] GCI: Loaded 44675 existing records. [2025-10-13T19:06:01.227351] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-13T19:06:01.359992] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:01.360375] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-13T19:06:01.360434] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-13T19:06:01.360935] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-13T19:06:01.360994] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-13T19:06:01.712369] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:06:01.774219] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:02.017979] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-13T19:06:02.817997] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-13T19:06:02.846359] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:06:03.085828] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:06:03.617976] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-13T19:06:04.081686] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:06:04.417967] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-13T19:06:05.210763] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:06:05.223931] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-13T19:06:05.957525] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:06:06.020020] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-13T19:06:06.026043] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:06:06.817993] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-13T19:06:07.541709] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:06:07.617944] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-13T19:06:08.135370] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:06:08.418029] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-13T19:06:09.217971] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-13T19:06:09.324345] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:06:09.453227] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:06:10.017987] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-13T19:06:10.767799] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:06:10.817931] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-13T19:06:11.396114] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:06:11.617967] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-13T19:06:12.417960] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-13T19:06:12.458163] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:06:13.095917] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:06:13.100842] [INFO ] [REMOTE ] GBCI: Full fetch complete (58656 records). [2025-10-13T19:06:13.100973] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-13T19:06:13.223096] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-13T19:06:13.479552] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-13T19:06:13.479632] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-13T19:06:13.480435] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-13T19:06:13.480512] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-13T19:06:13.481661] [DEBUG] [LOCAL ] GBCI: Trimmed 58656 records to 40690 (keeping 200 days of data) [2025-10-13T19:06:13.738044] [DEBUG] [LOCAL ] GBCI: Primary data saved (40690 records). [2025-10-13T19:06:13.738458] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-13T19:06:13.738672] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBCI took 42.9s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-13T19:06:13.909506] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:13.937308] [DEBUG] [LOCAL ] GCO: Loaded 24281 existing records from primary storage. [2025-10-13T19:06:13.937634] [INFO ] [MAIN ] GCO: Loaded 24281 existing records. [2025-10-13T19:06:14.019876] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-13T19:06:14.128282] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:14.128768] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-13T19:06:14.128848] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-13T19:06:14.154497] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-13T19:06:14.154434] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:06:14.154701] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-13T19:06:14.531897] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:14.772131] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:06:14.817888] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-13T19:06:15.387777] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:06:15.617952] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-13T19:06:16.223565] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:06:16.417965] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-13T19:06:17.117817] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:06:17.217960] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-13T19:06:17.880143] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:06:18.017950] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-13T19:06:18.467243] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T19:06:18.818076] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-13T19:06:19.417816] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:06:19.617990] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-13T19:06:20.417928] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-13T19:06:20.484915] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:06:20.988738] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:06:21.217956] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-13T19:06:21.629327] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:06:22.018020] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-13T19:06:22.499860] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T19:06:22.817958] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-13T19:06:22.898006] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T19:06:23.617943] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-13T19:06:23.952234] [DEBUG] [REMOTE ] GCO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T19:06:23.952561] [WARN ] [REMOTE ] GCO: No data returned for month 2025-02 [2025-10-13T19:06:23.952674] [FATAL] [REMOTE ] GCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:06:23.952760] [FATAL] [MAIN ] GCO: Failed to fetch primary data. [2025-10-13T19:06:23.952799] [WARN ] [MAIN ] GCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:06:23.952862] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-13T19:06:23.952924] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-13T19:06:23.952959] [INFO ] [LOCAL ] GCO: Starting deletion of derivative data. [2025-10-13T19:06:23.953194] [DEBUG] [LOCAL ] GCO: Deleted derivative data file. [2025-10-13T19:06:23.953280] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCO took 10.2s. Estimated remaining: 3h 26m 8s. Rate: 7.1 symbols/min [2025-10-13T19:06:24.169825] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:06:24.194433] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:24.231621] [DEBUG] [LOCAL ] GCTS: Loaded 20601 existing records from primary storage. [2025-10-13T19:06:24.232000] [INFO ] [MAIN ] GCTS: Loaded 20601 existing records. [2025-10-13T19:06:24.422377] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-13T19:06:24.477982] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:24.478715] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-13T19:06:24.478800] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-13T19:06:24.479218] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-13T19:06:24.479293] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-13T19:06:25.016619] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:25.218010] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-13T19:06:25.927508] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:06:25.931790] [INFO ] [REMOTE ] GBTG: Full fetch complete (56375 records). [2025-10-13T19:06:25.931954] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-13T19:06:26.023148] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-13T19:06:26.324312] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-13T19:06:26.324394] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-13T19:06:26.325132] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-13T19:06:26.325195] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-13T19:06:26.326274] [DEBUG] [LOCAL ] GBTG: Trimmed 56375 records to 40089 (keeping 200 days of data) [2025-10-13T19:06:26.551636] [DEBUG] [LOCAL ] GBTG: Primary data saved (40089 records). [2025-10-13T19:06:26.551798] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-13T19:06:26.551916] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GBTG took 36.7s. Estimated remaining: 3h 25m 50s. Rate: 7.1 symbols/min [2025-10-13T19:06:26.728205] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:26.738529] [DEBUG] [LOCAL ] GCV: Loaded 7736 existing records from primary storage. [2025-10-13T19:06:26.738756] [INFO ] [MAIN ] GCV: Loaded 7736 existing records. [2025-10-13T19:06:26.830558] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-13T19:06:26.950253] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:26.952236] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:06:26.961184] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-13T19:06:26.961414] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-13T19:06:26.962277] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-13T19:06:26.962338] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-13T19:06:27.276674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:06:27.339052] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:27.617892] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-13T19:06:27.899507] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:06:28.212549] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:06:28.417942] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-13T19:06:29.218065] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-13T19:06:29.773493] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:06:29.920161] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:06:30.017970] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-13T19:06:30.817948] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-13T19:06:30.981504] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:06:31.244171] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T19:06:31.618004] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-13T19:06:32.190343] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:06:32.418007] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-13T19:06:33.217994] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-13T19:06:34.017933] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-13T19:06:34.260818] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:06:34.275535] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:06:34.640403] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:06:34.817965] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-13T19:06:35.617949] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-13T19:06:36.374608] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:06:36.381793] [INFO ] [REMOTE ] GCI: Full fetch complete (63207 records). [2025-10-13T19:06:36.381932] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-13T19:06:36.423706] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-13T19:06:36.604441] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:06:36.794883] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-13T19:06:36.794960] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-13T19:06:36.795733] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-13T19:06:36.795794] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-13T19:06:36.797017] [DEBUG] [LOCAL ] GCI: Trimmed 63207 records to 43935 (keeping 200 days of data) [2025-10-13T19:06:37.058359] [DEBUG] [LOCAL ] GCI: Primary data saved (43935 records). [2025-10-13T19:06:37.058498] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-13T19:06:37.058591] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCI took 36.1s. Estimated remaining: 3h 25m 45s. Rate: 7.1 symbols/min [2025-10-13T19:06:37.229692] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:37.227180] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-13T19:06:37.248871] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T19:06:37.284101] [DEBUG] [LOCAL ] GD: Loaded 47478 existing records from primary storage. [2025-10-13T19:06:37.284417] [INFO ] [MAIN ] GD: Loaded 47478 existing records. [2025-10-13T19:06:37.454438] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:37.454662] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-13T19:06:37.454721] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-13T19:06:37.455156] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-13T19:06:37.455212] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-13T19:06:37.793916] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:37.950948] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:06:38.017889] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-13T19:06:38.817995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-13T19:06:39.080534] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T19:06:39.617938] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-13T19:06:40.027505] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:06:40.335219] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T19:06:40.417908] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-13T19:06:41.217931] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-13T19:06:41.606213] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:06:41.609302] [INFO ] [REMOTE ] GBX: Full fetch complete (42728 records). [2025-10-13T19:06:41.609383] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-13T19:06:41.975187] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-13T19:06:41.975397] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-13T19:06:41.976353] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-13T19:06:41.976419] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-13T19:06:41.977995] [DEBUG] [LOCAL ] GBX: Trimmed 42728 records to 29077 (keeping 200 days of data) [2025-10-13T19:06:42.035562] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-13T19:06:42.178177] [DEBUG] [LOCAL ] GBX: Primary data saved (29077 records). [2025-10-13T19:06:42.178427] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-13T19:06:42.178564] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GBX took 42.8s. Estimated remaining: 3h 25m 31s. Rate: 7.1 symbols/min [2025-10-13T19:06:42.356131] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:42.413714] [DEBUG] [LOCAL ] GDDY: Loaded 50527 existing records from primary storage. [2025-10-13T19:06:42.414178] [INFO ] [MAIN ] GDDY: Loaded 50527 existing records. [2025-10-13T19:06:42.624619] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:06:42.621742] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:42.630571] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-13T19:06:42.631191] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-13T19:06:42.632132] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-13T19:06:42.632196] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-13T19:06:42.828305] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-13T19:06:43.014366] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:43.617906] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-13T19:06:43.934870] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T19:06:44.300248] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:06:44.357180] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T19:06:44.417930] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-13T19:06:45.145766] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:06:45.217991] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-13T19:06:46.017951] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-13T19:06:46.817997] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-13T19:06:46.959953] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:06:46.981135] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T19:06:47.617972] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-13T19:06:47.890315] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:06:48.418002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-13T19:06:49.087063] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T19:06:49.217894] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-13T19:06:50.017984] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-13T19:06:50.169495] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T19:06:50.648478] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:06:50.817936] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-13T19:06:50.949689] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:06:51.589885] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:06:51.591476] [INFO ] [REMOTE ] GCV: Full fetch complete (9716 records). [2025-10-13T19:06:51.591543] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-13T19:06:51.623128] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-13T19:06:51.967244] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-13T19:06:51.967340] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-13T19:06:51.967759] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-13T19:06:51.967823] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-13T19:06:51.968350] [DEBUG] [LOCAL ] GCV: Trimmed 9716 records to 7706 (keeping 200 days of data) [2025-10-13T19:06:52.017196] [DEBUG] [LOCAL ] GCV: Primary data saved (7706 records). [2025-10-13T19:06:52.017363] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-13T19:06:52.017490] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GCV took 25.5s. Estimated remaining: 3h 25m 25s. Rate: 7.1 symbols/min [2025-10-13T19:06:52.231529] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:52.236962] [DEBUG] [LOCAL ] GDIV: Loaded 3659 existing records from primary storage. [2025-10-13T19:06:52.237146] [INFO ] [MAIN ] GDIV: Loaded 3659 existing records. [2025-10-13T19:06:52.422810] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-13T19:06:52.448824] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:52.449764] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-13T19:06:52.449827] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-13T19:06:52.449987] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-13T19:06:52.450043] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-13T19:06:52.840784] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:06:52.875328] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:53.217981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-13T19:06:53.940567] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:06:54.017935] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-13T19:06:54.382736] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:06:54.817924] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-13T19:06:55.120363] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T19:06:55.123517] [INFO ] [REMOTE ] GCTS: Full fetch complete (26890 records). [2025-10-13T19:06:55.123679] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-13T19:06:55.495702] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-13T19:06:55.495794] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-13T19:06:55.496285] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-13T19:06:55.496344] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-13T19:06:55.497001] [DEBUG] [LOCAL ] GCTS: Trimmed 26890 records to 20410 (keeping 200 days of data) [2025-10-13T19:06:55.610118] [DEBUG] [LOCAL ] GCTS: Primary data saved (20410 records). [2025-10-13T19:06:55.610251] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-13T19:06:55.610326] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GCTS took 31.7s. Estimated remaining: 3h 25m 9s. Rate: 7.1 symbols/min [2025-10-13T19:06:55.623139] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-13T19:06:55.780191] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:55.785168] [DEBUG] [LOCAL ] GDL: Loaded 2585 existing records from primary storage. [2025-10-13T19:06:55.785320] [INFO ] [MAIN ] GDL: Loaded 2585 existing records. [2025-10-13T19:06:55.955670] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:55.955890] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-13T19:06:55.955937] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-13T19:06:55.956112] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-13T19:06:55.956171] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-13T19:06:56.319544] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:56.314008] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:06:56.417899] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-13T19:06:56.570281] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T19:06:56.791780] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-13T19:06:57.218023] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-13T19:06:58.017974] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-13T19:06:58.482568] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T19:06:58.817973] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-13T19:06:58.865837] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:06:59.242781] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:06:59.618014] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-13T19:07:00.417986] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-13T19:07:01.217999] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-13T19:07:01.351228] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:07:01.785983] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T19:07:02.018013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-13T19:07:02.388562] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T19:07:02.393218] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T19:07:02.821218] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-13T19:07:03.617969] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-13T19:07:04.275454] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T19:07:04.417981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-13T19:07:04.576070] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:07:05.085578] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T19:07:05.217981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-13T19:07:05.762417] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:07:06.017951] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-13T19:07:06.387175] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T19:07:06.817938] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-13T19:07:07.361828] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T19:07:07.617985] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-13T19:07:08.057180] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T19:07:08.417994] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-13T19:07:08.892707] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-13T19:07:09.217998] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-13T19:07:10.017978] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-13T19:07:10.555402] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:07:10.819424] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-13T19:07:10.825736] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:07:11.617961] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-13T19:07:12.418053] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-13T19:07:12.685624] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T19:07:12.883913] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T19:07:13.217940] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-13T19:07:13.283486] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:07:13.681105] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:07:14.017976] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-13T19:07:14.597213] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:07:14.817973] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-13T19:07:15.617966] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-13T19:07:16.417936] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-13T19:07:16.673389] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T19:07:16.989896] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T19:07:16.991188] [INFO ] [REMOTE ] GDL: Full fetch complete (3484 records). [2025-10-13T19:07:16.991307] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-13T19:07:17.222355] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-13T19:07:17.534996] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-13T19:07:17.535140] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-13T19:07:17.535422] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-13T19:07:17.535676] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-13T19:07:17.536366] [DEBUG] [LOCAL ] GDL: Trimmed 3484 records to 2501 (keeping 200 days of data) [2025-10-13T19:07:17.557734] [DEBUG] [LOCAL ] GDL: Primary data saved (2501 records). [2025-10-13T19:07:17.558216] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-13T19:07:17.558433] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 21.9s. Estimated remaining: 3h 25m 22s. Rate: 7.1 symbols/min [2025-10-13T19:07:17.747816] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T19:07:17.866320] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:17.877845] [DEBUG] [LOCAL ] GDO: Loaded 5982 existing records from primary storage. [2025-10-13T19:07:17.878193] [INFO ] [MAIN ] GDO: Loaded 5982 existing records. [2025-10-13T19:07:18.023175] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-13T19:07:18.085215] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:18.085688] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-13T19:07:18.085778] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-13T19:07:18.086009] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-13T19:07:18.086067] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-13T19:07:18.474535] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:18.596067] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T19:07:18.817956] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-13T19:07:19.264464] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:07:19.617994] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-13T19:07:20.417936] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-13T19:07:20.508827] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:07:20.882884] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T19:07:21.217934] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-13T19:07:21.308554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:07:21.833501] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:07:22.017992] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-13T19:07:22.817975] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-13T19:07:23.617954] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-13T19:07:23.675054] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:07:23.681105] [INFO ] [REMOTE ] GDDY: Full fetch complete (71832 records). [2025-10-13T19:07:23.681298] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-13T19:07:24.100744] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-13T19:07:24.100871] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-13T19:07:24.101973] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-13T19:07:24.102040] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-13T19:07:24.103749] [DEBUG] [LOCAL ] GDDY: Trimmed 71832 records to 49810 (keeping 200 days of data) [2025-10-13T19:07:24.325252] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:07:24.415220] [DEBUG] [LOCAL ] GDDY: Primary data saved (49810 records). [2025-10-13T19:07:24.415356] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-13T19:07:24.416280] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 42.2s. Estimated remaining: 3h 25m 11s. Rate: 7.1 symbols/min [2025-10-13T19:07:24.427619] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-13T19:07:24.599965] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:24.596673] [DEBUG] [REMOTE ] GDIV: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T19:07:24.600909] [WARN ] [REMOTE ] GDIV: No data returned for month 2025-10 [2025-10-13T19:07:24.601029] [FATAL] [REMOTE ] GDIV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:07:24.601239] [FATAL] [MAIN ] GDIV: Failed to fetch primary data. [2025-10-13T19:07:24.601334] [WARN ] [MAIN ] GDIV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:07:24.601389] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-13T19:07:24.601563] [DEBUG] [LOCAL ] GDIV: No primary data file found to delete. [2025-10-13T19:07:24.601757] [INFO ] [LOCAL ] GDIV: Starting deletion of derivative data. [2025-10-13T19:07:24.611458] [DEBUG] [LOCAL ] GDIV: Deleted derivative data file. [2025-10-13T19:07:24.626733] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDIV took 32.6s. Estimated remaining: 3h 24m 50s. Rate: 7.1 symbols/min [2025-10-13T19:07:24.628840] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T19:07:24.831112] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:24.844452] [DEBUG] [LOCAL ] GDOT: Loaded 38316 existing records from primary storage. [2025-10-13T19:07:24.844827] [INFO ] [MAIN ] GDOT: Loaded 38316 existing records. [2025-10-13T19:07:25.028789] [DEBUG] [LOCAL ] GDV: Loaded 19886 existing records from primary storage. [2025-10-13T19:07:25.049211] [INFO ] [MAIN ] GDV: Loaded 19886 existing records. [2025-10-13T19:07:25.048875] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:25.096414] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-13T19:07:25.105491] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-13T19:07:25.129980] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-13T19:07:25.130054] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-13T19:07:25.229323] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-13T19:07:25.446010] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:25.512770] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-13T19:07:25.523996] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-13T19:07:25.549405] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-13T19:07:25.549508] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-13T19:07:25.770168] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:25.999529] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:26.017895] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-13T19:07:26.817962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-13T19:07:26.936537] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:07:26.941257] [INFO ] [REMOTE ] GD: Full fetch complete (69759 records). [2025-10-13T19:07:26.941384] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-13T19:07:27.113489] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T19:07:27.388405] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-13T19:07:27.388510] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-13T19:07:27.389419] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-13T19:07:27.389487] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-13T19:07:27.391006] [DEBUG] [LOCAL ] GD: Trimmed 69759 records to 46773 (keeping 200 days of data) [2025-10-13T19:07:27.490291] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T19:07:27.624026] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-13T19:07:27.704789] [DEBUG] [LOCAL ] GD: Primary data saved (46773 records). [2025-10-13T19:07:27.704931] [INFO ] [MAIN ] GD: Full history saved. [2025-10-13T19:07:27.705024] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GD took 50.6s. Estimated remaining: 3h 24m 33s. Rate: 7.1 symbols/min [2025-10-13T19:07:27.875976] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:27.924072] [DEBUG] [LOCAL ] GE: Loaded 54486 existing records from primary storage. [2025-10-13T19:07:27.924449] [INFO ] [MAIN ] GE: Loaded 54486 existing records. [2025-10-13T19:07:28.099302] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:28.099613] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-13T19:07:28.099696] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-13T19:07:28.100942] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-13T19:07:28.101002] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-13T19:07:28.423201] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-13T19:07:28.462523] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:28.988522] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:07:29.050675] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T19:07:29.217953] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-13T19:07:30.017979] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-13T19:07:30.475069] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T19:07:30.717873] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T19:07:30.817907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-13T19:07:31.507639] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:07:31.617976] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-13T19:07:32.418002] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-13T19:07:32.849315] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T19:07:33.218007] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-13T19:07:34.017908] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-13T19:07:34.584891] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-13T19:07:34.709141] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:07:34.739927] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:07:34.817959] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-13T19:07:35.617945] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-13T19:07:36.376396] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:07:36.417887] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-13T19:07:37.217887] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-13T19:07:37.702423] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T19:07:37.811689] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:07:37.886478] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:07:38.017907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-13T19:07:38.675418] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T19:07:38.817951] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-13T19:07:39.617978] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-13T19:07:40.216335] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:07:40.417940] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-13T19:07:41.217984] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-13T19:07:41.577363] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T19:07:41.838790] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:07:42.017888] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-13T19:07:42.118616] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:07:42.817995] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-13T19:07:43.419145] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T19:07:43.617901] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-13T19:07:43.856692] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:07:44.417962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-13T19:07:45.129815] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T19:07:45.217906] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-13T19:07:45.701741] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T19:07:45.826348] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T19:07:46.017945] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-13T19:07:46.817951] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-13T19:07:47.553182] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:07:47.617903] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-13T19:07:48.417972] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-13T19:07:49.003025] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T19:07:49.006925] [INFO ] [REMOTE ] GDOT: Full fetch complete (53120 records). [2025-10-13T19:07:49.007027] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-13T19:07:49.087180] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:07:49.119393] [INFO ] [REMOTE ] GDO: Full fetch complete (8639 records). [2025-10-13T19:07:49.158889] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-13T19:07:49.237304] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-13T19:07:49.602803] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-13T19:07:49.731109] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-13T19:07:49.741492] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-13T19:07:49.742352] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-13T19:07:49.742711] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-13T19:07:49.793691] [DEBUG] [LOCAL ] GDOT: Trimmed 53120 records to 37679 (keeping 200 days of data) [2025-10-13T19:07:49.821996] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-13T19:07:49.822087] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-13T19:07:49.822247] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-13T19:07:49.822322] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-13T19:07:49.823257] [DEBUG] [LOCAL ] GDO: Trimmed 8639 records to 5913 (keeping 200 days of data) [2025-10-13T19:07:49.943486] [DEBUG] [LOCAL ] GDO: Primary data saved (5913 records). [2025-10-13T19:07:49.944430] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-13T19:07:49.944844] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDO took 32.4s. Estimated remaining: 3h 24m 47s. Rate: 7.1 symbols/min [2025-10-13T19:07:50.022748] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-13T19:07:50.137753] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:50.209923] [DEBUG] [LOCAL ] GEF: Loaded 20991 existing records from primary storage. [2025-10-13T19:07:50.242238] [INFO ] [MAIN ] GEF: Loaded 20991 existing records. [2025-10-13T19:07:50.344330] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:07:50.457503] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:50.459290] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-13T19:07:50.459928] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-13T19:07:50.461657] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-13T19:07:50.461728] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-13T19:07:50.775323] [DEBUG] [LOCAL ] GDOT: Primary data saved (37679 records). [2025-10-13T19:07:50.792874] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-13T19:07:50.803701] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GDOT took 26.4s. Estimated remaining: 3h 24m 26s. Rate: 7.1 symbols/min [2025-10-13T19:07:50.824460] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-13T19:07:50.874246] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:51.016400] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:51.056873] [DEBUG] [LOCAL ] GEL: Loaded 32658 existing records from primary storage. [2025-10-13T19:07:51.057214] [INFO ] [MAIN ] GEL: Loaded 32658 existing records. [2025-10-13T19:07:51.236578] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:51.236864] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-13T19:07:51.236912] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-13T19:07:51.237551] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-13T19:07:51.237607] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-13T19:07:51.583220] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:51.617889] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-13T19:07:51.956890] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T19:07:52.419241] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-13T19:07:52.419128] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T19:07:52.845098] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:07:53.217966] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-13T19:07:53.411134] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T19:07:54.017947] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-13T19:07:54.545564] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:07:54.817959] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-13T19:07:55.174776] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:07:55.617959] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-13T19:07:56.417939] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-13T19:07:56.729405] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:07:56.911944] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T19:07:57.217936] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-13T19:07:57.519564] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:07:57.945575] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:07:58.017882] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-13T19:07:58.817996] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-13T19:07:58.960171] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:07:59.617978] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-13T19:08:00.418010] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-13T19:08:01.189055] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:08:01.217882] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-13T19:08:01.359973] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-13T19:08:01.457034] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:08:01.460102] [INFO ] [REMOTE ] GDV: Full fetch complete (28432 records). [2025-10-13T19:08:01.460242] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-13T19:08:01.849896] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-13T19:08:01.849981] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-13T19:08:01.850550] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-13T19:08:01.850593] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-13T19:08:01.851264] [DEBUG] [LOCAL ] GDV: Trimmed 28432 records to 19548 (keeping 200 days of data) [2025-10-13T19:08:01.971776] [DEBUG] [LOCAL ] GDV: Primary data saved (19548 records). [2025-10-13T19:08:01.971924] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-13T19:08:01.972004] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GDV took 37.3s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-13T19:08:02.025674] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-13T19:08:02.139582] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:02.191933] [DEBUG] [LOCAL ] GENI: Loaded 53716 existing records from primary storage. [2025-10-13T19:08:02.192270] [INFO ] [MAIN ] GENI: Loaded 53716 existing records. [2025-10-13T19:08:02.367785] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:02.368035] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-13T19:08:02.368085] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-13T19:08:02.369349] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-13T19:08:02.369418] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-13T19:08:02.748500] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:02.784306] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:08:02.817884] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-13T19:08:03.617980] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-13T19:08:04.018864] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:08:04.119866] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:08:04.417965] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-13T19:08:05.217946] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-13T19:08:05.295493] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:08:05.667342] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:08:06.017993] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-13T19:08:06.220034] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:08:06.818020] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-13T19:08:07.617970] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-13T19:08:08.237247] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-13T19:08:08.398164] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:08:08.417880] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-13T19:08:08.655966] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:08:09.217959] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-13T19:08:09.993076] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:08:10.018595] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-13T19:08:10.020763] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:08:10.026917] [INFO ] [REMOTE ] GE: Full fetch complete (77770 records). [2025-10-13T19:08:10.027078] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-13T19:08:10.472027] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-13T19:08:10.472124] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-13T19:08:10.473257] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-13T19:08:10.473331] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-13T19:08:10.474973] [DEBUG] [LOCAL ] GE: Trimmed 77770 records to 53706 (keeping 200 days of data) [2025-10-13T19:08:10.817966] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-13T19:08:10.838836] [DEBUG] [LOCAL ] GE: Primary data saved (53706 records). [2025-10-13T19:08:10.838939] [INFO ] [MAIN ] GE: Full history saved. [2025-10-13T19:08:10.839014] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GE took 43.1s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-13T19:08:11.013624] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:11.061865] [DEBUG] [LOCAL ] GEO: Loaded 52625 existing records from primary storage. [2025-10-13T19:08:11.062212] [INFO ] [MAIN ] GEO: Loaded 52625 existing records. [2025-10-13T19:08:11.251575] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:08:11.255270] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:11.259453] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-13T19:08:11.260145] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-13T19:08:11.261137] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-13T19:08:11.261195] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-13T19:08:11.614493] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:11.617881] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-13T19:08:12.417907] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-13T19:08:12.600804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:08:13.166042] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:08:13.217907] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-13T19:08:13.397115] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:08:14.017938] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-13T19:08:14.818028] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-13T19:08:15.129746] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:08:15.193897] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:08:15.617963] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-13T19:08:16.417935] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-13T19:08:16.494557] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:08:17.218005] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-13T19:08:17.425172] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:08:17.810687] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:08:18.017894] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-13T19:08:18.416361] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:08:18.817951] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-13T19:08:19.051822] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:08:19.617935] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-13T19:08:20.417901] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-13T19:08:20.628424] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:08:20.676667] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:08:21.217979] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-13T19:08:22.017955] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-13T19:08:22.238979] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:08:22.440044] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:08:22.817985] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-13T19:08:23.617998] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-13T19:08:23.665686] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:08:24.210320] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:08:24.417991] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-13T19:08:24.450201] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T19:08:24.454272] [INFO ] [REMOTE ] GEL: Full fetch complete (48173 records). [2025-10-13T19:08:24.454440] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-13T19:08:24.834780] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-13T19:08:24.834874] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-13T19:08:24.835581] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-13T19:08:24.835666] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-13T19:08:24.836732] [DEBUG] [LOCAL ] GEL: Trimmed 48173 records to 31996 (keeping 200 days of data) [2025-10-13T19:08:25.026378] [DEBUG] [LOCAL ] GEL: Primary data saved (31996 records). [2025-10-13T19:08:25.026521] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-13T19:08:25.027535] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GEL took 34.2s. Estimated remaining: 3h 24m 15s. Rate: 7.1 symbols/min [2025-10-13T19:08:25.195598] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:25.219052] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-13T19:08:25.236573] [DEBUG] [LOCAL ] GES: Loaded 39210 existing records from primary storage. [2025-10-13T19:08:25.236921] [INFO ] [MAIN ] GES: Loaded 39210 existing records. [2025-10-13T19:08:25.411258] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:25.411556] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-13T19:08:25.411704] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-13T19:08:25.412787] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-13T19:08:25.412857] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-13T19:08:25.760965] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:26.017905] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-13T19:08:26.279713] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:08:26.341437] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T19:08:26.817973] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-13T19:08:27.537576] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:08:27.618010] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-13T19:08:28.417902] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-13T19:08:28.613030] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:08:28.667406] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:08:29.218006] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-13T19:08:29.876449] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:08:30.018000] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-13T19:08:30.817970] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-13T19:08:31.181977] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:08:31.219587] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:08:31.617902] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-13T19:08:31.640358] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:08:31.642888] [INFO ] [REMOTE ] GEF: Full fetch complete (29301 records). [2025-10-13T19:08:31.642959] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-13T19:08:32.016586] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-13T19:08:32.016701] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-13T19:08:32.017286] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-13T19:08:32.017332] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-13T19:08:32.018231] [DEBUG] [LOCAL ] GEF: Trimmed 29301 records to 20781 (keeping 200 days of data) [2025-10-13T19:08:32.147010] [DEBUG] [LOCAL ] GEF: Primary data saved (20781 records). [2025-10-13T19:08:32.147154] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-13T19:08:32.147249] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEF took 42.2s. Estimated remaining: 3h 24m 5s. Rate: 7.1 symbols/min [2025-10-13T19:08:32.314083] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:32.349969] [DEBUG] [LOCAL ] GETY: Loaded 35855 existing records from primary storage. [2025-10-13T19:08:32.350256] [INFO ] [MAIN ] GETY: Loaded 35855 existing records. [2025-10-13T19:08:32.423131] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-13T19:08:32.527727] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:32.527992] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-13T19:08:32.528048] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-13T19:08:32.528722] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-13T19:08:32.528782] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-13T19:08:32.871401] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:33.217886] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-13T19:08:33.404372] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:08:33.990549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T19:08:34.017949] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-13T19:08:34.618915] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T19:08:34.817974] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-13T19:08:35.272548] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:08:35.617936] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-13T19:08:36.417951] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-13T19:08:36.815215] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-13T19:08:36.900345] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T19:08:37.217954] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-13T19:08:38.018003] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-13T19:08:38.352691] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T19:08:38.818011] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-13T19:08:39.120975] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T19:08:39.126438] [INFO ] [REMOTE ] GENI: Full fetch complete (75685 records). [2025-10-13T19:08:39.126578] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-13T19:08:39.533493] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-13T19:08:39.533592] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-13T19:08:39.534546] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-13T19:08:39.534608] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-13T19:08:39.536058] [DEBUG] [LOCAL ] GENI: Trimmed 75685 records to 52939 (keeping 200 days of data) [2025-10-13T19:08:39.621714] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-13T19:08:39.784822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:08:39.904044] [DEBUG] [LOCAL ] GENI: Primary data saved (52939 records). [2025-10-13T19:08:39.904216] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-13T19:08:39.904315] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GENI took 37.9s. Estimated remaining: 3h 23m 55s. Rate: 7.1 symbols/min [2025-10-13T19:08:40.417986] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-13T19:08:40.497435] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T19:08:41.217894] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-13T19:08:41.363977] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:08:41.651716] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T19:08:42.017991] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-13T19:08:42.817898] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-13T19:08:42.916499] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:08:42.921797] [INFO ] [REMOTE ] GEO: Full fetch complete (75431 records). [2025-10-13T19:08:42.921910] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-13T19:08:43.312638] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-13T19:08:43.312853] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-13T19:08:43.313821] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-13T19:08:43.313930] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-13T19:08:43.315565] [DEBUG] [LOCAL ] GEO: Trimmed 75431 records to 51877 (keeping 200 days of data) [2025-10-13T19:08:43.419509] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T19:08:43.628551] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-13T19:08:43.655024] [DEBUG] [LOCAL ] GEO: Primary data saved (51877 records). [2025-10-13T19:08:43.655124] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-13T19:08:43.655203] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GEO took 32.8s. Estimated remaining: 3h 23m 39s. Rate: 7.1 symbols/min [2025-10-13T19:08:43.969959] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:08:44.417996] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-13T19:08:45.155522] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:08:45.217884] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-13T19:08:45.762800] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T19:08:46.017966] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-13T19:08:46.617451] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:08:46.818028] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-13T19:08:47.618242] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T19:08:47.626234] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-13T19:08:48.317909] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:08:48.417900] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-13T19:08:49.143555] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:08:49.217897] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-13T19:08:49.357492] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:08:50.018005] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-13T19:08:50.592224] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:08:50.817893] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-13T19:08:51.394932] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T19:08:51.398722] [INFO ] [REMOTE ] GES: Full fetch complete (58820 records). [2025-10-13T19:08:51.398825] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-13T19:08:51.777744] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-13T19:08:51.777833] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-13T19:08:51.778617] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-13T19:08:51.778701] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-13T19:08:51.779970] [DEBUG] [LOCAL ] GES: Trimmed 58820 records to 38436 (keeping 200 days of data) [2025-10-13T19:08:52.016626] [DEBUG] [LOCAL ] GES: Primary data saved (38436 records). [2025-10-13T19:08:52.016844] [INFO ] [MAIN ] GES: Full history saved. [2025-10-13T19:08:52.017571] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GES took 27.0s. Estimated remaining: 3h 23m 31s. Rate: 7.1 symbols/min [2025-10-13T19:08:52.149108] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:08:52.156454] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-13T19:08:53.639436] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:08:53.643200] [INFO ] [REMOTE ] GETY: Full fetch complete (55412 records). [2025-10-13T19:08:53.643345] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-13T19:08:54.014308] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-13T19:08:54.014399] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-13T19:08:54.015140] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-13T19:08:54.015205] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-13T19:08:54.016897] [DEBUG] [LOCAL ] GETY: Trimmed 55412 records to 35067 (keeping 200 days of data) [2025-10-13T19:08:54.209543] [DEBUG] [LOCAL ] GETY: Primary data saved (35067 records). [2025-10-13T19:08:54.209711] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-13T19:08:54.209801] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GETY took 22.1s. Estimated remaining: 3h 23m 13s. Rate: 7.1 symbols/min [2025-10-13T19:08:54.850383] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.943318] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.949464] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.977362] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.981001] [DEBUG] [LOCAL ] GF: Loaded 2802 existing records from primary storage. [2025-10-13T19:08:54.981268] [INFO ] [MAIN ] GF: Loaded 2802 existing records. [2025-10-13T19:08:55.100544] [DEBUG] [LOCAL ] GFF: Loaded 30567 existing records from primary storage. [2025-10-13T19:08:55.127833] [INFO ] [MAIN ] GFF: Loaded 30567 existing records. [2025-10-13T19:08:55.242373] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:55.311817] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-13T19:08:55.312008] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-13T19:08:55.328326] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-13T19:08:55.355703] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-13T19:08:55.515825] [DEBUG] [LOCAL ] GEV: Loaded 53780 existing records from primary storage. [2025-10-13T19:08:55.490630] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:55.536719] [INFO ] [MAIN ] GEV: Loaded 53780 existing records. [2025-10-13T19:08:55.538042] [DEBUG] [LOCAL ] GFI: Loaded 53878 existing records from primary storage. [2025-10-13T19:08:55.570728] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-13T19:08:55.571215] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-13T19:08:55.561929] [INFO ] [MAIN ] GFI: Loaded 53878 existing records. [2025-10-13T19:08:55.622338] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-13T19:08:55.656190] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-13T19:08:56.194684] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:56.218471] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-13T19:08:56.218276] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:56.219049] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-13T19:08:56.219166] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-13T19:08:56.225821] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-13T19:08:56.241355] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-13T19:08:56.276481] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-13T19:08:56.332782] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-13T19:08:56.381714] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-13T19:08:56.434240] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:56.488876] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-13T19:08:56.953725] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:56.986295] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-13T19:08:57.274451] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:57.303813] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:57.308617] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-13T19:08:57.308900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-13T19:08:57.309550] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:08:57.312605] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-13T19:08:57.861359] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T19:08:57.862795] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-13T19:08:58.395760] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:08:58.407058] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-13T19:08:58.443348] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T19:08:58.444928] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-13T19:08:58.847347] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:08:58.857318] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-13T19:08:59.147955] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:08:59.563336] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-13T19:08:59.617879] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-13T19:08:59.734594] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:09:00.418073] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-13T19:09:01.217946] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-13T19:09:01.293502] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-13T19:09:02.017977] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-13T19:09:02.142970] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T19:09:02.143886] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T19:09:02.371949] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-13T19:09:02.818012] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-13T19:09:03.617899] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-13T19:09:03.650717] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:09:04.202099] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:09:04.417955] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-13T19:09:05.016420] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:09:05.217965] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-13T19:09:05.861083] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T19:09:06.017979] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-13T19:09:06.756098] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:09:06.817966] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-13T19:09:07.617940] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-13T19:09:08.074548] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:09:08.191372] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:09:08.417944] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-13T19:09:09.217907] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-13T19:09:09.456705] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:09:09.555859] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T19:09:10.018004] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-13T19:09:10.317794] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-13T19:09:10.707492] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-13T19:09:10.817899] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-13T19:09:11.617956] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-13T19:09:12.078740] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:09:12.097987] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:09:12.418004] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-13T19:09:13.217984] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-13T19:09:13.607937] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T19:09:14.017954] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-13T19:09:14.540587] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T19:09:14.817938] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-13T19:09:15.279422] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T19:09:15.280230] [INFO ] [REMOTE ] GF: Full fetch complete (4997 records). [2025-10-13T19:09:15.280296] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-13T19:09:15.626864] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-13T19:09:15.627191] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-13T19:09:15.627834] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-13T19:09:15.627985] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-13T19:09:15.628050] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-13T19:09:15.628442] [DEBUG] [LOCAL ] GF: Trimmed 4997 records to 2724 (keeping 200 days of data) [2025-10-13T19:09:15.645120] [DEBUG] [LOCAL ] GF: Primary data saved (2724 records). [2025-10-13T19:09:15.645185] [INFO ] [MAIN ] GF: Full history saved. [2025-10-13T19:09:15.645251] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GF took 21.4s. Estimated remaining: 3h 23m 25s. Rate: 7.1 symbols/min [2025-10-13T19:09:15.809669] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:15.859535] [DEBUG] [LOCAL ] GFL: Loaded 48588 existing records from primary storage. [2025-10-13T19:09:15.859917] [INFO ] [MAIN ] GFL: Loaded 48588 existing records. [2025-10-13T19:09:16.034174] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:16.034348] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-13T19:09:16.034415] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-13T19:09:16.034913] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-13T19:09:16.034969] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-13T19:09:16.384237] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:16.417875] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-13T19:09:16.459374] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-13T19:09:17.217885] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-13T19:09:17.661195] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:09:17.708569] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:09:18.017898] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-13T19:09:18.817957] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-13T19:09:19.300467] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T19:09:19.342165] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:09:19.617971] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-13T19:09:20.418038] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-13T19:09:20.748590] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T19:09:21.136028] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:09:21.217975] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-13T19:09:22.017955] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-13T19:09:22.701360] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:09:22.817884] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-13T19:09:22.939212] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-13T19:09:23.618028] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-13T19:09:23.674577] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:09:24.417998] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-13T19:09:24.505443] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T19:09:25.217965] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-13T19:09:25.774494] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T19:09:26.017959] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-13T19:09:26.379479] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T19:09:26.626689] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T19:09:26.817947] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-13T19:09:27.617957] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-13T19:09:28.204553] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T19:09:28.418040] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-13T19:09:28.599449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T19:09:28.777066] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T19:09:29.217993] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-13T19:09:30.018008] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-13T19:09:30.755081] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-13T19:09:30.761101] [INFO ] [REMOTE ] GEV: Full fetch complete (76901 records). [2025-10-13T19:09:30.761253] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-13T19:09:30.825196] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-13T19:09:31.079946] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:09:31.192127] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:09:31.217798] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-13T19:09:31.218002] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-13T19:09:31.218929] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-13T19:09:31.219011] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-13T19:09:31.219125] [INFO ] [REMOTE ] GFF: Full fetch complete (44011 records). [2025-10-13T19:09:31.219316] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-13T19:09:31.319047] [DEBUG] [LOCAL ] GEV: Trimmed 76901 records to 53002 (keeping 200 days of data) [2025-10-13T19:09:31.620609] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-13T19:09:31.701947] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-13T19:09:31.702366] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-13T19:09:31.703113] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-13T19:09:31.703453] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-13T19:09:31.708354] [DEBUG] [LOCAL ] GFF: Trimmed 44011 records to 30038 (keeping 200 days of data) [2025-10-13T19:09:32.028830] [DEBUG] [LOCAL ] GFF: Primary data saved (30038 records). [2025-10-13T19:09:32.029471] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-13T19:09:32.030698] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 37.8s. Estimated remaining: 3h 23m 29s. Rate: 7.1 symbols/min [2025-10-13T19:09:32.207823] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:32.227301] [DEBUG] [LOCAL ] GFR: Loaded 8021 existing records from primary storage. [2025-10-13T19:09:32.231577] [INFO ] [MAIN ] GFR: Loaded 8021 existing records. [2025-10-13T19:09:32.480747] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:32.488489] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-13T19:09:32.489337] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-13T19:09:32.491845] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-13T19:09:32.491922] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-13T19:09:32.588890] [DEBUG] [LOCAL ] GEV: Primary data saved (53002 records). [2025-10-13T19:09:32.599607] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-13T19:09:32.600027] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GEV took 38.4s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-10-13T19:09:32.960167] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:33.041033] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:33.042711] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-13T19:09:33.082886] [DEBUG] [LOCAL ] GGB: Loaded 51931 existing records from primary storage. [2025-10-13T19:09:33.083229] [INFO ] [MAIN ] GGB: Loaded 51931 existing records. [2025-10-13T19:09:33.263489] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:33.263870] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-13T19:09:33.264028] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-13T19:09:33.275800] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-13T19:09:33.290066] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-13T19:09:33.357868] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:09:33.428160] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-13T19:09:33.619765] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T19:09:33.708750] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:33.945135] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:09:34.017974] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-13T19:09:34.817968] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-13T19:09:35.615775] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:09:35.625147] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-13T19:09:35.675309] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-13T19:09:35.680982] [INFO ] [REMOTE ] GFI: Full fetch complete (76504 records). [2025-10-13T19:09:35.681098] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-13T19:09:36.067434] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-13T19:09:36.067525] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-13T19:09:36.068474] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-13T19:09:36.068542] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-13T19:09:36.069987] [DEBUG] [LOCAL ] GFI: Trimmed 76504 records to 53116 (keeping 200 days of data) [2025-10-13T19:09:36.392703] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-13T19:09:36.393015] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-13T19:09:36.393136] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 42.2s. Estimated remaining: 3h 22m 53s. Rate: 7.1 symbols/min [2025-10-13T19:09:36.429115] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-13T19:09:36.569798] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:36.603570] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:09:36.605486] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:09:36.651037] [DEBUG] [LOCAL ] GGG: Loaded 41367 existing records from primary storage. [2025-10-13T19:09:36.651357] [INFO ] [MAIN ] GGG: Loaded 41367 existing records. [2025-10-13T19:09:36.822564] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:36.822828] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-13T19:09:36.822875] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-13T19:09:36.823813] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-13T19:09:36.823870] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-13T19:09:37.170310] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:37.217957] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-13T19:09:37.996536] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:09:38.017943] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-13T19:09:38.761798] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T19:09:38.761554] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:09:38.817886] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-13T19:09:39.619520] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-13T19:09:39.621896] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T19:09:40.417951] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-13T19:09:41.217899] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-13T19:09:41.253915] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:09:41.286516] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:09:42.018014] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-13T19:09:42.664171] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:09:42.802544] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T19:09:42.817889] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-13T19:09:43.491477] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T19:09:43.617977] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-13T19:09:44.417990] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-13T19:09:45.171944] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:09:45.217990] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-13T19:09:45.826487] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T19:09:46.017973] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-13T19:09:46.205427] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T19:09:46.585683] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T19:09:46.818012] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-13T19:09:47.617983] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-13T19:09:48.219587] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T19:09:48.388390] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:09:48.417893] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-13T19:09:49.217950] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-13T19:09:50.017947] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-13T19:09:50.081389] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:09:50.417273] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:09:50.422417] [INFO ] [REMOTE ] GFL: Full fetch complete (69221 records). [2025-10-13T19:09:50.422549] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-13T19:09:50.815460] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:09:50.835746] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-13T19:09:50.819089] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-13T19:09:50.835892] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-13T19:09:50.837213] [INFO ] [REMOTE ] GFR: Full fetch complete (12316 records). [2025-10-13T19:09:50.837335] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-13T19:09:50.838246] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-13T19:09:50.839128] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-13T19:09:50.944425] [DEBUG] [LOCAL ] GFL: Trimmed 69221 records to 47788 (keeping 200 days of data) [2025-10-13T19:09:51.320006] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-13T19:09:51.320588] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-13T19:09:51.321164] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-13T19:09:51.321519] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-13T19:09:51.325454] [DEBUG] [LOCAL ] GFR: Trimmed 12316 records to 7832 (keeping 200 days of data) [2025-10-13T19:09:51.373858] [DEBUG] [LOCAL ] GFR: Primary data saved (7832 records). [2025-10-13T19:09:51.374483] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-13T19:09:51.375164] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GFR took 19.3s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-13T19:09:51.637882] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:51.634624] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-13T19:09:51.661575] [DEBUG] [LOCAL ] GGT: Loaded 14394 existing records from primary storage. [2025-10-13T19:09:51.662706] [INFO ] [MAIN ] GGT: Loaded 14394 existing records. [2025-10-13T19:09:51.854840] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:51.856329] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-13T19:09:51.856626] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-13T19:09:51.857519] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-13T19:09:51.857885] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-13T19:09:52.271607] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:52.273339] [DEBUG] [LOCAL ] GFL: Primary data saved (47788 records). [2025-10-13T19:09:52.273482] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-13T19:09:52.273590] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GFL took 36.6s. Estimated remaining: 3h 22m 34s. Rate: 7.1 symbols/min [2025-10-13T19:09:52.438416] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-13T19:09:52.441426] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:52.446511] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-10-13T19:09:52.446758] [INFO ] [MAIN ] GGZ: Loaded 2465 existing records. [2025-10-13T19:09:52.625683] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:52.626059] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-13T19:09:52.647466] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-13T19:09:52.648137] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-13T19:09:52.648198] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-13T19:09:52.648988] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T19:09:53.009150] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:53.057337] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:09:53.217896] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-13T19:09:53.319244] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:09:53.921370] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T19:09:54.017965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-13T19:09:54.817954] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-13T19:09:55.376868] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:09:55.617902] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-13T19:09:55.808037] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:09:56.084118] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T19:09:56.417938] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-13T19:09:57.217950] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-13T19:09:58.017999] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-13T19:09:58.142800] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:09:58.352734] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-13T19:09:58.700231] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:09:58.817894] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-13T19:09:59.617939] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-13T19:10:00.419842] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-13T19:10:00.423229] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:10:01.217944] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-13T19:10:01.284755] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:10:01.815387] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-13T19:10:02.017959] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-13T19:10:02.818005] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-13T19:10:03.486682] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T19:10:03.614835] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:10:03.618044] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-13T19:10:03.867167] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-13T19:10:04.417951] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-13T19:10:05.031091] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:10:05.217988] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-13T19:10:05.341096] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T19:10:06.018039] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-13T19:10:06.111464] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T19:10:06.322562] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-13T19:10:06.818047] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-13T19:10:07.618008] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-13T19:10:07.996944] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T19:10:08.137622] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T19:10:08.417912] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-13T19:10:09.214270] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:10:09.217795] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-13T19:10:10.017896] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-13T19:10:10.263300] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:10:10.817949] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-13T19:10:11.344957] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T19:10:11.617967] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-13T19:10:11.796328] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T19:10:12.417976] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-13T19:10:12.884955] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:10:13.148519] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T19:10:13.154377] [INFO ] [REMOTE ] GGG: Full fetch complete (59314 records). [2025-10-13T19:10:13.154606] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-13T19:10:13.223401] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-13T19:10:13.607188] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-13T19:10:13.607285] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-13T19:10:13.608190] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-13T19:10:13.608258] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-13T19:10:13.609550] [DEBUG] [LOCAL ] GGG: Trimmed 59314 records to 40761 (keeping 200 days of data) [2025-10-13T19:10:13.862270] [DEBUG] [LOCAL ] GGG: Primary data saved (40761 records). [2025-10-13T19:10:13.862411] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-13T19:10:13.862491] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 37.5s. Estimated remaining: 3h 22m 46s. Rate: 7.1 symbols/min [2025-10-13T19:10:14.025553] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-13T19:10:14.028245] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:14.033521] [DEBUG] [LOCAL ] GHC: Loaded 2905 existing records from primary storage. [2025-10-13T19:10:14.033882] [INFO ] [MAIN ] GHC: Loaded 2905 existing records. [2025-10-13T19:10:14.232916] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:14.233169] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-13T19:10:14.233217] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-13T19:10:14.233442] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-13T19:10:14.233500] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-13T19:10:14.582134] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:14.817904] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-13T19:10:14.993270] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:10:15.033348] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:10:15.115452] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-13T19:10:15.617940] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-13T19:10:16.417997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-13T19:10:16.544560] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:10:17.217962] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-13T19:10:17.887396] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:10:18.017910] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-13T19:10:18.367576] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T19:10:18.818015] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-13T19:10:18.910471] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T19:10:19.618032] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-13T19:10:20.416217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T19:10:20.421815] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-13T19:10:20.423850] [INFO ] [REMOTE ] GGB: Full fetch complete (74145 records). [2025-10-13T19:10:20.424120] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-13T19:10:20.577325] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T19:10:20.883094] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-13T19:10:20.883193] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-13T19:10:20.884104] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-13T19:10:20.884173] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-13T19:10:20.885680] [DEBUG] [LOCAL ] GGB: Trimmed 74145 records to 51339 (keeping 200 days of data) [2025-10-13T19:10:21.093378] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:10:21.095730] [INFO ] [REMOTE ] GGZ: Full fetch complete (4002 records). [2025-10-13T19:10:21.096082] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-13T19:10:21.218346] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-13T19:10:21.501604] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-13T19:10:21.502297] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-13T19:10:21.503051] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-13T19:10:21.503675] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-13T19:10:21.507213] [DEBUG] [LOCAL ] GGZ: Trimmed 4002 records to 2409 (keeping 200 days of data) [2025-10-13T19:10:21.527751] [DEBUG] [LOCAL ] GGZ: Primary data saved (2409 records). [2025-10-13T19:10:21.530116] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-13T19:10:21.530549] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 29.3s. Estimated remaining: 3h 22m 37s. Rate: 7.1 symbols/min [2025-10-13T19:10:21.738866] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:21.763697] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T19:10:21.772853] [DEBUG] [LOCAL ] GHG: Loaded 3294 existing records from primary storage. [2025-10-13T19:10:21.774332] [INFO ] [MAIN ] GHG: Loaded 3294 existing records. [2025-10-13T19:10:21.965486] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:21.972557] [DEBUG] [LOCAL ] GGB: Primary data saved (51339 records). [2025-10-13T19:10:21.972877] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-13T19:10:21.973134] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-13T19:10:21.973253] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-13T19:10:21.973475] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GGB took 49.4s. Estimated remaining: 3h 22m 16s. Rate: 7.1 symbols/min [2025-10-13T19:10:21.973831] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-13T19:10:22.021748] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-13T19:10:22.053547] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-13T19:10:22.277234] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:22.433211] [DEBUG] [LOCAL ] GHI: Loaded 7339 existing records from primary storage. [2025-10-13T19:10:22.449911] [INFO ] [MAIN ] GHI: Loaded 7339 existing records. [2025-10-13T19:10:22.702445] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:22.722593] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:22.722783] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-13T19:10:22.722832] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-13T19:10:22.723143] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-13T19:10:22.723217] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-13T19:10:22.823068] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-13T19:10:23.088431] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:23.167768] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:10:23.404238] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T19:10:23.617941] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-13T19:10:24.417905] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-13T19:10:24.624623] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:10:24.626901] [INFO ] [REMOTE ] GGT: Full fetch complete (18819 records). [2025-10-13T19:10:24.626970] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-13T19:10:24.915145] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-13T19:10:24.999997] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-13T19:10:25.000076] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-13T19:10:25.000467] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-13T19:10:25.000505] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-13T19:10:25.001092] [DEBUG] [LOCAL ] GGT: Trimmed 18819 records to 14336 (keeping 200 days of data) [2025-10-13T19:10:25.100456] [DEBUG] [LOCAL ] GGT: Primary data saved (14336 records). [2025-10-13T19:10:25.100604] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-13T19:10:25.100705] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GGT took 33.7s. Estimated remaining: 3h 21m 59s. Rate: 7.1 symbols/min [2025-10-13T19:10:25.223002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-13T19:10:25.271204] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:25.277283] [DEBUG] [LOCAL ] GHLD: Loaded 4263 existing records from primary storage. [2025-10-13T19:10:25.277491] [INFO ] [MAIN ] GHLD: Loaded 4263 existing records. [2025-10-13T19:10:25.457266] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:25.457492] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-13T19:10:25.457537] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-13T19:10:25.457748] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-13T19:10:25.457804] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-13T19:10:25.807059] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:26.017903] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-13T19:10:26.238930] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T19:10:26.312490] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-13T19:10:26.817949] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-13T19:10:27.494944] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T19:10:27.618013] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-13T19:10:28.110420] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T19:10:28.417965] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-13T19:10:29.111755] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T19:10:29.217976] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-13T19:10:29.648441] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T19:10:30.017972] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-13T19:10:30.602102] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T19:10:30.817973] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-13T19:10:31.297907] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T19:10:31.617993] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-13T19:10:32.197046] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:10:32.418005] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-13T19:10:33.044726] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:10:33.217938] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-13T19:10:33.921309] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:10:34.017977] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-13T19:10:34.685440] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:10:34.686635] [INFO ] [REMOTE ] GHC: Full fetch complete (3591 records). [2025-10-13T19:10:34.686737] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-13T19:10:34.823107] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-13T19:10:35.107576] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-13T19:10:35.107691] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-13T19:10:35.107955] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-13T19:10:35.108020] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-13T19:10:35.108416] [DEBUG] [LOCAL ] GHC: Trimmed 3591 records to 2904 (keeping 200 days of data) [2025-10-13T19:10:35.127054] [DEBUG] [LOCAL ] GHC: Primary data saved (2904 records). [2025-10-13T19:10:35.127139] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-13T19:10:35.127220] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHC took 21.3s. Estimated remaining: 3h 21m 53s. Rate: 7.1 symbols/min [2025-10-13T19:10:35.307688] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T19:10:35.311395] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:35.329613] [DEBUG] [LOCAL ] GHM: Loaded 14401 existing records from primary storage. [2025-10-13T19:10:35.329912] [INFO ] [MAIN ] GHM: Loaded 14401 existing records. [2025-10-13T19:10:35.511852] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:35.512167] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-13T19:10:35.512231] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-13T19:10:35.512521] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-13T19:10:35.512590] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-13T19:10:35.623295] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-13T19:10:35.899463] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:36.093662] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:10:36.417963] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-13T19:10:36.903545] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T19:10:37.217960] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-13T19:10:37.680382] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:10:38.017951] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-13T19:10:38.746930] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T19:10:38.817908] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-13T19:10:39.503823] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:10:39.617966] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-13T19:10:40.417981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-13T19:10:40.611099] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:10:40.848525] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T19:10:41.217961] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-13T19:10:41.810067] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:10:42.017937] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-13T19:10:42.434781] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:10:42.817902] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-13T19:10:43.434149] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:10:43.617941] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-13T19:10:44.298627] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:10:44.417982] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-13T19:10:45.054321] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:10:45.217892] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-13T19:10:45.809857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T19:10:45.810896] [INFO ] [REMOTE ] GHLD: Full fetch complete (4936 records). [2025-10-13T19:10:45.810984] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-13T19:10:46.023154] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-13T19:10:46.170315] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-13T19:10:46.170395] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-13T19:10:46.170551] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-13T19:10:46.170590] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-13T19:10:46.170978] [DEBUG] [LOCAL ] GHLD: Trimmed 4936 records to 4242 (keeping 200 days of data) [2025-10-13T19:10:46.196177] [DEBUG] [LOCAL ] GHLD: Primary data saved (4242 records). [2025-10-13T19:10:46.196252] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-13T19:10:46.196363] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 21.1s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-13T19:10:46.371028] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:46.393088] [DEBUG] [LOCAL ] GHY: Loaded 21183 existing records from primary storage. [2025-10-13T19:10:46.393369] [INFO ] [MAIN ] GHY: Loaded 21183 existing records. [2025-10-13T19:10:46.572482] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:46.572815] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-13T19:10:46.572872] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-13T19:10:46.574071] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-13T19:10:46.574131] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-13T19:10:46.754524] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:10:46.823817] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-13T19:10:46.946806] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:47.607564] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:10:47.617877] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-13T19:10:48.360581] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T19:10:48.417881] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-13T19:10:49.151961] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T19:10:49.217908] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-13T19:10:50.017991] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-13T19:10:50.146416] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T19:10:50.817901] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-13T19:10:50.856344] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:10:50.857834] [INFO ] [REMOTE ] GHI: Full fetch complete (11307 records). [2025-10-13T19:10:50.857903] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-13T19:10:51.203103] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-13T19:10:51.203235] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-13T19:10:51.203539] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-13T19:10:51.203578] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-13T19:10:51.204038] [DEBUG] [LOCAL ] GHI: Trimmed 11307 records to 7235 (keeping 200 days of data) [2025-10-13T19:10:51.248195] [DEBUG] [LOCAL ] GHI: Primary data saved (7235 records). [2025-10-13T19:10:51.248325] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-13T19:10:51.248425] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHI took 29.3s. Estimated remaining: 3h 21m 35s. Rate: 7.1 symbols/min [2025-10-13T19:10:51.413246] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:51.446999] [DEBUG] [LOCAL ] GIB: Loaded 32258 existing records from primary storage. [2025-10-13T19:10:51.447293] [INFO ] [MAIN ] GIB: Loaded 32258 existing records. [2025-10-13T19:10:51.623286] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-13T19:10:51.626442] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:51.627693] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-13T19:10:51.627759] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-13T19:10:51.628572] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-13T19:10:51.628633] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-13T19:10:51.976868] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:10:52.007516] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:52.417900] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-13T19:10:52.802102] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T19:10:53.211768] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T19:10:53.217869] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-13T19:10:54.017900] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-13T19:10:54.414975] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T19:10:54.826577] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-13T19:10:54.827493] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:10:55.617932] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-13T19:10:56.149565] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:10:56.417903] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-13T19:10:56.766545] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T19:10:57.217914] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-13T19:10:57.674479] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T19:10:57.831932] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T19:10:58.017888] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-13T19:10:58.817942] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-13T19:10:59.386577] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T19:10:59.464117] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:10:59.617965] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-13T19:11:00.417988] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-13T19:11:00.967046] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:11:01.217933] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-13T19:11:01.558187] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:11:02.017980] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-13T19:11:02.325090] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T19:11:02.817961] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-13T19:11:03.301627] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T19:11:03.397232] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T19:11:03.617953] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-13T19:11:04.417958] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-13T19:11:04.441461] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T19:11:05.217987] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-13T19:11:05.675011] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T19:11:05.857121] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:11:06.017956] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-13T19:11:06.600990] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T19:11:06.817947] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-13T19:11:07.614770] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T19:11:07.617976] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-13T19:11:08.417982] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-13T19:11:08.978273] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:11:09.217940] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-13T19:11:09.378636] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:11:10.017983] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-13T19:11:10.376488] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T19:11:10.817986] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-13T19:11:11.042498] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T19:11:11.617900] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-13T19:11:11.910192] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:11:12.090768] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:11:12.417993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-13T19:11:13.003411] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T19:11:13.217954] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-13T19:11:13.852796] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:11:13.853819] [INFO ] [REMOTE ] GHG: Full fetch complete (4145 records). [2025-10-13T19:11:13.853886] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-13T19:11:14.030918] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-13T19:11:14.218637] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-13T19:11:14.218796] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-13T19:11:14.218950] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-13T19:11:14.218988] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-13T19:11:14.219361] [DEBUG] [LOCAL ] GHG: Trimmed 4145 records to 3279 (keeping 200 days of data) [2025-10-13T19:11:14.237809] [DEBUG] [LOCAL ] GHG: Primary data saved (3279 records). [2025-10-13T19:11:14.237973] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-13T19:11:14.238090] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHG took 52.7s. Estimated remaining: 3h 21m 50s. Rate: 7.1 symbols/min [2025-10-13T19:11:14.408246] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:14.423813] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-13T19:11:14.424025] [INFO ] [MAIN ] GIC: Loaded 13577 existing records. [2025-10-13T19:11:14.597443] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:14.597668] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-13T19:11:14.597729] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-13T19:11:14.598189] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-13T19:11:14.598247] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-13T19:11:14.823210] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-13T19:11:14.963549] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:15.092011] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:11:15.617947] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-13T19:11:16.363134] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:11:16.417943] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-13T19:11:16.532341] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T19:11:17.217910] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-13T19:11:17.516439] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T19:11:18.017945] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-13T19:11:18.466867] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T19:11:18.473749] [INFO ] [REMOTE ] GIB: Full fetch complete (45706 records). [2025-10-13T19:11:18.473878] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-13T19:11:18.823030] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-13T19:11:18.859096] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-13T19:11:18.859342] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-13T19:11:18.860145] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-13T19:11:18.860323] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-13T19:11:18.861418] [DEBUG] [LOCAL ] GIB: Trimmed 45706 records to 31605 (keeping 200 days of data) [2025-10-13T19:11:19.053496] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:11:19.075834] [DEBUG] [LOCAL ] GIB: Primary data saved (31605 records). [2025-10-13T19:11:19.075963] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-13T19:11:19.076046] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 27.8s. Estimated remaining: 3h 21m 36s. Rate: 7.1 symbols/min [2025-10-13T19:11:19.247682] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:19.287143] [DEBUG] [LOCAL ] GIL: Loaded 44393 existing records from primary storage. [2025-10-13T19:11:19.287480] [INFO ] [MAIN ] GIL: Loaded 44393 existing records. [2025-10-13T19:11:19.465768] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:19.466010] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-13T19:11:19.466055] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-13T19:11:19.467187] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-13T19:11:19.467244] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-13T19:11:19.621801] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-13T19:11:19.819430] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:19.828325] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T19:11:20.418011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-13T19:11:20.816561] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:11:21.217949] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-13T19:11:21.811935] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:11:22.017960] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-13T19:11:22.118438] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:11:22.818017] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-13T19:11:23.110765] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:11:23.618017] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-13T19:11:23.801099] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:11:24.418004] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-13T19:11:24.671095] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:11:24.673213] [INFO ] [REMOTE ] GHM: Full fetch complete (21997 records). [2025-10-13T19:11:24.673283] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-13T19:11:25.036254] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-13T19:11:25.036362] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-13T19:11:25.036892] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-13T19:11:25.036957] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-13T19:11:25.037514] [DEBUG] [LOCAL ] GHM: Trimmed 21997 records to 14248 (keeping 200 days of data) [2025-10-13T19:11:25.119870] [DEBUG] [LOCAL ] GHM: Primary data saved (14248 records). [2025-10-13T19:11:25.120005] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-13T19:11:25.120129] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GHM took 50.0s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-13T19:11:25.218866] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-13T19:11:25.287547] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:25.338095] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-13T19:11:25.338460] [INFO ] [MAIN ] GIS: Loaded 54452 existing records. [2025-10-13T19:11:25.516137] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:25.516430] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-13T19:11:25.516492] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-13T19:11:25.518052] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-13T19:11:25.518136] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-13T19:11:25.871510] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:25.891603] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:11:26.017947] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-13T19:11:26.214757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T19:11:26.817958] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-13T19:11:27.445896] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:11:27.617904] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-13T19:11:27.791860] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:11:28.418004] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-13T19:11:29.217909] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-13T19:11:29.470776] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:11:29.557347] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T19:11:30.017912] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-13T19:11:30.187099] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T19:11:30.817944] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-13T19:11:31.613022] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:11:31.621787] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-13T19:11:31.668313] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T19:11:32.417934] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-13T19:11:33.217898] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-13T19:11:33.416898] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:11:33.987176] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:11:34.019221] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-13T19:11:34.020958] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:11:34.817903] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-13T19:11:35.074026] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:11:35.076915] [INFO ] [REMOTE ] GHY: Full fetch complete (32345 records). [2025-10-13T19:11:35.076991] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-13T19:11:35.447848] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-13T19:11:35.447962] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-13T19:11:35.448610] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-13T19:11:35.448691] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-13T19:11:35.449715] [DEBUG] [LOCAL ] GHY: Trimmed 32345 records to 20868 (keeping 200 days of data) [2025-10-13T19:11:35.576979] [DEBUG] [LOCAL ] GHY: Primary data saved (20868 records). [2025-10-13T19:11:35.577099] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-13T19:11:35.577173] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GHY took 49.4s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-10-13T19:11:35.623229] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-13T19:11:35.747083] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:35.789127] [DEBUG] [LOCAL ] GKOS: Loaded 43125 existing records from primary storage. [2025-10-13T19:11:35.789424] [INFO ] [MAIN ] GKOS: Loaded 43125 existing records. [2025-10-13T19:11:35.962009] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:35.962255] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-13T19:11:35.962301] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-13T19:11:35.963253] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-13T19:11:35.963309] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-13T19:11:36.322475] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:36.394988] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:11:36.417888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-13T19:11:37.069467] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:11:37.217899] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-13T19:11:38.017981] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-13T19:11:38.333274] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:11:38.820256] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-13T19:11:38.840276] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T19:11:38.850837] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:11:39.617957] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-13T19:11:40.417945] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-13T19:11:40.776333] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:11:40.997098] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:11:41.217994] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-13T19:11:42.004209] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:11:42.017882] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-13T19:11:42.817964] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-13T19:11:43.262663] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T19:11:43.363862] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:11:43.368600] [INFO ] [REMOTE ] GIL: Full fetch complete (61936 records). [2025-10-13T19:11:43.368746] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-13T19:11:43.618722] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-13T19:11:43.589833] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:11:43.789120] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-13T19:11:43.789252] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-13T19:11:43.790082] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-13T19:11:43.790145] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-13T19:11:43.791409] [DEBUG] [LOCAL ] GIL: Trimmed 61936 records to 43786 (keeping 200 days of data) [2025-10-13T19:11:44.056185] [DEBUG] [LOCAL ] GIL: Primary data saved (43786 records). [2025-10-13T19:11:44.056328] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-13T19:11:44.056477] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIL took 25.0s. Estimated remaining: 3h 21m 10s. Rate: 7.1 symbols/min [2025-10-13T19:11:44.223778] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:44.259268] [DEBUG] [LOCAL ] GL: Loaded 38358 existing records from primary storage. [2025-10-13T19:11:44.259583] [INFO ] [MAIN ] GL: Loaded 38358 existing records. [2025-10-13T19:11:44.432231] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-13T19:11:44.436816] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:44.437794] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-13T19:11:44.437847] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-13T19:11:44.438800] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-13T19:11:44.438856] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-13T19:11:44.792448] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:45.217898] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-13T19:11:45.410502] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:11:45.984929] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:11:46.017905] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-13T19:11:46.812681] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:11:46.820784] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-13T19:11:47.433221] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:11:47.617912] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-13T19:11:48.417900] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-13T19:11:48.475839] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T19:11:48.539150] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:11:49.217915] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-13T19:11:49.885112] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:11:50.003516] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T19:11:50.005148] [INFO ] [REMOTE ] GIC: Full fetch complete (19995 records). [2025-10-13T19:11:50.005217] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-13T19:11:50.025562] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-13T19:11:50.390639] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-13T19:11:50.390767] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-13T19:11:50.391343] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-13T19:11:50.391390] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-13T19:11:50.392203] [DEBUG] [LOCAL ] GIC: Trimmed 19995 records to 13429 (keeping 200 days of data) [2025-10-13T19:11:50.486358] [DEBUG] [LOCAL ] GIC: Primary data saved (13429 records). [2025-10-13T19:11:50.486527] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-13T19:11:50.486626] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIC took 36.2s. Estimated remaining: 3h 20m 58s. Rate: 7.1 symbols/min [2025-10-13T19:11:50.653187] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:50.699154] [DEBUG] [LOCAL ] GLOB: Loaded 48507 existing records from primary storage. [2025-10-13T19:11:50.699495] [INFO ] [MAIN ] GLOB: Loaded 48507 existing records. [2025-10-13T19:11:50.823061] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-13T19:11:50.901784] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:50.902091] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-13T19:11:50.902138] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-13T19:11:50.903290] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-13T19:11:50.903347] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-13T19:11:51.247471] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:51.617950] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-13T19:11:52.164044] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T19:11:52.417952] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-13T19:11:52.976617] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-13T19:11:53.160089] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:11:53.217906] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-13T19:11:53.894935] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:11:54.017911] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-13T19:11:54.693906] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:11:54.817908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-13T19:11:55.592185] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:11:55.617889] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-13T19:11:56.173444] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:11:56.417908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-13T19:11:57.217947] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-13T19:11:57.339448] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:11:57.968151] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:11:58.017893] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-13T19:11:58.642320] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:11:58.817999] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-13T19:11:59.625130] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-13T19:11:59.627627] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:12:00.413003] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:12:00.421226] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-13T19:12:01.217950] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-13T19:12:01.310307] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:12:02.017975] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-13T19:12:02.507469] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-13T19:12:02.778940] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:12:02.817883] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-13T19:12:03.468138] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:12:03.617892] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-13T19:12:04.403562] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:12:04.417878] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-13T19:12:05.217901] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-13T19:12:05.292621] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:12:06.017907] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-13T19:12:06.110066] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:12:06.323807] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:12:06.329761] [INFO ] [REMOTE ] GIS: Full fetch complete (77657 records). [2025-10-13T19:12:06.329906] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-13T19:12:06.744489] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-13T19:12:06.744576] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-13T19:12:06.745482] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-13T19:12:06.745546] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-13T19:12:06.746972] [DEBUG] [LOCAL ] GIS: Trimmed 77657 records to 53672 (keeping 200 days of data) [2025-10-13T19:12:06.837372] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-13T19:12:07.084304] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-13T19:12:07.084453] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-13T19:12:07.084533] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GIS took 42.0s. Estimated remaining: 3h 21m 2s. Rate: 7.1 symbols/min [2025-10-13T19:12:07.253326] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:07.264151] [DEBUG] [LOCAL ] GLP: Loaded 9370 existing records from primary storage. [2025-10-13T19:12:07.264383] [INFO ] [MAIN ] GLP: Loaded 9370 existing records. [2025-10-13T19:12:07.443180] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:07.443508] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-13T19:12:07.443576] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-13T19:12:07.443983] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-13T19:12:07.444078] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-13T19:12:07.632055] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-13T19:12:07.742091] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T19:12:07.843582] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:08.302266] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:12:08.306582] [INFO ] [REMOTE ] GKOS: Full fetch complete (60138 records). [2025-10-13T19:12:08.306721] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-13T19:12:08.423039] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-13T19:12:08.689528] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-13T19:12:08.689613] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-13T19:12:08.690400] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-13T19:12:08.690485] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-13T19:12:08.691637] [DEBUG] [LOCAL ] GKOS: Trimmed 60138 records to 42521 (keeping 200 days of data) [2025-10-13T19:12:08.939930] [DEBUG] [LOCAL ] GKOS: Primary data saved (42521 records). [2025-10-13T19:12:08.940073] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-13T19:12:08.940948] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GKOS took 33.4s. Estimated remaining: 3h 20m 44s. Rate: 7.1 symbols/min [2025-10-13T19:12:09.117235] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:09.170060] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-13T19:12:09.170535] [INFO ] [MAIN ] GLW: Loaded 54416 existing records. [2025-10-13T19:12:09.223100] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-13T19:12:09.332002] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T19:12:09.368268] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:09.371401] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-13T19:12:09.371541] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-13T19:12:09.383216] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-13T19:12:09.398047] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-13T19:12:09.452011] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:12:09.761781] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:10.018004] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-13T19:12:10.639227] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:12:10.817913] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-13T19:12:11.617903] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-13T19:12:11.890462] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:12:12.289692] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:12:12.417897] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-13T19:12:12.647443] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T19:12:13.206867] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:12:13.217870] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-13T19:12:14.017969] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-13T19:12:14.225212] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:12:14.817994] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-13T19:12:15.543590] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:12:15.617895] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-13T19:12:16.417991] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-13T19:12:16.925586] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T19:12:17.121222] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:12:17.217946] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-13T19:12:18.017911] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-13T19:12:18.057591] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:12:18.725832] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:12:18.747169] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:12:18.817888] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-13T19:12:19.618001] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-13T19:12:20.118750] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T19:12:20.123326] [INFO ] [REMOTE ] GL: Full fetch complete (55143 records). [2025-10-13T19:12:20.123424] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-13T19:12:20.423092] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-13T19:12:20.479787] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T19:12:20.518842] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-13T19:12:20.518904] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-13T19:12:20.519597] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-13T19:12:20.519635] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-13T19:12:20.520693] [DEBUG] [LOCAL ] GL: Trimmed 55143 records to 37661 (keeping 200 days of data) [2025-10-13T19:12:20.758518] [DEBUG] [LOCAL ] GL: Primary data saved (37661 records). [2025-10-13T19:12:20.758689] [INFO ] [MAIN ] GL: Full history saved. [2025-10-13T19:12:20.758782] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GL took 36.7s. Estimated remaining: 3h 20m 41s. Rate: 7.1 symbols/min [2025-10-13T19:12:20.926000] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:20.977609] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-13T19:12:20.981140] [INFO ] [MAIN ] GM: Loaded 54509 existing records. [2025-10-13T19:12:21.156243] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:21.156460] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-13T19:12:21.156505] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-13T19:12:21.157267] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-13T19:12:21.157333] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-13T19:12:21.223192] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-13T19:12:21.504773] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:22.017898] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-13T19:12:22.103074] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:12:22.108130] [INFO ] [REMOTE ] GLOB: Full fetch complete (65026 records). [2025-10-13T19:12:22.108238] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-13T19:12:22.489221] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-13T19:12:22.489313] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-13T19:12:22.490132] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-13T19:12:22.490245] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-13T19:12:22.492107] [DEBUG] [LOCAL ] GLOB: Trimmed 65026 records to 47959 (keeping 200 days of data) [2025-10-13T19:12:22.779217] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T19:12:22.790151] [DEBUG] [LOCAL ] GLOB: Primary data saved (47959 records). [2025-10-13T19:12:22.790245] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-13T19:12:22.790410] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLOB took 32.3s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-13T19:12:22.823705] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-13T19:12:22.972839] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:23.001338] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T19:12:23.055954] [DEBUG] [LOCAL ] GME: Loaded 54563 existing records from primary storage. [2025-10-13T19:12:23.056324] [INFO ] [MAIN ] GME: Loaded 54563 existing records. [2025-10-13T19:12:23.232230] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:23.232464] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-13T19:12:23.232509] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-13T19:12:23.233598] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-13T19:12:23.233695] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-13T19:12:23.585430] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:23.617905] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-13T19:12:24.417946] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-13T19:12:25.084319] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-13T19:12:25.217944] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-13T19:12:26.023186] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-13T19:12:26.026585] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:12:26.402810] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-13T19:12:26.428424] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T19:12:26.817907] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-13T19:12:27.297693] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T19:12:27.617900] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-13T19:12:28.415474] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:12:28.418148] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-13T19:12:28.675382] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:12:29.217949] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-13T19:12:30.017948] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-13T19:12:30.817992] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-13T19:12:31.004635] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-13T19:12:31.204719] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:12:31.600906] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T19:12:31.617882] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-13T19:12:31.862039] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T19:12:32.375115] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T19:12:32.376533] [INFO ] [REMOTE ] GLP: Full fetch complete (14256 records). [2025-10-13T19:12:32.376600] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-13T19:12:32.428137] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-13T19:12:32.779867] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-13T19:12:32.779969] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-13T19:12:32.780543] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-13T19:12:32.780667] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-13T19:12:32.781239] [DEBUG] [LOCAL ] GLP: Trimmed 14256 records to 9245 (keeping 200 days of data) [2025-10-13T19:12:32.842748] [DEBUG] [LOCAL ] GLP: Primary data saved (9245 records). [2025-10-13T19:12:32.842907] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-13T19:12:32.842994] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLP took 25.8s. Estimated remaining: 3h 20m 17s. Rate: 7.1 symbols/min [2025-10-13T19:12:33.019442] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:33.062172] [DEBUG] [LOCAL ] GMED: Loaded 49041 existing records from primary storage. [2025-10-13T19:12:33.062508] [INFO ] [MAIN ] GMED: Loaded 49041 existing records. [2025-10-13T19:12:33.226027] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-13T19:12:33.263201] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:33.263537] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-13T19:12:33.263591] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-13T19:12:33.264733] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-13T19:12:33.264818] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-13T19:12:33.636603] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:34.017996] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-13T19:12:34.817980] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-13T19:12:34.938251] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-13T19:12:35.510201] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T19:12:35.617881] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-13T19:12:35.827595] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T19:12:35.924855] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T19:12:36.417958] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-13T19:12:37.218036] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-13T19:12:37.351328] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:12:38.017983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-13T19:12:38.072193] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:12:38.817915] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-13T19:12:39.093300] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:12:39.617966] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-13T19:12:40.421746] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-13T19:12:40.441388] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:12:40.519268] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-13T19:12:41.217900] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-13T19:12:41.625426] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T19:12:42.018010] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-13T19:12:42.456027] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:12:42.817954] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-13T19:12:43.571437] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T19:12:43.617986] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-13T19:12:43.674184] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:12:44.417999] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-13T19:12:45.095469] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T19:12:45.222192] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-13T19:12:45.594410] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T19:12:45.911329] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:12:45.918704] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-13T19:12:45.918909] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-13T19:12:46.018146] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-13T19:12:46.359090] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:12:46.393815] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-13T19:12:46.394267] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-13T19:12:46.395766] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-13T19:12:46.395855] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-13T19:12:46.399564] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 53636 (keeping 200 days of data) [2025-10-13T19:12:46.739257] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-13T19:12:46.739404] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-13T19:12:46.740302] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GLW took 37.8s. Estimated remaining: 3h 20m 17s. Rate: 7.1 symbols/min [2025-10-13T19:12:46.823099] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-13T19:12:46.917372] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:46.957111] [DEBUG] [LOCAL ] GMRE: Loaded 37595 existing records from primary storage. [2025-10-13T19:12:46.957482] [INFO ] [MAIN ] GMRE: Loaded 37595 existing records. [2025-10-13T19:12:47.135839] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:47.136072] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-13T19:12:47.136121] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-13T19:12:47.136685] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-13T19:12:47.136757] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-13T19:12:47.500748] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:47.617947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-13T19:12:48.417977] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-13T19:12:48.640068] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-13T19:12:48.723264] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T19:12:48.760747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:12:49.217991] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-13T19:12:50.017912] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-13T19:12:50.115695] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:12:50.493087] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T19:12:50.817986] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-13T19:12:51.617977] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-13T19:12:52.094113] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T19:12:52.417912] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-13T19:12:52.457268] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-13T19:12:53.217951] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-13T19:12:53.641891] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T19:12:53.802009] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:12:54.018029] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-13T19:12:54.817913] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-13T19:12:55.290101] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T19:12:55.411725] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-13T19:12:55.617880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-13T19:12:56.417916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-13T19:12:56.895370] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T19:12:57.217982] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-13T19:12:57.998978] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:12:58.017881] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-13T19:12:58.087153] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-13T19:12:58.116538] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:12:58.123079] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-13T19:12:58.123316] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-13T19:12:58.555032] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-13T19:12:58.555155] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-13T19:12:58.556690] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-13T19:12:58.556769] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-13T19:12:58.560793] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-13T19:12:58.826699] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-13T19:12:58.919309] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-13T19:12:58.919512] [INFO ] [MAIN ] GM: Full history saved. [2025-10-13T19:12:58.919670] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GM took 38.2s. Estimated remaining: 3h 20m 14s. Rate: 7.1 symbols/min [2025-10-13T19:12:59.093920] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:59.116053] [DEBUG] [LOCAL ] GNE: Loaded 18049 existing records from primary storage. [2025-10-13T19:12:59.116366] [INFO ] [MAIN ] GNE: Loaded 18049 existing records. [2025-10-13T19:12:59.315429] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:59.315747] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-13T19:12:59.315804] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-13T19:12:59.316157] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-13T19:12:59.316215] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-13T19:12:59.621427] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-13T19:12:59.695393] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:59.728274] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:13:00.417972] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-13T19:13:01.217985] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-13T19:13:01.357452] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:13:01.578929] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-13T19:13:01.734132] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:13:02.017916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-13T19:13:02.245345] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:13:02.817958] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-13T19:13:03.617960] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-13T19:13:03.676774] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:13:03.749917] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:13:04.418002] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-13T19:13:05.098297] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:13:05.217892] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-13T19:13:06.018002] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-13T19:13:06.667865] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:13:06.813850] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:13:06.817945] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-13T19:13:06.874604] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-13T19:13:06.880485] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-13T19:13:06.880748] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-13T19:13:07.357668] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-13T19:13:07.357789] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-13T19:13:07.358912] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-13T19:13:07.358988] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-13T19:13:07.360781] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53783 (keeping 200 days of data) [2025-10-13T19:13:07.619419] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-13T19:13:07.790512] [DEBUG] [LOCAL ] GME: Primary data saved (53783 records). [2025-10-13T19:13:07.790754] [INFO ] [MAIN ] GME: Full history saved. [2025-10-13T19:13:07.790916] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 45.0s. Estimated remaining: 3h 20m 6s. Rate: 7.1 symbols/min [2025-10-13T19:13:08.050784] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:08.097894] [DEBUG] [LOCAL ] GNK: Loaded 40846 existing records from primary storage. [2025-10-13T19:13:08.098364] [INFO ] [MAIN ] GNK: Loaded 40846 existing records. [2025-10-13T19:13:08.304443] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:08.304969] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-13T19:13:08.305110] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-13T19:13:08.313483] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-13T19:13:08.328051] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-13T19:13:08.382443] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:13:08.422908] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-13T19:13:08.725373] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:09.211362] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:13:09.217620] [INFO ] [REMOTE ] GMED: Full fetch complete (69722 records). [2025-10-13T19:13:09.217851] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-13T19:13:09.217974] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-13T19:13:09.345132] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T19:13:09.677210] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-13T19:13:09.677334] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-13T19:13:09.678605] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-13T19:13:09.678703] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-13T19:13:09.680346] [DEBUG] [LOCAL ] GMED: Trimmed 69722 records to 48340 (keeping 200 days of data) [2025-10-13T19:13:09.991100] [DEBUG] [LOCAL ] GMED: Primary data saved (48340 records). [2025-10-13T19:13:09.991256] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-13T19:13:09.991342] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GMED took 37.1s. Estimated remaining: 3h 19m 48s. Rate: 7.1 symbols/min [2025-10-13T19:13:10.023196] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-13T19:13:10.174320] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:10.215430] [DEBUG] [LOCAL ] GNL: Loaded 47438 existing records from primary storage. [2025-10-13T19:13:10.215818] [INFO ] [MAIN ] GNL: Loaded 47438 existing records. [2025-10-13T19:13:10.392438] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:10.393008] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-13T19:13:10.393067] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-13T19:13:10.394028] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-13T19:13:10.394088] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-13T19:13:10.759315] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:10.788354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:13:10.817883] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-13T19:13:11.503671] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:13:11.617903] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-13T19:13:12.133315] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:13:12.136626] [INFO ] [REMOTE ] GMRE: Full fetch complete (52771 records). [2025-10-13T19:13:12.136770] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-13T19:13:12.423035] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-13T19:13:12.514552] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-13T19:13:12.514680] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-13T19:13:12.515474] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-13T19:13:12.515519] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-13T19:13:12.516702] [DEBUG] [LOCAL ] GMRE: Trimmed 52771 records to 37093 (keeping 200 days of data) [2025-10-13T19:13:12.756024] [DEBUG] [LOCAL ] GMRE: Primary data saved (37093 records). [2025-10-13T19:13:12.756177] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-13T19:13:12.756886] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GMRE took 26.0s. Estimated remaining: 3h 19m 31s. Rate: 7.1 symbols/min [2025-10-13T19:13:12.935717] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:12.987294] [DEBUG] [LOCAL ] GNRC: Loaded 45960 existing records from primary storage. [2025-10-13T19:13:12.987691] [INFO ] [MAIN ] GNRC: Loaded 45960 existing records. [2025-10-13T19:13:13.170759] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:13.171155] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-13T19:13:13.171315] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-13T19:13:13.172584] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-13T19:13:13.172684] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-13T19:13:13.221574] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-13T19:13:13.361694] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:13:13.437356] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T19:13:13.584754] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:14.018011] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-13T19:13:14.656301] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:13:14.817966] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-13T19:13:15.618165] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-13T19:13:15.620973] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:13:16.006838] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:13:16.417945] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-13T19:13:17.061023] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:13:17.217906] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-13T19:13:17.343363] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T19:13:18.017952] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-13T19:13:18.735187] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:13:18.809352] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:13:18.817875] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-13T19:13:19.617961] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-13T19:13:20.048404] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:13:20.418002] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-13T19:13:21.224548] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-13T19:13:21.228799] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:13:21.487565] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:13:22.017910] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-13T19:13:22.818030] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-13T19:13:22.820451] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:13:23.123677] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:13:23.618010] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-13T19:13:24.421073] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-13T19:13:24.423597] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:13:25.217951] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-13T19:13:25.280727] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:13:25.368176] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T19:13:26.017997] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-13T19:13:26.817893] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-13T19:13:26.932274] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:13:27.590693] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:13:27.617883] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-13T19:13:28.423076] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-13T19:13:28.444929] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T19:13:29.157626] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:13:29.217917] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-13T19:13:29.638465] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:13:30.017999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-13T19:13:30.671613] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:13:30.817914] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-13T19:13:31.548088] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:13:31.617892] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-13T19:13:32.417904] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-13T19:13:32.453493] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:13:33.217915] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-13T19:13:33.263944] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:13:33.368938] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T19:13:33.371184] [INFO ] [REMOTE ] GNE: Full fetch complete (22460 records). [2025-10-13T19:13:33.371259] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-13T19:13:33.745677] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-13T19:13:33.745773] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-13T19:13:33.746673] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-13T19:13:33.746735] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-13T19:13:33.747326] [DEBUG] [LOCAL ] GNE: Trimmed 22460 records to 17941 (keeping 200 days of data) [2025-10-13T19:13:33.856562] [DEBUG] [LOCAL ] GNE: Primary data saved (17941 records). [2025-10-13T19:13:33.856754] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-13T19:13:33.856890] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNE took 34.9s. Estimated remaining: 3h 19m 42s. Rate: 7.1 symbols/min [2025-10-13T19:13:34.022928] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:34.023048] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-13T19:13:34.033578] [DEBUG] [LOCAL ] GNT: Loaded 8428 existing records from primary storage. [2025-10-13T19:13:34.033815] [INFO ] [MAIN ] GNT: Loaded 8428 existing records. [2025-10-13T19:13:34.220159] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:34.220436] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-13T19:13:34.220485] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-13T19:13:34.221027] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-13T19:13:34.221088] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-13T19:13:34.602410] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:34.629522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:13:34.817971] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-13T19:13:35.625288] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-13T19:13:35.646223] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:13:35.678798] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:13:36.417969] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-13T19:13:37.217949] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-13T19:13:37.258846] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:13:38.017969] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-13T19:13:38.101771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T19:13:38.712710] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:13:38.817961] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-13T19:13:39.436712] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:13:39.617979] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-13T19:13:40.248133] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T19:13:40.417963] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-13T19:13:41.218005] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-13T19:13:41.402241] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T19:13:41.406936] [INFO ] [REMOTE ] GNRC: Full fetch complete (65413 records). [2025-10-13T19:13:41.407076] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-13T19:13:41.794135] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-13T19:13:41.794278] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-13T19:13:41.795106] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-13T19:13:41.795210] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-13T19:13:41.796623] [DEBUG] [LOCAL ] GNRC: Trimmed 65413 records to 45346 (keeping 200 days of data) [2025-10-13T19:13:41.894136] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:13:41.901271] [INFO ] [REMOTE ] GNK: Full fetch complete (57244 records). [2025-10-13T19:13:41.902452] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-13T19:13:42.022457] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-13T19:13:42.322771] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-13T19:13:42.323266] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-13T19:13:42.325135] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-13T19:13:42.325576] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-13T19:13:42.332094] [DEBUG] [LOCAL ] GNK: Trimmed 57244 records to 40257 (keeping 200 days of data) [2025-10-13T19:13:42.590030] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:13:42.693451] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:13:42.772521] [DEBUG] [LOCAL ] GNRC: Primary data saved (45346 records). [2025-10-13T19:13:42.774010] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-13T19:13:42.775374] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 30.0s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-13T19:13:42.819678] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-13T19:13:42.964902] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:42.976268] [DEBUG] [LOCAL ] GNK: Primary data saved (40257 records). [2025-10-13T19:13:42.976509] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-13T19:13:42.976625] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNK took 35.2s. Estimated remaining: 3h 19m 13s. Rate: 7.1 symbols/min [2025-10-13T19:13:43.176609] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:43.194390] [DEBUG] [LOCAL ] GNW: Loaded 52114 existing records from primary storage. [2025-10-13T19:13:43.194806] [INFO ] [MAIN ] GNW: Loaded 52114 existing records. [2025-10-13T19:13:43.391373] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:43.392248] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-13T19:13:43.392350] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-13T19:13:43.403286] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-13T19:13:43.404739] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-13T19:13:43.448953] [DEBUG] [LOCAL ] GOF: Loaded 43182 existing records from primary storage. [2025-10-13T19:13:43.486233] [INFO ] [MAIN ] GOF: Loaded 43182 existing records. [2025-10-13T19:13:43.621788] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-13T19:13:43.855301] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:43.874881] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-13T19:13:43.877002] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-13T19:13:43.883250] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-13T19:13:43.888525] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-13T19:13:44.066239] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:44.333209] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:44.375090] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:13:44.407573] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:13:44.417941] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-13T19:13:45.217916] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-13T19:13:45.866633] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:13:46.017874] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-13T19:13:46.108858] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T19:13:46.787837] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T19:13:46.817883] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-13T19:13:47.502802] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-13T19:13:47.617974] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-13T19:13:48.350988] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:13:48.417950] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-13T19:13:49.133912] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T19:13:49.217971] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-13T19:13:49.895910] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:13:50.017906] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-13T19:13:50.817947] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-13T19:13:51.487117] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:13:51.492744] [INFO ] [REMOTE ] GNL: Full fetch complete (68022 records). [2025-10-13T19:13:51.492920] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-13T19:13:51.623051] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-13T19:13:51.900686] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-13T19:13:51.900798] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-13T19:13:51.902016] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-13T19:13:51.902082] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-13T19:13:51.903865] [DEBUG] [LOCAL ] GNL: Trimmed 68022 records to 46678 (keeping 200 days of data) [2025-10-13T19:13:52.150568] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:13:52.242539] [DEBUG] [LOCAL ] GNL: Primary data saved (46678 records). [2025-10-13T19:13:52.242778] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-13T19:13:52.242897] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNL took 42.3s. Estimated remaining: 3h 19m 6s. Rate: 7.1 symbols/min [2025-10-13T19:13:52.426702] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-13T19:13:52.430730] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:52.462747] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:13:52.478150] [DEBUG] [LOCAL ] GOLF: Loaded 31437 existing records from primary storage. [2025-10-13T19:13:52.478560] [INFO ] [MAIN ] GOLF: Loaded 31437 existing records. [2025-10-13T19:13:52.667834] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:52.668150] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-13T19:13:52.668203] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-13T19:13:52.669159] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-13T19:13:52.669221] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-13T19:13:53.023879] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:53.217955] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-13T19:13:53.942886] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:13:54.017893] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-13T19:13:54.040517] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:13:54.042078] [INFO ] [REMOTE ] GNT: Full fetch complete (11080 records). [2025-10-13T19:13:54.042145] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-13T19:13:54.402956] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-13T19:13:54.403037] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-13T19:13:54.403319] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-13T19:13:54.403358] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-13T19:13:54.403859] [DEBUG] [LOCAL ] GNT: Trimmed 11080 records to 8395 (keeping 200 days of data) [2025-10-13T19:13:54.453135] [DEBUG] [LOCAL ] GNT: Primary data saved (8395 records). [2025-10-13T19:13:54.453273] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-13T19:13:54.453365] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GNT took 20.6s. Estimated remaining: 3h 18m 49s. Rate: 7.1 symbols/min [2025-10-13T19:13:54.625258] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:54.671167] [DEBUG] [LOCAL ] GOOS: Loaded 45406 existing records from primary storage. [2025-10-13T19:13:54.671571] [INFO ] [MAIN ] GOOS: Loaded 45406 existing records. [2025-10-13T19:13:54.822638] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-13T19:13:54.845802] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:54.846629] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-13T19:13:54.846713] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-13T19:13:54.847133] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-13T19:13:54.847171] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-13T19:13:55.196911] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:55.617950] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-13T19:13:55.990968] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:13:56.418032] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-13T19:13:56.633223] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T19:13:56.747406] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:13:57.217991] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-13T19:13:57.663731] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:13:58.018042] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-13T19:13:58.775474] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:13:58.817965] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-13T19:13:59.444860] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:13:59.617952] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-13T19:14:00.417912] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-13T19:14:00.569775] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:14:01.218265] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-13T19:14:01.667190] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T19:14:02.010398] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T19:14:02.019260] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-13T19:14:02.817950] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-13T19:14:02.855405] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:14:03.250525] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T19:14:03.618014] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-13T19:14:04.417958] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-13T19:14:04.554015] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:14:04.625773] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:14:05.217963] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-13T19:14:06.027121] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-13T19:14:06.029373] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:14:06.817985] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-13T19:14:06.945231] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:14:07.617904] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-13T19:14:07.677467] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:14:08.247176] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:14:08.417886] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-13T19:14:09.217910] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-13T19:14:09.346771] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T19:14:10.017988] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-13T19:14:10.180416] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:14:10.817909] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-13T19:14:10.878526] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:14:11.526933] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:14:11.617903] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-13T19:14:12.129072] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T19:14:12.417942] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-13T19:14:13.220471] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-13T19:14:13.222599] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:14:14.017992] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-13T19:14:14.069926] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:14:14.074588] [INFO ] [REMOTE ] GOF: Full fetch complete (62109 records). [2025-10-13T19:14:14.074727] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-13T19:14:14.489627] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-13T19:14:14.489751] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-13T19:14:14.490584] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-13T19:14:14.490631] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-13T19:14:14.491945] [DEBUG] [LOCAL ] GOF: Trimmed 62109 records to 42577 (keeping 200 days of data) [2025-10-13T19:14:14.759117] [DEBUG] [LOCAL ] GOF: Primary data saved (42577 records). [2025-10-13T19:14:14.759259] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-13T19:14:14.759340] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOF took 31.8s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-10-13T19:14:14.825940] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-13T19:14:14.972736] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:14.969974] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:14:15.016174] [DEBUG] [LOCAL ] GOTU: Loaded 38292 existing records from primary storage. [2025-10-13T19:14:15.016516] [INFO ] [MAIN ] GOTU: Loaded 38292 existing records. [2025-10-13T19:14:15.189935] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:15.190237] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-13T19:14:15.190299] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-13T19:14:15.191168] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-13T19:14:15.191227] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-13T19:14:15.573748] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:15.607587] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:14:15.617894] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-13T19:14:16.306366] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:14:16.417905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-13T19:14:17.092065] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:14:17.217892] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-13T19:14:18.024745] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-13T19:14:18.030283] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:14:18.817910] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-13T19:14:18.863788] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:14:19.617904] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-13T19:14:19.775345] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T19:14:20.099705] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:14:20.417914] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-13T19:14:20.949302] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T19:14:21.217986] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-13T19:14:22.018021] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-13T19:14:22.059145] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:14:22.474912] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T19:14:22.818006] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-13T19:14:23.617904] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-13T19:14:23.725284] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:14:24.107158] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T19:14:24.417920] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-13T19:14:24.738117] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T19:14:25.217991] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-13T19:14:26.017903] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-13T19:14:26.204936] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:14:26.648546] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:14:26.652906] [INFO ] [REMOTE ] GOOS: Full fetch complete (64873 records). [2025-10-13T19:14:26.653022] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-13T19:14:26.825543] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-13T19:14:27.066462] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-13T19:14:27.066621] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-13T19:14:27.067494] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-13T19:14:27.067545] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-13T19:14:27.068810] [DEBUG] [LOCAL ] GOOS: Trimmed 64873 records to 44767 (keeping 200 days of data) [2025-10-13T19:14:27.297321] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T19:14:27.363910] [DEBUG] [LOCAL ] GOOS: Primary data saved (44767 records). [2025-10-13T19:14:27.364064] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-13T19:14:27.364146] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 32.9s. Estimated remaining: 3h 18m 56s. Rate: 7.1 symbols/min [2025-10-13T19:14:27.527812] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:27.570154] [DEBUG] [LOCAL ] GPC: Loaded 46854 existing records from primary storage. [2025-10-13T19:14:27.570536] [INFO ] [MAIN ] GPC: Loaded 46854 existing records. [2025-10-13T19:14:27.630885] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-13T19:14:27.744805] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:27.745163] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-13T19:14:27.745213] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-13T19:14:27.746616] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-13T19:14:27.746701] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-13T19:14:28.096507] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:28.141528] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T19:14:28.417983] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-13T19:14:29.217891] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-13T19:14:29.418597] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:14:29.629510] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T19:14:29.632697] [INFO ] [REMOTE ] GOLF: Full fetch complete (45136 records). [2025-10-13T19:14:29.632812] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-13T19:14:30.025613] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-13T19:14:30.028815] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-13T19:14:30.029812] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-13T19:14:30.030563] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-13T19:14:30.030611] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-13T19:14:30.031696] [DEBUG] [LOCAL ] GOLF: Trimmed 45136 records to 31005 (keeping 200 days of data) [2025-10-13T19:14:30.241932] [DEBUG] [LOCAL ] GOLF: Primary data saved (31005 records). [2025-10-13T19:14:30.242182] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-13T19:14:30.242422] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 38.0s. Estimated remaining: 3h 18m 39s. Rate: 7.1 symbols/min [2025-10-13T19:14:30.818001] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-13T19:14:30.896831] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:14:30.902404] [INFO ] [REMOTE ] GNW: Full fetch complete (73679 records). [2025-10-13T19:14:30.902592] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-13T19:14:31.327209] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-13T19:14:31.327308] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-13T19:14:31.328217] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-13T19:14:31.328306] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-13T19:14:31.329905] [DEBUG] [LOCAL ] GNW: Trimmed 73679 records to 51406 (keeping 200 days of data) [2025-10-13T19:14:31.626745] [DEBUG] [LOCAL ] GNW: Primary data saved (51406 records). [2025-10-13T19:14:31.626908] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-13T19:14:31.627809] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GNW took 48.9s. Estimated remaining: 3h 18m 20s. Rate: 7.1 symbols/min [2025-10-13T19:14:31.797261] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T19:14:31.809126] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-13T19:14:32.276567] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:14:32.417968] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-13T19:14:33.576324] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:14:33.586755] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-13T19:14:33.644215] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:14:34.017952] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-13T19:14:35.144353] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:14:35.156441] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-13T19:14:35.343005] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:14:35.617947] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-13T19:14:36.921290] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:14:36.932903] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-13T19:14:36.959079] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:14:37.217959] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-13T19:14:38.710078] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:14:38.748600] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T19:14:38.746493] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-13T19:14:38.818014] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-13T19:14:39.957126] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T19:14:39.965143] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-13T19:14:40.532246] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T19:14:40.548639] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-13T19:14:41.305450] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:14:41.309282] [INFO ] [REMOTE ] GOTU: Full fetch complete (58682 records). [2025-10-13T19:14:41.309383] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-13T19:14:41.691368] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-13T19:14:41.691462] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-13T19:14:41.692248] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-13T19:14:41.692326] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-13T19:14:41.695728] [DEBUG] [LOCAL ] GOTU: Trimmed 58682 records to 37454 (keeping 200 days of data) [2025-10-13T19:14:41.921894] [DEBUG] [LOCAL ] GOTU: Primary data saved (37454 records). [2025-10-13T19:14:41.922056] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-13T19:14:41.922143] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 27.2s. Estimated remaining: 3h 18m 14s. Rate: 7.1 symbols/min [2025-10-13T19:14:42.312346] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:14:42.322345] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-13T19:14:43.931936] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:14:43.942947] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-13T19:14:45.644722] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:14:45.653947] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-13T19:14:47.310449] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:14:47.321725] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-13T19:14:48.832991] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:14:48.837846] [INFO ] [REMOTE ] GPC: Full fetch complete (68694 records). [2025-10-13T19:14:48.837986] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-13T19:14:49.227626] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-13T19:14:49.227753] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-13T19:14:49.228616] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-13T19:14:49.228705] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-13T19:14:49.230144] [DEBUG] [LOCAL ] GPC: Trimmed 68694 records to 46150 (keeping 200 days of data) [2025-10-13T19:14:49.515775] [DEBUG] [LOCAL ] GPC: Primary data saved (46150 records). [2025-10-13T19:14:49.515916] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-13T19:14:49.515992] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 22.2s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-13T19:14:50.142886] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.184962] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.227798] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.250214] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.256157] [DEBUG] [LOCAL ] GPJA: Loaded 4306 existing records from primary storage. [2025-10-13T19:14:50.257677] [INFO ] [MAIN ] GPJA: Loaded 4306 existing records. [2025-10-13T19:14:50.352280] [DEBUG] [LOCAL ] GPI: Loaded 14872 existing records from primary storage. [2025-10-13T19:14:50.372853] [INFO ] [MAIN ] GPI: Loaded 14872 existing records. [2025-10-13T19:14:50.490082] [DEBUG] [LOCAL ] GPMT: Loaded 26136 existing records from primary storage. [2025-10-13T19:14:50.515278] [INFO ] [MAIN ] GPMT: Loaded 26136 existing records. [2025-10-13T19:14:50.556048] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:50.626170] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-13T19:14:50.640608] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-13T19:14:50.670896] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-13T19:14:50.671021] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-13T19:14:50.785908] [DEBUG] [LOCAL ] GPK: Loaded 53446 existing records from primary storage. [2025-10-13T19:14:50.858850] [INFO ] [MAIN ] GPK: Loaded 53446 existing records. [2025-10-13T19:14:50.843355] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:50.895934] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-13T19:14:50.939683] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-13T19:14:51.030975] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-13T19:14:51.076955] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:51.091254] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-13T19:14:51.120517] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-13T19:14:51.175212] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-13T19:14:51.199082] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-13T19:14:51.199206] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-13T19:14:51.424957] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:51.514842] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-13T19:14:51.545255] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-13T19:14:51.688686] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-13T19:14:51.808792] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-13T19:14:51.854867] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:51.925862] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-13T19:14:52.168943] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.249296] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-13T19:14:52.415111] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.433198] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-13T19:14:52.559678] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.560142] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-13T19:14:52.676886] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:14:52.678900] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-13T19:14:53.333623] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:14:53.338292] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-13T19:14:53.540960] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:14:53.566787] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-13T19:14:53.580548] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:14:53.591623] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-13T19:14:53.970487] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T19:14:53.976973] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-13T19:14:54.066430] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:14:54.076437] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-13T19:14:54.122277] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T19:14:54.124705] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-13T19:14:54.600804] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T19:14:54.602435] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-13T19:14:54.677092] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:14:54.683551] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-13T19:14:54.838542] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:14:54.841745] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-13T19:14:55.164730] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T19:14:55.590755] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:14:55.623025] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-13T19:14:55.634003] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:14:55.798888] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:14:56.102847] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T19:14:56.418004] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-13T19:14:57.217977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-13T19:14:57.532715] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:14:58.017913] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-13T19:14:58.390290] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:14:58.663391] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:14:58.817995] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-13T19:14:59.390054] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T19:14:59.617988] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-13T19:15:00.173510] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T19:15:00.418047] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-13T19:15:01.076356] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T19:15:01.217981] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-13T19:15:01.932517] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:15:02.018031] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-13T19:15:02.818015] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-13T19:15:02.826568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:15:02.828207] [INFO ] [REMOTE ] GPJA: Full fetch complete (7129 records). [2025-10-13T19:15:02.828371] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-13T19:15:03.263956] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-13T19:15:03.264075] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-13T19:15:03.264470] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-13T19:15:03.264514] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-13T19:15:03.265314] [DEBUG] [LOCAL ] GPJA: Trimmed 7129 records to 4251 (keeping 200 days of data) [2025-10-13T19:15:03.300843] [DEBUG] [LOCAL ] GPJA: Primary data saved (4251 records). [2025-10-13T19:15:03.301044] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-13T19:15:03.301216] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 13.8s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-13T19:15:03.489000] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:03.547465] [DEBUG] [LOCAL ] GPN: Loaded 52784 existing records from primary storage. [2025-10-13T19:15:03.547995] [INFO ] [MAIN ] GPN: Loaded 52784 existing records. [2025-10-13T19:15:03.622413] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-13T19:15:03.736415] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:03.736807] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-13T19:15:03.736909] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-13T19:15:03.737779] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-13T19:15:03.737841] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-13T19:15:03.897457] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:15:04.129817] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:04.418014] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-13T19:15:05.099764] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:15:05.217982] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-13T19:15:06.018039] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-13T19:15:06.213947] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T19:15:06.480168] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T19:15:06.818003] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-13T19:15:07.264911] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:15:07.621447] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-13T19:15:07.658568] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:15:08.418049] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-13T19:15:09.187392] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:15:09.217991] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-13T19:15:09.319629] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:15:10.017950] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-13T19:15:10.653150] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T19:15:10.817967] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-13T19:15:11.019887] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:15:11.617976] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-13T19:15:12.417991] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-13T19:15:12.560064] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:15:12.925938] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:15:13.217911] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-13T19:15:13.474591] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T19:15:13.476710] [INFO ] [REMOTE ] GPI: Full fetch complete (21296 records). [2025-10-13T19:15:13.476780] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-13T19:15:13.836693] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-13T19:15:13.836811] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-13T19:15:13.837236] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-13T19:15:13.837278] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-13T19:15:13.837867] [DEBUG] [LOCAL ] GPI: Trimmed 21296 records to 14798 (keeping 200 days of data) [2025-10-13T19:15:13.931101] [DEBUG] [LOCAL ] GPI: Primary data saved (14798 records). [2025-10-13T19:15:13.931238] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-13T19:15:13.931347] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPI took 24.4s. Estimated remaining: 3h 17m 59s. Rate: 7.1 symbols/min [2025-10-13T19:15:14.020221] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-13T19:15:14.124071] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:14.154283] [DEBUG] [LOCAL ] GPOR: Loaded 23651 existing records from primary storage. [2025-10-13T19:15:14.154547] [INFO ] [MAIN ] GPOR: Loaded 23651 existing records. [2025-10-13T19:15:14.332268] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:14.344511] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-13T19:15:14.345101] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-13T19:15:14.345519] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:15:14.347262] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-13T19:15:14.350668] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-13T19:15:14.700338] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:14.817904] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-13T19:15:15.617902] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-13T19:15:15.653764] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:15:15.709639] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:15:16.417908] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-13T19:15:16.616138] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:15:17.217990] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-13T19:15:17.807388] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:15:18.017996] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-13T19:15:18.818132] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-13T19:15:18.997858] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:15:19.112867] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:15:19.617955] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-13T19:15:19.994244] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T19:15:20.417902] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-13T19:15:20.629515] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:15:20.631878] [INFO ] [REMOTE ] GPMT: Full fetch complete (36821 records). [2025-10-13T19:15:20.631955] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-13T19:15:21.021522] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-13T19:15:21.021618] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-13T19:15:21.022236] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-13T19:15:21.022291] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-13T19:15:21.023230] [DEBUG] [LOCAL ] GPMT: Trimmed 36821 records to 25859 (keeping 200 days of data) [2025-10-13T19:15:21.176254] [DEBUG] [LOCAL ] GPMT: Primary data saved (25859 records). [2025-10-13T19:15:21.176395] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-13T19:15:21.176490] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPMT took 31.6s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-13T19:15:21.223065] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-13T19:15:21.359116] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:21.397797] [DEBUG] [LOCAL ] GPRK: Loaded 40024 existing records from primary storage. [2025-10-13T19:15:21.398204] [INFO ] [MAIN ] GPRK: Loaded 40024 existing records. [2025-10-13T19:15:21.585968] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:21.586204] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-13T19:15:21.586253] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-13T19:15:21.586610] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-13T19:15:21.586707] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-13T19:15:21.914440] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:15:21.985697] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:22.017890] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-13T19:15:22.817911] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-13T19:15:23.021055] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:15:23.323535] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:15:23.618022] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-13T19:15:24.237616] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:15:24.417967] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-13T19:15:24.803000] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T19:15:25.217955] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-13T19:15:25.956500] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:15:26.017915] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-13T19:15:26.275060] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:15:26.817968] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-13T19:15:27.477681] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:15:27.617899] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-13T19:15:27.863140] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:15:28.418014] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-13T19:15:29.217964] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-13T19:15:29.435871] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T19:15:29.512394] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:15:30.018004] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-13T19:15:30.817907] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-13T19:15:30.972509] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:15:31.418908] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:15:31.617982] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-13T19:15:32.260017] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:15:32.417946] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-13T19:15:33.217948] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-13T19:15:33.418755] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:15:33.870887] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:15:34.017994] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-13T19:15:34.817971] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-13T19:15:35.010838] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:15:35.164612] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T19:15:35.617963] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-13T19:15:36.418000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-13T19:15:36.570737] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:15:37.217917] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-13T19:15:37.349862] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:15:37.899394] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:15:38.017917] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-13T19:15:38.618214] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T19:15:38.623460] [INFO ] [REMOTE ] GPN: Full fetch complete (74930 records). [2025-10-13T19:15:38.623612] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-13T19:15:38.826795] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-13T19:15:39.011611] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-13T19:15:39.011732] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-13T19:15:39.012636] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-13T19:15:39.012719] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-13T19:15:39.014170] [DEBUG] [LOCAL ] GPN: Trimmed 74930 records to 52044 (keeping 200 days of data) [2025-10-13T19:15:39.349521] [DEBUG] [LOCAL ] GPN: Primary data saved (52044 records). [2025-10-13T19:15:39.349701] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-13T19:15:39.350510] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 36.0s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-13T19:15:39.523913] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:39.549168] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:15:39.582860] [DEBUG] [LOCAL ] GRBK: Loaded 27490 existing records from primary storage. [2025-10-13T19:15:39.583159] [INFO ] [MAIN ] GRBK: Loaded 27490 existing records. [2025-10-13T19:15:39.627214] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-13T19:15:39.770894] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:39.771148] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-13T19:15:39.771206] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-13T19:15:39.771518] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-13T19:15:39.771559] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-13T19:15:40.146855] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:40.417904] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-13T19:15:40.723052] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T19:15:40.928127] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T19:15:41.217990] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-13T19:15:41.842236] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:15:42.017985] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-13T19:15:42.549249] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:15:42.817915] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-13T19:15:43.311334] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T19:15:43.314256] [INFO ] [REMOTE ] GPOR: Full fetch complete (35072 records). [2025-10-13T19:15:43.314334] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-13T19:15:43.623184] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-13T19:15:43.683407] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-13T19:15:43.683752] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-13T19:15:43.684512] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-13T19:15:43.684573] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-13T19:15:43.685579] [DEBUG] [LOCAL ] GPOR: Trimmed 35072 records to 23188 (keeping 200 days of data) [2025-10-13T19:15:43.824459] [DEBUG] [LOCAL ] GPOR: Primary data saved (23188 records). [2025-10-13T19:15:43.824614] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-13T19:15:43.824728] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 29.9s. Estimated remaining: 3h 17m 40s. Rate: 7.1 symbols/min [2025-10-13T19:15:43.999523] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:44.012530] [DEBUG] [LOCAL ] GRC: Loaded 9381 existing records from primary storage. [2025-10-13T19:15:44.012796] [INFO ] [MAIN ] GRC: Loaded 9381 existing records. [2025-10-13T19:15:44.144808] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:15:44.239458] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:44.239752] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-13T19:15:44.239806] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-13T19:15:44.240025] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-13T19:15:44.240097] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-13T19:15:44.426671] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-13T19:15:44.636415] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:45.172167] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T19:15:45.217893] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-13T19:15:46.017913] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-13T19:15:46.152928] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T19:15:46.158412] [INFO ] [REMOTE ] GPK: Full fetch complete (75648 records). [2025-10-13T19:15:46.158572] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-13T19:15:46.549163] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-13T19:15:46.549523] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-13T19:15:46.550573] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-13T19:15:46.550635] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-13T19:15:46.552209] [DEBUG] [LOCAL ] GPK: Trimmed 75648 records to 52741 (keeping 200 days of data) [2025-10-13T19:15:46.797571] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:15:46.818210] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-13T19:15:46.912399] [DEBUG] [LOCAL ] GPK: Primary data saved (52741 records). [2025-10-13T19:15:46.912617] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-13T19:15:46.912863] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPK took 57.4s. Estimated remaining: 3h 17m 24s. Rate: 7.1 symbols/min [2025-10-13T19:15:47.035705] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:15:47.112413] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:47.134887] [DEBUG] [LOCAL ] GRDN: Loaded 21246 existing records from primary storage. [2025-10-13T19:15:47.135173] [INFO ] [MAIN ] GRDN: Loaded 21246 existing records. [2025-10-13T19:15:47.313595] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:47.313948] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-13T19:15:47.313997] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-13T19:15:47.314318] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-13T19:15:47.314379] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-13T19:15:47.620043] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-13T19:15:47.674503] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:15:47.695702] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:48.417921] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-13T19:15:48.935972] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T19:15:49.217913] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-13T19:15:49.265523] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:15:50.017920] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-13T19:15:50.440046] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:15:50.444533] [INFO ] [REMOTE ] GPRK: Full fetch complete (57802 records). [2025-10-13T19:15:50.444639] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-13T19:15:50.822677] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-13T19:15:50.833193] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T19:15:50.833358] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-13T19:15:50.836358] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-13T19:15:50.837213] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-13T19:15:50.837276] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-13T19:15:50.838882] [DEBUG] [LOCAL ] GPRK: Trimmed 57802 records to 39556 (keeping 200 days of data) [2025-10-13T19:15:51.061680] [DEBUG] [LOCAL ] GPRK: Primary data saved (39556 records). [2025-10-13T19:15:51.061822] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-13T19:15:51.061898] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GPRK took 29.9s. Estimated remaining: 3h 17m 10s. Rate: 7.1 symbols/min [2025-10-13T19:15:51.228705] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:51.265497] [DEBUG] [LOCAL ] GRMN: Loaded 41183 existing records from primary storage. [2025-10-13T19:15:51.265873] [INFO ] [MAIN ] GRMN: Loaded 41183 existing records. [2025-10-13T19:15:51.442424] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:51.442678] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-13T19:15:51.442746] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-13T19:15:51.443299] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-13T19:15:51.443360] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-13T19:15:51.623005] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-13T19:15:51.804134] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:52.158675] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:15:52.418080] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-13T19:15:52.709169] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T19:15:53.217888] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-13T19:15:53.626101] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:15:54.017916] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-13T19:15:54.042871] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:15:54.817978] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-13T19:15:55.256519] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T19:15:55.611994] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T19:15:55.617875] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-13T19:15:56.358341] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T19:15:56.417989] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-13T19:15:57.217903] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-13T19:15:57.280915] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T19:15:58.017901] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-13T19:15:58.164579] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T19:15:58.817966] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-13T19:15:58.835431] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T19:15:59.617948] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-13T19:15:59.982577] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:16:00.327953] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T19:16:00.417945] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-13T19:16:01.217908] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-13T19:16:01.282022] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T19:16:02.018034] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-13T19:16:02.820476] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-13T19:16:02.831260] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:16:03.055816] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T19:16:03.617985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-13T19:16:03.798063] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:16:04.417949] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-13T19:16:05.217997] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-13T19:16:05.271614] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:16:05.325418] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T19:16:05.990215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:16:06.017963] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-13T19:16:06.817904] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-13T19:16:07.205263] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:16:07.541279] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T19:16:07.617963] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-13T19:16:08.377159] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:16:08.417891] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-13T19:16:09.217912] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-13T19:16:09.291623] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T19:16:09.293790] [INFO ] [REMOTE ] GRC: Full fetch complete (13252 records). [2025-10-13T19:16:09.293899] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-13T19:16:09.708227] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-13T19:16:09.708310] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-13T19:16:09.708601] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-13T19:16:09.708639] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-13T19:16:09.709162] [DEBUG] [LOCAL ] GRC: Trimmed 13252 records to 9233 (keeping 200 days of data) [2025-10-13T19:16:09.769711] [DEBUG] [LOCAL ] GRC: Primary data saved (9233 records). [2025-10-13T19:16:09.769888] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-13T19:16:09.769987] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 25.9s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-13T19:16:09.942764] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:09.993805] [DEBUG] [LOCAL ] GRND: Loaded 50718 existing records from primary storage. [2025-10-13T19:16:09.994178] [INFO ] [MAIN ] GRND: Loaded 50718 existing records. [2025-10-13T19:16:10.023214] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-13T19:16:10.173543] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:10.173885] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-13T19:16:10.173933] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-13T19:16:10.174434] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-13T19:16:10.174489] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-13T19:16:10.460473] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:16:10.543116] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:10.818002] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-13T19:16:11.617913] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-13T19:16:11.751525] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T19:16:12.417958] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-13T19:16:12.449278] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:16:12.980846] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:16:12.984272] [INFO ] [REMOTE ] GRBK: Full fetch complete (40500 records). [2025-10-13T19:16:12.984353] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-13T19:16:13.228849] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-13T19:16:13.369682] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-13T19:16:13.369781] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-13T19:16:13.370546] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-13T19:16:13.370606] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-13T19:16:13.371565] [DEBUG] [LOCAL ] GRBK: Trimmed 40500 records to 27134 (keeping 200 days of data) [2025-10-13T19:16:13.472149] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T19:16:13.550949] [DEBUG] [LOCAL ] GRBK: Primary data saved (27134 records). [2025-10-13T19:16:13.551104] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-13T19:16:13.551190] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRBK took 34.2s. Estimated remaining: 3h 17m 1s. Rate: 7.1 symbols/min [2025-10-13T19:16:13.725159] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:13.760111] [DEBUG] [LOCAL ] GRNT: Loaded 34422 existing records from primary storage. [2025-10-13T19:16:13.760393] [INFO ] [MAIN ] GRNT: Loaded 34422 existing records. [2025-10-13T19:16:13.949864] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:13.950142] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-13T19:16:13.950190] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-13T19:16:13.950552] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-13T19:16:13.950611] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-13T19:16:14.025137] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-13T19:16:14.309706] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:14.823939] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-13T19:16:14.845432] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T19:16:15.060636] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:16:15.617960] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-13T19:16:16.258748] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:16:16.417969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-13T19:16:17.154996] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:16:17.218010] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-13T19:16:17.712777] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T19:16:18.017974] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-13T19:16:18.817903] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-13T19:16:18.966420] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:16:19.352184] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:16:19.617961] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-13T19:16:20.427882] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-13T19:16:20.433156] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:16:20.778945] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T19:16:21.217958] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-13T19:16:21.646847] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:16:21.649814] [INFO ] [REMOTE ] GRDN: Full fetch complete (26217 records). [2025-10-13T19:16:21.649908] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-13T19:16:22.023720] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-13T19:16:22.026526] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-13T19:16:22.026617] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-13T19:16:22.027245] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-13T19:16:22.027412] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-13T19:16:22.028212] [DEBUG] [LOCAL ] GRDN: Trimmed 26217 records to 20887 (keeping 200 days of data) [2025-10-13T19:16:22.151326] [DEBUG] [LOCAL ] GRDN: Primary data saved (20887 records). [2025-10-13T19:16:22.151465] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-13T19:16:22.151543] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRDN took 35.2s. Estimated remaining: 3h 16m 53s. Rate: 7.1 symbols/min [2025-10-13T19:16:22.320477] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:22.331529] [DEBUG] [LOCAL ] GROV: Loaded 8934 existing records from primary storage. [2025-10-13T19:16:22.331771] [INFO ] [MAIN ] GROV: Loaded 8934 existing records. [2025-10-13T19:16:22.509618] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:22.509862] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-13T19:16:22.509908] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-13T19:16:22.510145] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-13T19:16:22.510197] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-13T19:16:22.823081] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-13T19:16:22.904305] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:22.990133] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:16:23.617984] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-13T19:16:23.699436] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:16:24.238815] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T19:16:24.254430] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:16:24.417969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-13T19:16:25.217997] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-13T19:16:25.826442] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:16:26.017973] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-13T19:16:26.704202] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:16:26.817972] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-13T19:16:26.917856] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T19:16:27.618029] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-13T19:16:28.288251] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T19:16:28.319549] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:16:28.417914] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-13T19:16:29.217985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-13T19:16:30.017987] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-13T19:16:30.189076] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:16:30.470230] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T19:16:30.817896] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-13T19:16:31.255227] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T19:16:31.617911] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-13T19:16:32.202323] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:16:32.417965] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-13T19:16:32.624942] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:16:33.217955] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-13T19:16:33.678403] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:16:34.018149] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-13T19:16:34.054443] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T19:16:34.817950] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-13T19:16:35.534395] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:16:35.600588] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:16:35.617897] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-13T19:16:36.417893] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-13T19:16:36.803269] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:16:37.217913] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-13T19:16:38.020104] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-13T19:16:38.022882] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:16:38.094510] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T19:16:38.813603] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:16:38.817889] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-13T19:16:39.617960] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-13T19:16:40.345265] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:16:40.368296] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:16:40.417943] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-13T19:16:41.217982] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-13T19:16:41.528348] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:16:42.017971] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-13T19:16:42.759074] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:16:42.763106] [INFO ] [REMOTE ] GRMN: Full fetch complete (59599 records). [2025-10-13T19:16:42.763277] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-13T19:16:42.824945] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-13T19:16:43.212467] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-13T19:16:43.212350] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:16:43.212680] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-13T19:16:43.220424] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-13T19:16:43.220681] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-13T19:16:43.222989] [DEBUG] [LOCAL ] GRMN: Trimmed 59599 records to 40513 (keeping 200 days of data) [2025-10-13T19:16:43.476561] [DEBUG] [LOCAL ] GRMN: Primary data saved (40513 records). [2025-10-13T19:16:43.476725] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-13T19:16:43.476879] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRMN took 52.4s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-13T19:16:43.623097] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-13T19:16:43.705834] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:43.714448] [DEBUG] [LOCAL ] GRX: Loaded 4825 existing records from primary storage. [2025-10-13T19:16:43.714724] [INFO ] [MAIN ] GRX: Loaded 4825 existing records. [2025-10-13T19:16:43.924029] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:43.924293] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-13T19:16:43.924343] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-13T19:16:43.924801] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-13T19:16:43.924862] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-13T19:16:44.298060] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:44.417967] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-13T19:16:44.511479] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:16:45.010942] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:16:45.051030] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:16:45.054725] [INFO ] [REMOTE ] GRNT: Full fetch complete (48252 records). [2025-10-13T19:16:45.054815] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-13T19:16:45.221423] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-13T19:16:45.443040] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-13T19:16:45.443127] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-13T19:16:45.443825] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-13T19:16:45.443887] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-13T19:16:45.445012] [DEBUG] [LOCAL ] GRNT: Trimmed 48252 records to 33945 (keeping 200 days of data) [2025-10-13T19:16:45.641259] [DEBUG] [LOCAL ] GRNT: Primary data saved (33945 records). [2025-10-13T19:16:45.641407] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-13T19:16:45.642195] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRNT took 32.1s. Estimated remaining: 3h 16m 45s. Rate: 7.1 symbols/min [2025-10-13T19:16:45.812458] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:45.869327] [DEBUG] [LOCAL ] GS: Loaded 52532 existing records from primary storage. [2025-10-13T19:16:45.869811] [INFO ] [MAIN ] GS: Loaded 52532 existing records. [2025-10-13T19:16:46.018555] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-13T19:16:46.058411] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:46.067063] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-13T19:16:46.067291] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-13T19:16:46.069977] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-13T19:16:46.069904] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T19:16:46.070329] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-13T19:16:46.426268] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:46.707516] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:16:46.817895] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-13T19:16:47.460046] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:16:47.617975] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-13T19:16:48.269612] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T19:16:48.271431] [INFO ] [REMOTE ] GROV: Full fetch complete (14078 records). [2025-10-13T19:16:48.271511] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-13T19:16:48.428074] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-13T19:16:48.655058] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-13T19:16:48.655151] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-13T19:16:48.655761] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-13T19:16:48.655827] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-13T19:16:48.656381] [DEBUG] [LOCAL ] GROV: Trimmed 14078 records to 8755 (keeping 200 days of data) [2025-10-13T19:16:48.712097] [DEBUG] [LOCAL ] GROV: Primary data saved (8755 records). [2025-10-13T19:16:48.712262] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-13T19:16:48.712359] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GROV took 26.6s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-13T19:16:48.885698] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:48.931189] [DEBUG] [LOCAL ] GSBD: Loaded 40105 existing records from primary storage. [2025-10-13T19:16:48.931583] [INFO ] [MAIN ] GSBD: Loaded 40105 existing records. [2025-10-13T19:16:49.110184] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:49.110450] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-13T19:16:49.110501] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-13T19:16:49.111004] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-13T19:16:49.111063] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-13T19:16:49.223070] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-13T19:16:49.482825] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:49.764457] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:16:50.017982] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-13T19:16:50.271091] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:16:50.276826] [INFO ] [REMOTE ] GRND: Full fetch complete (71247 records). [2025-10-13T19:16:50.276954] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-13T19:16:50.592282] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:16:50.687030] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-13T19:16:50.687118] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-13T19:16:50.688283] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-13T19:16:50.688350] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-13T19:16:50.690848] [DEBUG] [LOCAL ] GRND: Trimmed 71247 records to 50041 (keeping 200 days of data) [2025-10-13T19:16:50.862617] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-13T19:16:51.018496] [DEBUG] [LOCAL ] GRND: Primary data saved (50041 records). [2025-10-13T19:16:51.018699] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-13T19:16:51.018826] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRND took 41.2s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-13T19:16:51.188969] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:51.245034] [DEBUG] [LOCAL ] GSK: Loaded 54280 existing records from primary storage. [2025-10-13T19:16:51.245444] [INFO ] [MAIN ] GSK: Loaded 54280 existing records. [2025-10-13T19:16:51.428370] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:51.428621] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-13T19:16:51.428702] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-13T19:16:51.429455] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-13T19:16:51.429518] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-13T19:16:51.624325] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-13T19:16:51.801766] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:52.296697] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T19:16:52.417901] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-13T19:16:52.490686] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:16:53.217967] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-13T19:16:54.017951] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-13T19:16:54.175618] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:16:54.574912] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T19:16:54.675918] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:16:54.818028] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-13T19:16:55.618035] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-13T19:16:56.228354] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T19:16:56.417968] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-13T19:16:56.702080] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T19:16:57.013178] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T19:16:57.217957] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-13T19:16:58.017986] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-13T19:16:58.817919] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-13T19:16:58.983848] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T19:16:59.617952] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-13T19:16:59.916638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:17:00.335136] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:17:00.417958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-13T19:17:01.217981] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-13T19:17:01.425260] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:17:01.836412] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T19:17:02.018015] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-13T19:17:02.154374] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:17:02.817990] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-13T19:17:03.617952] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-13T19:17:04.282880] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-13T19:17:04.417984] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-13T19:17:04.677537] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:17:05.180323] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:17:05.184381] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:17:05.217885] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-13T19:17:06.017910] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-13T19:17:06.595883] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T19:17:06.818007] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-13T19:17:07.487782] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:17:07.617993] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-13T19:17:08.116056] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:17:08.418002] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-13T19:17:09.217918] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-13T19:17:09.617864] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:17:10.017975] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-13T19:17:10.414087] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:17:10.451759] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:17:10.817980] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-13T19:17:11.617969] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-13T19:17:12.287550] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:17:12.291517] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T19:17:12.291660] [INFO ] [REMOTE ] GRX: Full fetch complete (6525 records). [2025-10-13T19:17:12.291842] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-13T19:17:12.420326] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-13T19:17:12.678803] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-13T19:17:12.679025] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-13T19:17:12.679284] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-13T19:17:12.679364] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-13T19:17:12.680013] [DEBUG] [LOCAL ] GRX: Trimmed 6525 records to 4762 (keeping 200 days of data) [2025-10-13T19:17:12.709455] [DEBUG] [LOCAL ] GRX: Primary data saved (4762 records). [2025-10-13T19:17:12.709577] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-13T19:17:12.709723] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GRX took 29.2s. Estimated remaining: 3h 16m 23s. Rate: 7.1 symbols/min [2025-10-13T19:17:12.883151] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:12.919237] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T19:17:12.963795] [DEBUG] [LOCAL ] GSL: Loaded 33733 existing records from primary storage. [2025-10-13T19:17:12.964123] [INFO ] [MAIN ] GSL: Loaded 33733 existing records. [2025-10-13T19:17:13.140275] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:13.140525] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-13T19:17:13.140578] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-13T19:17:13.141097] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-13T19:17:13.141173] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-13T19:17:13.223022] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-13T19:17:13.507748] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:14.017972] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-13T19:17:14.051383] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:17:14.817961] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-13T19:17:15.169157] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T19:17:15.304536] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:17:15.617972] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-13T19:17:16.417914] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-13T19:17:16.755387] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T19:17:17.217907] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-13T19:17:17.739289] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T19:17:17.776770] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:17:18.017997] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-13T19:17:18.817981] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-13T19:17:19.239739] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T19:17:19.289039] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:17:19.618049] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-13T19:17:20.417907] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-13T19:17:20.852059] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T19:17:21.012364] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:17:21.217906] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-13T19:17:21.666104] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:17:22.018020] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-13T19:17:22.817984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-13T19:17:23.617963] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-13T19:17:23.745701] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:17:24.071920] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T19:17:24.261072] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:17:24.266482] [INFO ] [REMOTE ] GSBD: Full fetch complete (58567 records). [2025-10-13T19:17:24.266637] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-13T19:17:24.423994] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-13T19:17:24.665032] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-13T19:17:24.665144] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-13T19:17:24.666019] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-13T19:17:24.666083] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-13T19:17:24.667420] [DEBUG] [LOCAL ] GSBD: Trimmed 58567 records to 39619 (keeping 200 days of data) [2025-10-13T19:17:24.926095] [DEBUG] [LOCAL ] GSBD: Primary data saved (39619 records). [2025-10-13T19:17:24.926280] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-13T19:17:24.926395] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSBD took 36.2s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-13T19:17:25.112309] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:25.136955] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:17:25.196149] [DEBUG] [LOCAL ] GTES: Loaded 51168 existing records from primary storage. [2025-10-13T19:17:25.196545] [INFO ] [MAIN ] GTES: Loaded 51168 existing records. [2025-10-13T19:17:25.227575] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-13T19:17:25.383104] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:25.383388] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-13T19:17:25.383439] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-13T19:17:25.384109] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-13T19:17:25.384169] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-13T19:17:25.746256] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:26.018042] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-13T19:17:26.373240] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T19:17:26.382004] [INFO ] [REMOTE ] GSK: Full fetch complete (77473 records). [2025-10-13T19:17:26.382239] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-13T19:17:26.821357] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-13T19:17:26.840165] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:17:26.843668] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-13T19:17:26.865458] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-13T19:17:26.867898] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-13T19:17:26.868204] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-13T19:17:26.871554] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:17:26.878587] [INFO ] [REMOTE ] GS: Full fetch complete (75646 records). [2025-10-13T19:17:26.878950] [DEBUG] [LOCAL ] GSK: Trimmed 77473 records to 53502 (keeping 200 days of data) [2025-10-13T19:17:26.879077] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-13T19:17:27.434275] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-13T19:17:27.435811] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-13T19:17:27.437439] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-13T19:17:27.438683] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-13T19:17:27.451305] [DEBUG] [LOCAL ] GS: Trimmed 75646 records to 51775 (keeping 200 days of data) [2025-10-13T19:17:27.635851] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-13T19:17:27.924520] [DEBUG] [LOCAL ] GSK: Primary data saved (53502 records). [2025-10-13T19:17:27.925851] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-13T19:17:27.926281] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 36.9s. Estimated remaining: 3h 16m 3s. Rate: 7.1 symbols/min [2025-10-13T19:17:28.115332] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:28.236345] [DEBUG] [LOCAL ] GTLS: Loaded 43640 existing records from primary storage. [2025-10-13T19:17:28.238845] [INFO ] [MAIN ] GTLS: Loaded 43640 existing records. [2025-10-13T19:17:28.265989] [DEBUG] [LOCAL ] GS: Primary data saved (51775 records). [2025-10-13T19:17:28.281726] [INFO ] [MAIN ] GS: Full history saved. [2025-10-13T19:17:28.304877] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GS took 42.7s. Estimated remaining: 3h 15m 43s. Rate: 7.1 symbols/min [2025-10-13T19:17:28.603042] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:28.613694] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-13T19:17:28.640826] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:28.632975] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-13T19:17:28.642019] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-13T19:17:28.642336] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-13T19:17:28.777884] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T19:17:28.820102] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-13T19:17:29.038597] [DEBUG] [LOCAL ] GTN: Loaded 45885 existing records from primary storage. [2025-10-13T19:17:29.061985] [INFO ] [MAIN ] GTN: Loaded 45885 existing records. [2025-10-13T19:17:29.190974] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:29.224439] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-13T19:17:29.364499] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:29.364971] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-13T19:17:29.365514] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-13T19:17:29.367285] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:17:29.374446] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-13T19:17:29.374977] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-13T19:17:29.739466] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:30.017951] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-13T19:17:30.441763] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:17:30.532630] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:17:30.817970] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-13T19:17:31.533621] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:17:31.617949] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-13T19:17:32.412263] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:17:32.420919] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-13T19:17:32.905965] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:17:33.217988] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-13T19:17:33.874629] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:17:34.017977] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-13T19:17:34.359140] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:17:34.818005] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-13T19:17:35.263820] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:17:35.617963] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-13T19:17:36.320402] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:17:36.417962] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-13T19:17:36.927098] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:17:37.217969] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-13T19:17:37.651867] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:17:38.017977] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-13T19:17:38.235147] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:17:38.817944] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-13T19:17:39.412902] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:17:39.617971] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-13T19:17:40.412189] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:17:40.422583] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-13T19:17:41.274183] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-13T19:17:41.299320] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:17:41.772244] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:17:42.017975] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-13T19:17:42.785176] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:17:42.817887] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-13T19:17:42.854118] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:17:42.858182] [INFO ] [REMOTE ] GSL: Full fetch complete (48074 records). [2025-10-13T19:17:42.858311] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-13T19:17:43.250011] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-13T19:17:43.250128] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-13T19:17:43.251168] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-13T19:17:43.251232] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-13T19:17:43.252664] [DEBUG] [LOCAL ] GSL: Trimmed 48074 records to 33280 (keeping 200 days of data) [2025-10-13T19:17:43.471710] [DEBUG] [LOCAL ] GSL: Primary data saved (33280 records). [2025-10-13T19:17:43.471907] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-13T19:17:43.472011] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GSL took 30.8s. Estimated remaining: 3h 15m 45s. Rate: 7.1 symbols/min [2025-10-13T19:17:43.623909] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-13T19:17:43.654085] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:43.690232] [DEBUG] [LOCAL ] GTY: Loaded 30692 existing records from primary storage. [2025-10-13T19:17:43.690637] [INFO ] [MAIN ] GTY: Loaded 30692 existing records. [2025-10-13T19:17:43.878360] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:43.878681] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-13T19:17:43.878748] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-13T19:17:43.879064] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-13T19:17:43.879105] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-13T19:17:44.260191] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:44.324553] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:17:44.417965] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-13T19:17:44.935405] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:17:45.217942] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-13T19:17:45.863747] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:17:46.017961] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-13T19:17:46.820004] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-13T19:17:46.822753] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:17:47.614388] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T19:17:47.625185] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-13T19:17:48.431980] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-13T19:17:48.465401] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:17:48.773772] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:17:49.217948] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-13T19:17:50.023858] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-13T19:17:50.042895] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:17:50.747626] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:17:50.818016] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-13T19:17:51.291090] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:17:51.617982] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-13T19:17:52.418019] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-13T19:17:52.482305] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:17:52.941531] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:17:53.221904] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-13T19:17:54.020325] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-13T19:17:54.023875] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:17:54.807085] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:17:54.812755] [INFO ] [REMOTE ] GTES: Full fetch complete (73745 records). [2025-10-13T19:17:54.812904] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-13T19:17:54.825804] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-13T19:17:55.232635] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-13T19:17:55.232778] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-13T19:17:55.234248] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-13T19:17:55.234328] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-13T19:17:55.236351] [DEBUG] [LOCAL ] GTES: Trimmed 73745 records to 50407 (keeping 200 days of data) [2025-10-13T19:17:55.555231] [DEBUG] [LOCAL ] GTES: Primary data saved (50407 records). [2025-10-13T19:17:55.555421] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-13T19:17:55.555527] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTES took 30.6s. Estimated remaining: 3h 15m 41s. Rate: 7.1 symbols/min [2025-10-13T19:17:55.621217] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-13T19:17:55.740248] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:55.777858] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:17:55.796342] [DEBUG] [LOCAL ] GUG: Loaded 12355 existing records from primary storage. [2025-10-13T19:17:55.796724] [INFO ] [MAIN ] GUG: Loaded 12355 existing records. [2025-10-13T19:17:55.986713] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:55.987205] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-13T19:17:55.987372] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-13T19:17:55.987710] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-13T19:17:55.987769] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-13T19:17:56.236097] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T19:17:56.409453] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:56.417896] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-13T19:17:57.217920] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-13T19:17:57.242424] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:17:57.322747] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:17:58.017986] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-13T19:17:58.551771] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:17:58.818002] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-13T19:17:59.610974] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:17:59.622683] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-13T19:18:00.417976] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-13T19:18:00.483619] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:18:00.622434] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T19:18:01.217923] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-13T19:18:02.018007] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-13T19:18:02.127005] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:18:02.133411] [INFO ] [REMOTE ] GTLS: Full fetch complete (61412 records). [2025-10-13T19:18:02.133683] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-13T19:18:02.552176] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-13T19:18:02.552395] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-13T19:18:02.553592] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-13T19:18:02.553684] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-13T19:18:02.555438] [DEBUG] [LOCAL ] GTLS: Trimmed 61412 records to 43230 (keeping 200 days of data) [2025-10-13T19:18:02.822616] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-13T19:18:02.827839] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:18:02.872021] [DEBUG] [LOCAL ] GTLS: Primary data saved (43230 records). [2025-10-13T19:18:02.872183] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-13T19:18:02.872272] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTLS took 34.9s. Estimated remaining: 3h 15m 31s. Rate: 7.1 symbols/min [2025-10-13T19:18:03.041731] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:03.059278] [DEBUG] [LOCAL ] GUT: Loaded 15771 existing records from primary storage. [2025-10-13T19:18:03.059532] [INFO ] [MAIN ] GUT: Loaded 15771 existing records. [2025-10-13T19:18:03.238002] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:03.238362] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-13T19:18:03.238414] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-13T19:18:03.238721] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-13T19:18:03.238778] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-13T19:18:03.607208] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:03.623238] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-13T19:18:03.637877] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:18:03.668458] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:18:04.417914] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-13T19:18:04.442366] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:18:05.065842] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:18:05.217916] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-13T19:18:05.913392] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T19:18:06.018016] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-13T19:18:06.817956] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-13T19:18:07.110695] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:18:07.617922] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-13T19:18:08.103077] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T19:18:08.417896] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-13T19:18:08.482634] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:18:09.217924] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-13T19:18:09.570199] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:18:10.017984] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-13T19:18:10.740572] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T19:18:10.745309] [INFO ] [REMOTE ] GTN: Full fetch complete (66100 records). [2025-10-13T19:18:10.745426] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-13T19:18:10.828132] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-13T19:18:10.865890] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T19:18:11.153448] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-13T19:18:11.153538] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-13T19:18:11.154406] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-13T19:18:11.154469] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-13T19:18:11.155876] [DEBUG] [LOCAL ] GTN: Trimmed 66100 records to 45242 (keeping 200 days of data) [2025-10-13T19:18:11.420661] [DEBUG] [LOCAL ] GTN: Primary data saved (45242 records). [2025-10-13T19:18:11.420810] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-13T19:18:11.420894] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTN took 43.1s. Estimated remaining: 3h 15m 23s. Rate: 7.1 symbols/min [2025-10-13T19:18:11.610143] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:11.617970] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-13T19:18:11.647247] [DEBUG] [LOCAL ] GVA: Loaded 33295 existing records from primary storage. [2025-10-13T19:18:11.647590] [INFO ] [MAIN ] GVA: Loaded 33295 existing records. [2025-10-13T19:18:11.848951] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:11.849189] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-13T19:18:11.849233] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-13T19:18:11.849545] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-13T19:18:11.849603] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-13T19:18:12.210370] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:12.232562] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:18:12.417960] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-13T19:18:12.449601] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T19:18:13.217920] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-13T19:18:13.807799] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:18:13.855982] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T19:18:14.017923] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-13T19:18:14.817972] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-13T19:18:15.387348] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:18:15.617962] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-13T19:18:15.698527] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:18:16.418025] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-13T19:18:16.770031] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T19:18:17.217921] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-13T19:18:17.719156] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:18:18.017996] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-13T19:18:18.176793] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:18:18.817955] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-13T19:18:19.523375] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:18:19.617953] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-13T19:18:19.888709] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:18:20.417920] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-13T19:18:20.465697] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T19:18:21.218001] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-13T19:18:21.710586] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T19:18:21.714139] [INFO ] [REMOTE ] GTY: Full fetch complete (43768 records). [2025-10-13T19:18:21.714258] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-13T19:18:22.023120] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-13T19:18:22.088771] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-13T19:18:22.088883] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-13T19:18:22.089581] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-13T19:18:22.089625] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-13T19:18:22.090785] [DEBUG] [LOCAL ] GTY: Trimmed 43768 records to 30265 (keeping 200 days of data) [2025-10-13T19:18:22.280478] [DEBUG] [LOCAL ] GTY: Primary data saved (30265 records). [2025-10-13T19:18:22.280625] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-13T19:18:22.280738] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTY took 38.8s. Estimated remaining: 3h 15m 18s. Rate: 7.1 symbols/min [2025-10-13T19:18:22.449695] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:22.474165] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:18:22.496036] [DEBUG] [LOCAL ] GWH: Loaded 17652 existing records from primary storage. [2025-10-13T19:18:22.496297] [INFO ] [MAIN ] GWH: Loaded 17652 existing records. [2025-10-13T19:18:22.669390] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:22.669682] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-13T19:18:22.669739] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-13T19:18:22.670022] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-13T19:18:22.670077] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-13T19:18:22.818602] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-13T19:18:22.930175] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T19:18:23.039755] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:23.617969] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-13T19:18:24.284349] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:18:24.415846] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:18:24.418602] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-13T19:18:25.217915] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-13T19:18:25.713858] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:18:26.017967] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-13T19:18:26.027057] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:18:26.028764] [INFO ] [REMOTE ] GUG: Full fetch complete (19325 records). [2025-10-13T19:18:26.028837] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-13T19:18:26.396086] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-13T19:18:26.396208] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-13T19:18:26.396726] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-13T19:18:26.396787] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-13T19:18:26.397330] [DEBUG] [LOCAL ] GUG: Trimmed 19325 records to 12212 (keeping 200 days of data) [2025-10-13T19:18:26.474639] [DEBUG] [LOCAL ] GUG: Primary data saved (12212 records). [2025-10-13T19:18:26.474811] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-13T19:18:26.474993] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUG took 30.9s. Estimated remaining: 3h 15m 4s. Rate: 7.1 symbols/min [2025-10-13T19:18:26.640830] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:26.681279] [DEBUG] [LOCAL ] GWRE: Loaded 40700 existing records from primary storage. [2025-10-13T19:18:26.682696] [INFO ] [MAIN ] GWRE: Loaded 40700 existing records. [2025-10-13T19:18:26.823973] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-13T19:18:26.869801] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:26.871395] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-13T19:18:26.871489] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-13T19:18:26.872036] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-13T19:18:26.872104] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-13T19:18:27.176670] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:18:27.257676] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:27.617979] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-13T19:18:28.309023] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:18:28.335748] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T19:18:28.417990] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-13T19:18:29.217909] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-13T19:18:29.352948] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:18:30.017955] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-13T19:18:30.817905] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-13T19:18:30.854623] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:18:30.887413] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T19:18:30.924841] [DEBUG] [REMOTE ] GVA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-13T19:18:30.925441] [WARN ] [REMOTE ] GVA: No data returned for month 2025-08 [2025-10-13T19:18:30.925547] [FATAL] [REMOTE ] GVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:18:30.925698] [FATAL] [MAIN ] GVA: Failed to fetch primary data. [2025-10-13T19:18:30.925779] [WARN ] [MAIN ] GVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:18:30.925863] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-13T19:18:30.925949] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-13T19:18:30.926043] [INFO ] [LOCAL ] GVA: Starting deletion of derivative data. [2025-10-13T19:18:30.926274] [DEBUG] [LOCAL ] GVA: Deleted derivative data file. [2025-10-13T19:18:30.927189] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 19.5s. Estimated remaining: 3h 14m 49s. Rate: 7.1 symbols/min [2025-10-13T19:18:31.095886] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:31.124394] [DEBUG] [LOCAL ] GWW: Loaded 19737 existing records from primary storage. [2025-10-13T19:18:31.125490] [INFO ] [MAIN ] GWW: Loaded 19737 existing records. [2025-10-13T19:18:31.306397] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:31.307222] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-13T19:18:31.307317] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-13T19:18:31.308258] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-13T19:18:31.308320] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-13T19:18:31.625974] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-13T19:18:31.669147] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:32.417948] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-13T19:18:32.519251] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:18:33.217987] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-13T19:18:33.303828] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:18:34.010827] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:18:34.017875] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-13T19:18:34.793320] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:18:34.817880] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-13T19:18:35.567508] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:18:35.617978] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-13T19:18:36.417908] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-13T19:18:36.528503] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:18:37.217896] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-13T19:18:37.446507] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:18:38.017911] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-13T19:18:38.183608] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T19:18:38.817904] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-13T19:18:39.049937] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:18:39.617925] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-13T19:18:39.738506] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T19:18:39.741129] [INFO ] [REMOTE ] GUT: Full fetch complete (22592 records). [2025-10-13T19:18:39.741222] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-13T19:18:40.115780] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-13T19:18:40.115891] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-13T19:18:40.116882] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-13T19:18:40.116951] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-13T19:18:40.117777] [DEBUG] [LOCAL ] GUT: Trimmed 22592 records to 15567 (keeping 200 days of data) [2025-10-13T19:18:40.220838] [DEBUG] [LOCAL ] GUT: Primary data saved (15567 records). [2025-10-13T19:18:40.221044] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-13T19:18:40.221174] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GUT took 37.3s. Estimated remaining: 3h 14m 42s. Rate: 7.1 symbols/min [2025-10-13T19:18:40.398966] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:40.417980] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-13T19:18:40.462981] [DEBUG] [LOCAL ] GXO: Loaded 47741 existing records from primary storage. [2025-10-13T19:18:40.463380] [INFO ] [MAIN ] GXO: Loaded 47741 existing records. [2025-10-13T19:18:40.653941] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:40.654256] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-13T19:18:40.654310] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-13T19:18:40.654931] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-13T19:18:40.654992] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-13T19:18:41.060108] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:41.231459] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-13T19:18:41.268702] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:18:41.516514] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:18:42.017958] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-13T19:18:42.817966] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-13T19:18:43.023210] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:18:43.539170] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:18:43.617970] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-13T19:18:44.033690] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:18:44.417957] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-13T19:18:45.217920] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-13T19:18:45.301297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T19:18:45.720887] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T19:18:46.016914] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:18:46.023243] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-13T19:18:46.817951] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-13T19:18:47.548714] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T19:18:47.617909] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-13T19:18:47.967994] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:18:48.417975] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-13T19:18:49.217910] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-13T19:18:49.229153] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:18:49.285834] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T19:18:50.017905] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-13T19:18:50.173313] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:18:50.817959] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-13T19:18:51.095765] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:18:51.617978] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-13T19:18:51.657545] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T19:18:52.417953] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-13T19:18:53.217906] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-13T19:18:53.359776] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:18:53.953441] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:18:54.017958] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-13T19:18:54.202364] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T19:18:54.206207] [INFO ] [REMOTE ] GWH: Full fetch complete (22697 records). [2025-10-13T19:18:54.206283] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-13T19:18:54.565453] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-13T19:18:54.565533] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-13T19:18:54.565964] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-13T19:18:54.566023] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-13T19:18:54.566632] [DEBUG] [LOCAL ] GWH: Trimmed 22697 records to 17922 (keeping 200 days of data) [2025-10-13T19:18:54.664426] [DEBUG] [LOCAL ] GWH: Primary data saved (17922 records). [2025-10-13T19:18:54.664562] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-13T19:18:54.664697] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWH took 32.4s. Estimated remaining: 3h 14m 42s. Rate: 7.1 symbols/min [2025-10-13T19:18:54.829964] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-13T19:18:54.833754] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:54.838839] [DEBUG] [LOCAL ] GYLD: Loaded 1575 existing records from primary storage. [2025-10-13T19:18:54.838982] [INFO ] [MAIN ] GYLD: Loaded 1575 existing records. [2025-10-13T19:18:55.039506] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:55.039786] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-13T19:18:55.039838] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-13T19:18:55.039990] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-13T19:18:55.040027] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-13T19:18:55.386284] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:55.617914] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-13T19:18:55.675692] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:18:56.002392] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:18:56.418032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-13T19:18:57.210856] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:18:57.219770] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-13T19:18:58.017923] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-13T19:18:58.083600] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:18:58.143933] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:18:58.817964] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-13T19:18:59.560065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T19:18:59.617962] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-13T19:19:00.332179] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:19:00.417958] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-13T19:19:01.215672] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:19:01.224291] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-13T19:19:01.550387] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-13T19:19:01.568438] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:19:02.018027] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-13T19:19:02.817990] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-13T19:19:03.536479] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:19:03.617951] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-13T19:19:04.425393] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-13T19:19:04.442265] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T19:19:04.793784] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-13T19:19:05.219870] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:19:05.217923] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-13T19:19:06.017959] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-13T19:19:06.312890] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-13T19:19:06.328355] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:19:06.332810] [INFO ] [REMOTE ] GWRE: Full fetch complete (60372 records). [2025-10-13T19:19:06.332950] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-13T19:19:06.733752] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-13T19:19:06.733865] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-13T19:19:06.735112] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-13T19:19:06.735178] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-13T19:19:06.736818] [DEBUG] [LOCAL ] GWRE: Trimmed 60372 records to 40055 (keeping 200 days of data) [2025-10-13T19:19:06.828932] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-13T19:19:07.002977] [DEBUG] [LOCAL ] GWRE: Primary data saved (40055 records). [2025-10-13T19:19:07.003164] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-13T19:19:07.003282] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWRE took 40.5s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-13T19:19:07.179673] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:07.233959] [DEBUG] [LOCAL ] H: Loaded 45165 existing records from primary storage. [2025-10-13T19:19:07.234374] [INFO ] [MAIN ] H: Loaded 45165 existing records. [2025-10-13T19:19:07.433683] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:07.434003] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-13T19:19:07.434083] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-13T19:19:07.434512] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-13T19:19:07.434555] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-13T19:19:07.623149] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-13T19:19:07.802999] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:07.972474] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T19:19:07.975328] [INFO ] [REMOTE ] GWW: Full fetch complete (29072 records). [2025-10-13T19:19:07.975404] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-13T19:19:08.229354] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:19:08.356414] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-13T19:19:08.356516] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-13T19:19:08.357553] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-13T19:19:08.357622] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-13T19:19:08.358506] [DEBUG] [LOCAL ] GWW: Trimmed 29072 records to 19568 (keeping 200 days of data) [2025-10-13T19:19:08.429538] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-13T19:19:08.500356] [DEBUG] [LOCAL ] GWW: Primary data saved (19568 records). [2025-10-13T19:19:08.500561] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-13T19:19:08.500715] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 37.6s. Estimated remaining: 3h 14m 21s. Rate: 7.1 symbols/min [2025-10-13T19:19:08.678867] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:08.722011] [DEBUG] [LOCAL ] HAE: Loaded 40041 existing records from primary storage. [2025-10-13T19:19:08.722317] [INFO ] [MAIN ] HAE: Loaded 40041 existing records. [2025-10-13T19:19:08.900541] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:08.900870] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-13T19:19:08.900934] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-13T19:19:08.901395] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-13T19:19:08.901454] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-13T19:19:09.222557] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-13T19:19:09.307061] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:09.932933] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:19:10.018047] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-13T19:19:10.801137] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T19:19:10.817883] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-13T19:19:10.951368] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T19:19:11.617971] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-13T19:19:12.363339] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:19:12.368615] [INFO ] [REMOTE ] GXO: Full fetch complete (69630 records). [2025-10-13T19:19:12.368809] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-13T19:19:12.423051] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-13T19:19:12.814489] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-13T19:19:12.814629] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-13T19:19:12.815730] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-13T19:19:12.815808] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-13T19:19:12.817270] [DEBUG] [LOCAL ] GXO: Trimmed 69630 records to 46910 (keeping 200 days of data) [2025-10-13T19:19:13.067589] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:19:13.133433] [DEBUG] [LOCAL ] GXO: Primary data saved (46910 records). [2025-10-13T19:19:13.133593] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-13T19:19:13.133703] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 32.9s. Estimated remaining: 3h 14m 7s. Rate: 7.1 symbols/min [2025-10-13T19:19:13.224808] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-13T19:19:13.309366] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:13.351572] [DEBUG] [LOCAL ] HAFN: Loaded 43736 existing records from primary storage. [2025-10-13T19:19:13.352063] [INFO ] [MAIN ] HAFN: Loaded 43736 existing records. [2025-10-13T19:19:13.556272] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:13.556745] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-13T19:19:13.556880] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-13T19:19:13.557878] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-13T19:19:13.557958] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-13T19:19:13.917878] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:13.940474] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:19:14.017904] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-13T19:19:14.669064] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:19:14.817956] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-13T19:19:15.262736] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T19:19:15.587449] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:19:15.617895] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-13T19:19:16.418000] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-13T19:19:17.217971] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-13T19:19:17.530143] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:19:17.582079] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:19:18.017923] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-13T19:19:18.105706] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:19:18.818009] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-13T19:19:19.617961] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-13T19:19:20.309266] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:19:20.417980] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-13T19:19:20.778248] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T19:19:20.871334] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T19:19:21.217922] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-13T19:19:22.018021] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-13T19:19:22.772410] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T19:19:22.817922] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-13T19:19:23.233386] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (5.22 seconds). [2025-10-13T19:19:23.511032] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:19:23.618005] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-13T19:19:24.417900] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-13T19:19:24.489678] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:19:24.721063] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-13T19:19:25.226521] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-13T19:19:25.244532] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:19:25.686447] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:19:26.017972] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-13T19:19:26.817989] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-13T19:19:27.617988] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-13T19:19:27.650235] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:19:28.192118] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:19:28.417979] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-13T19:19:29.217974] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-13T19:19:29.385342] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:19:29.690055] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:19:30.023221] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-13T19:19:30.029156] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:19:30.817993] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-13T19:19:31.617992] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-13T19:19:31.671737] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:19:32.298530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:19:32.303803] [INFO ] [REMOTE ] H: Full fetch complete (62671 records). [2025-10-13T19:19:32.303991] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-13T19:19:32.423049] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-13T19:19:32.711443] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-13T19:19:32.711570] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-13T19:19:32.712728] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-13T19:19:32.712797] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-13T19:19:32.714739] [DEBUG] [LOCAL ] H: Trimmed 62671 records to 44516 (keeping 200 days of data) [2025-10-13T19:19:32.914370] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T19:19:32.915866] [INFO ] [REMOTE ] GYLD: Full fetch complete (2107 records). [2025-10-13T19:19:32.928431] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-13T19:19:33.235930] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-13T19:19:33.410524] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-13T19:19:33.413396] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-13T19:19:33.414625] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-13T19:19:33.414329] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:19:33.415318] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-13T19:19:33.426157] [DEBUG] [LOCAL ] GYLD: Trimmed 2107 records to 1541 (keeping 200 days of data) [2025-10-13T19:19:33.442884] [DEBUG] [LOCAL ] GYLD: Primary data saved (1541 records). [2025-10-13T19:19:33.443583] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-13T19:19:33.443819] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. GYLD took 38.8s. Estimated remaining: 3h 14m 15s. Rate: 7.1 symbols/min [2025-10-13T19:19:33.636920] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:33.684054] [DEBUG] [LOCAL ] H: Primary data saved (44516 records). [2025-10-13T19:19:33.684243] [INFO ] [MAIN ] H: Full history saved. [2025-10-13T19:19:33.684353] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. H took 26.7s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-10-13T19:19:33.903678] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:33.905859] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-13T19:19:33.906792] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-10-13T19:19:34.023198] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-13T19:19:34.130272] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:34.143099] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-13T19:19:34.143202] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-13T19:19:34.144527] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-13T19:19:34.144594] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-13T19:19:34.292737] [DEBUG] [LOCAL ] HASI: Loaded 47989 existing records from primary storage. [2025-10-13T19:19:34.330312] [INFO ] [MAIN ] HASI: Loaded 47989 existing records. [2025-10-13T19:19:34.667283] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:34.678927] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-13T19:19:34.684286] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-13T19:19:34.705296] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-13T19:19:34.705526] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-13T19:19:34.791220] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:34.821486] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-13T19:19:35.073971] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T19:19:35.189853] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:35.617923] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-13T19:19:35.955474] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:19:36.417957] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-13T19:19:36.941023] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T19:19:37.073837] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:19:37.217971] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-13T19:19:37.995205] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:19:38.017979] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-13T19:19:38.817916] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-13T19:19:39.172829] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T19:19:39.617987] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-13T19:19:39.653907] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:19:40.198975] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T19:19:40.417970] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-13T19:19:41.218002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-13T19:19:41.470091] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T19:19:41.958575] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:19:42.017925] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-13T19:19:42.517083] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:19:42.817984] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-13T19:19:43.617996] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-13T19:19:43.943107] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T19:19:44.241936] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:19:44.418002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-13T19:19:45.223034] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-13T19:19:45.237901] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T19:19:45.971149] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:19:46.017909] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-13T19:19:46.817977] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-13T19:19:47.234149] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T19:19:47.618044] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-13T19:19:47.690461] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:19:48.316812] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:19:48.417889] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-13T19:19:49.217922] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-13T19:19:49.750546] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T19:19:50.017926] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-13T19:19:50.136740] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:19:50.818044] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-13T19:19:51.041720] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:19:51.047192] [INFO ] [REMOTE ] HAE: Full fetch complete (58605 records). [2025-10-13T19:19:51.047346] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-13T19:19:51.443629] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-13T19:19:51.443741] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-13T19:19:51.444502] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-13T19:19:51.444544] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-13T19:19:51.445767] [DEBUG] [LOCAL ] HAE: Trimmed 58605 records to 39430 (keeping 200 days of data) [2025-10-13T19:19:51.639100] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-13T19:19:51.680161] [DEBUG] [LOCAL ] HAE: Primary data saved (39430 records). [2025-10-13T19:19:51.680349] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-13T19:19:51.681390] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAE took 43.2s. Estimated remaining: 3h 14m 0s. Rate: 7.1 symbols/min [2025-10-13T19:19:51.852732] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:51.904818] [DEBUG] [LOCAL ] HAYW: Loaded 49473 existing records from primary storage. [2025-10-13T19:19:51.905162] [INFO ] [MAIN ] HAYW: Loaded 49473 existing records. [2025-10-13T19:19:52.087025] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:52.087495] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-13T19:19:52.087580] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-13T19:19:52.088314] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-13T19:19:52.088437] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-13T19:19:52.380581] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-13T19:19:52.422287] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-13T19:19:52.514911] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:52.549349] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:19:53.180138] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:19:53.185327] [INFO ] [REMOTE ] HAFN: Full fetch complete (65036 records). [2025-10-13T19:19:53.185520] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-13T19:19:53.223109] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-13T19:19:53.607125] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-13T19:19:53.607257] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-13T19:19:53.608833] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-13T19:19:53.608913] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-13T19:19:53.611012] [DEBUG] [LOCAL ] HAFN: Trimmed 65036 records to 43057 (keeping 200 days of data) [2025-10-13T19:19:53.879380] [DEBUG] [LOCAL ] HAFN: Primary data saved (43057 records). [2025-10-13T19:19:53.879896] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-13T19:19:53.880032] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAFN took 40.7s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-13T19:19:54.029901] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-13T19:19:54.066287] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:54.075952] [DEBUG] [LOCAL ] HBB: Loaded 6551 existing records from primary storage. [2025-10-13T19:19:54.076564] [INFO ] [MAIN ] HBB: Loaded 6551 existing records. [2025-10-13T19:19:54.259237] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:54.259590] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-13T19:19:54.259926] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-13T19:19:54.260431] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-13T19:19:54.260559] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-13T19:19:54.711906] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:54.717958] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T19:19:54.817885] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-13T19:19:55.014475] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:19:55.617926] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-13T19:19:55.739858] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:19:56.417992] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-13T19:19:56.522426] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:19:56.696180] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T19:19:57.217925] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-13T19:19:57.682476] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T19:19:58.017913] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-13T19:19:58.022419] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:19:58.817962] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-13T19:19:59.617904] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-13T19:20:00.012122] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T19:20:00.412586] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:20:00.421940] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-13T19:20:00.844685] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:20:00.985837] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:20:01.217927] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-13T19:20:01.977592] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T19:20:02.017959] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-13T19:20:02.823100] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-13T19:20:02.832241] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:20:02.838473] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-13T19:20:02.838688] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-13T19:20:03.242324] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-13T19:20:03.242407] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-13T19:20:03.243329] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-13T19:20:03.243392] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-13T19:20:03.245000] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-13T19:20:03.570412] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-13T19:20:03.570550] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-13T19:20:03.570634] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAL took 30.1s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-13T19:20:03.624557] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-13T19:20:03.739429] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:03.786349] [DEBUG] [LOCAL ] HBI: Loaded 53755 existing records from primary storage. [2025-10-13T19:20:03.786740] [INFO ] [MAIN ] HBI: Loaded 53755 existing records. [2025-10-13T19:20:03.961837] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:03.962069] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-13T19:20:03.962117] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-13T19:20:03.963136] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-13T19:20:03.963194] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-13T19:20:04.318011] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:04.358010] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:20:04.417900] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-13T19:20:05.217967] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-13T19:20:05.267597] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:20:05.765045] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:20:05.931500] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:20:06.017962] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-13T19:20:06.781083] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:20:06.817969] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-13T19:20:07.617923] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-13T19:20:08.267975] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:20:08.417897] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-13T19:20:08.598821] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:20:09.217905] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-13T19:20:10.017293] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:20:10.026679] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-13T19:20:10.793320] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:20:10.798732] [INFO ] [REMOTE ] HASI: Full fetch complete (68039 records). [2025-10-13T19:20:10.798947] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-13T19:20:10.823118] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-13T19:20:11.183832] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-13T19:20:11.183925] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-13T19:20:11.184924] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-13T19:20:11.184989] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-13T19:20:11.186485] [DEBUG] [LOCAL ] HASI: Trimmed 68039 records to 47474 (keeping 200 days of data) [2025-10-13T19:20:11.477952] [DEBUG] [LOCAL ] HASI: Primary data saved (47474 records). [2025-10-13T19:20:11.478264] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-13T19:20:11.478384] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 37.8s. Estimated remaining: 3h 13m 27s. Rate: 7.1 symbols/min [2025-10-13T19:20:11.559158] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T19:20:11.627354] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-13T19:20:11.659515] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:11.688913] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:20:11.743835] [DEBUG] [LOCAL ] HBM: Loaded 53708 existing records from primary storage. [2025-10-13T19:20:11.744168] [INFO ] [MAIN ] HBM: Loaded 53708 existing records. [2025-10-13T19:20:11.919726] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:11.919994] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-13T19:20:11.920043] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-13T19:20:11.921064] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-13T19:20:11.921123] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-13T19:20:12.279376] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:12.417989] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-13T19:20:12.505199] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T19:20:13.217925] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-13T19:20:14.018689] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-13T19:20:14.034181] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:20:14.594508] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:20:14.817926] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-13T19:20:14.923121] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:20:15.617991] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-13T19:20:16.300479] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T19:20:16.301695] [INFO ] [REMOTE ] HBB: Full fetch complete (9411 records). [2025-10-13T19:20:16.301771] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-13T19:20:16.422370] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-13T19:20:16.693229] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:20:16.724949] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-13T19:20:16.725077] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-13T19:20:16.725367] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-13T19:20:16.725408] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-13T19:20:16.725859] [DEBUG] [LOCAL ] HBB: Trimmed 9411 records to 6478 (keeping 200 days of data) [2025-10-13T19:20:16.763993] [DEBUG] [LOCAL ] HBB: Primary data saved (6478 records). [2025-10-13T19:20:16.764080] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-13T19:20:16.764156] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBB took 22.9s. Estimated remaining: 3h 13m 15s. Rate: 7.1 symbols/min [2025-10-13T19:20:17.217967] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-13T19:20:18.018014] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-13T19:20:18.202543] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T19:20:18.817897] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-13T19:20:18.902508] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:20:19.122546] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:20:19.617901] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-13T19:20:20.417967] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-13T19:20:20.612960] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:20:20.722192] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:20:21.217995] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-13T19:20:22.022747] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-13T19:20:22.025501] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:20:22.797208] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:20:22.817889] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-13T19:20:23.593461] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T19:20:23.617881] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-13T19:20:24.417983] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-13T19:20:24.556439] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:20:25.221423] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-13T19:20:25.227379] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:20:25.977632] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:20:26.018021] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-13T19:20:26.731594] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:20:26.817890] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-13T19:20:27.536578] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:20:27.617954] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-13T19:20:28.174311] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:20:28.417920] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-13T19:20:29.217903] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-13T19:20:29.415155] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:20:29.997420] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T19:20:30.017887] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-13T19:20:30.818045] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-13T19:20:31.172266] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T19:20:31.178174] [INFO ] [REMOTE ] HBI: Full fetch complete (76867 records). [2025-10-13T19:20:31.178347] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-13T19:20:31.453073] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:20:31.495380] [INFO ] [REMOTE ] HAYW: Full fetch complete (70728 records). [2025-10-13T19:20:31.498330] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-13T19:20:31.734304] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-13T19:20:31.753011] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-13T19:20:31.770348] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-13T19:20:31.804757] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-13T19:20:31.914635] [DEBUG] [LOCAL ] HBI: Trimmed 76867 records to 52982 (keeping 200 days of data) [2025-10-13T19:20:32.057905] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-13T19:20:32.067919] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-13T19:20:32.098588] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-13T19:20:32.105747] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-13T19:20:32.128712] [DEBUG] [LOCAL ] HAYW: Trimmed 70728 records to 48879 (keeping 200 days of data) [2025-10-13T19:20:32.568404] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:20:32.582677] [DEBUG] [LOCAL ] HBI: Primary data saved (52982 records). [2025-10-13T19:20:32.583866] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-13T19:20:32.584095] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 29.0s. Estimated remaining: 3h 13m 16s. Rate: 7.1 symbols/min [2025-10-13T19:20:32.588315] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-13T19:20:32.660950] [DEBUG] [LOCAL ] HAYW: Primary data saved (48879 records). [2025-10-13T19:20:32.661092] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-13T19:20:32.661731] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HAYW took 41.0s. Estimated remaining: 3h 12m 56s. Rate: 7.1 symbols/min [2025-10-13T19:20:34.402919] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:20:34.414828] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-13T19:20:36.213906] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:20:36.225211] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-13T19:20:38.084050] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:20:38.095427] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-13T19:20:39.977515] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:20:39.983130] [INFO ] [REMOTE ] HBM: Full fetch complete (76399 records). [2025-10-13T19:20:39.983262] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-13T19:20:40.379156] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-13T19:20:40.379281] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-13T19:20:40.380231] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-13T19:20:40.380328] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-13T19:20:40.382273] [DEBUG] [LOCAL ] HBM: Trimmed 76399 records to 52941 (keeping 200 days of data) [2025-10-13T19:20:40.690281] [DEBUG] [LOCAL ] HBM: Primary data saved (52941 records). [2025-10-13T19:20:40.690381] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-13T19:20:40.690475] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 29.2s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-13T19:20:41.296475] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.386099] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-13T19:20:41.387238] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.389453] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-13T19:20:41.394535] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.409721] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-13T19:20:41.413107] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.413440] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-13T19:20:41.414276] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-13T19:20:41.414428] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-13T19:20:41.620171] [DEBUG] [LOCAL ] HCI: Loaded 14343 existing records from primary storage. [2025-10-13T19:20:41.660721] [INFO ] [MAIN ] HCI: Loaded 14343 existing records. [2025-10-13T19:20:41.848240] [DEBUG] [LOCAL ] HCC: Loaded 45904 existing records from primary storage. [2025-10-13T19:20:41.911266] [INFO ] [MAIN ] HCC: Loaded 45904 existing records. [2025-10-13T19:20:41.952914] [DEBUG] [LOCAL ] HCA: Loaded 47601 existing records from primary storage. [2025-10-13T19:20:41.975147] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:42.010362] [INFO ] [MAIN ] HCA: Loaded 47601 existing records. [2025-10-13T19:20:42.010702] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-13T19:20:42.173528] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.240080] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.259327] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-13T19:20:42.268497] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-13T19:20:42.268689] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-13T19:20:42.450671] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.461844] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.507797] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.534005] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-13T19:20:42.526938] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-13T19:20:42.535316] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-13T19:20:42.534308] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.536546] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-13T19:20:42.536911] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-13T19:20:42.552663] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-13T19:20:42.597788] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-13T19:20:42.672515] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-13T19:20:42.888582] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T19:20:42.982237] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-13T19:20:43.317440] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.354877] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-13T19:20:43.381831] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-13T19:20:43.433183] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-13T19:20:43.700797] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.706505] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-13T19:20:43.787778] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.788198] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-13T19:20:43.790944] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-13T19:20:43.791941] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-13T19:20:44.021807] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-13T19:20:44.022667] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-13T19:20:44.253953] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-13T19:20:44.254829] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-13T19:20:44.490521] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:20:44.494721] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-13T19:20:44.499476] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-13T19:20:44.500529] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-13T19:20:44.727310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-13T19:20:44.728353] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-13T19:20:44.995196] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-13T19:20:45.029686] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:20:45.217909] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-13T19:20:45.388190] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:20:45.450888] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-13T19:20:45.494488] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:20:46.017955] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-13T19:20:46.342377] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-13T19:20:46.343104] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-13T19:20:46.343198] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-13T19:20:46.343555] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T19:20:46.343660] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:20:46.343720] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:20:46.343785] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-13T19:20:46.343843] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-13T19:20:46.343878] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-13T19:20:46.343917] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-13T19:20:46.344035] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 5.6s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-13T19:20:46.517771] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:46.579761] [DEBUG] [LOCAL ] HD: Loaded 54268 existing records from primary storage. [2025-10-13T19:20:46.580129] [INFO ] [MAIN ] HD: Loaded 54268 existing records. [2025-10-13T19:20:46.765889] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:46.766061] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-13T19:20:46.766107] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-13T19:20:46.766614] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-13T19:20:46.766703] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-13T19:20:46.823060] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-13T19:20:47.137997] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:47.617919] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-13T19:20:48.403718] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:20:48.417885] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-13T19:20:48.464016] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:20:49.217927] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-13T19:20:49.718316] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:20:50.017971] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-13T19:20:50.149861] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:20:50.817988] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-13T19:20:51.410465] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T19:20:51.618022] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-13T19:20:52.385146] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T19:20:52.417917] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-13T19:20:53.217907] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-13T19:20:53.291503] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:20:53.729574] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T19:20:54.017913] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-13T19:20:54.817908] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-13T19:20:55.365195] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T19:20:55.475601] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:20:55.617906] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-13T19:20:55.816895] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:20:56.417918] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-13T19:20:57.217916] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-13T19:20:57.287104] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T19:20:57.521803] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:20:58.018007] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-13T19:20:58.490408] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:20:58.817906] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-13T19:20:59.617917] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-13T19:21:00.243235] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T19:21:00.417960] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-13T19:21:00.463975] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:21:00.639286] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:21:01.217962] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-13T19:21:02.018009] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-13T19:21:02.656808] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T19:21:02.818042] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-13T19:21:02.954596] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:21:03.629808] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-13T19:21:03.652242] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:21:03.849427] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:21:04.421634] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-13T19:21:05.217927] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-13T19:21:05.856351] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-13T19:21:05.922272] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:21:06.017925] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-13T19:21:06.139310] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:21:06.817920] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-13T19:21:07.618002] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-13T19:21:07.904299] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:21:08.417927] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-13T19:21:09.087278] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T19:21:09.217900] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-13T19:21:09.466408] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:21:10.017953] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-13T19:21:10.240954] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:21:10.818000] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-13T19:21:10.959276] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:21:11.357391] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T19:21:11.617913] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-13T19:21:12.417904] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-13T19:21:12.537686] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:21:13.217889] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-13T19:21:13.652048] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:21:13.656762] [INFO ] [REMOTE ] HCC: Full fetch complete (64592 records). [2025-10-13T19:21:13.656880] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-13T19:21:14.020141] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-13T19:21:14.074773] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-13T19:21:14.105631] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-13T19:21:14.105728] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-13T19:21:14.106745] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-13T19:21:14.107055] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-13T19:21:14.108799] [DEBUG] [LOCAL ] HCC: Trimmed 64592 records to 45223 (keeping 200 days of data) [2025-10-13T19:21:14.380805] [DEBUG] [LOCAL ] HCC: Primary data saved (45223 records). [2025-10-13T19:21:14.380942] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-13T19:21:14.382114] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCC took 33.7s. Estimated remaining: 3h 12m 54s. Rate: 7.1 symbols/min [2025-10-13T19:21:14.553795] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:14.609807] [DEBUG] [LOCAL ] HDB: Loaded 52716 existing records from primary storage. [2025-10-13T19:21:14.610123] [INFO ] [MAIN ] HDB: Loaded 52716 existing records. [2025-10-13T19:21:14.787034] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:14.787905] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-13T19:21:14.788123] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-13T19:21:14.788416] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-13T19:21:14.788463] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-13T19:21:14.827202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-13T19:21:15.032249] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:21:15.090305] [INFO ] [REMOTE ] HCI: Full fetch complete (19490 records). [2025-10-13T19:21:15.128419] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-13T19:21:15.141125] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:21:15.304573] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:15.615853] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-13T19:21:15.615953] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-13T19:21:15.616609] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-13T19:21:15.616731] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-13T19:21:15.617918] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-13T19:21:15.619044] [DEBUG] [LOCAL ] HCI: Trimmed 19490 records to 14057 (keeping 200 days of data) [2025-10-13T19:21:15.714693] [DEBUG] [LOCAL ] HCI: Primary data saved (14057 records). [2025-10-13T19:21:15.714871] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-13T19:21:15.714962] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCI took 35.0s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-13T19:21:15.881800] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:15.930178] [DEBUG] [LOCAL ] HE: Loaded 49673 existing records from primary storage. [2025-10-13T19:21:15.930566] [INFO ] [MAIN ] HE: Loaded 49673 existing records. [2025-10-13T19:21:16.120202] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:16.120436] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-13T19:21:16.120529] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-13T19:21:16.121050] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-13T19:21:16.121108] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-13T19:21:16.423220] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-13T19:21:16.503078] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:17.040427] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T19:21:17.217879] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-13T19:21:17.292846] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T19:21:17.298889] [INFO ] [REMOTE ] HCA: Full fetch complete (68718 records). [2025-10-13T19:21:17.299003] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-13T19:21:17.678444] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-13T19:21:17.678553] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-13T19:21:17.679604] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-13T19:21:17.679746] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-13T19:21:17.681354] [DEBUG] [LOCAL ] HCA: Trimmed 68718 records to 46919 (keeping 200 days of data) [2025-10-13T19:21:17.945944] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:21:18.016427] [DEBUG] [LOCAL ] HCA: Primary data saved (46919 records). [2025-10-13T19:21:18.016571] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-13T19:21:18.016680] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HCA took 37.3s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-13T19:21:18.022684] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-13T19:21:18.183737] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:18.214520] [DEBUG] [LOCAL ] HEI: Loaded 32017 existing records from primary storage. [2025-10-13T19:21:18.214833] [INFO ] [MAIN ] HEI: Loaded 32017 existing records. [2025-10-13T19:21:18.390024] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:18.390223] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-13T19:21:18.390270] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-13T19:21:18.391077] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-13T19:21:18.391135] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-13T19:21:18.740715] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:18.817976] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-13T19:21:19.313601] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-13T19:21:19.617928] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-13T19:21:19.889600] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T19:21:20.417978] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-13T19:21:20.541325] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:21:21.217894] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-13T19:21:21.720694] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T19:21:21.762251] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T19:21:22.017926] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-13T19:21:22.799341] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:21:22.817896] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-13T19:21:23.617904] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-13T19:21:23.822152] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:21:24.418038] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-13T19:21:24.508338] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T19:21:24.658590] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:21:25.218029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-13T19:21:26.017906] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-13T19:21:26.131171] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T19:21:26.817922] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-13T19:21:27.042926] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T19:21:27.457618] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:21:27.617912] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-13T19:21:28.417910] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-13T19:21:28.603567] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:21:28.731729] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-13T19:21:28.738568] [INFO ] [REMOTE ] HD: Full fetch complete (77444 records). [2025-10-13T19:21:28.738722] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-13T19:21:29.158576] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-13T19:21:29.158870] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-13T19:21:29.160800] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-13T19:21:29.160916] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-13T19:21:29.183311] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:21:29.192292] [DEBUG] [LOCAL ] HD: Trimmed 77444 records to 53493 (keeping 200 days of data) [2025-10-13T19:21:29.265581] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-13T19:21:29.576732] [DEBUG] [LOCAL ] HD: Primary data saved (53493 records). [2025-10-13T19:21:29.577031] [INFO ] [MAIN ] HD: Full history saved. [2025-10-13T19:21:29.577255] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 43.2s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-13T19:21:29.751602] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:29.761255] [DEBUG] [LOCAL ] HEQ: Loaded 6748 existing records from primary storage. [2025-10-13T19:21:29.761506] [INFO ] [MAIN ] HEQ: Loaded 6748 existing records. [2025-10-13T19:21:29.955268] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:29.955509] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-13T19:21:29.955558] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-13T19:21:29.955782] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-13T19:21:29.955840] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-13T19:21:30.023175] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-13T19:21:30.323734] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:30.710951] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:21:30.817952] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-13T19:21:31.617994] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-13T19:21:31.768384] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:21:32.010541] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T19:21:32.418002] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-13T19:21:33.055899] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:21:33.217918] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-13T19:21:33.803083] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T19:21:34.017980] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-13T19:21:34.817979] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-13T19:21:34.960485] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:21:35.304764] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:21:35.617979] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-13T19:21:36.418013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-13T19:21:36.570405] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:21:37.032214] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T19:21:37.218008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-13T19:21:37.278982] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:21:37.697196] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:21:38.017929] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-13T19:21:38.817925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-13T19:21:39.429577] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T19:21:39.617925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-13T19:21:39.758315] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:21:40.206160] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:21:40.417926] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-13T19:21:41.217968] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-13T19:21:42.017903] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-13T19:21:42.144235] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:21:42.818036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-13T19:21:42.905532] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:21:43.439563] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:21:43.617925] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-13T19:21:44.417911] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-13T19:21:44.559842] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T19:21:44.844773] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:21:45.217955] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-13T19:21:46.018037] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-13T19:21:46.234736] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:21:46.817905] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-13T19:21:46.861380] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:21:46.864281] [INFO ] [REMOTE ] HEI: Full fetch complete (47746 records). [2025-10-13T19:21:46.864409] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-13T19:21:47.140092] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T19:21:47.183686] [INFO ] [REMOTE ] HDB: Full fetch complete (75343 records). [2025-10-13T19:21:47.183851] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-13T19:21:47.392099] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-13T19:21:47.392339] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-13T19:21:47.393164] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-13T19:21:47.393447] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-13T19:21:47.451536] [DEBUG] [LOCAL ] HEI: Trimmed 47746 records to 31410 (keeping 200 days of data) [2025-10-13T19:21:47.594389] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:21:47.633834] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-13T19:21:47.816988] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-13T19:21:47.817820] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-13T19:21:47.819486] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-13T19:21:47.819986] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-13T19:21:47.825876] [DEBUG] [LOCAL ] HDB: Trimmed 75343 records to 51946 (keeping 200 days of data) [2025-10-13T19:21:48.019357] [DEBUG] [LOCAL ] HEI: Primary data saved (31410 records). [2025-10-13T19:21:48.022933] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-13T19:21:48.023758] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 30.0s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-13T19:21:48.226818] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:48.383885] [DEBUG] [LOCAL ] HESM: Loaded 49040 existing records from primary storage. [2025-10-13T19:21:48.385718] [INFO ] [MAIN ] HESM: Loaded 49040 existing records. [2025-10-13T19:21:48.424712] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-13T19:21:48.661144] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:48.664893] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-13T19:21:48.665555] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-13T19:21:48.667462] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-13T19:21:48.667910] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-13T19:21:48.843163] [DEBUG] [LOCAL ] HDB: Primary data saved (51946 records). [2025-10-13T19:21:48.886717] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-13T19:21:48.909735] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HDB took 34.5s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-13T19:21:49.174816] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T19:21:49.232003] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:49.241204] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-13T19:21:49.242674] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-13T19:21:49.238608] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:49.242815] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-13T19:21:49.243275] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-13T19:21:49.243593] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-13T19:21:49.243794] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-13T19:21:49.243951] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-13T19:21:49.560209] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T19:21:49.648713] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:49.843968] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T19:21:50.018009] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-13T19:21:50.817927] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-13T19:21:51.625128] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-13T19:21:51.627150] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:21:51.632386] [INFO ] [REMOTE ] HE: Full fetch complete (72151 records). [2025-10-13T19:21:51.632505] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-13T19:21:52.047048] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:21:52.066304] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-13T19:21:52.066384] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-13T19:21:52.067360] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-13T19:21:52.067427] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-13T19:21:52.069104] [DEBUG] [LOCAL ] HE: Trimmed 72151 records to 48960 (keeping 200 days of data) [2025-10-13T19:21:52.386985] [DEBUG] [LOCAL ] HE: Primary data saved (48960 records). [2025-10-13T19:21:52.387134] [INFO ] [MAIN ] HE: Full history saved. [2025-10-13T19:21:52.387784] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HE took 36.7s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-13T19:21:52.420084] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-13T19:21:52.427907] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:21:52.576331] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:52.576545] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-13T19:21:52.576584] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-13T19:21:52.576731] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-13T19:21:52.576777] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-13T19:21:52.576819] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-13T19:21:52.576852] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-13T19:21:52.839105] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T19:21:52.945000] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:53.217925] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-13T19:21:53.457583] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-13T19:21:54.018028] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-13T19:21:54.818013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-13T19:21:55.513289] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T19:21:55.602873] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:21:55.617881] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-13T19:21:56.417907] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-13T19:21:56.861784] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T19:21:57.152805] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:21:57.217896] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-13T19:21:57.800703] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T19:21:58.017978] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-13T19:21:58.437816] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T19:21:58.817979] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-13T19:21:59.065316] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-13T19:21:59.617923] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-13T19:22:00.417997] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-13T19:22:01.165994] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T19:22:01.207728] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T19:22:01.217999] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-13T19:22:01.980536] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:22:02.018022] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-13T19:22:02.451937] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T19:22:02.817947] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-13T19:22:03.060139] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-13T19:22:03.617966] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-13T19:22:04.035156] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T19:22:04.417911] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-13T19:22:05.217982] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-13T19:22:05.473788] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-13T19:22:05.534952] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T19:22:06.018003] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-13T19:22:06.817928] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-13T19:22:07.585529] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:22:07.586847] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:22:07.597377] [INFO ] [REMOTE ] HEQ: Full fetch complete (9550 records). [2025-10-13T19:22:07.597670] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-13T19:22:07.626790] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-13T19:22:07.961101] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-13T19:22:07.960907] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:22:07.961288] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-13T19:22:07.962628] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-13T19:22:07.962723] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-13T19:22:07.963212] [DEBUG] [LOCAL ] HEQ: Trimmed 9550 records to 6723 (keeping 200 days of data) [2025-10-13T19:22:08.002730] [DEBUG] [LOCAL ] HEQ: Primary data saved (6723 records). [2025-10-13T19:22:08.002849] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-13T19:22:08.002943] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HEQ took 38.4s. Estimated remaining: 3h 11m 47s. Rate: 7.1 symbols/min [2025-10-13T19:22:08.168623] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:08.185266] [DEBUG] [LOCAL ] HFRO: Loaded 17645 existing records from primary storage. [2025-10-13T19:22:08.185512] [INFO ] [MAIN ] HFRO: Loaded 17645 existing records. [2025-10-13T19:22:08.372849] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:08.373075] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-13T19:22:08.373123] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-13T19:22:08.373779] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-13T19:22:08.373842] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-13T19:22:08.423097] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-13T19:22:08.756008] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:08.898074] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T19:22:09.217962] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-13T19:22:10.017965] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-13T19:22:10.379143] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T19:22:10.396962] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:22:10.817975] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-13T19:22:11.617926] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-13T19:22:11.869499] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-13T19:22:12.417909] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-13T19:22:12.485631] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T19:22:13.217902] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-13T19:22:13.530367] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T19:22:13.617121] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T19:22:13.618170] [INFO ] [REMOTE ] HF: Full fetch complete (438 records). [2025-10-13T19:22:13.618240] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-13T19:22:13.818370] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-13T19:22:13.818635] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:22:13.818734] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:22:13.818811] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-13T19:22:13.818879] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-13T19:22:13.818916] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-13T19:22:13.818958] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-13T19:22:13.819030] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HF took 24.9s. Estimated remaining: 3h 11m 35s. Rate: 7.1 symbols/min [2025-10-13T19:22:13.990221] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:14.004873] [DEBUG] [LOCAL ] HGER: Loaded 14757 existing records from primary storage. [2025-10-13T19:22:14.005179] [INFO ] [MAIN ] HGER: Loaded 14757 existing records. [2025-10-13T19:22:14.025065] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-13T19:22:14.186616] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:14.186921] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-13T19:22:14.186975] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-13T19:22:14.187407] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-13T19:22:14.187496] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-13T19:22:14.562138] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:14.817930] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-13T19:22:15.617904] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-13T19:22:15.797767] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:22:15.918048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:22:15.918255] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-13T19:22:16.418037] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-13T19:22:17.217906] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-13T19:22:17.529254] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:22:17.898754] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T19:22:18.017955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-13T19:22:18.817909] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-13T19:22:19.130296] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:22:19.617924] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-13T19:22:19.866852] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-13T19:22:20.417910] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-13T19:22:20.554527] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T19:22:20.822849] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T19:22:21.217952] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-13T19:22:21.515839] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T19:22:22.017971] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-13T19:22:22.412136] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T19:22:22.818009] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-13T19:22:23.617899] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-13T19:22:23.653841] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:22:24.418003] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-13T19:22:25.123549] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:22:25.217923] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-13T19:22:25.367670] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:22:26.017980] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-13T19:22:26.295556] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:22:26.616849] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:22:26.817925] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-13T19:22:27.538322] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:22:27.617969] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-13T19:22:28.417996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-13T19:22:28.463089] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:22:29.217970] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-13T19:22:29.520304] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T19:22:29.565056] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T19:22:29.566208] [INFO ] [REMOTE ] HFND: Full fetch complete (1791 records). [2025-10-13T19:22:29.566299] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-13T19:22:29.763743] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T19:22:29.764023] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:22:29.764100] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:22:29.764180] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-13T19:22:29.764255] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-13T19:22:29.764294] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-13T19:22:29.764335] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-13T19:22:29.764402] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFND took 37.4s. Estimated remaining: 3h 11m 36s. Rate: 7.1 symbols/min [2025-10-13T19:22:29.949736] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:29.961409] [DEBUG] [LOCAL ] HGLB: Loaded 9807 existing records from primary storage. [2025-10-13T19:22:29.961676] [INFO ] [MAIN ] HGLB: Loaded 9807 existing records. [2025-10-13T19:22:30.023096] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-13T19:22:30.147233] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:30.147474] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-13T19:22:30.147521] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-13T19:22:30.147738] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-13T19:22:30.147793] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-13T19:22:30.499473] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:30.817893] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-13T19:22:31.135072] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T19:22:31.617956] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-13T19:22:32.358328] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:22:32.363633] [INFO ] [REMOTE ] HESM: Full fetch complete (69470 records). [2025-10-13T19:22:32.363796] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-13T19:22:32.425936] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-13T19:22:32.754835] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T19:22:32.780985] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-13T19:22:32.781417] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-13T19:22:32.782339] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-13T19:22:32.782402] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-13T19:22:32.783701] [DEBUG] [LOCAL ] HESM: Trimmed 69470 records to 48421 (keeping 200 days of data) [2025-10-13T19:22:33.076103] [DEBUG] [LOCAL ] HESM: Primary data saved (48421 records). [2025-10-13T19:22:33.076232] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-13T19:22:33.076307] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HESM took 45.1s. Estimated remaining: 3h 11m 21s. Rate: 7.1 symbols/min [2025-10-13T19:22:33.218923] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-13T19:22:33.244768] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:33.263833] [DEBUG] [LOCAL ] HGTY: Loaded 13389 existing records from primary storage. [2025-10-13T19:22:33.264138] [INFO ] [MAIN ] HGTY: Loaded 13389 existing records. [2025-10-13T19:22:33.446177] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T19:22:33.449800] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:33.452888] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-13T19:22:33.453211] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-13T19:22:33.453592] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-13T19:22:33.453677] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-13T19:22:33.797593] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:34.017914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-13T19:22:34.031196] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:22:34.033138] [INFO ] [REMOTE ] HFRO: Full fetch complete (28184 records). [2025-10-13T19:22:34.033236] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-13T19:22:34.388032] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-13T19:22:34.388119] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-13T19:22:34.388718] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-13T19:22:34.388778] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-13T19:22:34.389440] [DEBUG] [LOCAL ] HFRO: Trimmed 28184 records to 17162 (keeping 200 days of data) [2025-10-13T19:22:34.493463] [DEBUG] [LOCAL ] HFRO: Primary data saved (17162 records). [2025-10-13T19:22:34.493610] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-13T19:22:34.493732] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFRO took 26.5s. Estimated remaining: 3h 11m 3s. Rate: 7.1 symbols/min [2025-10-13T19:22:34.666732] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:34.710552] [DEBUG] [LOCAL ] HGV: Loaded 46989 existing records from primary storage. [2025-10-13T19:22:34.710891] [INFO ] [MAIN ] HGV: Loaded 46989 existing records. [2025-10-13T19:22:34.823078] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-13T19:22:34.902363] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:22:34.907803] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:34.911718] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-13T19:22:34.911803] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-13T19:22:34.912221] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-13T19:22:34.912275] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-13T19:22:35.275935] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:35.617973] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-13T19:22:35.740677] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T19:22:36.417968] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-13T19:22:36.427425] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:22:37.217947] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-13T19:22:37.337279] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T19:22:38.017944] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-13T19:22:38.677132] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:22:38.817895] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-13T19:22:38.948893] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:22:39.617972] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-13T19:22:40.037548] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:22:40.418016] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-13T19:22:40.683093] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:22:41.177493] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T19:22:41.217882] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-13T19:22:42.017911] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-13T19:22:42.076222] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:22:42.817977] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-13T19:22:42.998545] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T19:22:43.001636] [INFO ] [REMOTE ] HGER: Full fetch complete (18005 records). [2025-10-13T19:22:43.001746] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-13T19:22:43.364591] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-13T19:22:43.364716] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-13T19:22:43.365112] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-13T19:22:43.365151] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-13T19:22:43.365761] [DEBUG] [LOCAL ] HGER: Trimmed 18005 records to 14728 (keeping 200 days of data) [2025-10-13T19:22:43.453999] [DEBUG] [LOCAL ] HGER: Primary data saved (14728 records). [2025-10-13T19:22:43.454134] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-13T19:22:43.454214] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGER took 29.6s. Estimated remaining: 3h 10m 56s. Rate: 7.1 symbols/min [2025-10-13T19:22:43.619372] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-13T19:22:43.620847] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:43.655384] [DEBUG] [LOCAL ] HHH: Loaded 33400 existing records from primary storage. [2025-10-13T19:22:43.655689] [INFO ] [MAIN ] HHH: Loaded 33400 existing records. [2025-10-13T19:22:43.839197] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:43.839452] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-13T19:22:43.839521] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-13T19:22:43.840017] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-13T19:22:43.840088] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-13T19:22:43.963938] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:22:44.182292] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T19:22:44.234791] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:44.417919] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-13T19:22:45.217970] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-13T19:22:45.485060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:22:46.005156] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:22:46.017871] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-13T19:22:46.817908] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-13T19:22:46.854993] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T19:22:47.594094] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:22:47.617891] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-13T19:22:48.305995] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:22:48.417966] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-13T19:22:49.182637] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:22:49.217918] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-13T19:22:49.887120] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T19:22:50.018009] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-13T19:22:50.817914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-13T19:22:51.512573] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T19:22:51.617998] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-13T19:22:52.418007] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-13T19:22:53.217970] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-13T19:23:06.404729] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (15.59 seconds). [2025-10-13T19:23:06.408538] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-13T19:23:06.523110] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (14.91 seconds). [2025-10-13T19:23:06.534902] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-13T19:23:07.136146] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:23:07.141090] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-13T19:23:07.420056] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (14.20 seconds). [2025-10-13T19:23:07.423374] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-13T19:23:07.815484] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:23:07.825407] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-13T19:23:08.005394] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (15.59 seconds). [2025-10-13T19:23:08.011310] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-13T19:23:08.143226] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:23:08.148070] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-13T19:23:08.853125] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:23:08.854799] [INFO ] [REMOTE ] HGTY: Full fetch complete (17235 records). [2025-10-13T19:23:08.854875] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-13T19:23:09.089685] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:23:09.147431] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-13T19:23:09.183449] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:23:09.219184] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-13T19:23:09.279298] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-13T19:23:09.279485] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-13T19:23:09.279937] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-13T19:23:09.280074] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-13T19:23:09.289796] [DEBUG] [LOCAL ] HGTY: Trimmed 17235 records to 13154 (keeping 200 days of data) [2025-10-13T19:23:09.305935] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:23:09.315808] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-13T19:23:09.392387] [DEBUG] [LOCAL ] HGTY: Primary data saved (13154 records). [2025-10-13T19:23:09.392548] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-13T19:23:09.392632] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGTY took 36.3s. Estimated remaining: 3h 11m 10s. Rate: 7.1 symbols/min [2025-10-13T19:23:09.555364] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:09.589710] [DEBUG] [LOCAL ] HI: Loaded 35881 existing records from primary storage. [2025-10-13T19:23:09.590002] [INFO ] [MAIN ] HI: Loaded 35881 existing records. [2025-10-13T19:23:09.765625] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:09.765851] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-13T19:23:09.765897] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-13T19:23:09.766272] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-13T19:23:09.766327] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-13T19:23:09.943687] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:23:10.018743] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-13T19:23:10.128826] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:10.129135] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-13T19:23:10.582393] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T19:23:10.589270] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-13T19:23:10.892282] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T19:23:10.895472] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-13T19:23:11.042897] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T19:23:11.054567] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-13T19:23:11.589435] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:23:11.596927] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-13T19:23:11.633972] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T19:23:11.636582] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-13T19:23:11.843061] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:23:11.849040] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-13T19:23:12.447171] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:23:12.450138] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-13T19:23:12.557341] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:23:12.582898] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-13T19:23:12.583692] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:23:12.591115] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-13T19:23:13.034219] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T19:23:13.036017] [INFO ] [REMOTE ] HGLB: Full fetch complete (14779 records). [2025-10-13T19:23:13.036085] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-13T19:23:13.417358] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-13T19:23:13.417576] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-13T19:23:13.418469] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-13T19:23:13.418556] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-13T19:23:13.429014] [DEBUG] [LOCAL ] HGLB: Trimmed 14779 records to 9724 (keeping 200 days of data) [2025-10-13T19:23:13.445734] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:23:13.497190] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-13T19:23:13.516740] [DEBUG] [LOCAL ] HGLB: Primary data saved (9724 records). [2025-10-13T19:23:13.516863] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-13T19:23:13.517014] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HGLB took 43.8s. Estimated remaining: 3h 10m 56s. Rate: 7.1 symbols/min [2025-10-13T19:23:13.682497] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:13.736793] [DEBUG] [LOCAL ] HIG: Loaded 51891 existing records from primary storage. [2025-10-13T19:23:13.737136] [INFO ] [MAIN ] HIG: Loaded 51891 existing records. [2025-10-13T19:23:13.916740] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:13.917029] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-13T19:23:13.917112] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-13T19:23:13.917914] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-13T19:23:13.918004] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-13T19:23:14.041955] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:23:14.097594] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-13T19:23:14.347272] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:14.347758] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-13T19:23:14.376237] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:23:14.389542] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-13T19:23:15.047852] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:23:15.055370] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-13T19:23:15.472482] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:23:15.480060] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-13T19:23:15.781156] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:23:15.791406] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-13T19:23:15.936868] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:23:15.942254] [INFO ] [REMOTE ] HGV: Full fetch complete (65811 records). [2025-10-13T19:23:15.942394] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-13T19:23:16.338042] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-13T19:23:16.338147] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-13T19:23:16.339028] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-13T19:23:16.339091] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-13T19:23:16.340535] [DEBUG] [LOCAL ] HGV: Trimmed 65811 records to 46369 (keeping 200 days of data) [2025-10-13T19:23:16.628134] [DEBUG] [LOCAL ] HGV: Primary data saved (46369 records). [2025-10-13T19:23:16.628545] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-13T19:23:16.628678] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HGV took 42.1s. Estimated remaining: 3h 10m 41s. Rate: 7.1 symbols/min [2025-10-13T19:23:16.823272] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:16.824462] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:23:16.833616] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-13T19:23:16.865470] [DEBUG] [LOCAL ] HII: Loaded 34485 existing records from primary storage. [2025-10-13T19:23:16.865760] [INFO ] [MAIN ] HII: Loaded 34485 existing records. [2025-10-13T19:23:17.048616] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:17.048935] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-13T19:23:17.049009] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-13T19:23:17.057408] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-13T19:23:17.064684] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-13T19:23:17.148164] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:23:17.219853] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-13T19:23:17.486135] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:17.516909] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:23:17.945479] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T19:23:18.017949] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-13T19:23:18.664249] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:23:18.817967] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-13T19:23:19.592467] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:23:19.617895] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-13T19:23:20.200744] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:23:20.417942] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-13T19:23:20.683754] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:23:21.217984] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-13T19:23:22.017995] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-13T19:23:22.158586] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:23:22.769499] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:23:22.817901] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-13T19:23:23.310457] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T19:23:23.617973] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-13T19:23:24.418000] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-13T19:23:24.687768] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:23:25.000602] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T19:23:25.217963] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-13T19:23:25.771284] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:23:25.775633] [INFO ] [REMOTE ] HHH: Full fetch complete (45718 records). [2025-10-13T19:23:25.775856] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-13T19:23:26.023994] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-13T19:23:26.220278] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-13T19:23:26.220384] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-13T19:23:26.221415] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-13T19:23:26.221514] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-13T19:23:26.222909] [DEBUG] [LOCAL ] HHH: Trimmed 45718 records to 33136 (keeping 200 days of data) [2025-10-13T19:23:26.432679] [DEBUG] [LOCAL ] HHH: Primary data saved (33136 records). [2025-10-13T19:23:26.432887] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-13T19:23:26.432989] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HHH took 43.0s. Estimated remaining: 3h 10m 34s. Rate: 7.1 symbols/min [2025-10-13T19:23:26.613976] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:26.643155] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T19:23:26.706355] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-13T19:23:26.706870] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-10-13T19:23:26.822842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-13T19:23:26.912329] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:26.912864] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-13T19:23:26.912930] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-13T19:23:26.913452] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-13T19:23:26.913511] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-13T19:23:27.291551] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:27.617904] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-13T19:23:27.930567] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:23:28.360919] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:23:28.417911] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-13T19:23:29.217968] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-13T19:23:29.828047] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:23:30.023454] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-13T19:23:30.037039] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-13T19:23:30.555309] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T19:23:30.817904] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-13T19:23:31.406401] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T19:23:31.617961] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-13T19:23:32.418022] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-13T19:23:32.982376] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:23:32.987390] [INFO ] [REMOTE ] HI: Full fetch complete (50113 records). [2025-10-13T19:23:32.987593] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-13T19:23:33.233319] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-13T19:23:33.372036] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-13T19:23:33.372134] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-13T19:23:33.372994] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-13T19:23:33.373067] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-13T19:23:33.404803] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-13T19:23:33.404975] [DEBUG] [LOCAL ] HI: Trimmed 50113 records to 35572 (keeping 200 days of data) [2025-10-13T19:23:33.628785] [DEBUG] [LOCAL ] HI: Primary data saved (35572 records). [2025-10-13T19:23:33.628936] [INFO ] [MAIN ] HI: Full history saved. [2025-10-13T19:23:33.629017] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HI took 24.2s. Estimated remaining: 3h 10m 24s. Rate: 7.1 symbols/min [2025-10-13T19:23:33.798434] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:33.820792] [DEBUG] [LOCAL ] HIO: Loaded 24411 existing records from primary storage. [2025-10-13T19:23:33.821045] [INFO ] [MAIN ] HIO: Loaded 24411 existing records. [2025-10-13T19:23:33.998021] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:33.998256] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-13T19:23:33.998302] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-13T19:23:33.998607] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-13T19:23:33.998701] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-13T19:23:34.028942] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-13T19:23:34.357467] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:34.403435] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T19:23:34.715418] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:23:34.817896] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-13T19:23:35.617926] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-13T19:23:36.417899] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-13T19:23:36.528351] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-13T19:23:36.632966] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:23:37.190181] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:23:37.217897] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-13T19:23:37.330552] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T19:23:38.017913] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-13T19:23:38.625974] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:23:38.818193] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-13T19:23:39.487968] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:23:39.618090] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-13T19:23:40.417949] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-13T19:23:41.113296] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:23:41.116598] [INFO ] [REMOTE ] HII: Full fetch complete (52301 records). [2025-10-13T19:23:41.116709] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-13T19:23:41.222332] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-13T19:23:41.513936] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-13T19:23:41.514223] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-13T19:23:41.515108] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-13T19:23:41.515261] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-13T19:23:41.516759] [DEBUG] [LOCAL ] HII: Trimmed 52301 records to 33833 (keeping 200 days of data) [2025-10-13T19:23:41.671095] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-13T19:23:41.708929] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T19:23:41.827997] [DEBUG] [LOCAL ] HII: Primary data saved (33833 records). [2025-10-13T19:23:41.828565] [INFO ] [MAIN ] HII: Full history saved. [2025-10-13T19:23:41.828889] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HII took 25.2s. Estimated remaining: 3h 10m 15s. Rate: 7.1 symbols/min [2025-10-13T19:23:41.995560] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:42.016183] [DEBUG] [LOCAL ] HIPO: Loaded 22218 existing records from primary storage. [2025-10-13T19:23:42.016434] [INFO ] [MAIN ] HIPO: Loaded 22218 existing records. [2025-10-13T19:23:42.027549] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-13T19:23:42.207172] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:42.207355] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-13T19:23:42.207401] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-13T19:23:42.207712] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-13T19:23:42.207771] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-13T19:23:42.556364] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:42.818001] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-13T19:23:43.166581] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T19:23:43.245189] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:23:43.617951] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-13T19:23:44.417968] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-13T19:23:44.748140] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:23:45.217908] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-13T19:23:45.388672] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T19:23:45.685917] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T19:23:46.018021] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-13T19:23:46.473069] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T19:23:46.817971] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-13T19:23:47.617977] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-13T19:23:48.417925] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-13T19:23:48.550509] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:23:48.598939] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:23:48.764390] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-13T19:23:49.217944] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-13T19:23:49.267425] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:23:50.017966] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-13T19:23:50.100104] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T19:23:50.818027] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-13T19:23:51.392225] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:23:51.617925] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-13T19:23:51.782433] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:23:52.417975] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-13T19:23:52.671867] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:23:53.217951] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-13T19:23:54.018004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-13T19:23:54.309935] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:23:54.817911] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-13T19:23:55.004495] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-13T19:23:55.074994] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:23:55.617895] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-13T19:23:55.936604] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T19:23:56.417918] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-13T19:23:56.845003] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T19:23:57.217907] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-13T19:23:57.614614] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:23:58.017973] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-13T19:23:58.817897] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-13T19:23:59.218502] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T19:23:59.478165] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:23:59.483593] [INFO ] [REMOTE ] HIG: Full fetch complete (73169 records). [2025-10-13T19:23:59.483754] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-13T19:23:59.635693] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-13T19:23:59.893134] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-13T19:23:59.893503] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-13T19:23:59.895152] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-13T19:23:59.895826] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-13T19:23:59.934429] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-13T19:23:59.931875] [DEBUG] [LOCAL ] HIG: Trimmed 73169 records to 51154 (keeping 200 days of data) [2025-10-13T19:24:00.289334] [DEBUG] [LOCAL ] HIG: Primary data saved (51154 records). [2025-10-13T19:24:00.289539] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-13T19:24:00.290861] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIG took 46.8s. Estimated remaining: 3h 10m 20s. Rate: 7.1 symbols/min [2025-10-13T19:24:00.431932] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-13T19:24:00.467793] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:00.524771] [DEBUG] [LOCAL ] HIW: Loaded 45116 existing records from primary storage. [2025-10-13T19:24:00.525165] [INFO ] [MAIN ] HIW: Loaded 45116 existing records. [2025-10-13T19:24:00.720225] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:00.720725] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-13T19:24:00.720811] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-13T19:24:00.726542] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-13T19:24:00.734121] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-13T19:24:00.810505] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:24:01.111784] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:01.217982] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-13T19:24:02.017980] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-13T19:24:02.735858] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:24:02.817886] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-13T19:24:03.232183] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-13T19:24:03.350723] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T19:24:03.354471] [INFO ] [REMOTE ] HIO: Full fetch complete (37736 records). [2025-10-13T19:24:03.354546] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-13T19:24:03.625082] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-13T19:24:03.722470] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-13T19:24:03.722549] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-13T19:24:03.723244] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-13T19:24:03.723306] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-13T19:24:03.724120] [DEBUG] [LOCAL ] HIO: Trimmed 37736 records to 24076 (keeping 200 days of data) [2025-10-13T19:24:03.861569] [DEBUG] [LOCAL ] HIO: Primary data saved (24076 records). [2025-10-13T19:24:03.861724] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-13T19:24:03.861809] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIO took 30.2s. Estimated remaining: 3h 10m 5s. Rate: 7.1 symbols/min [2025-10-13T19:24:04.034937] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:04.054894] [DEBUG] [LOCAL ] HIX: Loaded 20859 existing records from primary storage. [2025-10-13T19:24:04.055149] [INFO ] [MAIN ] HIX: Loaded 20859 existing records. [2025-10-13T19:24:04.249287] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:04.250008] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-13T19:24:04.250134] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-13T19:24:04.250619] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-13T19:24:04.250716] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-13T19:24:04.436460] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:24:04.432923] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-13T19:24:04.682877] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:05.217956] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-13T19:24:05.508409] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T19:24:06.017958] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-13T19:24:06.095577] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:24:06.817953] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-13T19:24:06.873446] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:24:07.220346] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:24:07.618066] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-13T19:24:07.900896] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:24:08.418033] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-13T19:24:08.811033] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:24:09.217970] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-13T19:24:10.017956] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-13T19:24:10.178410] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:24:10.305629] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:24:10.308045] [INFO ] [REMOTE ] HIPO: Full fetch complete (31333 records). [2025-10-13T19:24:10.308134] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-13T19:24:10.688109] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-13T19:24:10.688225] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-13T19:24:10.689499] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-13T19:24:10.689567] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-13T19:24:10.690630] [DEBUG] [LOCAL ] HIPO: Trimmed 31333 records to 21977 (keeping 200 days of data) [2025-10-13T19:24:10.825618] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-13T19:24:10.833063] [DEBUG] [LOCAL ] HIPO: Primary data saved (21977 records). [2025-10-13T19:24:10.834476] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-13T19:24:10.834624] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIPO took 29.0s. Estimated remaining: 3h 9m 55s. Rate: 7.1 symbols/min [2025-10-13T19:24:11.007433] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:11.029846] [DEBUG] [LOCAL ] HKD: Loaded 18878 existing records from primary storage. [2025-10-13T19:24:11.030112] [INFO ] [MAIN ] HKD: Loaded 18878 existing records. [2025-10-13T19:24:11.160903] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:24:11.230738] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:11.230967] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-13T19:24:11.231019] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-13T19:24:11.231383] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-13T19:24:11.231442] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-13T19:24:11.574120] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:11.617890] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-13T19:24:12.418002] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-13T19:24:12.887802] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:24:13.217918] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-13T19:24:13.497986] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:24:13.595485] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-13T19:24:13.602080] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-13T19:24:13.602308] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-13T19:24:14.061364] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-13T19:24:14.088591] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-13T19:24:14.088731] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-13T19:24:14.090024] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-13T19:24:14.090093] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-13T19:24:14.091952] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-13T19:24:14.459932] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-13T19:24:14.460154] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-13T19:24:14.460262] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIMS took 48.0s. Estimated remaining: 3h 9m 40s. Rate: 7.1 symbols/min [2025-10-13T19:24:14.651426] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:14.735335] [DEBUG] [LOCAL ] HL: Loaded 54452 existing records from primary storage. [2025-10-13T19:24:14.739276] [INFO ] [MAIN ] HL: Loaded 54452 existing records. [2025-10-13T19:24:14.788389] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:24:14.828803] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-13T19:24:14.954086] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:14.954366] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-13T19:24:14.954418] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-13T19:24:14.955088] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-13T19:24:14.955159] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-13T19:24:15.369508] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T19:24:15.383424] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:15.617947] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-13T19:24:16.266572] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:24:16.417957] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-13T19:24:16.731913] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T19:24:17.217973] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-13T19:24:17.685249] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T19:24:18.018008] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-13T19:24:18.220308] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T19:24:18.817988] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-13T19:24:19.066962] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:24:19.617996] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-13T19:24:20.417991] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-13T19:24:20.699383] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:24:20.729531] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:24:21.217973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-13T19:24:22.017988] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-13T19:24:22.152016] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:24:22.199242] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:24:22.817969] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-13T19:24:23.618001] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-13T19:24:23.775940] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T19:24:24.267589] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:24:24.417973] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-13T19:24:24.914100] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:24:25.217957] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-13T19:24:25.948203] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:24:26.017899] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-13T19:24:26.755799] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:24:26.817948] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-13T19:24:27.623927] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-13T19:24:27.644525] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:24:27.704580] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T19:24:28.417966] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-13T19:24:29.217983] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-13T19:24:29.582455] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:24:29.582984] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:24:30.017950] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-13T19:24:30.434067] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T19:24:30.817967] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-13T19:24:31.617999] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-13T19:24:31.805271] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:24:32.261847] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-13T19:24:32.418054] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-13T19:24:33.217916] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-13T19:24:33.250623] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:24:33.689767] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T19:24:34.017922] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-13T19:24:34.817957] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-13T19:24:35.031409] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:24:35.033800] [INFO ] [REMOTE ] HIX: Full fetch complete (30138 records). [2025-10-13T19:24:35.033899] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-13T19:24:35.439336] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-13T19:24:35.477160] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-13T19:24:35.477359] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-13T19:24:35.478158] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-13T19:24:35.478241] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-13T19:24:35.479459] [DEBUG] [LOCAL ] HIX: Trimmed 30138 records to 20501 (keeping 200 days of data) [2025-10-13T19:24:35.605159] [DEBUG] [LOCAL ] HIX: Primary data saved (20501 records). [2025-10-13T19:24:35.605330] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-13T19:24:35.605424] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 31.7s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-10-13T19:24:35.628231] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-13T19:24:35.786620] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:35.841278] [DEBUG] [LOCAL ] HLF: Loaded 49122 existing records from primary storage. [2025-10-13T19:24:35.856492] [INFO ] [MAIN ] HLF: Loaded 49122 existing records. [2025-10-13T19:24:35.857028] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T19:24:36.045802] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:36.046089] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-13T19:24:36.046146] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-13T19:24:36.046768] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-13T19:24:36.046826] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-13T19:24:36.418264] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:36.418384] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-13T19:24:37.149879] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T19:24:37.154565] [INFO ] [REMOTE ] HIW: Full fetch complete (64723 records). [2025-10-13T19:24:37.154719] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-13T19:24:37.227817] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-13T19:24:37.555019] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-13T19:24:37.555142] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-13T19:24:37.556380] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-13T19:24:37.556458] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-13T19:24:37.558442] [DEBUG] [LOCAL ] HIW: Trimmed 64723 records to 44556 (keeping 200 days of data) [2025-10-13T19:24:37.822528] [DEBUG] [LOCAL ] HIW: Primary data saved (44556 records). [2025-10-13T19:24:37.822697] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-13T19:24:37.823581] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HIW took 37.5s. Estimated remaining: 3h 9m 31s. Rate: 7.1 symbols/min [2025-10-13T19:24:37.990505] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:38.025912] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-13T19:24:38.027515] [DEBUG] [LOCAL ] HLI: Loaded 31364 existing records from primary storage. [2025-10-13T19:24:38.029168] [INFO ] [MAIN ] HLI: Loaded 31364 existing records. [2025-10-13T19:24:38.206292] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:38.206593] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-13T19:24:38.206683] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-13T19:24:38.207101] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-13T19:24:38.207156] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-13T19:24:38.546087] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T19:24:38.629342] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:38.817968] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-13T19:24:38.961833] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:24:39.037212] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:24:39.040022] [INFO ] [REMOTE ] HKD: Full fetch complete (28356 records). [2025-10-13T19:24:39.040116] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-13T19:24:39.414287] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-13T19:24:39.414375] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-13T19:24:39.414960] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-13T19:24:39.415020] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-13T19:24:39.415748] [DEBUG] [LOCAL ] HKD: Trimmed 28356 records to 18625 (keeping 200 days of data) [2025-10-13T19:24:39.518745] [DEBUG] [LOCAL ] HKD: Primary data saved (18625 records). [2025-10-13T19:24:39.518887] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-13T19:24:39.518965] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HKD took 28.7s. Estimated remaining: 3h 9m 14s. Rate: 7.1 symbols/min [2025-10-13T19:24:39.623320] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-13T19:24:39.698621] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:39.728289] [DEBUG] [LOCAL ] HLIO: Loaded 28206 existing records from primary storage. [2025-10-13T19:24:39.728569] [INFO ] [MAIN ] HLIO: Loaded 28206 existing records. [2025-10-13T19:24:39.909609] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:39.909890] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-13T19:24:39.909948] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-13T19:24:39.910313] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-13T19:24:39.910377] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-13T19:24:40.265293] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:40.417912] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-13T19:24:40.887675] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:24:41.033802] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:24:41.217949] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-13T19:24:41.420905] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:24:42.017947] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-13T19:24:42.817955] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-13T19:24:43.205836] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:24:43.617947] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-13T19:24:43.727948] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:24:43.833435] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:24:44.417952] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-13T19:24:45.217968] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-13T19:24:45.769281] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:24:45.814356] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T19:24:46.017960] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-13T19:24:46.817906] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-13T19:24:46.898916] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:24:46.975128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T19:24:47.617993] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-13T19:24:48.029429] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T19:24:48.417903] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-13T19:24:48.645149] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T19:24:49.218012] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-13T19:24:50.018017] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-13T19:24:50.551212] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:24:50.617405] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-13T19:24:50.622977] [INFO ] [REMOTE ] HL: Full fetch complete (77666 records). [2025-10-13T19:24:50.623091] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-13T19:24:50.828311] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-13T19:24:51.016531] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-13T19:24:51.016638] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-13T19:24:51.017706] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-13T19:24:51.017851] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-13T19:24:51.019575] [DEBUG] [LOCAL ] HL: Trimmed 77666 records to 53672 (keeping 200 days of data) [2025-10-13T19:24:51.254549] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T19:24:51.355142] [DEBUG] [LOCAL ] HL: Primary data saved (53672 records). [2025-10-13T19:24:51.355280] [INFO ] [MAIN ] HL: Full history saved. [2025-10-13T19:24:51.355357] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 36.9s. Estimated remaining: 3h 9m 10s. Rate: 7.1 symbols/min [2025-10-13T19:24:51.521808] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:51.551973] [DEBUG] [LOCAL ] HLLY: Loaded 34004 existing records from primary storage. [2025-10-13T19:24:51.552240] [INFO ] [MAIN ] HLLY: Loaded 34004 existing records. [2025-10-13T19:24:51.626590] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-13T19:24:51.737745] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:51.741152] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-13T19:24:51.741213] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-13T19:24:51.741549] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-13T19:24:51.741605] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-13T19:24:52.088851] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:52.333865] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:24:52.417881] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-13T19:24:52.966058] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T19:24:53.217960] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-13T19:24:53.367775] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T19:24:54.017949] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-13T19:24:54.824685] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-13T19:24:54.830587] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:24:55.379911] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:24:55.617915] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-13T19:24:56.237072] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:24:56.417950] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-13T19:24:57.217907] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-13T19:24:57.298083] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:24:57.595223] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:24:58.017966] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-13T19:24:58.036233] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:24:58.817971] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-13T19:24:59.076556] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T19:24:59.617977] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-13T19:25:00.229339] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:25:00.418000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-13T19:25:01.217957] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-13T19:25:01.261168] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:25:01.950819] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:25:02.018030] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-13T19:25:02.702287] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:25:02.817985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-13T19:25:03.531762] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:25:03.618016] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-13T19:25:04.335842] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:25:04.417984] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-13T19:25:05.008820] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:25:05.217980] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-13T19:25:05.283589] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T19:25:06.017967] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-13T19:25:06.817952] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-13T19:25:06.886606] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:25:07.331312] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T19:25:07.617903] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-13T19:25:08.087505] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:25:08.417940] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-13T19:25:09.217947] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-13T19:25:09.314875] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:25:09.510987] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T19:25:10.018065] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-13T19:25:10.383578] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:25:10.387295] [INFO ] [REMOTE ] HLI: Full fetch complete (45136 records). [2025-10-13T19:25:10.387416] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-13T19:25:10.778062] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-13T19:25:10.778165] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-13T19:25:10.778964] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-13T19:25:10.779024] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-13T19:25:10.780062] [DEBUG] [LOCAL ] HLI: Trimmed 45136 records to 30937 (keeping 200 days of data) [2025-10-13T19:25:10.835845] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-13T19:25:10.974606] [DEBUG] [LOCAL ] HLI: Primary data saved (30937 records). [2025-10-13T19:25:10.974779] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-13T19:25:10.975975] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 33.2s. Estimated remaining: 3h 9m 16s. Rate: 7.1 symbols/min [2025-10-13T19:25:11.141704] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:11.202557] [DEBUG] [LOCAL ] HLN: Loaded 53870 existing records from primary storage. [2025-10-13T19:25:11.203116] [INFO ] [MAIN ] HLN: Loaded 53870 existing records. [2025-10-13T19:25:11.380846] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:11.381137] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-13T19:25:11.381192] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-13T19:25:11.381938] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-13T19:25:11.382000] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-13T19:25:11.636567] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-13T19:25:11.767403] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:11.786787] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:25:11.935001] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:25:12.418000] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-13T19:25:12.958051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T19:25:13.217962] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-13T19:25:13.270954] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:25:13.273933] [INFO ] [REMOTE ] HLIO: Full fetch complete (36522 records). [2025-10-13T19:25:13.274049] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-13T19:25:13.657195] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-13T19:25:13.657340] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-13T19:25:13.658272] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-13T19:25:13.658340] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-13T19:25:13.659332] [DEBUG] [LOCAL ] HLIO: Trimmed 36522 records to 28073 (keeping 200 days of data) [2025-10-13T19:25:13.840194] [DEBUG] [LOCAL ] HLIO: Primary data saved (28073 records). [2025-10-13T19:25:13.840350] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-13T19:25:13.840589] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 34.3s. Estimated remaining: 3h 9m 0s. Rate: 7.1 symbols/min [2025-10-13T19:25:14.011860] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:14.018032] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-13T19:25:14.066976] [DEBUG] [LOCAL ] HLT: Loaded 51350 existing records from primary storage. [2025-10-13T19:25:14.067327] [INFO ] [MAIN ] HLT: Loaded 51350 existing records. [2025-10-13T19:25:14.245966] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:14.246186] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-13T19:25:14.246233] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-13T19:25:14.246784] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-13T19:25:14.246853] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-13T19:25:14.598632] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:14.817897] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-13T19:25:15.035863] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T19:25:15.466781] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:25:15.617909] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-13T19:25:16.358126] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:25:16.417886] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-13T19:25:16.566356] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T19:25:17.217952] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-13T19:25:17.779808] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:25:18.017983] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-13T19:25:18.631478] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:25:18.635804] [INFO ] [REMOTE ] HLLY: Full fetch complete (46214 records). [2025-10-13T19:25:18.635889] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-13T19:25:18.823033] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-13T19:25:19.055855] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-13T19:25:19.055935] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-13T19:25:19.056635] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-13T19:25:19.056783] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-13T19:25:19.057771] [DEBUG] [LOCAL ] HLLY: Trimmed 46214 records to 33620 (keeping 200 days of data) [2025-10-13T19:25:19.247413] [DEBUG] [LOCAL ] HLLY: Primary data saved (33620 records). [2025-10-13T19:25:19.247556] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-13T19:25:19.247696] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 27.9s. Estimated remaining: 3h 8m 48s. Rate: 7.1 symbols/min [2025-10-13T19:25:19.426955] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:19.475770] [DEBUG] [LOCAL ] HLX: Loaded 48235 existing records from primary storage. [2025-10-13T19:25:19.476112] [INFO ] [MAIN ] HLX: Loaded 48235 existing records. [2025-10-13T19:25:19.638314] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-13T19:25:19.661681] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:19.663070] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-13T19:25:19.663225] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-13T19:25:19.663939] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-13T19:25:19.664002] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-13T19:25:19.947977] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T19:25:20.061068] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:20.418008] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-13T19:25:20.582532] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T19:25:21.217912] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-13T19:25:21.271007] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:21.277028] [INFO ] [REMOTE ] HLF: Full fetch complete (70872 records). [2025-10-13T19:25:21.277201] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-13T19:25:21.702207] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-13T19:25:21.702487] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-13T19:25:21.704086] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-13T19:25:21.704159] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-13T19:25:21.706832] [DEBUG] [LOCAL ] HLF: Trimmed 70872 records to 48470 (keeping 200 days of data) [2025-10-13T19:25:21.844999] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:25:22.017977] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-13T19:25:22.052844] [DEBUG] [LOCAL ] HLF: Primary data saved (48470 records). [2025-10-13T19:25:22.053770] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-13T19:25:22.053921] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLF took 46.4s. Estimated remaining: 3h 8m 32s. Rate: 7.1 symbols/min [2025-10-13T19:25:22.224573] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:22.270224] [DEBUG] [LOCAL ] HMC: Loaded 47231 existing records from primary storage. [2025-10-13T19:25:22.270526] [INFO ] [MAIN ] HMC: Loaded 47231 existing records. [2025-10-13T19:25:22.442937] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:22.443179] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-13T19:25:22.443225] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-13T19:25:22.443699] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-13T19:25:22.443754] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-13T19:25:22.799866] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:22.836211] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-13T19:25:22.856840] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:25:23.617914] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-13T19:25:23.660692] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:25:24.418000] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-13T19:25:24.872008] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-13T19:25:25.217973] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-13T19:25:25.484258] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:25:25.976542] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:25:26.017986] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-13T19:25:26.817989] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-13T19:25:26.936273] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:25:27.617953] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-13T19:25:27.786829] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:25:28.418010] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-13T19:25:28.731532] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:25:29.150496] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:25:29.217876] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-13T19:25:29.712135] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T19:25:30.017970] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-13T19:25:30.817957] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-13T19:25:31.025184] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:25:31.617971] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-13T19:25:32.018766] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:25:32.136256] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T19:25:32.417982] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-13T19:25:33.217969] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-13T19:25:33.642441] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T19:25:33.995327] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:25:34.017875] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-13T19:25:34.123204] [DEBUG] [REMOTE ] HLX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-13T19:25:34.123361] [WARN ] [REMOTE ] HLX: No data returned for month 2025-04 [2025-10-13T19:25:34.123467] [FATAL] [REMOTE ] HLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:25:34.123526] [FATAL] [MAIN ] HLX: Failed to fetch primary data. [2025-10-13T19:25:34.123562] [WARN ] [MAIN ] HLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:25:34.123597] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-13T19:25:34.123682] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-13T19:25:34.123739] [INFO ] [LOCAL ] HLX: Starting deletion of derivative data. [2025-10-13T19:25:34.123928] [DEBUG] [LOCAL ] HLX: Deleted derivative data file. [2025-10-13T19:25:34.124011] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 14.9s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-10-13T19:25:34.291747] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:34.314525] [DEBUG] [LOCAL ] HMN: Loaded 23715 existing records from primary storage. [2025-10-13T19:25:34.314782] [INFO ] [MAIN ] HMN: Loaded 23715 existing records. [2025-10-13T19:25:34.485513] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:34.485709] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-13T19:25:34.485763] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-13T19:25:34.486037] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-13T19:25:34.486079] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-13T19:25:34.818048] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-13T19:25:34.841076] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:35.054564] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T19:25:35.617950] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-13T19:25:36.417909] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-13T19:25:36.451941] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T19:25:37.217901] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-13T19:25:37.493091] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:25:38.023077] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-13T19:25:38.039755] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:25:38.670037] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:25:38.817885] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-13T19:25:39.057066] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:25:39.617967] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-13T19:25:40.417895] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-13T19:25:40.618567] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T19:25:41.217969] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-13T19:25:41.428933] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:25:41.452116] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:25:42.018031] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-13T19:25:42.817950] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-13T19:25:42.995407] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T19:25:43.617894] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-13T19:25:43.701209] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T19:25:43.923155] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:25:44.418008] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-13T19:25:45.217969] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-13T19:25:45.307742] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:25:45.402873] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T19:25:46.017912] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-13T19:25:46.817913] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-13T19:25:46.985206] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:25:47.617989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-13T19:25:47.669209] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:25:48.416877] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T19:25:48.426675] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-13T19:25:48.488848] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:25:48.761266] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-13T19:25:48.767815] [INFO ] [REMOTE ] HLT: Full fetch complete (73526 records). [2025-10-13T19:25:48.768006] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-13T19:25:49.173771] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-13T19:25:49.173891] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-13T19:25:49.175368] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-13T19:25:49.175438] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-13T19:25:49.177480] [DEBUG] [LOCAL ] HLT: Trimmed 73526 records to 50609 (keeping 200 days of data) [2025-10-13T19:25:49.234508] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-13T19:25:49.516893] [DEBUG] [LOCAL ] HLT: Primary data saved (50609 records). [2025-10-13T19:25:49.517104] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-13T19:25:49.517244] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLT took 35.7s. Estimated remaining: 3h 8m 29s. Rate: 7.1 symbols/min [2025-10-13T19:25:49.692197] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:49.755054] [DEBUG] [LOCAL ] HMY: Loaded 53913 existing records from primary storage. [2025-10-13T19:25:49.755482] [INFO ] [MAIN ] HMY: Loaded 53913 existing records. [2025-10-13T19:25:49.941836] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:49.942151] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-13T19:25:49.942206] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-13T19:25:49.942865] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-13T19:25:49.942925] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-13T19:25:50.023180] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-13T19:25:50.318468] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:50.501325] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:25:50.817957] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-13T19:25:51.617978] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-13T19:25:51.656681] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:51.662199] [INFO ] [REMOTE ] HLN: Full fetch complete (76836 records). [2025-10-13T19:25:51.662320] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-13T19:25:52.076340] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-13T19:25:52.077086] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-13T19:25:52.076991] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:25:52.078389] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-13T19:25:52.083153] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-13T19:25:52.086553] [DEBUG] [LOCAL ] HLN: Trimmed 76836 records to 53113 (keeping 200 days of data) [2025-10-13T19:25:52.421268] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-13T19:25:52.432223] [DEBUG] [LOCAL ] HLN: Primary data saved (53113 records). [2025-10-13T19:25:52.432462] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-13T19:25:52.433873] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HLN took 41.5s. Estimated remaining: 3h 8m 13s. Rate: 7.1 symbols/min [2025-10-13T19:25:52.617837] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:52.618126] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-13T19:25:52.618172] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-13T19:25:52.618328] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-13T19:25:52.618404] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-13T19:25:52.618507] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-13T19:25:52.618560] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-13T19:25:52.983101] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:53.218006] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-13T19:25:53.245478] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:53.250413] [INFO ] [REMOTE ] HMC: Full fetch complete (69018 records). [2025-10-13T19:25:53.250535] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-13T19:25:53.647486] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-13T19:25:53.647594] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-13T19:25:53.652220] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-13T19:25:53.652429] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-13T19:25:53.654137] [DEBUG] [LOCAL ] HMC: Trimmed 69018 records to 46553 (keeping 200 days of data) [2025-10-13T19:25:53.759589] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:25:53.953465] [DEBUG] [LOCAL ] HMC: Primary data saved (46553 records). [2025-10-13T19:25:53.953601] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-13T19:25:53.953722] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 31.9s. Estimated remaining: 3h 7m 56s. Rate: 7.1 symbols/min [2025-10-13T19:25:54.027916] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-13T19:25:54.127203] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:54.159195] [DEBUG] [LOCAL ] HNI: Loaded 29751 existing records from primary storage. [2025-10-13T19:25:54.159483] [INFO ] [MAIN ] HNI: Loaded 29751 existing records. [2025-10-13T19:25:54.276364] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:25:54.308671] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-13T19:25:54.334995] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:25:54.338602] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-13T19:25:54.338434] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:54.338772] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:25:54.338908] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-13T19:25:54.339026] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-13T19:25:54.339181] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-13T19:25:54.339326] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-13T19:25:54.339271] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-13T19:25:54.339550] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-13T19:25:54.339666] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNGE took 1.9s. Estimated remaining: 3h 7m 37s. Rate: 7.1 symbols/min [2025-10-13T19:25:54.339855] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-13T19:25:54.339929] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-13T19:25:54.696789] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:54.800989] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T19:25:54.817883] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-13T19:25:55.618007] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-13T19:25:56.418025] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-13T19:25:56.619098] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:25:56.789639] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T19:25:57.217969] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-13T19:25:57.635882] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T19:25:58.017948] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-13T19:25:58.244069] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T19:25:58.817955] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-13T19:25:59.140518] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T19:25:59.531835] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:25:59.534232] [INFO ] [REMOTE ] HMN: Full fetch complete (31420 records). [2025-10-13T19:25:59.534313] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-13T19:25:59.623476] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-13T19:25:59.900546] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-13T19:25:59.900670] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-13T19:25:59.901294] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-13T19:25:59.901354] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-13T19:25:59.902143] [DEBUG] [LOCAL ] HMN: Trimmed 31420 records to 23424 (keeping 200 days of data) [2025-10-13T19:26:00.047129] [DEBUG] [LOCAL ] HMN: Primary data saved (23424 records). [2025-10-13T19:26:00.047261] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-13T19:26:00.047349] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMN took 25.9s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-13T19:26:00.417917] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-13T19:26:01.688216] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:26:01.699094] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-13T19:26:01.745523] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:26:02.018030] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-13T19:26:03.355311] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:26:03.362447] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-13T19:26:03.467974] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:26:03.617935] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-13T19:26:04.562216] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T19:26:04.568455] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-13T19:26:05.670402] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:26:05.676052] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-13T19:26:05.882327] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-13T19:26:06.018012] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-13T19:26:06.920529] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:26:06.926669] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-13T19:26:07.999795] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:26:08.005503] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-13T19:26:08.154014] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T19:26:08.417993] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-13T19:26:09.508721] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:26:09.518243] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-13T19:26:10.436816] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-13T19:26:10.452213] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-13T19:26:11.156500] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:26:11.165949] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-13T19:26:12.496847] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:26:12.509835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-13T19:26:12.576108] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:26:12.580043] [INFO ] [REMOTE ] HNI: Full fetch complete (41775 records). [2025-10-13T19:26:12.580146] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-13T19:26:13.010114] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-13T19:26:13.010243] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-13T19:26:13.011627] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-13T19:26:13.011720] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-13T19:26:13.013221] [DEBUG] [LOCAL ] HNI: Trimmed 41775 records to 29427 (keeping 200 days of data) [2025-10-13T19:26:13.201524] [DEBUG] [LOCAL ] HNI: Primary data saved (29427 records). [2025-10-13T19:26:13.201702] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-13T19:26:13.201802] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HNI took 19.2s. Estimated remaining: 3h 7m 23s. Rate: 7.1 symbols/min [2025-10-13T19:26:14.456381] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:26:14.467751] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-13T19:26:16.686087] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-13T19:26:16.706504] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-13T19:26:18.677870] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T19:26:18.684133] [INFO ] [REMOTE ] HMY: Full fetch complete (76790 records). [2025-10-13T19:26:18.684285] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-13T19:26:19.090754] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-13T19:26:19.090863] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-13T19:26:19.091838] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-13T19:26:19.091900] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-13T19:26:19.093446] [DEBUG] [LOCAL ] HMY: Trimmed 76790 records to 53167 (keeping 200 days of data) [2025-10-13T19:26:19.437087] [DEBUG] [LOCAL ] HMY: Primary data saved (53167 records). [2025-10-13T19:26:19.437277] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-13T19:26:19.437424] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HMY took 29.9s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-13T19:26:20.011031] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.154854] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.153390] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.241251] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.249146] [DEBUG] [LOCAL ] HOV: Loaded 14065 existing records from primary storage. [2025-10-13T19:26:20.249616] [INFO ] [MAIN ] HOV: Loaded 14065 existing records. [2025-10-13T19:26:20.479412] [DEBUG] [LOCAL ] HOUS: Loaded 45606 existing records from primary storage. [2025-10-13T19:26:20.468992] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:20.494342] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-13T19:26:20.494422] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-13T19:26:20.494768] [INFO ] [MAIN ] HOUS: Loaded 45606 existing records. [2025-10-13T19:26:20.500446] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-13T19:26:20.515847] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-13T19:26:20.648397] [DEBUG] [LOCAL ] HOMB: Loaded 44074 existing records from primary storage. [2025-10-13T19:26:20.714697] [INFO ] [MAIN ] HOMB: Loaded 44074 existing records. [2025-10-13T19:26:20.721270] [DEBUG] [LOCAL ] HOG: Loaded 51709 existing records from primary storage. [2025-10-13T19:26:20.730737] [INFO ] [MAIN ] HOG: Loaded 51709 existing records. [2025-10-13T19:26:20.997356] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.205372] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.280135] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-13T19:26:21.343000] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.365438] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-13T19:26:21.376291] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-13T19:26:21.393991] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.471270] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.460253] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-13T19:26:21.485142] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.500682] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-13T19:26:21.553313] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-13T19:26:21.560693] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-13T19:26:21.575332] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-13T19:26:21.564920] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:21.591575] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-13T19:26:21.601455] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-13T19:26:22.496520] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.518889] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-13T19:26:22.693083] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.711905] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.712358] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-13T19:26:22.712553] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-13T19:26:22.723932] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T19:26:22.727684] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-13T19:26:23.531975] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:26:23.534988] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-13T19:26:23.722761] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:26:23.731137] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-13T19:26:23.795060] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:26:23.803833] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-13T19:26:24.379869] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:26:24.384240] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-13T19:26:24.439910] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:26:24.451309] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-13T19:26:25.177818] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:26:25.187480] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-13T19:26:25.198797] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:26:25.202365] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-13T19:26:25.310459] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:26:25.320853] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-13T19:26:26.186602] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:26:26.196914] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-13T19:26:26.227770] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:26:26.232261] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-13T19:26:26.286484] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:26:26.294956] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-13T19:26:26.717630] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:26:26.819231] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-13T19:26:26.820728] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T19:26:27.617917] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-13T19:26:27.877280] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:26:27.924138] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:26:28.402334] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:26:28.417918] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-13T19:26:28.589342] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T19:26:29.217953] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-13T19:26:30.017979] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-13T19:26:30.153404] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:26:30.191720] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:26:30.817969] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-13T19:26:31.437481] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:26:31.617938] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-13T19:26:32.417982] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-13T19:26:32.620142] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T19:26:33.047429] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:26:33.132473] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:26:33.217914] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-13T19:26:34.017907] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-13T19:26:34.149496] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T19:26:34.817914] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-13T19:26:35.431680] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:26:35.617957] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-13T19:26:36.417970] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-13T19:26:36.482382] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T19:26:36.484106] [INFO ] [REMOTE ] HOV: Full fetch complete (19003 records). [2025-10-13T19:26:36.484172] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-13T19:26:36.821994] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:26:36.940882] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-13T19:26:36.940990] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-13T19:26:36.941679] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-13T19:26:36.941755] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-13T19:26:36.942691] [DEBUG] [LOCAL ] HOV: Trimmed 19003 records to 13969 (keeping 200 days of data) [2025-10-13T19:26:37.035757] [DEBUG] [LOCAL ] HOV: Primary data saved (13969 records). [2025-10-13T19:26:37.035916] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-13T19:26:37.036001] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 17.6s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-13T19:26:37.209155] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:37.218080] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-13T19:26:37.261920] [DEBUG] [LOCAL ] HP: Loaded 52330 existing records from primary storage. [2025-10-13T19:26:37.262262] [INFO ] [MAIN ] HP: Loaded 52330 existing records. [2025-10-13T19:26:37.438844] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:37.439078] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-13T19:26:37.439165] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-13T19:26:37.439530] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-13T19:26:37.439588] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-13T19:26:37.805238] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:38.018019] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-13T19:26:38.083460] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:26:38.787777] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:26:38.817878] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-13T19:26:39.586959] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:26:39.617881] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-13T19:26:40.417985] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-13T19:26:40.616197] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:26:41.217969] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-13T19:26:41.332672] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:26:41.867053] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:26:42.017912] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-13T19:26:42.648922] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:26:42.817886] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-13T19:26:43.383956] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T19:26:43.618001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-13T19:26:44.293886] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:26:44.417946] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-13T19:26:45.217912] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-13T19:26:45.322758] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:26:45.686437] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:26:46.017960] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-13T19:26:46.817949] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-13T19:26:46.913378] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:26:46.918136] [INFO ] [REMOTE ] HOMB: Full fetch complete (63878 records). [2025-10-13T19:26:46.918251] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-13T19:26:47.323291] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-13T19:26:47.323411] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-13T19:26:47.324716] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-13T19:26:47.324789] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-13T19:26:47.326778] [DEBUG] [LOCAL ] HOMB: Trimmed 63878 records to 43542 (keeping 200 days of data) [2025-10-13T19:26:47.635769] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-13T19:26:47.649332] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T19:26:47.665894] [DEBUG] [LOCAL ] HOMB: Primary data saved (43542 records). [2025-10-13T19:26:47.666094] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-13T19:26:47.666200] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 28.2s. Estimated remaining: 3h 7m 9s. Rate: 7.1 symbols/min [2025-10-13T19:26:47.861703] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:47.919197] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-13T19:26:47.919622] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-10-13T19:26:48.105351] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:48.105848] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-13T19:26:48.105905] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-13T19:26:48.106531] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-13T19:26:48.106589] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-13T19:26:48.424374] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-13T19:26:48.516611] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:48.529612] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:26:49.217987] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-13T19:26:49.328334] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:26:49.851853] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:26:50.017978] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-13T19:26:50.635214] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:26:50.817901] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-13T19:26:51.618001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-13T19:26:51.684772] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:26:52.418033] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-13T19:26:52.827859] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T19:26:53.001488] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T19:26:53.007228] [INFO ] [REMOTE ] HOG: Full fetch complete (74049 records). [2025-10-13T19:26:53.007417] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-13T19:26:53.223112] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-13T19:26:53.425440] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-13T19:26:53.425576] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-13T19:26:53.427217] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-13T19:26:53.427289] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-13T19:26:53.429333] [DEBUG] [LOCAL ] HOG: Trimmed 74049 records to 50870 (keeping 200 days of data) [2025-10-13T19:26:53.762192] [DEBUG] [LOCAL ] HOG: Primary data saved (50870 records). [2025-10-13T19:26:53.762372] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-13T19:26:53.763280] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOG took 34.3s. Estimated remaining: 3h 6m 58s. Rate: 7.1 symbols/min [2025-10-13T19:26:53.940404] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:53.952123] [DEBUG] [LOCAL ] HPF: Loaded 7555 existing records from primary storage. [2025-10-13T19:26:53.952555] [INFO ] [MAIN ] HPF: Loaded 7555 existing records. [2025-10-13T19:26:54.024003] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-13T19:26:54.141876] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:54.142283] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-13T19:26:54.142394] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-13T19:26:54.142774] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-13T19:26:54.142912] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-13T19:26:54.480740] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:26:54.578533] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:54.817972] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-13T19:26:55.205220] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-13T19:26:55.337284] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:26:55.343082] [INFO ] [REMOTE ] HOUS: Full fetch complete (64052 records). [2025-10-13T19:26:55.343306] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-13T19:26:55.623244] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-13T19:26:55.733035] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-13T19:26:55.733138] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-13T19:26:55.734012] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-13T19:26:55.734080] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-13T19:26:55.735505] [DEBUG] [LOCAL ] HOUS: Trimmed 64052 records to 45081 (keeping 200 days of data) [2025-10-13T19:26:55.997803] [DEBUG] [LOCAL ] HOUS: Primary data saved (45081 records). [2025-10-13T19:26:55.998014] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-13T19:26:55.998123] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HOUS took 36.5s. Estimated remaining: 3h 6m 41s. Rate: 7.1 symbols/min [2025-10-13T19:26:56.169137] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:56.183703] [DEBUG] [LOCAL ] HPI: Loaded 10713 existing records from primary storage. [2025-10-13T19:26:56.183974] [INFO ] [MAIN ] HPI: Loaded 10713 existing records. [2025-10-13T19:26:56.375261] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:56.375555] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-13T19:26:56.375625] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-13T19:26:56.376015] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-13T19:26:56.376077] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-13T19:26:56.425981] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-13T19:26:56.480367] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:26:56.762575] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:56.793531] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T19:26:57.217956] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-13T19:26:57.862907] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:26:58.017897] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-13T19:26:58.330717] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:26:58.773435] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:26:58.817896] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-13T19:26:59.433917] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:26:59.617955] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-13T19:27:00.417415] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:27:00.419737] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-13T19:27:01.217960] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-13T19:27:02.018009] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-13T19:27:02.479819] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:27:02.527904] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T19:27:02.706486] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T19:27:02.817939] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-13T19:27:03.617995] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-13T19:27:04.255538] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T19:27:04.417969] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-13T19:27:04.636671] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:27:05.217999] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-13T19:27:05.946133] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T19:27:06.023085] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-13T19:27:06.040340] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:27:06.764895] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T19:27:06.817893] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-13T19:27:07.295926] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T19:27:07.617964] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-13T19:27:08.418009] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-13T19:27:09.217975] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-13T19:27:09.632513] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T19:27:09.763632] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T19:27:09.945793] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:27:10.017886] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-13T19:27:10.817961] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-13T19:27:10.847615] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:27:11.530041] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:27:11.617956] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-13T19:27:12.417966] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-13T19:27:13.217960] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-13T19:27:13.393696] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:27:13.437431] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:27:13.926353] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:27:14.017911] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-13T19:27:14.767072] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:27:14.817909] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-13T19:27:15.617910] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-13T19:27:15.797604] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:27:16.417912] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-13T19:27:17.217898] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-13T19:27:17.232917] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:27:17.238211] [INFO ] [REMOTE ] HP: Full fetch complete (73886 records). [2025-10-13T19:27:17.238374] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-13T19:27:17.346585] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:27:17.351872] [INFO ] [REMOTE ] HPI: Full fetch complete (13905 records). [2025-10-13T19:27:17.357468] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-13T19:27:17.976000] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-13T19:27:17.997741] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-13T19:27:18.007890] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-13T19:27:18.031837] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-13T19:27:18.032781] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-13T19:27:18.032874] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-13T19:27:18.032930] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-13T19:27:18.033166] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-13T19:27:18.033357] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-13T19:27:18.034538] [DEBUG] [LOCAL ] HPI: Trimmed 13905 records to 10635 (keeping 200 days of data) [2025-10-13T19:27:18.035497] [DEBUG] [LOCAL ] HP: Trimmed 73886 records to 51538 (keeping 200 days of data) [2025-10-13T19:27:18.305675] [DEBUG] [LOCAL ] HPI: Primary data saved (10635 records). [2025-10-13T19:27:18.307822] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-13T19:27:18.309007] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPI took 22.3s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-13T19:27:18.573102] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:18.595328] [DEBUG] [LOCAL ] HP: Primary data saved (51538 records). [2025-10-13T19:27:18.595490] [INFO ] [MAIN ] HP: Full history saved. [2025-10-13T19:27:18.595576] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HP took 41.6s. Estimated remaining: 3h 6m 32s. Rate: 7.1 symbols/min [2025-10-13T19:27:18.790604] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:18.806473] [DEBUG] [LOCAL ] HPP: Loaded 51811 existing records from primary storage. [2025-10-13T19:27:18.806874] [INFO ] [MAIN ] HPP: Loaded 51811 existing records. [2025-10-13T19:27:18.992944] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:18.993967] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-13T19:27:19.002372] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-13T19:27:19.002837] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:27:19.006295] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-13T19:27:19.006710] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-13T19:27:19.006916] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-13T19:27:19.154617] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-10-13T19:27:19.175931] [INFO ] [MAIN ] HPQ: Loaded 54448 existing records. [2025-10-13T19:27:19.616544] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:19.648055] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-13T19:27:19.672294] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-13T19:27:19.690138] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:19.691297] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-13T19:27:19.691178] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-13T19:27:19.692583] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-13T19:27:19.695690] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-13T19:27:19.825864] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:27:20.090708] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:20.417960] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-13T19:27:21.127665] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T19:27:21.217948] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-13T19:27:21.425142] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:27:22.017953] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-13T19:27:22.817968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-13T19:27:23.247136] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T19:27:23.595469] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:27:23.618069] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-13T19:27:24.417993] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-13T19:27:24.749471] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T19:27:25.132896] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:27:25.217977] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-13T19:27:25.936519] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T19:27:25.939133] [INFO ] [REMOTE ] HPF: Full fetch complete (10684 records). [2025-10-13T19:27:25.939300] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-13T19:27:26.022588] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-13T19:27:26.222041] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:27:26.556623] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-13T19:27:26.556776] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-13T19:27:26.557288] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-13T19:27:26.557358] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-13T19:27:26.558299] [DEBUG] [LOCAL ] HPF: Trimmed 10684 records to 7500 (keeping 200 days of data) [2025-10-13T19:27:26.615959] [DEBUG] [LOCAL ] HPF: Primary data saved (7500 records). [2025-10-13T19:27:26.616154] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-13T19:27:26.616263] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPF took 32.9s. Estimated remaining: 3h 6m 23s. Rate: 7.1 symbols/min [2025-10-13T19:27:26.811036] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:26.818005] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-13T19:27:26.824763] [DEBUG] [LOCAL ] HPS: Loaded 10421 existing records from primary storage. [2025-10-13T19:27:26.825041] [INFO ] [MAIN ] HPS: Loaded 10421 existing records. [2025-10-13T19:27:27.069130] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:27.069445] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-13T19:27:27.069497] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-13T19:27:27.069782] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-13T19:27:27.069842] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-13T19:27:27.454243] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:27.617983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-13T19:27:27.778279] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:27:28.417971] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-13T19:27:28.720421] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T19:27:29.217956] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-13T19:27:29.585901] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T19:27:30.017949] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-13T19:27:30.094372] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:27:30.817969] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-13T19:27:31.054729] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T19:27:31.617980] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-13T19:27:31.891116] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:27:31.897029] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-13T19:27:31.897234] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-13T19:27:32.310902] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-13T19:27:32.311107] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-13T19:27:32.312471] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-13T19:27:32.312601] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-13T19:27:32.316572] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-13T19:27:32.427263] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-13T19:27:32.450052] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T19:27:32.722875] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-13T19:27:32.723071] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-13T19:27:32.723178] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPE took 45.1s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-13T19:27:32.902916] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:32.931346] [DEBUG] [LOCAL ] HQH: Loaded 26049 existing records from primary storage. [2025-10-13T19:27:32.931745] [INFO ] [MAIN ] HQH: Loaded 26049 existing records. [2025-10-13T19:27:33.131053] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:33.131565] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-13T19:27:33.131830] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-13T19:27:33.132286] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-13T19:27:33.132365] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-13T19:27:33.223912] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-13T19:27:33.312469] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:27:33.445988] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T19:27:33.579102] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:34.017976] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-13T19:27:34.756328] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:27:34.817891] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-13T19:27:35.617944] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-13T19:27:36.145206] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T19:27:36.417914] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-13T19:27:36.463217] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:27:36.514050] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:27:37.217973] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-13T19:27:37.762929] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:27:38.017979] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-13T19:27:38.820115] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-13T19:27:38.827404] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:27:39.151029] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T19:27:39.618015] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-13T19:27:40.276986] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T19:27:40.417950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-13T19:27:40.842722] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T19:27:41.221770] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-13T19:27:41.224130] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:27:42.017992] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-13T19:27:42.326578] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:27:42.817962] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-13T19:27:43.618008] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-13T19:27:43.712710] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:27:43.742101] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T19:27:44.417976] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-13T19:27:44.696608] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:27:45.217953] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-13T19:27:45.302916] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T19:27:46.017970] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-13T19:27:46.817911] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-13T19:27:46.835631] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:27:46.842177] [INFO ] [REMOTE ] HPP: Full fetch complete (73271 records). [2025-10-13T19:27:46.842343] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-13T19:27:47.262154] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-13T19:27:47.271589] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-13T19:27:47.273963] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-13T19:27:47.274068] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-13T19:27:47.272254] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:27:47.282469] [DEBUG] [LOCAL ] HPP: Trimmed 73271 records to 51145 (keeping 200 days of data) [2025-10-13T19:27:47.592173] [DEBUG] [LOCAL ] HPP: Primary data saved (51145 records). [2025-10-13T19:27:47.592363] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-13T19:27:47.592474] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPP took 29.3s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-13T19:27:47.623270] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-13T19:27:47.699305] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:27:47.787117] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:47.806729] [DEBUG] [LOCAL ] HQL: Loaded 17027 existing records from primary storage. [2025-10-13T19:27:47.807068] [INFO ] [MAIN ] HQL: Loaded 17027 existing records. [2025-10-13T19:27:47.993047] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:47.993308] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-13T19:27:47.993359] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-13T19:27:47.993738] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-13T19:27:47.993799] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-13T19:27:48.364500] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:48.418038] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-13T19:27:48.954170] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:27:49.217967] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-13T19:27:49.385152] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:27:50.018001] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-13T19:27:50.195759] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:27:50.817958] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-13T19:27:51.618043] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-13T19:27:51.641490] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:27:51.898881] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T19:27:52.417962] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-13T19:27:52.751407] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T19:27:52.883882] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:27:53.217968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-13T19:27:54.018034] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-13T19:27:54.829883] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-13T19:27:54.837163] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:27:54.992007] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:27:55.617977] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-13T19:27:55.631776] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:27:55.634079] [INFO ] [REMOTE ] HPS: Full fetch complete (15195 records). [2025-10-13T19:27:55.634179] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-13T19:27:55.997028] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-13T19:27:55.997128] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-13T19:27:55.997574] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-13T19:27:55.997616] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-13T19:27:55.998193] [DEBUG] [LOCAL ] HPS: Trimmed 15195 records to 10321 (keeping 200 days of data) [2025-10-13T19:27:56.066629] [DEBUG] [LOCAL ] HPS: Primary data saved (10321 records). [2025-10-13T19:27:56.066834] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-13T19:27:56.066930] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPS took 29.5s. Estimated remaining: 3h 6m 3s. Rate: 7.1 symbols/min [2025-10-13T19:27:56.245944] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:56.306636] [DEBUG] [LOCAL ] HR: Loaded 52742 existing records from primary storage. [2025-10-13T19:27:56.307023] [INFO ] [MAIN ] HR: Loaded 52742 existing records. [2025-10-13T19:27:56.423091] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-13T19:27:56.498970] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:56.499249] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-13T19:27:56.499306] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-13T19:27:56.500150] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-13T19:27:56.500209] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-13T19:27:56.850925] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:27:56.913979] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:57.217961] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-13T19:27:58.017973] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-13T19:27:58.272172] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:27:58.329267] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:27:58.817965] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-13T19:27:59.445315] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:27:59.617943] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-13T19:27:59.783225] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T19:28:00.417996] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-13T19:28:01.217988] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-13T19:28:01.689744] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-13T19:28:01.719845] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T19:28:02.017991] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-13T19:28:02.818003] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-13T19:28:02.899555] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:28:02.955455] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T19:28:02.961474] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-13T19:28:02.961713] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-13T19:28:03.350457] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-13T19:28:03.350559] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-13T19:28:03.351518] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-13T19:28:03.351611] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-13T19:28:03.353758] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-13T19:28:03.638353] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-13T19:28:03.690365] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-13T19:28:03.690518] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-13T19:28:03.690604] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HPQ took 45.1s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-13T19:28:03.862202] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:03.874790] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:28:03.921972] [DEBUG] [LOCAL ] HRB: Loaded 49060 existing records from primary storage. [2025-10-13T19:28:03.922313] [INFO ] [MAIN ] HRB: Loaded 49060 existing records. [2025-10-13T19:28:04.094085] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:04.094318] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-13T19:28:04.094367] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-13T19:28:04.094680] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-13T19:28:04.094737] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-13T19:28:04.424964] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-13T19:28:04.472720] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:04.515012] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T19:28:05.217946] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-13T19:28:05.393605] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T19:28:06.017974] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-13T19:28:06.341187] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T19:28:06.344528] [INFO ] [REMOTE ] HQH: Full fetch complete (37199 records). [2025-10-13T19:28:06.344606] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-13T19:28:06.710278] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-13T19:28:06.710372] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-13T19:28:06.711011] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-13T19:28:06.711070] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-13T19:28:06.711920] [DEBUG] [LOCAL ] HQH: Trimmed 37199 records to 25666 (keeping 200 days of data) [2025-10-13T19:28:06.819764] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-13T19:28:06.867236] [DEBUG] [LOCAL ] HQH: Primary data saved (25666 records). [2025-10-13T19:28:06.867377] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-13T19:28:06.867458] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQH took 34.1s. Estimated remaining: 3h 5m 38s. Rate: 7.1 symbols/min [2025-10-13T19:28:07.032629] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:07.065178] [DEBUG] [LOCAL ] HRI: Loaded 32990 existing records from primary storage. [2025-10-13T19:28:07.065467] [INFO ] [MAIN ] HRI: Loaded 32990 existing records. [2025-10-13T19:28:07.243018] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:07.243215] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-13T19:28:07.243261] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-13T19:28:07.243710] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-13T19:28:07.243767] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-13T19:28:07.610762] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:07.622994] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-13T19:28:07.640889] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T19:28:08.171879] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T19:28:08.417942] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-13T19:28:08.908637] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:28:09.217956] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-13T19:28:10.027777] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-13T19:28:10.048166] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:28:10.479471] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T19:28:10.817965] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-13T19:28:10.965138] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:28:11.617945] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-13T19:28:12.386120] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:28:12.417883] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-13T19:28:13.217987] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-13T19:28:13.276794] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:28:14.017891] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-13T19:28:14.073151] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:28:14.419186] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T19:28:14.817963] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-13T19:28:15.617888] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-13T19:28:15.743924] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:28:16.417964] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-13T19:28:16.571051] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:28:16.634042] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:28:17.217957] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-13T19:28:17.967569] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:28:18.017901] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-13T19:28:18.818015] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-13T19:28:18.963827] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:28:19.617966] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-13T19:28:19.729683] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:28:20.390199] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:28:20.419215] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-13T19:28:20.421927] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:28:21.217959] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-13T19:28:21.968121] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:28:22.017886] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-13T19:28:22.214225] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:28:22.817955] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-13T19:28:23.617951] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-13T19:28:23.727348] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:28:24.165213] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:28:24.417899] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-13T19:28:24.548711] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:28:25.218041] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-13T19:28:25.934023] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:28:26.017984] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-13T19:28:26.551747] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:28:26.817985] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-13T19:28:27.617960] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-13T19:28:27.837412] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:28:28.096106] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T19:28:28.417903] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-13T19:28:28.666923] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:28:29.217902] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-13T19:28:30.023994] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-13T19:28:30.026219] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:28:30.031918] [INFO ] [REMOTE ] HRB: Full fetch complete (69880 records). [2025-10-13T19:28:30.032023] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-13T19:28:30.476833] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-13T19:28:30.476917] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-13T19:28:30.477827] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-13T19:28:30.477889] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-13T19:28:30.479270] [DEBUG] [LOCAL ] HRB: Trimmed 69880 records to 48339 (keeping 200 days of data) [2025-10-13T19:28:30.771631] [DEBUG] [LOCAL ] HRB: Primary data saved (48339 records). [2025-10-13T19:28:30.771796] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-13T19:28:30.771880] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRB took 27.1s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-13T19:28:30.826171] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-13T19:28:30.956179] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:30.985765] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:28:31.045289] [DEBUG] [LOCAL ] HRL: Loaded 53874 existing records from primary storage. [2025-10-13T19:28:31.045709] [INFO ] [MAIN ] HRL: Loaded 53874 existing records. [2025-10-13T19:28:31.271276] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:31.271553] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-13T19:28:31.271629] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-13T19:28:31.272182] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-13T19:28:31.272240] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-13T19:28:31.624671] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-13T19:28:31.650159] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:28:31.647661] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:31.976238] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T19:28:31.979117] [INFO ] [REMOTE ] HQL: Full fetch complete (25153 records). [2025-10-13T19:28:31.979189] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-13T19:28:32.355505] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-13T19:28:32.355595] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-13T19:28:32.356170] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-13T19:28:32.356232] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-13T19:28:32.356928] [DEBUG] [LOCAL ] HQL: Trimmed 25153 records to 16787 (keeping 200 days of data) [2025-10-13T19:28:32.431091] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-13T19:28:32.463703] [DEBUG] [LOCAL ] HQL: Primary data saved (16787 records). [2025-10-13T19:28:32.463854] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-13T19:28:32.463935] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HQL took 44.9s. Estimated remaining: 3h 5m 32s. Rate: 7.1 symbols/min [2025-10-13T19:28:32.641630] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:32.675246] [DEBUG] [LOCAL ] HRTG: Loaded 34334 existing records from primary storage. [2025-10-13T19:28:32.675523] [INFO ] [MAIN ] HRTG: Loaded 34334 existing records. [2025-10-13T19:28:32.852847] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:32.853066] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-13T19:28:32.853113] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-13T19:28:32.853397] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-13T19:28:32.853454] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-13T19:28:33.217393] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:33.217987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-13T19:28:33.239388] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:28:33.244886] [INFO ] [REMOTE ] HR: Full fetch complete (74808 records). [2025-10-13T19:28:33.245007] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-13T19:28:33.634833] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-13T19:28:33.634979] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-13T19:28:33.635996] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-13T19:28:33.636082] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-13T19:28:33.638023] [DEBUG] [LOCAL ] HR: Trimmed 74808 records to 52098 (keeping 200 days of data) [2025-10-13T19:28:33.755271] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:28:33.980623] [DEBUG] [LOCAL ] HR: Primary data saved (52098 records). [2025-10-13T19:28:33.980783] [INFO ] [MAIN ] HR: Full history saved. [2025-10-13T19:28:33.981458] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HR took 37.9s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-13T19:28:34.024272] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-13T19:28:34.156425] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:34.208766] [DEBUG] [LOCAL ] HSBC: Loaded 51725 existing records from primary storage. [2025-10-13T19:28:34.209143] [INFO ] [MAIN ] HSBC: Loaded 51725 existing records. [2025-10-13T19:28:34.386592] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:34.386920] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-13T19:28:34.386971] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-13T19:28:34.387976] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-13T19:28:34.388035] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-13T19:28:34.522379] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T19:28:34.770848] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:34.817886] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-13T19:28:35.617941] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-13T19:28:35.845775] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T19:28:36.131915] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:28:36.417951] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-13T19:28:36.966779] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:28:37.009634] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T19:28:37.217958] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-13T19:28:38.017965] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-13T19:28:38.418911] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:28:38.422599] [INFO ] [REMOTE ] HRI: Full fetch complete (46208 records). [2025-10-13T19:28:38.422725] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-13T19:28:38.825167] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-13T19:28:38.829113] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-13T19:28:38.829227] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-13T19:28:38.830406] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-13T19:28:38.830588] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-13T19:28:38.832228] [DEBUG] [LOCAL ] HRI: Trimmed 46208 records to 32515 (keeping 200 days of data) [2025-10-13T19:28:39.051587] [DEBUG] [LOCAL ] HRI: Primary data saved (32515 records). [2025-10-13T19:28:39.051812] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-13T19:28:39.051918] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRI took 32.2s. Estimated remaining: 3h 5m 2s. Rate: 7.1 symbols/min [2025-10-13T19:28:39.224988] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:39.240693] [DEBUG] [LOCAL ] HSHP: Loaded 15260 existing records from primary storage. [2025-10-13T19:28:39.240993] [INFO ] [MAIN ] HSHP: Loaded 15260 existing records. [2025-10-13T19:28:39.417630] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:39.418031] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-13T19:28:39.418120] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-13T19:28:39.418632] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-13T19:28:39.418734] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-13T19:28:39.636001] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-13T19:28:39.799369] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:39.914089] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T19:28:39.963860] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:28:40.417977] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-13T19:28:41.217975] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-13T19:28:41.687397] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T19:28:42.017929] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-13T19:28:42.211762] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T19:28:42.280249] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T19:28:42.817957] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-13T19:28:43.623111] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-13T19:28:43.638302] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:28:44.186305] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T19:28:44.417986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-13T19:28:44.601258] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T19:28:45.217994] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-13T19:28:45.934263] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:28:46.017911] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-13T19:28:46.216327] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T19:28:46.817957] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-13T19:28:47.446100] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:28:47.617904] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-13T19:28:48.418011] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-13T19:28:48.811552] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:28:48.939217] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T19:28:49.217944] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-13T19:28:49.885186] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:28:50.018024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-13T19:28:50.616164] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T19:28:50.817944] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-13T19:28:51.617976] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-13T19:28:51.918517] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:28:52.220052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:28:52.417987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-13T19:28:53.217961] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-13T19:28:53.673621] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:28:53.844772] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:28:53.848753] [INFO ] [REMOTE ] HRTG: Full fetch complete (43682 records). [2025-10-13T19:28:53.848856] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-13T19:28:54.023302] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-13T19:28:54.233472] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-13T19:28:54.233592] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-13T19:28:54.246850] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-13T19:28:54.247047] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-13T19:28:54.248688] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:28:54.255000] [DEBUG] [LOCAL ] HRTG: Trimmed 43682 records to 34109 (keeping 200 days of data) [2025-10-13T19:28:54.450264] [DEBUG] [LOCAL ] HRTG: Primary data saved (34109 records). [2025-10-13T19:28:54.450402] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-13T19:28:54.450480] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 22.0s. Estimated remaining: 3h 5m 2s. Rate: 7.1 symbols/min [2025-10-13T19:28:54.615717] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:54.668187] [DEBUG] [LOCAL ] HSY: Loaded 51062 existing records from primary storage. [2025-10-13T19:28:54.668525] [INFO ] [MAIN ] HSY: Loaded 51062 existing records. [2025-10-13T19:28:54.822621] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-13T19:28:54.843991] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:54.845564] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-13T19:28:54.845614] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-13T19:28:54.846126] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-13T19:28:54.846182] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-13T19:28:55.197464] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:55.617987] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-13T19:28:55.942350] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T19:28:56.005602] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T19:28:56.417983] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-13T19:28:57.217964] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-13T19:28:57.454124] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T19:28:58.017966] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-13T19:28:58.245741] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T19:28:58.301836] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:28:58.817963] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-13T19:28:59.365278] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T19:28:59.541757] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:28:59.618003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-13T19:29:00.418028] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-13T19:29:01.218072] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-13T19:29:01.765615] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T19:29:02.017966] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-13T19:29:02.616622] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-13T19:29:02.817935] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-13T19:29:02.894280] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T19:29:03.617894] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-13T19:29:03.786345] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:29:03.832820] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:29:04.417932] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-13T19:29:05.217998] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-13T19:29:05.385423] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:29:06.017947] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-13T19:29:06.145337] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:29:06.337954] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:29:06.817945] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-13T19:29:07.617989] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-13T19:29:07.766245] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T19:29:07.787572] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T19:29:08.417970] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-13T19:29:09.217983] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-13T19:29:09.266357] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:29:10.017898] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-13T19:29:10.292942] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T19:29:10.817945] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-13T19:29:11.009361] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:29:11.014940] [INFO ] [REMOTE ] HSBC: Full fetch complete (73852 records). [2025-10-13T19:29:11.015115] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-13T19:29:11.455980] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-13T19:29:11.456382] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-13T19:29:11.458087] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-13T19:29:11.458481] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-13T19:29:11.460601] [DEBUG] [LOCAL ] HSBC: Trimmed 73852 records to 50994 (keeping 200 days of data) [2025-10-13T19:29:11.618720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-13T19:29:11.654002] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:29:11.963340] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:29:12.011037] [DEBUG] [LOCAL ] HSBC: Primary data saved (50994 records). [2025-10-13T19:29:12.011253] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-13T19:29:12.012511] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSBC took 38.0s. Estimated remaining: 3h 5m 5s. Rate: 7.1 symbols/min [2025-10-13T19:29:12.235402] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:12.235591] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-13T19:29:12.235628] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-13T19:29:12.235767] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-13T19:29:12.235809] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-13T19:29:12.235849] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-13T19:29:12.235890] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-13T19:29:12.423689] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-13T19:29:12.611954] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:13.218173] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-13T19:29:13.432225] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:29:13.465124] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:29:13.468049] [INFO ] [REMOTE ] HSHP: Full fetch complete (23263 records). [2025-10-13T19:29:13.468118] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-13T19:29:13.836224] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-13T19:29:13.836298] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-13T19:29:13.836854] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-13T19:29:13.836914] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-13T19:29:13.837514] [DEBUG] [LOCAL ] HSHP: Trimmed 23263 records to 14975 (keeping 200 days of data) [2025-10-13T19:29:13.924614] [DEBUG] [LOCAL ] HSHP: Primary data saved (14975 records). [2025-10-13T19:29:13.924772] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-13T19:29:13.924904] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSHP took 34.9s. Estimated remaining: 3h 4m 49s. Rate: 7.1 symbols/min [2025-10-13T19:29:14.023020] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-13T19:29:14.095352] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:14.114909] [DEBUG] [LOCAL ] HTD: Loaded 14213 existing records from primary storage. [2025-10-13T19:29:14.115150] [INFO ] [MAIN ] HTD: Loaded 14213 existing records. [2025-10-13T19:29:14.305615] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:14.305905] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-13T19:29:14.305967] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-13T19:29:14.306385] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-13T19:29:14.306459] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-13T19:29:14.670269] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:14.817945] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-13T19:29:15.178226] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T19:29:15.369217] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T19:29:15.617990] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-13T19:29:15.767333] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:29:16.417963] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-13T19:29:16.458223] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T19:29:17.217982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-13T19:29:18.017940] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-13T19:29:18.230628] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:29:18.231268] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-13T19:29:18.231376] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:29:18.231425] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-13T19:29:18.231496] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:29:18.231573] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-13T19:29:18.231674] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-13T19:29:18.231769] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-13T19:29:18.231833] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-13T19:29:18.231892] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTB took 6.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-13T19:29:18.391433] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T19:29:18.460248] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:18.460470] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-13T19:29:18.460507] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-13T19:29:18.460639] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-13T19:29:18.460718] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-13T19:29:18.460764] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-13T19:29:18.460800] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-13T19:29:18.862046] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-13T19:29:18.867726] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:19.310488] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T19:29:19.316106] [INFO ] [REMOTE ] HRL: Full fetch complete (76699 records). [2025-10-13T19:29:19.316261] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-13T19:29:19.619834] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-13T19:29:19.705383] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:29:19.748237] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-13T19:29:19.748334] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-13T19:29:19.749578] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-13T19:29:19.749680] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-13T19:29:19.751534] [DEBUG] [LOCAL ] HRL: Trimmed 76699 records to 53111 (keeping 200 days of data) [2025-10-13T19:29:19.984122] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-13T19:29:20.070146] [DEBUG] [LOCAL ] HRL: Primary data saved (53111 records). [2025-10-13T19:29:20.070293] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-13T19:29:20.070394] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HRL took 49.3s. Estimated remaining: 3h 4m 19s. Rate: 7.1 symbols/min [2025-10-13T19:29:20.235212] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:20.280540] [DEBUG] [LOCAL ] HTGC: Loaded 48240 existing records from primary storage. [2025-10-13T19:29:20.280889] [INFO ] [MAIN ] HTGC: Loaded 48240 existing records. [2025-10-13T19:29:20.423093] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-13T19:29:20.461702] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:20.462212] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-13T19:29:20.462262] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-13T19:29:20.463226] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-13T19:29:20.463284] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-13T19:29:20.804303] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:21.221756] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-13T19:29:21.540152] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T19:29:22.017979] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-13T19:29:22.248199] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T19:29:22.278078] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-13T19:29:22.817978] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-13T19:29:23.617998] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-13T19:29:23.748684] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:29:24.417969] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-13T19:29:24.731676] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-13T19:29:25.217934] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-13T19:29:25.343604] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:29:26.017951] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-13T19:29:26.143779] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T19:29:26.817952] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-13T19:29:27.617952] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-13T19:29:27.646405] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T19:29:27.738168] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T19:29:27.743172] [INFO ] [REMOTE ] HSY: Full fetch complete (73480 records). [2025-10-13T19:29:27.743286] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-13T19:29:28.137760] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-13T19:29:28.137847] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-13T19:29:28.138780] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-13T19:29:28.138844] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-13T19:29:28.140282] [DEBUG] [LOCAL ] HSY: Trimmed 73480 records to 50382 (keeping 200 days of data) [2025-10-13T19:29:28.426442] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-13T19:29:28.459841] [DEBUG] [LOCAL ] HSY: Primary data saved (50382 records). [2025-10-13T19:29:28.459932] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-13T19:29:28.460008] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 34.0s. Estimated remaining: 3h 4m 10s. Rate: 7.1 symbols/min [2025-10-13T19:29:28.630548] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:28.666466] [DEBUG] [LOCAL ] HTH: Loaded 32795 existing records from primary storage. [2025-10-13T19:29:28.666755] [INFO ] [MAIN ] HTH: Loaded 32795 existing records. [2025-10-13T19:29:28.845160] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:28.845495] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-13T19:29:28.845550] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-13T19:29:28.845891] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-13T19:29:28.845947] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-13T19:29:29.237741] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-13T19:29:29.259080] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:29:29.262610] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:29.289671] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T19:29:29.698758] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:29:30.017933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-13T19:29:30.818008] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-13T19:29:31.153264] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T19:29:31.617904] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-13T19:29:31.672047] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:29:31.929322] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:29:32.417947] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-13T19:29:32.652411] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-13T19:29:33.217946] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-13T19:29:33.442969] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-13T19:29:34.021289] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-13T19:29:34.817901] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-13T19:29:35.125946] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T19:29:35.617939] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-13T19:29:35.798119] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:29:35.928729] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-13T19:29:36.418028] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-13T19:29:37.217898] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-13T19:29:37.556370] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T19:29:37.557339] [INFO ] [REMOTE ] HTFC: Full fetch complete (852 records). [2025-10-13T19:29:37.557523] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-13T19:29:37.725816] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T19:29:37.761749] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-13T19:29:37.761898] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:29:37.761967] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:29:37.762039] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-13T19:29:37.762103] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-13T19:29:37.762140] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-13T19:29:37.762180] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-13T19:29:37.762237] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTFC took 19.5s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-13T19:29:37.932263] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:37.973860] [DEBUG] [LOCAL ] HUBB: Loaded 37087 existing records from primary storage. [2025-10-13T19:29:37.974161] [INFO ] [MAIN ] HUBB: Loaded 37087 existing records. [2025-10-13T19:29:38.023122] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-13T19:29:38.167423] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:38.167765] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-13T19:29:38.167822] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-13T19:29:38.168926] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-13T19:29:38.168990] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-13T19:29:38.557016] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:38.817941] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-13T19:29:38.921228] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T19:29:39.617987] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-13T19:29:40.249940] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:29:40.417993] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-13T19:29:40.958255] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T19:29:41.217987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-13T19:29:41.868953] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:29:42.017887] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-13T19:29:42.440356] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:29:42.817992] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-13T19:29:42.990697] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T19:29:43.617995] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-13T19:29:44.417910] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-13T19:29:44.573775] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:29:44.589672] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T19:29:44.591740] [INFO ] [REMOTE ] HTD: Full fetch complete (19301 records). [2025-10-13T19:29:44.591811] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-13T19:29:44.966909] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-13T19:29:44.966987] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-13T19:29:44.967410] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-13T19:29:44.967450] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-13T19:29:44.968306] [DEBUG] [LOCAL ] HTD: Trimmed 19301 records to 14053 (keeping 200 days of data) [2025-10-13T19:29:45.054798] [DEBUG] [LOCAL ] HTD: Primary data saved (14053 records). [2025-10-13T19:29:45.054939] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-13T19:29:45.055023] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTD took 31.1s. Estimated remaining: 3h 3m 53s. Rate: 7.1 symbols/min [2025-10-13T19:29:45.226961] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:45.223901] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-13T19:29:45.269026] [DEBUG] [LOCAL ] HUBS: Loaded 40321 existing records from primary storage. [2025-10-13T19:29:45.269312] [INFO ] [MAIN ] HUBS: Loaded 40321 existing records. [2025-10-13T19:29:45.443576] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:45.443785] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-13T19:29:45.443833] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-13T19:29:45.444218] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-13T19:29:45.444273] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-13T19:29:45.830065] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:45.910915] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:29:46.017934] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-13T19:29:46.522807] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:29:46.817966] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-13T19:29:47.617936] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-13T19:29:47.811551] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T19:29:47.890451] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:29:48.417970] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-13T19:29:48.993415] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T19:29:49.217899] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-13T19:29:50.017910] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-13T19:29:50.093802] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T19:29:50.664382] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:29:50.817961] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-13T19:29:51.375936] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:29:51.618000] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-13T19:29:52.256088] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:29:52.417979] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-13T19:29:52.819402] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:29:53.218008] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-13T19:29:54.017942] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-13T19:29:54.086476] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:29:54.814795] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:29:54.823005] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-13T19:29:55.238485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:29:55.617946] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-13T19:29:56.094066] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:29:56.418008] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-13T19:29:56.847190] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:29:57.217951] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-13T19:29:57.898120] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:29:58.017975] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-13T19:29:58.791985] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:29:58.817894] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-13T19:29:59.623161] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-13T19:29:59.637609] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:30:00.247244] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:30:00.417996] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-13T19:30:01.208169] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:30:01.217877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-13T19:30:01.481764] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:30:02.018065] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-13T19:30:02.697861] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:30:02.818009] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-13T19:30:03.394805] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:30:03.618004] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-13T19:30:04.442466] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-13T19:30:04.475701] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:30:05.217960] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-13T19:30:05.480305] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T19:30:06.017933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-13T19:30:06.183172] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:30:06.737469] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:30:06.818014] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-13T19:30:07.617945] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-13T19:30:07.787700] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:30:08.179840] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:30:08.417968] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-13T19:30:09.217905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-13T19:30:09.345790] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:30:09.685840] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T19:30:09.694745] [INFO ] [REMOTE ] HTGC: Full fetch complete (68591 records). [2025-10-13T19:30:09.694927] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-13T19:30:10.024296] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-13T19:30:10.088555] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-13T19:30:10.088691] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-13T19:30:10.089758] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-13T19:30:10.089835] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-13T19:30:10.091690] [DEBUG] [LOCAL ] HTGC: Trimmed 68591 records to 47669 (keeping 200 days of data) [2025-10-13T19:30:10.450691] [DEBUG] [LOCAL ] HTGC: Primary data saved (47669 records). [2025-10-13T19:30:10.450857] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-13T19:30:10.450948] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HTGC took 50.4s. Estimated remaining: 3h 4m 5s. Rate: 7.1 symbols/min [2025-10-13T19:30:10.574349] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:30:10.640472] [INFO ] [REMOTE ] HTH: Full fetch complete (46677 records). [2025-10-13T19:30:10.646821] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-13T19:30:10.646626] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:10.829727] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-13T19:30:11.029906] [DEBUG] [LOCAL ] HUM: Loaded 49709 existing records from primary storage. [2025-10-13T19:30:11.041250] [INFO ] [MAIN ] HUM: Loaded 49709 existing records. [2025-10-13T19:30:11.263058] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-13T19:30:11.263200] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-13T19:30:11.264003] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-13T19:30:11.264461] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-13T19:30:11.346317] [DEBUG] [LOCAL ] HTH: Trimmed 46677 records to 32523 (keeping 200 days of data) [2025-10-13T19:30:11.352040] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:11.353276] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-13T19:30:11.353353] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-13T19:30:11.353937] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-13T19:30:11.353998] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-13T19:30:11.726995] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:30:11.775988] [INFO ] [REMOTE ] HUBB: Full fetch complete (53966 records). [2025-10-13T19:30:11.789938] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-13T19:30:11.992162] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:12.023727] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-13T19:30:12.204697] [DEBUG] [LOCAL ] HTH: Primary data saved (32523 records). [2025-10-13T19:30:12.236997] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-13T19:30:12.248032] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTH took 43.8s. Estimated remaining: 3h 3m 49s. Rate: 7.1 symbols/min [2025-10-13T19:30:12.495309] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-13T19:30:12.511833] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-13T19:30:12.543594] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-13T19:30:12.572144] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:12.572309] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-13T19:30:12.610471] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:30:12.606472] [DEBUG] [LOCAL ] HUBB: Trimmed 53966 records to 36459 (keeping 200 days of data) [2025-10-13T19:30:12.620758] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-13T19:30:12.797977] [DEBUG] [LOCAL ] HUN: Loaded 53981 existing records from primary storage. [2025-10-13T19:30:12.853476] [INFO ] [MAIN ] HUN: Loaded 53981 existing records. [2025-10-13T19:30:13.112867] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:13.114747] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-13T19:30:13.117720] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-13T19:30:13.122520] [DEBUG] [LOCAL ] HUBB: Primary data saved (36459 records). [2025-10-13T19:30:13.122703] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-13T19:30:13.123581] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBB took 35.4s. Estimated remaining: 3h 3m 31s. Rate: 7.1 symbols/min [2025-10-13T19:30:13.123687] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-13T19:30:13.123834] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-13T19:30:13.479321] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:13.695147] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:13.705866] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-13T19:30:13.724013] [DEBUG] [LOCAL ] HUYA: Loaded 44619 existing records from primary storage. [2025-10-13T19:30:13.724312] [INFO ] [MAIN ] HUYA: Loaded 44619 existing records. [2025-10-13T19:30:13.903254] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:13.903669] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-13T19:30:13.903748] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-13T19:30:13.927048] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-13T19:30:13.930157] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-13T19:30:13.992339] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T19:30:14.019081] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-13T19:30:14.266271] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:30:14.326822] [INFO ] [REMOTE ] HUBS: Full fetch complete (56230 records). [2025-10-13T19:30:14.330605] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:14.330989] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-13T19:30:14.732466] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-13T19:30:14.732554] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-13T19:30:14.733377] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-13T19:30:14.733441] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-13T19:30:14.734779] [DEBUG] [LOCAL ] HUBS: Trimmed 56230 records to 39971 (keeping 200 days of data) [2025-10-13T19:30:14.828819] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-13T19:30:15.018972] [DEBUG] [LOCAL ] HUBS: Primary data saved (39971 records). [2025-10-13T19:30:15.019154] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-13T19:30:15.019261] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUBS took 30.0s. Estimated remaining: 3h 3m 14s. Rate: 7.1 symbols/min [2025-10-13T19:30:15.197468] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:15.213382] [DEBUG] [LOCAL ] HVT: Loaded 15512 existing records from primary storage. [2025-10-13T19:30:15.213668] [INFO ] [MAIN ] HVT: Loaded 15512 existing records. [2025-10-13T19:30:15.421969] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:15.422303] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-13T19:30:15.422480] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-13T19:30:15.423038] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-13T19:30:15.423142] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-13T19:30:15.745532] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-13T19:30:15.825540] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:15.826016] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-13T19:30:15.891878] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T19:30:16.376062] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:30:16.417887] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-13T19:30:16.828404] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:30:17.217948] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-13T19:30:18.017954] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-13T19:30:18.068356] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:30:18.207637] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:30:18.817943] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-13T19:30:19.612926] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:30:19.622711] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-13T19:30:20.341753] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:30:20.417957] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-13T19:30:21.171077] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:30:21.217886] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-13T19:30:21.455118] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:30:22.017947] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-13T19:30:22.817952] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-13T19:30:22.848145] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:30:23.617895] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-13T19:30:23.719322] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T19:30:23.972992] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:30:24.417982] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-13T19:30:25.217975] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-13T19:30:25.455848] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:30:26.017932] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-13T19:30:26.075450] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:30:26.332502] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:30:26.817942] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-13T19:30:27.578204] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:30:27.617902] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-13T19:30:28.311668] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:30:28.417894] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-13T19:30:28.818536] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:30:29.102092] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T19:30:29.217959] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-13T19:30:30.017962] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-13T19:30:30.581087] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:30:30.817989] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-13T19:30:30.917987] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T19:30:31.617966] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-13T19:30:32.181670] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:30:32.423278] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-13T19:30:32.427773] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:30:33.217945] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-13T19:30:34.017941] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-13T19:30:34.356471] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:30:34.817983] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-13T19:30:34.981691] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:30:35.348383] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T19:30:35.617973] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-13T19:30:36.149593] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:30:36.417942] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-13T19:30:36.528209] [DEBUG] [REMOTE ] HUM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-13T19:30:36.528497] [WARN ] [REMOTE ] HUM: No data returned for month 2025-07 [2025-10-13T19:30:36.528605] [FATAL] [REMOTE ] HUM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:30:36.528757] [FATAL] [MAIN ] HUM: Failed to fetch primary data. [2025-10-13T19:30:36.528825] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:30:36.528897] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-13T19:30:36.528960] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-13T19:30:36.529005] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-13T19:30:36.529221] [DEBUG] [LOCAL ] HUM: Deleted derivative data file. [2025-10-13T19:30:36.529314] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 26.1s. Estimated remaining: 3h 3m 22s. Rate: 7.1 symbols/min [2025-10-13T19:30:36.716948] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:36.767079] [DEBUG] [LOCAL ] HWM: Loaded 53615 existing records from primary storage. [2025-10-13T19:30:36.767384] [INFO ] [MAIN ] HWM: Loaded 53615 existing records. [2025-10-13T19:30:36.945510] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:36.945717] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-13T19:30:36.945770] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-13T19:30:36.947382] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-13T19:30:36.947441] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-13T19:30:37.224947] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-13T19:30:37.307047] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:37.395297] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:30:38.017967] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-13T19:30:38.133983] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:30:38.817942] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-13T19:30:39.617940] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-13T19:30:39.781404] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:30:40.417971] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-13T19:30:40.509190] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:30:40.525264] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T19:30:40.527061] [INFO ] [REMOTE ] HVT: Full fetch complete (23195 records). [2025-10-13T19:30:40.527128] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-13T19:30:40.886639] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-13T19:30:40.886742] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-13T19:30:40.887218] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-13T19:30:40.887258] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-13T19:30:40.887883] [DEBUG] [LOCAL ] HVT: Trimmed 23195 records to 15205 (keeping 200 days of data) [2025-10-13T19:30:40.978468] [DEBUG] [LOCAL ] HVT: Primary data saved (15205 records). [2025-10-13T19:30:40.978604] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-13T19:30:40.978720] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 26.0s. Estimated remaining: 3h 3m 9s. Rate: 7.1 symbols/min [2025-10-13T19:30:41.144422] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:41.184485] [DEBUG] [LOCAL ] HXL: Loaded 46548 existing records from primary storage. [2025-10-13T19:30:41.184833] [INFO ] [MAIN ] HXL: Loaded 46548 existing records. [2025-10-13T19:30:41.226262] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-13T19:30:41.360063] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:41.360263] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-13T19:30:41.360313] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-13T19:30:41.361367] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-13T19:30:41.361424] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-13T19:30:41.719472] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:41.922171] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:30:42.017904] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-13T19:30:42.754031] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:30:42.817942] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-13T19:30:43.263447] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:30:43.617954] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-13T19:30:44.417902] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-13T19:30:44.463479] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:30:45.109945] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:30:45.114633] [INFO ] [REMOTE ] HUYA: Full fetch complete (63960 records). [2025-10-13T19:30:45.114767] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-13T19:30:45.221157] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-13T19:30:45.516719] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-13T19:30:45.516812] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-13T19:30:45.517673] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-13T19:30:45.517737] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-13T19:30:45.519196] [DEBUG] [LOCAL ] HUYA: Trimmed 63960 records to 43863 (keeping 200 days of data) [2025-10-13T19:30:45.776216] [DEBUG] [LOCAL ] HUYA: Primary data saved (43863 records). [2025-10-13T19:30:45.776367] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-13T19:30:45.776458] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUYA took 32.7s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-13T19:30:45.955145] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:45.979638] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T19:30:45.996776] [DEBUG] [LOCAL ] HY: Loaded 10112 existing records from primary storage. [2025-10-13T19:30:45.997015] [INFO ] [MAIN ] HY: Loaded 10112 existing records. [2025-10-13T19:30:46.027958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-13T19:30:46.173718] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:46.173957] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-13T19:30:46.174024] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-13T19:30:46.174391] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-13T19:30:46.174450] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-13T19:30:46.518005] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:46.817895] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-13T19:30:47.038122] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:30:47.621583] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-13T19:30:47.625905] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:30:48.417902] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-13T19:30:48.463201] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:30:49.217993] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-13T19:30:49.369459] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T19:30:49.375847] [INFO ] [REMOTE ] HUN: Full fetch complete (76726 records). [2025-10-13T19:30:49.376051] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-13T19:30:49.794293] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-13T19:30:49.794409] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-13T19:30:49.795474] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-13T19:30:49.795540] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-13T19:30:49.797132] [DEBUG] [LOCAL ] HUN: Trimmed 76726 records to 53215 (keeping 200 days of data) [2025-10-13T19:30:50.018260] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-13T19:30:50.057804] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:30:50.175399] [DEBUG] [LOCAL ] HUN: Primary data saved (53215 records). [2025-10-13T19:30:50.175548] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-13T19:30:50.175631] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HUN took 37.9s. Estimated remaining: 3h 2m 42s. Rate: 7.1 symbols/min [2025-10-13T19:30:50.350309] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:50.350519] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-13T19:30:50.350583] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-13T19:30:50.350725] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-13T19:30:50.350774] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-13T19:30:50.350816] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-13T19:30:50.350849] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-13T19:30:50.727378] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:50.759519] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:30:50.817945] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-13T19:30:50.828260] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T19:30:51.153182] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T19:30:51.617953] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-13T19:30:51.914378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-13T19:30:52.417981] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-13T19:30:52.754178] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T19:30:53.218011] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-13T19:30:54.017978] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-13T19:30:54.817954] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-13T19:30:54.875639] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:30:55.160037] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T19:30:55.617961] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-13T19:30:56.418020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-13T19:30:56.459229] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T19:30:56.667080] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-13T19:30:57.220397] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-13T19:30:57.223381] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:30:58.017950] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-13T19:30:58.133258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T19:30:58.331403] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-13T19:30:58.817955] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-13T19:30:59.617975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-13T19:30:59.691824] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T19:30:59.880735] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T19:31:00.417945] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-13T19:31:01.217980] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-13T19:31:02.017934] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-13T19:31:02.132118] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:31:02.332453] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:31:02.817981] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-13T19:31:03.147936] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:31:03.617897] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-13T19:31:03.672860] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:31:04.053072] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T19:31:04.417976] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-13T19:31:05.217947] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-13T19:31:06.017955] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-13T19:31:06.238605] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T19:31:06.269209] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-13T19:31:06.817973] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-13T19:31:06.870162] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T19:31:07.617971] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-13T19:31:07.850739] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-13T19:31:08.417897] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-13T19:31:08.891963] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:31:09.217982] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-13T19:31:09.677753] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:31:10.017970] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-13T19:31:10.427622] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T19:31:10.428457] [INFO ] [REMOTE ] HYAC: Full fetch complete (913 records). [2025-10-13T19:31:10.428539] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-13T19:31:10.608953] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-13T19:31:10.609163] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:31:10.609233] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:31:10.609304] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-13T19:31:10.609365] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-13T19:31:10.609400] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-13T19:31:10.609439] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-13T19:31:10.609543] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 20.4s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-13T19:31:10.776086] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:10.776252] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-13T19:31:10.776306] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-13T19:31:10.776415] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-13T19:31:10.776455] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-13T19:31:10.776495] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-13T19:31:10.776538] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-13T19:31:10.828733] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-13T19:31:11.133360] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:11.197987] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:31:11.617929] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-13T19:31:11.968768] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-13T19:31:12.417904] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-13T19:31:12.586318] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:31:13.209451] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:31:13.217897] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-13T19:31:14.013458] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:31:14.017962] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-13T19:31:14.817982] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-13T19:31:15.143971] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T19:31:15.617905] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-13T19:31:15.991093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T19:31:16.417953] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-13T19:31:16.713842] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-13T19:31:17.096714] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T19:31:17.217902] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-13T19:31:18.017957] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-13T19:31:18.724226] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T19:31:18.784509] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:31:18.817892] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-13T19:31:19.617941] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-13T19:31:19.851961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-13T19:31:20.417941] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-13T19:31:20.554216] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T19:31:20.558861] [INFO ] [REMOTE ] HXL: Full fetch complete (66230 records). [2025-10-13T19:31:20.559005] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-13T19:31:20.934707] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-13T19:31:20.934802] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-13T19:31:20.935662] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-13T19:31:20.935726] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-13T19:31:20.937079] [DEBUG] [LOCAL ] HXL: Trimmed 66230 records to 45906 (keeping 200 days of data) [2025-10-13T19:31:21.218273] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-13T19:31:21.264092] [DEBUG] [LOCAL ] HXL: Primary data saved (45906 records). [2025-10-13T19:31:21.264291] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-13T19:31:21.264503] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HXL took 40.3s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-10-13T19:31:21.462386] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:21.476756] [DEBUG] [LOCAL ] HYI: Loaded 10069 existing records from primary storage. [2025-10-13T19:31:21.477000] [INFO ] [MAIN ] HYI: Loaded 10069 existing records. [2025-10-13T19:31:21.662533] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:21.662758] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-13T19:31:21.662815] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-13T19:31:21.663118] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-13T19:31:21.663184] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-13T19:31:22.029196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-13T19:31:22.063712] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:22.073057] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T19:31:22.192013] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:31:22.197695] [INFO ] [REMOTE ] HWM: Full fetch complete (76516 records). [2025-10-13T19:31:22.197824] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-13T19:31:22.579387] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-13T19:31:22.579467] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-13T19:31:22.580422] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-13T19:31:22.580484] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-13T19:31:22.581986] [DEBUG] [LOCAL ] HWM: Trimmed 76516 records to 52832 (keeping 200 days of data) [2025-10-13T19:31:22.805179] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:31:22.818883] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-13T19:31:22.922359] [DEBUG] [LOCAL ] HWM: Primary data saved (52832 records). [2025-10-13T19:31:22.922501] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-13T19:31:22.922585] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HWM took 46.4s. Estimated remaining: 3h 2m 26s. Rate: 7.1 symbols/min [2025-10-13T19:31:23.087511] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:23.119567] [DEBUG] [LOCAL ] HYT: Loaded 34001 existing records from primary storage. [2025-10-13T19:31:23.119862] [INFO ] [MAIN ] HYT: Loaded 34001 existing records. [2025-10-13T19:31:23.297298] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:23.297667] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-13T19:31:23.297858] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-13T19:31:23.298179] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-13T19:31:23.298230] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-13T19:31:23.406076] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:31:23.623102] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-13T19:31:23.660881] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:23.988104] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T19:31:24.417930] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-13T19:31:25.217981] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-13T19:31:25.714285] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T19:31:25.726477] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T19:31:26.017980] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-13T19:31:26.817947] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-13T19:31:26.853553] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:31:27.611307] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:31:27.617872] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-13T19:31:28.356766] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T19:31:28.417940] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-13T19:31:28.723153] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:31:29.217945] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-13T19:31:30.017936] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-13T19:31:30.205309] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T19:31:30.356740] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T19:31:30.817959] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-13T19:31:31.617901] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-13T19:31:31.639434] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:31:31.640976] [INFO ] [REMOTE ] HY: Full fetch complete (15020 records). [2025-10-13T19:31:31.641045] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-13T19:31:31.996073] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-13T19:31:31.996148] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-13T19:31:31.996475] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-13T19:31:31.996517] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-13T19:31:31.997051] [DEBUG] [LOCAL ] HY: Trimmed 15020 records to 10021 (keeping 200 days of data) [2025-10-13T19:31:32.057074] [DEBUG] [LOCAL ] HY: Primary data saved (10021 records). [2025-10-13T19:31:32.057196] [INFO ] [MAIN ] HY: Full history saved. [2025-10-13T19:31:32.057296] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HY took 46.3s. Estimated remaining: 3h 2m 18s. Rate: 7.1 symbols/min [2025-10-13T19:31:32.222487] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:32.228236] [DEBUG] [LOCAL ] HYTR: Loaded 3168 existing records from primary storage. [2025-10-13T19:31:32.228406] [INFO ] [MAIN ] HYTR: Loaded 3168 existing records. [2025-10-13T19:31:32.404676] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:32.404899] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-13T19:31:32.404965] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-13T19:31:32.405194] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-13T19:31:32.405286] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-13T19:31:32.425686] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-13T19:31:32.798664] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:32.980110] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T19:31:33.002097] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:31:33.217968] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-13T19:31:33.635628] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:31:34.017957] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-13T19:31:34.340843] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-13T19:31:34.817946] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-13T19:31:35.617953] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-13T19:31:36.056030] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:31:36.327103] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:31:36.417886] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-13T19:31:37.217951] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-13T19:31:37.559201] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T19:31:37.559887] [INFO ] [REMOTE ] HYBX: Full fetch complete (717 records). [2025-10-13T19:31:37.559952] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-13T19:31:37.560282] [FATAL] [VALIDATOR ] HYBX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T19:31:37.560363] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:31:37.560404] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:31:37.560442] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-13T19:31:37.560496] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-13T19:31:37.560530] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-13T19:31:37.560567] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-13T19:31:37.560618] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYBX took 27.0s. Estimated remaining: 3h 2m 6s. Rate: 7.1 symbols/min [2025-10-13T19:31:38.001365] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:31:38.017870] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-13T19:31:38.817960] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-13T19:31:39.500413] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:31:39.514551] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:31:39.617938] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-13T19:31:40.417947] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-13T19:31:40.868317] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T19:31:40.930552] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T19:31:41.217981] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-13T19:31:41.998481] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:31:42.017880] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-13T19:31:42.535995] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T19:31:42.817937] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-13T19:31:43.313121] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T19:31:43.617949] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-13T19:31:44.233575] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:31:44.417947] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-13T19:31:45.217953] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-13T19:31:45.381063] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:31:45.383104] [INFO ] [REMOTE ] HYI: Full fetch complete (13976 records). [2025-10-13T19:31:45.383202] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-13T19:31:45.745921] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-13T19:31:45.745995] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-13T19:31:45.746293] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-13T19:31:45.746330] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-13T19:31:45.746862] [DEBUG] [LOCAL ] HYI: Trimmed 13976 records to 9920 (keeping 200 days of data) [2025-10-13T19:31:45.806268] [DEBUG] [LOCAL ] HYI: Primary data saved (9920 records). [2025-10-13T19:31:45.806388] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-13T19:31:45.806471] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYI took 24.5s. Estimated remaining: 3h 1m 58s. Rate: 7.1 symbols/min [2025-10-13T19:31:46.017923] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-13T19:31:46.459483] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:31:46.717820] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:31:46.817990] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-13T19:31:47.162138] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-13T19:31:47.617997] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-13T19:31:48.162307] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T19:31:48.418009] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-13T19:31:49.221486] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-13T19:31:49.749725] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T19:31:49.773894] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:31:50.017991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-13T19:31:50.582269] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T19:31:50.817937] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-13T19:31:51.617960] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-13T19:31:52.081728] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:31:52.272508] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:31:52.417889] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-13T19:31:53.217976] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-13T19:31:53.696415] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T19:31:53.832292] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:31:54.017966] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-13T19:31:54.817989] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-13T19:31:55.383116] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T19:31:55.386851] [INFO ] [REMOTE ] HYT: Full fetch complete (47790 records). [2025-10-13T19:31:55.386953] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-13T19:31:55.490410] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:31:55.502322] [INFO ] [REMOTE ] HYTR: Full fetch complete (4627 records). [2025-10-13T19:31:55.512674] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-13T19:31:56.071595] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-13T19:31:56.081972] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-13T19:31:56.088082] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-13T19:31:56.088164] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-13T19:31:56.146614] [DEBUG] [LOCAL ] HYT: Trimmed 47790 records to 33656 (keeping 200 days of data) [2025-10-13T19:31:56.146962] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-13T19:31:56.147077] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-13T19:31:56.147202] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-13T19:31:56.147268] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-13T19:31:56.148314] [DEBUG] [LOCAL ] HYTR: Trimmed 4627 records to 3131 (keeping 200 days of data) [2025-10-13T19:31:56.259905] [DEBUG] [LOCAL ] HYTR: Primary data saved (3131 records). [2025-10-13T19:31:56.265286] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-13T19:31:56.266403] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 24.2s. Estimated remaining: 3h 1m 52s. Rate: 7.1 symbols/min [2025-10-13T19:31:56.367900] [DEBUG] [LOCAL ] HYT: Primary data saved (33656 records). [2025-10-13T19:31:56.368068] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-13T19:31:56.368162] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYT took 33.4s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-13T19:31:57.086176] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.076216] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.106269] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.104953] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.117505] [DEBUG] [LOCAL ] IAE: Loaded 6312 existing records from primary storage. [2025-10-13T19:31:57.117837] [INFO ] [MAIN ] IAE: Loaded 6312 existing records. [2025-10-13T19:31:57.331576] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:57.333054] [DEBUG] [LOCAL ] HZO: Loaded 29457 existing records from primary storage. [2025-10-13T19:31:57.333411] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-13T19:31:57.333981] [INFO ] [MAIN ] HZO: Loaded 29457 existing records. [2025-10-13T19:31:57.334086] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-13T19:31:57.350984] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-13T19:31:57.357792] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-13T19:31:57.532810] [DEBUG] [LOCAL ] IAG: Loaded 54253 existing records from primary storage. [2025-10-13T19:31:57.590735] [INFO ] [MAIN ] IAG: Loaded 54253 existing records. [2025-10-13T19:31:57.634245] [DEBUG] [LOCAL ] IBM: Loaded 54410 existing records from primary storage. [2025-10-13T19:31:57.733362] [INFO ] [MAIN ] IBM: Loaded 54410 existing records. [2025-10-13T19:31:57.842049] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:57.920052] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-13T19:31:57.972721] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-13T19:31:58.135412] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-13T19:31:58.141617] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:58.151423] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-13T19:31:58.161897] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-13T19:31:58.237168] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-13T19:31:58.362496] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-13T19:31:58.362691] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-13T19:31:58.464244] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:58.643990] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-13T19:31:58.709055] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-13T19:31:58.721288] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:58.737083] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-13T19:31:58.754731] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-13T19:31:58.745909] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-13T19:31:59.122261] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.202930] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-13T19:31:59.434769] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.445398] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-13T19:31:59.503968] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.504386] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-13T19:31:59.561528] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:31:59.563340] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-13T19:32:00.150725] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T19:32:00.152512] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-13T19:32:00.387509] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:32:00.417890] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-13T19:32:00.951330] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:32:01.217901] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-13T19:32:01.498926] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T19:32:01.725470] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-13T19:32:01.854913] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:32:02.009702] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-13T19:32:02.021528] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-13T19:32:02.817978] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-13T19:32:03.617972] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-13T19:32:03.770955] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:32:04.067365] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T19:32:04.068238] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:32:04.417929] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-13T19:32:05.217938] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-13T19:32:05.820200] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:32:06.018043] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-13T19:32:06.394010] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T19:32:06.817939] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-13T19:32:07.282695] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:32:07.617985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-13T19:32:08.417949] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-13T19:32:09.065936] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:32:09.069208] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-13T19:32:09.217949] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-13T19:32:09.345915] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:32:10.017951] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-13T19:32:10.815545] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:32:10.817875] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-13T19:32:11.457553] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T19:32:11.494714] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T19:32:11.617900] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-13T19:32:12.418008] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-13T19:32:13.217900] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-13T19:32:13.786575] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T19:32:13.861532] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:32:14.017958] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-13T19:32:14.817987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-13T19:32:14.822968] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:32:15.074203] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:32:15.617956] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-13T19:32:16.417940] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-13T19:32:17.002314] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-13T19:32:17.217934] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-13T19:32:17.415039] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T19:32:17.592922] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T19:32:18.014241] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:32:18.015947] [INFO ] [REMOTE ] IAE: Full fetch complete (8967 records). [2025-10-13T19:32:18.016022] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-13T19:32:18.023164] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-13T19:32:18.408070] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-13T19:32:18.408154] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-13T19:32:18.408438] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-13T19:32:18.408478] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-13T19:32:18.408948] [DEBUG] [LOCAL ] IAE: Trimmed 8967 records to 6226 (keeping 200 days of data) [2025-10-13T19:32:18.448024] [DEBUG] [LOCAL ] IAE: Primary data saved (6226 records). [2025-10-13T19:32:18.448157] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-13T19:32:18.448256] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 22.1s. Estimated remaining: 3h 1m 41s. Rate: 7.1 symbols/min [2025-10-13T19:32:18.628781] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:18.678387] [DEBUG] [LOCAL ] IBN: Loaded 53629 existing records from primary storage. [2025-10-13T19:32:18.678767] [INFO ] [MAIN ] IBN: Loaded 53629 existing records. [2025-10-13T19:32:18.824498] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-13T19:32:18.866898] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:18.867112] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-13T19:32:18.867159] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-13T19:32:18.868247] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-13T19:32:18.868309] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-13T19:32:19.219716] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:19.617989] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-13T19:32:20.083978] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:32:20.417937] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-13T19:32:21.217981] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-13T19:32:21.378672] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:32:21.408991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-13T19:32:21.941487] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:32:22.017887] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-13T19:32:22.396450] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:32:22.817995] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-13T19:32:23.617944] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-13T19:32:24.423036] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-13T19:32:24.444276] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-13T19:32:24.625455] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:32:25.103344] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:32:25.217940] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-13T19:32:25.706135] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T19:32:26.018001] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-13T19:32:26.817931] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-13T19:32:26.937934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:32:27.284931] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T19:32:27.618005] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-13T19:32:28.417949] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-13T19:32:29.218025] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-13T19:32:29.292070] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:32:29.336228] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:32:29.651578] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:32:30.017978] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-13T19:32:30.817964] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-13T19:32:30.859582] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:32:30.879569] [INFO ] [REMOTE ] IBM: Full fetch complete (77621 records). [2025-10-13T19:32:30.893572] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-13T19:32:30.899096] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:32:31.305020] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-13T19:32:31.305102] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-13T19:32:31.306058] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-13T19:32:31.306120] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-13T19:32:31.307759] [DEBUG] [LOCAL ] IBM: Trimmed 77621 records to 53633 (keeping 200 days of data) [2025-10-13T19:32:31.635058] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-13T19:32:31.662369] [DEBUG] [LOCAL ] IBM: Primary data saved (53633 records). [2025-10-13T19:32:31.662522] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-13T19:32:31.662618] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBM took 35.3s. Estimated remaining: 3h 1m 38s. Rate: 7.1 symbols/min [2025-10-13T19:32:31.835095] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:31.862910] [DEBUG] [LOCAL ] IBP: Loaded 29252 existing records from primary storage. [2025-10-13T19:32:31.863173] [INFO ] [MAIN ] IBP: Loaded 29252 existing records. [2025-10-13T19:32:32.044393] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:32.044669] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-13T19:32:32.044729] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-13T19:32:32.045485] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-13T19:32:32.045545] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-13T19:32:32.401954] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:32.417879] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-13T19:32:32.809115] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:32:32.812106] [INFO ] [REMOTE ] HZO: Full fetch complete (41072 records). [2025-10-13T19:32:32.812183] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-13T19:32:32.998555] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T19:32:33.219009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-13T19:32:33.252872] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-13T19:32:33.253147] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-13T19:32:33.254083] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-13T19:32:33.254256] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-13T19:32:33.255515] [DEBUG] [LOCAL ] HZO: Trimmed 41072 records to 29044 (keeping 200 days of data) [2025-10-13T19:32:33.435620] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T19:32:33.457347] [DEBUG] [LOCAL ] HZO: Primary data saved (29044 records). [2025-10-13T19:32:33.457497] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-13T19:32:33.457590] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. HZO took 37.1s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-13T19:32:33.622111] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:33.660413] [DEBUG] [LOCAL ] IBTA: Loaded 37604 existing records from primary storage. [2025-10-13T19:32:33.660741] [INFO ] [MAIN ] IBTA: Loaded 37604 existing records. [2025-10-13T19:32:33.834229] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:33.834419] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-13T19:32:33.834466] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-13T19:32:33.834906] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-13T19:32:33.834975] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-13T19:32:34.026008] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-13T19:32:34.181934] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:34.817950] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-13T19:32:35.101074] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:32:35.106542] [INFO ] [REMOTE ] IAG: Full fetch complete (77298 records). [2025-10-13T19:32:35.106684] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-13T19:32:35.488294] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-13T19:32:35.488378] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-13T19:32:35.489364] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-13T19:32:35.489428] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-13T19:32:35.490900] [DEBUG] [LOCAL ] IAG: Trimmed 77298 records to 53486 (keeping 200 days of data) [2025-10-13T19:32:35.651093] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-13T19:32:35.809190] [DEBUG] [LOCAL ] IAG: Primary data saved (53486 records). [2025-10-13T19:32:35.809463] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-13T19:32:35.809603] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IAG took 39.4s. Estimated remaining: 3h 1m 6s. Rate: 7.1 symbols/min [2025-10-13T19:32:35.988045] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:36.018975] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:32:36.083925] [DEBUG] [LOCAL ] ICE: Loaded 53792 existing records from primary storage. [2025-10-13T19:32:36.084412] [INFO ] [MAIN ] ICE: Loaded 53792 existing records. [2025-10-13T19:32:36.241776] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T19:32:36.290039] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:36.290227] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-13T19:32:36.290273] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-13T19:32:36.291122] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-13T19:32:36.291180] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-13T19:32:36.425994] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-13T19:32:36.647628] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:36.663223] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T19:32:37.217896] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-13T19:32:37.589167] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T19:32:38.017985] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-13T19:32:38.515599] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:32:38.817942] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-13T19:32:39.617928] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-13T19:32:39.805432] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:32:40.153432] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:32:40.417922] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-13T19:32:40.721480] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:32:41.218000] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-13T19:32:42.017926] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-13T19:32:42.210145] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:32:42.790870] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:32:42.817878] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-13T19:32:43.430892] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:32:43.617938] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-13T19:32:44.417931] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-13T19:32:44.557732] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:32:44.946428] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:32:45.217952] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-13T19:32:46.017900] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-13T19:32:46.216692] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T19:32:46.492571] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:32:46.817967] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-13T19:32:47.508547] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:32:47.617899] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-13T19:32:48.418002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-13T19:32:48.516106] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:32:48.581954] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:32:49.217901] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-13T19:32:49.710697] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:32:50.017964] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-13T19:32:50.609612] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:32:50.817990] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-13T19:32:51.617970] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-13T19:32:51.725481] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:32:52.341971] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:32:52.418002] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-13T19:32:52.993867] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:32:53.217980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-13T19:32:53.918628] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:32:54.017890] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-13T19:32:54.817991] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-13T19:32:55.018789] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:32:55.341854] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:32:55.345479] [INFO ] [REMOTE ] IBTA: Full fetch complete (50941 records). [2025-10-13T19:32:55.345581] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-13T19:32:55.623135] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-13T19:32:55.744104] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-13T19:32:55.744212] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-13T19:32:55.745294] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-13T19:32:55.745398] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-13T19:32:55.747006] [DEBUG] [LOCAL ] IBTA: Trimmed 50941 records to 36817 (keeping 200 days of data) [2025-10-13T19:32:55.988146] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T19:32:56.004952] [DEBUG] [LOCAL ] IBTA: Primary data saved (36817 records). [2025-10-13T19:32:56.005191] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-13T19:32:56.005307] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 22.5s. Estimated remaining: 3h 1m 12s. Rate: 7.1 symbols/min [2025-10-13T19:32:56.187205] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:56.227401] [DEBUG] [LOCAL ] ICL: Loaded 39002 existing records from primary storage. [2025-10-13T19:32:56.227811] [INFO ] [MAIN ] ICL: Loaded 39002 existing records. [2025-10-13T19:32:56.407113] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:56.407444] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-13T19:32:56.407500] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-13T19:32:56.407868] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-13T19:32:56.407960] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-13T19:32:56.423234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-13T19:32:56.783958] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:57.218114] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-13T19:32:57.224687] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:32:58.018007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-13T19:32:58.357149] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T19:32:58.380021] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T19:32:58.383620] [INFO ] [REMOTE ] IBP: Full fetch complete (40972 records). [2025-10-13T19:32:58.383773] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-13T19:32:58.756612] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-13T19:32:58.756728] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-13T19:32:58.757431] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-13T19:32:58.757528] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-13T19:32:58.758592] [DEBUG] [LOCAL ] IBP: Trimmed 40972 records to 28889 (keeping 200 days of data) [2025-10-13T19:32:58.827745] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-13T19:32:58.946883] [DEBUG] [LOCAL ] IBP: Primary data saved (28889 records). [2025-10-13T19:32:58.947028] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-13T19:32:58.947109] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBP took 27.3s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-13T19:32:59.115840] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:59.151049] [DEBUG] [LOCAL ] IDA: Loaded 33044 existing records from primary storage. [2025-10-13T19:32:59.151352] [INFO ] [MAIN ] IDA: Loaded 33044 existing records. [2025-10-13T19:32:59.347750] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:59.348068] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-13T19:32:59.348144] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-13T19:32:59.348494] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-13T19:32:59.348562] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-13T19:32:59.620319] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-13T19:32:59.852010] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:59.906276] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T19:32:59.951733] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T19:33:00.418027] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-13T19:33:01.217938] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-13T19:33:01.755170] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T19:33:01.784614] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T19:33:02.018004] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-13T19:33:02.575567] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:33:02.817960] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-13T19:33:03.617893] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-13T19:33:03.950130] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:33:03.979102] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T19:33:04.417973] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-13T19:33:05.129862] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:33:05.217921] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-13T19:33:05.543974] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T19:33:06.017987] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-13T19:33:06.504386] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:33:06.817956] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-13T19:33:07.617980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-13T19:33:07.710186] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T19:33:07.715524] [INFO ] [REMOTE ] IBN: Full fetch complete (76326 records). [2025-10-13T19:33:07.715634] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-13T19:33:08.115623] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-13T19:33:08.115832] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-13T19:33:08.116875] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-13T19:33:08.117012] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-13T19:33:08.140174] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T19:33:08.149020] [DEBUG] [LOCAL ] IBN: Trimmed 76326 records to 52832 (keeping 200 days of data) [2025-10-13T19:33:08.427838] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-13T19:33:08.475071] [DEBUG] [LOCAL ] IBN: Primary data saved (52832 records). [2025-10-13T19:33:08.475182] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-13T19:33:08.475261] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IBN took 50.0s. Estimated remaining: 3h 0m 50s. Rate: 7.1 symbols/min [2025-10-13T19:33:08.640625] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:08.650161] [DEBUG] [LOCAL ] IDE: Loaded 9136 existing records from primary storage. [2025-10-13T19:33:08.650331] [INFO ] [MAIN ] IDE: Loaded 9136 existing records. [2025-10-13T19:33:08.822787] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:08.822999] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-13T19:33:08.823045] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-13T19:33:08.823206] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-13T19:33:08.823262] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-13T19:33:09.180677] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:09.217891] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-13T19:33:09.253994] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:33:10.017977] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-13T19:33:10.049945] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:33:10.186444] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:33:10.817962] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-13T19:33:11.555733] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T19:33:11.617893] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-13T19:33:12.055336] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:33:12.372625] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:33:12.417969] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-13T19:33:13.078244] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T19:33:13.217984] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-13T19:33:14.017970] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-13T19:33:14.735629] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T19:33:14.817931] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-13T19:33:15.069622] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:33:15.617976] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-13T19:33:16.165168] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:33:16.409683] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:33:16.417872] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-13T19:33:17.204094] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:33:17.217876] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-13T19:33:17.965637] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T19:33:18.017891] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-13T19:33:18.817990] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-13T19:33:18.831802] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:33:19.617981] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-13T19:33:20.203379] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T19:33:20.372448] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:33:20.417888] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-13T19:33:21.202576] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T19:33:21.204247] [INFO ] [REMOTE ] IDE: Full fetch complete (12676 records). [2025-10-13T19:33:21.204343] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-13T19:33:21.224918] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-13T19:33:21.588874] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-13T19:33:21.589012] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-13T19:33:21.589490] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-13T19:33:21.589557] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-13T19:33:21.590210] [DEBUG] [LOCAL ] IDE: Trimmed 12676 records to 9063 (keeping 200 days of data) [2025-10-13T19:33:21.651854] [DEBUG] [LOCAL ] IDE: Primary data saved (9063 records). [2025-10-13T19:33:21.652042] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-13T19:33:21.652189] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDE took 13.2s. Estimated remaining: 3h 0m 47s. Rate: 7.1 symbols/min [2025-10-13T19:33:21.826859] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:21.849493] [DEBUG] [LOCAL ] IDT: Loaded 18518 existing records from primary storage. [2025-10-13T19:33:21.849871] [INFO ] [MAIN ] IDT: Loaded 18518 existing records. [2025-10-13T19:33:22.023492] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-13T19:33:22.028484] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:22.029781] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-13T19:33:22.029846] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-13T19:33:22.030122] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-13T19:33:22.030192] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-13T19:33:22.401691] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:22.461547] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:33:22.817938] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-13T19:33:23.621189] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-13T19:33:23.944963] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:33:24.256748] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:33:24.417863] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-13T19:33:24.678685] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:33:25.217948] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-13T19:33:25.879792] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:33:25.897211] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T19:33:26.017955] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-13T19:33:26.818010] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-13T19:33:26.830010] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:33:27.617978] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-13T19:33:28.251529] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:33:28.372205] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:33:28.417930] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-13T19:33:29.217949] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-13T19:33:29.843553] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T19:33:30.017943] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-13T19:33:30.731874] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:33:30.737456] [INFO ] [REMOTE ] ICE: Full fetch complete (76766 records). [2025-10-13T19:33:30.737577] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-13T19:33:30.823267] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-13T19:33:31.106326] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T19:33:31.166967] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-13T19:33:31.167062] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-13T19:33:31.168160] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-13T19:33:31.168225] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-13T19:33:31.169830] [DEBUG] [LOCAL ] ICE: Trimmed 76766 records to 53011 (keeping 200 days of data) [2025-10-13T19:33:31.504913] [DEBUG] [LOCAL ] ICE: Primary data saved (53011 records). [2025-10-13T19:33:31.505059] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-13T19:33:31.505148] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. ICE took 55.7s. Estimated remaining: 3h 0m 40s. Rate: 7.1 symbols/min [2025-10-13T19:33:31.623133] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-13T19:33:31.673810] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:31.711949] [DEBUG] [LOCAL ] IEX: Loaded 38845 existing records from primary storage. [2025-10-13T19:33:31.712249] [INFO ] [MAIN ] IEX: Loaded 38845 existing records. [2025-10-13T19:33:31.887823] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:31.888103] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-13T19:33:31.888151] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-13T19:33:31.889058] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-13T19:33:31.889117] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-13T19:33:32.262806] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:32.418017] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-13T19:33:32.791969] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T19:33:33.064897] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:33:33.218005] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-13T19:33:33.913783] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:33:34.017974] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-13T19:33:34.555086] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:33:34.559438] [INFO ] [REMOTE ] ICL: Full fetch complete (55923 records). [2025-10-13T19:33:34.559547] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-13T19:33:34.826610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-13T19:33:34.974425] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-13T19:33:34.974540] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-13T19:33:34.975538] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-13T19:33:34.975608] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-13T19:33:34.979271] [DEBUG] [LOCAL ] ICL: Trimmed 55923 records to 38494 (keeping 200 days of data) [2025-10-13T19:33:35.223205] [DEBUG] [LOCAL ] ICL: Primary data saved (38494 records). [2025-10-13T19:33:35.223614] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-13T19:33:35.223771] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. ICL took 39.2s. Estimated remaining: 3h 0m 26s. Rate: 7.1 symbols/min [2025-10-13T19:33:35.403244] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:35.423772] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:33:35.492304] [DEBUG] [LOCAL ] IFF: Loaded 51808 existing records from primary storage. [2025-10-13T19:33:35.492776] [INFO ] [MAIN ] IFF: Loaded 51808 existing records. [2025-10-13T19:33:35.623170] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-13T19:33:35.686023] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:35.687505] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-13T19:33:35.687739] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-13T19:33:35.688376] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-13T19:33:35.688443] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-13T19:33:35.892966] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:33:36.080217] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:36.417963] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-13T19:33:36.710122] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T19:33:37.217972] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-13T19:33:37.474704] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:33:38.017968] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-13T19:33:38.717132] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:33:38.817954] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-13T19:33:39.183473] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T19:33:39.617996] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-13T19:33:40.417965] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-13T19:33:40.540148] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:33:41.047567] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T19:33:41.122927] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:33:41.218013] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-13T19:33:42.018031] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-13T19:33:42.817992] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-13T19:33:42.910797] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:33:43.267449] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:33:43.617945] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-13T19:33:43.761120] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T19:33:44.417971] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-13T19:33:45.217960] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-13T19:33:45.410856] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:33:45.905041] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:33:46.018011] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-13T19:33:46.663341] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:33:46.667306] [INFO ] [REMOTE ] IDA: Full fetch complete (45066 records). [2025-10-13T19:33:46.667453] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-13T19:33:46.823125] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-13T19:33:47.072071] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-13T19:33:47.072193] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-13T19:33:47.073207] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-13T19:33:47.073288] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-13T19:33:47.075302] [DEBUG] [LOCAL ] IDA: Trimmed 45066 records to 32732 (keeping 200 days of data) [2025-10-13T19:33:47.296383] [DEBUG] [LOCAL ] IDA: Primary data saved (32732 records). [2025-10-13T19:33:47.296602] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-13T19:33:47.296788] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDA took 48.3s. Estimated remaining: 3h 0m 22s. Rate: 7.1 symbols/min [2025-10-13T19:33:47.478266] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:47.503026] [DEBUG] [LOCAL ] IFN: Loaded 18563 existing records from primary storage. [2025-10-13T19:33:47.503364] [INFO ] [MAIN ] IFN: Loaded 18563 existing records. [2025-10-13T19:33:47.619717] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-13T19:33:47.695553] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:47.696057] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-13T19:33:47.696138] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-13T19:33:47.706473] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-13T19:33:47.707124] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-13T19:33:47.778971] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:33:48.157867] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:48.290711] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:33:48.417952] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-13T19:33:49.156367] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:33:49.217933] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-13T19:33:49.622861] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:33:49.625788] [INFO ] [REMOTE ] IDT: Full fetch complete (23620 records). [2025-10-13T19:33:49.625868] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-13T19:33:49.988125] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-13T19:33:49.988200] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-13T19:33:49.988717] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-13T19:33:49.988776] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-13T19:33:49.989368] [DEBUG] [LOCAL ] IDT: Trimmed 23620 records to 18345 (keeping 200 days of data) [2025-10-13T19:33:50.037205] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-13T19:33:50.104892] [DEBUG] [LOCAL ] IDT: Primary data saved (18345 records). [2025-10-13T19:33:50.105014] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-13T19:33:50.105117] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IDT took 28.5s. Estimated remaining: 3h 0m 7s. Rate: 7.1 symbols/min [2025-10-13T19:33:50.272348] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:50.299715] [DEBUG] [LOCAL ] IFS: Loaded 23218 existing records from primary storage. [2025-10-13T19:33:50.300110] [INFO ] [MAIN ] IFS: Loaded 23218 existing records. [2025-10-13T19:33:50.491239] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:50.491545] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-13T19:33:50.491596] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-13T19:33:50.492357] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-13T19:33:50.492419] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-13T19:33:50.819623] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-13T19:33:50.878211] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:50.905955] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:33:51.362833] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:33:51.618141] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-13T19:33:52.318109] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:33:52.418072] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-13T19:33:52.696061] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:33:53.217984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-13T19:33:54.017939] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-13T19:33:54.307403] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:33:54.755684] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:33:54.817918] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-13T19:33:55.193351] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:33:55.618006] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-13T19:33:56.062706] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:33:56.417995] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-13T19:33:56.681354] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T19:33:57.217957] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-13T19:33:57.435018] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:33:58.018006] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-13T19:33:58.664331] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:33:58.668279] [INFO ] [REMOTE ] IEX: Full fetch complete (53398 records). [2025-10-13T19:33:58.668378] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-13T19:33:58.825250] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-13T19:33:59.080827] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-13T19:33:59.081056] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-13T19:33:59.082027] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-13T19:33:59.082115] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-13T19:33:59.084348] [DEBUG] [LOCAL ] IEX: Trimmed 53398 records to 38338 (keeping 200 days of data) [2025-10-13T19:33:59.334149] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:33:59.397143] [DEBUG] [LOCAL ] IEX: Primary data saved (38338 records). [2025-10-13T19:33:59.397317] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-13T19:33:59.397412] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IEX took 27.9s. Estimated remaining: 2h 59m 59s. Rate: 7.1 symbols/min [2025-10-13T19:33:59.563975] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:59.576960] [DEBUG] [LOCAL ] IGA: Loaded 10174 existing records from primary storage. [2025-10-13T19:33:59.577210] [INFO ] [MAIN ] IGA: Loaded 10174 existing records. [2025-10-13T19:33:59.630197] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-13T19:33:59.758492] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:59.758738] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-13T19:33:59.758790] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-13T19:33:59.759037] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-13T19:33:59.759105] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-13T19:34:00.062238] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:34:00.145161] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:00.417975] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-13T19:34:01.217950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-13T19:34:01.651068] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T19:34:01.674704] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:34:02.017933] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-13T19:34:02.177801] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T19:34:02.817962] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-13T19:34:03.028308] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:34:03.617896] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-13T19:34:03.934909] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:34:04.417962] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-13T19:34:05.217925] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-13T19:34:05.253376] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:34:05.419732] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T19:34:06.017978] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-13T19:34:06.084635] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:34:06.817940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-13T19:34:07.097115] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T19:34:07.617971] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-13T19:34:07.654561] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:34:08.417982] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-13T19:34:09.217921] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-13T19:34:09.389164] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:34:09.565080] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:34:09.738725] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:34:10.017973] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-13T19:34:10.817943] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-13T19:34:11.104801] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:34:11.621924] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-13T19:34:11.957083] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T19:34:12.417979] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-13T19:34:13.108748] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T19:34:13.217964] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-13T19:34:13.394522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:34:14.017964] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-13T19:34:14.195612] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T19:34:14.817939] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-13T19:34:15.617929] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-13T19:34:15.815321] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T19:34:15.924258] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T19:34:16.417973] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-13T19:34:16.636070] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:34:17.217942] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-13T19:34:17.490491] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:34:18.017988] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-13T19:34:18.290484] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:34:18.728892] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:34:18.817946] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-13T19:34:19.617945] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-13T19:34:19.626275] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T19:34:20.417931] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-13T19:34:21.210992] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T19:34:21.217877] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-13T19:34:21.374074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:34:21.381885] [INFO ] [REMOTE ] IFF: Full fetch complete (73231 records). [2025-10-13T19:34:21.382116] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-13T19:34:21.790364] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-13T19:34:21.790454] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-13T19:34:21.791359] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-13T19:34:21.791421] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-13T19:34:21.792835] [DEBUG] [LOCAL ] IFF: Trimmed 73231 records to 51078 (keeping 200 days of data) [2025-10-13T19:34:22.027868] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-13T19:34:22.036157] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:34:22.133058] [DEBUG] [LOCAL ] IFF: Primary data saved (51078 records). [2025-10-13T19:34:22.133222] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-13T19:34:22.133316] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 46.9s. Estimated remaining: 3h 0m 7s. Rate: 7.1 symbols/min [2025-10-13T19:34:22.300100] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:22.318578] [DEBUG] [LOCAL ] IGD: Loaded 19633 existing records from primary storage. [2025-10-13T19:34:22.318835] [INFO ] [MAIN ] IGD: Loaded 19633 existing records. [2025-10-13T19:34:22.493771] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:22.493994] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-13T19:34:22.494041] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-13T19:34:22.494322] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-13T19:34:22.494384] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-13T19:34:22.824726] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-13T19:34:22.855143] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:23.100017] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:34:23.102999] [INFO ] [REMOTE ] IFN: Full fetch complete (28661 records). [2025-10-13T19:34:23.103093] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-13T19:34:23.482912] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-13T19:34:23.483009] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-13T19:34:23.483907] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-13T19:34:23.483972] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-13T19:34:23.484796] [DEBUG] [LOCAL ] IFN: Trimmed 28661 records to 18400 (keeping 200 days of data) [2025-10-13T19:34:23.607633] [DEBUG] [LOCAL ] IFN: Primary data saved (18400 records). [2025-10-13T19:34:23.607944] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-13T19:34:23.608073] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFN took 36.3s. Estimated remaining: 2h 59m 51s. Rate: 7.1 symbols/min [2025-10-13T19:34:23.623036] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-13T19:34:23.738057] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:34:23.823827] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:23.831363] [DEBUG] [LOCAL ] IGI: Loaded 3893 existing records from primary storage. [2025-10-13T19:34:23.831702] [INFO ] [MAIN ] IGI: Loaded 3893 existing records. [2025-10-13T19:34:24.017168] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:24.017461] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-13T19:34:24.017513] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-13T19:34:24.017809] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-13T19:34:24.017867] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-13T19:34:24.389442] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:24.417948] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-13T19:34:24.689189] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:34:24.692581] [INFO ] [REMOTE ] IFS: Full fetch complete (31856 records). [2025-10-13T19:34:24.692717] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-13T19:34:25.088335] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-13T19:34:25.088450] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-13T19:34:25.089327] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-13T19:34:25.089391] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-13T19:34:25.090783] [DEBUG] [LOCAL ] IFS: Trimmed 31856 records to 22767 (keeping 200 days of data) [2025-10-13T19:34:25.223713] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-13T19:34:25.234866] [DEBUG] [LOCAL ] IFS: Primary data saved (22767 records). [2025-10-13T19:34:25.235209] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-13T19:34:25.235315] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IFS took 35.1s. Estimated remaining: 2h 59m 34s. Rate: 7.1 symbols/min [2025-10-13T19:34:25.282528] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T19:34:25.321965] [INFO ] [REMOTE ] IGA: Full fetch complete (14026 records). [2025-10-13T19:34:25.333810] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-13T19:34:25.574710] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:25.849112] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-13T19:34:25.848867] [DEBUG] [LOCAL ] IGR: Loaded 30825 existing records from primary storage. [2025-10-13T19:34:25.849508] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-13T19:34:25.849767] [INFO ] [MAIN ] IGR: Loaded 30825 existing records. [2025-10-13T19:34:25.850408] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-13T19:34:25.850503] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-13T19:34:25.884331] [DEBUG] [LOCAL ] IGA: Trimmed 14026 records to 10122 (keeping 200 days of data) [2025-10-13T19:34:26.028211] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-13T19:34:26.108285] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:26.111013] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-13T19:34:26.111467] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-13T19:34:26.116932] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-13T19:34:26.117674] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-13T19:34:26.168284] [DEBUG] [LOCAL ] IGA: Primary data saved (10122 records). [2025-10-13T19:34:26.191341] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-13T19:34:26.191506] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGA took 26.8s. Estimated remaining: 2h 59m 17s. Rate: 7.1 symbols/min [2025-10-13T19:34:26.509394] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:26.603236] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:34:26.618582] [DEBUG] [LOCAL ] IH: Loaded 2888 existing records from primary storage. [2025-10-13T19:34:26.636337] [INFO ] [MAIN ] IH: Loaded 2888 existing records. [2025-10-13T19:34:26.841187] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-13T19:34:26.847542] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:26.940772] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:26.941050] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-13T19:34:26.941139] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-13T19:34:26.944229] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-13T19:34:26.946863] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-13T19:34:26.983337] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T19:34:27.357313] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:27.618017] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-13T19:34:28.116034] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:34:28.183879] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T19:34:28.417988] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-13T19:34:29.217926] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-13T19:34:29.428514] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:34:29.688381] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:34:30.017964] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-13T19:34:30.541272] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:34:30.818013] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-13T19:34:31.617976] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-13T19:34:31.923518] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:34:32.417971] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-13T19:34:33.043191] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:34:33.217941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-13T19:34:33.312728] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T19:34:33.702294] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T19:34:34.017965] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-13T19:34:34.495911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T19:34:34.817941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-13T19:34:35.338294] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T19:34:35.617966] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-13T19:34:36.417961] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-13T19:34:36.854610] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T19:34:36.988281] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:34:37.218003] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-13T19:34:37.873368] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T19:34:38.017950] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-13T19:34:38.325980] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:34:38.817971] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-13T19:34:39.617960] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-13T19:34:40.076453] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:34:40.174231] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T19:34:40.417957] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-13T19:34:40.905549] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T19:34:41.217966] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-13T19:34:42.017971] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-13T19:34:42.253956] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T19:34:42.605861] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:34:42.817979] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-13T19:34:43.617997] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-13T19:34:43.862872] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T19:34:44.214056] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T19:34:44.417938] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-13T19:34:45.045533] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:34:45.217989] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-13T19:34:45.766013] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T19:34:46.017973] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-13T19:34:46.817980] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-13T19:34:47.308908] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:34:47.617953] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-13T19:34:47.854385] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T19:34:48.256135] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-13T19:34:48.417993] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-13T19:34:49.028716] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T19:34:49.217971] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-13T19:34:50.017981] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-13T19:34:50.269845] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T19:34:50.704820] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:34:50.706102] [INFO ] [REMOTE ] IGI: Full fetch complete (5443 records). [2025-10-13T19:34:50.706169] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-13T19:34:50.823192] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-13T19:34:51.088612] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-13T19:34:51.088816] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-13T19:34:51.089095] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-13T19:34:51.089146] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-13T19:34:51.089858] [DEBUG] [LOCAL ] IGI: Trimmed 5443 records to 3896 (keeping 200 days of data) [2025-10-13T19:34:51.113160] [DEBUG] [LOCAL ] IGI: Primary data saved (3896 records). [2025-10-13T19:34:51.113223] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-13T19:34:51.113299] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGI took 27.5s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-13T19:34:51.276618] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:51.284663] [DEBUG] [LOCAL ] IHD: Loaded 7240 existing records from primary storage. [2025-10-13T19:34:51.284860] [INFO ] [MAIN ] IHD: Loaded 7240 existing records. [2025-10-13T19:34:51.463145] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:51.463335] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:34:51.463606] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-13T19:34:51.465102] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-13T19:34:51.465706] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-13T19:34:51.465765] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-13T19:34:51.623423] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-13T19:34:51.818285] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:52.417987] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-13T19:34:53.123733] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:34:53.168087] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:34:53.217882] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-13T19:34:54.019977] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-13T19:34:54.023617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:34:54.817995] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-13T19:34:55.175111] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T19:34:55.617961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-13T19:34:56.133409] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T19:34:56.334120] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:34:56.417935] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-13T19:34:57.217901] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-13T19:34:57.419822] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:34:57.990340] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T19:34:58.017879] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-13T19:34:58.608237] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T19:34:58.818002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-13T19:34:59.540932] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-13T19:34:59.618008] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-13T19:35:00.417954] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-13T19:35:00.665568] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:35:00.668775] [INFO ] [REMOTE ] IGD: Full fetch complete (29979 records). [2025-10-13T19:35:00.668854] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-13T19:35:01.093093] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-13T19:35:01.093232] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-13T19:35:01.094588] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-13T19:35:01.094850] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-13T19:35:01.096867] [DEBUG] [LOCAL ] IGD: Trimmed 29979 records to 19338 (keeping 200 days of data) [2025-10-13T19:35:01.220131] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-13T19:35:01.221576] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:35:01.286626] [DEBUG] [LOCAL ] IGD: Primary data saved (19338 records). [2025-10-13T19:35:01.286864] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-13T19:35:01.286990] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGD took 39.2s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-13T19:35:01.547125] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:01.581392] [DEBUG] [LOCAL ] IHG: Loaded 24505 existing records from primary storage. [2025-10-13T19:35:01.581807] [INFO ] [MAIN ] IHG: Loaded 24505 existing records. [2025-10-13T19:35:01.853988] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:01.854286] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-13T19:35:01.854357] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-13T19:35:01.855096] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-13T19:35:01.855159] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-13T19:35:02.023250] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-13T19:35:02.350508] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:02.513430] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T19:35:02.817989] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-13T19:35:02.857537] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:35:03.368776] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T19:35:03.369721] [INFO ] [REMOTE ] IH: Full fetch complete (5002 records). [2025-10-13T19:35:03.369794] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-13T19:35:03.623207] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-13T19:35:03.743068] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-13T19:35:03.743148] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-13T19:35:03.743299] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-13T19:35:03.743338] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-13T19:35:03.743755] [DEBUG] [LOCAL ] IH: Trimmed 5002 records to 2809 (keeping 200 days of data) [2025-10-13T19:35:03.759749] [DEBUG] [LOCAL ] IH: Primary data saved (2809 records). [2025-10-13T19:35:03.759851] [INFO ] [MAIN ] IH: Full history saved. [2025-10-13T19:35:03.759945] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 37.6s. Estimated remaining: 2h 59m 6s. Rate: 7.1 symbols/min [2025-10-13T19:35:03.928957] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:03.963867] [DEBUG] [LOCAL ] IHS: Loaded 38726 existing records from primary storage. [2025-10-13T19:35:03.964179] [INFO ] [MAIN ] IHS: Loaded 38726 existing records. [2025-10-13T19:35:04.144738] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:04.144998] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-13T19:35:04.145057] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-13T19:35:04.145849] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-13T19:35:04.145905] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-13T19:35:04.421557] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-13T19:35:04.457094] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T19:35:04.546286] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:05.217971] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-13T19:35:05.689397] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:35:06.017974] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-13T19:35:06.714618] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:35:06.817936] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-13T19:35:07.467513] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:35:07.617954] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-13T19:35:07.916014] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:35:08.417932] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-13T19:35:08.739309] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T19:35:09.217959] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-13T19:35:09.445414] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:35:10.017986] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-13T19:35:10.545437] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:35:10.817964] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-13T19:35:10.971763] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T19:35:11.617963] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-13T19:35:11.986255] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:35:11.989291] [INFO ] [REMOTE ] IGR: Full fetch complete (44933 records). [2025-10-13T19:35:11.989372] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-13T19:35:12.360255] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-13T19:35:12.360336] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-13T19:35:12.361027] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-13T19:35:12.361127] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-13T19:35:12.362109] [DEBUG] [LOCAL ] IGR: Trimmed 44933 records to 30339 (keeping 200 days of data) [2025-10-13T19:35:12.419166] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-13T19:35:12.538575] [DEBUG] [LOCAL ] IGR: Primary data saved (30339 records). [2025-10-13T19:35:12.538739] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-13T19:35:12.538827] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IGR took 47.3s. Estimated remaining: 2h 58m 58s. Rate: 7.1 symbols/min [2025-10-13T19:35:12.713103] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:12.730021] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:35:12.739112] [DEBUG] [LOCAL ] IIF: Loaded 5698 existing records from primary storage. [2025-10-13T19:35:12.739331] [INFO ] [MAIN ] IIF: Loaded 5698 existing records. [2025-10-13T19:35:12.915156] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:12.915360] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-13T19:35:12.915406] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-13T19:35:12.915723] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-13T19:35:12.915782] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-13T19:35:13.223102] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-13T19:35:13.260172] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:13.922010] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:35:14.017878] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-13T19:35:14.492771] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T19:35:14.817942] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-13T19:35:15.368301] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:35:15.544440] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T19:35:15.617959] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-13T19:35:16.417950] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-13T19:35:16.952417] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T19:35:17.217976] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-13T19:35:17.272355] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:35:18.017960] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-13T19:35:18.823685] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-13T19:35:18.836812] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T19:35:19.280070] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:35:19.617994] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-13T19:35:19.695016] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T19:35:20.417979] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-13T19:35:20.994223] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T19:35:21.095045] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:35:21.217977] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-13T19:35:21.985555] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:35:22.017987] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-13T19:35:22.818006] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-13T19:35:23.442047] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:35:23.619114] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-13T19:35:23.622994] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:35:23.624821] [INFO ] [REMOTE ] IHD: Full fetch complete (11943 records). [2025-10-13T19:35:23.624894] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-13T19:35:23.975586] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-13T19:35:23.975687] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-13T19:35:23.975995] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-13T19:35:23.976035] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-13T19:35:23.976467] [DEBUG] [LOCAL ] IHD: Trimmed 11943 records to 7224 (keeping 200 days of data) [2025-10-13T19:35:24.017871] [DEBUG] [LOCAL ] IHD: Primary data saved (7224 records). [2025-10-13T19:35:24.018014] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-13T19:35:24.018101] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHD took 32.9s. Estimated remaining: 2h 58m 53s. Rate: 7.1 symbols/min [2025-10-13T19:35:24.188774] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:24.206926] [DEBUG] [LOCAL ] IIIN: Loaded 16292 existing records from primary storage. [2025-10-13T19:35:24.207142] [INFO ] [MAIN ] IIIN: Loaded 16292 existing records. [2025-10-13T19:35:24.378390] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:24.378613] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-13T19:35:24.378694] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-13T19:35:24.378974] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-13T19:35:24.379029] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-13T19:35:24.422995] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-13T19:35:24.723566] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:25.067309] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:35:25.217890] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-13T19:35:25.299006] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:35:26.018043] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-13T19:35:26.544839] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:35:26.817965] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-13T19:35:26.892798] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:35:27.617950] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-13T19:35:28.028173] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T19:35:28.417929] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-13T19:35:28.860073] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T19:35:28.863524] [INFO ] [REMOTE ] IHS: Full fetch complete (51455 records). [2025-10-13T19:35:28.863669] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-13T19:35:28.985722] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:35:29.218712] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-13T19:35:29.251837] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-13T19:35:29.251905] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-13T19:35:29.252720] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-13T19:35:29.252783] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-13T19:35:29.253967] [DEBUG] [LOCAL ] IHS: Trimmed 51455 records to 37878 (keeping 200 days of data) [2025-10-13T19:35:29.462365] [DEBUG] [LOCAL ] IHS: Primary data saved (37878 records). [2025-10-13T19:35:29.462495] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-13T19:35:29.462587] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHS took 25.7s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-13T19:35:29.642277] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:29.661233] [DEBUG] [LOCAL ] IIM: Loaded 16054 existing records from primary storage. [2025-10-13T19:35:29.661452] [INFO ] [MAIN ] IIM: Loaded 16054 existing records. [2025-10-13T19:35:29.840517] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:29.840854] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-13T19:35:29.840908] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-13T19:35:29.841454] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-13T19:35:29.841516] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-13T19:35:29.946092] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:35:30.028281] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-13T19:35:30.206907] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:30.817950] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-13T19:35:31.353279] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:35:31.617951] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-13T19:35:32.144927] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:35:32.234274] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:35:32.417941] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-13T19:35:33.218008] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-13T19:35:33.749429] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:35:33.820291] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T19:35:34.018013] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-13T19:35:34.817983] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-13T19:35:35.250464] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T19:35:35.464285] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T19:35:35.617949] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-13T19:35:36.417971] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-13T19:35:36.577284] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T19:35:36.907495] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T19:35:36.908444] [INFO ] [REMOTE ] IIF: Full fetch complete (9041 records). [2025-10-13T19:35:36.908513] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-13T19:35:37.223040] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-13T19:35:37.263975] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-13T19:35:37.264062] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-13T19:35:37.264321] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-13T19:35:37.264384] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-13T19:35:37.265000] [DEBUG] [LOCAL ] IIF: Trimmed 9041 records to 5598 (keeping 200 days of data) [2025-10-13T19:35:37.303505] [DEBUG] [LOCAL ] IIF: Primary data saved (5598 records). [2025-10-13T19:35:37.303792] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-13T19:35:37.304059] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIF took 24.8s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-13T19:35:37.475162] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:37.505776] [DEBUG] [LOCAL ] IIPR: Loaded 29852 existing records from primary storage. [2025-10-13T19:35:37.506042] [INFO ] [MAIN ] IIPR: Loaded 29852 existing records. [2025-10-13T19:35:37.685635] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:37.685889] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-13T19:35:37.685935] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-13T19:35:37.686695] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-13T19:35:37.686792] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-13T19:35:38.023083] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-13T19:35:38.055554] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:38.299432] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:35:38.820990] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-13T19:35:39.166087] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T19:35:39.618029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-13T19:35:40.410077] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:35:40.417873] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-13T19:35:40.697789] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:35:41.217946] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-13T19:35:41.911153] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:35:42.017945] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-13T19:35:42.378798] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T19:35:42.381628] [INFO ] [REMOTE ] IHG: Full fetch complete (33776 records). [2025-10-13T19:35:42.381747] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-13T19:35:42.754510] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-13T19:35:42.754592] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-13T19:35:42.755261] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-13T19:35:42.755322] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-13T19:35:42.757479] [DEBUG] [LOCAL ] IHG: Trimmed 33776 records to 24225 (keeping 200 days of data) [2025-10-13T19:35:42.822795] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-13T19:35:42.915843] [DEBUG] [LOCAL ] IHG: Primary data saved (24225 records). [2025-10-13T19:35:42.915983] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-13T19:35:42.916083] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IHG took 41.6s. Estimated remaining: 2h 58m 20s. Rate: 7.1 symbols/min [2025-10-13T19:35:43.087074] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:43.104588] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:35:43.148485] [DEBUG] [LOCAL ] IMAX: Loaded 43577 existing records from primary storage. [2025-10-13T19:35:43.148816] [INFO ] [MAIN ] IMAX: Loaded 43577 existing records. [2025-10-13T19:35:43.321617] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:43.321874] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-13T19:35:43.321920] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-13T19:35:43.322286] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-13T19:35:43.322342] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-13T19:35:43.623107] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-13T19:35:43.678674] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:43.969709] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:35:44.418031] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-13T19:35:44.712069] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:35:45.217903] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-13T19:35:45.375043] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:35:46.017942] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-13T19:35:46.519761] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:35:46.817935] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-13T19:35:47.029233] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T19:35:47.617903] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-13T19:35:48.421840] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-13T19:35:48.424723] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:35:48.577130] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:35:49.217952] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-13T19:35:49.865764] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:35:50.017954] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-13T19:35:50.679457] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:35:50.817902] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-13T19:35:50.857709] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:35:51.617984] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-13T19:35:52.188377] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:35:52.417952] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-13T19:35:53.163812] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:35:53.217902] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-13T19:35:53.343711] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T19:35:54.017994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-13T19:35:54.212269] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:35:54.789731] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:35:54.818024] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-13T19:35:55.617018] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:35:55.621051] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-13T19:35:56.244632] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:35:56.417953] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-13T19:35:57.217934] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-13T19:35:57.362239] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T19:35:58.017969] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-13T19:35:58.689369] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:35:58.817928] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-13T19:35:59.214581] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:35:59.617946] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-13T19:36:00.324050] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:36:00.417949] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-13T19:36:01.004685] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:36:01.167074] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:36:01.217887] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-13T19:36:02.017985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-13T19:36:02.287630] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:36:02.290442] [INFO ] [REMOTE ] IIM: Full fetch complete (25252 records). [2025-10-13T19:36:02.290943] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-13T19:36:02.667683] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-13T19:36:02.667825] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-13T19:36:02.668855] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-13T19:36:02.668925] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-13T19:36:02.670029] [DEBUG] [LOCAL ] IIM: Trimmed 25252 records to 15729 (keeping 200 days of data) [2025-10-13T19:36:02.778813] [DEBUG] [LOCAL ] IIM: Primary data saved (15729 records). [2025-10-13T19:36:02.778976] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-13T19:36:02.779061] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 33.3s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-13T19:36:02.823153] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-13T19:36:02.973846] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:03.018141] [DEBUG] [LOCAL ] INFA: Loaded 49851 existing records from primary storage. [2025-10-13T19:36:03.018498] [INFO ] [MAIN ] INFA: Loaded 49851 existing records. [2025-10-13T19:36:03.194806] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:03.195234] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-13T19:36:03.195406] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-13T19:36:03.196003] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-13T19:36:03.196061] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-13T19:36:03.576204] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:03.598293] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:36:03.617985] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-13T19:36:04.415529] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:36:04.423707] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-13T19:36:05.217966] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-13T19:36:05.234369] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:36:05.465318] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:36:06.017979] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-13T19:36:06.605812] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T19:36:06.817985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-13T19:36:07.617994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-13T19:36:07.788666] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:36:08.088076] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T19:36:08.091833] [INFO ] [REMOTE ] IIPR: Full fetch complete (44393 records). [2025-10-13T19:36:08.091933] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-13T19:36:08.422587] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-13T19:36:08.433451] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:36:08.441801] [INFO ] [REMOTE ] IIIN: Full fetch complete (24463 records). [2025-10-13T19:36:08.502120] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-13T19:36:08.513906] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-13T19:36:08.514133] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-13T19:36:08.515136] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-13T19:36:08.528099] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-13T19:36:08.641121] [DEBUG] [LOCAL ] IIPR: Trimmed 44393 records to 29422 (keeping 200 days of data) [2025-10-13T19:36:09.175088] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-13T19:36:09.175840] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-13T19:36:09.178601] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-13T19:36:09.183211] [DEBUG] [LOCAL ] IIPR: Primary data saved (29422 records). [2025-10-13T19:36:09.183435] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-13T19:36:09.183537] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-13T19:36:09.183721] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 31.9s. Estimated remaining: 2h 58m 14s. Rate: 7.1 symbols/min [2025-10-13T19:36:09.226724] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-13T19:36:09.252609] [DEBUG] [LOCAL ] IIIN: Trimmed 24463 records to 15957 (keeping 200 days of data) [2025-10-13T19:36:09.431861] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:09.464040] [DEBUG] [LOCAL ] IIIN: Primary data saved (15957 records). [2025-10-13T19:36:09.464328] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-13T19:36:09.464467] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IIIN took 45.4s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-13T19:36:09.669834] [DEBUG] [LOCAL ] INFY: Loaded 54374 existing records from primary storage. [2025-10-13T19:36:09.671367] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:09.672131] [INFO ] [MAIN ] INFY: Loaded 54374 existing records. [2025-10-13T19:36:09.859462] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:09.859784] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-13T19:36:09.859834] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-13T19:36:09.860353] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-13T19:36:09.860408] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-13T19:36:10.139793] [DEBUG] [LOCAL ] ING: Loaded 51465 existing records from primary storage. [2025-10-13T19:36:10.172508] [INFO ] [MAIN ] ING: Loaded 51465 existing records. [2025-10-13T19:36:10.311007] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:10.333295] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-13T19:36:10.476455] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:10.478537] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:36:10.487626] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-13T19:36:10.487814] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-13T19:36:10.489446] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-13T19:36:10.489584] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-13T19:36:10.796990] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:36:10.820571] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-13T19:36:10.885941] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:11.618007] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-13T19:36:12.422602] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-13T19:36:12.425820] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:36:12.600317] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:36:12.925496] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:36:13.217935] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-13T19:36:14.017956] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-13T19:36:14.109455] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:36:14.817937] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-13T19:36:14.954450] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:36:15.476361] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:36:15.617894] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-13T19:36:16.288771] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T19:36:16.417956] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-13T19:36:16.718361] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:36:17.217974] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-13T19:36:18.012827] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:36:18.023274] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-13T19:36:18.817943] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-13T19:36:18.903208] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:36:19.617895] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-13T19:36:19.652208] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T19:36:20.270144] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:36:20.274736] [INFO ] [REMOTE ] IMAX: Full fetch complete (60284 records). [2025-10-13T19:36:20.274838] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-13T19:36:20.423022] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-13T19:36:20.654815] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-13T19:36:20.654895] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-13T19:36:20.655692] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-13T19:36:20.655754] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-13T19:36:20.657002] [DEBUG] [LOCAL ] IMAX: Trimmed 60284 records to 43065 (keeping 200 days of data) [2025-10-13T19:36:20.915084] [DEBUG] [LOCAL ] IMAX: Primary data saved (43065 records). [2025-10-13T19:36:20.915210] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-13T19:36:20.915287] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. IMAX took 38.0s. Estimated remaining: 2h 57m 51s. Rate: 7.1 symbols/min [2025-10-13T19:36:21.088204] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:21.119211] [DEBUG] [LOCAL ] INGM: Loaded 29140 existing records from primary storage. [2025-10-13T19:36:21.119478] [INFO ] [MAIN ] INGM: Loaded 29140 existing records. [2025-10-13T19:36:21.223090] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-13T19:36:21.307841] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:21.308126] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-13T19:36:21.308183] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-13T19:36:21.308632] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-13T19:36:21.308723] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-13T19:36:21.665735] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:21.756456] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T19:36:22.017985] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-13T19:36:22.274353] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T19:36:22.594630] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:36:22.817938] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-13T19:36:22.945339] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T19:36:23.617968] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-13T19:36:24.417948] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-13T19:36:24.536143] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:36:24.887667] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:36:25.217974] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-13T19:36:25.304615] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:36:26.017930] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-13T19:36:26.817954] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-13T19:36:27.133949] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T19:36:27.586993] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T19:36:27.617896] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-13T19:36:28.417986] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-13T19:36:28.604601] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:36:29.223887] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-13T19:36:29.230093] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:36:29.257268] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:36:30.017950] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-13T19:36:30.817927] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-13T19:36:31.102166] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T19:36:31.324150] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:36:31.618011] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-13T19:36:32.371310] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T19:36:32.417904] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-13T19:36:33.116316] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T19:36:33.217947] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-13T19:36:33.853741] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:36:33.858165] [INFO ] [REMOTE ] INFA: Full fetch complete (70797 records). [2025-10-13T19:36:33.858295] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-13T19:36:34.029197] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-13T19:36:34.243941] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-13T19:36:34.244027] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-13T19:36:34.244952] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-13T19:36:34.245017] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-13T19:36:34.246489] [DEBUG] [LOCAL ] INFA: Trimmed 70797 records to 49157 (keeping 200 days of data) [2025-10-13T19:36:34.499253] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:36:34.582399] [DEBUG] [LOCAL ] INFA: Primary data saved (49157 records). [2025-10-13T19:36:34.582535] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-13T19:36:34.582614] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFA took 31.8s. Estimated remaining: 2h 57m 49s. Rate: 7.1 symbols/min [2025-10-13T19:36:34.746790] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:34.780582] [DEBUG] [LOCAL ] INGR: Loaded 34205 existing records from primary storage. [2025-10-13T19:36:34.780874] [INFO ] [MAIN ] INGR: Loaded 34205 existing records. [2025-10-13T19:36:34.823289] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-13T19:36:34.954132] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:34.954324] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-13T19:36:34.954370] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-13T19:36:34.954688] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-13T19:36:34.954744] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-13T19:36:35.330612] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:35.617979] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-13T19:36:36.078985] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-13T19:36:36.417990] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-13T19:36:36.780425] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:36:36.974925] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T19:36:37.217943] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-13T19:36:37.778887] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:36:38.017928] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-13T19:36:38.443966] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:36:38.817992] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-13T19:36:39.536988] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:36:39.617901] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-13T19:36:40.133183] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:36:40.417956] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-13T19:36:40.949755] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:36:41.217964] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-13T19:36:42.017972] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-13T19:36:42.141776] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:36:42.331924] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T19:36:42.817950] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-13T19:36:43.244167] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T19:36:43.617986] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-13T19:36:44.106879] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:36:44.417956] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-13T19:36:44.878118] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:36:45.217940] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-13T19:36:45.590984] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:36:46.017962] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-13T19:36:46.817927] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-13T19:36:47.085416] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:36:47.618008] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-13T19:36:47.904940] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T19:36:47.964821] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:36:48.418006] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-13T19:36:49.217928] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-13T19:36:49.258206] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T19:36:49.263843] [INFO ] [REMOTE ] INFY: Full fetch complete (77553 records). [2025-10-13T19:36:49.264012] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-13T19:36:49.608437] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:36:49.654966] [INFO ] [REMOTE ] INGM: Full fetch complete (42096 records). [2025-10-13T19:36:49.671954] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-13T19:36:49.699150] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-13T19:36:49.733334] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-13T19:36:49.747202] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-13T19:36:49.761439] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-13T19:36:49.820904] [DEBUG] [LOCAL ] INFY: Trimmed 77553 records to 53596 (keeping 200 days of data) [2025-10-13T19:36:50.052906] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-13T19:36:50.269975] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-13T19:36:50.270091] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-13T19:36:50.271258] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-13T19:36:50.324213] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-13T19:36:50.369029] [DEBUG] [LOCAL ] INGM: Trimmed 42096 records to 28621 (keeping 200 days of data) [2025-10-13T19:36:50.662609] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-13T19:36:50.664835] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-13T19:36:50.665272] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INFY took 41.5s. Estimated remaining: 2h 57m 49s. Rate: 7.1 symbols/min [2025-10-13T19:36:50.789807] [DEBUG] [LOCAL ] INGM: Primary data saved (28621 records). [2025-10-13T19:36:50.800755] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-13T19:36:50.806106] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 29.9s. Estimated remaining: 2h 57m 31s. Rate: 7.1 symbols/min [2025-10-13T19:36:50.981212] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:51.074363] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:51.081906] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-13T19:36:51.091565] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-13T19:36:51.094267] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-13T19:36:51.094154] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:36:51.094477] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-13T19:36:51.100086] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-13T19:36:51.100480] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-13T19:36:51.117757] [INFO ] [REMOTE ] ING: Full fetch complete (73607 records). [2025-10-13T19:36:51.131080] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-13T19:36:51.312742] [DEBUG] [LOCAL ] INN: Loaded 42347 existing records from primary storage. [2025-10-13T19:36:51.324229] [INFO ] [MAIN ] INN: Loaded 42347 existing records. [2025-10-13T19:36:52.052767] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:52.118224] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-13T19:36:52.124564] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-13T19:36:52.124449] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:52.138316] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-13T19:36:52.139312] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-13T19:36:52.139618] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-13T19:36:52.160429] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T19:36:52.231232] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-13T19:36:52.372870] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:36:52.387901] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-13T19:36:52.407352] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-13T19:36:52.417895] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-13T19:36:52.406624] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:36:52.434780] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-13T19:36:52.461387] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-13T19:36:52.449584] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-13T19:36:52.469188] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:36:52.498756] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-13T19:36:52.538957] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-13T19:36:52.551290] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-13T19:36:52.551169] [DEBUG] [LOCAL ] ING: Trimmed 73607 records to 50726 (keeping 200 days of data) [2025-10-13T19:36:52.592687] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-13T19:36:52.600796] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INR took 1.8s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-13T19:36:52.898521] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:52.914596] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-13T19:36:52.990850] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:53.157748] [DEBUG] [LOCAL ] INSP: Loaded 38337 existing records from primary storage. [2025-10-13T19:36:53.165158] [INFO ] [MAIN ] INSP: Loaded 38337 existing records. [2025-10-13T19:36:53.419566] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:53.422129] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-13T19:36:53.423897] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-13T19:36:53.425201] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-13T19:36:53.425573] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-13T19:36:53.477846] [DEBUG] [LOCAL ] ING: Primary data saved (50726 records). [2025-10-13T19:36:53.490625] [INFO ] [MAIN ] ING: Full history saved. [2025-10-13T19:36:53.528149] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. ING took 44.1s. Estimated remaining: 2h 56m 58s. Rate: 7.1 symbols/min [2025-10-13T19:36:53.949292] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:54.021515] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:36:54.053315] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:54.059768] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-13T19:36:54.061387] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-13T19:36:54.100066] [DEBUG] [LOCAL ] INSW: Loaded 40341 existing records from primary storage. [2025-10-13T19:36:54.100448] [INFO ] [MAIN ] INSW: Loaded 40341 existing records. [2025-10-13T19:36:54.280178] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:54.280389] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-13T19:36:54.280439] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-13T19:36:54.280895] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-13T19:36:54.280953] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-13T19:36:54.622831] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:36:54.681961] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:54.817953] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-13T19:36:55.232279] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T19:36:55.449066] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:36:55.617948] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-13T19:36:56.417934] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-13T19:36:56.578540] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:36:56.658515] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:36:57.217956] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-13T19:36:57.816583] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T19:36:58.017950] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-13T19:36:58.160675] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:36:58.817947] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-13T19:36:59.489482] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:36:59.617972] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-13T19:37:00.304227] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T19:37:00.417898] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-13T19:37:01.028127] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:37:01.217994] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-13T19:37:02.000789] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:37:02.007565] [INFO ] [REMOTE ] INGR: Full fetch complete (50470 records). [2025-10-13T19:37:02.007827] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-13T19:37:02.023241] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-13T19:37:02.410988] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-13T19:37:02.411215] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-13T19:37:02.412530] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-13T19:37:02.412604] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-13T19:37:02.414365] [DEBUG] [LOCAL ] INGR: Trimmed 50470 records to 33810 (keeping 200 days of data) [2025-10-13T19:37:02.650100] [DEBUG] [LOCAL ] INGR: Primary data saved (33810 records). [2025-10-13T19:37:02.650318] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-13T19:37:02.650540] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INGR took 28.1s. Estimated remaining: 2h 56m 50s. Rate: 7.1 symbols/min [2025-10-13T19:37:02.853625] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-13T19:37:02.857776] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:02.872154] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T19:37:02.939194] [DEBUG] [LOCAL ] INVH: Loaded 53939 existing records from primary storage. [2025-10-13T19:37:02.939635] [INFO ] [MAIN ] INVH: Loaded 53939 existing records. [2025-10-13T19:37:03.123683] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:03.123986] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-13T19:37:03.124039] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-13T19:37:03.124635] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-13T19:37:03.124731] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-13T19:37:03.506954] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:03.520221] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:37:03.617953] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-13T19:37:04.005011] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:37:04.417948] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-13T19:37:05.165331] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:37:05.217904] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-13T19:37:05.928052] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:37:06.017946] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-13T19:37:06.817953] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-13T19:37:06.923341] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:37:07.617967] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-13T19:37:07.729581] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:37:08.201531] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T19:37:08.417940] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-13T19:37:08.774748] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:37:09.217958] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-13T19:37:09.986826] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:37:10.017963] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-13T19:37:10.817948] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-13T19:37:10.847940] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:37:11.429783] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:37:11.617957] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-13T19:37:12.223518] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:37:12.418004] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-13T19:37:13.217943] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-13T19:37:13.465882] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T19:37:13.980604] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:37:14.017903] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-13T19:37:14.330720] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:37:14.817964] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-13T19:37:15.617988] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-13T19:37:15.785221] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:37:16.392464] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:37:16.417892] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-13T19:37:16.633361] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:37:17.217978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-13T19:37:17.796453] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T19:37:18.017967] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-13T19:37:18.682695] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T19:37:18.817964] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-13T19:37:19.223980] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T19:37:19.617992] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-13T19:37:20.215901] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T19:37:20.221571] [INFO ] [REMOTE ] INSW: Full fetch complete (60172 records). [2025-10-13T19:37:20.221696] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-13T19:37:20.424214] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-13T19:37:20.606633] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-13T19:37:20.606765] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-13T19:37:20.607742] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-13T19:37:20.607818] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-13T19:37:20.609239] [DEBUG] [LOCAL ] INSW: Trimmed 60172 records to 39735 (keeping 200 days of data) [2025-10-13T19:37:20.757635] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T19:37:20.883139] [DEBUG] [LOCAL ] INSW: Primary data saved (39735 records). [2025-10-13T19:37:20.883285] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-13T19:37:20.883380] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 27.3s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-13T19:37:21.053309] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:21.085876] [DEBUG] [LOCAL ] INVX: Loaded 29577 existing records from primary storage. [2025-10-13T19:37:21.086135] [INFO ] [MAIN ] INVX: Loaded 29577 existing records. [2025-10-13T19:37:21.224396] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-13T19:37:21.266593] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:21.266801] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-13T19:37:21.266848] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-13T19:37:21.267195] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-13T19:37:21.267251] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-13T19:37:21.617175] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:22.018007] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-13T19:37:22.159685] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:37:22.721346] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:37:22.817897] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-13T19:37:23.107082] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:37:23.618025] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-13T19:37:24.369541] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:37:24.417984] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-13T19:37:25.217938] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-13T19:37:25.466479] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:37:26.017969] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-13T19:37:26.205389] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:37:26.529962] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:37:26.817947] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-13T19:37:27.449488] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:37:27.617904] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-13T19:37:28.417921] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-13T19:37:28.655350] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:37:28.707201] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T19:37:29.217945] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-13T19:37:30.017948] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-13T19:37:30.072297] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:37:30.371403] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:37:30.817972] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-13T19:37:31.210925] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:37:31.618016] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-13T19:37:32.207995] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:37:32.418043] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-13T19:37:33.128297] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:37:33.132895] [INFO ] [REMOTE ] INSP: Full fetch complete (53346 records). [2025-10-13T19:37:33.133001] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-13T19:37:33.223195] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-13T19:37:33.520669] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-13T19:37:33.520892] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-13T19:37:33.521733] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-13T19:37:33.521795] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-13T19:37:33.523232] [DEBUG] [LOCAL ] INSP: Trimmed 53346 records to 38084 (keeping 200 days of data) [2025-10-13T19:37:33.751885] [DEBUG] [LOCAL ] INSP: Primary data saved (38084 records). [2025-10-13T19:37:33.752035] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-13T19:37:33.752116] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSP took 41.2s. Estimated remaining: 2h 56m 49s. Rate: 7.1 symbols/min [2025-10-13T19:37:33.842491] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T19:37:33.846776] [INFO ] [REMOTE ] INN: Full fetch complete (57671 records). [2025-10-13T19:37:33.846867] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-13T19:37:34.020093] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-13T19:37:34.233600] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-13T19:37:34.233708] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-13T19:37:34.234579] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-13T19:37:34.234621] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-13T19:37:34.237608] [DEBUG] [LOCAL ] INN: Trimmed 57671 records to 41803 (keeping 200 days of data) [2025-10-13T19:37:34.503383] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:37:34.504591] [DEBUG] [LOCAL ] INN: Primary data saved (41803 records). [2025-10-13T19:37:34.511330] [INFO ] [MAIN ] INN: Full history saved. [2025-10-13T19:37:34.511820] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INN took 43.8s. Estimated remaining: 2h 56m 32s. Rate: 7.1 symbols/min [2025-10-13T19:37:34.817946] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-13T19:37:35.905450] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T19:37:35.917334] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-13T19:37:35.963963] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:37:36.417997] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-13T19:37:37.647123] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T19:37:37.652871] [INFO ] [REMOTE ] INVH: Full fetch complete (76743 records). [2025-10-13T19:37:37.653030] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-13T19:37:38.034619] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:37:38.082246] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-13T19:37:38.082125] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-13T19:37:38.082445] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-13T19:37:38.084718] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-13T19:37:38.084792] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-13T19:37:38.086361] [DEBUG] [LOCAL ] INVH: Trimmed 76743 records to 53181 (keeping 200 days of data) [2025-10-13T19:37:38.441377] [DEBUG] [LOCAL ] INVH: Primary data saved (53181 records). [2025-10-13T19:37:38.441599] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-13T19:37:38.441809] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 35.8s. Estimated remaining: 2h 56m 19s. Rate: 7.1 symbols/min [2025-10-13T19:37:39.423921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T19:37:39.430108] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-13T19:37:40.621591] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:37:40.634305] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-13T19:37:41.641610] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:37:41.645515] [INFO ] [REMOTE ] INVX: Full fetch complete (43415 records). [2025-10-13T19:37:41.645705] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-13T19:37:42.037401] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-13T19:37:42.037481] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-13T19:37:42.038160] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-13T19:37:42.038224] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-13T19:37:42.039164] [DEBUG] [LOCAL ] INVX: Trimmed 43415 records to 29284 (keeping 200 days of data) [2025-10-13T19:37:42.206404] [DEBUG] [LOCAL ] INVX: Primary data saved (29284 records). [2025-10-13T19:37:42.206532] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-13T19:37:42.206611] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. INVX took 21.3s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-13T19:37:42.741017] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.844040] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.908830] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.958129] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:43.022622] [DEBUG] [LOCAL ] IOT: Loaded 54252 existing records from primary storage. [2025-10-13T19:37:43.023132] [INFO ] [MAIN ] IOT: Loaded 54252 existing records. [2025-10-13T19:37:43.214397] [DEBUG] [LOCAL ] IPG: Loaded 54108 existing records from primary storage. [2025-10-13T19:37:43.228298] [DEBUG] [LOCAL ] IP: Loaded 54090 existing records from primary storage. [2025-10-13T19:37:43.270872] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:43.286749] [INFO ] [MAIN ] IP: Loaded 54090 existing records. [2025-10-13T19:37:43.286194] [INFO ] [MAIN ] IPG: Loaded 54108 existing records. [2025-10-13T19:37:43.287181] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-13T19:37:43.334400] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-13T19:37:43.335409] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-13T19:37:43.387320] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-13T19:37:43.420103] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-13T19:37:43.425767] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-10-13T19:37:43.839040] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:43.855131] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-13T19:37:43.927547] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-13T19:37:43.991434] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-13T19:37:44.027091] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:44.076048] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-13T19:37:44.112659] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-13T19:37:44.112361] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:44.174431] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-13T19:37:44.194228] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-13T19:37:44.141355] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-13T19:37:44.272891] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-13T19:37:44.296238] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-13T19:37:44.296337] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-13T19:37:44.296602] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-13T19:37:44.633531] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:44.652833] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-13T19:37:45.225271] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.255523] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-13T19:37:45.383749] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.380282] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.384145] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-13T19:37:45.384608] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-13T19:37:46.739414] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:37:46.750324] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-13T19:37:47.008987] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T19:37:47.020094] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-13T19:37:47.187764] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T19:37:47.198279] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-13T19:37:48.060598] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-13T19:37:48.071686] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-13T19:37:48.526167] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:37:48.537150] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-13T19:37:48.592563] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:37:48.603365] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-13T19:37:48.816104] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:37:48.827839] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-13T19:37:49.938009] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:37:49.948754] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-13T19:37:50.265946] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:37:50.277250] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-13T19:37:50.404278] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-13T19:37:50.416137] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-13T19:37:50.456945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:37:50.817972] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-13T19:37:51.934148] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:37:51.945568] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-13T19:37:52.151263] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:37:52.417965] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-13T19:37:52.583467] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:37:52.662709] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-13T19:37:53.217960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-13T19:37:53.887001] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:37:54.017936] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-13T19:37:54.381993] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:37:54.817925] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-13T19:37:55.617948] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-13T19:37:55.948713] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:37:56.114434] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-13T19:37:56.369628] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:37:56.417952] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-13T19:37:57.065596] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:37:57.217943] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-13T19:37:58.017946] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-13T19:37:58.444626] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T19:37:58.818012] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-13T19:37:59.617948] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-13T19:37:59.688170] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:37:59.922686] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-13T19:38:00.417966] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-13T19:38:00.800131] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T19:38:01.217956] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-13T19:38:01.382037] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:38:02.017948] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-13T19:38:02.308395] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:38:02.817905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-13T19:38:03.205405] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:38:03.618029] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-13T19:38:04.031583] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T19:38:04.162020] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:38:04.417969] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-13T19:38:05.217986] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-13T19:38:05.342709] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:38:06.017961] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-13T19:38:06.823971] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-13T19:38:06.830363] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:38:07.198268] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-13T19:38:07.617943] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-13T19:38:07.806758] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:38:07.812294] [INFO ] [REMOTE ] IOT: Full fetch complete (77392 records). [2025-10-13T19:38:07.812453] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-13T19:38:08.221457] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-13T19:38:08.221624] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-13T19:38:08.222760] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-13T19:38:08.222867] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-13T19:38:08.224766] [DEBUG] [LOCAL ] IOT: Trimmed 77392 records to 53475 (keeping 200 days of data) [2025-10-13T19:38:08.386575] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:38:08.433676] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-13T19:38:08.595141] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-13T19:38:08.595279] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-13T19:38:08.595357] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IOT took 26.4s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-13T19:38:08.760629] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:08.782625] [DEBUG] [LOCAL ] IPI: Loaded 21875 existing records from primary storage. [2025-10-13T19:38:08.782892] [INFO ] [MAIN ] IPI: Loaded 21875 existing records. [2025-10-13T19:38:08.984939] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:08.985244] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-13T19:38:08.985297] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-13T19:38:08.985578] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-13T19:38:08.985616] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-13T19:38:09.229678] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-13T19:38:09.357316] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:09.389552] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:38:10.017967] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-13T19:38:10.817932] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-13T19:38:10.992465] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-13T19:38:11.056001] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:38:11.591530] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:38:11.597349] [INFO ] [REMOTE ] IPG: Full fetch complete (77251 records). [2025-10-13T19:38:11.597458] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-13T19:38:11.628492] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-13T19:38:11.907806] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T19:38:12.004241] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-13T19:38:12.004320] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-13T19:38:12.005256] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-13T19:38:12.005321] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-13T19:38:12.006793] [DEBUG] [LOCAL ] IPG: Trimmed 77251 records to 53329 (keeping 200 days of data) [2025-10-13T19:38:12.338287] [DEBUG] [LOCAL ] IPG: Primary data saved (53329 records). [2025-10-13T19:38:12.338421] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-13T19:38:12.338563] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPG took 30.1s. Estimated remaining: 2h 56m 3s. Rate: 7.1 symbols/min [2025-10-13T19:38:12.423277] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-13T19:38:12.511724] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:12.531370] [DEBUG] [LOCAL ] IQI: Loaded 18146 existing records from primary storage. [2025-10-13T19:38:12.531677] [INFO ] [MAIN ] IQI: Loaded 18146 existing records. [2025-10-13T19:38:12.712234] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:12.712491] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-13T19:38:12.712539] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-13T19:38:12.712818] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-13T19:38:12.712876] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-13T19:38:13.078861] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:13.097074] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:38:13.102790] [INFO ] [REMOTE ] IP: Full fetch complete (77171 records). [2025-10-13T19:38:13.102951] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-13T19:38:13.223175] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-13T19:38:13.493590] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-13T19:38:13.493702] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-13T19:38:13.494674] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-13T19:38:13.494737] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-13T19:38:13.496277] [DEBUG] [LOCAL ] IP: Trimmed 77171 records to 53310 (keeping 200 days of data) [2025-10-13T19:38:13.820463] [DEBUG] [LOCAL ] IP: Primary data saved (53310 records). [2025-10-13T19:38:13.820599] [INFO ] [MAIN ] IP: Full history saved. [2025-10-13T19:38:13.820701] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IP took 31.6s. Estimated remaining: 2h 55m 47s. Rate: 7.1 symbols/min [2025-10-13T19:38:13.983978] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:14.018012] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-13T19:38:14.037703] [DEBUG] [LOCAL ] IQV: Loaded 50832 existing records from primary storage. [2025-10-13T19:38:14.038039] [INFO ] [MAIN ] IQV: Loaded 50832 existing records. [2025-10-13T19:38:14.225843] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:14.226574] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-13T19:38:14.226629] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-13T19:38:14.227148] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-13T19:38:14.227206] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-13T19:38:14.578970] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:38:14.608014] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:14.817890] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-13T19:38:14.846836] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T19:38:15.218400] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-13T19:38:15.617960] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-13T19:38:15.883006] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:38:16.417899] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-13T19:38:16.612979] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:38:17.217960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-13T19:38:18.017904] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-13T19:38:18.124988] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:38:18.817899] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-13T19:38:19.084889] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:38:19.623849] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-13T19:38:19.639987] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T19:38:19.966891] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:38:20.231057] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:38:20.417958] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-13T19:38:21.217938] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-13T19:38:22.017937] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-13T19:38:22.089297] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:38:22.297961] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:38:22.817968] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-13T19:38:23.618019] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-13T19:38:23.791858] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:38:24.417942] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-13T19:38:24.483995] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:38:25.214769] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T19:38:25.224270] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-13T19:38:25.642776] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:38:26.017965] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-13T19:38:26.818016] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-13T19:38:26.927501] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T19:38:27.617937] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-13T19:38:27.888986] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-13T19:38:27.894418] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-13T19:38:27.894538] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-13T19:38:28.304408] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-13T19:38:28.304556] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-13T19:38:28.305503] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-13T19:38:28.305567] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-13T19:38:28.307046] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-13T19:38:28.418087] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-13T19:38:28.591622] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:38:28.595978] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T19:38:28.703980] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-13T19:38:28.704126] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-13T19:38:28.704219] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IONQ took 46.5s. Estimated remaining: 2h 55m 45s. Rate: 7.1 symbols/min [2025-10-13T19:38:28.872706] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:28.924069] [DEBUG] [LOCAL ] IR: Loaded 53520 existing records from primary storage. [2025-10-13T19:38:28.924376] [INFO ] [MAIN ] IR: Loaded 53520 existing records. [2025-10-13T19:38:29.100403] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:29.100776] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-13T19:38:29.100845] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-13T19:38:29.106562] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-13T19:38:29.111818] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-13T19:38:29.117872] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:38:29.222597] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-13T19:38:29.505664] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:30.017892] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-13T19:38:30.145549] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T19:38:30.817962] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-13T19:38:30.986196] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:38:31.617980] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-13T19:38:32.423358] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-13T19:38:32.429743] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:38:33.217897] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-13T19:38:33.321801] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T19:38:33.561163] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T19:38:34.017905] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-13T19:38:34.275954] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:38:34.817984] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-13T19:38:35.617950] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-13T19:38:35.694753] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:38:35.736494] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T19:38:36.417951] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-13T19:38:36.671017] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:38:37.217978] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-13T19:38:38.017953] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-13T19:38:38.133714] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:38:38.705895] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:38:38.709068] [INFO ] [REMOTE ] IPI: Full fetch complete (29727 records). [2025-10-13T19:38:38.709167] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-13T19:38:38.821419] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-13T19:38:39.124043] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-13T19:38:39.135052] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-13T19:38:39.142175] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-13T19:38:39.142311] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-13T19:38:39.154726] [DEBUG] [LOCAL ] IPI: Trimmed 29727 records to 21272 (keeping 200 days of data) [2025-10-13T19:38:39.157120] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T19:38:39.310223] [DEBUG] [LOCAL ] IPI: Primary data saved (21272 records). [2025-10-13T19:38:39.310431] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-13T19:38:39.310542] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IPI took 30.7s. Estimated remaining: 2h 55m 39s. Rate: 7.1 symbols/min [2025-10-13T19:38:39.485232] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:39.543555] [DEBUG] [LOCAL ] IRM: Loaded 49959 existing records from primary storage. [2025-10-13T19:38:39.544016] [INFO ] [MAIN ] IRM: Loaded 49959 existing records. [2025-10-13T19:38:39.618327] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-13T19:38:39.743151] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:39.749409] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-13T19:38:39.750239] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-13T19:38:39.750552] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:38:39.752729] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-13T19:38:39.752939] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-13T19:38:39.758220] [INFO ] [REMOTE ] IQI: Full fetch complete (26595 records). [2025-10-13T19:38:39.785674] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-13T19:38:40.423817] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-13T19:38:40.529016] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:40.577375] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-13T19:38:40.577472] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-13T19:38:40.578179] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-13T19:38:40.578267] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-13T19:38:40.578970] [DEBUG] [LOCAL ] IQI: Trimmed 26595 records to 17869 (keeping 200 days of data) [2025-10-13T19:38:40.689236] [DEBUG] [LOCAL ] IQI: Primary data saved (17869 records). [2025-10-13T19:38:40.689386] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-13T19:38:40.689472] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IQI took 28.4s. Estimated remaining: 2h 55m 23s. Rate: 7.1 symbols/min [2025-10-13T19:38:40.862108] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:40.885303] [DEBUG] [LOCAL ] IRS: Loaded 22978 existing records from primary storage. [2025-10-13T19:38:40.885593] [INFO ] [MAIN ] IRS: Loaded 22978 existing records. [2025-10-13T19:38:41.069013] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:41.069257] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-13T19:38:41.069305] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-13T19:38:41.069676] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-13T19:38:41.069765] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-13T19:38:41.222462] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-13T19:38:41.453011] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:41.494766] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T19:38:42.017976] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-13T19:38:42.342818] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T19:38:42.819197] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-13T19:38:42.825964] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:38:43.359155] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T19:38:43.617975] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-13T19:38:44.158191] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:38:44.417983] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-13T19:38:45.217948] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-13T19:38:45.420047] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:38:46.017967] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-13T19:38:46.058955] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:38:46.127428] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T19:38:46.817980] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-13T19:38:47.617994] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-13T19:38:47.692519] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:38:48.417975] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-13T19:38:48.451568] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:38:49.223027] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-13T19:38:49.243310] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T19:38:49.518854] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:38:50.018222] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-13T19:38:50.818006] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-13T19:38:51.015985] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:38:51.125265] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:38:51.617968] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-13T19:38:52.357413] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T19:38:52.417990] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-13T19:38:52.848091] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:38:53.217979] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-13T19:38:53.462473] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:38:53.886452] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:38:53.892416] [INFO ] [REMOTE ] IQV: Full fetch complete (72160 records). [2025-10-13T19:38:53.892579] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-13T19:38:54.023047] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-13T19:38:54.322140] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-13T19:38:54.322253] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-13T19:38:54.323573] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-13T19:38:54.323690] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-13T19:38:54.326440] [DEBUG] [LOCAL ] IQV: Trimmed 72160 records to 50121 (keeping 200 days of data) [2025-10-13T19:38:54.663347] [DEBUG] [LOCAL ] IQV: Primary data saved (50121 records). [2025-10-13T19:38:54.663540] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-13T19:38:54.663666] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IQV took 40.8s. Estimated remaining: 2h 55m 21s. Rate: 7.1 symbols/min [2025-10-13T19:38:54.817945] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-13T19:38:54.837085] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:54.893885] [DEBUG] [LOCAL ] IRT: Loaded 51183 existing records from primary storage. [2025-10-13T19:38:54.894329] [INFO ] [MAIN ] IRT: Loaded 51183 existing records. [2025-10-13T19:38:55.081514] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:55.082112] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-13T19:38:55.082213] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-13T19:38:55.082696] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-13T19:38:55.082759] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-13T19:38:55.455953] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:55.617933] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-13T19:38:55.726277] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T19:38:56.417937] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-13T19:38:56.621780] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:38:56.701589] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:38:57.218021] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-13T19:38:58.017939] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-13T19:38:58.167507] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:38:58.779531] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T19:38:58.817962] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-13T19:38:59.536062] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:38:59.617965] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-13T19:39:00.366360] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T19:39:00.417949] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-13T19:39:00.480207] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:39:01.217974] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-13T19:39:02.018009] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-13T19:39:02.164542] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T19:39:02.171667] [INFO ] [REMOTE ] IR: Full fetch complete (76245 records). [2025-10-13T19:39:02.171902] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-13T19:39:02.623138] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-13T19:39:02.623244] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-13T19:39:02.624313] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-13T19:39:02.624378] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-13T19:39:02.626170] [DEBUG] [LOCAL ] IR: Trimmed 76245 records to 52765 (keeping 200 days of data) [2025-10-13T19:39:02.818006] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-13T19:39:02.884758] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:39:02.999525] [DEBUG] [LOCAL ] IR: Primary data saved (52765 records). [2025-10-13T19:39:02.999703] [INFO ] [MAIN ] IR: Full history saved. [2025-10-13T19:39:02.999800] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IR took 34.3s. Estimated remaining: 2h 55m 12s. Rate: 7.1 symbols/min [2025-10-13T19:39:03.166582] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:03.183735] [DEBUG] [LOCAL ] ISD: Loaded 16060 existing records from primary storage. [2025-10-13T19:39:03.184016] [INFO ] [MAIN ] ISD: Loaded 16060 existing records. [2025-10-13T19:39:03.361243] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:03.361820] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-13T19:39:03.361882] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-13T19:39:03.362160] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-13T19:39:03.362224] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-13T19:39:03.618561] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-13T19:39:03.753067] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:39:03.756810] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:03.884871] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:39:04.417900] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-13T19:39:05.217939] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-13T19:39:05.311288] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:39:05.872788] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:39:06.017990] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-13T19:39:06.352019] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:39:06.817947] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-13T19:39:07.617902] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-13T19:39:07.741392] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:39:07.781576] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:39:08.417891] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-13T19:39:08.730317] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:39:09.217924] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-13T19:39:09.425224] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:39:10.017977] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-13T19:39:10.266382] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:39:10.817961] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-13T19:39:11.617964] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-13T19:39:11.842254] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:39:11.847347] [INFO ] [REMOTE ] IRM: Full fetch complete (72210 records). [2025-10-13T19:39:11.847475] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-13T19:39:12.269670] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-13T19:39:12.270110] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-13T19:39:12.271872] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T19:39:12.273030] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-13T19:39:12.273279] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-13T19:39:12.292512] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T19:39:12.296702] [DEBUG] [LOCAL ] IRM: Trimmed 72210 records to 49203 (keeping 200 days of data) [2025-10-13T19:39:12.418146] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-13T19:39:12.616228] [DEBUG] [LOCAL ] IRM: Primary data saved (49203 records). [2025-10-13T19:39:12.616367] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-13T19:39:12.616448] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRM took 33.3s. Estimated remaining: 2h 55m 5s. Rate: 7.1 symbols/min [2025-10-13T19:39:12.783325] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:12.824200] [DEBUG] [LOCAL ] IT: Loaded 42823 existing records from primary storage. [2025-10-13T19:39:12.824486] [INFO ] [MAIN ] IT: Loaded 42823 existing records. [2025-10-13T19:39:12.998442] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:12.998668] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-13T19:39:12.998726] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-13T19:39:12.999126] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-13T19:39:12.999181] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-13T19:39:13.227841] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-13T19:39:13.380149] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:13.753247] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:39:13.757008] [INFO ] [REMOTE ] IRS: Full fetch complete (32538 records). [2025-10-13T19:39:13.757104] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-13T19:39:14.026954] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-13T19:39:14.168508] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-13T19:39:14.168621] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-13T19:39:14.169720] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-13T19:39:14.169800] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-13T19:39:14.171160] [DEBUG] [LOCAL ] IRS: Trimmed 32538 records to 22924 (keeping 200 days of data) [2025-10-13T19:39:14.315185] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:39:14.329341] [DEBUG] [LOCAL ] IRS: Primary data saved (22924 records). [2025-10-13T19:39:14.329498] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-13T19:39:14.329611] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRS took 33.6s. Estimated remaining: 2h 54m 49s. Rate: 7.1 symbols/min [2025-10-13T19:39:14.500788] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:14.533637] [DEBUG] [LOCAL ] ITGR: Loaded 31647 existing records from primary storage. [2025-10-13T19:39:14.533978] [INFO ] [MAIN ] ITGR: Loaded 31647 existing records. [2025-10-13T19:39:14.717266] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:14.717601] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-13T19:39:14.717699] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-13T19:39:14.718196] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-13T19:39:14.718254] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-13T19:39:14.823088] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-13T19:39:15.091826] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:15.617952] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-13T19:39:15.786635] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:39:15.808279] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:39:16.417948] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-13T19:39:16.618675] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:39:17.217949] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-13T19:39:18.017963] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-13T19:39:18.112101] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T19:39:18.176975] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:39:18.817958] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-13T19:39:19.193085] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:39:19.618015] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-13T19:39:19.754110] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T19:39:20.417992] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-13T19:39:20.993115] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:39:21.217901] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-13T19:39:21.412110] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:39:22.017955] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-13T19:39:22.420925] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:39:22.818017] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-13T19:39:23.107334] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:39:23.618048] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-13T19:39:24.417940] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-13T19:39:24.455825] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:39:24.561499] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:39:25.218009] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-13T19:39:25.884594] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:39:26.017948] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-13T19:39:26.824231] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-13T19:39:26.829746] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:39:27.028167] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:39:27.030893] [INFO ] [REMOTE ] ISD: Full fetch complete (24010 records). [2025-10-13T19:39:27.030976] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-13T19:39:27.416555] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-13T19:39:27.417122] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-13T19:39:27.417983] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-13T19:39:27.418047] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-13T19:39:27.418889] [DEBUG] [LOCAL ] ISD: Trimmed 24010 records to 15901 (keeping 200 days of data) [2025-10-13T19:39:27.524238] [DEBUG] [LOCAL ] ISD: Primary data saved (15901 records). [2025-10-13T19:39:27.524443] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-13T19:39:27.524547] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 24.5s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-13T19:39:27.625882] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-13T19:39:27.707256] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:27.749234] [DEBUG] [LOCAL ] ITT: Loaded 33112 existing records from primary storage. [2025-10-13T19:39:27.749766] [INFO ] [MAIN ] ITT: Loaded 33112 existing records. [2025-10-13T19:39:27.931432] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:27.932032] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-13T19:39:27.932121] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-13T19:39:27.932669] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-13T19:39:27.932736] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-13T19:39:28.208805] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:39:28.334515] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:28.417999] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-13T19:39:29.217905] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-13T19:39:29.453834] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T19:39:29.750260] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:39:30.017979] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-13T19:39:30.801267] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T19:39:30.817885] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-13T19:39:31.626681] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-13T19:39:31.631792] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:39:32.351590] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:39:32.417899] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-13T19:39:33.137608] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:39:33.217890] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-13T19:39:33.958244] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:39:34.017882] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-13T19:39:34.568208] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:39:34.818026] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-13T19:39:35.373073] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:39:35.617906] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-13T19:39:36.017570] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:39:36.418005] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-13T19:39:37.217925] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-13T19:39:37.356844] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T19:39:37.680703] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:39:38.017961] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-13T19:39:38.817947] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-13T19:39:38.944272] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:39:39.228457] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T19:39:39.617994] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-13T19:39:40.245739] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:39:40.417894] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-13T19:39:40.796981] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:39:41.218020] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-13T19:39:41.767265] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:39:42.017945] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-13T19:39:42.822062] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-13T19:39:42.830669] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:39:43.318560] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T19:39:43.617989] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-13T19:39:43.874797] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:39:44.417990] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-13T19:39:45.217973] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-13T19:39:45.245494] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:39:45.250715] [INFO ] [REMOTE ] IT: Full fetch complete (56916 records). [2025-10-13T19:39:45.250852] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-13T19:39:45.637150] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-13T19:39:45.637227] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-13T19:39:45.638023] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-13T19:39:45.638098] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-13T19:39:45.641438] [DEBUG] [LOCAL ] IT: Trimmed 56916 records to 42159 (keeping 200 days of data) [2025-10-13T19:39:45.912992] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:39:45.937974] [DEBUG] [LOCAL ] IT: Primary data saved (42159 records). [2025-10-13T19:39:45.938113] [INFO ] [MAIN ] IT: Full history saved. [2025-10-13T19:39:45.938293] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 33.3s. Estimated remaining: 2h 54m 48s. Rate: 7.1 symbols/min [2025-10-13T19:39:46.027969] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-13T19:39:46.115566] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:46.166152] [DEBUG] [LOCAL ] ITUB: Loaded 54088 existing records from primary storage. [2025-10-13T19:39:46.166510] [INFO ] [MAIN ] ITUB: Loaded 54088 existing records. [2025-10-13T19:39:46.343485] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:46.343741] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-13T19:39:46.343793] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-13T19:39:46.344109] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-13T19:39:46.344164] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-13T19:39:46.707806] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:46.817893] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-13T19:39:46.868047] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:39:46.873604] [INFO ] [REMOTE ] IRT: Full fetch complete (72755 records). [2025-10-13T19:39:46.873739] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-13T19:39:47.308029] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-13T19:39:47.310398] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:39:47.310723] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-13T19:39:47.318750] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-13T19:39:47.319242] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-13T19:39:47.321408] [DEBUG] [LOCAL ] IRT: Trimmed 72755 records to 50560 (keeping 200 days of data) [2025-10-13T19:39:47.618116] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-13T19:39:47.640156] [DEBUG] [LOCAL ] IRT: Primary data saved (50560 records). [2025-10-13T19:39:47.640316] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-13T19:39:47.640425] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. IRT took 53.0s. Estimated remaining: 2h 54m 32s. Rate: 7.1 symbols/min [2025-10-13T19:39:47.804282] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:47.844914] [DEBUG] [LOCAL ] ITW: Loaded 46468 existing records from primary storage. [2025-10-13T19:39:47.845216] [INFO ] [MAIN ] ITW: Loaded 46468 existing records. [2025-10-13T19:39:48.019946] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:48.020177] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-13T19:39:48.020226] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-13T19:39:48.021376] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-13T19:39:48.021438] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-13T19:39:48.378062] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:48.417941] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-13T19:39:48.841345] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-13T19:39:48.917602] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:39:49.217970] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-13T19:39:49.609958] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:39:49.613584] [INFO ] [REMOTE ] ITGR: Full fetch complete (42472 records). [2025-10-13T19:39:49.613705] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-13T19:39:49.986898] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-13T19:39:49.986977] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-13T19:39:49.987607] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-13T19:39:49.987667] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-13T19:39:49.988588] [DEBUG] [LOCAL ] ITGR: Trimmed 42472 records to 31229 (keeping 200 days of data) [2025-10-13T19:39:50.038150] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-13T19:39:50.184917] [DEBUG] [LOCAL ] ITGR: Primary data saved (31229 records). [2025-10-13T19:39:50.185070] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-13T19:39:50.185207] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITGR took 35.9s. Estimated remaining: 2h 54m 17s. Rate: 7.1 symbols/min [2025-10-13T19:39:50.360209] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:50.404975] [DEBUG] [LOCAL ] IVR: Loaded 48793 existing records from primary storage. [2025-10-13T19:39:50.405404] [INFO ] [MAIN ] IVR: Loaded 48793 existing records. [2025-10-13T19:39:50.586903] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:50.587388] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-13T19:39:50.587468] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-13T19:39:50.606608] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-13T19:39:50.609870] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-13T19:39:50.643972] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:39:50.830275] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-13T19:39:50.977087] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:51.617958] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-13T19:39:51.821309] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:39:52.419404] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-13T19:39:52.425310] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:39:52.539842] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:39:53.217968] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-13T19:39:54.017974] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-13T19:39:54.194702] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:39:54.817977] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-13T19:39:54.989739] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:39:55.474742] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:39:55.617974] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-13T19:39:56.417939] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-13T19:39:56.516867] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:39:57.217937] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-13T19:39:57.320994] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:39:57.378616] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:39:58.017994] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-13T19:39:58.825780] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-13T19:39:58.842422] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:39:59.303323] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:39:59.617958] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-13T19:40:00.337718] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:40:00.417906] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-13T19:40:01.217934] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-13T19:40:01.529954] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:40:01.857886] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:40:01.863182] [INFO ] [REMOTE ] ITT: Full fetch complete (47043 records). [2025-10-13T19:40:01.863373] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-13T19:40:02.023079] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-13T19:40:02.290212] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-13T19:40:02.290290] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-13T19:40:02.290971] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-13T19:40:02.291039] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-13T19:40:02.291972] [DEBUG] [LOCAL ] ITT: Trimmed 47043 records to 32826 (keeping 200 days of data) [2025-10-13T19:40:02.498101] [DEBUG] [LOCAL ] ITT: Primary data saved (32826 records). [2025-10-13T19:40:02.498225] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-13T19:40:02.498317] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITT took 35.0s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-13T19:40:02.665873] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:02.700130] [DEBUG] [LOCAL ] IVT: Loaded 31596 existing records from primary storage. [2025-10-13T19:40:02.700388] [INFO ] [MAIN ] IVT: Loaded 31596 existing records. [2025-10-13T19:40:02.823023] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-13T19:40:02.885341] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:02.885579] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-13T19:40:02.885635] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-13T19:40:02.886020] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-13T19:40:02.886075] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-13T19:40:03.224806] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:03.617935] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-13T19:40:04.232723] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-13T19:40:04.418028] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-13T19:40:04.726500] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:40:04.830469] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-13T19:40:05.217998] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-13T19:40:05.519195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T19:40:05.907638] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:40:06.017991] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-13T19:40:06.690871] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T19:40:06.817959] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-13T19:40:07.617960] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-13T19:40:07.897079] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:40:08.417903] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-13T19:40:08.575839] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T19:40:09.217906] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-13T19:40:09.427419] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:40:09.779059] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:40:10.017958] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-13T19:40:10.746730] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:40:10.817896] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-13T19:40:11.618081] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-13T19:40:11.804132] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:40:11.877452] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T19:40:12.418032] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-13T19:40:13.217973] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-13T19:40:13.279048] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:40:14.017935] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-13T19:40:14.264619] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T19:40:14.659871] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:40:14.817957] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-13T19:40:15.185708] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:40:15.617961] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-13T19:40:16.417887] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-13T19:40:16.603249] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T19:40:17.217901] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-13T19:40:17.296989] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:40:17.302446] [INFO ] [REMOTE ] ITUB: Full fetch complete (77151 records). [2025-10-13T19:40:17.302591] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-13T19:40:17.715671] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-13T19:40:17.715776] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-13T19:40:17.716843] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-13T19:40:17.716907] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-13T19:40:17.718529] [DEBUG] [LOCAL ] ITUB: Trimmed 77151 records to 53318 (keeping 200 days of data) [2025-10-13T19:40:18.026701] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-13T19:40:18.055225] [DEBUG] [LOCAL ] ITUB: Primary data saved (53318 records). [2025-10-13T19:40:18.055377] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-13T19:40:18.055464] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITUB took 32.1s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-13T19:40:18.234310] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:18.263169] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:40:18.329880] [DEBUG] [LOCAL ] IVZ: Loaded 53881 existing records from primary storage. [2025-10-13T19:40:18.330226] [INFO ] [MAIN ] IVZ: Loaded 53881 existing records. [2025-10-13T19:40:18.520935] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:18.521188] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-13T19:40:18.521257] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-13T19:40:18.521690] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-13T19:40:18.521747] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-13T19:40:18.829847] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-13T19:40:18.898407] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:18.963447] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:40:19.346536] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T19:40:19.617952] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-13T19:40:20.417898] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-13T19:40:20.455761] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:40:20.967611] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:40:21.217952] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-13T19:40:22.017971] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-13T19:40:22.080122] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:40:22.085321] [INFO ] [REMOTE ] IVR: Full fetch complete (69129 records). [2025-10-13T19:40:22.085445] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-13T19:40:22.477552] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-13T19:40:22.477662] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-13T19:40:22.478572] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-13T19:40:22.478636] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-13T19:40:22.480053] [DEBUG] [LOCAL ] IVR: Trimmed 69129 records to 48122 (keeping 200 days of data) [2025-10-13T19:40:22.787629] [DEBUG] [LOCAL ] IVR: Primary data saved (48122 records). [2025-10-13T19:40:22.788890] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:40:22.788341] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-13T19:40:22.789042] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVR took 32.6s. Estimated remaining: 2h 53m 60s. Rate: 7.1 symbols/min [2025-10-13T19:40:22.830111] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-13T19:40:22.830244] [INFO ] [REMOTE ] ITW: Full fetch complete (66461 records). [2025-10-13T19:40:22.872560] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-13T19:40:23.097483] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:23.337166] [DEBUG] [LOCAL ] IX: Loaded 22586 existing records from primary storage. [2025-10-13T19:40:23.362580] [INFO ] [MAIN ] IX: Loaded 22586 existing records. [2025-10-13T19:40:23.515617] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-13T19:40:23.526127] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-13T19:40:23.536309] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-13T19:40:23.545828] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-13T19:40:23.643543] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:23.639327] [DEBUG] [LOCAL ] ITW: Trimmed 66461 records to 45832 (keeping 200 days of data) [2025-10-13T19:40:23.644254] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-13T19:40:23.644718] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-13T19:40:23.645225] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-13T19:40:23.645337] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-13T19:40:24.113372] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T19:40:24.164955] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-13T19:40:24.287760] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:24.318142] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T19:40:24.426416] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-13T19:40:24.503009] [DEBUG] [LOCAL ] ITW: Primary data saved (45832 records). [2025-10-13T19:40:24.503163] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-13T19:40:24.503250] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. ITW took 36.9s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-13T19:40:24.675744] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:24.717562] [DEBUG] [LOCAL ] J: Loaded 40817 existing records from primary storage. [2025-10-13T19:40:24.717944] [INFO ] [MAIN ] J: Loaded 40817 existing records. [2025-10-13T19:40:24.898972] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:24.899190] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-13T19:40:24.899237] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-13T19:40:24.899495] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-13T19:40:24.899536] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-13T19:40:25.224480] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-13T19:40:25.267500] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:25.756187] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:40:25.808549] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:40:25.948874] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:40:26.017942] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-13T19:40:26.818018] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-13T19:40:27.432391] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:40:27.504130] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:40:27.617944] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-13T19:40:28.417928] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-13T19:40:28.826855] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T19:40:29.174810] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:40:29.217984] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-13T19:40:30.017901] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-13T19:40:30.489783] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:40:30.817986] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-13T19:40:31.617987] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-13T19:40:31.732746] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:40:31.889268] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T19:40:32.417970] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-13T19:40:32.831516] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T19:40:33.217936] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-13T19:40:33.669947] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:40:34.017970] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-13T19:40:34.732811] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:40:34.817987] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-13T19:40:35.252565] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:40:35.618088] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-13T19:40:36.327493] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:40:36.417959] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-13T19:40:36.871060] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:40:37.217978] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-13T19:40:37.932612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:40:38.021489] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-13T19:40:38.234489] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:40:38.818008] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-13T19:40:39.344089] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:40:39.348202] [INFO ] [REMOTE ] IVT: Full fetch complete (45675 records). [2025-10-13T19:40:39.348336] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-13T19:40:39.623154] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-13T19:40:39.777156] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-13T19:40:39.777259] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-13T19:40:39.778577] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-13T19:40:39.778662] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-13T19:40:39.779965] [DEBUG] [LOCAL ] IVT: Trimmed 45675 records to 31261 (keeping 200 days of data) [2025-10-13T19:40:39.992448] [DEBUG] [LOCAL ] IVT: Primary data saved (31261 records). [2025-10-13T19:40:39.992708] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-13T19:40:39.992830] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVT took 37.5s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-13T19:40:40.186879] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:40.233825] [DEBUG] [LOCAL ] JBGS: Loaded 42765 existing records from primary storage. [2025-10-13T19:40:40.234264] [INFO ] [MAIN ] JBGS: Loaded 42765 existing records. [2025-10-13T19:40:40.424714] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-13T19:40:40.432008] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:40.433500] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-13T19:40:40.433557] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-13T19:40:40.434837] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-13T19:40:40.434907] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-13T19:40:40.818606] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:40.864721] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T19:40:41.217936] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-13T19:40:41.299524] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:40:41.606841] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:40:42.017984] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-13T19:40:42.817996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-13T19:40:42.957260] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:40:42.994433] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:40:43.618006] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-13T19:40:44.055521] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:40:44.417996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-13T19:40:45.218001] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-13T19:40:45.308952] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:40:45.378435] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:40:46.018009] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-13T19:40:46.725727] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:40:46.817892] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-13T19:40:47.618098] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-13T19:40:47.995837] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T19:40:48.248686] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:40:48.417974] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-13T19:40:48.868694] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:40:49.217976] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-13T19:40:49.736551] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:40:50.017963] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-13T19:40:50.601792] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:40:50.818008] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-13T19:40:51.462922] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:40:51.617948] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-13T19:40:52.417893] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-13T19:40:52.581633] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T19:40:52.783988] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:40:53.217960] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-13T19:40:53.946252] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:40:54.017897] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-13T19:40:54.463258] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:40:54.817949] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-13T19:40:55.567691] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:40:55.617879] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-13T19:40:55.884175] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:40:55.886812] [INFO ] [REMOTE ] IX: Full fetch complete (27958 records). [2025-10-13T19:40:55.886908] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-13T19:40:56.266759] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-13T19:40:56.266858] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-13T19:40:56.267514] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-13T19:40:56.267593] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-13T19:40:56.268851] [DEBUG] [LOCAL ] IX: Trimmed 27958 records to 22373 (keeping 200 days of data) [2025-10-13T19:40:56.405992] [DEBUG] [LOCAL ] IX: Primary data saved (22373 records). [2025-10-13T19:40:56.406121] [INFO ] [MAIN ] IX: Full history saved. [2025-10-13T19:40:56.406201] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IX took 33.6s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-13T19:40:56.428494] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-13T19:40:56.582214] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:56.622593] [DEBUG] [LOCAL ] JBI: Loaded 43912 existing records from primary storage. [2025-10-13T19:40:56.622910] [INFO ] [MAIN ] JBI: Loaded 43912 existing records. [2025-10-13T19:40:56.797275] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:56.797489] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-13T19:40:56.797544] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-13T19:40:56.798017] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-13T19:40:56.798080] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-13T19:40:57.144890] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:57.175845] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:40:57.217890] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-13T19:40:57.954017] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:40:58.017889] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-13T19:40:58.817899] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-13T19:40:58.865273] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:40:58.870730] [INFO ] [REMOTE ] IVZ: Full fetch complete (76813 records). [2025-10-13T19:40:58.870849] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-13T19:40:59.274311] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-13T19:40:59.274495] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-13T19:40:59.275872] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-13T19:40:59.276756] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-13T19:40:59.278703] [DEBUG] [LOCAL ] IVZ: Trimmed 76813 records to 53118 (keeping 200 days of data) [2025-10-13T19:40:59.535633] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:40:59.628742] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-13T19:40:59.652839] [DEBUG] [LOCAL ] IVZ: Primary data saved (53118 records). [2025-10-13T19:40:59.652928] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-13T19:40:59.653016] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. IVZ took 41.6s. Estimated remaining: 2h 53m 29s. Rate: 7.1 symbols/min [2025-10-13T19:40:59.819489] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:59.866173] [DEBUG] [LOCAL ] JBL: Loaded 49115 existing records from primary storage. [2025-10-13T19:40:59.866561] [INFO ] [MAIN ] JBL: Loaded 49115 existing records. [2025-10-13T19:41:00.043805] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:00.043981] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-13T19:41:00.044027] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-13T19:41:00.044444] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-13T19:41:00.044499] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-13T19:41:00.396010] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:00.418769] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-13T19:41:00.421343] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:41:01.115632] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:41:01.120437] [INFO ] [REMOTE ] J: Full fetch complete (59282 records). [2025-10-13T19:41:01.120575] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-13T19:41:01.223598] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-13T19:41:01.502575] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-13T19:41:01.502671] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-13T19:41:01.503502] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-13T19:41:01.503544] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-13T19:41:01.504760] [DEBUG] [LOCAL ] J: Trimmed 59282 records to 40285 (keeping 200 days of data) [2025-10-13T19:41:01.753589] [DEBUG] [LOCAL ] J: Primary data saved (40285 records). [2025-10-13T19:41:01.753737] [INFO ] [MAIN ] J: Full history saved. [2025-10-13T19:41:01.753822] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. J took 37.3s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-13T19:41:01.921499] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:01.946031] [DEBUG] [LOCAL ] JBND: Loaded 26996 existing records from primary storage. [2025-10-13T19:41:01.946325] [INFO ] [MAIN ] JBND: Loaded 26996 existing records. [2025-10-13T19:41:02.020829] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-13T19:41:02.148175] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:02.150127] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:41:02.148954] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-13T19:41:02.158431] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-13T19:41:02.159285] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-13T19:41:02.159346] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-13T19:41:02.515870] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:02.672500] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:41:02.817984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-13T19:41:03.617984] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-13T19:41:03.815747] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:41:03.871186] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T19:41:04.417944] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-13T19:41:04.970869] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T19:41:05.218004] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-13T19:41:06.017910] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-13T19:41:06.484509] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T19:41:06.713550] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:41:06.817898] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-13T19:41:06.957762] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:41:07.617953] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-13T19:41:08.241889] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:41:08.417903] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-13T19:41:08.473297] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:41:09.217950] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-13T19:41:09.928739] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:41:10.017885] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-13T19:41:10.734607] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:41:10.817892] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-13T19:41:11.617909] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-13T19:41:11.742316] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:41:12.249844] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:41:12.417934] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-13T19:41:12.770229] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:41:13.217956] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-13T19:41:13.830286] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:41:14.017947] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-13T19:41:14.744631] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:41:14.817891] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-13T19:41:15.617899] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-13T19:41:15.917470] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:41:16.295928] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T19:41:16.312721] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:41:16.317331] [INFO ] [REMOTE ] JBGS: Full fetch complete (59275 records). [2025-10-13T19:41:16.317470] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-13T19:41:16.423097] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-13T19:41:16.752438] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-13T19:41:16.752517] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-13T19:41:16.753328] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-13T19:41:16.753408] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-13T19:41:16.754559] [DEBUG] [LOCAL ] JBGS: Trimmed 59275 records to 42181 (keeping 200 days of data) [2025-10-13T19:41:17.013252] [DEBUG] [LOCAL ] JBGS: Primary data saved (42181 records). [2025-10-13T19:41:17.013397] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-13T19:41:17.013492] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBGS took 37.0s. Estimated remaining: 2h 53m 13s. Rate: 7.1 symbols/min [2025-10-13T19:41:17.180439] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:17.180626] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-13T19:41:17.180696] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-13T19:41:17.180810] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-13T19:41:17.180851] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-13T19:41:17.180893] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-13T19:41:17.180924] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-13T19:41:17.223201] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-13T19:41:17.530422] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:17.909786] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:41:18.017893] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-13T19:41:18.817905] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-13T19:41:18.922885] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:41:19.000084] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:41:19.617971] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-13T19:41:19.826605] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:41:19.826985] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-13T19:41:19.827076] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:41:19.827123] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-13T19:41:19.827157] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:41:19.827212] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-13T19:41:19.827268] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-13T19:41:19.827302] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-13T19:41:19.827340] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-13T19:41:19.827386] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBS took 2.8s. Estimated remaining: 2h 52m 58s. Rate: 7.1 symbols/min [2025-10-13T19:41:20.014798] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T19:41:20.079904] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:20.080198] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-13T19:41:20.080239] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-13T19:41:20.080373] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-13T19:41:20.080418] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-13T19:41:20.080461] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-13T19:41:20.080498] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-13T19:41:20.428111] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-13T19:41:20.472064] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:21.217941] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-13T19:41:21.422888] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:41:21.423215] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-13T19:41:21.423310] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:41:21.423386] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-13T19:41:21.423453] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:41:21.423525] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-13T19:41:21.423590] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-13T19:41:21.423626] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-13T19:41:21.423712] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-13T19:41:21.423770] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 52m 43s. Rate: 7.1 symbols/min [2025-10-13T19:41:21.612559] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:21.621594] [DEBUG] [LOCAL ] JCE: Loaded 7358 existing records from primary storage. [2025-10-13T19:41:21.621827] [INFO ] [MAIN ] JCE: Loaded 7358 existing records. [2025-10-13T19:41:21.800487] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:21.800712] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-13T19:41:21.800768] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-13T19:41:21.800908] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-13T19:41:21.800947] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-13T19:41:22.023048] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-13T19:41:22.170880] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:22.263832] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T19:41:22.817974] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-13T19:41:23.099254] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:41:23.617949] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-13T19:41:24.417946] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-13T19:41:24.681978] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:41:24.733970] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T19:41:25.033543] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:41:25.217954] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-13T19:41:26.017947] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-13T19:41:26.624914] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:41:26.629210] [INFO ] [REMOTE ] JBI: Full fetch complete (63977 records). [2025-10-13T19:41:26.629318] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-13T19:41:26.708068] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:41:26.827028] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-13T19:41:27.042045] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-13T19:41:27.042132] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-13T19:41:27.042998] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-13T19:41:27.043061] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-13T19:41:27.044395] [DEBUG] [LOCAL ] JBI: Trimmed 63977 records to 43124 (keeping 200 days of data) [2025-10-13T19:41:27.292449] [DEBUG] [LOCAL ] JBI: Primary data saved (43124 records). [2025-10-13T19:41:27.292579] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-13T19:41:27.292678] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBI took 30.9s. Estimated remaining: 2h 52m 31s. Rate: 7.1 symbols/min [2025-10-13T19:41:27.458250] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:27.514588] [DEBUG] [LOCAL ] JCI: Loaded 54312 existing records from primary storage. [2025-10-13T19:41:27.514984] [INFO ] [MAIN ] JCI: Loaded 54312 existing records. [2025-10-13T19:41:27.624768] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-13T19:41:27.743773] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:27.744142] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-13T19:41:27.744194] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-13T19:41:27.745366] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-13T19:41:27.745432] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-13T19:41:28.211030] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:28.233153] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T19:41:28.333824] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T19:41:28.418027] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-13T19:41:29.217949] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-13T19:41:29.805751] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:41:30.017943] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-13T19:41:30.090329] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:41:30.817946] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-13T19:41:31.525878] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:41:31.617943] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-13T19:41:31.751072] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:41:32.216608] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:41:32.417980] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-13T19:41:33.222034] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-13T19:41:34.017967] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-13T19:41:34.146254] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:41:34.817986] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-13T19:41:34.976685] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:41:35.346143] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:41:35.520703] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:41:35.617939] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-13T19:41:36.417949] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-13T19:41:36.898765] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T19:41:36.904884] [INFO ] [REMOTE ] JBND: Full fetch complete (35074 records). [2025-10-13T19:41:36.905078] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-13T19:41:37.105436] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T19:41:37.223024] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-13T19:41:37.312799] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-13T19:41:37.312876] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-13T19:41:37.313507] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-13T19:41:37.313567] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-13T19:41:37.314441] [DEBUG] [LOCAL ] JBND: Trimmed 35074 records to 26674 (keeping 200 days of data) [2025-10-13T19:41:37.480918] [DEBUG] [LOCAL ] JBND: Primary data saved (26674 records). [2025-10-13T19:41:37.481049] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-13T19:41:37.481168] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 35.7s. Estimated remaining: 2h 52m 25s. Rate: 7.1 symbols/min [2025-10-13T19:41:37.648426] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:37.699901] [DEBUG] [LOCAL ] JEF: Loaded 50909 existing records from primary storage. [2025-10-13T19:41:37.700211] [INFO ] [MAIN ] JEF: Loaded 50909 existing records. [2025-10-13T19:41:37.887333] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:37.887725] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-13T19:41:37.887787] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-13T19:41:37.888798] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-13T19:41:37.888869] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-13T19:41:37.995143] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:41:38.024351] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-13T19:41:38.249996] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:38.817900] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-13T19:41:39.048473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T19:41:39.617954] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-13T19:41:40.417907] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-13T19:41:40.554919] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:41:41.043451] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:41:41.045370] [INFO ] [REMOTE ] JCE: Full fetch complete (9765 records). [2025-10-13T19:41:41.045437] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-13T19:41:41.225959] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-13T19:41:41.430531] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-13T19:41:41.430626] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-13T19:41:41.431053] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-13T19:41:41.431112] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-13T19:41:41.431623] [DEBUG] [LOCAL ] JCE: Trimmed 9765 records to 7371 (keeping 200 days of data) [2025-10-13T19:41:41.491774] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:41:41.492863] [DEBUG] [LOCAL ] JCE: Primary data saved (7371 records). [2025-10-13T19:41:41.497872] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-13T19:41:41.498217] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 20.1s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-10-13T19:41:41.519168] [INFO ] [REMOTE ] JBL: Full fetch complete (70357 records). [2025-10-13T19:41:41.541538] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-13T19:41:41.822204] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:42.023209] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-13T19:41:42.084739] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-13T19:41:42.084838] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-13T19:41:42.086825] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-13T19:41:42.086961] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-13T19:41:42.103704] [DEBUG] [LOCAL ] JELD: Loaded 46759 existing records from primary storage. [2025-10-13T19:41:42.104313] [INFO ] [MAIN ] JELD: Loaded 46759 existing records. [2025-10-13T19:41:42.104191] [DEBUG] [LOCAL ] JBL: Trimmed 70357 records to 48384 (keeping 200 days of data) [2025-10-13T19:41:42.388599] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:42.389408] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-13T19:41:42.389728] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-13T19:41:42.391432] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-13T19:41:42.391759] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-13T19:41:42.772312] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:42.841751] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-13T19:41:42.903299] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:41:43.000847] [DEBUG] [LOCAL ] JBL: Primary data saved (48384 records). [2025-10-13T19:41:43.000988] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-13T19:41:43.001074] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JBL took 43.3s. Estimated remaining: 2h 51m 56s. Rate: 7.1 symbols/min [2025-10-13T19:41:43.171783] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:43.201695] [DEBUG] [LOCAL ] JFR: Loaded 31454 existing records from primary storage. [2025-10-13T19:41:43.201988] [INFO ] [MAIN ] JFR: Loaded 31454 existing records. [2025-10-13T19:41:43.376758] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:43.377294] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-13T19:41:43.377385] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-13T19:41:43.378149] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-13T19:41:43.378207] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-13T19:41:43.620424] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-13T19:41:43.733137] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:43.863143] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:41:44.317399] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:41:44.418005] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-13T19:41:45.217987] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-13T19:41:45.451011] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:41:45.763526] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:41:46.018005] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-13T19:41:46.243609] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:41:46.817950] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-13T19:41:47.467928] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:41:47.617906] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-13T19:41:48.401110] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T19:41:48.417882] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-13T19:41:49.147568] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:41:49.217888] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-13T19:41:50.017954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-13T19:41:50.631748] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T19:41:50.696982] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T19:41:50.817950] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-13T19:41:51.473097] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:41:51.617953] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-13T19:41:52.113752] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:41:52.417968] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-13T19:41:53.055365] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:41:53.217986] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-13T19:41:53.548901] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T19:41:54.018005] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-13T19:41:54.818063] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-13T19:41:55.084801] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:41:55.617996] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-13T19:41:55.716155] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T19:41:56.165904] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:41:56.417978] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-13T19:41:57.201401] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:41:57.217888] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-13T19:41:58.017970] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-13T19:41:58.097417] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:41:58.715712] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:41:58.817959] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-13T19:41:59.213252] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T19:41:59.617979] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-13T19:42:00.425450] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-13T19:42:00.432361] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:42:00.935511] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:42:01.217963] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-13T19:42:02.017948] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-13T19:42:02.217044] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:42:02.817900] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-13T19:42:03.000200] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:42:03.498631] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T19:42:03.617901] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-13T19:42:04.417978] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-13T19:42:04.457166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:42:04.623758] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:42:04.627462] [INFO ] [REMOTE ] JFR: Full fetch complete (48241 records). [2025-10-13T19:42:04.627537] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-13T19:42:04.994080] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-13T19:42:04.994176] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-13T19:42:04.994947] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-13T19:42:04.995011] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-13T19:42:04.996173] [DEBUG] [LOCAL ] JFR: Trimmed 48241 records to 30972 (keeping 200 days of data) [2025-10-13T19:42:05.192770] [DEBUG] [LOCAL ] JFR: Primary data saved (30972 records). [2025-10-13T19:42:05.192935] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-13T19:42:05.193025] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JFR took 22.2s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-13T19:42:05.223173] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-13T19:42:05.366406] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:05.378818] [DEBUG] [LOCAL ] JGH: Loaded 12013 existing records from primary storage. [2025-10-13T19:42:05.379027] [INFO ] [MAIN ] JGH: Loaded 12013 existing records. [2025-10-13T19:42:05.551723] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:05.551970] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-13T19:42:05.552016] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-13T19:42:05.552435] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-13T19:42:05.552494] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-13T19:42:05.905816] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:05.963083] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:42:06.017894] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-13T19:42:06.817954] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-13T19:42:06.977195] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T19:42:07.617929] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-13T19:42:07.648583] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:42:08.326020] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:42:08.372677] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:42:08.417937] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-13T19:42:09.218008] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-13T19:42:09.942770] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T19:42:10.017909] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-13T19:42:10.105852] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:42:10.644204] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:42:10.817946] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-13T19:42:11.595424] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:42:11.617885] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-13T19:42:12.417985] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-13T19:42:12.469453] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:42:13.218026] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-13T19:42:14.017939] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-13T19:42:14.326737] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T19:42:14.825423] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-13T19:42:14.830612] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:42:15.455323] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:42:15.531165] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:42:15.536743] [INFO ] [REMOTE ] JCI: Full fetch complete (77402 records). [2025-10-13T19:42:15.536859] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-13T19:42:15.623025] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-13T19:42:15.940588] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-13T19:42:15.940709] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-13T19:42:15.941709] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-13T19:42:15.941773] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-13T19:42:15.945143] [DEBUG] [LOCAL ] JCI: Trimmed 77402 records to 53533 (keeping 200 days of data) [2025-10-13T19:42:16.287991] [DEBUG] [LOCAL ] JCI: Primary data saved (53533 records). [2025-10-13T19:42:16.288533] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-13T19:42:16.288635] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JCI took 49.0s. Estimated remaining: 2h 51m 56s. Rate: 7.1 symbols/min [2025-10-13T19:42:16.424916] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-13T19:42:16.481179] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:16.522844] [DEBUG] [LOCAL ] JHG: Loaded 48298 existing records from primary storage. [2025-10-13T19:42:16.523196] [INFO ] [MAIN ] JHG: Loaded 48298 existing records. [2025-10-13T19:42:16.698965] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:16.699175] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-13T19:42:16.699221] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-13T19:42:16.700237] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-13T19:42:16.700295] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-13T19:42:17.043044] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:17.218058] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-13T19:42:17.246427] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:42:17.260669] [INFO ] [REMOTE ] JEF: Full fetch complete (73051 records). [2025-10-13T19:42:17.261607] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-13T19:42:17.261972] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:42:17.652740] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-13T19:42:17.652824] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-13T19:42:17.653783] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-13T19:42:17.653848] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-13T19:42:17.655440] [DEBUG] [LOCAL ] JEF: Trimmed 73051 records to 50183 (keeping 200 days of data) [2025-10-13T19:42:17.961686] [DEBUG] [LOCAL ] JEF: Primary data saved (50183 records). [2025-10-13T19:42:17.961827] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-13T19:42:17.961919] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEF took 40.5s. Estimated remaining: 2h 51m 41s. Rate: 7.1 symbols/min [2025-10-13T19:42:18.023532] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-13T19:42:18.129254] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:18.134395] [DEBUG] [LOCAL ] JHI: Loaded 3929 existing records from primary storage. [2025-10-13T19:42:18.134547] [INFO ] [MAIN ] JHI: Loaded 3929 existing records. [2025-10-13T19:42:18.306803] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:18.307005] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-13T19:42:18.307051] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-13T19:42:18.307257] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-13T19:42:18.307313] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-13T19:42:18.658836] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:18.817945] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-13T19:42:18.871516] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T19:42:19.051331] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T19:42:19.617987] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-13T19:42:20.309426] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T19:42:20.417965] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-13T19:42:20.477484] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T19:42:20.836469] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:42:21.217949] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-13T19:42:22.018173] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-13T19:42:22.018038] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:42:22.581964] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:42:22.817976] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-13T19:42:23.618980] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-13T19:42:23.622919] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:42:24.107321] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-13T19:42:24.417959] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-13T19:42:25.217987] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-13T19:42:25.434872] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T19:42:25.437422] [INFO ] [REMOTE ] JGH: Full fetch complete (15567 records). [2025-10-13T19:42:25.437504] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-13T19:42:25.828871] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-13T19:42:25.828959] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-13T19:42:25.829315] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-13T19:42:25.829358] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-13T19:42:25.829925] [DEBUG] [LOCAL ] JGH: Trimmed 15567 records to 12022 (keeping 200 days of data) [2025-10-13T19:42:25.902217] [DEBUG] [LOCAL ] JGH: Primary data saved (12022 records). [2025-10-13T19:42:25.902353] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-13T19:42:25.902433] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 20.7s. Estimated remaining: 2h 51m 32s. Rate: 7.1 symbols/min [2025-10-13T19:42:26.023072] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-13T19:42:26.081732] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:26.087295] [DEBUG] [LOCAL ] JHS: Loaded 2954 existing records from primary storage. [2025-10-13T19:42:26.087880] [INFO ] [MAIN ] JHS: Loaded 2954 existing records. [2025-10-13T19:42:26.261823] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:26.262074] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-13T19:42:26.262123] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-13T19:42:26.262297] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-13T19:42:26.262354] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-13T19:42:26.616838] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:26.622892] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T19:42:26.681446] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:42:26.686544] [INFO ] [REMOTE ] JELD: Full fetch complete (64212 records). [2025-10-13T19:42:26.686794] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-13T19:42:26.823081] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-13T19:42:27.120358] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-13T19:42:27.120450] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-13T19:42:27.121548] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-13T19:42:27.121687] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-13T19:42:27.123191] [DEBUG] [LOCAL ] JELD: Trimmed 64212 records to 46105 (keeping 200 days of data) [2025-10-13T19:42:27.348326] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T19:42:27.420452] [DEBUG] [LOCAL ] JELD: Primary data saved (46105 records). [2025-10-13T19:42:27.420595] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-13T19:42:27.420777] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JELD took 45.9s. Estimated remaining: 2h 51m 16s. Rate: 7.1 symbols/min [2025-10-13T19:42:27.605059] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:27.617956] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-13T19:42:27.658140] [DEBUG] [LOCAL ] JHX: Loaded 53931 existing records from primary storage. [2025-10-13T19:42:27.658474] [INFO ] [MAIN ] JHX: Loaded 53931 existing records. [2025-10-13T19:42:27.828943] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:27.829152] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-13T19:42:27.829198] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-13T19:42:27.829698] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-13T19:42:27.829755] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-13T19:42:28.172870] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:28.417927] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-13T19:42:29.156511] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:42:29.217900] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-13T19:42:29.405256] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:42:30.017989] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-13T19:42:30.469224] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:42:30.576222] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:42:30.817976] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-13T19:42:31.618036] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-13T19:42:32.196884] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T19:42:32.418022] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-13T19:42:32.481364] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:42:33.063808] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T19:42:33.217982] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-13T19:42:33.783831] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:42:34.018021] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-13T19:42:34.817999] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-13T19:42:35.617943] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-13T19:42:35.783559] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:42:35.833119] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:42:36.078511] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T19:42:36.417986] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-13T19:42:37.206738] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:42:37.217900] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-13T19:42:38.018020] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-13T19:42:38.381448] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:42:38.547793] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T19:42:38.818000] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-13T19:42:39.618043] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-13T19:42:40.114865] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T19:42:40.418047] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-13T19:42:40.493748] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:42:40.961290] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:42:41.217950] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-13T19:42:42.017951] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-13T19:42:42.436430] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T19:42:42.614264] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:42:42.818025] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-13T19:42:43.618003] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-13T19:42:44.417971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-13T19:42:44.499316] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T19:42:44.507737] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:42:44.970453] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:42:45.217987] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-13T19:42:45.683244] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:42:46.018053] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-13T19:42:46.630674] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T19:42:46.818038] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-13T19:42:47.409068] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T19:42:47.410356] [INFO ] [REMOTE ] JHS: Full fetch complete (4507 records). [2025-10-13T19:42:47.410431] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-13T19:42:47.619595] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-13T19:42:47.808604] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-13T19:42:47.808765] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-13T19:42:47.808962] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-13T19:42:47.809004] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-13T19:42:47.809453] [DEBUG] [LOCAL ] JHS: Trimmed 4507 records to 2944 (keeping 200 days of data) [2025-10-13T19:42:47.830306] [DEBUG] [LOCAL ] JHS: Primary data saved (2944 records). [2025-10-13T19:42:47.830501] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-13T19:42:47.830622] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHS took 21.9s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-13T19:42:48.005320] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:48.026362] [DEBUG] [LOCAL ] JILL: Loaded 16471 existing records from primary storage. [2025-10-13T19:42:48.026728] [INFO ] [MAIN ] JILL: Loaded 16471 existing records. [2025-10-13T19:42:48.212975] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:48.213252] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-13T19:42:48.213332] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-13T19:42:48.213615] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-13T19:42:48.213703] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-13T19:42:48.423829] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-13T19:42:48.582761] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:49.218010] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-13T19:42:49.333699] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:42:49.810366] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:42:50.018020] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-13T19:42:50.352343] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:42:50.617069] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T19:42:50.817961] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-13T19:42:51.617958] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-13T19:42:52.192533] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T19:42:52.256177] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:42:52.417903] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-13T19:42:53.218016] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-13T19:42:53.946118] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:42:54.017940] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-13T19:42:54.083529] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T19:42:54.817946] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-13T19:42:55.593334] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T19:42:55.617883] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-13T19:42:55.654725] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:42:56.337382] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:42:56.417936] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-13T19:42:57.217899] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-13T19:42:57.477523] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:42:58.017954] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-13T19:42:58.387180] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:42:58.392238] [INFO ] [REMOTE ] JHG: Full fetch complete (68258 records). [2025-10-13T19:42:58.392367] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-13T19:42:58.781200] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-13T19:42:58.781331] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-13T19:42:58.782218] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-13T19:42:58.782281] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-13T19:42:58.783598] [DEBUG] [LOCAL ] JHG: Trimmed 68258 records to 47620 (keeping 200 days of data) [2025-10-13T19:42:58.837097] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-13T19:42:59.007217] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:42:59.092435] [DEBUG] [LOCAL ] JHG: Primary data saved (47620 records). [2025-10-13T19:42:59.092584] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-13T19:42:59.092694] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 42.8s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-13T19:42:59.259145] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:59.296307] [DEBUG] [LOCAL ] JKS: Loaded 40520 existing records from primary storage. [2025-10-13T19:42:59.296599] [INFO ] [MAIN ] JKS: Loaded 40520 existing records. [2025-10-13T19:42:59.475717] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:59.475980] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-13T19:42:59.476025] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-13T19:42:59.476679] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-13T19:42:59.476745] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-13T19:42:59.624025] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-13T19:42:59.829243] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:00.417962] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-13T19:43:00.665552] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T19:43:00.741844] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T19:43:01.218016] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-13T19:43:01.961382] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T19:43:01.962871] [INFO ] [REMOTE ] JHI: Full fetch complete (5557 records). [2025-10-13T19:43:01.962942] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-13T19:43:02.023181] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-13T19:43:02.320172] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-13T19:43:02.320346] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-13T19:43:02.320538] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-13T19:43:02.320860] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-13T19:43:02.321356] [DEBUG] [LOCAL ] JHI: Trimmed 5557 records to 3933 (keeping 200 days of data) [2025-10-13T19:43:02.365858] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T19:43:02.381542] [DEBUG] [LOCAL ] JHI: Primary data saved (3933 records). [2025-10-13T19:43:02.381623] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-13T19:43:02.381732] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHI took 44.4s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-13T19:43:02.805793] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:43:02.817973] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-13T19:43:03.617952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-13T19:43:04.415733] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:43:04.424847] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-13T19:43:04.458889] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T19:43:05.217952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-13T19:43:05.996163] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T19:43:06.017899] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-13T19:43:06.182314] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:43:06.713988] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:43:06.716082] [INFO ] [REMOTE ] JILL: Full fetch complete (22588 records). [2025-10-13T19:43:06.716180] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-13T19:43:06.823007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-13T19:43:07.075862] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-13T19:43:07.075947] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-13T19:43:07.076503] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-13T19:43:07.076543] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-13T19:43:07.077153] [DEBUG] [LOCAL ] JILL: Trimmed 22588 records to 16095 (keeping 200 days of data) [2025-10-13T19:43:07.178335] [DEBUG] [LOCAL ] JILL: Primary data saved (16095 records). [2025-10-13T19:43:07.178475] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-13T19:43:07.178555] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 19.3s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-13T19:43:07.617942] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-13T19:43:08.666524] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:43:08.679080] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-13T19:43:09.079340] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:43:09.217934] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-13T19:43:10.514354] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:43:10.520029] [INFO ] [REMOTE ] JHX: Full fetch complete (60615 records). [2025-10-13T19:43:10.520134] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-13T19:43:10.996350] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-13T19:43:10.996484] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-13T19:43:10.997532] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-13T19:43:10.997616] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-13T19:43:11.002266] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:43:11.012207] [DEBUG] [LOCAL ] JHX: Trimmed 60615 records to 53153 (keeping 200 days of data) [2025-10-13T19:43:11.012932] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-13T19:43:11.352797] [DEBUG] [LOCAL ] JHX: Primary data saved (53153 records). [2025-10-13T19:43:11.352934] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-13T19:43:11.353015] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 43.9s. Estimated remaining: 2h 50m 35s. Rate: 7.1 symbols/min [2025-10-13T19:43:12.892352] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T19:43:12.902511] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-13T19:43:14.338095] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:43:14.346121] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-13T19:43:15.785943] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T19:43:15.794105] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-13T19:43:17.252737] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T19:43:17.261496] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-13T19:43:18.649495] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:43:18.657097] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-13T19:43:20.081368] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:43:20.091830] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-13T19:43:21.414050] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:43:21.418930] [INFO ] [REMOTE ] JKS: Full fetch complete (58751 records). [2025-10-13T19:43:21.419106] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-13T19:43:21.801976] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-13T19:43:21.802074] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-13T19:43:21.802965] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-13T19:43:21.803029] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-13T19:43:21.804281] [DEBUG] [LOCAL ] JKS: Trimmed 58751 records to 39731 (keeping 200 days of data) [2025-10-13T19:43:22.042181] [DEBUG] [LOCAL ] JKS: Primary data saved (39731 records). [2025-10-13T19:43:22.042318] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-13T19:43:22.042406] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 22.9s. Estimated remaining: 2h 50m 29s. Rate: 7.1 symbols/min [2025-10-13T19:43:22.760440] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.739957] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.762010] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.769802] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-13T19:43:22.786549] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-13T19:43:22.787666] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-13T19:43:22.789239] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.790438] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-13T19:43:22.791150] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-13T19:43:22.791277] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-13T19:43:22.834850] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-13T19:43:22.858380] [INFO ] [MAIN ] JLS: Loaded 4203 existing records. [2025-10-13T19:43:23.147835] [DEBUG] [LOCAL ] JLL: Loaded 31853 existing records from primary storage. [2025-10-13T19:43:23.240841] [INFO ] [MAIN ] JLL: Loaded 31853 existing records. [2025-10-13T19:43:23.318951] [DEBUG] [LOCAL ] JMIA: Loaded 51623 existing records from primary storage. [2025-10-13T19:43:23.349721] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.360165] [INFO ] [MAIN ] JMIA: Loaded 51623 existing records. [2025-10-13T19:43:23.369708] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.388367] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-13T19:43:23.490713] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-13T19:43:23.552056] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:23.524995] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-13T19:43:23.557561] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-13T19:43:23.919075] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.952849] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.963929] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.964278] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-13T19:43:23.964546] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.972053] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-13T19:43:23.972162] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-13T19:43:24.004079] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-13T19:43:24.050559] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-13T19:43:24.050726] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-13T19:43:24.102057] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-13T19:43:24.103666] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-13T19:43:24.384304] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.409140] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-13T19:43:24.588317] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:43:24.649138] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-13T19:43:24.843301] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.854117] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-13T19:43:24.917897] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.918312] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-13T19:43:24.992845] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-13T19:43:24.994307] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-13T19:43:25.220811] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T19:43:25.221919] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-13T19:43:25.515830] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:43:25.517944] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-13T19:43:25.571559] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T19:43:25.572498] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-13T19:43:25.934994] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:43:25.940698] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-13T19:43:26.023282] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:43:26.024779] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-13T19:43:26.065557] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:43:26.067224] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-13T19:43:26.416118] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T19:43:26.417612] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-13T19:43:26.678259] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:43:26.800366] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:43:26.817893] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-13T19:43:26.929700] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T19:43:27.257565] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:43:27.617943] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-13T19:43:28.417908] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-13T19:43:28.648526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:43:28.718851] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:43:28.962498] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:43:29.217906] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-13T19:43:29.644567] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T19:43:30.017979] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-13T19:43:30.469375] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:43:30.817909] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-13T19:43:31.435685] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-13T19:43:31.617969] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-13T19:43:32.417989] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-13T19:43:32.993371] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:43:33.013882] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:43:33.217978] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-13T19:43:34.017980] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-13T19:43:34.628909] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T19:43:34.650262] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T19:43:34.817942] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-13T19:43:35.387307] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T19:43:35.617904] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-13T19:43:36.417968] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-13T19:43:36.887228] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T19:43:36.888019] [INFO ] [REMOTE ] JMM: Full fetch complete (2303 records). [2025-10-13T19:43:36.888088] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-13T19:43:37.078121] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-13T19:43:37.078496] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:43:37.078712] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:43:37.078796] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-13T19:43:37.085879] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-13T19:43:37.096810] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-13T19:43:37.096971] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-13T19:43:37.097101] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 15.0s. Estimated remaining: 2h 50m 28s. Rate: 7.1 symbols/min [2025-10-13T19:43:37.133872] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:43:37.222991] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-13T19:43:37.284157] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:37.338044] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-13T19:43:37.338436] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-10-13T19:43:37.523043] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:37.523259] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-13T19:43:37.523305] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-13T19:43:37.524436] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-13T19:43:37.524494] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-13T19:43:37.880735] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:38.017965] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-13T19:43:38.637397] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:43:38.697386] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:43:38.817941] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-13T19:43:39.392939] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:43:39.617904] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-13T19:43:40.417987] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-13T19:43:41.069156] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T19:43:41.070320] [INFO ] [REMOTE ] JLS: Full fetch complete (5841 records). [2025-10-13T19:43:41.070392] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-13T19:43:41.223213] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-13T19:43:41.471549] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-13T19:43:41.471820] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-13T19:43:41.472014] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-13T19:43:41.472092] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-13T19:43:41.472775] [DEBUG] [LOCAL ] JLS: Trimmed 5841 records to 4178 (keeping 200 days of data) [2025-10-13T19:43:41.520430] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:43:41.525451] [DEBUG] [LOCAL ] JLS: Primary data saved (4178 records). [2025-10-13T19:43:41.534942] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-13T19:43:41.535076] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 19.5s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-13T19:43:41.711829] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:41.769359] [DEBUG] [LOCAL ] JOBY: Loaded 54581 existing records from primary storage. [2025-10-13T19:43:41.769838] [INFO ] [MAIN ] JOBY: Loaded 54581 existing records. [2025-10-13T19:43:41.960567] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:41.960924] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-13T19:43:41.960986] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-13T19:43:41.961921] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-13T19:43:41.961989] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-13T19:43:42.026758] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-13T19:43:42.330992] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:42.402375] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:43:42.817948] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-13T19:43:43.617992] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-13T19:43:43.717809] [DEBUG] [REMOTE ] JMIA: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-13T19:43:43.718156] [WARN ] [REMOTE ] JMIA: No data returned for month 2025-03 [2025-10-13T19:43:43.718249] [FATAL] [REMOTE ] JMIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:43:43.718329] [FATAL] [MAIN ] JMIA: Failed to fetch primary data. [2025-10-13T19:43:43.718367] [WARN ] [MAIN ] JMIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:43:43.718441] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-13T19:43:43.718516] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-10-13T19:43:43.718556] [INFO ] [LOCAL ] JMIA: Starting deletion of derivative data. [2025-10-13T19:43:43.718833] [DEBUG] [LOCAL ] JMIA: Deleted derivative data file. [2025-10-13T19:43:43.718968] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 21.7s. Estimated remaining: 2h 50m 0s. Rate: 7.1 symbols/min [2025-10-13T19:43:43.925284] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:43.950468] [DEBUG] [LOCAL ] JOE: Loaded 24247 existing records from primary storage. [2025-10-13T19:43:43.950838] [INFO ] [MAIN ] JOE: Loaded 24247 existing records. [2025-10-13T19:43:44.141247] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:44.141726] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-13T19:43:44.141791] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-13T19:43:44.142810] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-13T19:43:44.142893] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-13T19:43:44.421225] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-13T19:43:44.539768] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:44.573269] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-13T19:43:45.217904] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-13T19:43:45.337139] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-13T19:43:45.983497] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:43:46.017881] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-13T19:43:46.817972] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-13T19:43:47.279249] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T19:43:47.452300] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T19:43:47.617940] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-13T19:43:48.417944] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-13T19:43:48.959345] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:43:48.962522] [INFO ] [REMOTE ] JLL: Full fetch complete (44751 records). [2025-10-13T19:43:48.962663] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-13T19:43:49.227484] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-13T19:43:49.377911] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-13T19:43:49.378066] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-13T19:43:49.379492] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-13T19:43:49.379580] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-13T19:43:49.381923] [DEBUG] [LOCAL ] JLL: Trimmed 44751 records to 31667 (keeping 200 days of data) [2025-10-13T19:43:49.503965] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-13T19:43:49.628096] [DEBUG] [LOCAL ] JLL: Primary data saved (31667 records). [2025-10-13T19:43:49.628283] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-13T19:43:49.628456] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JLL took 27.5s. Estimated remaining: 2h 49m 49s. Rate: 7.1 symbols/min [2025-10-13T19:43:49.792599] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:49.800384] [DEBUG] [LOCAL ] JOF: Loaded 6991 existing records from primary storage. [2025-10-13T19:43:49.800555] [INFO ] [MAIN ] JOF: Loaded 6991 existing records. [2025-10-13T19:43:49.972511] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:49.972708] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-13T19:43:49.972763] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-13T19:43:49.973094] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-13T19:43:49.973151] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-13T19:43:50.027722] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-13T19:43:50.348841] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:50.479262] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:43:50.515064] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:43:50.818008] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-13T19:43:51.617931] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-13T19:43:52.002801] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:43:52.212291] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:43:52.417981] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-13T19:43:52.465546] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-13T19:43:53.217982] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-13T19:43:53.559905] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:43:54.017985] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-13T19:43:54.817961] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-13T19:43:55.275991] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:43:55.391689] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T19:43:55.617910] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-13T19:43:55.691952] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-13T19:43:56.417972] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-13T19:43:57.217903] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-13T19:43:57.767037] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-13T19:43:58.017944] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-13T19:43:58.548283] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T19:43:58.817900] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-13T19:43:58.920613] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-13T19:43:59.617891] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-13T19:43:59.955805] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:44:00.372127] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T19:44:00.417894] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-13T19:44:01.217945] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-13T19:44:02.017987] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-13T19:44:02.034048] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:44:02.439549] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-13T19:44:02.650261] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:44:02.819337] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T19:44:02.819486] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-13T19:44:03.617963] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-13T19:44:04.322959] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:44:04.417972] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-13T19:44:05.217983] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-13T19:44:05.302173] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-13T19:44:05.550361] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:44:05.663434] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:44:06.017996] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-13T19:44:06.625601] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:44:06.817900] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-13T19:44:07.397200] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T19:44:07.617879] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-13T19:44:08.292905] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T19:44:08.417942] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-13T19:44:09.217906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-13T19:44:09.483874] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:44:10.017992] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-13T19:44:10.817914] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-13T19:44:10.982073] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T19:44:11.246729] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T19:44:11.329410] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T19:44:11.617994] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-13T19:44:12.388396] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:44:12.417952] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-13T19:44:13.075988] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:44:13.077318] [INFO ] [REMOTE ] JOF: Full fetch complete (9546 records). [2025-10-13T19:44:13.077387] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-13T19:44:13.223115] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-13T19:44:13.496986] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-13T19:44:13.497064] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-13T19:44:13.497297] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-13T19:44:13.497385] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-13T19:44:13.497853] [DEBUG] [LOCAL ] JOF: Trimmed 9546 records to 6875 (keeping 200 days of data) [2025-10-13T19:44:13.539595] [DEBUG] [LOCAL ] JOF: Primary data saved (6875 records). [2025-10-13T19:44:13.539749] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-13T19:44:13.539855] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOF took 23.9s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-13T19:44:13.704392] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:13.737780] [DEBUG] [LOCAL ] JPC: Loaded 37827 existing records from primary storage. [2025-10-13T19:44:13.738133] [INFO ] [MAIN ] JPC: Loaded 37827 existing records. [2025-10-13T19:44:13.913923] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:13.914134] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-13T19:44:13.914179] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-13T19:44:13.914904] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-13T19:44:13.914961] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-13T19:44:14.023064] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-13T19:44:14.265431] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:14.362098] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T19:44:14.364848] [INFO ] [REMOTE ] JOE: Full fetch complete (35648 records). [2025-10-13T19:44:14.364927] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-13T19:44:14.724975] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-13T19:44:14.725057] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-13T19:44:14.725695] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-13T19:44:14.725758] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-13T19:44:14.726593] [DEBUG] [LOCAL ] JOE: Trimmed 35648 records to 23909 (keeping 200 days of data) [2025-10-13T19:44:14.818013] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-13T19:44:14.876394] [DEBUG] [LOCAL ] JOE: Primary data saved (23909 records). [2025-10-13T19:44:14.876526] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-13T19:44:14.876616] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 31.2s. Estimated remaining: 2h 49m 41s. Rate: 7.1 symbols/min [2025-10-13T19:44:15.064754] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:15.121046] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-13T19:44:15.121456] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-10-13T19:44:15.310676] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:15.310910] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-13T19:44:15.310958] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-13T19:44:15.312006] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-13T19:44:15.312064] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-13T19:44:15.630946] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-13T19:44:15.672335] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:16.287145] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T19:44:16.417909] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-13T19:44:16.833246] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-13T19:44:17.218001] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-13T19:44:17.913498] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T19:44:18.018812] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-13T19:44:18.021447] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-13T19:44:18.817906] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-13T19:44:19.617906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-13T19:44:19.734260] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-13T19:44:20.322250] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:44:20.417947] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-13T19:44:20.763097] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-13T19:44:21.217974] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-13T19:44:21.876732] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:44:22.003630] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-13T19:44:22.017888] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-13T19:44:22.817950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-13T19:44:23.377266] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T19:44:23.617946] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-13T19:44:24.339236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-13T19:44:24.418002] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-13T19:44:25.140056] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:44:25.218006] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-13T19:44:25.392381] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-13T19:44:26.018001] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-13T19:44:26.674128] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-13T19:44:26.680338] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-13T19:44:26.680497] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-13T19:44:26.823085] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-13T19:44:27.120770] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-13T19:44:27.121345] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-13T19:44:27.122335] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-13T19:44:27.123301] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T19:44:27.131042] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-13T19:44:27.134332] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-13T19:44:27.392945] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T19:44:27.517017] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-13T19:44:27.517169] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-13T19:44:27.517254] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JNJ took 50.4s. Estimated remaining: 2h 49m 37s. Rate: 7.1 symbols/min [2025-10-13T19:44:27.622991] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-13T19:44:27.686971] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:27.719182] [DEBUG] [LOCAL ] JQC: Loaded 34731 existing records from primary storage. [2025-10-13T19:44:27.719487] [INFO ] [MAIN ] JQC: Loaded 34731 existing records. [2025-10-13T19:44:27.906519] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:27.906729] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-13T19:44:27.906784] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-13T19:44:27.907537] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-13T19:44:27.907596] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-13T19:44:28.267058] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:28.417963] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-13T19:44:29.134481] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:44:29.209863] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T19:44:29.217878] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-13T19:44:29.565377] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-13T19:44:29.570739] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-13T19:44:29.570844] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-13T19:44:29.955196] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-13T19:44:29.955284] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-13T19:44:29.956224] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-13T19:44:29.956287] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-13T19:44:29.958717] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53803 (keeping 200 days of data) [2025-10-13T19:44:30.042237] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-13T19:44:30.285779] [DEBUG] [LOCAL ] JOBY: Primary data saved (53803 records). [2025-10-13T19:44:30.285910] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-13T19:44:30.286025] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 48.8s. Estimated remaining: 2h 49m 22s. Rate: 7.1 symbols/min [2025-10-13T19:44:30.458041] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:30.473598] [DEBUG] [LOCAL ] JRI: Loaded 15506 existing records from primary storage. [2025-10-13T19:44:30.473875] [INFO ] [MAIN ] JRI: Loaded 15506 existing records. [2025-10-13T19:44:30.654791] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:30.661829] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-13T19:44:30.673928] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-13T19:44:30.675220] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:44:30.675263] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-13T19:44:30.675411] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-13T19:44:30.825614] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-13T19:44:31.051225] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:31.351873] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T19:44:31.617960] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-13T19:44:32.253056] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:44:32.418060] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-13T19:44:32.809892] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T19:44:33.217980] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-13T19:44:33.784142] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:44:34.017943] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-13T19:44:34.292902] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:44:34.818022] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-13T19:44:35.534774] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:44:35.617942] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-13T19:44:36.208772] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:44:36.417957] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-13T19:44:36.654142] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:44:37.218010] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-13T19:44:37.666191] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:44:38.018002] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-13T19:44:38.623271] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:44:38.817975] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-13T19:44:39.178692] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:44:39.617983] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-13T19:44:39.807266] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T19:44:40.417987] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-13T19:44:40.796772] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:44:41.218016] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-13T19:44:41.549818] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T19:44:41.553911] [INFO ] [REMOTE ] JPC: Full fetch complete (55296 records). [2025-10-13T19:44:41.554006] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-13T19:44:41.947873] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-13T19:44:41.947967] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-13T19:44:41.948753] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-13T19:44:41.948813] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-13T19:44:41.950023] [DEBUG] [LOCAL ] JPC: Trimmed 55296 records to 37227 (keeping 200 days of data) [2025-10-13T19:44:42.034438] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-13T19:44:42.172071] [DEBUG] [LOCAL ] JPC: Primary data saved (37227 records). [2025-10-13T19:44:42.172335] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-13T19:44:42.172439] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 28.6s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-13T19:44:42.342488] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:42.353962] [DEBUG] [LOCAL ] JRS: Loaded 11760 existing records from primary storage. [2025-10-13T19:44:42.354214] [INFO ] [MAIN ] JRS: Loaded 11760 existing records. [2025-10-13T19:44:42.536021] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:42.536319] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-13T19:44:42.536396] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-13T19:44:42.536791] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-13T19:44:42.536855] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-13T19:44:42.744208] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:44:42.823250] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-13T19:44:42.943122] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:43.068503] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:44:43.617978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-13T19:44:44.260893] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:44:44.417984] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-13T19:44:44.542954] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T19:44:45.218010] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-13T19:44:45.490053] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:44:45.494207] [INFO ] [REMOTE ] JQC: Full fetch complete (49552 records). [2025-10-13T19:44:45.494295] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-13T19:44:45.914168] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-13T19:44:45.914303] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-13T19:44:45.915543] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-13T19:44:45.915629] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-13T19:44:45.917403] [DEBUG] [LOCAL ] JQC: Trimmed 49552 records to 33961 (keeping 200 days of data) [2025-10-13T19:44:46.024363] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-13T19:44:46.147783] [DEBUG] [LOCAL ] JQC: Primary data saved (33961 records). [2025-10-13T19:44:46.148006] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-13T19:44:46.148118] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 18.6s. Estimated remaining: 2h 49m 5s. Rate: 7.1 symbols/min [2025-10-13T19:44:46.264262] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:44:46.343057] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:46.386759] [DEBUG] [LOCAL ] JXN: Loaded 45676 existing records from primary storage. [2025-10-13T19:44:46.387175] [INFO ] [MAIN ] JXN: Loaded 45676 existing records. [2025-10-13T19:44:46.569291] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:46.569685] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-13T19:44:46.569860] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-13T19:44:46.571008] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-13T19:44:46.571072] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-13T19:44:46.696825] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T19:44:46.823059] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-13T19:44:46.963736] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:47.617942] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-13T19:44:47.853320] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:44:48.418037] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-13T19:44:49.174430] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:44:49.217990] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-13T19:44:50.017950] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-13T19:44:50.093749] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-13T19:44:50.391809] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T19:44:50.817955] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-13T19:44:50.840222] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:44:51.579412] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:44:51.617885] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-13T19:44:52.403008] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T19:44:52.417879] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-13T19:44:53.187797] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T19:44:53.217893] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-13T19:44:54.017944] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-13T19:44:54.083398] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T19:44:54.817982] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-13T19:44:55.596861] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T19:44:55.617912] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-13T19:44:56.417957] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-13T19:44:56.599118] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:44:56.604349] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-13T19:44:57.221323] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-13T19:44:57.217893] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:44:57.985915] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T19:44:58.018025] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-13T19:44:58.817944] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-13T19:44:58.947385] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:44:58.950355] [INFO ] [REMOTE ] JRI: Full fetch complete (23296 records). [2025-10-13T19:44:58.950437] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-13T19:44:59.344828] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-13T19:44:59.344914] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-13T19:44:59.345567] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-13T19:44:59.345610] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-13T19:44:59.346570] [DEBUG] [LOCAL ] JRI: Trimmed 23296 records to 15394 (keeping 200 days of data) [2025-10-13T19:44:59.454141] [DEBUG] [LOCAL ] JRI: Primary data saved (15394 records). [2025-10-13T19:44:59.454541] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-13T19:44:59.454734] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 29.2s. Estimated remaining: 2h 49m 1s. Rate: 7.1 symbols/min [2025-10-13T19:44:59.621629] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-13T19:44:59.644739] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:59.699365] [DEBUG] [LOCAL ] K: Loaded 50837 existing records from primary storage. [2025-10-13T19:44:59.699939] [INFO ] [MAIN ] K: Loaded 50837 existing records. [2025-10-13T19:44:59.911470] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:59.913216] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-13T19:44:59.913019] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:44:59.913452] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-13T19:44:59.918253] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-13T19:44:59.918344] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-13T19:45:00.303137] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:00.417979] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-13T19:45:01.218032] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-13T19:45:02.018006] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-13T19:45:02.091615] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-13T19:45:02.152902] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:45:02.155381] [INFO ] [REMOTE ] JRS: Full fetch complete (16367 records). [2025-10-13T19:45:02.155477] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-13T19:45:02.556562] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-13T19:45:02.595687] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-13T19:45:02.596188] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-13T19:45:02.597209] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-13T19:45:02.597277] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-13T19:45:02.598337] [DEBUG] [LOCAL ] JRS: Trimmed 16367 records to 11663 (keeping 200 days of data) [2025-10-13T19:45:02.675613] [DEBUG] [LOCAL ] JRS: Primary data saved (11663 records). [2025-10-13T19:45:02.675842] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-13T19:45:02.675956] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 20.5s. Estimated remaining: 2h 48m 47s. Rate: 7.1 symbols/min [2025-10-13T19:45:02.824968] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-13T19:45:02.862805] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:02.879403] [DEBUG] [LOCAL ] KAI: Loaded 13601 existing records from primary storage. [2025-10-13T19:45:02.879761] [INFO ] [MAIN ] KAI: Loaded 13601 existing records. [2025-10-13T19:45:03.074155] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:03.074612] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-13T19:45:03.074709] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-13T19:45:03.075255] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-13T19:45:03.075317] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-13T19:45:03.468935] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:03.617957] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-13T19:45:03.881022] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:45:04.363293] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:45:04.417948] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-13T19:45:05.217983] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-13T19:45:06.018060] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-13T19:45:06.086251] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-13T19:45:06.254867] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:45:06.817963] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-13T19:45:06.838699] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:45:06.876678] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T19:45:07.617949] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-13T19:45:08.418004] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-13T19:45:08.998424] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T19:45:09.217914] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-13T19:45:09.285179] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T19:45:09.709904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-13T19:45:10.017914] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-13T19:45:10.238807] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:45:10.817946] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-13T19:45:11.490673] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T19:45:11.617953] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-13T19:45:11.972973] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T19:45:12.418437] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-13T19:45:12.419998] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:45:13.217952] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-13T19:45:14.017909] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-13T19:45:14.176782] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:45:14.802329] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:45:14.817885] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-13T19:45:15.617953] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-13T19:45:16.423813] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-13T19:45:16.429892] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:45:16.543732] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:45:17.217986] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-13T19:45:17.361283] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:45:17.431454] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:45:18.018071] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-13T19:45:18.818039] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-13T19:45:19.567858] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T19:45:19.574107] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-13T19:45:19.574325] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-13T19:45:19.622994] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-13T19:45:19.927983] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:45:19.945077] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T19:45:20.048760] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-13T19:45:20.048890] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-13T19:45:20.050151] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-13T19:45:20.050221] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-13T19:45:20.052081] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-13T19:45:20.418709] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-13T19:45:20.438218] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-13T19:45:20.438574] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-13T19:45:20.438740] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JPM took 1m 6s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-13T19:45:20.617215] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:20.664185] [DEBUG] [LOCAL ] KAR: Loaded 40626 existing records from primary storage. [2025-10-13T19:45:20.664696] [INFO ] [MAIN ] KAR: Loaded 40626 existing records. [2025-10-13T19:45:20.857482] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:20.857860] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-13T19:45:20.857913] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-13T19:45:20.858718] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-13T19:45:20.858778] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-13T19:45:21.226150] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-13T19:45:21.251608] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:21.449742] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:45:21.496959] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T19:45:22.017961] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-13T19:45:22.651323] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:45:22.817957] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-13T19:45:23.617913] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-13T19:45:23.647474] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T19:45:23.711303] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:45:24.417946] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-13T19:45:25.035784] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T19:45:25.217981] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-13T19:45:26.017944] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-13T19:45:26.203541] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:45:26.227375] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T19:45:26.817953] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-13T19:45:27.589679] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:45:27.617886] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-13T19:45:28.330814] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:45:28.417969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-13T19:45:29.156516] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:45:29.217985] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-13T19:45:29.422847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T19:45:29.424785] [INFO ] [REMOTE ] KAI: Full fetch complete (18967 records). [2025-10-13T19:45:29.424858] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-13T19:45:29.851687] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-13T19:45:29.851781] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-13T19:45:29.852287] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-13T19:45:29.852351] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-13T19:45:29.853115] [DEBUG] [LOCAL ] KAI: Trimmed 18967 records to 13493 (keeping 200 days of data) [2025-10-13T19:45:29.944929] [DEBUG] [LOCAL ] KAI: Primary data saved (13493 records). [2025-10-13T19:45:29.945083] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-13T19:45:29.945167] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 27.3s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-13T19:45:30.023028] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-13T19:45:30.117090] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:30.140419] [DEBUG] [LOCAL ] KB: Loaded 23980 existing records from primary storage. [2025-10-13T19:45:30.140707] [INFO ] [MAIN ] KB: Loaded 23980 existing records. [2025-10-13T19:45:30.315790] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:30.316008] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-13T19:45:30.316056] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-13T19:45:30.316369] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-13T19:45:30.316426] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-13T19:45:30.678225] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:30.747482] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T19:45:30.751943] [INFO ] [REMOTE ] JXN: Full fetch complete (65231 records). [2025-10-13T19:45:30.752069] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-13T19:45:30.825419] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-13T19:45:31.133251] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-13T19:45:31.133328] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-13T19:45:31.134174] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-13T19:45:31.134338] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-13T19:45:31.135567] [DEBUG] [LOCAL ] JXN: Trimmed 65231 records to 44862 (keeping 200 days of data) [2025-10-13T19:45:31.383545] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:45:31.442923] [DEBUG] [LOCAL ] JXN: Primary data saved (44862 records). [2025-10-13T19:45:31.443084] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-13T19:45:31.443168] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. JXN took 45.3s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-13T19:45:31.608087] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:31.622320] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-13T19:45:31.633256] [DEBUG] [LOCAL ] KBDC: Loaded 22135 existing records from primary storage. [2025-10-13T19:45:31.633497] [INFO ] [MAIN ] KBDC: Loaded 22135 existing records. [2025-10-13T19:45:31.813112] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:31.813502] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-13T19:45:31.813579] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-13T19:45:31.813899] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-13T19:45:31.814025] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-13T19:45:32.039976] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:45:32.193789] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:32.417957] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-13T19:45:33.217895] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-13T19:45:33.385036] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T19:45:33.458982] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:45:34.017946] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-13T19:45:34.581781] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T19:45:34.737024] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:45:34.817969] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-13T19:45:35.617980] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-13T19:45:35.967285] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:45:36.418029] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-13T19:45:36.858071] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:45:37.218005] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-13T19:45:37.363814] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T19:45:38.017980] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-13T19:45:38.667542] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:45:38.672883] [INFO ] [REMOTE ] K: Full fetch complete (72121 records). [2025-10-13T19:45:38.672985] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-13T19:45:38.832202] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-13T19:45:39.067319] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-13T19:45:39.067399] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-13T19:45:39.068305] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-13T19:45:39.068368] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-13T19:45:39.069714] [DEBUG] [LOCAL ] K: Trimmed 72121 records to 50349 (keeping 200 days of data) [2025-10-13T19:45:39.312833] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T19:45:39.414105] [DEBUG] [LOCAL ] K: Primary data saved (50349 records). [2025-10-13T19:45:39.414238] [INFO ] [MAIN ] K: Full history saved. [2025-10-13T19:45:39.414325] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. K took 40.0s. Estimated remaining: 2h 48m 16s. Rate: 7.1 symbols/min [2025-10-13T19:45:39.609811] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:39.617966] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-13T19:45:39.657061] [DEBUG] [LOCAL ] KBH: Loaded 49611 existing records from primary storage. [2025-10-13T19:45:39.657375] [INFO ] [MAIN ] KBH: Loaded 49611 existing records. [2025-10-13T19:45:39.836717] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:39.836980] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-13T19:45:39.837057] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-13T19:45:39.838016] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-13T19:45:39.838075] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-13T19:45:40.200067] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:40.415828] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:45:40.424128] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-13T19:45:40.894536] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:45:41.217915] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-13T19:45:41.372533] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:45:42.017902] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-13T19:45:42.177030] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:45:42.817990] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-13T19:45:43.116339] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T19:45:43.617904] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-13T19:45:44.084103] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:45:44.418014] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-13T19:45:45.217904] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-13T19:45:45.254546] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:45:45.566207] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:45:46.017909] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-13T19:45:46.076353] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T19:45:46.817970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-13T19:45:47.225796] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:45:47.617983] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-13T19:45:48.418056] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-13T19:45:48.546659] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:45:48.689962] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:45:49.217957] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-13T19:45:49.819302] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T19:45:50.017961] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-13T19:45:50.223382] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:45:50.817978] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-13T19:45:51.423229] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T19:45:51.617903] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-13T19:45:51.779592] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:45:52.417946] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-13T19:45:52.982260] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:45:53.105053] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:45:53.107840] [INFO ] [REMOTE ] KB: Full fetch complete (33622 records). [2025-10-13T19:45:53.108120] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-13T19:45:53.223051] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-13T19:45:53.474594] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-13T19:45:53.474753] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-13T19:45:53.475400] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-13T19:45:53.475464] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-13T19:45:53.476504] [DEBUG] [LOCAL ] KB: Trimmed 33622 records to 23448 (keeping 200 days of data) [2025-10-13T19:45:53.618340] [DEBUG] [LOCAL ] KB: Primary data saved (23448 records). [2025-10-13T19:45:53.618471] [INFO ] [MAIN ] KB: Full history saved. [2025-10-13T19:45:53.618598] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 23.7s. Estimated remaining: 2h 48m 14s. Rate: 7.1 symbols/min [2025-10-13T19:45:53.811816] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:53.865153] [DEBUG] [LOCAL ] KBR: Loaded 48571 existing records from primary storage. [2025-10-13T19:45:53.865529] [INFO ] [MAIN ] KBR: Loaded 48571 existing records. [2025-10-13T19:45:54.020129] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-13T19:45:54.073844] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:54.074321] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-13T19:45:54.074379] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-13T19:45:54.075518] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-13T19:45:54.075588] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-13T19:45:54.446855] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:54.448291] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:45:54.817960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-13T19:45:55.624574] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-13T19:45:55.645037] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:45:55.985480] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:45:56.417969] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-13T19:45:57.213150] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:45:57.222768] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-13T19:45:57.954415] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:45:58.017896] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-13T19:45:58.213004] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:45:58.817947] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-13T19:45:59.304144] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:45:59.617994] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-13T19:46:00.417941] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-13T19:46:00.450609] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T19:46:01.217909] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-13T19:46:01.404565] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:46:01.846401] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:46:01.850203] [INFO ] [REMOTE ] KBDC: Full fetch complete (29905 records). [2025-10-13T19:46:01.850311] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-13T19:46:02.030636] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-13T19:46:02.230284] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-13T19:46:02.230365] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-13T19:46:02.230940] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-13T19:46:02.231007] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-13T19:46:02.231799] [DEBUG] [LOCAL ] KBDC: Trimmed 29905 records to 22026 (keeping 200 days of data) [2025-10-13T19:46:02.369208] [DEBUG] [LOCAL ] KBDC: Primary data saved (22026 records). [2025-10-13T19:46:02.369344] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-13T19:46:02.369469] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 30.9s. Estimated remaining: 2h 48m 6s. Rate: 7.1 symbols/min [2025-10-13T19:46:02.546821] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:02.602610] [DEBUG] [LOCAL ] KD: Loaded 53097 existing records from primary storage. [2025-10-13T19:46:02.602965] [INFO ] [MAIN ] KD: Loaded 53097 existing records. [2025-10-13T19:46:02.806232] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:46:02.809848] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:02.818029] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-13T19:46:02.820080] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-13T19:46:02.820193] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-13T19:46:02.821478] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-13T19:46:02.821569] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-13T19:46:03.189362] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:03.617946] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-13T19:46:03.975145] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T19:46:04.242482] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:46:04.417947] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-13T19:46:05.052864] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:46:05.058004] [INFO ] [REMOTE ] KAR: Full fetch complete (56822 records). [2025-10-13T19:46:05.058128] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-13T19:46:05.224680] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-13T19:46:05.486145] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-13T19:46:05.486230] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-13T19:46:05.487123] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-13T19:46:05.487198] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-13T19:46:05.488724] [DEBUG] [LOCAL ] KAR: Trimmed 56822 records to 40157 (keeping 200 days of data) [2025-10-13T19:46:05.729213] [DEBUG] [LOCAL ] KAR: Primary data saved (40157 records). [2025-10-13T19:46:05.729341] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-13T19:46:05.729417] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KAR took 45.3s. Estimated remaining: 2h 47m 52s. Rate: 7.1 symbols/min [2025-10-13T19:46:05.898243] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:05.904794] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-13T19:46:05.904974] [INFO ] [MAIN ] KEN: Loaded 4721 existing records. [2025-10-13T19:46:06.023073] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-13T19:46:06.081748] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:06.082385] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-13T19:46:06.082437] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-13T19:46:06.082809] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-13T19:46:06.082869] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-13T19:46:06.440782] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:06.503399] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:46:06.622157] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T19:46:06.817958] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-13T19:46:07.617910] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-13T19:46:07.769603] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:46:08.264860] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T19:46:08.417486] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:46:08.426812] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-13T19:46:09.217956] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-13T19:46:10.017902] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-13T19:46:10.234984] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:46:10.590173] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T19:46:10.817904] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-13T19:46:10.922163] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:46:11.338554] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T19:46:11.617970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-13T19:46:12.417954] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-13T19:46:13.217903] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-13T19:46:13.343153] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:46:13.722273] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T19:46:14.017958] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-13T19:46:14.817899] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-13T19:46:15.021930] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:46:15.620237] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-13T19:46:15.625465] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:46:16.277762] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T19:46:16.417944] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-13T19:46:17.217904] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-13T19:46:17.357425] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:46:18.017945] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-13T19:46:18.115886] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:46:18.121605] [INFO ] [REMOTE ] KBH: Full fetch complete (70804 records). [2025-10-13T19:46:18.121766] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-13T19:46:18.422020] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-13T19:46:18.515284] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-13T19:46:18.515375] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-13T19:46:18.516325] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-13T19:46:18.516395] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-13T19:46:18.517855] [DEBUG] [LOCAL ] KBH: Trimmed 70804 records to 48810 (keeping 200 days of data) [2025-10-13T19:46:18.816054] [DEBUG] [LOCAL ] KBH: Primary data saved (48810 records). [2025-10-13T19:46:18.816186] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-13T19:46:18.816269] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBH took 39.4s. Estimated remaining: 2h 47m 48s. Rate: 7.1 symbols/min [2025-10-13T19:46:18.827673] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-13T19:46:18.992139] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:19.022921] [DEBUG] [LOCAL ] KEP: Loaded 31817 existing records from primary storage. [2025-10-13T19:46:19.023315] [INFO ] [MAIN ] KEP: Loaded 31817 existing records. [2025-10-13T19:46:19.180554] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:46:19.272639] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:19.273248] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-13T19:46:19.273377] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-13T19:46:19.274022] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-13T19:46:19.274083] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-13T19:46:19.625371] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-13T19:46:19.631282] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:19.639922] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T19:46:20.418003] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-13T19:46:21.217984] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-13T19:46:21.519140] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:46:21.656854] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T19:46:21.831694] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:46:22.017971] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-13T19:46:22.818011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-13T19:46:23.534734] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:46:23.617878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-13T19:46:24.417894] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-13T19:46:24.547538] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:46:25.175172] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:46:25.180115] [INFO ] [REMOTE ] KBR: Full fetch complete (69786 records). [2025-10-13T19:46:25.180237] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-13T19:46:25.223265] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-13T19:46:25.564219] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-13T19:46:25.564310] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-13T19:46:25.565215] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-13T19:46:25.565278] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-13T19:46:25.566804] [DEBUG] [LOCAL ] KBR: Trimmed 69786 records to 48028 (keeping 200 days of data) [2025-10-13T19:46:25.873198] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:46:25.887537] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T19:46:25.902837] [DEBUG] [LOCAL ] KBR: Primary data saved (48028 records). [2025-10-13T19:46:25.902945] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-13T19:46:25.903041] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBR took 32.3s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-13T19:46:26.017996] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-13T19:46:26.097307] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:26.135313] [DEBUG] [LOCAL ] KEX: Loaded 39119 existing records from primary storage. [2025-10-13T19:46:26.135665] [INFO ] [MAIN ] KEX: Loaded 39119 existing records. [2025-10-13T19:46:26.329625] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:26.329879] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-13T19:46:26.329927] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-13T19:46:26.330628] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-13T19:46:26.330735] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-13T19:46:26.799359] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:26.818018] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-13T19:46:27.508514] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T19:46:27.617964] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-13T19:46:27.750201] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T19:46:28.418033] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-13T19:46:28.766428] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T19:46:29.218004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-13T19:46:30.017971] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-13T19:46:30.339199] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T19:46:30.365739] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:46:30.665693] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T19:46:30.817972] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-13T19:46:31.617947] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-13T19:46:32.417994] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-13T19:46:32.665491] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:46:32.983815] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T19:46:33.184397] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:46:33.217897] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-13T19:46:34.017955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-13T19:46:34.741701] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:46:34.817903] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-13T19:46:35.062263] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:46:35.380023] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T19:46:35.380967] [INFO ] [REMOTE ] KEN: Full fetch complete (5962 records). [2025-10-13T19:46:35.381039] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-13T19:46:35.623176] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-13T19:46:35.739021] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-13T19:46:35.739102] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-13T19:46:35.739270] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-13T19:46:35.739310] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-13T19:46:35.739732] [DEBUG] [LOCAL ] KEN: Trimmed 5962 records to 4698 (keeping 200 days of data) [2025-10-13T19:46:35.767318] [DEBUG] [LOCAL ] KEN: Primary data saved (4698 records). [2025-10-13T19:46:35.767452] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-13T19:46:35.767536] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEN took 30.0s. Estimated remaining: 2h 47m 31s. Rate: 7.1 symbols/min [2025-10-13T19:46:35.937366] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:35.937543] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-13T19:46:35.937586] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-13T19:46:35.937720] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-13T19:46:35.937789] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-13T19:46:35.937832] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-13T19:46:35.937864] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-13T19:46:36.283926] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:36.417941] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-13T19:46:37.021413] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:46:37.218006] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-13T19:46:37.715751] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:46:38.017908] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-13T19:46:38.817908] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-13T19:46:39.044947] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:46:39.439267] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T19:46:39.617955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-13T19:46:40.417994] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-13T19:46:40.579783] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:46:41.072323] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:46:41.217958] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-13T19:46:42.017891] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-13T19:46:42.183871] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:46:42.189573] [INFO ] [REMOTE ] KD: Full fetch complete (75789 records). [2025-10-13T19:46:42.189773] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-13T19:46:42.588103] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-13T19:46:42.588269] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-13T19:46:42.589300] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-13T19:46:42.589401] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-13T19:46:42.591262] [DEBUG] [LOCAL ] KD: Trimmed 75789 records to 52360 (keeping 200 days of data) [2025-10-13T19:46:42.822997] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-13T19:46:42.841460] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:46:42.952279] [DEBUG] [LOCAL ] KD: Primary data saved (52360 records). [2025-10-13T19:46:42.952504] [INFO ] [MAIN ] KD: Full history saved. [2025-10-13T19:46:42.952603] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 40.6s. Estimated remaining: 2h 47m 22s. Rate: 7.1 symbols/min [2025-10-13T19:46:43.122335] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:43.166991] [DEBUG] [LOCAL ] KEYS: Loaded 43794 existing records from primary storage. [2025-10-13T19:46:43.167291] [INFO ] [MAIN ] KEYS: Loaded 43794 existing records. [2025-10-13T19:46:43.347828] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:43.348164] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-13T19:46:43.348210] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-13T19:46:43.348855] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-13T19:46:43.348912] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-13T19:46:43.633266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-13T19:46:43.660499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:46:43.747554] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:44.337172] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:46:44.417883] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-13T19:46:45.217981] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-13T19:46:45.349969] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:46:45.830459] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:46:46.017978] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-13T19:46:46.197570] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:46:46.817911] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-13T19:46:47.473157] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:46:47.617892] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-13T19:46:48.417966] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-13T19:46:48.635984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:46:48.961995] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:46:49.217980] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-13T19:46:49.795417] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:46:50.017900] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-13T19:46:50.329097] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:46:50.817954] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-13T19:46:51.617948] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-13T19:46:51.890372] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T19:46:52.282930] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:46:52.418009] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-13T19:46:53.076968] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:46:53.217950] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-13T19:46:53.678537] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T19:46:53.682474] [INFO ] [REMOTE ] KEP: Full fetch complete (41817 records). [2025-10-13T19:46:53.682564] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-13T19:46:54.023109] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-13T19:46:54.098160] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-13T19:46:54.098262] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-13T19:46:54.099778] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-13T19:46:54.099849] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-13T19:46:54.100955] [DEBUG] [LOCAL ] KEP: Trimmed 41817 records to 31657 (keeping 200 days of data) [2025-10-13T19:46:54.291413] [DEBUG] [LOCAL ] KEP: Primary data saved (31657 records). [2025-10-13T19:46:54.291555] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-13T19:46:54.291660] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 35.5s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-13T19:46:54.469873] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:54.474054] [DEBUG] [LOCAL ] KF: Loaded 2400 existing records from primary storage. [2025-10-13T19:46:54.474207] [INFO ] [MAIN ] KF: Loaded 2400 existing records. [2025-10-13T19:46:54.684716] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:54.684964] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-13T19:46:54.685022] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-13T19:46:54.685246] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-13T19:46:54.685304] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-13T19:46:54.822680] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-13T19:46:55.057799] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T19:46:55.090207] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:55.617972] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-13T19:46:55.675228] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:46:55.975540] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-13T19:46:56.417917] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-13T19:46:56.706772] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T19:46:57.217952] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-13T19:46:58.021691] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-13T19:46:58.032183] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:46:58.811484] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:46:58.815829] [INFO ] [REMOTE ] KEX: Full fetch complete (55812 records). [2025-10-13T19:46:58.815924] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-13T19:46:58.827581] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-13T19:46:59.189485] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-13T19:46:59.189566] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-13T19:46:59.190332] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-13T19:46:59.190395] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-13T19:46:59.191635] [DEBUG] [LOCAL ] KEX: Trimmed 55812 records to 38528 (keeping 200 days of data) [2025-10-13T19:46:59.430341] [DEBUG] [LOCAL ] KEX: Primary data saved (38528 records). [2025-10-13T19:46:59.430612] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-13T19:46:59.430855] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 33.5s. Estimated remaining: 2h 47m 4s. Rate: 7.1 symbols/min [2025-10-13T19:46:59.626098] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:59.623552] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-13T19:46:59.669487] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:46:59.697843] [DEBUG] [LOCAL ] KFRC: Loaded 20385 existing records from primary storage. [2025-10-13T19:46:59.698139] [INFO ] [MAIN ] KFRC: Loaded 20385 existing records. [2025-10-13T19:46:59.876176] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:59.876391] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-13T19:46:59.876440] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-13T19:46:59.876932] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-13T19:46:59.876992] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-13T19:47:00.167152] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T19:47:00.242131] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:00.417955] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-13T19:47:00.635161] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:47:00.958852] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:47:01.217946] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-13T19:47:02.017977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-13T19:47:02.817956] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-13T19:47:03.276475] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T19:47:03.618038] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-13T19:47:03.708242] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:47:03.748011] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T19:47:04.083135] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T19:47:04.417989] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-13T19:47:04.932450] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-13T19:47:05.217977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-13T19:47:06.017982] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-13T19:47:06.762356] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T19:47:06.806570] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:47:06.817884] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-13T19:47:07.617983] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-13T19:47:08.299707] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:47:08.417896] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-13T19:47:08.491145] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T19:47:09.217947] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-13T19:47:10.017902] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-13T19:47:10.289749] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:47:10.727858] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:47:10.817977] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-13T19:47:10.935808] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T19:47:11.373597] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T19:47:11.617950] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-13T19:47:12.417986] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-13T19:47:12.663377] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:47:12.922663] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-13T19:47:13.217913] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-13T19:47:13.660869] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T19:47:14.017946] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-13T19:47:14.463500] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:47:14.817949] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-13T19:47:15.617947] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-13T19:47:16.079308] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T19:47:16.080151] [INFO ] [REMOTE ] KF: Full fetch complete (3556 records). [2025-10-13T19:47:16.080251] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-13T19:47:16.418273] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-13T19:47:16.450209] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-13T19:47:16.450348] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-13T19:47:16.450503] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-13T19:47:16.450575] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-13T19:47:16.451434] [DEBUG] [LOCAL ] KF: Trimmed 3556 records to 2335 (keeping 200 days of data) [2025-10-13T19:47:16.465901] [DEBUG] [LOCAL ] KF: Primary data saved (2335 records). [2025-10-13T19:47:16.465981] [INFO ] [MAIN ] KF: Full history saved. [2025-10-13T19:47:16.466060] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 22.2s. Estimated remaining: 2h 47m 5s. Rate: 7.1 symbols/min [2025-10-13T19:47:16.681751] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:16.684848] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:47:16.705872] [DEBUG] [LOCAL ] KFS: Loaded 8671 existing records from primary storage. [2025-10-13T19:47:16.706103] [INFO ] [MAIN ] KFS: Loaded 8671 existing records. [2025-10-13T19:47:16.885196] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:16.885430] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-13T19:47:16.885478] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-13T19:47:16.885811] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-13T19:47:16.885869] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-13T19:47:17.219045] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-13T19:47:17.242176] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:17.522201] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T19:47:18.017914] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-13T19:47:18.655783] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:47:18.817897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-13T19:47:19.044022] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:47:19.049586] [INFO ] [REMOTE ] KEY: Full fetch complete (77258 records). [2025-10-13T19:47:19.049763] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-13T19:47:19.251157] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T19:47:19.251928] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:47:19.251998] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:47:19.252048] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-13T19:47:19.252117] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-13T19:47:19.252171] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-13T19:47:19.252228] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-13T19:47:19.252310] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEY took 43.5s. Estimated remaining: 2h 46m 50s. Rate: 7.1 symbols/min [2025-10-13T19:47:19.425053] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:19.455577] [DEBUG] [LOCAL ] KFY: Loaded 30330 existing records from primary storage. [2025-10-13T19:47:19.455905] [INFO ] [MAIN ] KFY: Loaded 30330 existing records. [2025-10-13T19:47:19.623480] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-13T19:47:19.654229] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:19.654798] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-13T19:47:19.655015] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-13T19:47:19.655753] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-13T19:47:19.655812] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-13T19:47:20.022493] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T19:47:20.186398] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:20.289577] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:47:20.417985] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-13T19:47:21.217956] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-13T19:47:21.982620] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:47:22.017887] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-13T19:47:22.228226] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:47:22.817998] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-13T19:47:23.189080] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T19:47:23.618966] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-13T19:47:23.624790] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:47:24.417982] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-13T19:47:24.946155] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:47:25.217978] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-13T19:47:25.506476] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:47:25.832218] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:47:26.017967] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-13T19:47:26.817992] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-13T19:47:27.571334] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:47:27.576137] [INFO ] [REMOTE ] KEYS: Full fetch complete (62660 records). [2025-10-13T19:47:27.576290] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-13T19:47:27.620206] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-13T19:47:27.965086] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-13T19:47:27.965236] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-13T19:47:27.966101] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-13T19:47:27.966163] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-13T19:47:27.967368] [DEBUG] [LOCAL ] KEYS: Trimmed 62660 records to 43256 (keeping 200 days of data) [2025-10-13T19:47:28.092803] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:47:28.257112] [DEBUG] [LOCAL ] KEYS: Primary data saved (43256 records). [2025-10-13T19:47:28.257248] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-13T19:47:28.257325] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 45.3s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-13T19:47:28.426500] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:28.426597] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-13T19:47:28.446429] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T19:47:28.488405] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-13T19:47:28.488757] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-10-13T19:47:28.660097] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:28.660320] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-13T19:47:28.660374] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-13T19:47:28.660875] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-13T19:47:28.660932] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-13T19:47:29.005827] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:29.217902] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-13T19:47:29.510073] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T19:47:30.017946] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-13T19:47:30.817904] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-13T19:47:31.087050] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T19:47:31.147940] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T19:47:31.578712] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:47:31.617883] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-13T19:47:32.363805] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:47:32.417883] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-13T19:47:33.190631] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:47:33.217880] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-13T19:47:34.008234] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:47:34.017873] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-13T19:47:34.757040] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T19:47:34.817973] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-13T19:47:35.617897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-13T19:47:35.942347] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T19:47:36.417984] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-13T19:47:36.853851] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T19:47:36.856964] [INFO ] [REMOTE ] KFRC: Full fetch complete (26295 records). [2025-10-13T19:47:36.857088] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-13T19:47:37.223455] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-13T19:47:37.224147] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-13T19:47:37.224228] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-13T19:47:37.225599] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-13T19:47:37.225687] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-13T19:47:37.226516] [DEBUG] [LOCAL ] KFRC: Trimmed 26295 records to 20312 (keeping 200 days of data) [2025-10-13T19:47:37.351212] [DEBUG] [LOCAL ] KFRC: Primary data saved (20312 records). [2025-10-13T19:47:37.351339] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-13T19:47:37.351414] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFRC took 37.9s. Estimated remaining: 2h 46m 35s. Rate: 7.1 symbols/min [2025-10-13T19:47:37.522789] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:37.563888] [DEBUG] [LOCAL ] KGS: Loaded 46609 existing records from primary storage. [2025-10-13T19:47:37.564250] [INFO ] [MAIN ] KGS: Loaded 46609 existing records. [2025-10-13T19:47:37.737297] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:37.737583] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-13T19:47:37.737663] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-13T19:47:37.738600] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-13T19:47:37.738698] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-13T19:47:38.023106] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-13T19:47:38.107217] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:38.272378] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T19:47:38.817911] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-13T19:47:38.895863] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:47:38.910878] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T19:47:38.913866] [INFO ] [REMOTE ] KFS: Full fetch complete (10877 records). [2025-10-13T19:47:38.914120] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-13T19:47:39.269230] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-13T19:47:39.269313] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-13T19:47:39.269611] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-13T19:47:39.269687] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-13T19:47:39.270638] [DEBUG] [LOCAL ] KFS: Trimmed 10877 records to 8662 (keeping 200 days of data) [2025-10-13T19:47:39.319936] [DEBUG] [LOCAL ] KFS: Primary data saved (8662 records). [2025-10-13T19:47:39.320064] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-13T19:47:39.320180] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFS took 22.9s. Estimated remaining: 2h 46m 20s. Rate: 7.1 symbols/min [2025-10-13T19:47:39.483349] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:39.536137] [DEBUG] [LOCAL ] KIM: Loaded 53761 existing records from primary storage. [2025-10-13T19:47:39.536441] [INFO ] [MAIN ] KIM: Loaded 53761 existing records. [2025-10-13T19:47:39.625208] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-13T19:47:39.712957] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:39.713157] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-13T19:47:39.713203] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-13T19:47:39.713691] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-13T19:47:39.713748] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-13T19:47:40.057939] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:40.417905] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-13T19:47:40.748661] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T19:47:41.123285] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:47:41.217918] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-13T19:47:42.017958] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-13T19:47:42.121742] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T19:47:42.353128] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:47:42.817956] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-13T19:47:43.618001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-13T19:47:44.072454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T19:47:44.221682] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:47:44.418010] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-13T19:47:45.003552] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:47:45.218003] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-13T19:47:46.017982] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-13T19:47:46.063895] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T19:47:46.524201] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T19:47:46.817888] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-13T19:47:47.617899] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-13T19:47:47.919708] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:47:47.949029] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:47:48.417955] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-13T19:47:48.996079] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:47:49.217987] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-13T19:47:50.017909] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-13T19:47:50.529154] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T19:47:50.773393] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:47:50.817895] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-13T19:47:51.617903] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-13T19:47:51.729200] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:47:52.304484] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:47:52.417911] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-13T19:47:52.969257] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:47:53.217970] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-13T19:47:54.017982] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-13T19:47:54.201159] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:47:54.817976] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-13T19:47:55.182230] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-13T19:47:55.202411] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T19:47:55.206035] [INFO ] [REMOTE ] KFY: Full fetch complete (43199 records). [2025-10-13T19:47:55.206119] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-13T19:47:55.581092] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-13T19:47:55.581169] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-13T19:47:55.581813] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-13T19:47:55.581874] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-13T19:47:55.582816] [DEBUG] [LOCAL ] KFY: Trimmed 43199 records to 30001 (keeping 200 days of data) [2025-10-13T19:47:55.636202] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-13T19:47:55.768485] [DEBUG] [LOCAL ] KFY: Primary data saved (30001 records). [2025-10-13T19:47:55.768628] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-13T19:47:55.768784] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 36.5s. Estimated remaining: 2h 46m 19s. Rate: 7.1 symbols/min [2025-10-13T19:47:55.936123] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:55.957262] [DEBUG] [LOCAL ] KIO: Loaded 21860 existing records from primary storage. [2025-10-13T19:47:55.957507] [INFO ] [MAIN ] KIO: Loaded 21860 existing records. [2025-10-13T19:47:56.167815] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:56.168147] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-13T19:47:56.168198] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-13T19:47:56.168865] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-13T19:47:56.168926] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-13T19:47:56.425459] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-13T19:47:56.538599] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:56.570597] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:47:57.217946] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-13T19:47:57.807456] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T19:47:57.871407] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:47:58.017959] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-13T19:47:58.766259] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:47:58.817890] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-13T19:47:59.617950] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-13T19:47:59.819980] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:48:00.232976] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:48:00.283139] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T19:48:00.417941] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-13T19:48:01.217960] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-13T19:48:02.017994] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-13T19:48:02.596424] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T19:48:02.817917] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-13T19:48:02.974346] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:48:03.608954] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:48:03.618918] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-13T19:48:04.417895] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-13T19:48:04.721822] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:48:04.823330] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T19:48:05.217972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-13T19:48:06.017959] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-13T19:48:06.277474] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T19:48:06.303629] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T19:48:06.817949] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-13T19:48:07.617909] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-13T19:48:07.664583] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:48:08.158393] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T19:48:08.417959] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-13T19:48:09.217901] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-13T19:48:09.547598] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T19:48:09.867407] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-13T19:48:09.872879] [INFO ] [REMOTE ] KGC: Full fetch complete (77702 records). [2025-10-13T19:48:09.873005] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-13T19:48:10.025398] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-13T19:48:10.279521] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-13T19:48:10.279601] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-13T19:48:10.280521] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-13T19:48:10.280583] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-13T19:48:10.282663] [DEBUG] [LOCAL ] KGC: Trimmed 77702 records to 53700 (keeping 200 days of data) [2025-10-13T19:48:10.616095] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-13T19:48:10.616249] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-13T19:48:10.616387] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 42.4s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-13T19:48:10.794080] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:10.822287] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-13T19:48:10.846062] [DEBUG] [LOCAL ] KKR: Loaded 54282 existing records from primary storage. [2025-10-13T19:48:10.846379] [INFO ] [MAIN ] KKR: Loaded 54282 existing records. [2025-10-13T19:48:11.036690] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:11.048368] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-13T19:48:11.066187] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-13T19:48:11.068372] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:48:11.068429] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-13T19:48:11.079395] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-13T19:48:11.275074] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:48:11.497498] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:11.617914] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-13T19:48:12.418199] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-13T19:48:12.422790] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T19:48:12.538039] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:48:13.218079] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-13T19:48:14.018054] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-13T19:48:14.174381] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:48:14.186743] [INFO ] [REMOTE ] KIM: Full fetch complete (76793 records). [2025-10-13T19:48:14.191677] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-13T19:48:14.192080] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T19:48:14.620571] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-13T19:48:14.620697] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-13T19:48:14.621675] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-13T19:48:14.621737] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-13T19:48:14.623226] [DEBUG] [LOCAL ] KIM: Trimmed 76793 records to 52996 (keeping 200 days of data) [2025-10-13T19:48:14.837393] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-13T19:48:14.957672] [DEBUG] [LOCAL ] KIM: Primary data saved (52996 records). [2025-10-13T19:48:14.957830] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-13T19:48:14.957915] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 35.6s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-13T19:48:15.127468] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:15.134909] [DEBUG] [LOCAL ] KKRS: Loaded 5772 existing records from primary storage. [2025-10-13T19:48:15.135591] [INFO ] [MAIN ] KKRS: Loaded 5772 existing records. [2025-10-13T19:48:15.327245] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:15.327484] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-13T19:48:15.327534] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-13T19:48:15.327745] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-13T19:48:15.327803] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-13T19:48:15.622998] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-13T19:48:15.670213] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:48:15.721500] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:15.723211] [INFO ] [REMOTE ] KGS: Full fetch complete (66412 records). [2025-10-13T19:48:15.723451] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-13T19:48:15.790073] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T19:48:16.166838] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-13T19:48:16.166924] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-13T19:48:16.167805] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-13T19:48:16.167867] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-13T19:48:16.169539] [DEBUG] [LOCAL ] KGS: Trimmed 66412 records to 46095 (keeping 200 days of data) [2025-10-13T19:48:16.428495] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-13T19:48:16.450836] [DEBUG] [LOCAL ] KGS: Primary data saved (46095 records). [2025-10-13T19:48:16.450929] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-13T19:48:16.451005] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KGS took 39.1s. Estimated remaining: 2h 45m 49s. Rate: 7.1 symbols/min [2025-10-13T19:48:16.624277] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:16.624444] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-13T19:48:16.624484] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-13T19:48:16.624598] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-13T19:48:16.624663] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-13T19:48:16.624733] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-13T19:48:16.624792] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-13T19:48:16.980110] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:17.217987] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-13T19:48:17.415599] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:48:17.416147] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-13T19:48:17.416245] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:48:17.416325] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-13T19:48:17.416404] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:48:17.416499] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-13T19:48:17.416595] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-13T19:48:17.416635] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-13T19:48:17.416731] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-13T19:48:17.416839] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 1.0s. Estimated remaining: 2h 45m 33s. Rate: 7.1 symbols/min [2025-10-13T19:48:17.618601] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:17.618850] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-13T19:48:17.618930] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-13T19:48:17.619179] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-13T19:48:17.619280] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-13T19:48:17.619507] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-13T19:48:17.619583] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-13T19:48:17.896187] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T19:48:18.001151] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-13T19:48:18.021047] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-13T19:48:18.066523] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:18.818001] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-13T19:48:19.019856] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:48:19.020261] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-13T19:48:19.020359] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:48:19.020418] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-13T19:48:19.020477] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:48:19.020550] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-13T19:48:19.020618] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-13T19:48:19.020689] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-13T19:48:19.020751] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-13T19:48:19.020806] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 1.6s. Estimated remaining: 2h 45m 18s. Rate: 7.1 symbols/min [2025-10-13T19:48:19.222929] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:19.239842] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:48:19.281825] [DEBUG] [LOCAL ] KLC: Loaded 37317 existing records from primary storage. [2025-10-13T19:48:19.282259] [INFO ] [MAIN ] KLC: Loaded 37317 existing records. [2025-10-13T19:48:19.476305] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:19.476612] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-13T19:48:19.476696] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-13T19:48:19.477155] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-13T19:48:19.477223] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-13T19:48:19.627197] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-13T19:48:19.864778] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:20.417903] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-13T19:48:20.428056] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:48:21.217998] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-13T19:48:21.868421] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:48:22.017963] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-13T19:48:22.347117] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T19:48:22.350022] [INFO ] [REMOTE ] KIO: Full fetch complete (31676 records). [2025-10-13T19:48:22.350095] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-13T19:48:22.711377] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-13T19:48:22.711461] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-13T19:48:22.712034] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-13T19:48:22.712094] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-13T19:48:22.712806] [DEBUG] [LOCAL ] KIO: Trimmed 31676 records to 21587 (keeping 200 days of data) [2025-10-13T19:48:22.818005] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-13T19:48:22.849865] [DEBUG] [LOCAL ] KIO: Primary data saved (21587 records). [2025-10-13T19:48:22.849998] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-13T19:48:22.850077] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KIO took 27.1s. Estimated remaining: 2h 45m 5s. Rate: 7.1 symbols/min [2025-10-13T19:48:23.253055] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T19:48:23.617984] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-13T19:48:24.156398] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T19:48:24.417982] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-13T19:48:24.597997] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:48:25.014514] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:48:25.218010] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-13T19:48:25.736483] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T19:48:26.017951] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-13T19:48:26.808064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T19:48:26.817870] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-13T19:48:27.525876] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:48:27.617981] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-13T19:48:28.417943] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-13T19:48:28.684483] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:48:29.062633] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T19:48:29.217985] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-13T19:48:30.017917] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-13T19:48:30.817982] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-13T19:48:30.936114] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:48:31.405434] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T19:48:31.551101] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T19:48:31.617965] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-13T19:48:32.417952] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-13T19:48:33.031213] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T19:48:33.035419] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:48:33.217954] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-13T19:48:34.018014] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-13T19:48:34.611873] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T19:48:34.709084] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:48:34.817983] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-13T19:48:35.617958] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-13T19:48:36.418000] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-13T19:48:36.783332] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:48:36.918935] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:48:37.041376] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T19:48:37.042603] [INFO ] [REMOTE ] KKRS: Full fetch complete (7721 records). [2025-10-13T19:48:37.042709] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-13T19:48:37.223460] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-13T19:48:37.428826] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-13T19:48:37.428951] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-13T19:48:37.429450] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-13T19:48:37.429525] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-13T19:48:37.430069] [DEBUG] [LOCAL ] KKRS: Trimmed 7721 records to 5732 (keeping 200 days of data) [2025-10-13T19:48:37.469550] [DEBUG] [LOCAL ] KKRS: Primary data saved (5732 records). [2025-10-13T19:48:37.469766] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-13T19:48:37.469929] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRS took 22.5s. Estimated remaining: 2h 45m 3s. Rate: 7.1 symbols/min [2025-10-13T19:48:38.018046] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-13T19:48:38.623950] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:48:38.817911] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-13T19:48:40.155137] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T19:48:40.166632] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-13T19:48:40.374481] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:48:40.417962] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-13T19:48:41.890417] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:48:41.899221] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-13T19:48:42.000108] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T19:48:42.018029] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-13T19:48:43.312556] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:48:43.316636] [INFO ] [REMOTE ] KLC: Full fetch complete (50450 records). [2025-10-13T19:48:43.316754] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-13T19:48:43.703793] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-13T19:48:43.703895] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-13T19:48:43.704616] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-13T19:48:43.704820] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-13T19:48:43.706029] [DEBUG] [LOCAL ] KLC: Trimmed 50450 records to 36593 (keeping 200 days of data) [2025-10-13T19:48:43.931187] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:48:43.954024] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-13T19:48:43.964484] [DEBUG] [LOCAL ] KLC: Primary data saved (36593 records). [2025-10-13T19:48:43.964576] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-13T19:48:43.964673] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 24.9s. Estimated remaining: 2h 44m 53s. Rate: 7.1 symbols/min [2025-10-13T19:48:46.118748] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T19:48:46.131753] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-13T19:48:47.966840] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:48:47.979358] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-13T19:48:49.836417] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:48:49.848899] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-13T19:48:51.660725] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T19:48:51.666592] [INFO ] [REMOTE ] KKR: Full fetch complete (77455 records). [2025-10-13T19:48:51.666749] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-13T19:48:52.053345] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-13T19:48:52.053427] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-13T19:48:52.054354] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-13T19:48:52.054418] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-13T19:48:52.055864] [DEBUG] [LOCAL ] KKR: Trimmed 77455 records to 53503 (keeping 200 days of data) [2025-10-13T19:48:52.390135] [DEBUG] [LOCAL ] KKR: Primary data saved (53503 records). [2025-10-13T19:48:52.390280] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-13T19:48:52.390365] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KKR took 41.8s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-10-13T19:48:53.057694] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.036995] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.110516] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.142853] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.153000] [DEBUG] [LOCAL ] KMPB: Loaded 3854 existing records from primary storage. [2025-10-13T19:48:53.153569] [INFO ] [MAIN ] KMPB: Loaded 3854 existing records. [2025-10-13T19:48:53.415039] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:53.405543] [DEBUG] [LOCAL ] KMT: Loaded 43511 existing records from primary storage. [2025-10-13T19:48:53.417442] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-13T19:48:53.417038] [DEBUG] [LOCAL ] KMPR: Loaded 40015 existing records from primary storage. [2025-10-13T19:48:53.432922] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-13T19:48:53.433469] [INFO ] [MAIN ] KMT: Loaded 43511 existing records. [2025-10-13T19:48:53.439891] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-13T19:48:53.440163] [INFO ] [MAIN ] KMPR: Loaded 40015 existing records. [2025-10-13T19:48:53.440261] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-13T19:48:53.513630] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-13T19:48:53.513974] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-10-13T19:48:53.965297] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.081200] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.132917] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.163898] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-13T19:48:54.191624] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.196998] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-13T19:48:54.283285] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-13T19:48:54.294123] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-13T19:48:54.378041] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-13T19:48:54.377915] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.378425] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-13T19:48:54.404506] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.416482] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-13T19:48:54.487095] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-13T19:48:54.501579] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-13T19:48:54.882727] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.027988] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-13T19:48:55.558606] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.601091] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.606589] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-13T19:48:55.592713] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-13T19:48:55.677876] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.678340] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-13T19:48:55.858672] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T19:48:55.860124] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-13T19:48:56.342025] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:48:56.344209] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-13T19:48:56.740094] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T19:48:56.746215] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-13T19:48:56.790066] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T19:48:56.791875] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-13T19:48:56.838924] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:48:56.847837] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-13T19:48:57.374705] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T19:48:57.376530] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-13T19:48:57.704321] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T19:48:57.715731] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-13T19:48:57.732204] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:48:57.738271] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-13T19:48:57.909144] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T19:48:57.910511] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-13T19:48:58.251244] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T19:48:58.261134] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-13T19:48:58.266720] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:48:58.268319] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-13T19:48:58.685055] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:48:58.691134] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-13T19:48:58.898367] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T19:48:58.900169] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-13T19:48:59.376459] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T19:48:59.617941] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-13T19:48:59.718174] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T19:48:59.781031] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:48:59.880448] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T19:49:00.252901] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:49:00.417909] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-13T19:49:01.217999] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-13T19:49:01.786901] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T19:49:01.943140] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:49:02.017919] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-13T19:49:02.817999] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-13T19:49:03.550168] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T19:49:03.617975] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-13T19:49:04.281915] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:49:04.417994] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-13T19:49:05.218016] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-13T19:49:05.594336] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T19:49:05.915280] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:49:05.918479] [INFO ] [REMOTE ] KMPB: Full fetch complete (5052 records). [2025-10-13T19:49:05.920739] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:49:05.921079] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-13T19:49:06.023246] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-13T19:49:06.316690] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-13T19:49:06.316785] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-13T19:49:06.316935] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-13T19:49:06.316973] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-13T19:49:06.317469] [DEBUG] [LOCAL ] KMPB: Trimmed 5052 records to 3733 (keeping 200 days of data) [2025-10-13T19:49:06.342056] [DEBUG] [LOCAL ] KMPB: Primary data saved (3733 records). [2025-10-13T19:49:06.342187] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-13T19:49:06.342270] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 13.9s. Estimated remaining: 2h 44m 41s. Rate: 7.1 symbols/min [2025-10-13T19:49:06.528471] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:06.579400] [DEBUG] [LOCAL ] KMX: Loaded 53995 existing records from primary storage. [2025-10-13T19:49:06.579729] [INFO ] [MAIN ] KMX: Loaded 53995 existing records. [2025-10-13T19:49:06.751939] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:06.752161] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-13T19:49:06.752207] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-13T19:49:06.753101] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-13T19:49:06.753158] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-13T19:49:06.823145] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-13T19:49:07.116376] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:07.583314] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T19:49:07.617902] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-13T19:49:08.275203] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:49:08.417957] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-13T19:49:09.081621] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T19:49:09.217984] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-13T19:49:09.868286] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:49:10.017912] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-13T19:49:10.675241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T19:49:10.817984] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-13T19:49:11.617907] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-13T19:49:11.816071] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:49:12.417912] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-13T19:49:12.767752] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T19:49:12.891674] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T19:49:13.218005] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-13T19:49:13.708858] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:49:14.017971] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-13T19:49:14.817971] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-13T19:49:15.166241] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T19:49:15.617964] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-13T19:49:15.735295] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:49:16.224317] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:49:16.417987] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-13T19:49:17.111000] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:49:17.217894] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-13T19:49:17.962575] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:49:17.968133] [INFO ] [REMOTE ] KMPR: Full fetch complete (52376 records). [2025-10-13T19:49:17.968361] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-13T19:49:18.028046] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-13T19:49:18.377965] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-13T19:49:18.378084] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-13T19:49:18.379161] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-13T19:49:18.379227] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-13T19:49:18.380865] [DEBUG] [LOCAL ] KMPR: Trimmed 52376 records to 39744 (keeping 200 days of data) [2025-10-13T19:49:18.653780] [DEBUG] [LOCAL ] KMPR: Primary data saved (39744 records). [2025-10-13T19:49:18.653985] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-13T19:49:18.654096] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 26.3s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-13T19:49:18.818472] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-13T19:49:18.839819] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:18.871630] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:49:18.917113] [DEBUG] [LOCAL ] KN: Loaded 39166 existing records from primary storage. [2025-10-13T19:49:18.917478] [INFO ] [MAIN ] KN: Loaded 39166 existing records. [2025-10-13T19:49:19.103543] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:19.103861] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-13T19:49:19.103911] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-13T19:49:19.104632] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-13T19:49:19.104732] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-13T19:49:19.480717] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:19.617965] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-13T19:49:19.965278] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:49:20.417968] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-13T19:49:20.807071] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:49:20.843106] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:49:21.218005] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-13T19:49:22.017961] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-13T19:49:22.318417] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T19:49:22.627544] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:49:22.817990] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-13T19:49:23.617991] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-13T19:49:23.820031] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:49:24.417995] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-13T19:49:24.668517] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T19:49:25.138604] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:49:25.218039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-13T19:49:26.017959] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-13T19:49:26.345099] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:49:26.691241] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:49:26.818025] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-13T19:49:27.511401] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:49:27.515961] [INFO ] [REMOTE ] KMT: Full fetch complete (61792 records). [2025-10-13T19:49:27.516149] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-13T19:49:27.623206] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-13T19:49:27.956388] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-13T19:49:27.956773] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-13T19:49:27.957955] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-13T19:49:27.958038] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-13T19:49:27.970749] [DEBUG] [LOCAL ] KMT: Trimmed 61792 records to 42905 (keeping 200 days of data) [2025-10-13T19:49:27.989284] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T19:49:28.278285] [DEBUG] [LOCAL ] KMT: Primary data saved (42905 records). [2025-10-13T19:49:28.278486] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-13T19:49:28.278591] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 35.9s. Estimated remaining: 2h 44m 29s. Rate: 7.1 symbols/min [2025-10-13T19:49:28.427812] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-13T19:49:28.467375] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:28.510850] [DEBUG] [LOCAL ] KNF: Loaded 36854 existing records from primary storage. [2025-10-13T19:49:28.511314] [INFO ] [MAIN ] KNF: Loaded 36854 existing records. [2025-10-13T19:49:28.701268] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:28.701666] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-13T19:49:28.701749] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-13T19:49:28.702574] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-13T19:49:28.702638] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-13T19:49:29.064963] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:29.217917] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-13T19:49:29.395905] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:49:30.022213] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-13T19:49:30.031337] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:49:30.709035] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:49:30.817995] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-13T19:49:31.617911] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-13T19:49:31.951859] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:49:32.266909] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:49:32.417993] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-13T19:49:33.217921] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-13T19:49:33.553267] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T19:49:33.779768] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:49:34.017977] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-13T19:49:34.817908] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-13T19:49:35.132907] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:49:35.455305] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:49:35.617964] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-13T19:49:36.418051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-13T19:49:36.674476] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T19:49:36.680808] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-13T19:49:36.681028] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-13T19:49:37.099797] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-13T19:49:37.099921] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-13T19:49:37.101736] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-13T19:49:37.101809] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-13T19:49:37.103874] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-13T19:49:37.218282] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-13T19:49:37.497174] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:49:37.510338] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-13T19:49:37.511963] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-13T19:49:37.512282] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 45.1s. Estimated remaining: 2h 44m 21s. Rate: 7.1 symbols/min [2025-10-13T19:49:37.693860] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:37.731541] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T19:49:37.752964] [DEBUG] [LOCAL ] KNOP: Loaded 10627 existing records from primary storage. [2025-10-13T19:49:37.753884] [INFO ] [MAIN ] KNOP: Loaded 10627 existing records. [2025-10-13T19:49:37.938392] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:37.938708] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-13T19:49:37.938770] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-13T19:49:37.939147] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-13T19:49:37.939219] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-13T19:49:38.023223] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-13T19:49:38.311632] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:38.584777] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:49:38.823000] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-13T19:49:38.833560] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:49:38.840837] [INFO ] [REMOTE ] KMX: Full fetch complete (76108 records). [2025-10-13T19:49:38.840999] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-13T19:49:39.265221] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-13T19:49:39.265344] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-13T19:49:39.266897] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-13T19:49:39.266987] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-13T19:49:39.269099] [DEBUG] [LOCAL ] KMX: Trimmed 76108 records to 53264 (keeping 200 days of data) [2025-10-13T19:49:39.618015] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-13T19:49:39.625699] [DEBUG] [LOCAL ] KMX: Primary data saved (53264 records). [2025-10-13T19:49:39.625946] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-13T19:49:39.626114] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 33.3s. Estimated remaining: 2h 44m 7s. Rate: 7.1 symbols/min [2025-10-13T19:49:39.810786] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:39.831351] [DEBUG] [LOCAL ] KNSL: Loaded 18641 existing records from primary storage. [2025-10-13T19:49:39.831731] [INFO ] [MAIN ] KNSL: Loaded 18641 existing records. [2025-10-13T19:49:40.026883] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:40.027264] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-13T19:49:40.027479] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-13T19:49:40.028118] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-13T19:49:40.028195] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-13T19:49:40.192115] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:49:40.426736] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-13T19:49:40.472397] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:41.163982] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T19:49:41.186572] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T19:49:41.217897] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-13T19:49:42.017967] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-13T19:49:42.540831] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:49:42.555063] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:49:42.559465] [INFO ] [REMOTE ] KN: Full fetch complete (56436 records). [2025-10-13T19:49:42.559600] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-13T19:49:42.823394] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-13T19:49:42.966311] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-13T19:49:42.966417] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-13T19:49:42.967550] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-13T19:49:42.967630] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-13T19:49:42.969605] [DEBUG] [LOCAL ] KN: Trimmed 56436 records to 38584 (keeping 200 days of data) [2025-10-13T19:49:43.209698] [DEBUG] [LOCAL ] KN: Primary data saved (38584 records). [2025-10-13T19:49:43.209893] [INFO ] [MAIN ] KN: Full history saved. [2025-10-13T19:49:43.210008] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 24.6s. Estimated remaining: 2h 43m 54s. Rate: 7.1 symbols/min [2025-10-13T19:49:43.380953] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:43.428775] [DEBUG] [LOCAL ] KNTK: Loaded 47300 existing records from primary storage. [2025-10-13T19:49:43.429169] [INFO ] [MAIN ] KNTK: Loaded 47300 existing records. [2025-10-13T19:49:43.607211] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:43.607478] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-13T19:49:43.607542] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-13T19:49:43.608200] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-13T19:49:43.608266] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-13T19:49:43.623005] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-13T19:49:43.979185] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:49:44.010800] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:44.418027] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-13T19:49:45.093400] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:49:45.217962] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-13T19:49:46.017950] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-13T19:49:46.048080] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:49:46.817913] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-13T19:49:46.828769] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T19:49:47.130050] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T19:49:47.617950] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-13T19:49:48.240491] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T19:49:48.417961] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-13T19:49:48.436060] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:49:49.217976] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-13T19:49:49.763564] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:49:49.965801] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:49:50.017894] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-13T19:49:50.460889] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T19:49:50.817980] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-13T19:49:51.617985] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-13T19:49:52.155549] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:49:52.417996] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-13T19:49:53.003514] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T19:49:53.217974] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-13T19:49:53.774399] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:49:54.017975] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-13T19:49:54.754276] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T19:49:54.817974] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-13T19:49:55.045744] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:49:55.617961] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-13T19:49:56.423066] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-13T19:49:56.441964] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:49:57.059770] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:49:57.154856] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:49:57.217968] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-13T19:49:58.017971] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-13T19:49:58.675149] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:49:58.682600] [INFO ] [REMOTE ] KNF: Full fetch complete (51069 records). [2025-10-13T19:49:58.682914] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-13T19:49:58.823184] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-13T19:49:59.139396] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-13T19:49:59.139635] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-13T19:49:59.140825] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-13T19:49:59.141033] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-13T19:49:59.147622] [DEBUG] [LOCAL ] KNF: Trimmed 51069 records to 36521 (keeping 200 days of data) [2025-10-13T19:49:59.388611] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:49:59.430220] [DEBUG] [LOCAL ] KNF: Primary data saved (36521 records). [2025-10-13T19:49:59.430434] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-13T19:49:59.430557] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 31.2s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-13T19:49:59.603283] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:59.617942] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-13T19:49:59.663838] [DEBUG] [LOCAL ] KNX: Loaded 53376 existing records from primary storage. [2025-10-13T19:49:59.664306] [INFO ] [MAIN ] KNX: Loaded 53376 existing records. [2025-10-13T19:49:59.852427] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:59.852774] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-13T19:49:59.852832] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-13T19:49:59.853783] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-13T19:49:59.853843] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-13T19:49:59.968931] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T19:50:00.256047] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:00.417977] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-13T19:50:01.217950] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-13T19:50:01.256395] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:50:02.018013] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-13T19:50:02.135139] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:50:02.184125] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:50:02.818035] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-13T19:50:02.883830] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T19:50:03.618039] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-13T19:50:04.417984] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-13T19:50:04.729737] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:50:04.784306] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:50:05.217965] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-13T19:50:06.020595] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-13T19:50:06.027852] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:50:06.372729] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:50:06.817979] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-13T19:50:07.617963] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-13T19:50:07.829556] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:50:08.417976] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-13T19:50:08.477693] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T19:50:08.518105] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:50:09.217965] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-13T19:50:10.017951] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-13T19:50:10.134213] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T19:50:10.137024] [INFO ] [REMOTE ] KNOP: Full fetch complete (14563 records). [2025-10-13T19:50:10.137493] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-13T19:50:10.535823] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T19:50:10.572732] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-13T19:50:10.573370] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-13T19:50:10.574327] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-13T19:50:10.574416] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-13T19:50:10.575463] [DEBUG] [LOCAL ] KNOP: Trimmed 14563 records to 10368 (keeping 200 days of data) [2025-10-13T19:50:10.643909] [DEBUG] [LOCAL ] KNOP: Primary data saved (10368 records). [2025-10-13T19:50:10.644156] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-13T19:50:10.644312] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNOP took 33.1s. Estimated remaining: 2h 43m 47s. Rate: 7.1 symbols/min [2025-10-13T19:50:10.830206] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:10.830537] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-13T19:50:10.826220] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-13T19:50:10.830637] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-13T19:50:10.832456] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-13T19:50:10.832556] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-13T19:50:10.832610] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-13T19:50:10.832688] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-13T19:50:11.211435] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:11.277559] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:50:11.618014] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-13T19:50:12.417986] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-13T19:50:12.489494] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:50:13.217914] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-13T19:50:13.455559] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T19:50:13.479749] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:50:14.017996] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-13T19:50:14.514054] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T19:50:14.521023] [INFO ] [REMOTE ] KNTK: Full fetch complete (65106 records). [2025-10-13T19:50:14.521292] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-13T19:50:14.823166] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-13T19:50:15.067267] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-13T19:50:15.067500] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-13T19:50:15.069758] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-13T19:50:15.069977] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-13T19:50:15.073479] [DEBUG] [LOCAL ] KNTK: Trimmed 65106 records to 46863 (keeping 200 days of data) [2025-10-13T19:50:15.384567] [DEBUG] [LOCAL ] KNTK: Primary data saved (46863 records). [2025-10-13T19:50:15.384727] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-13T19:50:15.384816] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 32.2s. Estimated remaining: 2h 43m 35s. Rate: 7.1 symbols/min [2025-10-13T19:50:15.556094] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:15.594048] [DEBUG] [LOCAL ] KODK: Loaded 44104 existing records from primary storage. [2025-10-13T19:50:15.594337] [INFO ] [MAIN ] KODK: Loaded 44104 existing records. [2025-10-13T19:50:15.625755] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-13T19:50:15.777453] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:15.777706] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-13T19:50:15.777767] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-13T19:50:15.778500] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-13T19:50:15.778557] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-13T19:50:16.147205] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:16.417973] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-13T19:50:16.732722] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-13T19:50:16.795624] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T19:50:16.797831] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T19:50:17.217963] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-13T19:50:18.018045] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-13T19:50:18.098774] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:50:18.818029] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-13T19:50:18.903814] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:50:19.617920] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-13T19:50:20.417998] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-13T19:50:20.560188] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:50:20.600436] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-13T19:50:21.217892] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-13T19:50:21.399769] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T19:50:21.559698] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T19:50:22.017948] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-13T19:50:22.817967] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-13T19:50:23.617996] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-13T19:50:23.702135] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-13T19:50:23.797179] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:50:23.852456] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T19:50:24.417999] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-13T19:50:24.857692] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:50:25.217916] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-13T19:50:25.463863] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:50:26.017919] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-13T19:50:26.817965] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-13T19:50:27.573287] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:50:27.617889] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-13T19:50:27.741958] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-13T19:50:28.417913] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-13T19:50:28.588005] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:50:28.934159] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T19:50:29.217970] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-13T19:50:30.017949] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-13T19:50:30.817964] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-13T19:50:30.882860] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T19:50:30.984141] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T19:50:30.987733] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T19:50:31.002206] [INFO ] [REMOTE ] KNSL: Full fetch complete (26810 records). [2025-10-13T19:50:31.003601] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-13T19:50:31.399370] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-13T19:50:31.399570] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-13T19:50:31.400945] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-13T19:50:31.401014] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-13T19:50:31.402212] [DEBUG] [LOCAL ] KNSL: Trimmed 26810 records to 18409 (keeping 200 days of data) [2025-10-13T19:50:31.521766] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:50:31.535001] [INFO ] [REMOTE ] KNX: Full fetch complete (75928 records). [2025-10-13T19:50:31.535734] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-13T19:50:31.624690] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-13T19:50:31.765234] [DEBUG] [LOCAL ] KNSL: Primary data saved (18409 records). [2025-10-13T19:50:31.819060] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-13T19:50:31.833725] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNSL took 52.2s. Estimated remaining: 2h 43m 34s. Rate: 7.1 symbols/min [2025-10-13T19:50:32.128815] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:32.128933] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-13T19:50:32.129301] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-13T19:50:32.130272] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-13T19:50:32.130355] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-13T19:50:32.132318] [DEBUG] [LOCAL ] KNX: Trimmed 75928 records to 52602 (keeping 200 days of data) [2025-10-13T19:50:32.271001] [DEBUG] [LOCAL ] KOF: Loaded 26841 existing records from primary storage. [2025-10-13T19:50:32.271328] [INFO ] [MAIN ] KOF: Loaded 26841 existing records. [2025-10-13T19:50:32.454885] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-13T19:50:32.564600] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:32.567238] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-13T19:50:32.567830] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-13T19:50:32.569155] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-13T19:50:32.569754] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-13T19:50:33.014060] [DEBUG] [LOCAL ] KNX: Primary data saved (52602 records). [2025-10-13T19:50:33.019003] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:33.019176] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-13T19:50:33.019282] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 33.6s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-13T19:50:33.183922] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:33.200164] [DEBUG] [LOCAL ] KOP: Loaded 17721 existing records from primary storage. [2025-10-13T19:50:33.200395] [INFO ] [MAIN ] KOP: Loaded 17721 existing records. [2025-10-13T19:50:33.231287] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-13T19:50:33.379405] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:33.379619] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-13T19:50:33.379694] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-13T19:50:33.380151] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-13T19:50:33.380209] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-13T19:50:33.734189] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:33.944219] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:50:34.017902] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-13T19:50:34.254084] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-13T19:50:34.379888] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:50:34.818062] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-13T19:50:35.617951] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-13T19:50:35.733373] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:50:35.827205] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T19:50:36.417964] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-13T19:50:37.217920] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-13T19:50:38.018037] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-13T19:50:38.206633] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T19:50:38.350799] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-13T19:50:38.408429] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:50:38.817916] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-13T19:50:39.005525] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:50:39.617914] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-13T19:50:40.142542] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:50:40.418027] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-13T19:50:41.157703] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:50:41.217888] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-13T19:50:41.477028] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T19:50:42.017983] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-13T19:50:42.777798] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:50:42.783817] [INFO ] [REMOTE ] KODK: Full fetch complete (63313 records). [2025-10-13T19:50:42.783966] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-13T19:50:42.825954] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-13T19:50:43.053413] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:50:43.187067] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-13T19:50:43.187151] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-13T19:50:43.188023] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-13T19:50:43.188126] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-13T19:50:43.189410] [DEBUG] [LOCAL ] KODK: Trimmed 63313 records to 43626 (keeping 200 days of data) [2025-10-13T19:50:43.436291] [DEBUG] [LOCAL ] KODK: Primary data saved (43626 records). [2025-10-13T19:50:43.436451] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-13T19:50:43.436548] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 28.1s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-13T19:50:43.604664] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:43.608939] [DEBUG] [LOCAL ] KORE: Loaded 2158 existing records from primary storage. [2025-10-13T19:50:43.609104] [INFO ] [MAIN ] KORE: Loaded 2158 existing records. [2025-10-13T19:50:43.623263] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-13T19:50:43.788351] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:43.788588] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-13T19:50:43.788638] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-13T19:50:43.788873] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-13T19:50:43.788931] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-13T19:50:44.144850] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:44.417947] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-13T19:50:44.986224] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T19:50:45.217910] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-13T19:50:45.394529] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T19:50:45.773298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-13T19:50:46.017977] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-13T19:50:46.334942] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:50:46.817998] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-13T19:50:47.617916] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-13T19:50:47.626768] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:50:48.299302] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-13T19:50:48.417983] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-13T19:50:48.690189] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:50:49.217918] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-13T19:50:50.017980] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-13T19:50:50.195047] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:50:50.583926] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T19:50:50.817898] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-13T19:50:51.240466] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:50:51.514106] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:50:51.519544] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-13T19:50:51.519677] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-13T19:50:51.620013] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-13T19:50:51.716042] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T19:50:51.716799] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:50:51.716870] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:50:51.716945] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-13T19:50:51.717012] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-13T19:50:51.717048] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-13T19:50:51.717087] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-13T19:50:51.717145] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 41.1s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-13T19:50:51.882717] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:51.935216] [DEBUG] [LOCAL ] KOS: Loaded 53851 existing records from primary storage. [2025-10-13T19:50:51.935541] [INFO ] [MAIN ] KOS: Loaded 53851 existing records. [2025-10-13T19:50:52.131935] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:52.132149] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-13T19:50:52.132197] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-13T19:50:52.133929] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-13T19:50:52.133990] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-13T19:50:52.421889] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-13T19:50:52.423721] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:50:52.505674] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:53.217922] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-13T19:50:53.771780] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:50:54.017954] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-13T19:50:54.152554] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:50:54.817942] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-13T19:50:55.617905] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-13T19:50:55.900478] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:50:56.069346] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T19:50:56.417910] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-13T19:50:56.603006] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:50:57.217906] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-13T19:50:57.513677] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T19:50:58.017899] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-13T19:50:58.334298] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T19:50:58.817993] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-13T19:50:59.364683] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:50:59.617899] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-13T19:50:59.737004] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:51:00.052540] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T19:51:00.417972] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-13T19:51:01.217941] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-13T19:51:01.816637] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:51:02.017954] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-13T19:51:02.226451] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:51:02.228902] [INFO ] [REMOTE ] KOP: Full fetch complete (25439 records). [2025-10-13T19:51:02.228978] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-13T19:51:02.503328] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T19:51:02.612434] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-13T19:51:02.612508] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-13T19:51:02.613029] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-13T19:51:02.613091] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-13T19:51:02.613748] [DEBUG] [LOCAL ] KOP: Trimmed 25439 records to 17485 (keeping 200 days of data) [2025-10-13T19:51:02.724639] [DEBUG] [LOCAL ] KOP: Primary data saved (17485 records). [2025-10-13T19:51:02.724830] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-13T19:51:02.724928] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 29.7s. Estimated remaining: 2h 42m 58s. Rate: 7.1 symbols/min [2025-10-13T19:51:02.823148] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-13T19:51:02.904585] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:02.953694] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-13T19:51:02.954015] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-10-13T19:51:03.135237] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:03.135454] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-13T19:51:03.135500] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-13T19:51:03.136420] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-13T19:51:03.136479] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-13T19:51:03.495682] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:03.617908] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-13T19:51:03.718285] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:51:03.721482] [INFO ] [REMOTE ] KOF: Full fetch complete (37625 records). [2025-10-13T19:51:03.721559] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-13T19:51:04.126687] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-13T19:51:04.126774] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-13T19:51:04.127379] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-13T19:51:04.127416] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-13T19:51:04.128346] [DEBUG] [LOCAL ] KOF: Trimmed 37625 records to 26539 (keeping 200 days of data) [2025-10-13T19:51:04.297708] [DEBUG] [LOCAL ] KOF: Primary data saved (26539 records). [2025-10-13T19:51:04.297850] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-13T19:51:04.297961] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 32.5s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-13T19:51:04.422986] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-13T19:51:04.477916] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:04.521985] [DEBUG] [LOCAL ] KRC: Loaded 49050 existing records from primary storage. [2025-10-13T19:51:04.522318] [INFO ] [MAIN ] KRC: Loaded 49050 existing records. [2025-10-13T19:51:04.704025] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:04.704251] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-13T19:51:04.704305] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-13T19:51:04.705260] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-13T19:51:04.705322] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-13T19:51:04.993558] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:51:05.072941] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:05.217905] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-13T19:51:05.380673] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:51:06.017955] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-13T19:51:06.783960] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:51:06.818038] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-13T19:51:07.618027] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-13T19:51:07.903864] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:51:08.417956] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-13T19:51:08.597970] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:51:08.738294] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T19:51:08.840340] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:51:09.217991] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-13T19:51:09.676669] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T19:51:10.017966] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-13T19:51:10.818065] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-13T19:51:11.543480] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:51:11.580969] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:51:11.617917] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-13T19:51:12.418009] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-13T19:51:13.217998] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-13T19:51:13.428105] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:51:14.018001] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-13T19:51:14.252282] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T19:51:14.451680] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T19:51:14.662244] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:51:14.817950] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-13T19:51:15.617922] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-13T19:51:16.417901] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-13T19:51:16.641918] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T19:51:17.217986] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-13T19:51:17.360713] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:51:18.021065] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-13T19:51:18.233093] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:51:18.817896] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-13T19:51:19.274203] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:51:19.411430] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:51:19.617891] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-13T19:51:20.417893] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-13T19:51:20.529967] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:51:21.197225] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:51:21.217880] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-13T19:51:22.017982] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-13T19:51:22.375526] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:51:22.487276] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:51:22.817971] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-13T19:51:23.617897] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-13T19:51:23.902280] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:51:24.251023] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:51:24.252014] [INFO ] [REMOTE ] KORE: Full fetch complete (5590 records). [2025-10-13T19:51:24.252101] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-13T19:51:24.425623] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-13T19:51:24.670712] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-13T19:51:24.670821] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-13T19:51:24.671045] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-13T19:51:24.671774] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-13T19:51:24.673291] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T19:51:24.683877] [DEBUG] [LOCAL ] KORE: Trimmed 5590 records to 2146 (keeping 200 days of data) [2025-10-13T19:51:24.697274] [DEBUG] [LOCAL ] KORE: Primary data saved (2146 records). [2025-10-13T19:51:24.697343] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-13T19:51:24.697431] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 41.3s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-13T19:51:24.872243] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:24.906379] [DEBUG] [LOCAL ] KREF: Loaded 38383 existing records from primary storage. [2025-10-13T19:51:24.906710] [INFO ] [MAIN ] KREF: Loaded 38383 existing records. [2025-10-13T19:51:25.091827] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:25.092051] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-13T19:51:25.092098] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-13T19:51:25.092857] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-13T19:51:25.092916] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-13T19:51:25.223166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-13T19:51:25.474945] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:26.017913] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-13T19:51:26.590306] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T19:51:26.675212] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:51:26.817956] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-13T19:51:27.197074] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T19:51:27.617948] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-13T19:51:28.417899] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-13T19:51:28.683398] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T19:51:29.217892] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-13T19:51:29.389543] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:51:29.801104] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:51:30.018031] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-13T19:51:30.753983] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:51:30.759604] [INFO ] [REMOTE ] KRC: Full fetch complete (69846 records). [2025-10-13T19:51:30.759787] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-13T19:51:30.818677] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-13T19:51:31.214214] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-13T19:51:31.214370] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-13T19:51:31.215513] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-13T19:51:31.215582] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-13T19:51:31.217128] [DEBUG] [LOCAL ] KRC: Trimmed 69846 records to 48286 (keeping 200 days of data) [2025-10-13T19:51:31.522130] [DEBUG] [LOCAL ] KRC: Primary data saved (48286 records). [2025-10-13T19:51:31.522272] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-13T19:51:31.522355] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 27.2s. Estimated remaining: 2h 42m 35s. Rate: 7.1 symbols/min [2025-10-13T19:51:31.619149] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-13T19:51:31.693310] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:31.737375] [DEBUG] [LOCAL ] KRG: Loaded 49891 existing records from primary storage. [2025-10-13T19:51:31.737869] [INFO ] [MAIN ] KRG: Loaded 49891 existing records. [2025-10-13T19:51:31.857905] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:51:31.907515] [INFO ] [REMOTE ] KOS: Full fetch complete (76873 records). [2025-10-13T19:51:31.929134] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-13T19:51:31.956218] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:31.956806] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-13T19:51:31.956862] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-13T19:51:31.989836] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-13T19:51:32.022067] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-13T19:51:32.716128] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:32.740105] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-13T19:51:32.759683] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-13T19:51:32.761395] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-13T19:51:32.762527] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-13T19:51:32.762815] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-13T19:51:32.761163] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:51:32.772077] [DEBUG] [LOCAL ] KOS: Trimmed 76873 records to 53089 (keeping 200 days of data) [2025-10-13T19:51:32.885509] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:51:33.117013] [DEBUG] [LOCAL ] KOS: Primary data saved (53089 records). [2025-10-13T19:51:33.117150] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-13T19:51:33.117234] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KOS took 41.4s. Estimated remaining: 2h 42m 21s. Rate: 7.1 symbols/min [2025-10-13T19:51:33.218914] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-13T19:51:33.290035] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:33.290202] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-13T19:51:33.290240] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-13T19:51:33.290352] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-13T19:51:33.290395] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-13T19:51:33.290447] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-13T19:51:33.290479] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-13T19:51:33.651028] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:34.018006] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-13T19:51:34.393176] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T19:51:34.817986] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-13T19:51:34.871164] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:51:35.118076] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T19:51:35.617958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-13T19:51:36.418011] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-13T19:51:36.457210] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:51:36.615105] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:51:36.615503] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-13T19:51:36.615595] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:51:36.615687] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-13T19:51:36.615754] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:51:36.615828] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-13T19:51:36.615893] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-13T19:51:36.615929] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-13T19:51:36.615966] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-13T19:51:36.616048] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 3.5s. Estimated remaining: 2h 42m 7s. Rate: 7.1 symbols/min [2025-10-13T19:51:36.785038] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:36.810092] [DEBUG] [LOCAL ] KRO: Loaded 26592 existing records from primary storage. [2025-10-13T19:51:36.810390] [INFO ] [MAIN ] KRO: Loaded 26592 existing records. [2025-10-13T19:51:36.995720] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:36.995976] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-13T19:51:36.996023] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-13T19:51:36.996575] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-13T19:51:36.996677] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-13T19:51:37.223098] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-13T19:51:37.402375] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:37.439782] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:51:38.018008] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-13T19:51:38.723450] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:51:38.752121] [INFO ] [REMOTE ] KR: Full fetch complete (77680 records). [2025-10-13T19:51:38.752885] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-13T19:51:38.753696] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:51:38.828209] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-13T19:51:39.149895] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-13T19:51:39.149970] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-13T19:51:39.150890] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-13T19:51:39.150951] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-13T19:51:39.152470] [DEBUG] [LOCAL ] KR: Trimmed 77680 records to 53681 (keeping 200 days of data) [2025-10-13T19:51:39.481110] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-13T19:51:39.481280] [INFO ] [MAIN ] KR: Full history saved. [2025-10-13T19:51:39.481386] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KR took 36.8s. Estimated remaining: 2h 41m 54s. Rate: 7.1 symbols/min [2025-10-13T19:51:39.630175] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-13T19:51:39.663893] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:39.701329] [DEBUG] [LOCAL ] KRP: Loaded 37244 existing records from primary storage. [2025-10-13T19:51:39.701610] [INFO ] [MAIN ] KRP: Loaded 37244 existing records. [2025-10-13T19:51:39.886108] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:39.886494] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-13T19:51:39.886546] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-13T19:51:39.888329] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-13T19:51:39.888399] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-13T19:51:40.265091] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:40.416006] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:51:40.424361] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-13T19:51:40.813815] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:51:41.217956] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-13T19:51:41.950959] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:51:42.017964] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-13T19:51:42.666371] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:51:42.817983] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-13T19:51:43.588053] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:51:43.617882] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-13T19:51:44.306550] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:51:44.417918] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-13T19:51:45.217901] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-13T19:51:45.391911] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:51:45.437711] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:51:46.017946] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-13T19:51:46.531153] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:51:46.817988] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-13T19:51:47.029517] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:51:47.617955] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-13T19:51:48.417922] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-13T19:51:48.488222] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:51:49.168489] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:51:49.217960] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-13T19:51:49.579399] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:51:50.020986] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-13T19:51:50.263529] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:51:50.817948] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-13T19:51:51.368977] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:51:51.617921] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-13T19:51:52.288059] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T19:51:52.419817] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-13T19:51:52.422533] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:51:53.217921] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-13T19:51:53.995610] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:51:54.017913] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-13T19:51:54.818042] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-13T19:51:55.207016] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:51:55.617900] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-13T19:51:56.421010] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-13T19:51:56.422792] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:51:56.560702] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-13T19:51:57.034530] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:51:57.217965] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-13T19:51:57.516856] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:51:58.018000] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-13T19:51:58.817889] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-13T19:51:58.961386] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:51:58.978841] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:51:58.983225] [INFO ] [REMOTE ] KREF: Full fetch complete (52699 records). [2025-10-13T19:51:58.983311] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-13T19:51:59.351381] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-13T19:51:59.351452] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-13T19:51:59.352131] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-13T19:51:59.352191] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-13T19:51:59.353263] [DEBUG] [LOCAL ] KREF: Trimmed 52699 records to 37962 (keeping 200 days of data) [2025-10-13T19:51:59.581748] [DEBUG] [LOCAL ] KREF: Primary data saved (37962 records). [2025-10-13T19:51:59.581884] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-13T19:51:59.581983] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KREF took 34.9s. Estimated remaining: 2h 41m 56s. Rate: 7.1 symbols/min [2025-10-13T19:51:59.624358] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-13T19:51:59.749937] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:59.799748] [DEBUG] [LOCAL ] KSS: Loaded 54376 existing records from primary storage. [2025-10-13T19:51:59.800091] [INFO ] [MAIN ] KSS: Loaded 54376 existing records. [2025-10-13T19:51:59.985116] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:59.985422] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-13T19:51:59.985483] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-13T19:51:59.986616] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-13T19:51:59.986720] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-13T19:52:00.423268] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-13T19:52:00.546766] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:00.597303] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T19:52:01.121238] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:52:01.217958] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-13T19:52:01.603554] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T19:52:02.017963] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-13T19:52:02.817960] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-13T19:52:03.617947] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-13T19:52:03.841805] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-13T19:52:04.006727] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T19:52:04.243730] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:52:04.417975] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-13T19:52:04.931423] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:52:05.217942] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-13T19:52:05.894941] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:52:06.017964] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-13T19:52:06.735189] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:52:06.817969] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-13T19:52:07.532361] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:52:07.537387] [INFO ] [REMOTE ] KRG: Full fetch complete (71128 records). [2025-10-13T19:52:07.537491] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-13T19:52:07.625382] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-13T19:52:07.959777] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-13T19:52:07.959874] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-13T19:52:07.960804] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-13T19:52:07.960893] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-13T19:52:07.962189] [DEBUG] [LOCAL ] KRG: Trimmed 71128 records to 49255 (keeping 200 days of data) [2025-10-13T19:52:08.263500] [DEBUG] [LOCAL ] KRG: Primary data saved (49255 records). [2025-10-13T19:52:08.263626] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-13T19:52:08.263751] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 36.7s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-13T19:52:08.423810] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-13T19:52:08.423725] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:52:08.462188] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:08.511871] [DEBUG] [LOCAL ] KT: Loaded 46155 existing records from primary storage. [2025-10-13T19:52:08.512183] [INFO ] [MAIN ] KT: Loaded 46155 existing records. [2025-10-13T19:52:08.690929] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:08.691183] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-13T19:52:08.691243] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-13T19:52:08.692117] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-13T19:52:08.692176] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-13T19:52:09.045336] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:09.217970] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-13T19:52:09.661531] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:52:10.017972] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-13T19:52:10.391949] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-10-13T19:52:10.506088] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:52:10.817900] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-13T19:52:11.238942] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:52:11.241972] [INFO ] [REMOTE ] KRO: Full fetch complete (35150 records). [2025-10-13T19:52:11.242043] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-13T19:52:11.607028] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-13T19:52:11.607150] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-13T19:52:11.607778] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-13T19:52:11.607840] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-13T19:52:11.608802] [DEBUG] [LOCAL ] KRO: Trimmed 35150 records to 26376 (keeping 200 days of data) [2025-10-13T19:52:11.656571] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-13T19:52:11.759852] [DEBUG] [LOCAL ] KRO: Primary data saved (26376 records). [2025-10-13T19:52:11.759973] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-13T19:52:11.760069] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRO took 35.1s. Estimated remaining: 2h 41m 35s. Rate: 7.1 symbols/min [2025-10-13T19:52:11.924962] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:11.964589] [DEBUG] [LOCAL ] KTB: Loaded 41117 existing records from primary storage. [2025-10-13T19:52:11.964887] [INFO ] [MAIN ] KTB: Loaded 41117 existing records. [2025-10-13T19:52:12.137533] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:12.137754] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-13T19:52:12.137802] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-13T19:52:12.138540] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-13T19:52:12.138596] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-13T19:52:12.418175] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-13T19:52:12.500503] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:12.524945] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:52:13.217910] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-13T19:52:13.315541] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:52:13.771307] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:52:14.017995] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-13T19:52:14.710398] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:52:14.817979] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-13T19:52:15.623010] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-13T19:52:15.637533] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:52:16.171022] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:52:16.174995] [INFO ] [REMOTE ] KRP: Full fetch complete (54849 records). [2025-10-13T19:52:16.175091] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-13T19:52:16.425343] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-13T19:52:16.617416] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-13T19:52:16.617522] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-13T19:52:16.618541] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-13T19:52:16.618613] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-13T19:52:16.620088] [DEBUG] [LOCAL ] KRP: Trimmed 54849 records to 36498 (keeping 200 days of data) [2025-10-13T19:52:16.866834] [DEBUG] [LOCAL ] KRP: Primary data saved (36498 records). [2025-10-13T19:52:16.866983] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-13T19:52:16.867065] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRP took 37.4s. Estimated remaining: 2h 41m 23s. Rate: 7.1 symbols/min [2025-10-13T19:52:17.037022] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:17.048738] [DEBUG] [LOCAL ] KTF: Loaded 12160 existing records from primary storage. [2025-10-13T19:52:17.048939] [INFO ] [MAIN ] KTF: Loaded 12160 existing records. [2025-10-13T19:52:17.224498] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-13T19:52:17.253717] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:17.254350] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-13T19:52:17.254437] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-13T19:52:17.254801] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-13T19:52:17.254859] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-13T19:52:17.606046] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:17.783758] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:52:18.017964] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-13T19:52:18.409596] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-13T19:52:18.528024] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T19:52:18.817999] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-13T19:52:18.985486] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:52:19.617924] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-13T19:52:20.423007] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-13T19:52:20.439609] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:52:21.217915] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-13T19:52:21.614948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:52:22.017958] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-13T19:52:22.393399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T19:52:22.809520] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:52:22.819358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-13T19:52:23.557425] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:52:23.603035] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T19:52:23.617966] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-13T19:52:24.418038] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-13T19:52:24.428043] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T19:52:25.217983] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-13T19:52:25.989378] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:52:26.017902] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-13T19:52:26.241212] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T19:52:26.818035] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-13T19:52:27.628621] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-13T19:52:27.635780] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:52:28.417969] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-13T19:52:28.655851] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:52:28.888676] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:52:29.217981] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-13T19:52:29.904408] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:52:30.017950] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-13T19:52:30.734068] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:52:30.791212] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T19:52:30.817949] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-13T19:52:31.617953] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-13T19:52:31.714416] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T19:52:32.417963] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-13T19:52:33.095156] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:52:33.218004] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-13T19:52:33.708981] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:52:34.017971] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-13T19:52:34.817977] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-13T19:52:35.377396] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T19:52:35.608300] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:52:35.617904] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-13T19:52:36.417976] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-13T19:52:36.544453] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T19:52:37.209900] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:52:37.220983] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-13T19:52:37.301032] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T19:52:38.017996] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-13T19:52:38.817994] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-13T19:52:39.245773] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T19:52:39.482121] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:52:39.486952] [INFO ] [REMOTE ] KT: Full fetch complete (66386 records). [2025-10-13T19:52:39.487088] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-13T19:52:39.621036] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-13T19:52:39.610744] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:52:39.891818] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-13T19:52:39.891905] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-13T19:52:39.892813] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-13T19:52:39.892876] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-13T19:52:39.894207] [DEBUG] [LOCAL ] KT: Trimmed 66386 records to 45544 (keeping 200 days of data) [2025-10-13T19:52:40.174433] [DEBUG] [LOCAL ] KT: Primary data saved (45544 records). [2025-10-13T19:52:40.174581] [INFO ] [MAIN ] KT: Full history saved. [2025-10-13T19:52:40.174730] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 31.9s. Estimated remaining: 2h 41m 29s. Rate: 7.1 symbols/min [2025-10-13T19:52:40.348217] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:40.348422] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-13T19:52:40.348505] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-13T19:52:40.348662] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-13T19:52:40.348722] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-13T19:52:40.348812] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-13T19:52:40.348854] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-13T19:52:40.423705] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-13T19:52:40.722965] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:41.217977] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-13T19:52:41.618571] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T19:52:41.624389] [INFO ] [REMOTE ] KSS: Full fetch complete (77627 records). [2025-10-13T19:52:41.624528] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-13T19:52:42.019249] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-13T19:52:42.059676] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-13T19:52:42.069064] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:52:42.069169] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-13T19:52:42.072255] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-13T19:52:42.082493] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-13T19:52:42.082968] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T19:52:42.090774] [DEBUG] [LOCAL ] KSS: Trimmed 77627 records to 53596 (keeping 200 days of data) [2025-10-13T19:52:42.448788] [DEBUG] [LOCAL ] KSS: Primary data saved (53596 records). [2025-10-13T19:52:42.448990] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-13T19:52:42.449089] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KSS took 42.9s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-13T19:52:42.629835] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:42.687968] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-13T19:52:42.688478] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-10-13T19:52:42.823112] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-13T19:52:42.888926] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:42.895545] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-13T19:52:42.895862] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:52:42.896128] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-13T19:52:42.899774] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-13T19:52:42.899954] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-13T19:52:43.257255] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:43.617999] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-13T19:52:43.670309] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:52:43.671598] [INFO ] [REMOTE ] KTF: Full fetch complete (17403 records). [2025-10-13T19:52:43.671711] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-13T19:52:44.032342] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-13T19:52:44.032421] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-13T19:52:44.032886] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-13T19:52:44.032950] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-13T19:52:44.033482] [DEBUG] [LOCAL ] KTF: Trimmed 17403 records to 11915 (keeping 200 days of data) [2025-10-13T19:52:44.103925] [DEBUG] [LOCAL ] KTF: Primary data saved (11915 records). [2025-10-13T19:52:44.104053] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-13T19:52:44.104130] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTF took 27.2s. Estimated remaining: 2h 40m 60s. Rate: 7.1 symbols/min [2025-10-13T19:52:44.270948] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:44.317239] [DEBUG] [LOCAL ] KVYO: Loaded 51205 existing records from primary storage. [2025-10-13T19:52:44.317543] [INFO ] [MAIN ] KVYO: Loaded 51205 existing records. [2025-10-13T19:52:44.423091] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-13T19:52:44.493874] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:44.494060] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-13T19:52:44.494110] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-13T19:52:44.495066] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-13T19:52:44.495125] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-13T19:52:44.852082] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:45.217907] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-13T19:52:45.482471] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:52:46.017977] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-13T19:52:46.057040] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:52:46.817987] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-13T19:52:47.082038] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:52:47.617915] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-13T19:52:47.673984] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T19:52:47.852775] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T19:52:47.857177] [INFO ] [REMOTE ] KTB: Full fetch complete (57945 records). [2025-10-13T19:52:47.857340] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-13T19:52:48.264632] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-13T19:52:48.264762] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-13T19:52:48.265797] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-13T19:52:48.265866] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-13T19:52:48.267422] [DEBUG] [LOCAL ] KTB: Trimmed 57945 records to 40542 (keeping 200 days of data) [2025-10-13T19:52:48.380810] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:52:48.419232] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-13T19:52:48.553783] [DEBUG] [LOCAL ] KTB: Primary data saved (40542 records). [2025-10-13T19:52:48.553965] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-13T19:52:48.554062] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTB took 36.8s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-13T19:52:48.723589] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:48.764858] [DEBUG] [LOCAL ] KW: Loaded 40951 existing records from primary storage. [2025-10-13T19:52:48.765307] [INFO ] [MAIN ] KW: Loaded 40951 existing records. [2025-10-13T19:52:48.956936] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:48.957305] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-13T19:52:48.963843] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:52:48.963968] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-13T19:52:48.967076] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-13T19:52:48.967155] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-13T19:52:49.223191] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-13T19:52:49.327816] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:50.017906] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-13T19:52:50.817916] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-13T19:52:50.952608] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:52:51.617918] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-13T19:52:51.690628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T19:52:51.815534] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:52:52.417923] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-13T19:52:52.879780] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T19:52:52.972037] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T19:52:53.218010] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-13T19:52:54.017948] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-13T19:52:54.794007] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:52:54.817888] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-13T19:52:55.474945] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:52:55.617915] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-13T19:52:56.417954] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-13T19:52:56.500181] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:52:57.132008] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:52:57.217942] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-13T19:52:57.844620] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:52:58.017964] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-13T19:52:58.817956] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-13T19:52:58.902965] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:52:59.398593] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:52:59.617922] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-13T19:53:00.417923] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-13T19:53:00.988136] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T19:53:01.217909] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-13T19:53:01.542703] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-13T19:53:01.599952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T19:53:01.865311] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:53:02.017953] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-13T19:53:02.448258] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T19:53:02.817970] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-13T19:53:03.617999] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-13T19:53:04.384391] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:53:04.417920] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-13T19:53:05.217988] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-13T19:53:05.372001] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:53:05.863337] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:53:06.017981] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-13T19:53:06.817943] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-13T19:53:07.090620] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T19:53:07.575531] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:53:07.617891] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-13T19:53:07.856601] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T19:53:08.417907] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-13T19:53:09.217898] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-13T19:53:09.254710] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:53:09.824101] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:53:10.017995] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-13T19:53:10.664367] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:53:10.817925] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-13T19:53:11.306762] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T19:53:11.457082] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T19:53:11.617959] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-13T19:53:12.181329] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T19:53:12.417987] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-13T19:53:13.217925] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-13T19:53:14.017899] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-13T19:53:14.229523] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T19:53:14.818012] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-13T19:53:14.849326] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:53:15.618024] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-13T19:53:15.692117] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:53:16.417951] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-13T19:53:16.686968] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:53:16.708787] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:53:16.712905] [INFO ] [REMOTE ] KW: Full fetch complete (57055 records). [2025-10-13T19:53:16.713057] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-13T19:53:17.104942] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-13T19:53:17.105019] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-13T19:53:17.105907] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-13T19:53:17.105975] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-13T19:53:17.107392] [DEBUG] [LOCAL ] KW: Trimmed 57055 records to 40483 (keeping 200 days of data) [2025-10-13T19:53:17.218078] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-13T19:53:17.351859] [DEBUG] [LOCAL ] KW: Primary data saved (40483 records). [2025-10-13T19:53:17.351994] [INFO ] [MAIN ] KW: Full history saved. [2025-10-13T19:53:17.352075] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KW took 28.8s. Estimated remaining: 2h 40m 58s. Rate: 7.1 symbols/min [2025-10-13T19:53:17.440046] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T19:53:17.538006] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:17.556890] [DEBUG] [LOCAL ] KWR: Loaded 16404 existing records from primary storage. [2025-10-13T19:53:17.557129] [INFO ] [MAIN ] KWR: Loaded 16404 existing records. [2025-10-13T19:53:17.737561] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:17.737827] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-13T19:53:17.737877] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-13T19:53:17.738290] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-13T19:53:17.738348] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-13T19:53:18.019362] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-13T19:53:18.118454] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:18.114856] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:53:18.124254] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-13T19:53:18.124347] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-13T19:53:18.531836] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-13T19:53:18.531937] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-13T19:53:18.533375] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-13T19:53:18.533442] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-13T19:53:18.535523] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-13T19:53:18.843020] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-13T19:53:18.902214] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-13T19:53:18.902435] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-13T19:53:18.902546] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVUE took 36.5s. Estimated remaining: 2h 40m 43s. Rate: 7.1 symbols/min [2025-10-13T19:53:19.085349] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:19.119604] [DEBUG] [LOCAL ] KYN: Loaded 30600 existing records from primary storage. [2025-10-13T19:53:19.120043] [INFO ] [MAIN ] KYN: Loaded 30600 existing records. [2025-10-13T19:53:19.316161] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:19.316495] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-13T19:53:19.316550] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-13T19:53:19.317688] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-13T19:53:19.317774] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-13T19:53:19.621424] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-13T19:53:19.709023] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:19.794038] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:53:19.804550] [INFO ] [REMOTE ] KVYO: Full fetch complete (71819 records). [2025-10-13T19:53:19.804787] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-13T19:53:19.805663] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:53:19.832798] [INFO ] [REMOTE ] KUKE: Full fetch complete (8863 records). [2025-10-13T19:53:19.876839] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-13T19:53:20.283678] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T19:53:20.305517] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:53:20.326545] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:53:20.344985] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-13T19:53:20.365217] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-13T19:53:20.379772] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-13T19:53:20.384727] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-13T19:53:20.402231] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-13T19:53:20.402479] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-13T19:53:20.402423] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KUKE took 40.2s. Estimated remaining: 2h 40m 28s. Rate: 7.1 symbols/min [2025-10-13T19:53:20.403481] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-13T19:53:20.408861] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-13T19:53:20.426988] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-13T19:53:20.511928] [DEBUG] [LOCAL ] KVYO: Trimmed 71819 records to 50682 (keeping 200 days of data) [2025-10-13T19:53:20.666623] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:20.696745] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:53:20.736476] [DEBUG] [LOCAL ] L: Loaded 41622 existing records from primary storage. [2025-10-13T19:53:20.737817] [INFO ] [MAIN ] L: Loaded 41622 existing records. [2025-10-13T19:53:21.017615] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:21.018414] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-13T19:53:21.019059] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-13T19:53:21.020195] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-13T19:53:21.020268] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-13T19:53:21.218543] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-13T19:53:21.454466] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:21.461518] [DEBUG] [LOCAL ] KVYO: Primary data saved (50682 records). [2025-10-13T19:53:21.461683] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-13T19:53:21.461787] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVYO took 37.4s. Estimated remaining: 2h 40m 13s. Rate: 7.1 symbols/min [2025-10-13T19:53:21.629523] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:21.681464] [DEBUG] [LOCAL ] LAC: Loaded 53223 existing records from primary storage. [2025-10-13T19:53:21.681846] [INFO ] [MAIN ] LAC: Loaded 53223 existing records. [2025-10-13T19:53:21.890765] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:21.891096] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-13T19:53:21.891321] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-13T19:53:21.892078] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-13T19:53:21.892143] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-13T19:53:22.021873] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-13T19:53:22.063574] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:53:22.293009] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:22.331301] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T19:53:22.817992] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-13T19:53:23.425915] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T19:53:23.617953] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-13T19:53:24.287238] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T19:53:24.417983] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-13T19:53:25.111603] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:53:25.218024] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-13T19:53:26.017924] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-13T19:53:26.442217] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:53:26.605261] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-13T19:53:26.818023] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-13T19:53:27.036788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:53:27.617984] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-13T19:53:28.106461] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:53:28.417966] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-13T19:53:29.217978] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-13T19:53:29.534004] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T19:53:29.581351] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:53:30.017951] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-13T19:53:30.753469] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:53:30.817965] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-13T19:53:31.473774] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:53:31.617967] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-13T19:53:32.330494] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:53:32.417913] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-13T19:53:33.218025] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-13T19:53:33.426251] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:53:33.979319] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:53:34.017883] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-13T19:53:34.331720] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:53:34.817971] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-13T19:53:35.617898] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-13T19:53:35.980272] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:53:36.261336] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:53:36.417891] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-13T19:53:36.672755] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:53:37.217947] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-13T19:53:37.883793] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:53:38.017911] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-13T19:53:38.533459] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T19:53:38.817955] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-13T19:53:39.565771] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T19:53:39.617885] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-13T19:53:39.828943] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:53:40.417947] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-13T19:53:41.055817] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T19:53:41.217891] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-13T19:53:41.448106] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:53:42.017949] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-13T19:53:42.776866] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:53:42.817883] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-13T19:53:43.266500] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T19:53:43.617960] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-13T19:53:44.148436] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T19:53:44.153354] [INFO ] [REMOTE ] L: Full fetch complete (59225 records). [2025-10-13T19:53:44.153743] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-13T19:53:44.421689] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-13T19:53:44.536374] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-13T19:53:44.536462] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-13T19:53:44.537356] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-13T19:53:44.537422] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-13T19:53:44.538767] [DEBUG] [LOCAL ] L: Trimmed 59225 records to 41080 (keeping 200 days of data) [2025-10-13T19:53:44.681429] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:53:44.811901] [DEBUG] [LOCAL ] L: Primary data saved (41080 records). [2025-10-13T19:53:44.812036] [INFO ] [MAIN ] L: Full history saved. [2025-10-13T19:53:44.812179] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 24.4s. Estimated remaining: 2h 40m 18s. Rate: 7.1 symbols/min [2025-10-13T19:53:44.976148] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:45.000588] [DEBUG] [LOCAL ] LAD: Loaded 23862 existing records from primary storage. [2025-10-13T19:53:45.000898] [INFO ] [MAIN ] LAD: Loaded 23862 existing records. [2025-10-13T19:53:45.172990] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:45.173249] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-13T19:53:45.173297] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-13T19:53:45.173919] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-13T19:53:45.173989] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-13T19:53:45.226596] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-13T19:53:45.543214] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:45.589564] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:53:45.844132] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T19:53:46.017974] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-13T19:53:46.818003] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-13T19:53:47.617972] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-13T19:53:47.724933] [DEBUG] [REMOTE ] LAD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T19:53:47.725252] [WARN ] [REMOTE ] LAD: No data returned for month 2024-12 [2025-10-13T19:53:47.725341] [FATAL] [REMOTE ] LAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:53:47.725388] [FATAL] [MAIN ] LAD: Failed to fetch primary data. [2025-10-13T19:53:47.725447] [WARN ] [MAIN ] LAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:53:47.725522] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-13T19:53:47.725586] [DEBUG] [LOCAL ] LAD: No primary data file found to delete. [2025-10-13T19:53:47.725622] [INFO ] [LOCAL ] LAD: Starting deletion of derivative data. [2025-10-13T19:53:47.725859] [DEBUG] [LOCAL ] LAD: Deleted derivative data file. [2025-10-13T19:53:47.725963] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 2.9s. Estimated remaining: 2h 40m 5s. Rate: 7.1 symbols/min [2025-10-13T19:53:47.913931] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:47.972184] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T19:53:47.999603] [DEBUG] [LOCAL ] LADR: Loaded 39783 existing records from primary storage. [2025-10-13T19:53:47.999979] [INFO ] [MAIN ] LADR: Loaded 39783 existing records. [2025-10-13T19:53:48.198165] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:48.198605] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-13T19:53:48.198886] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-13T19:53:48.199854] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-13T19:53:48.199918] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-13T19:53:48.328881] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:53:48.423033] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-13T19:53:48.609015] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:49.217956] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-13T19:53:50.017923] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-13T19:53:50.409946] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:53:50.458777] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:53:50.817916] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-13T19:53:51.212019] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:53:51.617961] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-13T19:53:52.417972] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-13T19:53:52.433833] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:53:52.435717] [INFO ] [REMOTE ] KWR: Full fetch complete (23676 records). [2025-10-13T19:53:52.435815] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-13T19:53:52.862440] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T19:53:52.912507] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-13T19:53:52.912944] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-13T19:53:52.913612] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-13T19:53:52.913714] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-13T19:53:52.914420] [DEBUG] [LOCAL ] KWR: Trimmed 23676 records to 16178 (keeping 200 days of data) [2025-10-13T19:53:53.024562] [DEBUG] [LOCAL ] KWR: Primary data saved (16178 records). [2025-10-13T19:53:53.024747] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-13T19:53:53.024863] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. KWR took 35.7s. Estimated remaining: 2h 39m 53s. Rate: 7.1 symbols/min [2025-10-13T19:53:53.219147] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-13T19:53:53.219064] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:53.225105] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-13T19:53:53.225462] [INFO ] [MAIN ] LANV: Loaded 2845 existing records. [2025-10-13T19:53:53.433783] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:53.434133] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-13T19:53:53.434186] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-13T19:53:53.434390] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-13T19:53:53.434433] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-13T19:53:53.592008] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:53:53.691133] [INFO ] [REMOTE ] KYN: Full fetch complete (44348 records). [2025-10-13T19:53:53.718411] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-13T19:53:54.023398] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:54.050340] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-13T19:53:54.257744] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-13T19:53:54.257833] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-13T19:53:54.258738] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-13T19:53:54.258801] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-13T19:53:54.259843] [DEBUG] [LOCAL ] KYN: Trimmed 44348 records to 30165 (keeping 200 days of data) [2025-10-13T19:53:54.442438] [DEBUG] [LOCAL ] KYN: Primary data saved (30165 records). [2025-10-13T19:53:54.442571] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-13T19:53:54.442683] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. KYN took 35.5s. Estimated remaining: 2h 39m 39s. Rate: 7.1 symbols/min [2025-10-13T19:53:54.610154] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:54.610342] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-13T19:53:54.610398] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-13T19:53:54.610530] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-13T19:53:54.610603] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-13T19:53:54.610676] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-13T19:53:54.610732] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-13T19:53:54.828505] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-13T19:53:54.967697] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:55.447784] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T19:53:55.605263] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:53:55.617871] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-13T19:53:55.707574] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:53:56.417971] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-13T19:53:56.615961] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:53:56.616282] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-13T19:53:56.616375] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:53:56.616421] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-13T19:53:56.616454] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:53:56.616517] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-13T19:53:56.616579] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-13T19:53:56.616614] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-13T19:53:56.616685] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-13T19:53:56.616751] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAR took 2.2s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-13T19:53:56.919508] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:53:57.217976] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-13T19:53:58.017956] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-13T19:53:58.632075] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T19:53:58.817955] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-13T19:53:59.196103] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:53:59.617915] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-13T19:53:59.828895] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:54:00.418028] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-13T19:54:01.217978] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-13T19:54:01.565708] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T19:54:01.626629] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:54:01.688184] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T19:54:02.018069] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-13T19:54:02.818043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-13T19:54:03.386712] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:54:03.617977] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-13T19:54:04.400629] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-13T19:54:04.406567] [INFO ] [REMOTE ] LAC: Full fetch complete (76007 records). [2025-10-13T19:54:04.406980] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-13T19:54:04.441557] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-13T19:54:04.805544] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-13T19:54:04.805626] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-13T19:54:04.806599] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-13T19:54:04.806678] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-13T19:54:04.808464] [DEBUG] [LOCAL ] LAC: Trimmed 76007 records to 52482 (keeping 200 days of data) [2025-10-13T19:54:04.984362] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T19:54:05.095304] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:54:05.147503] [DEBUG] [LOCAL ] LAC: Primary data saved (52482 records). [2025-10-13T19:54:05.147662] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-13T19:54:05.147799] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 43.7s. Estimated remaining: 2h 39m 16s. Rate: 7.1 symbols/min [2025-10-13T19:54:05.217978] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-13T19:54:06.018005] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-13T19:54:06.400870] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T19:54:06.642880] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:54:06.817912] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-13T19:54:07.617975] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-13T19:54:08.051569] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T19:54:08.423016] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-13T19:54:08.439576] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:54:08.756853] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:54:09.218008] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-13T19:54:10.018018] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-13T19:54:10.607834] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T19:54:10.634867] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:54:10.818034] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-13T19:54:11.617987] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-13T19:54:12.272809] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T19:54:12.301985] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T19:54:12.417915] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-13T19:54:13.218070] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-13T19:54:13.845821] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:54:13.853056] [INFO ] [REMOTE ] LADR: Full fetch complete (55526 records). [2025-10-13T19:54:13.853186] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T19:54:13.853385] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-13T19:54:13.854398] [INFO ] [REMOTE ] LANV: Full fetch complete (4323 records). [2025-10-13T19:54:13.854589] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-13T19:54:14.619957] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-13T19:54:14.634849] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-13T19:54:14.635137] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-13T19:54:14.645583] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-13T19:54:14.656453] [DEBUG] [LOCAL ] LANV: Trimmed 4323 records to 2815 (keeping 200 days of data) [2025-10-13T19:54:14.704607] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-13T19:54:14.708586] [DEBUG] [LOCAL ] LANV: Primary data saved (2815 records). [2025-10-13T19:54:14.708888] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-13T19:54:14.708815] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-13T19:54:14.709068] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 21.7s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-13T19:54:14.710032] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-13T19:54:14.710262] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-13T19:54:14.711618] [DEBUG] [LOCAL ] LADR: Trimmed 55526 records to 39324 (keeping 200 days of data) [2025-10-13T19:54:14.953480] [DEBUG] [LOCAL ] LADR: Primary data saved (39324 records). [2025-10-13T19:54:14.953674] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-13T19:54:14.953777] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LADR took 27.2s. Estimated remaining: 2h 38m 53s. Rate: 7.1 symbols/min [2025-10-13T19:54:15.591627] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.642207] [DEBUG] [LOCAL ] LBRT: No existing data file found in primary storage. [2025-10-13T19:54:15.684299] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.718577] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.739955] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.735410] [WARN ] [MAIN ] LBRT: No existing data found, performing full refresh instead. [2025-10-13T19:54:15.741707] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-13T19:54:15.741949] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-13T19:54:15.742054] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-13T19:54:15.742115] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-13T19:54:15.868500] [DEBUG] [LOCAL ] LAW: Loaded 14516 existing records from primary storage. [2025-10-13T19:54:15.904129] [INFO ] [MAIN ] LAW: Loaded 14516 existing records. [2025-10-13T19:54:16.099986] [DEBUG] [LOCAL ] LB: Loaded 38235 existing records from primary storage. [2025-10-13T19:54:16.161137] [INFO ] [MAIN ] LB: Loaded 38235 existing records. [2025-10-13T19:54:16.220231] [DEBUG] [LOCAL ] LAZ: Loaded 45361 existing records from primary storage. [2025-10-13T19:54:16.329322] [INFO ] [MAIN ] LAZ: Loaded 45361 existing records. [2025-10-13T19:54:16.436748] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.479135] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.530944] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-13T19:54:16.594946] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-13T19:54:16.633945] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-13T19:54:16.837247] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.833624] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:16.884404] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.899012] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.898926] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-13T19:54:16.919927] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-13T19:54:16.935023] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.935168] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-13T19:54:16.940837] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-13T19:54:16.940967] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-13T19:54:16.961628] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-13T19:54:16.975674] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-13T19:54:17.720719] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:17.820231] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-13T19:54:18.007795] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:18.012272] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-13T19:54:18.011948] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:18.013454] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-13T19:54:18.779579] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:54:18.790067] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-13T19:54:18.956033] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:54:18.959864] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-13T19:54:19.214858] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:54:19.222951] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-13T19:54:19.748679] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:54:19.757371] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-13T19:54:19.788465] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T19:54:20.417909] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-13T19:54:20.529454] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:54:20.769192] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:54:20.964203] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:54:21.217986] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-13T19:54:21.431902] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:54:22.017960] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-13T19:54:22.745449] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:54:22.817908] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-13T19:54:23.529998] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:54:23.617905] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-13T19:54:24.417974] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-13T19:54:24.561076] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:54:24.581997] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:54:25.217926] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-13T19:54:25.949441] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:54:26.017918] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-13T19:54:26.066805] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:54:26.817960] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-13T19:54:27.498358] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:54:27.618043] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-13T19:54:28.417975] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-13T19:54:28.494045] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:54:28.784566] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T19:54:29.217994] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-13T19:54:30.017996] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-13T19:54:30.075551] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:54:30.794239] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:54:30.817901] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-13T19:54:30.905114] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T19:54:31.617915] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-13T19:54:32.379147] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:54:32.417962] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-13T19:54:33.146225] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:54:33.217921] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-13T19:54:33.343638] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:54:34.018021] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-13T19:54:34.817960] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-13T19:54:35.034737] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:54:35.433010] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:54:35.617974] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-13T19:54:35.715141] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T19:54:36.417985] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-13T19:54:37.219213] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:54:37.218011] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-13T19:54:37.917581] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:54:38.018028] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-13T19:54:38.817953] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-13T19:54:38.956534] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:54:39.381822] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:54:39.617993] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-13T19:54:39.743544] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T19:54:40.417986] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-13T19:54:41.217960] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-13T19:54:41.320021] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:54:41.431887] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:54:41.434530] [INFO ] [REMOTE ] LAW: Full fetch complete (20767 records). [2025-10-13T19:54:41.434687] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-13T19:54:41.847018] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-13T19:54:41.847100] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-13T19:54:41.847758] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-13T19:54:41.847823] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-13T19:54:41.848772] [DEBUG] [LOCAL ] LAW: Trimmed 20767 records to 14500 (keeping 200 days of data) [2025-10-13T19:54:41.934173] [DEBUG] [LOCAL ] LAW: Primary data saved (14500 records). [2025-10-13T19:54:41.934378] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-13T19:54:41.934483] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 27.0s. Estimated remaining: 2h 39m 1s. Rate: 7.1 symbols/min [2025-10-13T19:54:42.026328] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-13T19:54:42.115861] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:42.164712] [DEBUG] [LOCAL ] LC: Loaded 48680 existing records from primary storage. [2025-10-13T19:54:42.165109] [INFO ] [MAIN ] LC: Loaded 48680 existing records. [2025-10-13T19:54:42.355256] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:42.355604] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-13T19:54:42.355880] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-13T19:54:42.357089] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-13T19:54:42.357156] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-13T19:54:42.545713] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:54:42.773680] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:42.817985] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-13T19:54:43.529384] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:54:43.618011] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-13T19:54:44.417922] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-13T19:54:44.456471] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:54:45.024492] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:54:45.030177] [INFO ] [REMOTE ] LAZ: Full fetch complete (65579 records). [2025-10-13T19:54:45.030300] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-13T19:54:45.226804] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-13T19:54:45.431025] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-13T19:54:45.431139] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-13T19:54:45.432233] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-13T19:54:45.432297] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-13T19:54:45.434269] [DEBUG] [LOCAL ] LAZ: Trimmed 65579 records to 44790 (keeping 200 days of data) [2025-10-13T19:54:45.736083] [DEBUG] [LOCAL ] LAZ: Primary data saved (44790 records). [2025-10-13T19:54:45.736285] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-13T19:54:45.736402] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 30.8s. Estimated remaining: 2h 38m 49s. Rate: 7.1 symbols/min [2025-10-13T19:54:45.923369] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:45.953387] [DEBUG] [LOCAL ] LCII: Loaded 27968 existing records from primary storage. [2025-10-13T19:54:45.953772] [INFO ] [MAIN ] LCII: Loaded 27968 existing records. [2025-10-13T19:54:46.018830] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-13T19:54:46.150186] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:46.150737] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-13T19:54:46.150908] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-13T19:54:46.151804] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-13T19:54:46.151872] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-13T19:54:46.415237] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T19:54:46.577035] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:46.738292] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:54:46.817961] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-13T19:54:47.617974] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-13T19:54:47.741202] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:54:48.417911] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-13T19:54:48.667687] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:54:48.695297] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:54:49.217975] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-13T19:54:50.028683] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-13T19:54:50.035486] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:54:50.274332] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T19:54:50.817905] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-13T19:54:51.589949] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T19:54:51.617885] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-13T19:54:51.788392] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:54:51.794672] [INFO ] [REMOTE ] LBRT: Full fetch complete (76648 records). [2025-10-13T19:54:51.794852] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-13T19:54:52.195352] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-13T19:54:52.195446] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-13T19:54:52.196659] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-13T19:54:52.196726] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-13T19:54:52.198715] [DEBUG] [LOCAL ] LBRT: Trimmed 76648 records to 52952 (keeping 200 days of data) [2025-10-13T19:54:52.424916] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-13T19:54:52.546792] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T19:54:52.578183] [DEBUG] [LOCAL ] LBRT: Primary data saved (52952 records). [2025-10-13T19:54:52.578386] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-13T19:54:52.578476] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 37.6s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-13T19:54:52.754616] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:52.797083] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-13T19:54:52.797472] [INFO ] [MAIN ] LDI: Loaded 45259 existing records. [2025-10-13T19:54:52.979135] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:52.979485] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-13T19:54:52.979536] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-13T19:54:52.980600] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-13T19:54:52.980696] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-13T19:54:53.225589] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-13T19:54:53.356326] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:53.995239] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:54:54.017897] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-13T19:54:54.672476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:54:54.818047] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-13T19:54:55.481224] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:54:55.617967] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-13T19:54:56.128736] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:54:56.133371] [INFO ] [REMOTE ] LB: Full fetch complete (55968 records). [2025-10-13T19:54:56.133490] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-13T19:54:56.423178] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-13T19:54:56.589219] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-13T19:54:56.589358] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-13T19:54:56.590425] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-13T19:54:56.590491] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-13T19:54:56.593129] [DEBUG] [LOCAL ] LB: Trimmed 55968 records to 37646 (keeping 200 days of data) [2025-10-13T19:54:56.832828] [DEBUG] [LOCAL ] LB: Primary data saved (37646 records). [2025-10-13T19:54:56.833121] [INFO ] [MAIN ] LB: Full history saved. [2025-10-13T19:54:56.833375] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LB took 41.9s. Estimated remaining: 2h 38m 26s. Rate: 7.1 symbols/min [2025-10-13T19:54:57.026691] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:57.028968] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:54:57.079766] [DEBUG] [LOCAL ] LDOS: Loaded 45881 existing records from primary storage. [2025-10-13T19:54:57.080112] [INFO ] [MAIN ] LDOS: Loaded 45881 existing records. [2025-10-13T19:54:57.230851] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-13T19:54:57.277725] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:57.278506] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-13T19:54:57.278594] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-13T19:54:57.280251] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-13T19:54:57.280430] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-13T19:54:57.640617] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:58.018332] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:54:58.018468] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-13T19:54:58.211278] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:54:58.818078] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-13T19:54:59.617321] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:54:59.627083] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-13T19:55:00.377956] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:55:00.418046] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-13T19:55:01.217977] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-13T19:55:01.467798] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T19:55:02.017962] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-13T19:55:02.165373] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:55:02.817912] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-13T19:55:02.856369] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T19:55:03.527153] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:55:03.617994] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-13T19:55:04.130597] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T19:55:04.417992] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-13T19:55:04.896596] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:55:05.218012] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-13T19:55:05.690613] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:55:06.017905] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-13T19:55:06.817907] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-13T19:55:06.983910] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:55:07.574511] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:55:07.617891] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-13T19:55:07.741247] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T19:55:08.417984] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-13T19:55:09.217903] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-13T19:55:09.350638] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:55:09.654283] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T19:55:10.017951] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-13T19:55:10.309687] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:55:10.817966] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-13T19:55:11.617961] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-13T19:55:11.780196] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:55:11.845626] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:55:12.417921] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-13T19:55:12.672122] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:55:13.217969] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-13T19:55:14.017950] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-13T19:55:14.300764] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T19:55:14.817969] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-13T19:55:14.943368] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:55:15.495123] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:55:15.618013] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-13T19:55:16.417901] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-13T19:55:16.500401] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:55:17.217978] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-13T19:55:17.268891] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:55:17.834176] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T19:55:17.839491] [INFO ] [REMOTE ] LC: Full fetch complete (70492 records). [2025-10-13T19:55:17.839622] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-13T19:55:18.021613] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-13T19:55:18.258901] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-13T19:55:18.259022] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-13T19:55:18.260077] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-13T19:55:18.260149] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-13T19:55:18.261831] [DEBUG] [LOCAL ] LC: Trimmed 70492 records to 48079 (keeping 200 days of data) [2025-10-13T19:55:18.563091] [DEBUG] [LOCAL ] LC: Primary data saved (48079 records). [2025-10-13T19:55:18.563244] [INFO ] [MAIN ] LC: Full history saved. [2025-10-13T19:55:18.563333] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 36.6s. Estimated remaining: 2h 38m 30s. Rate: 7.1 symbols/min [2025-10-13T19:55:18.738745] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:18.752431] [DEBUG] [LOCAL ] LDP: Loaded 13106 existing records from primary storage. [2025-10-13T19:55:18.752794] [INFO ] [MAIN ] LDP: Loaded 13106 existing records. [2025-10-13T19:55:18.826415] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-13T19:55:18.947582] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:18.948076] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-13T19:55:18.948269] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-13T19:55:18.949068] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-13T19:55:18.949293] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-13T19:55:19.128396] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:55:19.354387] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:19.617927] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-13T19:55:19.904474] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:55:20.421934] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-13T19:55:20.423905] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-13T19:55:20.746223] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:55:21.217962] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-13T19:55:21.435543] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T19:55:22.017979] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-13T19:55:22.307237] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:55:22.310020] [INFO ] [REMOTE ] LCII: Full fetch complete (39052 records). [2025-10-13T19:55:22.310121] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-13T19:55:22.676509] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-13T19:55:22.676583] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-13T19:55:22.677215] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-13T19:55:22.677321] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-13T19:55:22.678273] [DEBUG] [LOCAL ] LCII: Trimmed 39052 records to 27562 (keeping 200 days of data) [2025-10-13T19:55:22.825099] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-13T19:55:22.853536] [DEBUG] [LOCAL ] LCII: Primary data saved (27562 records). [2025-10-13T19:55:22.853636] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-13T19:55:22.853767] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 37.1s. Estimated remaining: 2h 38m 18s. Rate: 7.1 symbols/min [2025-10-13T19:55:22.991766] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:55:23.044681] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:23.081825] [DEBUG] [LOCAL ] LEA: Loaded 42180 existing records from primary storage. [2025-10-13T19:55:23.082133] [INFO ] [MAIN ] LEA: Loaded 42180 existing records. [2025-10-13T19:55:23.253045] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:23.253238] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-13T19:55:23.253306] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-13T19:55:23.254348] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-13T19:55:23.254408] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-13T19:55:23.610217] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:23.617895] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-13T19:55:24.418037] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-13T19:55:25.152688] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-13T19:55:25.158529] [INFO ] [REMOTE ] LDI: Full fetch complete (61402 records). [2025-10-13T19:55:25.158690] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-13T19:55:25.222692] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-13T19:55:25.492332] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T19:55:25.599053] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-13T19:55:25.599156] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-13T19:55:25.600071] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-13T19:55:25.600183] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-13T19:55:25.601717] [DEBUG] [LOCAL ] LDI: Trimmed 61402 records to 44727 (keeping 200 days of data) [2025-10-13T19:55:25.736421] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:55:25.901425] [DEBUG] [LOCAL ] LDI: Primary data saved (44727 records). [2025-10-13T19:55:25.901572] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-13T19:55:25.901695] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 33.3s. Estimated remaining: 2h 38m 5s. Rate: 7.1 symbols/min [2025-10-13T19:55:26.020041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-13T19:55:26.074004] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:26.093967] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T19:55:26.131285] [DEBUG] [LOCAL ] LEG: Loaded 50914 existing records from primary storage. [2025-10-13T19:55:26.131590] [INFO ] [MAIN ] LEG: Loaded 50914 existing records. [2025-10-13T19:55:26.302252] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:26.302469] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-13T19:55:26.302557] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-13T19:55:26.303336] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-13T19:55:26.303403] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-13T19:55:26.649770] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:26.817945] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-13T19:55:27.593992] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:55:27.617885] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-13T19:55:28.417900] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-13T19:55:28.449545] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:55:29.166979] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:55:29.171448] [INFO ] [REMOTE ] LDOS: Full fetch complete (67177 records). [2025-10-13T19:55:29.171560] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-13T19:55:29.225354] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-13T19:55:29.576333] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-13T19:55:29.576420] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-13T19:55:29.577328] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-13T19:55:29.577392] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-13T19:55:29.578779] [DEBUG] [LOCAL ] LDOS: Trimmed 67177 records to 45172 (keeping 200 days of data) [2025-10-13T19:55:29.868385] [DEBUG] [LOCAL ] LDOS: Primary data saved (45172 records). [2025-10-13T19:55:29.868535] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-13T19:55:29.868622] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 33.0s. Estimated remaining: 2h 37m 52s. Rate: 7.1 symbols/min [2025-10-13T19:55:30.027753] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-13T19:55:30.055219] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:30.086922] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:55:30.153510] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:55:30.153113] [DEBUG] [LOCAL ] LEN: Loaded 53950 existing records from primary storage. [2025-10-13T19:55:30.157240] [INFO ] [MAIN ] LEN: Loaded 53950 existing records. [2025-10-13T19:55:30.341282] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:30.341549] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-13T19:55:30.341597] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-13T19:55:30.342956] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-13T19:55:30.343046] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-13T19:55:30.708381] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:30.817951] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-13T19:55:31.618037] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-13T19:55:31.706232] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:55:32.417902] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-13T19:55:32.599743] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:55:32.638753] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T19:55:33.217946] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-13T19:55:33.997205] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:55:34.017899] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-13T19:55:34.422514] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:55:34.817955] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-13T19:55:35.617902] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-13T19:55:35.733438] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T19:55:35.972369] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T19:55:36.417925] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-13T19:55:37.217909] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-13T19:55:37.290392] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:55:37.896545] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T19:55:38.017978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-13T19:55:38.177415] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:55:38.817947] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-13T19:55:39.617973] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-13T19:55:39.815924] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T19:55:40.417973] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-13T19:55:40.724306] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:55:40.955699] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:55:41.217923] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-13T19:55:41.263687] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:55:41.871960] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T19:55:42.017979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-13T19:55:42.817995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-13T19:55:43.617967] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-13T19:55:43.948982] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T19:55:44.417958] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-13T19:55:44.508110] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T19:55:45.173801] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:55:45.217965] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-13T19:55:46.018113] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-13T19:55:46.320860] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T19:55:46.321955] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:55:46.817949] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-13T19:55:47.618013] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-13T19:55:47.702150] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T19:55:47.705937] [INFO ] [REMOTE ] LDP: Full fetch complete (18983 records). [2025-10-13T19:55:47.706175] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-13T19:55:47.710755] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:55:48.242075] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-13T19:55:48.242228] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-13T19:55:48.242765] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-13T19:55:48.242830] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-13T19:55:48.243465] [DEBUG] [LOCAL ] LDP: Trimmed 18983 records to 12892 (keeping 200 days of data) [2025-10-13T19:55:48.340530] [DEBUG] [LOCAL ] LDP: Primary data saved (12892 records). [2025-10-13T19:55:48.340671] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-13T19:55:48.340863] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 29.8s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-13T19:55:48.423048] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-13T19:55:48.522584] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:48.540607] [DEBUG] [LOCAL ] LEO: Loaded 17099 existing records from primary storage. [2025-10-13T19:55:48.540903] [INFO ] [MAIN ] LEO: Loaded 17099 existing records. [2025-10-13T19:55:48.720222] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:48.720434] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-13T19:55:48.720497] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-13T19:55:48.721111] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-13T19:55:48.721182] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-13T19:55:49.089326] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:49.119228] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:55:49.217965] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-13T19:55:49.331011] [DEBUG] [REMOTE ] LEO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T19:55:49.331331] [WARN ] [REMOTE ] LEO: No data returned for month 2024-12 [2025-10-13T19:55:49.331421] [FATAL] [REMOTE ] LEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:55:49.331467] [FATAL] [MAIN ] LEO: Failed to fetch primary data. [2025-10-13T19:55:49.331499] [WARN ] [MAIN ] LEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:55:49.331535] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-13T19:55:49.331586] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-10-13T19:55:49.331621] [INFO ] [LOCAL ] LEO: Starting deletion of derivative data. [2025-10-13T19:55:49.331877] [DEBUG] [LOCAL ] LEO: Deleted derivative data file. [2025-10-13T19:55:49.331981] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEO took 1.0s. Estimated remaining: 2h 37m 38s. Rate: 7.1 symbols/min [2025-10-13T19:55:49.496463] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:49.546238] [DEBUG] [LOCAL ] LEVI: Loaded 52452 existing records from primary storage. [2025-10-13T19:55:49.546538] [INFO ] [MAIN ] LEVI: Loaded 52452 existing records. [2025-10-13T19:55:49.725237] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:49.725441] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-13T19:55:49.725503] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-13T19:55:49.725859] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-13T19:55:49.725939] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-13T19:55:50.019336] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-13T19:55:50.104467] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:50.138449] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:55:50.817989] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-13T19:55:51.617924] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-13T19:55:51.863426] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T19:55:52.077635] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T19:55:52.417928] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-13T19:55:53.218013] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-13T19:55:53.284951] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:55:53.933406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:55:54.017922] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-13T19:55:54.817896] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-13T19:55:55.216955] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:55:55.505520] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:55:55.617909] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-13T19:55:56.417900] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-13T19:55:56.682866] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:55:56.744734] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:55:57.217910] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-13T19:55:57.809154] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:55:58.018032] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-13T19:55:58.736401] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:55:58.817985] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-13T19:55:59.618003] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-13T19:55:59.654476] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T19:55:59.659989] [INFO ] [REMOTE ] LEG: Full fetch complete (72951 records). [2025-10-13T19:55:59.660158] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-13T19:56:00.044460] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-13T19:56:00.044538] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-13T19:56:00.046291] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-13T19:56:00.046354] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-13T19:56:00.048712] [DEBUG] [LOCAL ] LEG: Trimmed 72951 records to 50184 (keeping 200 days of data) [2025-10-13T19:56:00.318966] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:56:00.342319] [INFO ] [REMOTE ] LEA: Full fetch complete (60537 records). [2025-10-13T19:56:00.348806] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-13T19:56:00.424866] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-13T19:56:00.730324] [DEBUG] [LOCAL ] LEG: Primary data saved (50184 records). [2025-10-13T19:56:00.759157] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-13T19:56:00.759503] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 34.9s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-13T19:56:01.053881] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-13T19:56:01.058959] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-13T19:56:01.060285] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-13T19:56:01.058862] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:01.060500] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-13T19:56:01.063480] [DEBUG] [LOCAL ] LEA: Trimmed 60537 records to 41508 (keeping 200 days of data) [2025-10-13T19:56:01.179711] [DEBUG] [LOCAL ] LFT: Loaded 18593 existing records from primary storage. [2025-10-13T19:56:01.181887] [INFO ] [MAIN ] LFT: Loaded 18593 existing records. [2025-10-13T19:56:01.392624] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:01.394314] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-13T19:56:01.395028] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-13T19:56:01.395363] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-13T19:56:01.395733] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-13T19:56:01.909166] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:01.910469] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-13T19:56:01.982122] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-13T19:56:02.016981] [DEBUG] [LOCAL ] LEA: Primary data saved (41508 records). [2025-10-13T19:56:02.017165] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-13T19:56:02.017270] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEA took 39.2s. Estimated remaining: 2h 37m 17s. Rate: 7.1 symbols/min [2025-10-13T19:56:02.022675] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-13T19:56:02.218413] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:02.239728] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:56:02.260717] [DEBUG] [LOCAL ] LGI: Loaded 10159 existing records from primary storage. [2025-10-13T19:56:02.261024] [INFO ] [MAIN ] LGI: Loaded 10159 existing records. [2025-10-13T19:56:02.456195] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:02.456464] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-13T19:56:02.456514] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-13T19:56:02.456998] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-13T19:56:02.457058] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-13T19:56:02.826876] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-13T19:56:02.833483] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:02.983717] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:56:03.618052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-13T19:56:04.385259] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-13T19:56:04.417911] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-13T19:56:04.463292] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T19:56:04.603817] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:56:05.214996] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:56:05.217875] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-13T19:56:06.016186] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:56:06.018866] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-13T19:56:06.723769] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:56:06.730342] [INFO ] [REMOTE ] LEN: Full fetch complete (77048 records). [2025-10-13T19:56:06.730588] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-13T19:56:06.823220] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-13T19:56:07.139410] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-13T19:56:07.139491] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-13T19:56:07.140464] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-13T19:56:07.140528] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-13T19:56:07.141960] [DEBUG] [LOCAL ] LEN: Trimmed 77048 records to 53175 (keeping 200 days of data) [2025-10-13T19:56:07.488026] [DEBUG] [LOCAL ] LEN: Primary data saved (53175 records). [2025-10-13T19:56:07.488195] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-13T19:56:07.488307] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 37.6s. Estimated remaining: 2h 37m 6s. Rate: 7.1 symbols/min [2025-10-13T19:56:07.619501] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:56:07.618870] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-13T19:56:07.676207] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:07.711895] [DEBUG] [LOCAL ] LH: Loaded 38243 existing records from primary storage. [2025-10-13T19:56:07.712197] [INFO ] [MAIN ] LH: Loaded 38243 existing records. [2025-10-13T19:56:07.888029] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:07.888269] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-13T19:56:07.888315] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-13T19:56:07.889279] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-13T19:56:07.889337] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-13T19:56:08.251539] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:08.417887] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-13T19:56:09.217960] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-13T19:56:09.622025] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:56:09.897921] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:56:09.982111] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T19:56:10.017978] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-13T19:56:10.817965] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-13T19:56:11.072666] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T19:56:11.617973] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-13T19:56:12.297486] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T19:56:12.417921] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-13T19:56:13.217993] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-13T19:56:13.429217] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:56:13.479502] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:56:14.017898] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-13T19:56:14.061391] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:56:14.817925] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-13T19:56:15.617955] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-13T19:56:15.661236] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T19:56:15.664078] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:56:16.417961] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-13T19:56:17.127820] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:56:17.217901] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-13T19:56:17.244683] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:56:18.018034] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-13T19:56:18.817897] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-13T19:56:19.164097] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T19:56:19.619230] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-13T19:56:19.624233] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:56:19.678768] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T19:56:20.417964] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-13T19:56:21.217902] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-13T19:56:21.342940] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:56:21.374877] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:56:22.017914] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-13T19:56:22.308592] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:56:22.746632] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T19:56:22.817925] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-13T19:56:23.617958] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-13T19:56:24.417909] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-13T19:56:24.456944] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:56:24.455228] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:56:24.469623] [INFO ] [REMOTE ] LGI: Full fetch complete (14458 records). [2025-10-13T19:56:24.469770] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-13T19:56:24.848151] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-13T19:56:24.848237] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-13T19:56:24.848604] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-13T19:56:24.848710] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-13T19:56:24.849210] [DEBUG] [LOCAL ] LGI: Trimmed 14458 records to 10043 (keeping 200 days of data) [2025-10-13T19:56:24.911188] [DEBUG] [LOCAL ] LGI: Primary data saved (10043 records). [2025-10-13T19:56:24.911327] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-13T19:56:24.911405] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 22.9s. Estimated remaining: 2h 37m 5s. Rate: 7.1 symbols/min [2025-10-13T19:56:25.080189] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:25.124807] [DEBUG] [LOCAL ] LHX: Loaded 49289 existing records from primary storage. [2025-10-13T19:56:25.125125] [INFO ] [MAIN ] LHX: Loaded 49289 existing records. [2025-10-13T19:56:25.225492] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-13T19:56:25.308381] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:25.308626] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-13T19:56:25.308728] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-13T19:56:25.309819] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-13T19:56:25.309878] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-13T19:56:25.463214] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:56:25.688756] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:26.018018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-13T19:56:26.817901] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-13T19:56:26.925933] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T19:56:27.118329] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:56:27.617915] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-13T19:56:28.417979] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-13T19:56:28.440183] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:56:28.446028] [INFO ] [REMOTE ] LEVI: Full fetch complete (74581 records). [2025-10-13T19:56:28.446150] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-13T19:56:28.831445] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-13T19:56:28.831530] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-13T19:56:28.832494] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-13T19:56:28.832557] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-13T19:56:28.834060] [DEBUG] [LOCAL ] LEVI: Trimmed 74581 records to 51716 (keeping 200 days of data) [2025-10-13T19:56:29.152840] [DEBUG] [LOCAL ] LEVI: Primary data saved (51716 records). [2025-10-13T19:56:29.152985] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-13T19:56:29.153076] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 39.8s. Estimated remaining: 2h 36m 53s. Rate: 7.1 symbols/min [2025-10-13T19:56:29.221105] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-13T19:56:29.361802] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:56:29.365323] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:29.402974] [DEBUG] [LOCAL ] LII: Loaded 28417 existing records from primary storage. [2025-10-13T19:56:29.403280] [INFO ] [MAIN ] LII: Loaded 28417 existing records. [2025-10-13T19:56:29.586253] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:29.586464] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-13T19:56:29.586512] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-13T19:56:29.587560] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-13T19:56:29.587620] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-13T19:56:29.938275] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:30.017988] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-13T19:56:30.154894] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:56:30.362519] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T19:56:30.817928] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-13T19:56:31.560376] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:56:31.617893] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-13T19:56:31.845201] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:56:32.417983] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-13T19:56:33.142426] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:56:33.208450] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T19:56:33.217873] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-13T19:56:34.018066] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-13T19:56:34.122372] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:56:34.124470] [INFO ] [REMOTE ] LFT: Full fetch complete (23970 records). [2025-10-13T19:56:34.124546] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-13T19:56:34.479615] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-13T19:56:34.479725] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-13T19:56:34.480202] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-13T19:56:34.480242] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-13T19:56:34.480896] [DEBUG] [LOCAL ] LFT: Trimmed 23970 records to 18325 (keeping 200 days of data) [2025-10-13T19:56:34.588094] [DEBUG] [LOCAL ] LFT: Primary data saved (18325 records). [2025-10-13T19:56:34.588231] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-13T19:56:34.588342] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LFT took 33.8s. Estimated remaining: 2h 36m 42s. Rate: 7.1 symbols/min [2025-10-13T19:56:34.753066] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:34.793760] [DEBUG] [LOCAL ] LION: Loaded 46182 existing records from primary storage. [2025-10-13T19:56:34.794057] [INFO ] [MAIN ] LION: Loaded 46182 existing records. [2025-10-13T19:56:34.824204] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-13T19:56:34.977921] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:34.978140] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-13T19:56:34.978187] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-13T19:56:34.979124] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-13T19:56:34.979183] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-13T19:56:35.325574] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:35.617959] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-13T19:56:35.847092] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:56:36.374599] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:56:36.417893] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-13T19:56:36.603920] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:56:37.217970] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-13T19:56:37.699439] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:56:38.017981] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-13T19:56:38.527201] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:56:38.817967] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-13T19:56:39.377100] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:56:39.381028] [INFO ] [REMOTE ] LH: Full fetch complete (54883 records). [2025-10-13T19:56:39.381122] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-13T19:56:39.627449] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-13T19:56:39.714100] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T19:56:39.799164] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-13T19:56:39.799246] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-13T19:56:39.800120] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-13T19:56:39.800182] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-13T19:56:39.802126] [DEBUG] [LOCAL ] LH: Trimmed 54883 records to 37690 (keeping 200 days of data) [2025-10-13T19:56:40.050062] [DEBUG] [LOCAL ] LH: Primary data saved (37690 records). [2025-10-13T19:56:40.050216] [INFO ] [MAIN ] LH: Full history saved. [2025-10-13T19:56:40.050311] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 32.6s. Estimated remaining: 2h 36m 31s. Rate: 7.1 symbols/min [2025-10-13T19:56:40.227229] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:40.235734] [DEBUG] [LOCAL ] LITB: Loaded 4305 existing records from primary storage. [2025-10-13T19:56:40.236069] [INFO ] [MAIN ] LITB: Loaded 4305 existing records. [2025-10-13T19:56:40.423243] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-13T19:56:40.471565] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:40.472447] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-13T19:56:40.472524] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-13T19:56:40.472961] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-13T19:56:40.473038] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-13T19:56:41.074951] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:41.218002] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-13T19:56:41.435787] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:56:41.685910] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T19:56:41.782361] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:56:42.017962] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-13T19:56:42.570128] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T19:56:42.817925] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-13T19:56:43.617962] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-13T19:56:43.885407] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:56:44.417992] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-13T19:56:45.217949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-13T19:56:45.426751] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:56:45.853731] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:56:46.017926] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-13T19:56:46.291889] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T19:56:46.817964] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-13T19:56:47.617898] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-13T19:56:47.784250] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:56:48.031842] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:56:48.417924] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-13T19:56:49.074572] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:56:49.217973] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-13T19:56:49.989739] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:56:50.017896] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-13T19:56:50.736485] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:56:50.817950] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-13T19:56:51.255049] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T19:56:51.609849] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:56:51.619395] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-13T19:56:52.417918] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-13T19:56:52.949673] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:56:53.093056] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T19:56:53.218003] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-13T19:56:54.017976] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-13T19:56:54.817957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-13T19:56:55.250956] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:56:55.280831] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:56:55.571598] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:56:55.617884] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-13T19:56:56.159537] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T19:56:56.417998] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-13T19:56:57.217930] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-13T19:56:58.017913] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-13T19:56:58.327562] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:56:58.524128] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T19:56:58.623287] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:56:58.817959] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-13T19:56:59.617974] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-13T19:56:59.768366] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T19:57:00.417963] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-13T19:57:01.217980] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-13T19:57:01.619530] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:57:01.716562] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T19:57:02.017967] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-13T19:57:02.590353] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T19:57:02.817981] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-13T19:57:03.617923] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-13T19:57:03.995050] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:57:04.028584] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T19:57:04.031809] [INFO ] [REMOTE ] LII: Full fetch complete (41230 records). [2025-10-13T19:57:04.031888] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-13T19:57:04.126102] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T19:57:04.413150] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-13T19:57:04.413270] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-13T19:57:04.414453] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-13T19:57:04.414533] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-13T19:57:04.416176] [DEBUG] [LOCAL ] LII: Trimmed 41230 records to 27925 (keeping 200 days of data) [2025-10-13T19:57:04.417962] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-13T19:57:04.611045] [DEBUG] [LOCAL ] LII: Primary data saved (27925 records). [2025-10-13T19:57:04.611273] [INFO ] [MAIN ] LII: Full history saved. [2025-10-13T19:57:04.611381] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 35.5s. Estimated remaining: 2h 36m 37s. Rate: 7.1 symbols/min [2025-10-13T19:57:04.793027] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:04.848159] [DEBUG] [LOCAL ] LLY: Loaded 54048 existing records from primary storage. [2025-10-13T19:57:04.848610] [INFO ] [MAIN ] LLY: Loaded 54048 existing records. [2025-10-13T19:57:05.038475] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:05.038805] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-13T19:57:05.038861] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-13T19:57:05.040201] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-13T19:57:05.040261] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-13T19:57:05.223921] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-13T19:57:05.421701] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:05.739740] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T19:57:06.017910] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-13T19:57:06.253364] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:57:06.817958] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-13T19:57:07.617955] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-13T19:57:08.417978] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-13T19:57:08.496722] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-13T19:57:08.538429] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:57:09.217995] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-13T19:57:09.276085] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:57:09.305155] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T19:57:10.017926] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-13T19:57:10.614681] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T19:57:10.615851] [INFO ] [REMOTE ] LITB: Full fetch complete (5663 records). [2025-10-13T19:57:10.615929] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-13T19:57:10.823255] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-13T19:57:10.997329] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T19:57:11.004500] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-13T19:57:11.004579] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-13T19:57:11.009161] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-13T19:57:11.009515] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-13T19:57:11.010165] [DEBUG] [LOCAL ] LITB: Trimmed 5663 records to 4216 (keeping 200 days of data) [2025-10-13T19:57:11.010081] [INFO ] [REMOTE ] LION: Full fetch complete (56611 records). [2025-10-13T19:57:11.010521] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-13T19:57:11.171292] [DEBUG] [LOCAL ] LITB: Primary data saved (4216 records). [2025-10-13T19:57:11.188230] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-13T19:57:11.188374] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LITB took 31.1s. Estimated remaining: 2h 36m 27s. Rate: 7.1 symbols/min [2025-10-13T19:57:11.550033] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:11.618904] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-13T19:57:11.638905] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-13T19:57:11.639196] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-13T19:57:11.640266] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-13T19:57:11.640384] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-13T19:57:11.643369] [DEBUG] [LOCAL ] LION: Trimmed 56611 records to 46070 (keeping 200 days of data) [2025-10-13T19:57:11.869398] [DEBUG] [LOCAL ] LMND: Loaded 52761 existing records from primary storage. [2025-10-13T19:57:11.900270] [INFO ] [MAIN ] LMND: Loaded 52761 existing records. [2025-10-13T19:57:12.091066] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:12.092785] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-13T19:57:12.092857] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-13T19:57:12.095196] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-13T19:57:12.096737] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-13T19:57:12.497087] [DEBUG] [LOCAL ] LION: Primary data saved (46070 records). [2025-10-13T19:57:12.497270] [INFO ] [MAIN ] LION: Full history saved. [2025-10-13T19:57:12.526491] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LION took 37.9s. Estimated remaining: 2h 36m 12s. Rate: 7.1 symbols/min [2025-10-13T19:57:12.526353] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:12.526952] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-13T19:57:12.711873] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:12.764898] [DEBUG] [LOCAL ] LMT: Loaded 50457 existing records from primary storage. [2025-10-13T19:57:12.765365] [INFO ] [MAIN ] LMT: Loaded 50457 existing records. [2025-10-13T19:57:12.968099] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:12.968765] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-13T19:57:12.968836] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-13T19:57:12.970549] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-13T19:57:12.970616] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-13T19:57:13.353116] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:13.353807] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-13T19:57:13.388550] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-13T19:57:13.781245] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-13T19:57:13.787012] [INFO ] [REMOTE ] LHX: Full fetch complete (70590 records). [2025-10-13T19:57:13.787290] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-13T19:57:14.042964] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-13T19:57:14.221263] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-13T19:57:14.221379] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-13T19:57:14.222905] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-13T19:57:14.222992] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-13T19:57:14.225157] [DEBUG] [LOCAL ] LHX: Trimmed 70590 records to 48591 (keeping 200 days of data) [2025-10-13T19:57:14.564568] [DEBUG] [LOCAL ] LHX: Primary data saved (48591 records). [2025-10-13T19:57:14.564836] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-13T19:57:14.564972] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LHX took 49.7s. Estimated remaining: 2h 35m 58s. Rate: 7.1 symbols/min [2025-10-13T19:57:14.746103] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:14.794957] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-13T19:57:14.830343] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-13T19:57:14.854791] [DEBUG] [LOCAL ] LNC: Loaded 52341 existing records from primary storage. [2025-10-13T19:57:14.855196] [INFO ] [MAIN ] LNC: Loaded 52341 existing records. [2025-10-13T19:57:15.036985] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:15.037229] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-13T19:57:15.037287] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-13T19:57:15.038512] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-13T19:57:15.038572] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-13T19:57:15.398039] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:15.499269] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T19:57:15.617925] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-13T19:57:16.417919] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-13T19:57:16.466675] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-13T19:57:16.554343] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:57:17.218000] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-13T19:57:17.251238] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:57:18.018000] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-13T19:57:18.486770] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T19:57:18.704701] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:57:18.817985] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-13T19:57:19.617970] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-13T19:57:20.417968] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-13T19:57:20.561475] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-13T19:57:20.853701] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-13T19:57:21.217996] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-13T19:57:21.521503] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:57:22.005108] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:57:22.017881] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-13T19:57:22.817972] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-13T19:57:23.368694] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-13T19:57:23.627206] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-13T19:57:23.633314] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:57:24.417930] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-13T19:57:25.129601] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T19:57:25.217978] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-13T19:57:25.530210] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:57:26.017922] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-13T19:57:26.070785] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T19:57:26.817986] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-13T19:57:27.492376] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:57:27.617887] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-13T19:57:27.903597] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-13T19:57:28.417999] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-13T19:57:28.462348] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:57:28.921094] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:57:29.217924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-13T19:57:30.018004] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-13T19:57:30.818017] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-13T19:57:30.860439] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:57:30.952545] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-13T19:57:31.617988] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-13T19:57:32.066850] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T19:57:32.417964] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-13T19:57:32.863251] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T19:57:33.217928] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-13T19:57:33.335679] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T19:57:34.017909] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-13T19:57:34.510130] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T19:57:34.818022] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-13T19:57:35.141040] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T19:57:35.621211] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-13T19:57:35.823929] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:57:36.417927] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-13T19:57:37.064004] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-13T19:57:37.217919] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-13T19:57:38.017918] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-13T19:57:38.080627] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-13T19:57:38.126610] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:57:38.817924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-13T19:57:39.617889] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-13T19:57:39.788269] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-13T19:57:40.077351] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T19:57:40.177954] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:57:40.417924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-13T19:57:41.217926] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-13T19:57:41.434080] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:57:41.650478] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:57:41.655889] [INFO ] [REMOTE ] LNC: Full fetch complete (74353 records). [2025-10-13T19:57:41.655999] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-13T19:57:42.023918] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-13T19:57:42.042225] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-13T19:57:42.042302] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-13T19:57:42.044007] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-13T19:57:42.044173] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-13T19:57:42.046593] [DEBUG] [LOCAL ] LNC: Trimmed 74353 records to 51595 (keeping 200 days of data) [2025-10-13T19:57:42.367863] [DEBUG] [LOCAL ] LNC: Primary data saved (51595 records). [2025-10-13T19:57:42.368154] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-13T19:57:42.368260] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LNC took 27.8s. Estimated remaining: 2h 36m 7s. Rate: 7.1 symbols/min [2025-10-13T19:57:42.536669] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:42.543219] [DEBUG] [LOCAL ] LND: Loaded 5034 existing records from primary storage. [2025-10-13T19:57:42.543391] [INFO ] [MAIN ] LND: Loaded 5034 existing records. [2025-10-13T19:57:42.720226] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:42.720470] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-13T19:57:42.720526] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-13T19:57:42.720779] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-13T19:57:42.720838] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-13T19:57:42.827625] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-13T19:57:43.087627] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:43.617910] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-13T19:57:44.067729] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-13T19:57:44.146386] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-13T19:57:44.417913] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-13T19:57:44.454868] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:57:44.711154] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:57:44.716846] [INFO ] [REMOTE ] LMND: Full fetch complete (75341 records). [2025-10-13T19:57:44.716981] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-13T19:57:45.109498] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-13T19:57:45.109577] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-13T19:57:45.110613] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-13T19:57:45.110726] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-13T19:57:45.112126] [DEBUG] [LOCAL ] LMND: Trimmed 75341 records to 52006 (keeping 200 days of data) [2025-10-13T19:57:45.218678] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-13T19:57:45.421724] [DEBUG] [LOCAL ] LMND: Primary data saved (52006 records). [2025-10-13T19:57:45.421857] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-13T19:57:45.421936] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 34.2s. Estimated remaining: 2h 35m 53s. Rate: 7.1 symbols/min [2025-10-13T19:57:45.590877] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:45.641602] [DEBUG] [LOCAL ] LNG: Loaded 52045 existing records from primary storage. [2025-10-13T19:57:45.641936] [INFO ] [MAIN ] LNG: Loaded 52045 existing records. [2025-10-13T19:57:45.834411] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:45.838995] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-13T19:57:45.839572] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-13T19:57:45.839853] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T19:57:45.841664] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-13T19:57:45.842619] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-13T19:57:46.021076] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-13T19:57:46.219526] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:46.435116] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-13T19:57:46.440098] [INFO ] [REMOTE ] LMT: Full fetch complete (72347 records). [2025-10-13T19:57:46.440198] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-13T19:57:46.838346] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-13T19:57:46.867026] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-13T19:57:46.867395] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-13T19:57:46.867269] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:57:46.869341] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-13T19:57:46.869585] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-13T19:57:46.873867] [DEBUG] [LOCAL ] LMT: Trimmed 72347 records to 49667 (keeping 200 days of data) [2025-10-13T19:57:47.186598] [DEBUG] [LOCAL ] LMT: Primary data saved (49667 records). [2025-10-13T19:57:47.186759] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-13T19:57:47.186845] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 34.7s. Estimated remaining: 2h 35m 39s. Rate: 7.1 symbols/min [2025-10-13T19:57:47.350601] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:47.362725] [DEBUG] [LOCAL ] LNN: Loaded 11409 existing records from primary storage. [2025-10-13T19:57:47.362920] [INFO ] [MAIN ] LNN: Loaded 11409 existing records. [2025-10-13T19:57:47.533988] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:47.534238] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-13T19:57:47.534283] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-13T19:57:47.534569] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-13T19:57:47.534624] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-13T19:57:47.623063] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-13T19:57:47.881809] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:48.417925] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-13T19:57:49.217900] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-13T19:57:49.258966] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:57:49.512018] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:57:49.565665] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-13T19:57:49.903977] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T19:57:50.017982] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-13T19:57:50.813027] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:57:50.817870] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-13T19:57:50.924545] [DEBUG] [REMOTE ] LNN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T19:57:50.924907] [WARN ] [REMOTE ] LNN: No data returned for month 2025-02 [2025-10-13T19:57:50.924996] [FATAL] [REMOTE ] LNN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:57:50.925071] [FATAL] [MAIN ] LNN: Failed to fetch primary data. [2025-10-13T19:57:50.925133] [WARN ] [MAIN ] LNN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:57:50.925199] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-13T19:57:50.925261] [DEBUG] [LOCAL ] LNN: No primary data file found to delete. [2025-10-13T19:57:50.925297] [INFO ] [LOCAL ] LNN: Starting deletion of derivative data. [2025-10-13T19:57:50.925513] [DEBUG] [LOCAL ] LNN: Deleted derivative data file. [2025-10-13T19:57:50.925596] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNN took 3.7s. Estimated remaining: 2h 35m 27s. Rate: 7.1 symbols/min [2025-10-13T19:57:51.095975] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:51.134206] [DEBUG] [LOCAL ] LOAR: Loaded 42616 existing records from primary storage. [2025-10-13T19:57:51.134486] [INFO ] [MAIN ] LOAR: Loaded 42616 existing records. [2025-10-13T19:57:51.312232] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:51.312468] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-13T19:57:51.312515] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-13T19:57:51.313569] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-13T19:57:51.313631] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-13T19:57:51.628165] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-13T19:57:51.669319] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:52.418003] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-13T19:57:53.217981] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-13T19:57:53.690325] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-13T19:57:53.947504] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T19:57:53.953005] [INFO ] [REMOTE ] LLY: Full fetch complete (77241 records). [2025-10-13T19:57:53.953124] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-13T19:57:54.022625] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-13T19:57:54.154017] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:57:54.395109] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-13T19:57:54.395310] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-13T19:57:54.396744] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-13T19:57:54.396812] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-13T19:57:54.398386] [DEBUG] [LOCAL ] LLY: Trimmed 77241 records to 53276 (keeping 200 days of data) [2025-10-13T19:57:54.499758] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T19:57:54.742866] [DEBUG] [LOCAL ] LLY: Primary data saved (53276 records). [2025-10-13T19:57:54.743002] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-13T19:57:54.743154] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LLY took 50.1s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-13T19:57:54.823097] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-13T19:57:54.911014] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:54.937454] [DEBUG] [LOCAL ] LOB: Loaded 27539 existing records from primary storage. [2025-10-13T19:57:54.937766] [INFO ] [MAIN ] LOB: Loaded 27539 existing records. [2025-10-13T19:57:55.119700] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:55.119950] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-13T19:57:55.119997] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-13T19:57:55.120678] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-13T19:57:55.120752] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-13T19:57:55.490417] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:55.617920] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-13T19:57:56.417957] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-13T19:57:56.706191] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T19:57:56.761774] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:57:57.004257] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T19:57:57.217990] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-13T19:57:58.018029] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-13T19:57:58.607091] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:57:58.817928] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-13T19:57:59.472996] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T19:57:59.623871] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-13T19:57:59.637468] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-13T19:58:00.294007] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T19:58:00.417949] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-13T19:58:01.217919] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-13T19:58:01.450135] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:58:02.018048] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-13T19:58:02.600249] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:58:02.817964] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-13T19:58:03.336458] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T19:58:03.351210] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T19:58:03.352695] [INFO ] [REMOTE ] LND: Full fetch complete (7988 records). [2025-10-13T19:58:03.353116] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-13T19:58:03.623049] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-13T19:58:03.706124] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-13T19:58:03.706200] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-13T19:58:03.706401] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-13T19:58:03.706439] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-13T19:58:03.706853] [DEBUG] [LOCAL ] LND: Trimmed 7988 records to 5002 (keeping 200 days of data) [2025-10-13T19:58:03.736520] [DEBUG] [LOCAL ] LND: Primary data saved (5002 records). [2025-10-13T19:58:03.736636] [INFO ] [MAIN ] LND: Full history saved. [2025-10-13T19:58:03.736782] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LND took 21.4s. Estimated remaining: 2h 35m 6s. Rate: 7.1 symbols/min [2025-10-13T19:58:03.899862] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:03.905920] [DEBUG] [LOCAL ] LOCL: Loaded 3665 existing records from primary storage. [2025-10-13T19:58:03.906076] [INFO ] [MAIN ] LOCL: Loaded 3665 existing records. [2025-10-13T19:58:04.080172] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:04.080408] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-13T19:58:04.080456] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-13T19:58:04.080853] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-13T19:58:04.080912] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-13T19:58:04.422038] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-13T19:58:04.444956] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:04.763977] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:58:05.218037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-13T19:58:05.828053] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T19:58:06.017895] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-13T19:58:06.435837] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T19:58:06.817911] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-13T19:58:07.242570] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:58:07.617960] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-13T19:58:07.864637] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:58:08.417969] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-13T19:58:08.999023] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:58:09.217920] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-13T19:58:10.017995] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-13T19:58:10.309472] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:58:10.757061] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:58:10.817915] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-13T19:58:10.845848] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T19:58:11.617967] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-13T19:58:11.975984] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T19:58:12.417958] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-13T19:58:12.594534] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:58:13.217965] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-13T19:58:13.553616] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T19:58:13.855602] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:58:14.017901] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-13T19:58:14.471274] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T19:58:14.817917] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-13T19:58:15.617925] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-13T19:58:16.417896] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-13T19:58:16.820433] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:58:16.846039] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:58:17.217900] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-13T19:58:17.254479] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T19:58:18.023019] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-13T19:58:18.030841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T19:58:18.476769] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T19:58:18.817916] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-13T19:58:19.617899] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-13T19:58:20.325536] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:58:20.417898] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-13T19:58:21.217887] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-13T19:58:21.490150] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:58:21.547750] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:58:21.662103] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T19:58:22.017976] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-13T19:58:22.570871] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:58:22.817922] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-13T19:58:23.285685] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:58:23.617964] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-13T19:58:24.237781] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T19:58:24.417966] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-13T19:58:25.217919] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-13T19:58:25.739078] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T19:58:25.740536] [INFO ] [REMOTE ] LOCL: Full fetch complete (4459 records). [2025-10-13T19:58:25.740702] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-13T19:58:25.976797] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:58:26.025514] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-13T19:58:26.177622] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-13T19:58:26.177761] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-13T19:58:26.178054] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-13T19:58:26.178123] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-13T19:58:26.178574] [DEBUG] [LOCAL ] LOCL: Trimmed 4459 records to 3674 (keeping 200 days of data) [2025-10-13T19:58:26.200878] [DEBUG] [LOCAL ] LOCL: Primary data saved (3674 records). [2025-10-13T19:58:26.200993] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-13T19:58:26.201091] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 22.5s. Estimated remaining: 2h 35m 10s. Rate: 7.1 symbols/min [2025-10-13T19:58:26.381272] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:26.426932] [DEBUG] [LOCAL ] LOMA: Loaded 32810 existing records from primary storage. [2025-10-13T19:58:26.427340] [INFO ] [MAIN ] LOMA: Loaded 32810 existing records. [2025-10-13T19:58:26.615980] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:26.616288] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-13T19:58:26.616338] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-13T19:58:26.616707] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-13T19:58:26.616766] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-13T19:58:26.826965] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-13T19:58:26.996310] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:27.617914] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-13T19:58:27.808030] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:58:28.362158] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:58:28.422991] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-13T19:58:28.432680] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:58:29.144723] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T19:58:29.149925] [INFO ] [REMOTE ] LNG: Full fetch complete (74615 records). [2025-10-13T19:58:29.150055] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-13T19:58:29.223144] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-13T19:58:29.532586] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-13T19:58:29.532690] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-13T19:58:29.533633] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-13T19:58:29.533711] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-13T19:58:29.535158] [DEBUG] [LOCAL ] LNG: Trimmed 74615 records to 51287 (keeping 200 days of data) [2025-10-13T19:58:29.856346] [DEBUG] [LOCAL ] LNG: Primary data saved (51287 records). [2025-10-13T19:58:29.856480] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-13T19:58:29.856560] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 44.4s. Estimated remaining: 2h 34m 57s. Rate: 7.1 symbols/min [2025-10-13T19:58:30.021413] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-13T19:58:30.022911] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:30.073205] [DEBUG] [LOCAL ] LOW: Loaded 53753 existing records from primary storage. [2025-10-13T19:58:30.073541] [INFO ] [MAIN ] LOW: Loaded 53753 existing records. [2025-10-13T19:58:30.250990] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:30.251385] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-13T19:58:30.251447] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-13T19:58:30.252506] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-13T19:58:30.252565] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-13T19:58:30.617305] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:30.639282] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:58:30.817981] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-13T19:58:31.289959] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T19:58:31.617911] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-13T19:58:32.153683] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:58:32.157767] [INFO ] [REMOTE ] LOAR: Full fetch complete (56046 records). [2025-10-13T19:58:32.157859] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-13T19:58:32.423039] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-13T19:58:32.537889] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-13T19:58:32.538029] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-13T19:58:32.538897] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-13T19:58:32.538960] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-13T19:58:32.540115] [DEBUG] [LOCAL ] LOAR: Trimmed 56046 records to 42298 (keeping 200 days of data) [2025-10-13T19:58:32.791932] [DEBUG] [LOCAL ] LOAR: Primary data saved (42298 records). [2025-10-13T19:58:32.792062] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-13T19:58:32.792178] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 41.9s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-13T19:58:32.962906] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:33.005770] [DEBUG] [LOCAL ] LPG: Loaded 40224 existing records from primary storage. [2025-10-13T19:58:33.006191] [INFO ] [MAIN ] LPG: Loaded 40224 existing records. [2025-10-13T19:58:33.171691] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:58:33.230429] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-13T19:58:33.238063] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:33.238525] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-13T19:58:33.238583] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-13T19:58:33.239186] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-13T19:58:33.239395] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-13T19:58:33.600321] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:34.017888] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-13T19:58:34.101630] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:58:34.456758] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:58:34.459732] [INFO ] [REMOTE ] LOB: Full fetch complete (38057 records). [2025-10-13T19:58:34.459810] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-13T19:58:34.825099] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-13T19:58:34.827249] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-13T19:58:34.827325] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-13T19:58:34.828049] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-13T19:58:34.828126] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-13T19:58:34.829607] [DEBUG] [LOCAL ] LOB: Trimmed 38057 records to 26773 (keeping 200 days of data) [2025-10-13T19:58:35.005736] [DEBUG] [LOCAL ] LOB: Primary data saved (26773 records). [2025-10-13T19:58:35.005934] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-13T19:58:35.006037] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 40.3s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-13T19:58:35.188941] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:35.219247] [DEBUG] [LOCAL ] LPL: Loaded 28058 existing records from primary storage. [2025-10-13T19:58:35.219609] [INFO ] [MAIN ] LPL: Loaded 28058 existing records. [2025-10-13T19:58:35.415246] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:35.415882] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-13T19:58:35.416218] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-13T19:58:35.417004] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-13T19:58:35.417065] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-13T19:58:35.627137] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-13T19:58:35.617326] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:58:35.846276] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:36.364094] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:58:36.417955] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-13T19:58:37.217908] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-13T19:58:37.552970] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T19:58:38.023023] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-13T19:58:38.028749] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T19:58:38.327005] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:58:38.817966] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-13T19:58:39.617971] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-13T19:58:39.843141] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T19:58:40.107387] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:58:40.418008] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-13T19:58:40.859424] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:58:41.217968] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-13T19:58:42.017912] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-13T19:58:42.247147] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:58:42.393093] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T19:58:42.818207] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-13T19:58:42.923008] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T19:58:43.618005] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-13T19:58:44.409807] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T19:58:44.418021] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-13T19:58:45.217929] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-13T19:58:45.400598] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:58:45.593566] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T19:58:46.018014] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-13T19:58:46.752069] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:58:46.817902] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-13T19:58:47.033817] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T19:58:47.617930] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-13T19:58:48.141451] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T19:58:48.417929] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-13T19:58:48.823638] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:58:49.217913] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-13T19:58:49.590825] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T19:58:50.017910] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-13T19:58:50.283930] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T19:58:50.817922] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-13T19:58:51.273714] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T19:58:51.617961] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-13T19:58:52.423345] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-13T19:58:52.440308] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:58:52.890767] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T19:58:53.217928] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-13T19:58:54.017917] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-13T19:58:54.214370] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:58:54.308046] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T19:58:54.817923] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-13T19:58:55.516065] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:58:55.617921] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-13T19:58:56.251696] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:58:56.417933] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-13T19:58:57.059580] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:58:57.063482] [INFO ] [REMOTE ] LOMA: Full fetch complete (47801 records). [2025-10-13T19:58:57.063567] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-13T19:58:57.218477] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-13T19:58:57.450442] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-13T19:58:57.450527] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-13T19:58:57.451333] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-13T19:58:57.451396] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-13T19:58:57.452506] [DEBUG] [LOCAL ] LOMA: Trimmed 47801 records to 32558 (keeping 200 days of data) [2025-10-13T19:58:57.644176] [DEBUG] [LOCAL ] LOMA: Primary data saved (32558 records). [2025-10-13T19:58:57.644323] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-13T19:58:57.644407] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOMA took 31.4s. Estimated remaining: 2h 34m 34s. Rate: 7.1 symbols/min [2025-10-13T19:58:57.818454] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:57.854105] [DEBUG] [LOCAL ] LPX: Loaded 40508 existing records from primary storage. [2025-10-13T19:58:57.854466] [INFO ] [MAIN ] LPX: Loaded 40508 existing records. [2025-10-13T19:58:58.031114] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-13T19:58:58.036996] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:58.038268] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-13T19:58:58.038374] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-13T19:58:58.039225] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-13T19:58:58.039297] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-13T19:58:58.414468] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:58.449754] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T19:58:58.823008] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-13T19:58:58.837575] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T19:58:59.200278] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:58:59.618010] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-13T19:59:00.417902] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-13T19:59:00.789378] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T19:59:01.217933] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-13T19:59:01.291975] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T19:59:02.018038] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-13T19:59:02.068665] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:59:02.817931] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-13T19:59:03.618005] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-13T19:59:03.681829] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-13T19:59:03.788438] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:59:04.397262] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T19:59:04.417886] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-13T19:59:05.111703] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:59:05.217906] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-13T19:59:05.490764] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:59:06.018010] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-13T19:59:06.790563] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:59:06.797408] [INFO ] [REMOTE ] LOW: Full fetch complete (76533 records). [2025-10-13T19:59:06.797579] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-13T19:59:06.823144] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-13T19:59:07.008014] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:59:07.276877] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-13T19:59:07.276980] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-13T19:59:07.278011] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-13T19:59:07.278075] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-13T19:59:07.279720] [DEBUG] [LOCAL ] LOW: Trimmed 76533 records to 52993 (keeping 200 days of data) [2025-10-13T19:59:07.619845] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-13T19:59:07.646615] [DEBUG] [LOCAL ] LOW: Primary data saved (52993 records). [2025-10-13T19:59:07.646938] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-13T19:59:07.647081] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOW took 37.8s. Estimated remaining: 2h 34m 27s. Rate: 7.1 symbols/min [2025-10-13T19:59:07.835773] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:59:07.875313] [DEBUG] [LOCAL ] LRN: Loaded 40180 existing records from primary storage. [2025-10-13T19:59:07.875683] [INFO ] [MAIN ] LRN: Loaded 40180 existing records. [2025-10-13T19:59:08.054195] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:59:08.054404] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-13T19:59:08.054452] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-13T19:59:08.055172] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-13T19:59:08.055230] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-13T19:59:08.423138] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-13T19:59:08.440268] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:59:08.463981] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:59:09.182194] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:59:09.217890] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-13T19:59:09.997053] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:59:10.001449] [INFO ] [REMOTE ] LPL: Full fetch complete (36573 records). [2025-10-13T19:59:10.001544] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-13T19:59:10.023185] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-13T19:59:10.378803] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-13T19:59:10.378883] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-13T19:59:10.379556] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-13T19:59:10.379603] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-13T19:59:10.380450] [DEBUG] [LOCAL ] LPL: Trimmed 36573 records to 27908 (keeping 200 days of data) [2025-10-13T19:59:10.536800] [DEBUG] [LOCAL ] LPL: Primary data saved (27908 records). [2025-10-13T19:59:10.536929] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-13T19:59:10.537008] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPL took 35.5s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-13T19:59:10.707883] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:59:10.750431] [DEBUG] [LOCAL ] LSPD: Loaded 43440 existing records from primary storage. [2025-10-13T19:59:10.750981] [INFO ] [MAIN ] LSPD: Loaded 43440 existing records. [2025-10-13T19:59:10.820214] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-13T19:59:10.938535] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:59:10.971179] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:59:10.971514] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-13T19:59:10.971597] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-13T19:59:10.972524] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-13T19:59:10.972599] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-13T19:59:11.350551] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:59:11.521935] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:59:11.617893] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-13T19:59:12.258471] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:59:12.262778] [INFO ] [REMOTE ] LPG: Full fetch complete (59138 records). [2025-10-13T19:59:12.262913] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-13T19:59:12.443506] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-13T19:59:12.658799] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-13T19:59:12.658896] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-13T19:59:12.659920] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-13T19:59:12.659985] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-13T19:59:12.661317] [DEBUG] [LOCAL ] LPG: Trimmed 59138 records to 39569 (keeping 200 days of data) [2025-10-13T19:59:12.905596] [DEBUG] [LOCAL ] LPG: Primary data saved (39569 records). [2025-10-13T19:59:12.905986] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-13T19:59:12.906150] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPG took 40.1s. Estimated remaining: 2h 34m 0s. Rate: 7.1 symbols/min [2025-10-13T19:59:13.078817] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:59:13.108706] [DEBUG] [LOCAL ] LTC: Loaded 30684 existing records from primary storage. [2025-10-13T19:59:13.109024] [INFO ] [MAIN ] LTC: Loaded 30684 existing records. [2025-10-13T19:59:13.221751] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-13T19:59:13.318376] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:59:13.322303] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-13T19:59:13.322451] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-13T19:59:13.325997] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:59:13.323436] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-13T19:59:13.335260] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-13T19:59:13.696464] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:59:13.723342] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T19:59:14.017976] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-13T19:59:14.817926] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-13T19:59:14.872320] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T19:59:15.277210] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T19:59:15.617929] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-13T19:59:15.997681] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:59:16.417926] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-13T19:59:17.200595] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:59:17.217883] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-13T19:59:17.694511] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T19:59:18.017999] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-13T19:59:18.819218] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-13T19:59:18.831780] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:59:18.895295] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T19:59:19.617914] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-13T19:59:20.387176] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:59:20.417883] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-13T19:59:21.052225] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:59:21.218011] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-13T19:59:21.968555] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T19:59:22.017882] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-13T19:59:22.579238] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T19:59:22.817980] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-13T19:59:23.543913] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T19:59:23.617933] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-13T19:59:24.104985] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T19:59:24.417933] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-13T19:59:24.847015] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:59:25.218003] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-13T19:59:25.831851] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:59:26.017975] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-13T19:59:26.407354] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T19:59:26.817917] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-13T19:59:27.058674] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T19:59:27.617965] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-13T19:59:28.417891] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-13T19:59:28.453707] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T19:59:28.582721] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T19:59:29.217963] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-13T19:59:29.801731] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T19:59:30.018007] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-13T19:59:30.659096] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:59:30.817921] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-13T19:59:31.617981] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-13T19:59:31.694374] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T19:59:32.227204] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:59:32.417923] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-13T19:59:33.110363] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:59:33.218002] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-13T19:59:33.548483] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:59:34.017980] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-13T19:59:34.663879] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:59:34.817978] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-13T19:59:35.535389] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:59:35.618018] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-13T19:59:36.257549] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T19:59:36.418002] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-13T19:59:37.114044] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:59:37.217974] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-13T19:59:37.871104] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T19:59:38.017966] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-13T19:59:38.672290] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:59:38.676598] [INFO ] [REMOTE ] LRN: Full fetch complete (58354 records). [2025-10-13T19:59:38.676788] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-13T19:59:38.823189] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-13T19:59:39.109680] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-13T19:59:39.109794] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-13T19:59:39.110826] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-13T19:59:39.110893] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-13T19:59:39.112297] [DEBUG] [LOCAL ] LRN: Trimmed 58354 records to 39598 (keeping 200 days of data) [2025-10-13T19:59:39.356633] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:59:39.368976] [INFO ] [REMOTE ] LSPD: Full fetch complete (61694 records). [2025-10-13T19:59:39.369820] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-13T19:59:39.516371] [DEBUG] [LOCAL ] LRN: Primary data saved (39598 records). [2025-10-13T19:59:39.526956] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-13T19:59:39.532282] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 31.9s. Estimated remaining: 2h 34m 7s. Rate: 7.1 symbols/min [2025-10-13T19:59:39.623144] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-13T19:59:39.988857] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:59:40.012450] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-13T19:59:40.012568] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-13T19:59:40.013663] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-13T19:59:40.013751] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-13T19:59:40.015678] [DEBUG] [LOCAL ] LSPD: Trimmed 61694 records to 42619 (keeping 200 days of data) [2025-10-13T19:59:40.309300] [DEBUG] [LOCAL ] LTH: Loaded 52485 existing records from primary storage. [2025-10-13T19:59:40.321217] [INFO ] [MAIN ] LTH: Loaded 52485 existing records. [2025-10-13T19:59:40.384416] [DEBUG] [LOCAL ] LSPD: Primary data saved (42619 records). [2025-10-13T19:59:40.432100] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-13T19:59:40.444335] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LSPD took 29.9s. Estimated remaining: 2h 33m 53s. Rate: 7.1 symbols/min [2025-10-13T19:59:40.532715] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:59:40.533195] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-13T19:59:40.533422] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-13T19:59:40.541732] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-13T19:59:40.555064] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-13T19:59:40.616324] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:59:40.674929] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-13T19:59:40.949915] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:59:41.223131] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-13T19:59:41.232143] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:59:41.238667] [INFO ] [REMOTE ] LPX: Full fetch complete (58862 records). [2025-10-13T19:59:41.238820] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-13T19:59:41.654057] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-13T19:59:41.654174] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-13T19:59:41.655209] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-13T19:59:41.655278] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-13T19:59:41.656994] [DEBUG] [LOCAL ] LPX: Trimmed 58862 records to 40079 (keeping 200 days of data) [2025-10-13T19:59:41.911869] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T19:59:41.958561] [DEBUG] [LOCAL ] LPX: Primary data saved (40079 records). [2025-10-13T19:59:41.958776] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-13T19:59:41.958879] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LPX took 44.3s. Estimated remaining: 2h 33m 38s. Rate: 7.1 symbols/min [2025-10-13T19:59:42.017978] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-13T19:59:42.785570] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T19:59:42.817899] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-13T19:59:43.438747] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:59:43.618025] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-13T19:59:44.449514] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T19:59:44.460847] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-13T19:59:45.028368] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:59:45.032309] [INFO ] [REMOTE ] LTC: Full fetch complete (43525 records). [2025-10-13T19:59:45.032408] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-13T19:59:45.427963] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-13T19:59:45.428104] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-13T19:59:45.429034] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-13T19:59:45.429098] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-13T19:59:45.430377] [DEBUG] [LOCAL ] LTC: Trimmed 43525 records to 30464 (keeping 200 days of data) [2025-10-13T19:59:45.628161] [DEBUG] [LOCAL ] LTC: Primary data saved (30464 records). [2025-10-13T19:59:45.628351] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-13T19:59:45.628455] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTC took 32.7s. Estimated remaining: 2h 33m 26s. Rate: 7.1 symbols/min [2025-10-13T19:59:46.150149] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:59:46.160284] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-13T19:59:47.889935] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T19:59:47.901441] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-13T19:59:49.613503] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:59:49.625637] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-13T19:59:51.422275] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:59:51.433669] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-13T19:59:53.189993] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:59:53.201971] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-13T19:59:54.904980] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:59:54.917193] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-13T19:59:56.567071] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:59:56.582892] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-13T19:59:58.243536] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:59:58.255696] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-13T19:59:59.867586] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:59:59.873430] [INFO ] [REMOTE ] LTH: Full fetch complete (74477 records). [2025-10-13T19:59:59.873595] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-13T20:00:00.291060] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-13T20:00:00.291186] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-13T20:00:00.292389] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-13T20:00:00.292458] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-13T20:00:00.294413] [DEBUG] [LOCAL ] LTH: Trimmed 74477 records to 51751 (keeping 200 days of data) [2025-10-13T20:00:00.622502] [DEBUG] [LOCAL ] LTH: Primary data saved (51751 records). [2025-10-13T20:00:00.622722] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-13T20:00:00.622831] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 21.1s. Estimated remaining: 2h 33m 23s. Rate: 7.1 symbols/min [2025-10-13T20:00:01.314455] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:01.348526] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:01.402739] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:01.482433] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:01.611147] [DEBUG] [LOCAL ] LTM: Loaded 38625 existing records from primary storage. [2025-10-13T20:00:01.609367] [DEBUG] [LOCAL ] LU: Loaded 49739 existing records from primary storage. [2025-10-13T20:00:01.610451] [DEBUG] [LOCAL ] LUMN: Loaded 54420 existing records from primary storage. [2025-10-13T20:00:01.611814] [INFO ] [MAIN ] LTM: Loaded 38625 existing records. [2025-10-13T20:00:01.612581] [DEBUG] [LOCAL ] LUCK: Loaded 24680 existing records from primary storage. [2025-10-13T20:00:01.612712] [INFO ] [MAIN ] LU: Loaded 49739 existing records. [2025-10-13T20:00:01.618251] [INFO ] [MAIN ] LUCK: Loaded 24680 existing records. [2025-10-13T20:00:01.618465] [INFO ] [MAIN ] LUMN: Loaded 54420 existing records. [2025-10-13T20:00:02.422469] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:02.440921] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:02.484490] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:02.517680] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-13T20:00:02.517978] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-13T20:00:02.493582] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-13T20:00:02.517486] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:02.518288] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-13T20:00:02.518508] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-13T20:00:02.518604] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-13T20:00:02.519573] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-13T20:00:02.519731] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-13T20:00:02.519677] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-13T20:00:02.520011] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-13T20:00:02.518178] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-13T20:00:02.519911] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-13T20:00:02.575929] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-13T20:00:02.612196] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-13T20:00:02.585326] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-13T20:00:02.627890] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-13T20:00:03.994263] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:04.070057] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-13T20:00:04.028011] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:04.138842] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:04.081848] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-13T20:00:04.145207] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:04.146097] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-13T20:00:04.146873] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-13T20:00:05.234217] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T20:00:05.239524] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-13T20:00:05.358908] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T20:00:05.364764] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-13T20:00:05.525853] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:00:05.537428] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-13T20:00:06.309063] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-13T20:00:06.320966] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-13T20:00:06.363079] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T20:00:06.365919] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T20:00:06.380035] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-13T20:00:06.380898] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-13T20:00:07.238114] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T20:00:07.249392] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-13T20:00:07.413494] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T20:00:07.421573] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-13T20:00:07.486819] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T20:00:07.492861] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-13T20:00:08.309799] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-13T20:00:08.321515] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-13T20:00:08.846594] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T20:00:08.873929] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-13T20:00:08.879843] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:00:08.888073] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-13T20:00:08.948570] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:00:08.955473] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-13T20:00:10.262914] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T20:00:10.308437] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-13T20:00:10.312760] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T20:00:10.324788] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-13T20:00:10.362236] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T20:00:10.373029] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-13T20:00:10.416093] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T20:00:10.428918] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-13T20:00:11.603011] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:00:11.612191] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-13T20:00:11.855504] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:00:11.863522] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-13T20:00:12.136484] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T20:00:12.148926] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-13T20:00:12.275525] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T20:00:12.288207] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-13T20:00:12.868627] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T20:00:12.875492] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-13T20:00:13.320273] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T20:00:13.329941] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-13T20:00:13.749821] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T20:00:13.761331] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-13T20:00:13.864043] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T20:00:14.017984] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-13T20:00:14.357780] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T20:00:14.818005] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-13T20:00:14.891436] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T20:00:15.419310] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:00:15.523066] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T20:00:15.617960] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-13T20:00:15.870460] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T20:00:16.417979] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-13T20:00:17.218013] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-13T20:00:17.362139] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T20:00:17.627899] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T20:00:18.017980] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-13T20:00:18.214315] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T20:00:18.817976] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-13T20:00:19.324579] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:00:19.617977] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-13T20:00:20.417919] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-13T20:00:20.572948] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T20:00:21.217929] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-13T20:00:21.323201] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T20:00:22.017974] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-13T20:00:22.120055] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T20:00:22.268933] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T20:00:22.272074] [INFO ] [REMOTE ] LUCK: Full fetch complete (40116 records). [2025-10-13T20:00:22.272267] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-13T20:00:22.671309] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-13T20:00:22.671430] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-13T20:00:22.672396] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-13T20:00:22.672480] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-13T20:00:22.673893] [DEBUG] [LOCAL ] LUCK: Trimmed 40116 records to 24238 (keeping 200 days of data) [2025-10-13T20:00:22.819837] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-13T20:00:22.827105] [DEBUG] [LOCAL ] LUCK: Primary data saved (24238 records). [2025-10-13T20:00:22.828383] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-13T20:00:22.828563] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 22.2s. Estimated remaining: 2h 33m 26s. Rate: 7.1 symbols/min [2025-10-13T20:00:23.000951] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:23.058556] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-13T20:00:23.059070] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-10-13T20:00:23.242227] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:23.242517] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-13T20:00:23.242572] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-13T20:00:23.243968] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-13T20:00:23.244031] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-13T20:00:23.602671] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T20:00:23.624976] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-13T20:00:23.657530] [INFO ] [REMOTE ] LU: Full fetch complete (70502 records). [2025-10-13T20:00:23.676435] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-13T20:00:23.684251] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:24.111740] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-13T20:00:24.111870] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-13T20:00:24.112978] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-13T20:00:24.113048] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-13T20:00:24.115051] [DEBUG] [LOCAL ] LU: Trimmed 70502 records to 48999 (keeping 200 days of data) [2025-10-13T20:00:24.418486] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-13T20:00:24.419974] [DEBUG] [LOCAL ] LU: Primary data saved (48999 records). [2025-10-13T20:00:24.421275] [INFO ] [MAIN ] LU: Full history saved. [2025-10-13T20:00:24.421462] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LU took 23.8s. Estimated remaining: 2h 33m 12s. Rate: 7.1 symbols/min [2025-10-13T20:00:24.597690] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T20:00:24.642687] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:24.643397] [INFO ] [REMOTE ] LTM: Full fetch complete (49603 records). [2025-10-13T20:00:24.643178] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-13T20:00:24.643534] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-13T20:00:24.643805] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-13T20:00:24.644235] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-13T20:00:24.644302] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-13T20:00:24.700342] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-13T20:00:24.733762] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-13T20:00:25.406547] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-13T20:00:25.420205] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-13T20:00:25.422171] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-13T20:00:25.443260] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-13T20:00:25.511093] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:25.512019] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-13T20:00:25.514350] [DEBUG] [LOCAL ] LTM: Trimmed 49603 records to 38494 (keeping 200 days of data) [2025-10-13T20:00:25.653535] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T20:00:25.797777] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:00:25.802882] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-13T20:00:25.803052] [DEBUG] [LOCAL ] LTM: Primary data saved (38494 records). [2025-10-13T20:00:25.803370] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-13T20:00:25.803290] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:00:25.803497] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-13T20:00:25.803618] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LTM took 25.2s. Estimated remaining: 2h 32m 57s. Rate: 7.1 symbols/min [2025-10-13T20:00:25.803732] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:00:25.803882] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-13T20:00:25.835607] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-13T20:00:25.867701] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-13T20:00:25.867813] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-13T20:00:25.879766] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUXE took 1.5s. Estimated remaining: 2h 32m 42s. Rate: 7.1 symbols/min [2025-10-13T20:00:26.020710] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-13T20:00:26.093477] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:26.167923] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:26.222541] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T20:00:26.242550] [DEBUG] [LOCAL ] LVWR: Loaded 18359 existing records from primary storage. [2025-10-13T20:00:26.242898] [INFO ] [MAIN ] LVWR: Loaded 18359 existing records. [2025-10-13T20:00:26.399172] [DEBUG] [LOCAL ] LVS: Loaded 54349 existing records from primary storage. [2025-10-13T20:00:26.425708] [INFO ] [MAIN ] LVS: Loaded 54349 existing records. [2025-10-13T20:00:26.503975] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:26.538377] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-13T20:00:26.544137] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-13T20:00:26.574054] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-13T20:00:26.576581] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-13T20:00:26.780618] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:26.817324] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-13T20:00:26.828721] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-13T20:00:26.826485] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-13T20:00:26.871926] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-13T20:00:26.888039] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-13T20:00:27.214274] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:27.408193] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:27.621850] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-13T20:00:28.187323] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-13T20:00:28.215577] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-13T20:00:28.418011] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-13T20:00:28.750262] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T20:00:29.106010] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T20:00:29.218031] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-13T20:00:30.017993] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-13T20:00:30.817964] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-13T20:00:31.093982] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T20:00:31.172939] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T20:00:31.617994] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-13T20:00:32.187215] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T20:00:32.418052] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-13T20:00:33.217965] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-13T20:00:33.384490] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T20:00:34.018021] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-13T20:00:34.561780] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-13T20:00:34.568046] [INFO ] [REMOTE ] LUMN: Full fetch complete (77637 records). [2025-10-13T20:00:34.568264] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-13T20:00:34.820609] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-13T20:00:35.004785] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-13T20:00:35.004941] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-13T20:00:35.006506] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-13T20:00:35.006597] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-13T20:00:35.038998] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T20:00:35.049525] [DEBUG] [LOCAL ] LUMN: Trimmed 77637 records to 53646 (keeping 200 days of data) [2025-10-13T20:00:35.377982] [DEBUG] [LOCAL ] LUMN: Primary data saved (53646 records). [2025-10-13T20:00:35.378170] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-13T20:00:35.378288] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUMN took 34.7s. Estimated remaining: 2h 32m 34s. Rate: 7.1 symbols/min [2025-10-13T20:00:35.509320] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T20:00:35.574558] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:35.628487] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-13T20:00:35.634973] [DEBUG] [LOCAL ] LW: Loaded 51986 existing records from primary storage. [2025-10-13T20:00:35.635705] [INFO ] [MAIN ] LW: Loaded 51986 existing records. [2025-10-13T20:00:35.888569] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T20:00:35.894721] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:35.907217] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-13T20:00:35.907352] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-13T20:00:35.909108] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-13T20:00:35.909182] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-13T20:00:36.311416] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:36.417974] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-13T20:00:37.218011] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-13T20:00:37.854104] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-13T20:00:38.017909] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-13T20:00:38.420367] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T20:00:38.443942] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T20:00:38.817912] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-13T20:00:39.617883] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-13T20:00:39.906547] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T20:00:40.174264] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-13T20:00:40.417936] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-13T20:00:41.217905] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-13T20:00:41.540152] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T20:00:42.017904] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-13T20:00:42.198358] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T20:00:42.818005] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-13T20:00:43.133851] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T20:00:43.617930] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-13T20:00:43.965627] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:00:44.046994] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T20:00:44.417922] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-13T20:00:45.217963] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-13T20:00:45.691164] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-13T20:00:46.017880] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-13T20:00:46.229297] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T20:00:46.817935] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-13T20:00:46.926320] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T20:00:47.618042] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-13T20:00:48.195806] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T20:00:48.280113] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T20:00:48.417975] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-13T20:00:49.209728] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T20:00:49.219196] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-13T20:00:50.017899] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-13T20:00:50.286666] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T20:00:50.334941] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T20:00:50.817925] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-13T20:00:51.617902] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-13T20:00:51.629785] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T20:00:52.112849] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T20:00:52.417920] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-13T20:00:53.218011] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-13T20:00:53.504282] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T20:00:54.017908] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-13T20:00:54.365897] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T20:00:54.579299] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T20:00:54.817931] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-13T20:00:55.558691] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:00:55.564458] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-13T20:00:55.564602] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-13T20:00:55.623828] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-13T20:00:55.984027] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-13T20:00:55.984217] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-13T20:00:55.985542] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-13T20:00:55.985802] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-13T20:00:56.017491] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 53689 (keeping 200 days of data) [2025-10-13T20:00:56.019840] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T20:00:56.370483] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-13T20:00:56.370611] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-13T20:00:56.370740] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUV took 33.5s. Estimated remaining: 2h 32m 37s. Rate: 7.1 symbols/min [2025-10-13T20:00:56.424401] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-13T20:00:56.542633] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:00:56.560140] [DEBUG] [LOCAL ] LXFR: Loaded 16936 existing records from primary storage. [2025-10-13T20:00:56.560402] [INFO ] [MAIN ] LXFR: Loaded 16936 existing records. [2025-10-13T20:00:56.778765] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T20:00:56.778062] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:00:56.782987] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-13T20:00:56.783291] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-13T20:00:56.783772] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-13T20:00:56.783828] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-13T20:00:57.136933] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:00:57.217986] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-13T20:00:57.867627] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T20:00:58.017983] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-13T20:00:58.817936] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-13T20:00:59.049280] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T20:00:59.055012] [INFO ] [REMOTE ] LVS: Full fetch complete (77521 records). [2025-10-13T20:00:59.055140] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-13T20:00:59.257505] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T20:00:59.485433] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-13T20:00:59.485549] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-13T20:00:59.486763] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-13T20:00:59.486829] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-13T20:00:59.488593] [DEBUG] [LOCAL ] LVS: Trimmed 77521 records to 53570 (keeping 200 days of data) [2025-10-13T20:00:59.618307] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-13T20:00:59.829781] [DEBUG] [LOCAL ] LVS: Primary data saved (53570 records). [2025-10-13T20:00:59.829915] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-13T20:00:59.829994] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVS took 34.0s. Estimated remaining: 2h 32m 24s. Rate: 7.1 symbols/min [2025-10-13T20:00:59.999339] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:00.045929] [DEBUG] [LOCAL ] LXP: Loaded 51488 existing records from primary storage. [2025-10-13T20:01:00.046337] [INFO ] [MAIN ] LXP: Loaded 51488 existing records. [2025-10-13T20:01:00.229207] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:00.229574] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-13T20:01:00.229865] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-13T20:01:00.230954] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-13T20:01:00.231016] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-13T20:01:00.437620] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-13T20:01:00.619769] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:00.622330] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T20:01:00.668029] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T20:01:01.217924] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-13T20:01:01.478493] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T20:01:01.480533] [INFO ] [REMOTE ] LVWR: Full fetch complete (20480 records). [2025-10-13T20:01:01.480605] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-13T20:01:01.895551] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-13T20:01:01.895636] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-13T20:01:01.896374] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-13T20:01:01.896420] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-13T20:01:01.897112] [DEBUG] [LOCAL ] LVWR: Trimmed 20480 records to 18399 (keeping 200 days of data) [2025-10-13T20:01:02.014275] [DEBUG] [LOCAL ] LVWR: Primary data saved (18399 records). [2025-10-13T20:01:02.014422] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-13T20:01:02.014506] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVWR took 36.1s. Estimated remaining: 2h 32m 10s. Rate: 7.1 symbols/min [2025-10-13T20:01:02.019878] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-13T20:01:02.203094] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:02.236882] [DEBUG] [LOCAL ] LXU: Loaded 32306 existing records from primary storage. [2025-10-13T20:01:02.237246] [INFO ] [MAIN ] LXU: Loaded 32306 existing records. [2025-10-13T20:01:02.439149] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:02.439390] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-13T20:01:02.439438] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-13T20:01:02.440127] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-13T20:01:02.440188] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-13T20:01:02.822452] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-13T20:01:02.865526] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:02.897727] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T20:01:03.617920] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-13T20:01:03.959379] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T20:01:03.987206] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:01:04.417967] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-13T20:01:04.697025] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:01:05.217929] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-13T20:01:05.442907] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T20:01:06.017956] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-13T20:01:06.553615] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T20:01:06.817925] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-13T20:01:07.051235] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T20:01:07.617925] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-13T20:01:07.669759] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:01:08.417965] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-13T20:01:09.217900] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-13T20:01:09.325449] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T20:01:10.017931] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-13T20:01:10.201203] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T20:01:10.234057] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T20:01:10.817920] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-13T20:01:11.114873] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T20:01:11.617961] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-13T20:01:12.063403] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T20:01:12.417910] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-13T20:01:13.081498] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T20:01:13.217934] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-13T20:01:14.017991] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-13T20:01:14.156053] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T20:01:14.551331] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T20:01:14.817909] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-13T20:01:15.070902] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T20:01:15.617896] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-13T20:01:16.055425] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T20:01:16.418006] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-13T20:01:17.217917] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-13T20:01:17.305087] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T20:01:17.781693] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T20:01:17.840612] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T20:01:18.018007] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-13T20:01:18.817920] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-13T20:01:19.029271] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T20:01:19.617920] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-13T20:01:20.136048] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T20:01:20.417920] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-13T20:01:20.961398] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T20:01:20.967366] [INFO ] [REMOTE ] LW: Full fetch complete (74657 records). [2025-10-13T20:01:20.967597] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-13T20:01:21.220822] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-13T20:01:21.368564] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-13T20:01:21.368702] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-13T20:01:21.370167] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-13T20:01:21.370250] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-13T20:01:21.371929] [DEBUG] [LOCAL ] LW: Trimmed 74657 records to 51248 (keeping 200 days of data) [2025-10-13T20:01:21.474372] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T20:01:21.709567] [DEBUG] [LOCAL ] LW: Primary data saved (51248 records). [2025-10-13T20:01:21.709746] [INFO ] [MAIN ] LW: Full history saved. [2025-10-13T20:01:21.709839] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 46.3s. Estimated remaining: 2h 32m 11s. Rate: 7.1 symbols/min [2025-10-13T20:01:21.877282] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:21.925685] [DEBUG] [LOCAL ] LYB: Loaded 54389 existing records from primary storage. [2025-10-13T20:01:21.926013] [INFO ] [MAIN ] LYB: Loaded 54389 existing records. [2025-10-13T20:01:22.025031] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-13T20:01:22.106710] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:22.106952] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-13T20:01:22.106998] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-13T20:01:22.108195] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-13T20:01:22.108254] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-13T20:01:22.499616] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:22.501745] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T20:01:22.817977] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-13T20:01:23.618023] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-13T20:01:23.794678] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T20:01:24.417925] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-13T20:01:24.714823] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T20:01:24.833680] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T20:01:24.837050] [INFO ] [REMOTE ] LXU: Full fetch complete (45136 records). [2025-10-13T20:01:24.837133] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-13T20:01:25.207490] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-13T20:01:25.207565] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-13T20:01:25.208391] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-13T20:01:25.208453] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-13T20:01:25.209389] [DEBUG] [LOCAL ] LXU: Trimmed 45136 records to 31881 (keeping 200 days of data) [2025-10-13T20:01:25.254699] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-13T20:01:25.393840] [DEBUG] [LOCAL ] LXU: Primary data saved (31881 records). [2025-10-13T20:01:25.393978] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-13T20:01:25.394060] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXU took 23.4s. Estimated remaining: 2h 31m 59s. Rate: 7.1 symbols/min [2025-10-13T20:01:25.560161] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:25.608559] [DEBUG] [LOCAL ] LYG: Loaded 53540 existing records from primary storage. [2025-10-13T20:01:25.608939] [INFO ] [MAIN ] LYG: Loaded 53540 existing records. [2025-10-13T20:01:25.786711] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:25.786928] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-13T20:01:25.786994] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-13T20:01:25.788183] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-13T20:01:25.788246] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-13T20:01:26.026181] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-13T20:01:26.152660] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:26.182952] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T20:01:26.741181] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:01:26.743614] [INFO ] [REMOTE ] LXFR: Full fetch complete (24749 records). [2025-10-13T20:01:26.743730] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-13T20:01:26.827363] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-13T20:01:27.125545] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-13T20:01:27.125691] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-13T20:01:27.126373] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-13T20:01:27.126445] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-13T20:01:27.127431] [DEBUG] [LOCAL ] LXFR: Trimmed 24749 records to 16750 (keeping 200 days of data) [2025-10-13T20:01:27.241990] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-13T20:01:27.270965] [DEBUG] [LOCAL ] LXFR: Primary data saved (16750 records). [2025-10-13T20:01:27.271102] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-13T20:01:27.271206] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXFR took 30.9s. Estimated remaining: 2h 31m 45s. Rate: 7.1 symbols/min [2025-10-13T20:01:27.445949] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:27.496618] [DEBUG] [LOCAL ] LYV: Loaded 51877 existing records from primary storage. [2025-10-13T20:01:27.497013] [INFO ] [MAIN ] LYV: Loaded 51877 existing records. [2025-10-13T20:01:27.623227] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-13T20:01:27.688332] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:27.688561] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-13T20:01:27.688611] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-13T20:01:27.689764] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-13T20:01:27.689825] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-13T20:01:28.064123] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:28.398360] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T20:01:28.417882] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-13T20:01:29.217929] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-13T20:01:29.427487] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T20:01:29.619054] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T20:01:30.017999] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-13T20:01:30.817909] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-13T20:01:30.923623] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:01:31.617906] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-13T20:01:31.752435] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T20:01:32.417894] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-13T20:01:32.526104] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T20:01:33.217907] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-13T20:01:33.322915] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T20:01:34.017890] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-13T20:01:34.071282] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:01:34.817895] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-13T20:01:34.927916] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T20:01:35.367691] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T20:01:35.617928] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-13T20:01:36.417898] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-13T20:01:36.516751] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T20:01:37.218034] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-13T20:01:37.461286] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T20:01:38.015773] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T20:01:38.026422] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-13T20:01:38.817992] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-13T20:01:39.095318] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T20:01:39.252196] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T20:01:39.258487] [INFO ] [REMOTE ] LXP: Full fetch complete (72696 records). [2025-10-13T20:01:39.258731] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-13T20:01:39.623228] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-13T20:01:39.828196] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-13T20:01:39.828287] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-13T20:01:39.829482] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-13T20:01:39.829553] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-13T20:01:39.831169] [DEBUG] [LOCAL ] LXP: Trimmed 72696 records to 50766 (keeping 200 days of data) [2025-10-13T20:01:40.156275] [DEBUG] [LOCAL ] LXP: Primary data saved (50766 records). [2025-10-13T20:01:40.156895] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-13T20:01:40.156984] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXP took 40.3s. Estimated remaining: 2h 31m 40s. Rate: 7.1 symbols/min [2025-10-13T20:01:40.329619] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:01:40.362142] [DEBUG] [LOCAL ] LZB: Loaded 35516 existing records from primary storage. [2025-10-13T20:01:40.362410] [INFO ] [MAIN ] LZB: Loaded 35516 existing records. [2025-10-13T20:01:40.425278] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-13T20:01:40.545431] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:01:40.546072] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-13T20:01:40.546197] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-13T20:01:40.547053] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-13T20:01:40.547115] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-13T20:01:40.890022] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T20:01:40.954008] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:01:41.217907] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-13T20:01:41.399194] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T20:01:42.017897] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-13T20:01:42.110231] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T20:01:42.817895] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-13T20:01:43.167927] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:01:43.308314] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T20:01:43.617919] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-13T20:01:44.417919] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-13T20:01:44.728513] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T20:01:44.858763] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:01:45.218028] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-13T20:01:46.017937] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-13T20:01:46.116826] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T20:01:46.817936] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-13T20:01:47.066685] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T20:01:47.459396] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T20:01:47.617998] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-13T20:01:48.417912] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-13T20:01:48.455373] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T20:01:49.038058] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T20:01:49.217924] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-13T20:01:50.018006] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-13T20:01:50.281451] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T20:01:50.663364] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T20:01:50.817938] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-13T20:01:51.617911] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-13T20:01:51.650104] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T20:01:52.099260] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:01:52.417937] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-13T20:01:53.217900] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-13T20:01:53.440714] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T20:01:54.017911] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-13T20:01:54.076004] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T20:01:54.817908] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-13T20:01:55.303636] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T20:01:55.618010] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-13T20:01:55.851188] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T20:01:56.284890] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T20:01:56.417887] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-13T20:01:56.605476] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:01:57.217996] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-13T20:01:58.017897] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-13T20:01:58.122217] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T20:01:58.525551] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T20:01:58.817991] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-13T20:01:59.438549] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T20:01:59.617993] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-13T20:02:00.408071] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T20:02:00.413502] [INFO ] [REMOTE ] LYG: Full fetch complete (76065 records). [2025-10-13T20:02:00.413662] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-13T20:02:00.425591] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-13T20:02:00.818714] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-13T20:02:00.818802] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-13T20:02:00.819860] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-13T20:02:00.819922] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-13T20:02:00.821435] [DEBUG] [LOCAL ] LYG: Trimmed 76065 records to 52750 (keeping 200 days of data) [2025-10-13T20:02:01.127349] [DEBUG] [LOCAL ] LYG: Primary data saved (52750 records). [2025-10-13T20:02:01.127484] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-13T20:02:01.127622] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 35.7s. Estimated remaining: 2h 31m 42s. Rate: 7.1 symbols/min [2025-10-13T20:02:01.225039] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-13T20:02:01.299614] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:01.313403] [DEBUG] [LOCAL ] LZM: Loaded 14676 existing records from primary storage. [2025-10-13T20:02:01.313606] [INFO ] [MAIN ] LZM: Loaded 14676 existing records. [2025-10-13T20:02:01.494536] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:01.494904] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-13T20:02:01.494991] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-13T20:02:01.496133] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-13T20:02:01.496265] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-13T20:02:01.755029] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-13T20:02:01.915440] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:01.937146] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T20:02:02.023533] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-13T20:02:02.024704] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:02:02.030983] [INFO ] [REMOTE ] LYV: Full fetch complete (73853 records). [2025-10-13T20:02:02.031077] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-13T20:02:02.442015] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-13T20:02:02.442113] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-13T20:02:02.443231] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-13T20:02:02.443297] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-13T20:02:02.445213] [DEBUG] [LOCAL ] LYV: Trimmed 73853 records to 51146 (keeping 200 days of data) [2025-10-13T20:02:02.774360] [DEBUG] [LOCAL ] LYV: Primary data saved (51146 records). [2025-10-13T20:02:02.774522] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-13T20:02:02.774639] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 35.5s. Estimated remaining: 2h 31m 28s. Rate: 7.1 symbols/min [2025-10-13T20:02:02.823133] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-13T20:02:02.950315] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:03.003867] [DEBUG] [LOCAL ] M: Loaded 54320 existing records from primary storage. [2025-10-13T20:02:03.004178] [INFO ] [MAIN ] M: Loaded 54320 existing records. [2025-10-13T20:02:03.187082] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:03.187361] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-13T20:02:03.187410] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-13T20:02:03.188497] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-13T20:02:03.188556] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-13T20:02:03.560220] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:03.591541] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T20:02:03.622973] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-13T20:02:03.627773] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:02:03.636021] [INFO ] [REMOTE ] LYB: Full fetch complete (77460 records). [2025-10-13T20:02:03.636218] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-13T20:02:04.032612] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-13T20:02:04.032846] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-13T20:02:04.033987] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-13T20:02:04.034048] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-13T20:02:04.035579] [DEBUG] [LOCAL ] LYB: Trimmed 77460 records to 53612 (keeping 200 days of data) [2025-10-13T20:02:04.367491] [DEBUG] [LOCAL ] LYB: Primary data saved (53612 records). [2025-10-13T20:02:04.367635] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-13T20:02:04.367821] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LYB took 42.7s. Estimated remaining: 2h 31m 14s. Rate: 7.1 symbols/min [2025-10-13T20:02:04.428177] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-13T20:02:04.544257] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:04.593575] [DEBUG] [LOCAL ] MA: Loaded 53267 existing records from primary storage. [2025-10-13T20:02:04.593918] [INFO ] [MAIN ] MA: Loaded 53267 existing records. [2025-10-13T20:02:04.768823] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:04.769062] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-13T20:02:04.769124] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-13T20:02:04.770306] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-13T20:02:04.770364] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-13T20:02:05.120781] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:05.217927] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-13T20:02:05.664093] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-13T20:02:05.819044] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T20:02:05.822706] [INFO ] [REMOTE ] LZB: Full fetch complete (50610 records). [2025-10-13T20:02:05.822799] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-13T20:02:06.024620] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-13T20:02:06.249386] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-13T20:02:06.249521] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-13T20:02:06.250529] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-13T20:02:06.250595] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-13T20:02:06.252274] [DEBUG] [LOCAL ] LZB: Trimmed 50610 records to 35162 (keeping 200 days of data) [2025-10-13T20:02:06.478457] [DEBUG] [LOCAL ] LZB: Primary data saved (35162 records). [2025-10-13T20:02:06.478680] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-13T20:02:06.478818] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZB took 26.3s. Estimated remaining: 2h 31m 0s. Rate: 7.1 symbols/min [2025-10-13T20:02:06.664746] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:06.706155] [DEBUG] [LOCAL ] MAA: Loaded 43220 existing records from primary storage. [2025-10-13T20:02:06.706491] [INFO ] [MAIN ] MAA: Loaded 43220 existing records. [2025-10-13T20:02:06.823018] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-13T20:02:06.889016] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:06.889332] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-13T20:02:06.889390] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-13T20:02:06.890406] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-13T20:02:06.890482] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-13T20:02:07.249981] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:07.279026] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T20:02:07.605910] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T20:02:07.617869] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-13T20:02:07.661613] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T20:02:08.354546] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T20:02:08.417963] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-13T20:02:09.217960] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-13T20:02:09.968001] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:02:09.981328] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T20:02:10.017882] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-13T20:02:10.817918] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-13T20:02:10.965355] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T20:02:11.617924] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-13T20:02:12.356310] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T20:02:12.417924] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-13T20:02:13.217936] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-13T20:02:13.427840] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T20:02:13.938117] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T20:02:14.017905] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-13T20:02:14.817962] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-13T20:02:15.087734] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T20:02:15.617939] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-13T20:02:15.802250] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T20:02:16.178726] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-13T20:02:16.421446] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-13T20:02:17.217965] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-13T20:02:17.528430] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T20:02:17.792069] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T20:02:18.018001] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-13T20:02:18.817902] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-13T20:02:19.260816] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T20:02:19.619331] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-13T20:02:19.623886] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T20:02:19.786269] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T20:02:20.417929] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-13T20:02:21.203639] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T20:02:21.217887] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-13T20:02:21.508812] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T20:02:21.988743] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T20:02:22.018025] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-13T20:02:22.809925] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T20:02:22.817876] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-13T20:02:23.617932] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-13T20:02:23.870614] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T20:02:24.417927] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-13T20:02:25.217964] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-13T20:02:25.429310] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T20:02:25.432249] [INFO ] [REMOTE ] LZM: Full fetch complete (19163 records). [2025-10-13T20:02:25.432346] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-13T20:02:25.827441] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-13T20:02:25.827722] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-13T20:02:25.828422] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-13T20:02:25.828507] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-13T20:02:25.830017] [DEBUG] [LOCAL ] LZM: Trimmed 19163 records to 14519 (keeping 200 days of data) [2025-10-13T20:02:25.926516] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-13T20:02:25.963737] [DEBUG] [LOCAL ] LZM: Primary data saved (14519 records). [2025-10-13T20:02:25.963945] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-13T20:02:25.964049] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZM took 24.8s. Estimated remaining: 2h 31m 1s. Rate: 7.1 symbols/min [2025-10-13T20:02:26.030425] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-13T20:02:26.144799] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:26.145068] [DEBUG] [LOCAL ] MAC: No existing data file found in primary storage. [2025-10-13T20:02:26.145110] [WARN ] [MAIN ] MAC: No existing data found, performing full refresh instead. [2025-10-13T20:02:26.145236] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-13T20:02:26.145312] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-13T20:02:26.145404] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-13T20:02:26.145443] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-13T20:02:26.517743] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:26.771401] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T20:02:26.817977] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-13T20:02:27.617986] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-13T20:02:27.777621] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T20:02:28.426554] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-13T20:02:28.459837] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T20:02:29.217907] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-13T20:02:29.262623] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T20:02:30.018027] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-13T20:02:30.409160] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T20:02:30.456795] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:02:30.817925] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-13T20:02:31.477238] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T20:02:31.617996] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-13T20:02:32.276302] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T20:02:32.418004] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-13T20:02:33.217926] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-13T20:02:33.525413] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T20:02:33.843222] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T20:02:34.017908] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-13T20:02:34.537158] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T20:02:34.817975] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-13T20:02:35.617904] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-13T20:02:35.946289] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T20:02:36.417965] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-13T20:02:36.953819] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T20:02:37.217923] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-13T20:02:37.290121] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T20:02:38.017923] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-13T20:02:38.046401] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T20:02:38.817980] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-13T20:02:39.067318] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T20:02:39.074179] [INFO ] [REMOTE ] M: Full fetch complete (77519 records). [2025-10-13T20:02:39.074415] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-13T20:02:39.513464] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-13T20:02:39.513692] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-13T20:02:39.514979] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-13T20:02:39.515050] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-13T20:02:39.517209] [DEBUG] [LOCAL ] M: Trimmed 77519 records to 53546 (keeping 200 days of data) [2025-10-13T20:02:39.618355] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-13T20:02:39.800255] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T20:02:39.927792] [DEBUG] [LOCAL ] M: Primary data saved (53546 records). [2025-10-13T20:02:39.927917] [INFO ] [MAIN ] M: Full history saved. [2025-10-13T20:02:39.928058] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. M took 37.2s. Estimated remaining: 2h 30m 57s. Rate: 7.1 symbols/min [2025-10-13T20:02:40.108970] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:40.123328] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T20:02:40.128743] [INFO ] [REMOTE ] MAA: Full fetch complete (61233 records). [2025-10-13T20:02:40.128959] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-13T20:02:40.427372] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-13T20:02:40.451167] [DEBUG] [LOCAL ] MAGN: Loaded 36255 existing records from primary storage. [2025-10-13T20:02:40.462085] [INFO ] [MAIN ] MAGN: Loaded 36255 existing records. [2025-10-13T20:02:40.752143] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-13T20:02:40.778109] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-13T20:02:40.779784] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-13T20:02:40.777811] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:40.780006] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-13T20:02:40.780133] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-13T20:02:40.780232] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-13T20:02:40.781521] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-13T20:02:40.781674] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-13T20:02:40.850055] [DEBUG] [LOCAL ] MAA: Trimmed 61233 records to 42748 (keeping 200 days of data) [2025-10-13T20:02:41.322876] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:41.388405] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-13T20:02:41.477537] [DEBUG] [LOCAL ] MAA: Primary data saved (42748 records). [2025-10-13T20:02:41.477733] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-13T20:02:41.477885] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MAA took 35.0s. Estimated remaining: 2h 30m 43s. Rate: 7.1 symbols/min [2025-10-13T20:02:41.683556] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:41.689294] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T20:02:41.745912] [DEBUG] [LOCAL ] MAIN: Loaded 42110 existing records from primary storage. [2025-10-13T20:02:41.746356] [INFO ] [MAIN ] MAIN: Loaded 42110 existing records. [2025-10-13T20:02:41.961109] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:41.961708] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-13T20:02:41.961988] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-13T20:02:41.963175] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-13T20:02:41.963241] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-13T20:02:42.023077] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-13T20:02:42.280008] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T20:02:42.411338] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:42.652742] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T20:02:42.817932] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-13T20:02:43.617915] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-13T20:02:44.076103] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T20:02:44.353540] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:02:44.417940] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-13T20:02:45.210274] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T20:02:45.221088] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-13T20:02:45.886481] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T20:02:46.017935] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-13T20:02:46.391578] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T20:02:46.817977] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-13T20:02:47.401326] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:02:47.617972] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-13T20:02:48.247467] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T20:02:48.417979] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-13T20:02:49.218467] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-13T20:02:49.592218] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:02:50.018021] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-13T20:02:50.085000] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T20:02:50.129696] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:02:50.817985] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-13T20:02:51.385557] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T20:02:51.618006] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-13T20:02:52.080198] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T20:02:52.417982] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-13T20:02:53.217977] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-13T20:02:53.316085] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T20:02:54.017974] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-13T20:02:54.079486] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T20:02:54.817961] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-13T20:02:55.058137] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T20:02:55.617929] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-13T20:02:55.816959] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T20:02:56.417937] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-13T20:02:56.441318] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T20:02:56.446968] [INFO ] [REMOTE ] MAC: Full fetch complete (71351 records). [2025-10-13T20:02:56.447132] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-13T20:02:56.856789] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-13T20:02:56.856894] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-13T20:02:56.858259] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-13T20:02:56.858328] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-13T20:02:56.860004] [DEBUG] [LOCAL ] MAC: Trimmed 71351 records to 49667 (keeping 200 days of data) [2025-10-13T20:02:57.201276] [DEBUG] [LOCAL ] MAC: Primary data saved (49667 records). [2025-10-13T20:02:57.201581] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-13T20:02:57.201784] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAC took 31.2s. Estimated remaining: 2h 30m 41s. Rate: 7.1 symbols/min [2025-10-13T20:02:57.223506] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-13T20:02:57.390450] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:57.420623] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T20:02:57.474754] [DEBUG] [LOCAL ] MAN: Loaded 44317 existing records from primary storage. [2025-10-13T20:02:57.475217] [INFO ] [MAIN ] MAN: Loaded 44317 existing records. [2025-10-13T20:02:57.649393] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:57.649941] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-13T20:02:57.650182] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-13T20:02:57.651457] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-13T20:02:57.651581] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-13T20:02:58.018946] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-13T20:02:58.022804] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:02:58.362825] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T20:02:58.369858] [INFO ] [REMOTE ] MA: Full fetch complete (76243 records). [2025-10-13T20:02:58.370059] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-13T20:02:58.796663] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-13T20:02:58.796879] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-13T20:02:58.798225] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-13T20:02:58.798381] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-13T20:02:58.823794] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-13T20:02:58.827914] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T20:02:58.836821] [DEBUG] [LOCAL ] MA: Trimmed 76243 records to 52495 (keeping 200 days of data) [2025-10-13T20:02:59.199889] [DEBUG] [LOCAL ] MA: Primary data saved (52495 records). [2025-10-13T20:02:59.200092] [INFO ] [MAIN ] MA: Full history saved. [2025-10-13T20:02:59.200192] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MA took 54.8s. Estimated remaining: 2h 30m 27s. Rate: 7.1 symbols/min [2025-10-13T20:02:59.390807] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:02:59.419037] [DEBUG] [LOCAL ] MANU: Loaded 27241 existing records from primary storage. [2025-10-13T20:02:59.419463] [INFO ] [MAIN ] MANU: Loaded 27241 existing records. [2025-10-13T20:02:59.618008] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-13T20:02:59.638778] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T20:02:59.662888] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:02:59.673547] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-13T20:02:59.673860] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-13T20:02:59.674545] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-13T20:02:59.674609] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-13T20:03:00.047008] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:00.373234] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:03:00.417982] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-13T20:03:01.133236] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T20:03:01.217982] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-13T20:03:01.962901] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T20:03:02.017965] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-13T20:03:02.371734] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T20:03:02.818035] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-13T20:03:03.409400] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T20:03:03.618027] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-13T20:03:03.970220] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T20:03:04.417979] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-13T20:03:04.824979] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T20:03:05.217974] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-13T20:03:05.930433] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T20:03:06.017923] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-13T20:03:06.817964] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-13T20:03:06.952717] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T20:03:07.181069] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T20:03:07.618010] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-13T20:03:08.258815] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T20:03:08.417907] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-13T20:03:09.175764] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T20:03:09.217898] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-13T20:03:09.958617] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:03:10.017930] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-13T20:03:10.491429] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T20:03:10.817982] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-13T20:03:11.623043] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-13T20:03:11.639311] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T20:03:12.417971] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-13T20:03:12.603698] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T20:03:13.063626] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T20:03:13.068463] [INFO ] [REMOTE ] MAGN: Full fetch complete (51408 records). [2025-10-13T20:03:13.068566] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-13T20:03:13.221040] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-13T20:03:13.449673] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-13T20:03:13.449756] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-13T20:03:13.450682] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-13T20:03:13.450742] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-13T20:03:13.451776] [DEBUG] [LOCAL ] MAGN: Trimmed 51408 records to 35865 (keeping 200 days of data) [2025-10-13T20:03:13.660783] [DEBUG] [LOCAL ] MAGN: Primary data saved (35865 records). [2025-10-13T20:03:13.660918] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-13T20:03:13.661010] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 33.7s. Estimated remaining: 2h 30m 23s. Rate: 7.1 symbols/min [2025-10-13T20:03:13.833173] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:13.885311] [DEBUG] [LOCAL ] MAS: Loaded 53015 existing records from primary storage. [2025-10-13T20:03:13.893373] [INFO ] [MAIN ] MAS: Loaded 53015 existing records. [2025-10-13T20:03:13.973186] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T20:03:14.019740] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-13T20:03:14.111258] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:14.111552] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-13T20:03:14.111602] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-13T20:03:14.112068] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-13T20:03:14.112128] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-13T20:03:14.516215] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:14.817920] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-13T20:03:14.927717] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T20:03:14.932365] [INFO ] [REMOTE ] MAIN: Full fetch complete (60205 records). [2025-10-13T20:03:14.932458] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-13T20:03:15.328257] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-13T20:03:15.328471] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-13T20:03:15.330426] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-13T20:03:15.330603] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-13T20:03:15.332742] [DEBUG] [LOCAL ] MAIN: Trimmed 60205 records to 41692 (keeping 200 days of data) [2025-10-13T20:03:15.455206] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T20:03:15.621373] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-13T20:03:15.653908] [DEBUG] [LOCAL ] MAIN: Primary data saved (41692 records). [2025-10-13T20:03:15.654081] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-13T20:03:15.654179] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 34.2s. Estimated remaining: 2h 30m 10s. Rate: 7.1 symbols/min [2025-10-13T20:03:15.836082] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:15.877846] [DEBUG] [LOCAL ] MATV: Loaded 36348 existing records from primary storage. [2025-10-13T20:03:15.878356] [INFO ] [MAIN ] MATV: Loaded 36348 existing records. [2025-10-13T20:03:16.081505] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:16.081974] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-13T20:03:16.082041] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-13T20:03:16.082472] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-13T20:03:16.082533] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-13T20:03:16.431131] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-13T20:03:16.434982] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T20:03:16.533265] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:16.896190] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T20:03:17.217931] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-13T20:03:17.827138] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T20:03:18.017931] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-13T20:03:18.823735] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-13T20:03:18.853558] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T20:03:19.338606] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T20:03:19.617928] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-13T20:03:20.418010] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-13T20:03:20.569818] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T20:03:20.711934] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T20:03:21.217927] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-13T20:03:21.568068] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T20:03:22.018008] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-13T20:03:22.662601] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T20:03:22.667257] [INFO ] [REMOTE ] MAN: Full fetch complete (62243 records). [2025-10-13T20:03:22.667362] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-13T20:03:22.824333] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-13T20:03:23.054847] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-13T20:03:23.054928] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-13T20:03:23.055816] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-13T20:03:23.055878] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-13T20:03:23.057199] [DEBUG] [LOCAL ] MAN: Trimmed 62243 records to 43860 (keeping 200 days of data) [2025-10-13T20:03:23.332807] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:03:23.343096] [DEBUG] [LOCAL ] MAN: Primary data saved (43860 records). [2025-10-13T20:03:23.343174] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-13T20:03:23.343249] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 26.1s. Estimated remaining: 2h 30m 1s. Rate: 7.1 symbols/min [2025-10-13T20:03:23.509167] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:23.541361] [DEBUG] [LOCAL ] MATX: Loaded 31897 existing records from primary storage. [2025-10-13T20:03:23.541622] [INFO ] [MAIN ] MATX: Loaded 31897 existing records. [2025-10-13T20:03:23.623118] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-13T20:03:23.722192] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:23.722369] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-13T20:03:23.722415] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-13T20:03:23.723132] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-13T20:03:23.723190] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-13T20:03:24.102502] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:24.132184] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:03:24.417972] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-13T20:03:24.855153] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T20:03:25.217992] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-13T20:03:26.023135] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-13T20:03:26.049949] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T20:03:26.297147] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:03:26.817935] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-13T20:03:27.617997] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-13T20:03:27.696469] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T20:03:27.919802] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T20:03:28.417898] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-13T20:03:28.725294] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T20:03:29.217919] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-13T20:03:29.667852] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T20:03:30.017998] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-13T20:03:30.762740] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:03:30.817917] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-13T20:03:31.623160] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-13T20:03:31.629142] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T20:03:32.205775] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T20:03:32.417922] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-13T20:03:32.862928] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T20:03:33.217988] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-13T20:03:34.017914] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-13T20:03:34.225542] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T20:03:34.445549] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T20:03:34.817996] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-13T20:03:35.343527] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T20:03:35.617898] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-13T20:03:35.936988] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T20:03:36.418191] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-13T20:03:37.161698] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:03:37.217883] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-13T20:03:37.815788] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T20:03:38.017997] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-13T20:03:38.733987] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T20:03:38.817889] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-13T20:03:39.215124] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T20:03:39.218580] [INFO ] [REMOTE ] MANU: Full fetch complete (38529 records). [2025-10-13T20:03:39.218704] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-13T20:03:39.592289] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-13T20:03:39.592364] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-13T20:03:39.593064] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-13T20:03:39.593126] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-13T20:03:39.593950] [DEBUG] [LOCAL ] MANU: Trimmed 38529 records to 26909 (keeping 200 days of data) [2025-10-13T20:03:39.641923] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-13T20:03:39.754475] [DEBUG] [LOCAL ] MANU: Primary data saved (26909 records). [2025-10-13T20:03:39.754602] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-13T20:03:39.754699] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MANU took 40.6s. Estimated remaining: 2h 29m 59s. Rate: 7.1 symbols/min [2025-10-13T20:03:39.928785] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:39.958149] [DEBUG] [LOCAL ] MAX: Loaded 31469 existing records from primary storage. [2025-10-13T20:03:39.958415] [INFO ] [MAIN ] MAX: Loaded 31469 existing records. [2025-10-13T20:03:40.155884] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:40.156766] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-13T20:03:40.157746] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T20:03:40.157829] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-13T20:03:40.164303] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-13T20:03:40.164367] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-13T20:03:40.426296] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-13T20:03:40.514576] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:41.174038] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T20:03:41.217886] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-13T20:03:41.898218] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T20:03:42.017973] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-13T20:03:42.565929] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T20:03:42.817919] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-13T20:03:43.387224] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T20:03:43.617918] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-13T20:03:44.299966] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T20:03:44.417913] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-13T20:03:44.815111] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T20:03:45.217975] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-13T20:03:45.821190] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T20:03:46.017941] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-13T20:03:46.502126] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T20:03:46.817924] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-13T20:03:47.139804] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:03:47.617929] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-13T20:03:48.080535] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T20:03:48.084040] [INFO ] [REMOTE ] MATX: Full fetch complete (43205 records). [2025-10-13T20:03:48.084147] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-13T20:03:48.420344] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-13T20:03:48.467049] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-13T20:03:48.467140] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-13T20:03:48.468002] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-13T20:03:48.468067] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-13T20:03:48.469545] [DEBUG] [LOCAL ] MATX: Trimmed 43205 records to 31771 (keeping 200 days of data) [2025-10-13T20:03:48.676810] [DEBUG] [LOCAL ] MATX: Primary data saved (31771 records). [2025-10-13T20:03:48.676949] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-13T20:03:48.677026] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATX took 25.3s. Estimated remaining: 2h 29m 51s. Rate: 7.1 symbols/min [2025-10-13T20:03:48.840949] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:48.884934] [DEBUG] [LOCAL ] MBC: Loaded 44294 existing records from primary storage. [2025-10-13T20:03:48.885232] [INFO ] [MAIN ] MBC: Loaded 44294 existing records. [2025-10-13T20:03:49.057206] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:49.057437] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-13T20:03:49.057504] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-13T20:03:49.058841] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-13T20:03:49.058900] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-13T20:03:49.227009] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-13T20:03:49.412723] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:49.832463] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-13T20:03:50.018029] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-13T20:03:50.322907] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T20:03:50.567380] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T20:03:50.570710] [INFO ] [REMOTE ] MATV: Full fetch complete (52094 records). [2025-10-13T20:03:50.570825] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-13T20:03:50.823069] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-13T20:03:50.945149] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-13T20:03:50.945227] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-13T20:03:50.946024] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-13T20:03:50.946084] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-13T20:03:50.947225] [DEBUG] [LOCAL ] MATV: Trimmed 52094 records to 35685 (keeping 200 days of data) [2025-10-13T20:03:51.171665] [DEBUG] [LOCAL ] MATV: Primary data saved (35685 records). [2025-10-13T20:03:51.171957] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-13T20:03:51.172170] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 35.5s. Estimated remaining: 2h 29m 37s. Rate: 7.1 symbols/min [2025-10-13T20:03:51.378526] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:03:51.403919] [DEBUG] [LOCAL ] MBI: Loaded 24626 existing records from primary storage. [2025-10-13T20:03:51.404320] [INFO ] [MAIN ] MBI: Loaded 24626 existing records. [2025-10-13T20:03:51.599140] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:03:51.599736] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-13T20:03:51.599808] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-13T20:03:51.600338] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-13T20:03:51.600409] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-13T20:03:51.632461] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-13T20:03:51.983418] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T20:03:52.035902] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:03:52.417940] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-13T20:03:53.122617] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-13T20:03:53.189190] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T20:03:53.217894] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-13T20:03:53.642609] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T20:03:54.018010] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-13T20:03:54.602892] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T20:03:54.817901] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-13T20:03:55.086401] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T20:03:55.617901] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-13T20:03:56.049540] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:03:56.417922] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-13T20:03:57.217939] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-13T20:03:57.863238] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-13T20:03:58.017918] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-13T20:03:58.254428] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T20:03:58.590624] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T20:03:58.817940] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-13T20:03:59.617938] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-13T20:04:00.218956] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-13T20:04:00.390493] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T20:04:00.417891] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-13T20:04:01.217919] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-13T20:04:01.467497] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T20:04:01.473939] [INFO ] [REMOTE ] MAS: Full fetch complete (74920 records). [2025-10-13T20:04:01.474077] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-13T20:04:01.871538] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-13T20:04:01.871707] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-13T20:04:01.872736] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-13T20:04:01.872888] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-13T20:04:01.875104] [DEBUG] [LOCAL ] MAS: Trimmed 74920 records to 52261 (keeping 200 days of data) [2025-10-13T20:04:02.017995] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-13T20:04:02.021178] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T20:04:02.235470] [DEBUG] [LOCAL ] MAS: Primary data saved (52261 records). [2025-10-13T20:04:02.235606] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-13T20:04:02.235734] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAS took 48.6s. Estimated remaining: 2h 29m 31s. Rate: 7.1 symbols/min [2025-10-13T20:04:02.408273] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:02.448076] [DEBUG] [LOCAL ] MC: Loaded 44518 existing records from primary storage. [2025-10-13T20:04:02.448382] [INFO ] [MAIN ] MC: Loaded 44518 existing records. [2025-10-13T20:04:02.630762] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:02.631107] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-13T20:04:02.631180] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-13T20:04:02.642268] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-13T20:04:02.644034] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-13T20:04:02.677487] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T20:04:02.831527] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-13T20:04:03.020966] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:03.617936] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-13T20:04:04.253142] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-13T20:04:04.417890] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-13T20:04:04.481819] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T20:04:05.062425] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T20:04:05.216229] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T20:04:05.222189] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-13T20:04:06.017991] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-13T20:04:06.464845] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:04:06.817934] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-13T20:04:07.407304] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T20:04:07.617940] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-13T20:04:08.118601] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T20:04:08.417910] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-13T20:04:09.217923] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-13T20:04:09.866006] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-13T20:04:10.017908] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-13T20:04:10.384499] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T20:04:10.646584] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T20:04:10.817911] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-13T20:04:11.373084] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T20:04:11.617919] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-13T20:04:12.342949] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T20:04:12.417932] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-13T20:04:13.042797] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T20:04:13.046865] [INFO ] [REMOTE ] MAX: Full fetch complete (45482 records). [2025-10-13T20:04:13.046993] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-13T20:04:13.223043] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-13T20:04:13.434443] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-13T20:04:13.434560] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-13T20:04:13.435370] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-13T20:04:13.435444] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-13T20:04:13.436767] [DEBUG] [LOCAL ] MAX: Trimmed 45482 records to 30984 (keeping 200 days of data) [2025-10-13T20:04:13.617587] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T20:04:13.640602] [DEBUG] [LOCAL ] MAX: Primary data saved (30984 records). [2025-10-13T20:04:13.640984] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-13T20:04:13.641102] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MAX took 33.9s. Estimated remaining: 2h 29m 25s. Rate: 7.1 symbols/min [2025-10-13T20:04:13.809808] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:13.821050] [DEBUG] [LOCAL ] MCB: Loaded 11456 existing records from primary storage. [2025-10-13T20:04:13.821252] [INFO ] [MAIN ] MCB: Loaded 11456 existing records. [2025-10-13T20:04:13.995412] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:13.995664] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-13T20:04:13.995743] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-13T20:04:13.996133] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-13T20:04:13.996192] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-13T20:04:14.027371] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-13T20:04:14.355485] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:14.817913] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-13T20:04:15.406128] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T20:04:15.507542] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T20:04:15.617939] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-13T20:04:16.242204] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T20:04:16.298170] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T20:04:16.418025] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-13T20:04:17.218172] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-13T20:04:18.014006] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T20:04:18.028939] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-13T20:04:18.364449] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T20:04:18.817909] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-13T20:04:19.617927] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-13T20:04:19.727054] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T20:04:20.417925] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-13T20:04:20.687310] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T20:04:21.169870] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T20:04:21.180762] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T20:04:21.183230] [INFO ] [REMOTE ] MBC: Full fetch complete (63091 records). [2025-10-13T20:04:21.183716] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-13T20:04:21.223921] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-13T20:04:21.594895] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-13T20:04:21.594974] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-13T20:04:21.595951] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-13T20:04:21.596012] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-13T20:04:21.597400] [DEBUG] [LOCAL ] MBC: Trimmed 63091 records to 43762 (keeping 200 days of data) [2025-10-13T20:04:21.854803] [DEBUG] [LOCAL ] MBC: Primary data saved (43762 records). [2025-10-13T20:04:21.854933] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-13T20:04:21.855041] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 33.2s. Estimated remaining: 2h 29m 16s. Rate: 7.1 symbols/min [2025-10-13T20:04:22.025286] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:22.023312] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-13T20:04:22.026318] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-13T20:04:22.026369] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-13T20:04:22.026496] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-13T20:04:22.026554] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-13T20:04:22.026610] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-13T20:04:22.026683] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-13T20:04:22.378342] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:22.786279] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T20:04:22.817891] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-13T20:04:23.447714] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T20:04:23.617918] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-13T20:04:24.418011] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-13T20:04:24.973375] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-13T20:04:25.229075] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-13T20:04:25.237367] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T20:04:25.272250] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T20:04:26.017995] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-13T20:04:26.817990] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-13T20:04:27.145631] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T20:04:27.169809] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T20:04:27.617923] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-13T20:04:28.291027] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T20:04:28.417924] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-13T20:04:28.691352] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T20:04:28.694701] [INFO ] [REMOTE ] MBI: Full fetch complete (36458 records). [2025-10-13T20:04:28.694800] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-13T20:04:29.114713] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-13T20:04:29.114803] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-13T20:04:29.115498] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-13T20:04:29.115560] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-13T20:04:29.116400] [DEBUG] [LOCAL ] MBI: Trimmed 36458 records to 24337 (keeping 200 days of data) [2025-10-13T20:04:29.217922] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-13T20:04:29.253215] [DEBUG] [LOCAL ] MBI: Primary data saved (24337 records). [2025-10-13T20:04:29.253334] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-13T20:04:29.253411] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MBI took 38.1s. Estimated remaining: 2h 29m 7s. Rate: 7.1 symbols/min [2025-10-13T20:04:29.426107] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:29.437093] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T20:04:29.446454] [DEBUG] [LOCAL ] MCI: Loaded 6589 existing records from primary storage. [2025-10-13T20:04:29.446626] [INFO ] [MAIN ] MCI: Loaded 6589 existing records. [2025-10-13T20:04:29.625847] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:29.626042] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-13T20:04:29.626089] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-13T20:04:29.626357] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-13T20:04:29.626416] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-13T20:04:29.969762] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:30.017935] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-13T20:04:30.818010] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-13T20:04:31.263155] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T20:04:31.299275] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T20:04:31.447579] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T20:04:31.617932] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-13T20:04:32.334744] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T20:04:32.417920] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-13T20:04:33.176255] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T20:04:33.217896] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-13T20:04:33.950253] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T20:04:34.017920] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-13T20:04:34.626581] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T20:04:34.817986] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-13T20:04:35.585433] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T20:04:35.617926] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-13T20:04:36.417924] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-13T20:04:37.217930] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-13T20:04:37.760603] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T20:04:37.948385] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T20:04:37.954236] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T20:04:37.954448] [INFO ] [REMOTE ] MC: Full fetch complete (62680 records). [2025-10-13T20:04:37.957149] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-13T20:04:38.023061] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-13T20:04:38.348515] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-13T20:04:38.348617] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-13T20:04:38.349604] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-13T20:04:38.349701] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-13T20:04:38.351051] [DEBUG] [LOCAL ] MC: Trimmed 62680 records to 44007 (keeping 200 days of data) [2025-10-13T20:04:38.638985] [DEBUG] [LOCAL ] MC: Primary data saved (44007 records). [2025-10-13T20:04:38.639120] [INFO ] [MAIN ] MC: Full history saved. [2025-10-13T20:04:38.639227] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MC took 36.4s. Estimated remaining: 2h 28m 59s. Rate: 7.1 symbols/min [2025-10-13T20:04:38.807765] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:38.817931] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-13T20:04:38.845320] [DEBUG] [LOCAL ] MCK: Loaded 39349 existing records from primary storage. [2025-10-13T20:04:38.845616] [INFO ] [MAIN ] MCK: Loaded 39349 existing records. [2025-10-13T20:04:39.018932] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:39.019141] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-13T20:04:39.019187] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-13T20:04:39.019960] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-13T20:04:39.020018] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-13T20:04:39.375890] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:39.426918] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T20:04:39.617915] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-13T20:04:39.951871] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T20:04:40.417923] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-13T20:04:41.048816] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T20:04:41.217979] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-13T20:04:42.017917] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-13T20:04:42.523861] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T20:04:42.543278] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-13T20:04:42.815929] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T20:04:42.824034] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-13T20:04:43.589689] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T20:04:43.617886] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-13T20:04:44.369749] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T20:04:44.417969] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-13T20:04:45.218011] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-13T20:04:45.804937] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T20:04:46.018004] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-13T20:04:46.504231] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T20:04:46.817991] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-13T20:04:47.248123] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T20:04:47.618039] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-13T20:04:48.384012] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T20:04:48.417905] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-13T20:04:48.924816] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T20:04:49.217990] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-13T20:04:49.917080] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T20:04:50.017894] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-13T20:04:50.818055] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-13T20:04:51.267448] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T20:04:51.424231] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T20:04:51.617900] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-13T20:04:51.858018] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T20:04:52.164944] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:04:52.166519] [INFO ] [REMOTE ] MCB: Full fetch complete (16436 records). [2025-10-13T20:04:52.166600] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-13T20:04:52.423029] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-13T20:04:52.539453] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-13T20:04:52.539546] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-13T20:04:52.540026] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-13T20:04:52.540089] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-13T20:04:52.540760] [DEBUG] [LOCAL ] MCB: Trimmed 16436 records to 11344 (keeping 200 days of data) [2025-10-13T20:04:52.619052] [DEBUG] [LOCAL ] MCB: Primary data saved (11344 records). [2025-10-13T20:04:52.619195] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-13T20:04:52.619291] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCB took 39.0s. Estimated remaining: 2h 28m 55s. Rate: 7.1 symbols/min [2025-10-13T20:04:52.804812] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:52.813852] [DEBUG] [LOCAL ] MCN: Loaded 8270 existing records from primary storage. [2025-10-13T20:04:52.814079] [INFO ] [MAIN ] MCN: Loaded 8270 existing records. [2025-10-13T20:04:52.987297] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:52.987452] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-13T20:04:52.987496] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-13T20:04:52.987770] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-13T20:04:52.987827] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-13T20:04:53.223205] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-13T20:04:53.286112] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T20:04:53.393937] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:54.017978] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-13T20:04:54.667465] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T20:04:54.817902] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-13T20:04:54.898430] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T20:04:55.366021] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:04:55.367478] [INFO ] [REMOTE ] MCI: Full fetch complete (10008 records). [2025-10-13T20:04:55.367582] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-13T20:04:55.623185] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-13T20:04:55.759000] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-13T20:04:55.759090] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-13T20:04:55.759385] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-13T20:04:55.759425] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-13T20:04:55.760050] [DEBUG] [LOCAL ] MCI: Trimmed 10008 records to 6520 (keeping 200 days of data) [2025-10-13T20:04:55.804968] [DEBUG] [LOCAL ] MCI: Primary data saved (6520 records). [2025-10-13T20:04:55.805133] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-13T20:04:55.805253] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCI took 26.6s. Estimated remaining: 2h 28m 43s. Rate: 7.1 symbols/min [2025-10-13T20:04:55.973494] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:04:56.009957] [DEBUG] [LOCAL ] MCO: Loaded 39893 existing records from primary storage. [2025-10-13T20:04:56.010332] [INFO ] [MAIN ] MCO: Loaded 39893 existing records. [2025-10-13T20:04:56.192449] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:04:56.192740] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-13T20:04:56.192796] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-13T20:04:56.193575] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-13T20:04:56.193633] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-13T20:04:56.430499] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-13T20:04:56.544127] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:04:57.207984] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T20:04:57.220748] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-13T20:04:57.223069] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T20:04:58.017933] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-13T20:04:58.817903] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-13T20:04:59.281229] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T20:04:59.409750] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T20:04:59.617939] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-13T20:04:59.892426] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T20:05:00.417942] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-13T20:05:00.976816] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T20:05:01.217909] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-13T20:05:01.256802] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T20:05:02.018001] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-13T20:05:02.818002] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-13T20:05:02.929714] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T20:05:03.588019] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T20:05:03.617887] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-13T20:05:03.746452] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T20:05:04.137679] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T20:05:04.417977] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-13T20:05:05.217992] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-13T20:05:06.017996] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-13T20:05:06.197068] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T20:05:06.654071] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:05:06.659801] [INFO ] [REMOTE ] MCD: Full fetch complete (77032 records). [2025-10-13T20:05:06.659950] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-13T20:05:06.821310] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-13T20:05:06.860788] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T20:05:06.862520] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:05:06.862742] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:05:06.862932] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-13T20:05:06.863115] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-13T20:05:06.863229] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-13T20:05:06.863287] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-13T20:05:06.863353] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCD took 45.0s. Estimated remaining: 2h 28m 36s. Rate: 7.1 symbols/min [2025-10-13T20:05:07.050924] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:07.083455] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T20:05:07.099237] [DEBUG] [LOCAL ] MCR: Loaded 8990 existing records from primary storage. [2025-10-13T20:05:07.099526] [INFO ] [MAIN ] MCR: Loaded 8990 existing records. [2025-10-13T20:05:07.280995] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:07.281200] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-13T20:05:07.281246] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-13T20:05:07.281549] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-13T20:05:07.281606] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-13T20:05:07.468808] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T20:05:07.623051] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-13T20:05:07.689183] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:08.417921] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-13T20:05:08.482948] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T20:05:09.217936] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-13T20:05:09.857371] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T20:05:09.861723] [INFO ] [REMOTE ] MCK: Full fetch complete (56722 records). [2025-10-13T20:05:09.861846] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-13T20:05:10.027264] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-13T20:05:10.119180] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T20:05:10.271162] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-13T20:05:10.271238] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-13T20:05:10.272064] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-13T20:05:10.272151] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-13T20:05:10.273350] [DEBUG] [LOCAL ] MCK: Trimmed 56722 records to 38713 (keeping 200 days of data) [2025-10-13T20:05:10.522465] [DEBUG] [LOCAL ] MCK: Primary data saved (38713 records). [2025-10-13T20:05:10.522609] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-13T20:05:10.522716] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCK took 31.9s. Estimated remaining: 2h 28m 24s. Rate: 7.1 symbols/min [2025-10-13T20:05:10.687144] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:10.707375] [DEBUG] [LOCAL ] MCS: Loaded 21277 existing records from primary storage. [2025-10-13T20:05:10.707620] [INFO ] [MAIN ] MCS: Loaded 21277 existing records. [2025-10-13T20:05:10.823043] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-13T20:05:10.886409] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:10.886616] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-13T20:05:10.886710] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-13T20:05:10.887200] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-13T20:05:10.887259] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-13T20:05:11.239168] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:11.617898] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-13T20:05:11.760423] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:05:11.876397] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T20:05:12.363729] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T20:05:12.417904] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-13T20:05:13.139453] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T20:05:13.217890] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-13T20:05:13.826856] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T20:05:14.017922] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-13T20:05:14.630444] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T20:05:14.818011] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-13T20:05:15.378093] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T20:05:15.617921] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-13T20:05:16.365185] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T20:05:16.417904] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-13T20:05:17.010621] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T20:05:17.217926] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-13T20:05:18.001264] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T20:05:18.017892] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-13T20:05:18.751207] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T20:05:18.752497] [INFO ] [REMOTE ] MCN: Full fetch complete (11667 records). [2025-10-13T20:05:18.752568] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-13T20:05:18.823068] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-13T20:05:19.137662] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-13T20:05:19.137770] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-13T20:05:19.138424] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-13T20:05:19.138497] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-13T20:05:19.139259] [DEBUG] [LOCAL ] MCN: Trimmed 11667 records to 8171 (keeping 200 days of data) [2025-10-13T20:05:19.190956] [DEBUG] [LOCAL ] MCN: Primary data saved (8171 records). [2025-10-13T20:05:19.191105] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-13T20:05:19.191209] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCN took 26.6s. Estimated remaining: 2h 28m 16s. Rate: 7.1 symbols/min [2025-10-13T20:05:19.485256] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T20:05:19.617919] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-13T20:05:20.417902] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-13T20:05:20.448752] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T20:05:21.217920] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-13T20:05:21.239900] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T20:05:22.017911] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-13T20:05:22.294811] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T20:05:22.499124] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T20:05:22.817935] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-13T20:05:23.617923] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-13T20:05:23.848923] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T20:05:24.417937] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-13T20:05:24.861088] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T20:05:25.218009] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-13T20:05:25.309474] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T20:05:25.311827] [INFO ] [REMOTE ] MCR: Full fetch complete (14016 records). [2025-10-13T20:05:25.311943] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-13T20:05:25.680872] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-13T20:05:25.680947] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-13T20:05:25.681280] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-13T20:05:25.681339] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-13T20:05:25.681829] [DEBUG] [LOCAL ] MCR: Trimmed 14016 records to 8867 (keeping 200 days of data) [2025-10-13T20:05:25.733063] [DEBUG] [LOCAL ] MCR: Primary data saved (8867 records). [2025-10-13T20:05:25.733202] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-13T20:05:25.733281] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCR took 18.9s. Estimated remaining: 2h 28m 6s. Rate: 7.1 symbols/min [2025-10-13T20:05:26.017934] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-13T20:05:26.613799] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T20:05:26.818033] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-13T20:05:27.204830] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T20:05:27.617941] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-13T20:05:28.451616] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:05:28.460404] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-13T20:05:28.647286] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T20:05:29.218011] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-13T20:05:29.633285] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:05:30.017896] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-13T20:05:30.410929] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T20:05:30.817928] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-13T20:05:31.420862] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T20:05:31.617941] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-13T20:05:31.765174] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T20:05:32.417940] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-13T20:05:33.244739] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T20:05:33.249422] [INFO ] [REMOTE ] MCO: Full fetch complete (57402 records). [2025-10-13T20:05:33.249524] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-13T20:05:33.604838] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T20:05:33.637535] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-13T20:05:33.683122] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-13T20:05:33.683201] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-13T20:05:33.684153] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-13T20:05:33.684216] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-13T20:05:33.685759] [DEBUG] [LOCAL ] MCO: Trimmed 57402 records to 39381 (keeping 200 days of data) [2025-10-13T20:05:33.937205] [DEBUG] [LOCAL ] MCO: Primary data saved (39381 records). [2025-10-13T20:05:33.937354] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-13T20:05:33.937435] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCO took 38.1s. Estimated remaining: 2h 27m 57s. Rate: 7.1 symbols/min [2025-10-13T20:05:34.830120] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:05:34.835852] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-13T20:05:35.910881] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T20:05:35.916684] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-13T20:05:36.904869] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T20:05:36.907565] [INFO ] [REMOTE ] MCS: Full fetch complete (30482 records). [2025-10-13T20:05:36.907674] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-13T20:05:37.302703] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-13T20:05:37.302791] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-13T20:05:37.303434] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-13T20:05:37.303476] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-13T20:05:37.304207] [DEBUG] [LOCAL ] MCS: Trimmed 30482 records to 20981 (keeping 200 days of data) [2025-10-13T20:05:37.430372] [DEBUG] [LOCAL ] MCS: Primary data saved (20981 records). [2025-10-13T20:05:37.430518] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-13T20:05:37.430611] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 26.9s. Estimated remaining: 2h 27m 45s. Rate: 7.1 symbols/min [2025-10-13T20:05:38.102848] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:38.105229] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:38.146492] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:38.148441] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:05:38.159332] [DEBUG] [LOCAL ] MDST: Loaded 5946 existing records from primary storage. [2025-10-13T20:05:38.159817] [INFO ] [MAIN ] MDST: Loaded 5946 existing records. [2025-10-13T20:05:38.373134] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:38.368197] [DEBUG] [LOCAL ] MCY: Loaded 24282 existing records from primary storage. [2025-10-13T20:05:38.373411] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-13T20:05:38.373772] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-13T20:05:38.373986] [INFO ] [MAIN ] MCY: Loaded 24282 existing records. [2025-10-13T20:05:38.426154] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-13T20:05:38.432675] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-13T20:05:38.614831] [DEBUG] [LOCAL ] MD: Loaded 39070 existing records from primary storage. [2025-10-13T20:05:38.626663] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-13T20:05:38.657058] [INFO ] [MAIN ] MD: Loaded 39070 existing records. [2025-10-13T20:05:38.668252] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-10-13T20:05:38.797465] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:38.884137] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-13T20:05:38.894802] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-13T20:05:39.024703] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-13T20:05:39.051469] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-13T20:05:39.460982] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:39.486593] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:05:39.499380] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-13T20:05:39.498939] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-13T20:05:39.483147] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:39.504921] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-13T20:05:39.510874] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-13T20:05:39.510734] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-13T20:05:39.541458] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-13T20:05:39.578387] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-13T20:05:39.555480] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-13T20:05:39.588362] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-13T20:05:40.169026] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:40.209713] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-13T20:05:40.344962] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T20:05:40.388167] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-13T20:05:40.507323] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:40.535767] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-13T20:05:40.580144] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:05:40.580618] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-13T20:05:41.212528] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T20:05:41.215006] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-13T20:05:41.469826] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T20:05:41.476603] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-13T20:05:41.868209] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T20:05:41.870139] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-13T20:05:42.066616] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T20:05:42.074426] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-13T20:05:42.440678] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T20:05:42.480943] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T20:05:42.817982] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-13T20:05:42.975863] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:05:43.198750] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:05:43.411460] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T20:05:43.617932] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-13T20:05:44.417930] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-13T20:05:44.928404] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:05:45.217934] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-13T20:05:46.017922] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-13T20:05:46.084486] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T20:05:46.526790] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T20:05:46.556241] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T20:05:46.817971] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-13T20:05:47.617912] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-13T20:05:48.225159] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T20:05:48.417938] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-13T20:05:49.217922] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-13T20:05:49.388005] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T20:05:49.778738] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T20:05:49.817143] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T20:05:50.017923] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-13T20:05:50.817983] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-13T20:05:51.617908] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-13T20:05:52.030977] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T20:05:52.160229] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T20:05:52.417922] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-13T20:05:52.857172] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T20:05:53.138590] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T20:05:53.217904] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-13T20:05:54.017971] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-13T20:05:54.370191] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T20:05:54.704509] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T20:05:54.817934] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-13T20:05:55.617997] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-13T20:05:56.275636] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T20:05:56.417925] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-13T20:05:56.716724] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T20:05:57.217945] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-13T20:05:57.607735] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T20:05:58.017996] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-13T20:05:58.768420] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T20:05:58.817900] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-13T20:05:58.997458] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T20:05:59.500485] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:05:59.501903] [INFO ] [REMOTE ] MDST: Full fetch complete (8670 records). [2025-10-13T20:05:59.501970] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-13T20:05:59.623052] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-13T20:05:59.874789] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-13T20:05:59.874857] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-13T20:05:59.875100] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-13T20:05:59.875141] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-13T20:05:59.875551] [DEBUG] [LOCAL ] MDST: Trimmed 8670 records to 5880 (keeping 200 days of data) [2025-10-13T20:05:59.916457] [DEBUG] [LOCAL ] MDST: Primary data saved (5880 records). [2025-10-13T20:05:59.916710] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-13T20:05:59.916951] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 22.5s. Estimated remaining: 2h 27m 48s. Rate: 7.1 symbols/min [2025-10-13T20:06:00.093212] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:00.141476] [DEBUG] [LOCAL ] MDU: Loaded 48734 existing records from primary storage. [2025-10-13T20:06:00.141831] [INFO ] [MAIN ] MDU: Loaded 48734 existing records. [2025-10-13T20:06:00.323560] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:00.323807] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-13T20:06:00.323911] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-13T20:06:00.324846] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-13T20:06:00.324916] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-13T20:06:00.426791] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-13T20:06:00.683881] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:01.132133] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T20:06:01.217901] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-13T20:06:02.017990] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-13T20:06:02.235629] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T20:06:02.332314] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T20:06:02.817934] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-13T20:06:03.129119] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T20:06:03.617974] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-13T20:06:04.417911] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-13T20:06:04.514540] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T20:06:05.195430] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T20:06:05.217891] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-13T20:06:05.251314] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T20:06:06.018025] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-13T20:06:06.817905] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-13T20:06:07.114188] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T20:06:07.117247] [INFO ] [REMOTE ] MCY: Full fetch complete (41051 records). [2025-10-13T20:06:07.117433] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-13T20:06:07.492672] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T20:06:07.541225] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-13T20:06:07.541305] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-13T20:06:07.542050] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-13T20:06:07.542131] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-13T20:06:07.544078] [DEBUG] [LOCAL ] MCY: Trimmed 41051 records to 23898 (keeping 200 days of data) [2025-10-13T20:06:07.634056] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-13T20:06:07.699602] [DEBUG] [LOCAL ] MCY: Primary data saved (23898 records). [2025-10-13T20:06:07.699780] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-13T20:06:07.699899] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 30.3s. Estimated remaining: 2h 27m 39s. Rate: 7.1 symbols/min [2025-10-13T20:06:07.868024] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:07.878211] [DEBUG] [LOCAL ] MDV: Loaded 8643 existing records from primary storage. [2025-10-13T20:06:07.878449] [INFO ] [MAIN ] MDV: Loaded 8643 existing records. [2025-10-13T20:06:08.067988] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:08.068225] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-13T20:06:08.068293] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-13T20:06:08.068764] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-13T20:06:08.068843] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-13T20:06:08.437411] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:08.437572] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-13T20:06:08.469379] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T20:06:09.217906] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-13T20:06:09.757768] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-13T20:06:09.789395] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:06:10.017928] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-13T20:06:10.817995] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-13T20:06:10.878882] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T20:06:11.617904] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-13T20:06:11.957222] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T20:06:12.270763] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T20:06:12.274876] [INFO ] [REMOTE ] MD: Full fetch complete (55027 records). [2025-10-13T20:06:12.274975] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-13T20:06:12.428407] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-13T20:06:12.671478] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-13T20:06:12.671554] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-13T20:06:12.672353] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-13T20:06:12.672415] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-13T20:06:12.673629] [DEBUG] [LOCAL ] MD: Trimmed 55027 records to 38560 (keeping 200 days of data) [2025-10-13T20:06:12.900200] [DEBUG] [LOCAL ] MD: Primary data saved (38560 records). [2025-10-13T20:06:12.900345] [INFO ] [MAIN ] MD: Full history saved. [2025-10-13T20:06:12.900426] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 35.5s. Estimated remaining: 2h 27m 28s. Rate: 7.1 symbols/min [2025-10-13T20:06:13.021023] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T20:06:13.088033] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:13.105469] [DEBUG] [LOCAL ] MEC: Loaded 16527 existing records from primary storage. [2025-10-13T20:06:13.105891] [INFO ] [MAIN ] MEC: Loaded 16527 existing records. [2025-10-13T20:06:13.224622] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-13T20:06:13.310857] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:13.311841] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-13T20:06:13.311900] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-13T20:06:13.323484] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-13T20:06:13.338050] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-13T20:06:13.441434] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T20:06:13.702200] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:13.988673] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T20:06:13.994674] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-13T20:06:13.994795] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-13T20:06:14.018679] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-13T20:06:14.387074] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-13T20:06:14.387165] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-13T20:06:14.388211] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-13T20:06:14.388279] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-13T20:06:14.389846] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-10-13T20:06:14.730467] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-13T20:06:14.730575] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-13T20:06:14.730681] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 37.3s. Estimated remaining: 2h 27m 14s. Rate: 7.1 symbols/min [2025-10-13T20:06:14.821266] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-13T20:06:14.906516] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:14.926771] [DEBUG] [LOCAL ] MED: Loaded 21627 existing records from primary storage. [2025-10-13T20:06:14.927049] [INFO ] [MAIN ] MED: Loaded 21627 existing records. [2025-10-13T20:06:15.113106] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T20:06:15.118403] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:15.122379] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-13T20:06:15.123000] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-13T20:06:15.123420] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-13T20:06:15.123478] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-13T20:06:15.496151] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:15.617918] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-13T20:06:16.273167] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T20:06:16.417905] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-13T20:06:16.923230] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T20:06:17.217992] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-13T20:06:17.278281] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T20:06:17.836952] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T20:06:18.018027] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-13T20:06:18.716307] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T20:06:18.817895] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-13T20:06:19.617979] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-13T20:06:19.902995] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T20:06:20.356706] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T20:06:20.418033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-13T20:06:21.218080] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-13T20:06:21.342187] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:06:21.958635] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T20:06:22.017895] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-13T20:06:22.781279] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T20:06:22.817940] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-13T20:06:23.617943] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-13T20:06:23.742812] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T20:06:24.417927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-13T20:06:24.710020] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T20:06:24.918428] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T20:06:25.217985] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-13T20:06:26.018016] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-13T20:06:26.136742] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:06:26.817908] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-13T20:06:27.606962] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T20:06:27.617873] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-13T20:06:27.756036] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T20:06:28.417927] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-13T20:06:29.210671] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T20:06:29.217872] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-13T20:06:29.265341] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T20:06:30.017913] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-13T20:06:30.109851] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T20:06:30.817924] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-13T20:06:31.440219] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T20:06:31.617917] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-13T20:06:31.806986] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T20:06:32.364362] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T20:06:32.417942] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-13T20:06:33.217934] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-13T20:06:33.834849] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T20:06:33.962859] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T20:06:34.017903] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-13T20:06:34.767505] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T20:06:34.817882] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-13T20:06:35.389977] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T20:06:35.617917] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-13T20:06:36.417992] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-13T20:06:36.628546] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T20:06:37.217986] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-13T20:06:37.230250] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T20:06:37.231683] [INFO ] [REMOTE ] MDV: Full fetch complete (11741 records). [2025-10-13T20:06:37.231889] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-13T20:06:37.629576] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-13T20:06:37.629701] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-13T20:06:37.630119] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-13T20:06:37.630165] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-13T20:06:37.630726] [DEBUG] [LOCAL ] MDV: Trimmed 11741 records to 8497 (keeping 200 days of data) [2025-10-13T20:06:37.687569] [DEBUG] [LOCAL ] MDV: Primary data saved (8497 records). [2025-10-13T20:06:37.687786] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-13T20:06:37.687909] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 30.0s. Estimated remaining: 2h 27m 17s. Rate: 7.1 symbols/min [2025-10-13T20:06:37.869730] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:37.909844] [DEBUG] [LOCAL ] MEG: Loaded 31917 existing records from primary storage. [2025-10-13T20:06:37.910215] [INFO ] [MAIN ] MEG: Loaded 31917 existing records. [2025-10-13T20:06:38.021061] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-13T20:06:38.106508] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:38.106787] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-13T20:06:38.106849] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-13T20:06:38.107454] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-13T20:06:38.107512] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-13T20:06:38.477775] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:38.736603] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T20:06:38.774160] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T20:06:38.817912] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-13T20:06:39.617936] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-13T20:06:40.374329] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T20:06:40.417926] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-13T20:06:41.028348] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T20:06:41.218031] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-13T20:06:42.023391] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-13T20:06:42.047560] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T20:06:42.066767] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T20:06:42.069143] [INFO ] [REMOTE ] MEC: Full fetch complete (22804 records). [2025-10-13T20:06:42.069229] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-13T20:06:42.448343] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-13T20:06:42.448471] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-13T20:06:42.449310] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-13T20:06:42.449374] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-13T20:06:42.450097] [DEBUG] [LOCAL ] MEC: Trimmed 22804 records to 16301 (keeping 200 days of data) [2025-10-13T20:06:42.562789] [DEBUG] [LOCAL ] MEC: Primary data saved (16301 records). [2025-10-13T20:06:42.562957] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-13T20:06:42.563070] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MEC took 29.7s. Estimated remaining: 2h 27m 6s. Rate: 7.1 symbols/min [2025-10-13T20:06:42.729281] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:42.749613] [DEBUG] [LOCAL ] MEGI: Loaded 20167 existing records from primary storage. [2025-10-13T20:06:42.749873] [INFO ] [MAIN ] MEGI: Loaded 20167 existing records. [2025-10-13T20:06:42.822179] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-13T20:06:42.927894] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:42.928150] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-13T20:06:42.928201] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-13T20:06:42.928694] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-13T20:06:42.928754] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-13T20:06:43.307312] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:43.309276] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T20:06:43.618036] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-13T20:06:44.426030] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-13T20:06:44.430578] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T20:06:44.437508] [INFO ] [REMOTE ] MDU: Full fetch complete (70395 records). [2025-10-13T20:06:44.437758] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-13T20:06:44.700574] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:06:44.871325] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-13T20:06:44.871414] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-13T20:06:44.872374] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-13T20:06:44.872439] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-13T20:06:44.873973] [DEBUG] [LOCAL ] MDU: Trimmed 70395 records to 48090 (keeping 200 days of data) [2025-10-13T20:06:45.170031] [DEBUG] [LOCAL ] MDU: Primary data saved (48090 records). [2025-10-13T20:06:45.170181] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-13T20:06:45.170269] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MDU took 45.3s. Estimated remaining: 2h 26m 53s. Rate: 7.1 symbols/min [2025-10-13T20:06:45.224978] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-13T20:06:45.341201] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:45.370501] [DEBUG] [LOCAL ] MEI: Loaded 32205 existing records from primary storage. [2025-10-13T20:06:45.370816] [INFO ] [MAIN ] MEI: Loaded 32205 existing records. [2025-10-13T20:06:45.551159] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:45.551423] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-13T20:06:45.551476] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-13T20:06:45.552064] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-13T20:06:45.552121] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-13T20:06:45.902367] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:45.927328] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:06:45.948353] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T20:06:46.017891] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-13T20:06:46.817899] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-13T20:06:46.965269] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T20:06:47.617934] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-13T20:06:48.173476] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T20:06:48.417913] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-13T20:06:48.730574] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T20:06:49.217993] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-13T20:06:49.506055] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T20:06:50.018018] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-13T20:06:50.599692] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:06:50.817946] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-13T20:06:50.917870] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T20:06:51.617993] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-13T20:06:52.174774] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T20:06:52.418183] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-13T20:06:52.422389] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T20:06:53.217895] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-13T20:06:53.679926] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T20:06:54.017912] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-13T20:06:54.193113] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T20:06:54.817913] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-13T20:06:55.022455] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T20:06:55.617920] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-13T20:06:56.358054] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:06:56.417942] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-13T20:06:56.707149] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T20:06:56.714242] [INFO ] [REMOTE ] MED: Full fetch complete (32067 records). [2025-10-13T20:06:56.714408] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-13T20:06:57.095716] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-13T20:06:57.095802] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-13T20:06:57.096402] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-13T20:06:57.096443] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-13T20:06:57.097371] [DEBUG] [LOCAL ] MED: Trimmed 32067 records to 21262 (keeping 200 days of data) [2025-10-13T20:06:57.220976] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-13T20:06:57.226316] [DEBUG] [LOCAL ] MED: Primary data saved (21262 records). [2025-10-13T20:06:57.226397] [INFO ] [MAIN ] MED: Full history saved. [2025-10-13T20:06:57.226473] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 42.5s. Estimated remaining: 2h 26m 47s. Rate: 7.1 symbols/min [2025-10-13T20:06:57.403169] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:06:57.460066] [DEBUG] [LOCAL ] MET: Loaded 54096 existing records from primary storage. [2025-10-13T20:06:57.460441] [INFO ] [MAIN ] MET: Loaded 54096 existing records. [2025-10-13T20:06:57.645687] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:06:57.645892] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-13T20:06:57.645939] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-13T20:06:57.646493] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-13T20:06:57.646548] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-13T20:06:57.816942] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T20:06:58.037047] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-13T20:06:58.042798] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:06:58.160472] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T20:06:58.817969] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-13T20:06:58.944132] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:06:59.617922] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-13T20:07:00.347676] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T20:07:00.417908] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-13T20:07:00.880714] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T20:07:01.217984] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-13T20:07:02.017929] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-13T20:07:02.099421] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T20:07:02.817925] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-13T20:07:02.931015] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:07:03.205751] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T20:07:03.617901] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-13T20:07:04.001979] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T20:07:04.418020] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-13T20:07:04.997398] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T20:07:05.217916] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-13T20:07:06.018028] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-13T20:07:06.070351] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:07:06.641492] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T20:07:06.817977] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-13T20:07:07.173462] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T20:07:07.618011] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-13T20:07:07.922682] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T20:07:08.417923] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-13T20:07:09.011217] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T20:07:09.014991] [INFO ] [REMOTE ] MEG: Full fetch complete (47420 records). [2025-10-13T20:07:09.015089] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-13T20:07:09.225871] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-13T20:07:09.396365] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-13T20:07:09.396534] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-13T20:07:09.397344] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-13T20:07:09.397405] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-13T20:07:09.398430] [DEBUG] [LOCAL ] MEG: Trimmed 47420 records to 31520 (keeping 200 days of data) [2025-10-13T20:07:09.602578] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T20:07:09.619809] [DEBUG] [LOCAL ] MEG: Primary data saved (31520 records). [2025-10-13T20:07:09.619936] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-13T20:07:09.620013] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 31.9s. Estimated remaining: 2h 26m 42s. Rate: 7.1 symbols/min [2025-10-13T20:07:09.789489] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:09.834862] [DEBUG] [LOCAL ] MFA: Loaded 46366 existing records from primary storage. [2025-10-13T20:07:09.835154] [INFO ] [MAIN ] MFA: Loaded 46366 existing records. [2025-10-13T20:07:10.016214] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:10.016398] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-13T20:07:10.016447] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-13T20:07:10.016827] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-13T20:07:10.016884] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-13T20:07:10.028117] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-13T20:07:10.376238] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:10.395459] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:07:10.817994] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-13T20:07:11.617976] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-13T20:07:11.781270] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T20:07:12.413637] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T20:07:12.420391] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-13T20:07:12.795393] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T20:07:13.218028] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-13T20:07:14.017986] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-13T20:07:14.322591] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T20:07:14.358605] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T20:07:14.818007] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-13T20:07:15.139817] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T20:07:15.141766] [INFO ] [REMOTE ] MEGI: Full fetch complete (29476 records). [2025-10-13T20:07:15.141841] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-13T20:07:15.537386] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-13T20:07:15.537491] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-13T20:07:15.538277] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-13T20:07:15.538354] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-13T20:07:15.539226] [DEBUG] [LOCAL ] MEGI: Trimmed 29476 records to 19820 (keeping 200 days of data) [2025-10-13T20:07:15.626446] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-13T20:07:15.663738] [DEBUG] [LOCAL ] MEGI: Primary data saved (19820 records). [2025-10-13T20:07:15.663888] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-13T20:07:15.663976] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 33.1s. Estimated remaining: 2h 26m 32s. Rate: 7.1 symbols/min [2025-10-13T20:07:15.841209] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:15.847412] [DEBUG] [LOCAL ] MFAN: Loaded 4428 existing records from primary storage. [2025-10-13T20:07:15.847606] [INFO ] [MAIN ] MFAN: Loaded 4428 existing records. [2025-10-13T20:07:16.025794] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:16.026014] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-13T20:07:16.026060] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-13T20:07:16.026268] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-13T20:07:16.026324] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-13T20:07:16.391264] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:16.415083] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T20:07:16.423468] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-13T20:07:16.869030] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-13T20:07:16.909000] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T20:07:16.913115] [INFO ] [REMOTE ] MEI: Full fetch complete (45454 records). [2025-10-13T20:07:16.913212] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-13T20:07:17.225766] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-13T20:07:17.323683] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-13T20:07:17.323794] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-13T20:07:17.324577] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-13T20:07:17.324621] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-13T20:07:17.325763] [DEBUG] [LOCAL ] MEI: Trimmed 45454 records to 31737 (keeping 200 days of data) [2025-10-13T20:07:17.506418] [DEBUG] [LOCAL ] MEI: Primary data saved (31737 records). [2025-10-13T20:07:17.506555] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-13T20:07:17.506639] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 32.3s. Estimated remaining: 2h 26m 18s. Rate: 7.1 symbols/min [2025-10-13T20:07:17.673605] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:17.679947] [DEBUG] [LOCAL ] MFAO: Loaded 4008 existing records from primary storage. [2025-10-13T20:07:17.680136] [INFO ] [MAIN ] MFAO: Loaded 4008 existing records. [2025-10-13T20:07:17.853043] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:17.853313] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-13T20:07:17.853361] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-13T20:07:17.853587] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-13T20:07:17.853680] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-13T20:07:18.023617] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-13T20:07:18.233027] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:18.678834] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T20:07:18.818005] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-13T20:07:18.860321] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T20:07:19.617939] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-13T20:07:20.417942] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-13T20:07:20.593395] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T20:07:20.729001] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-13T20:07:21.083385] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T20:07:21.217974] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-13T20:07:22.017923] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-13T20:07:22.452295] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T20:07:22.817886] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-13T20:07:22.852586] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T20:07:23.388158] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T20:07:23.617935] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-13T20:07:24.187905] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T20:07:24.417904] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-13T20:07:24.987169] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T20:07:25.217931] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-13T20:07:25.900754] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T20:07:26.017930] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-13T20:07:26.817921] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-13T20:07:27.271610] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-13T20:07:27.617900] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-13T20:07:27.950971] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T20:07:28.190762] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T20:07:28.417925] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-13T20:07:29.217918] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-13T20:07:30.017982] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-13T20:07:30.150397] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:07:30.581441] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T20:07:30.817985] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-13T20:07:30.961267] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T20:07:31.432881] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:07:31.433985] [INFO ] [REMOTE ] MFAN: Full fetch complete (5888 records). [2025-10-13T20:07:31.434052] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-13T20:07:31.627632] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-13T20:07:31.790006] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-13T20:07:31.790105] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-13T20:07:31.790318] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-13T20:07:31.790360] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-13T20:07:31.790851] [DEBUG] [LOCAL ] MFAN: Trimmed 5888 records to 4383 (keeping 200 days of data) [2025-10-13T20:07:31.826704] [DEBUG] [LOCAL ] MFAN: Primary data saved (4383 records). [2025-10-13T20:07:31.826862] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-13T20:07:31.826950] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFAN took 16.2s. Estimated remaining: 2h 26m 14s. Rate: 7.1 symbols/min [2025-10-13T20:07:31.994406] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:32.046915] [DEBUG] [LOCAL ] MFC: Loaded 51842 existing records from primary storage. [2025-10-13T20:07:32.047221] [INFO ] [MAIN ] MFC: Loaded 51842 existing records. [2025-10-13T20:07:32.234998] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:32.235330] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-13T20:07:32.235385] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-13T20:07:32.236586] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-13T20:07:32.236742] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-13T20:07:32.322430] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T20:07:32.430506] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-13T20:07:32.629172] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:33.217912] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-13T20:07:33.786732] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T20:07:34.017910] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-13T20:07:34.333985] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T20:07:34.817913] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-13T20:07:35.559566] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T20:07:35.590178] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T20:07:35.617877] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-13T20:07:36.417930] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-13T20:07:37.216491] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T20:07:37.227252] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-13T20:07:37.244295] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T20:07:38.017946] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-13T20:07:38.817900] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-13T20:07:38.983757] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T20:07:39.617903] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-13T20:07:39.818947] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T20:07:39.862148] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T20:07:40.417927] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-13T20:07:41.217909] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-13T20:07:41.259259] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T20:07:42.017917] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-13T20:07:42.065061] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:07:42.097215] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T20:07:42.817922] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-13T20:07:43.582895] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T20:07:43.617893] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-13T20:07:44.250762] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T20:07:44.417922] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-13T20:07:44.520754] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:07:45.217935] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-13T20:07:46.017973] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-13T20:07:46.213243] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T20:07:46.823154] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-13T20:07:46.839165] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T20:07:47.298132] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T20:07:47.617929] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-13T20:07:47.785435] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T20:07:48.319692] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:07:48.325909] [INFO ] [REMOTE ] MET: Full fetch complete (77119 records). [2025-10-13T20:07:48.326083] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-13T20:07:48.423030] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-13T20:07:48.744372] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-13T20:07:48.744457] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-13T20:07:48.745515] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-13T20:07:48.745584] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-13T20:07:48.747129] [DEBUG] [LOCAL ] MET: Trimmed 77119 records to 53320 (keeping 200 days of data) [2025-10-13T20:07:49.042831] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T20:07:49.083987] [DEBUG] [LOCAL ] MET: Primary data saved (53320 records). [2025-10-13T20:07:49.084127] [INFO ] [MAIN ] MET: Full history saved. [2025-10-13T20:07:49.084209] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MET took 51.9s. Estimated remaining: 2h 26m 12s. Rate: 7.1 symbols/min [2025-10-13T20:07:49.253465] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:49.223011] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-13T20:07:49.298394] [DEBUG] [LOCAL ] MFG: Loaded 50100 existing records from primary storage. [2025-10-13T20:07:49.298764] [INFO ] [MAIN ] MFG: Loaded 50100 existing records. [2025-10-13T20:07:49.474469] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:49.474728] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-13T20:07:49.474783] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-13T20:07:49.475002] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-13T20:07:49.475039] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-13T20:07:49.827492] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:50.017934] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-13T20:07:50.817909] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-13T20:07:50.914371] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T20:07:51.362844] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:07:51.363934] [INFO ] [REMOTE ] MFAO: Full fetch complete (5424 records). [2025-10-13T20:07:51.364001] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-13T20:07:51.623189] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-13T20:07:51.736686] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-13T20:07:51.736883] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-13T20:07:51.737158] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-13T20:07:51.737340] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-13T20:07:51.752362] [DEBUG] [LOCAL ] MFAO: Trimmed 5424 records to 3981 (keeping 200 days of data) [2025-10-13T20:07:51.764605] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T20:07:51.801377] [DEBUG] [LOCAL ] MFAO: Primary data saved (3981 records). [2025-10-13T20:07:51.801529] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-13T20:07:51.801621] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 34.3s. Estimated remaining: 2h 25m 60s. Rate: 7.1 symbols/min [2025-10-13T20:07:51.968892] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:51.987092] [DEBUG] [LOCAL ] MFM: Loaded 14970 existing records from primary storage. [2025-10-13T20:07:51.987356] [INFO ] [MAIN ] MFM: Loaded 14970 existing records. [2025-10-13T20:07:52.162754] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:07:52.163054] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-13T20:07:52.163101] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-13T20:07:52.163339] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-13T20:07:52.163394] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-13T20:07:52.425884] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-13T20:07:52.515024] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:53.217926] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-13T20:07:54.018030] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-13T20:07:54.037886] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T20:07:54.065214] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T20:07:54.817944] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-13T20:07:55.546125] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T20:07:55.617910] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-13T20:07:55.715491] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T20:07:55.721266] [INFO ] [REMOTE ] MFA: Full fetch complete (65324 records). [2025-10-13T20:07:55.721544] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-13T20:07:56.111112] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-13T20:07:56.111194] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-13T20:07:56.112072] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-13T20:07:56.112137] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-13T20:07:56.113470] [DEBUG] [LOCAL ] MFA: Trimmed 65324 records to 45781 (keeping 200 days of data) [2025-10-13T20:07:56.361933] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (4.74 seconds). [2025-10-13T20:07:56.420055] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-13T20:07:56.438487] [DEBUG] [LOCAL ] MFA: Primary data saved (45781 records). [2025-10-13T20:07:56.438594] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-13T20:07:56.438744] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFA took 46.8s. Estimated remaining: 2h 25m 48s. Rate: 7.1 symbols/min [2025-10-13T20:07:56.611628] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:07:56.611820] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-13T20:07:56.611859] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-13T20:07:56.611979] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-13T20:07:56.612027] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-13T20:07:56.612108] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-13T20:07:56.612174] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-13T20:07:56.964665] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:07:57.203284] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T20:07:57.217876] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-13T20:07:58.011102] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T20:07:58.020909] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-13T20:07:58.740611] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T20:07:58.822985] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-13T20:07:58.840262] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:07:59.252200] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-13T20:07:59.617936] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-13T20:08:00.417989] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-13T20:08:01.217913] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-13T20:08:01.239765] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T20:08:02.018006] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-13T20:08:02.817891] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-13T20:08:03.074406] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T20:08:03.187586] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T20:08:03.617902] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-13T20:08:03.849379] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (4.23 seconds). [2025-10-13T20:08:04.417942] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-13T20:08:05.217924] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-13T20:08:05.248313] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T20:08:05.352993] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T20:08:06.017976] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-13T20:08:06.818025] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-13T20:08:06.864402] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T20:08:06.931580] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:08:07.617928] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-13T20:08:08.207186] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (5.39 seconds). [2025-10-13T20:08:08.417931] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-13T20:08:08.540173] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T20:08:09.002373] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T20:08:09.021393] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T20:08:09.217938] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-13T20:08:10.018004] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-13T20:08:10.817998] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-13T20:08:10.876562] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T20:08:10.961327] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T20:08:11.617945] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-13T20:08:12.417975] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-13T20:08:12.468465] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T20:08:12.476155] [INFO ] [REMOTE ] MFC: Full fetch complete (74115 records). [2025-10-13T20:08:12.476341] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-13T20:08:12.590508] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T20:08:12.896138] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-13T20:08:12.896233] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-13T20:08:12.897439] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-13T20:08:12.897539] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-13T20:08:12.900061] [DEBUG] [LOCAL ] MFC: Trimmed 74115 records to 51104 (keeping 200 days of data) [2025-10-13T20:08:13.218051] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-13T20:08:13.243543] [DEBUG] [LOCAL ] MFC: Primary data saved (51104 records). [2025-10-13T20:08:13.243757] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-13T20:08:13.243914] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFC took 41.4s. Estimated remaining: 2h 25m 46s. Rate: 7.1 symbols/min [2025-10-13T20:08:13.451560] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:13.459535] [DEBUG] [LOCAL ] MFSG: Loaded 5694 existing records from primary storage. [2025-10-13T20:08:13.459817] [INFO ] [MAIN ] MFSG: Loaded 5694 existing records. [2025-10-13T20:08:13.573736] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-13T20:08:13.662129] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:13.662347] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-13T20:08:13.662436] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-13T20:08:13.662798] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-13T20:08:13.662858] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-13T20:08:14.028879] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-13T20:08:14.079437] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:14.248129] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T20:08:14.817990] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-13T20:08:14.886732] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T20:08:15.139266] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-13T20:08:15.617915] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-13T20:08:16.417926] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-13T20:08:16.507141] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T20:08:16.509248] [INFO ] [REMOTE ] MFM: Full fetch complete (19562 records). [2025-10-13T20:08:16.509321] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-13T20:08:16.866255] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-13T20:08:16.866333] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-13T20:08:16.866764] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-13T20:08:16.866825] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-13T20:08:16.867686] [DEBUG] [LOCAL ] MFM: Trimmed 19562 records to 14711 (keeping 200 days of data) [2025-10-13T20:08:16.951050] [DEBUG] [LOCAL ] MFM: Primary data saved (14711 records). [2025-10-13T20:08:16.951208] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-13T20:08:16.951321] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFM took 25.1s. Estimated remaining: 2h 25m 34s. Rate: 7.1 symbols/min [2025-10-13T20:08:17.125990] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:17.139405] [DEBUG] [LOCAL ] MFSI: Loaded 11975 existing records from primary storage. [2025-10-13T20:08:17.139705] [INFO ] [MAIN ] MFSI: Loaded 11975 existing records. [2025-10-13T20:08:17.223143] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-13T20:08:17.345556] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:17.345813] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-13T20:08:17.345859] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-13T20:08:17.346226] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-13T20:08:17.346283] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-13T20:08:17.635005] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-13T20:08:17.723664] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:18.023680] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-13T20:08:18.029151] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T20:08:18.271306] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-13T20:08:18.817913] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-13T20:08:19.154337] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T20:08:19.617966] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-13T20:08:19.943610] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T20:08:20.418018] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-13T20:08:20.856096] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T20:08:21.217923] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-13T20:08:21.689322] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T20:08:22.017937] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-13T20:08:22.461298] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T20:08:22.817924] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-13T20:08:23.617928] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-13T20:08:24.066741] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T20:08:24.316814] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T20:08:24.321958] [INFO ] [REMOTE ] MFG: Full fetch complete (69231 records). [2025-10-13T20:08:24.322095] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-13T20:08:24.420308] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-13T20:08:24.706901] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-13T20:08:24.706988] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-13T20:08:24.707909] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-13T20:08:24.708005] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-13T20:08:24.709336] [DEBUG] [LOCAL ] MFG: Trimmed 69231 records to 49426 (keeping 200 days of data) [2025-10-13T20:08:24.998331] [DEBUG] [LOCAL ] MFG: Primary data saved (49426 records). [2025-10-13T20:08:24.998462] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-13T20:08:24.998568] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFG took 35.9s. Estimated remaining: 2h 25m 25s. Rate: 7.1 symbols/min [2025-10-13T20:08:25.104040] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T20:08:25.172773] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:25.176940] [DEBUG] [LOCAL ] MFSV: Loaded 2755 existing records from primary storage. [2025-10-13T20:08:25.177080] [INFO ] [MAIN ] MFSV: Loaded 2755 existing records. [2025-10-13T20:08:25.223095] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-13T20:08:25.360285] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:25.360509] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-13T20:08:25.360556] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-13T20:08:25.360801] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-13T20:08:25.360861] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-13T20:08:25.712955] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:25.845780] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T20:08:26.017924] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-13T20:08:26.690175] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:08:26.691489] [INFO ] [REMOTE ] MFSB: Full fetch complete (1767 records). [2025-10-13T20:08:26.691583] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-13T20:08:26.823004] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-13T20:08:26.875482] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-13T20:08:26.875661] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:08:26.875728] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:08:26.875800] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-13T20:08:26.875861] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-13T20:08:26.875897] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-13T20:08:26.875954] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-13T20:08:26.876030] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSB took 30.4s. Estimated remaining: 2h 25m 12s. Rate: 7.1 symbols/min [2025-10-13T20:08:27.078507] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:27.098632] [DEBUG] [LOCAL ] MG: Loaded 16369 existing records from primary storage. [2025-10-13T20:08:27.098918] [INFO ] [MAIN ] MG: Loaded 16369 existing records. [2025-10-13T20:08:27.279192] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:27.279425] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-13T20:08:27.279473] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-13T20:08:27.279937] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-13T20:08:27.279997] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-13T20:08:27.565616] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T20:08:27.620896] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-13T20:08:27.649590] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:28.254834] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T20:08:28.417927] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-13T20:08:28.785240] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T20:08:29.217921] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-13T20:08:29.645111] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T20:08:30.017928] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-13T20:08:30.409809] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-13T20:08:30.817917] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-13T20:08:31.617908] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-13T20:08:31.892859] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T20:08:32.193455] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T20:08:32.417931] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-13T20:08:33.217904] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-13T20:08:33.378985] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T20:08:33.487497] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-13T20:08:34.017945] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-13T20:08:34.571799] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T20:08:34.817996] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-13T20:08:35.364891] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-13T20:08:35.617922] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-13T20:08:36.377775] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T20:08:36.417889] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-13T20:08:37.217897] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-13T20:08:37.407077] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:08:37.793137] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T20:08:38.017947] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-13T20:08:38.380416] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T20:08:38.817910] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-13T20:08:39.590180] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T20:08:39.617878] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-13T20:08:40.417906] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-13T20:08:40.522279] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T20:08:41.083002] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T20:08:41.218010] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-13T20:08:41.758788] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T20:08:42.017978] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-13T20:08:42.817898] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-13T20:08:43.052349] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T20:08:43.300360] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T20:08:43.617996] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-13T20:08:44.417896] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-13T20:08:44.474556] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T20:08:45.217986] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-13T20:08:45.363926] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T20:08:45.925541] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:08:45.926867] [INFO ] [REMOTE ] MFSG: Full fetch complete (6451 records). [2025-10-13T20:08:45.926938] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-13T20:08:46.023432] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-13T20:08:46.321611] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-13T20:08:46.321740] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-13T20:08:46.321963] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-13T20:08:46.322026] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-13T20:08:46.322425] [DEBUG] [LOCAL ] MFSG: Trimmed 6451 records to 5685 (keeping 200 days of data) [2025-10-13T20:08:46.360507] [DEBUG] [LOCAL ] MFSG: Primary data saved (5685 records). [2025-10-13T20:08:46.360673] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-13T20:08:46.360780] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 33.1s. Estimated remaining: 2h 25m 12s. Rate: 7.1 symbols/min [2025-10-13T20:08:46.482521] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T20:08:46.567863] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:46.619179] [DEBUG] [LOCAL ] MGA: Loaded 51404 existing records from primary storage. [2025-10-13T20:08:46.619568] [INFO ] [MAIN ] MGA: Loaded 51404 existing records. [2025-10-13T20:08:46.818183] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-13T20:08:46.820162] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:46.821671] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-13T20:08:46.821738] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-13T20:08:46.822791] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-13T20:08:46.822852] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-13T20:08:47.240359] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:47.294822] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T20:08:47.617968] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-13T20:08:48.028601] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T20:08:48.418057] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-13T20:08:49.217936] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-13T20:08:50.017901] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-13T20:08:50.085980] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T20:08:50.393078] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T20:08:50.405342] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T20:08:50.817920] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-13T20:08:51.618014] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-13T20:08:52.185384] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T20:08:52.423128] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-13T20:08:52.440929] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T20:08:53.039393] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T20:08:53.217986] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-13T20:08:54.017899] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-13T20:08:54.175901] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T20:08:54.817997] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-13T20:08:55.332714] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T20:08:55.334009] [INFO ] [REMOTE ] MFSV: Full fetch complete (3444 records). [2025-10-13T20:08:55.334088] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-13T20:08:55.635029] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-13T20:08:55.722680] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-13T20:08:55.722883] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-13T20:08:55.723103] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-13T20:08:55.723189] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-13T20:08:55.723992] [DEBUG] [LOCAL ] MFSV: Trimmed 3444 records to 2758 (keeping 200 days of data) [2025-10-13T20:08:55.742813] [DEBUG] [LOCAL ] MFSV: Primary data saved (2758 records). [2025-10-13T20:08:55.743045] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-13T20:08:55.743355] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSV took 30.7s. Estimated remaining: 2h 25m 4s. Rate: 7.1 symbols/min [2025-10-13T20:08:55.847834] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T20:08:55.966993] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:55.973889] [DEBUG] [LOCAL ] MGF: Loaded 4333 existing records from primary storage. [2025-10-13T20:08:55.974099] [INFO ] [MAIN ] MGF: Loaded 4333 existing records. [2025-10-13T20:08:56.173014] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:56.173397] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-13T20:08:56.173456] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-13T20:08:56.173747] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-13T20:08:56.173808] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-13T20:08:56.423054] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-13T20:08:56.543771] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:08:56.627117] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:57.217912] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-13T20:08:57.435344] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T20:08:57.437850] [INFO ] [REMOTE ] MFSI: Full fetch complete (14302 records). [2025-10-13T20:08:57.437921] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-13T20:08:57.792303] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-13T20:08:57.792385] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-13T20:08:57.792734] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-13T20:08:57.792796] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-13T20:08:57.793686] [DEBUG] [LOCAL ] MFSI: Trimmed 14302 records to 11946 (keeping 200 days of data) [2025-10-13T20:08:57.862975] [DEBUG] [LOCAL ] MFSI: Primary data saved (11946 records). [2025-10-13T20:08:57.863099] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-13T20:08:57.863176] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MFSI took 40.9s. Estimated remaining: 2h 24m 51s. Rate: 7.1 symbols/min [2025-10-13T20:08:58.030966] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-13T20:08:58.034485] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:08:58.086434] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-10-13T20:08:58.086798] [INFO ] [MAIN ] MGM: Loaded 54387 existing records. [2025-10-13T20:08:58.266543] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:08:58.266804] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-13T20:08:58.266851] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-13T20:08:58.268175] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-13T20:08:58.268235] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-13T20:08:58.619891] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:08:58.701935] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T20:08:58.817909] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-13T20:08:58.957630] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T20:08:59.617910] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-13T20:08:59.736363] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T20:09:00.168776] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T20:09:00.417894] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-13T20:09:01.218058] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-13T20:09:01.884569] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T20:09:02.018035] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-13T20:09:02.272067] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T20:09:02.817999] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-13T20:09:03.484855] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T20:09:03.617926] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-13T20:09:03.863056] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T20:09:04.418014] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-13T20:09:05.217944] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-13T20:09:05.346044] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T20:09:05.779172] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T20:09:05.894821] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T20:09:06.017931] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-13T20:09:06.817911] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-13T20:09:07.470451] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T20:09:07.617920] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-13T20:09:08.417912] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-13T20:09:09.232059] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-13T20:09:09.234573] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T20:09:09.281367] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:09:09.345011] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (3.33 seconds). [2025-10-13T20:09:09.743857] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T20:09:10.017904] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-13T20:09:10.817910] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-13T20:09:11.273818] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T20:09:11.617898] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-13T20:09:11.897330] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T20:09:12.247127] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T20:09:12.417922] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-13T20:09:13.217911] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-13T20:09:13.955170] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T20:09:14.020956] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-13T20:09:14.817919] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-13T20:09:15.274893] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T20:09:15.606415] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:09:15.609250] [INFO ] [REMOTE ] MG: Full fetch complete (23678 records). [2025-10-13T20:09:15.609418] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-13T20:09:15.623330] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-13T20:09:15.888788] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T20:09:16.157546] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-13T20:09:16.157614] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-13T20:09:16.158248] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-13T20:09:16.158309] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-13T20:09:16.159269] [DEBUG] [LOCAL ] MG: Trimmed 23678 records to 15987 (keeping 200 days of data) [2025-10-13T20:09:16.265609] [DEBUG] [LOCAL ] MG: Primary data saved (15987 records). [2025-10-13T20:09:16.265781] [INFO ] [MAIN ] MG: Full history saved. [2025-10-13T20:09:16.265865] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MG took 49.4s. Estimated remaining: 2h 24m 50s. Rate: 7.1 symbols/min [2025-10-13T20:09:16.388673] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T20:09:16.420944] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-13T20:09:16.447815] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:16.455179] [DEBUG] [LOCAL ] MGR: Loaded 5704 existing records from primary storage. [2025-10-13T20:09:16.455394] [INFO ] [MAIN ] MGR: Loaded 5704 existing records. [2025-10-13T20:09:16.627974] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:16.628155] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-13T20:09:16.628201] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-13T20:09:16.628464] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-13T20:09:16.628520] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-13T20:09:17.028007] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:17.218013] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-13T20:09:18.017989] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-13T20:09:18.281007] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T20:09:18.376513] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T20:09:18.817996] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-13T20:09:18.896419] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T20:09:19.617910] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-13T20:09:19.705630] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T20:09:20.417932] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-13T20:09:21.023150] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T20:09:21.214909] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T20:09:21.224949] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-13T20:09:21.803249] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T20:09:22.018026] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-13T20:09:22.817941] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-13T20:09:23.617939] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-13T20:09:23.934347] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T20:09:24.215456] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T20:09:24.216739] [INFO ] [REMOTE ] MGF: Full fetch complete (5872 records). [2025-10-13T20:09:24.216807] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-13T20:09:24.419548] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-13T20:09:24.625372] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T20:09:24.657419] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-13T20:09:24.657681] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-13T20:09:24.657990] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-13T20:09:24.658227] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-13T20:09:24.658107] [INFO ] [REMOTE ] MGA: Full fetch complete (73582 records). [2025-10-13T20:09:24.658364] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-13T20:09:24.659224] [DEBUG] [LOCAL ] MGF: Trimmed 5872 records to 4272 (keeping 200 days of data) [2025-10-13T20:09:24.814496] [DEBUG] [LOCAL ] MGF: Primary data saved (4272 records). [2025-10-13T20:09:24.826804] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-13T20:09:24.839709] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGF took 29.1s. Estimated remaining: 2h 24m 42s. Rate: 7.1 symbols/min [2025-10-13T20:09:25.136072] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T20:09:25.230327] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-13T20:09:25.263782] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:25.330877] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-13T20:09:25.330746] [DEBUG] [LOCAL ] MGRB: Loaded 4095 existing records from primary storage. [2025-10-13T20:09:25.331243] [INFO ] [MAIN ] MGRB: Loaded 4095 existing records. [2025-10-13T20:09:25.331053] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-13T20:09:25.374501] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-13T20:09:25.400860] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-13T20:09:25.455209] [DEBUG] [LOCAL ] MGA: Trimmed 73582 records to 50634 (keeping 200 days of data) [2025-10-13T20:09:25.512710] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:25.574771] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-13T20:09:25.575201] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-13T20:09:25.602087] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-13T20:09:25.603807] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-13T20:09:26.062026] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:26.067050] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-13T20:09:26.081160] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T20:09:26.221188] [DEBUG] [LOCAL ] MGA: Primary data saved (50634 records). [2025-10-13T20:09:26.221360] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-13T20:09:26.221452] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGA took 39.9s. Estimated remaining: 2h 24m 28s. Rate: 7.1 symbols/min [2025-10-13T20:09:26.389177] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:26.392877] [DEBUG] [LOCAL ] MGRD: Loaded 2282 existing records from primary storage. [2025-10-13T20:09:26.393015] [INFO ] [MAIN ] MGRD: Loaded 2282 existing records. [2025-10-13T20:09:26.563917] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:26.564219] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-13T20:09:26.564274] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-13T20:09:26.564448] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-13T20:09:26.564503] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-13T20:09:26.827256] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-13T20:09:26.917207] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:27.617913] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-13T20:09:27.706194] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T20:09:27.986463] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T20:09:28.170563] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T20:09:28.417979] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-13T20:09:28.933294] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T20:09:29.217917] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-13T20:09:29.765554] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T20:09:30.017903] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-13T20:09:30.817905] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-13T20:09:31.353868] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T20:09:31.617896] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-13T20:09:31.876721] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T20:09:32.199531] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T20:09:32.417913] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-13T20:09:33.061592] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-13T20:09:33.217923] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-13T20:09:33.695085] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T20:09:34.017924] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-13T20:09:34.469913] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T20:09:34.817929] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-13T20:09:35.442462] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T20:09:35.617911] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-13T20:09:36.043444] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T20:09:36.417945] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-13T20:09:36.882631] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T20:09:37.217931] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-13T20:09:37.912922] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:09:37.918599] [INFO ] [REMOTE ] MGM: Full fetch complete (77603 records). [2025-10-13T20:09:37.918748] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-13T20:09:38.023181] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-13T20:09:38.348708] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-13T20:09:38.348790] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-13T20:09:38.349749] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-13T20:09:38.349832] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-13T20:09:38.351426] [DEBUG] [LOCAL ] MGM: Trimmed 77603 records to 53606 (keeping 200 days of data) [2025-10-13T20:09:38.573486] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T20:09:38.700886] [DEBUG] [LOCAL ] MGM: Primary data saved (53606 records). [2025-10-13T20:09:38.701028] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-13T20:09:38.701105] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGM took 40.8s. Estimated remaining: 2h 24m 22s. Rate: 7.1 symbols/min [2025-10-13T20:09:38.823011] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-13T20:09:38.869921] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:38.879214] [DEBUG] [LOCAL ] MGRE: Loaded 6773 existing records from primary storage. [2025-10-13T20:09:38.879541] [INFO ] [MAIN ] MGRE: Loaded 6773 existing records. [2025-10-13T20:09:39.065382] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:39.065613] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-13T20:09:39.065697] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-13T20:09:39.066002] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-13T20:09:39.066061] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-13T20:09:39.411997] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:39.508840] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T20:09:39.617892] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-13T20:09:40.200180] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:09:40.201376] [INFO ] [REMOTE ] MGR: Full fetch complete (8038 records). [2025-10-13T20:09:40.201445] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-13T20:09:40.423043] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-13T20:09:40.569846] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-13T20:09:40.569920] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-13T20:09:40.570122] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-13T20:09:40.570160] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-13T20:09:40.570550] [DEBUG] [LOCAL ] MGR: Trimmed 8038 records to 5648 (keeping 200 days of data) [2025-10-13T20:09:40.605068] [DEBUG] [LOCAL ] MGR: Primary data saved (5648 records). [2025-10-13T20:09:40.605182] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-13T20:09:40.605258] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGR took 24.3s. Estimated remaining: 2h 24m 9s. Rate: 7.1 symbols/min [2025-10-13T20:09:40.773287] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:40.823505] [DEBUG] [LOCAL ] MGY: Loaded 53170 existing records from primary storage. [2025-10-13T20:09:40.823839] [INFO ] [MAIN ] MGY: Loaded 53170 existing records. [2025-10-13T20:09:40.934970] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T20:09:41.006832] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:41.007022] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-13T20:09:41.007070] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-13T20:09:41.008394] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-13T20:09:41.008459] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-13T20:09:41.223006] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-13T20:09:41.396110] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:41.828319] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T20:09:42.017909] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-13T20:09:42.461499] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T20:09:42.817992] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-13T20:09:43.484298] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T20:09:43.617946] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-13T20:09:44.073814] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T20:09:44.417928] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-13T20:09:45.217921] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-13T20:09:45.633521] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-13T20:09:45.889715] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T20:09:46.018007] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-13T20:09:46.817974] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-13T20:09:47.388256] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T20:09:47.389084] [INFO ] [REMOTE ] MGRD: Full fetch complete (3517 records). [2025-10-13T20:09:47.389151] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-13T20:09:47.621750] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-13T20:09:47.801258] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-13T20:09:47.801419] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-13T20:09:47.801605] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-13T20:09:47.801742] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-13T20:09:47.802319] [DEBUG] [LOCAL ] MGRD: Trimmed 3517 records to 2220 (keeping 200 days of data) [2025-10-13T20:09:47.842972] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T20:09:47.855900] [DEBUG] [LOCAL ] MGRD: Primary data saved (2220 records). [2025-10-13T20:09:47.855987] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-13T20:09:47.856057] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRD took 21.6s. Estimated remaining: 2h 23m 60s. Rate: 7.1 symbols/min [2025-10-13T20:09:48.026419] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:48.026604] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-13T20:09:48.026666] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-13T20:09:48.026785] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-13T20:09:48.026826] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-13T20:09:48.026866] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-13T20:09:48.026899] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-13T20:09:48.312844] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T20:09:48.392100] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:48.417882] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-13T20:09:48.624978] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:09:48.625299] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-13T20:09:48.625384] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:09:48.625433] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-13T20:09:48.625467] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:09:48.625505] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-13T20:09:48.625561] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-13T20:09:48.625598] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-13T20:09:48.625681] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-13T20:09:48.625751] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MH took 0.8s. Estimated remaining: 2h 23m 45s. Rate: 7.1 symbols/min [2025-10-13T20:09:48.792479] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:09:48.805342] [DEBUG] [LOCAL ] MHD: Loaded 12585 existing records from primary storage. [2025-10-13T20:09:48.805534] [INFO ] [MAIN ] MHD: Loaded 12585 existing records. [2025-10-13T20:09:48.979945] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:09:48.980170] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-13T20:09:48.980216] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-13T20:09:48.980588] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-13T20:09:48.980680] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-13T20:09:49.223156] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-13T20:09:49.335459] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:09:49.849264] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T20:09:50.017924] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-13T20:09:50.717101] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T20:09:50.817904] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-13T20:09:51.411450] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T20:09:51.617922] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-13T20:09:52.417929] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-13T20:09:53.217908] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-13T20:09:53.431075] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T20:09:54.017977] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-13T20:09:54.258502] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-13T20:09:54.376898] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T20:09:54.597535] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T20:09:54.817937] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-13T20:09:55.520088] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T20:09:55.617887] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-13T20:09:56.270789] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T20:09:56.417927] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-13T20:09:57.171090] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T20:09:57.217886] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-13T20:09:57.920096] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T20:09:58.017928] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-13T20:09:58.489866] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T20:09:58.817987] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-13T20:09:59.617903] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-13T20:10:00.309280] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T20:10:00.417898] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-13T20:10:00.586202] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T20:10:01.217910] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-13T20:10:01.358838] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:10:02.017929] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-13T20:10:02.817904] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-13T20:10:02.897342] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T20:10:02.942876] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T20:10:03.538246] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T20:10:03.617923] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-13T20:10:04.261087] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:10:04.262183] [INFO ] [REMOTE ] MGRE: Full fetch complete (9371 records). [2025-10-13T20:10:04.262271] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-13T20:10:04.426135] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-13T20:10:04.656345] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-13T20:10:04.656425] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-13T20:10:04.656742] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-13T20:10:04.656810] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-13T20:10:04.657444] [DEBUG] [LOCAL ] MGRE: Trimmed 9371 records to 6672 (keeping 200 days of data) [2025-10-13T20:10:04.699316] [DEBUG] [LOCAL ] MGRE: Primary data saved (6672 records). [2025-10-13T20:10:04.699448] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-13T20:10:04.699530] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 26.0s. Estimated remaining: 2h 23m 43s. Rate: 7.1 symbols/min [2025-10-13T20:10:04.892207] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:04.902499] [DEBUG] [LOCAL ] MHF: Loaded 8952 existing records from primary storage. [2025-10-13T20:10:04.902747] [INFO ] [MAIN ] MHF: Loaded 8952 existing records. [2025-10-13T20:10:05.104664] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:10:05.104909] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-13T20:10:05.104960] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-13T20:10:05.105462] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-13T20:10:05.105518] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-13T20:10:05.223048] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-13T20:10:05.454736] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:05.891911] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T20:10:06.017916] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-13T20:10:06.807215] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-13T20:10:06.818151] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-13T20:10:06.834214] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T20:10:07.617920] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-13T20:10:07.692455] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:10:08.418040] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-13T20:10:09.097455] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T20:10:09.120585] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T20:10:09.217918] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-13T20:10:09.850848] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T20:10:10.017929] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-13T20:10:10.817924] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-13T20:10:10.912316] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T20:10:11.260503] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T20:10:11.617940] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-13T20:10:12.417920] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-13T20:10:12.915002] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T20:10:12.915874] [INFO ] [REMOTE ] MGRB: Full fetch complete (5787 records). [2025-10-13T20:10:12.915946] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-13T20:10:13.222968] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-13T20:10:13.288826] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-13T20:10:13.288900] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-13T20:10:13.289069] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-13T20:10:13.289131] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-13T20:10:13.289496] [DEBUG] [LOCAL ] MGRB: Trimmed 5787 records to 4045 (keeping 200 days of data) [2025-10-13T20:10:13.315694] [DEBUG] [LOCAL ] MGRB: Primary data saved (4045 records). [2025-10-13T20:10:13.315798] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-13T20:10:13.315874] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MGRB took 48.5s. Estimated remaining: 2h 23m 34s. Rate: 7.1 symbols/min [2025-10-13T20:10:13.485672] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:13.527080] [DEBUG] [LOCAL ] MHK: Loaded 42752 existing records from primary storage. [2025-10-13T20:10:13.527383] [INFO ] [MAIN ] MHK: Loaded 42752 existing records. [2025-10-13T20:10:13.715697] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:10:13.715894] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-13T20:10:13.715956] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-13T20:10:13.716786] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-13T20:10:13.716848] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-13T20:10:14.040804] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-13T20:10:14.082692] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:14.093071] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T20:10:14.298621] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-13T20:10:14.815945] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T20:10:14.817946] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-13T20:10:15.617923] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-13T20:10:15.655720] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T20:10:16.195241] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T20:10:16.417939] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-13T20:10:17.188308] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T20:10:17.218000] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-13T20:10:18.017929] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-13T20:10:18.745667] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T20:10:18.825010] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-13T20:10:18.839864] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T20:10:19.617931] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-13T20:10:20.339465] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T20:10:20.417916] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-13T20:10:21.220110] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-13T20:10:21.222261] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T20:10:21.714629] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T20:10:22.029170] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-13T20:10:22.035683] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T20:10:22.817919] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-13T20:10:22.931562] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:10:23.617931] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-13T20:10:24.261089] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T20:10:24.417890] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-13T20:10:24.515622] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T20:10:25.217932] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-13T20:10:26.017901] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-13T20:10:26.036799] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T20:10:26.044148] [INFO ] [REMOTE ] MGY: Full fetch complete (75743 records). [2025-10-13T20:10:26.044277] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-13T20:10:26.128913] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T20:10:26.151311] [INFO ] [REMOTE ] MHD: Full fetch complete (18385 records). [2025-10-13T20:10:26.167192] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-13T20:10:26.745304] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-13T20:10:26.762130] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-13T20:10:26.785087] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-13T20:10:26.789451] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-13T20:10:26.819680] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-13T20:10:26.831431] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-13T20:10:26.831730] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-13T20:10:26.831977] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-13T20:10:26.832096] [DEBUG] [LOCAL ] MGY: Trimmed 75743 records to 52411 (keeping 200 days of data) [2025-10-13T20:10:26.832177] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-13T20:10:26.833207] [DEBUG] [LOCAL ] MHD: Trimmed 18385 records to 12370 (keeping 200 days of data) [2025-10-13T20:10:26.998777] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:10:27.019101] [DEBUG] [LOCAL ] MHD: Primary data saved (12370 records). [2025-10-13T20:10:27.020872] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-13T20:10:27.021793] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHD took 38.4s. Estimated remaining: 2h 23m 30s. Rate: 7.1 symbols/min [2025-10-13T20:10:27.208479] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:27.209339] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-13T20:10:27.209410] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-13T20:10:27.210989] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-13T20:10:27.211267] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-13T20:10:27.212537] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-13T20:10:27.212856] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-13T20:10:27.635339] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-13T20:10:27.678807] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:27.780927] [DEBUG] [LOCAL ] MGY: Primary data saved (52411 records). [2025-10-13T20:10:27.781129] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-13T20:10:27.781309] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MGY took 47.2s. Estimated remaining: 2h 23m 16s. Rate: 7.1 symbols/min [2025-10-13T20:10:27.948724] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:27.957751] [DEBUG] [LOCAL ] MHN: Loaded 7667 existing records from primary storage. [2025-10-13T20:10:27.958003] [INFO ] [MAIN ] MHN: Loaded 7667 existing records. [2025-10-13T20:10:28.132549] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:10:28.132786] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-13T20:10:28.132833] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-13T20:10:28.133103] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-13T20:10:28.133160] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-13T20:10:28.423029] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-13T20:10:28.493899] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:28.549149] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T20:10:28.779963] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-13T20:10:29.078486] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-13T20:10:29.217893] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-13T20:10:30.017923] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-13T20:10:30.817937] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-13T20:10:30.907712] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T20:10:30.923008] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T20:10:31.150474] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T20:10:31.617910] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-13T20:10:32.412888] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T20:10:32.417909] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-13T20:10:32.801947] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T20:10:33.217916] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-13T20:10:33.616732] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-13T20:10:34.017985] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-13T20:10:34.742629] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T20:10:34.817904] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-13T20:10:35.548685] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T20:10:35.617927] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-13T20:10:36.417943] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-13T20:10:36.787350] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-13T20:10:37.170597] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T20:10:37.217969] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-13T20:10:37.749828] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-13T20:10:38.017908] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-13T20:10:38.740052] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T20:10:38.818042] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-13T20:10:39.582912] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T20:10:39.617930] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-13T20:10:40.363682] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T20:10:40.418032] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-13T20:10:40.717259] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-13T20:10:41.217974] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-13T20:10:41.447710] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-13T20:10:42.017912] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-13T20:10:42.817945] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-13T20:10:43.612469] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:10:43.615803] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T20:10:43.624876] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-13T20:10:43.624815] [INFO ] [REMOTE ] MHF: Full fetch complete (12740 records). [2025-10-13T20:10:43.625718] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-13T20:10:43.981799] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-13T20:10:43.981876] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-13T20:10:43.982166] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-13T20:10:43.982205] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-13T20:10:43.982715] [DEBUG] [LOCAL ] MHF: Trimmed 12740 records to 8824 (keeping 200 days of data) [2025-10-13T20:10:44.034420] [DEBUG] [LOCAL ] MHF: Primary data saved (8824 records). [2025-10-13T20:10:44.034553] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-13T20:10:44.034678] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHF took 39.3s. Estimated remaining: 2h 23m 13s. Rate: 7.1 symbols/min [2025-10-13T20:10:44.106189] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T20:10:44.206455] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:44.228592] [DEBUG] [LOCAL ] MHO: Loaded 24089 existing records from primary storage. [2025-10-13T20:10:44.228881] [INFO ] [MAIN ] MHO: Loaded 24089 existing records. [2025-10-13T20:10:44.404332] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:10:44.404589] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-13T20:10:44.404679] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-13T20:10:44.405223] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-13T20:10:44.405281] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-13T20:10:44.425325] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-13T20:10:44.752451] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:45.217985] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-13T20:10:45.747278] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T20:10:46.017925] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-13T20:10:46.104057] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T20:10:46.817943] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-13T20:10:47.168532] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T20:10:47.240468] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T20:10:47.617928] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-13T20:10:48.417999] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-13T20:10:49.088985] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T20:10:49.160294] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T20:10:49.217901] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-13T20:10:49.833791] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T20:10:50.018022] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-13T20:10:50.817941] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-13T20:10:51.310165] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T20:10:51.311198] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T20:10:51.617996] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-13T20:10:52.230459] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:10:52.232254] [INFO ] [REMOTE ] MHN: Full fetch complete (11574 records). [2025-10-13T20:10:52.232436] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-13T20:10:52.423953] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-13T20:10:52.595233] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-13T20:10:52.595307] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-13T20:10:52.595578] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-13T20:10:52.595618] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-13T20:10:52.596125] [DEBUG] [LOCAL ] MHN: Trimmed 11574 records to 7534 (keeping 200 days of data) [2025-10-13T20:10:52.642380] [DEBUG] [LOCAL ] MHN: Primary data saved (7534 records). [2025-10-13T20:10:52.642519] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-13T20:10:52.642599] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 24.9s. Estimated remaining: 2h 23m 5s. Rate: 7.1 symbols/min [2025-10-13T20:10:52.811592] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:52.811778] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-13T20:10:52.811822] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-13T20:10:52.811955] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-13T20:10:52.812028] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-13T20:10:52.812108] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-13T20:10:52.812151] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-13T20:10:53.171064] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:53.217887] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-13T20:10:53.443030] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:10:53.443347] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-13T20:10:53.443445] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:10:53.443492] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-13T20:10:53.443551] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:10:53.443622] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-13T20:10:53.443726] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-13T20:10:53.443771] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-13T20:10:53.443812] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-13T20:10:53.443881] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MIAX took 0.8s. Estimated remaining: 2h 22m 51s. Rate: 7.1 symbols/min [2025-10-13T20:10:53.611568] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:10:53.625726] [DEBUG] [LOCAL ] MIN: Loaded 13950 existing records from primary storage. [2025-10-13T20:10:53.625963] [INFO ] [MAIN ] MIN: Loaded 13950 existing records. [2025-10-13T20:10:53.800701] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:10:53.801015] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-13T20:10:53.801069] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-13T20:10:53.801397] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-13T20:10:53.801454] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-13T20:10:54.023094] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-13T20:10:54.192820] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T20:10:54.215760] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:10:54.817919] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-13T20:10:55.331780] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:10:55.617915] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-13T20:10:56.358693] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T20:10:56.363982] [INFO ] [REMOTE ] MHK: Full fetch complete (60825 records). [2025-10-13T20:10:56.364083] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-13T20:10:56.426146] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-13T20:10:56.756006] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-13T20:10:56.756225] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-13T20:10:56.757110] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-13T20:10:56.757232] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-13T20:10:56.758477] [DEBUG] [LOCAL ] MHK: Trimmed 60825 records to 42155 (keeping 200 days of data) [2025-10-13T20:10:56.850944] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T20:10:56.852453] [INFO ] [REMOTE ] MHLA: Full fetch complete (1501 records). [2025-10-13T20:10:56.853071] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-13T20:10:56.981008] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T20:10:57.069420] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-13T20:10:57.070432] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:10:57.070857] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:10:57.071624] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-13T20:10:57.073242] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-13T20:10:57.074050] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-13T20:10:57.074560] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-13T20:10:57.075462] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHLA took 30.1s. Estimated remaining: 2h 22m 39s. Rate: 7.1 symbols/min [2025-10-13T20:10:57.217901] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-13T20:10:57.236703] [DEBUG] [LOCAL ] MHK: Primary data saved (42155 records). [2025-10-13T20:10:57.236804] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-13T20:10:57.236887] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MHK took 43.9s. Estimated remaining: 2h 22m 24s. Rate: 7.1 symbols/min [2025-10-13T20:10:58.017930] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-13T20:10:58.483051] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T20:10:58.818007] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-13T20:10:58.986287] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T20:10:59.617984] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-13T20:10:59.880869] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T20:11:00.417931] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-13T20:11:00.664187] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T20:11:01.218066] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-13T20:11:01.685733] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T20:11:02.018089] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-13T20:11:02.079683] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:11:02.818867] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-13T20:11:03.437793] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T20:11:03.579467] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T20:11:03.617987] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-13T20:11:04.210508] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T20:11:04.417983] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-13T20:11:05.213096] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T20:11:05.217870] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-13T20:11:06.017989] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-13T20:11:06.121903] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:11:06.818065] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-13T20:11:07.270963] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T20:11:07.617990] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-13T20:11:07.962899] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T20:11:08.417946] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-13T20:11:08.902588] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T20:11:09.044027] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T20:11:09.217937] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-13T20:11:10.017928] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-13T20:11:10.312330] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T20:11:10.315067] [INFO ] [REMOTE ] MHO: Full fetch complete (36619 records). [2025-10-13T20:11:10.315189] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-13T20:11:10.690716] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-13T20:11:10.690813] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-13T20:11:10.691463] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-13T20:11:10.691503] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-13T20:11:10.692516] [DEBUG] [LOCAL ] MHO: Trimmed 36619 records to 23748 (keeping 200 days of data) [2025-10-13T20:11:10.805775] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T20:11:10.817932] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-13T20:11:10.857833] [DEBUG] [LOCAL ] MHO: Primary data saved (23748 records). [2025-10-13T20:11:10.858029] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-13T20:11:10.858131] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 26.8s. Estimated remaining: 2h 22m 19s. Rate: 7.1 symbols/min [2025-10-13T20:11:11.736751] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T20:11:11.739267] [INFO ] [REMOTE ] MIN: Full fetch complete (18038 records). [2025-10-13T20:11:11.739490] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-13T20:11:12.113563] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-13T20:11:12.113696] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-13T20:11:12.114126] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-13T20:11:12.114169] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-13T20:11:12.114738] [DEBUG] [LOCAL ] MIN: Trimmed 18038 records to 13831 (keeping 200 days of data) [2025-10-13T20:11:12.195876] [DEBUG] [LOCAL ] MIN: Primary data saved (13831 records). [2025-10-13T20:11:12.196011] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-13T20:11:12.196093] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIN took 18.8s. Estimated remaining: 2h 22m 6s. Rate: 7.1 symbols/min [2025-10-13T20:11:12.893333] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:12.892033] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:12.937266] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-13T20:11:12.948508] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-13T20:11:12.941463] [DEBUG] [LOCAL ] MIR: No existing data file found in primary storage. [2025-10-13T20:11:12.941265] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:12.976028] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-13T20:11:12.976960] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-13T20:11:12.977898] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:12.976160] [WARN ] [MAIN ] MIR: No existing data found, performing full refresh instead. [2025-10-13T20:11:12.978685] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-13T20:11:12.979132] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-13T20:11:12.979203] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-13T20:11:12.979713] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-13T20:11:12.985434] [DEBUG] [LOCAL ] MIR: No primary data file found to delete. [2025-10-13T20:11:13.010092] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-13T20:11:13.145336] [DEBUG] [LOCAL ] MITP: Loaded 2369 existing records from primary storage. [2025-10-13T20:11:13.156781] [INFO ] [MAIN ] MITP: Loaded 2369 existing records. [2025-10-13T20:11:13.399056] [DEBUG] [LOCAL ] MITT: Loaded 23128 existing records from primary storage. [2025-10-13T20:11:13.462210] [INFO ] [MAIN ] MITT: Loaded 23128 existing records. [2025-10-13T20:11:13.871692] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:13.966957] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-13T20:11:13.983130] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-13T20:11:14.025593] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:14.009486] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-13T20:11:14.046626] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-13T20:11:14.052572] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-13T20:11:14.086574] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-13T20:11:14.116601] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-13T20:11:14.143742] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-13T20:11:14.194365] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:14.269297] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-13T20:11:14.421300] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:14.540919] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-13T20:11:14.832060] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T20:11:14.873207] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-13T20:11:14.942518] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:14.972189] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-13T20:11:15.002892] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:15.003358] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-13T20:11:15.264114] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-13T20:11:15.460318] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-13T20:11:15.617931] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-13T20:11:16.043913] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T20:11:16.293752] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T20:11:16.423044] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-13T20:11:16.445475] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T20:11:16.888305] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T20:11:17.217940] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-13T20:11:17.700465] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T20:11:18.017927] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-13T20:11:18.425313] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-13T20:11:18.817933] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-13T20:11:19.384013] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T20:11:19.617932] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-13T20:11:20.097747] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T20:11:20.417926] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-13T20:11:21.217944] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-13T20:11:21.533303] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:11:21.753741] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T20:11:22.017935] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-13T20:11:22.817928] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-13T20:11:23.617895] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-13T20:11:23.664248] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:11:23.879124] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T20:11:24.159053] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T20:11:24.417921] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-13T20:11:25.217934] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-13T20:11:26.017925] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-13T20:11:26.208588] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T20:11:26.353521] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T20:11:26.414078] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-13T20:11:26.817919] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-13T20:11:27.204669] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T20:11:27.617924] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-13T20:11:28.039837] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T20:11:28.417970] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-13T20:11:28.791061] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T20:11:29.217922] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-13T20:11:29.719721] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T20:11:30.017947] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-13T20:11:30.817980] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-13T20:11:31.607545] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T20:11:31.618003] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-13T20:11:31.976547] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T20:11:32.184525] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T20:11:32.417989] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-13T20:11:32.751403] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T20:11:33.217941] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-13T20:11:33.578859] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T20:11:34.017925] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-13T20:11:34.817902] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-13T20:11:35.072918] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T20:11:35.617925] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-13T20:11:36.127112] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T20:11:36.127907] [INFO ] [REMOTE ] MITP: Full fetch complete (3287 records). [2025-10-13T20:11:36.128006] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-13T20:11:36.420352] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-13T20:11:36.546031] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-13T20:11:36.545775] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T20:11:36.546189] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-13T20:11:36.556421] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-13T20:11:36.556962] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-13T20:11:36.557536] [DEBUG] [LOCAL ] MITP: Trimmed 3287 records to 2330 (keeping 200 days of data) [2025-10-13T20:11:36.572732] [DEBUG] [LOCAL ] MITP: Primary data saved (2330 records). [2025-10-13T20:11:36.572801] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-13T20:11:36.572876] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 24.4s. Estimated remaining: 2h 22m 9s. Rate: 7.1 symbols/min [2025-10-13T20:11:36.741978] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:36.749506] [DEBUG] [LOCAL ] MIY: Loaded 6272 existing records from primary storage. [2025-10-13T20:11:36.749714] [INFO ] [MAIN ] MIY: Loaded 6272 existing records. [2025-10-13T20:11:36.831763] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-13T20:11:36.934721] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:36.935014] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-13T20:11:36.935083] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-13T20:11:36.935504] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-13T20:11:36.935572] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-13T20:11:37.223167] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-13T20:11:37.318517] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:38.018005] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-13T20:11:38.813621] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T20:11:38.817872] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-13T20:11:38.875325] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T20:11:39.499968] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T20:11:39.617913] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-13T20:11:40.417895] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-13T20:11:40.786121] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T20:11:40.859449] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:11:40.860277] [INFO ] [REMOTE ] MITN: Full fetch complete (2363 records). [2025-10-13T20:11:40.860355] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-13T20:11:41.041318] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T20:11:41.041503] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:11:41.041575] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:11:41.041663] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-13T20:11:41.041745] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-13T20:11:41.041784] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-13T20:11:41.041825] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-13T20:11:41.041883] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITN took 28.8s. Estimated remaining: 2h 21m 58s. Rate: 7.1 symbols/min [2025-10-13T20:11:41.213216] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:41.217900] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-13T20:11:41.266886] [DEBUG] [LOCAL ] MKC: Loaded 53297 existing records from primary storage. [2025-10-13T20:11:41.267239] [INFO ] [MAIN ] MKC: Loaded 53297 existing records. [2025-10-13T20:11:41.447840] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:41.448097] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-13T20:11:41.448161] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-13T20:11:41.449073] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-13T20:11:41.449133] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-13T20:11:41.808988] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:42.017925] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-13T20:11:42.126624] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:11:42.817946] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-13T20:11:43.457818] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T20:11:43.459488] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T20:11:43.617925] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-13T20:11:44.041916] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T20:11:44.417920] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-13T20:11:45.174283] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T20:11:45.217911] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-13T20:11:45.801605] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T20:11:46.017924] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-13T20:11:46.817919] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-13T20:11:47.617907] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-13T20:11:47.721855] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:11:47.751985] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T20:11:48.328102] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T20:11:48.417908] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-13T20:11:48.990841] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T20:11:49.217979] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-13T20:11:49.862017] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T20:11:50.017929] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-13T20:11:50.818008] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-13T20:11:51.149172] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T20:11:51.519229] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T20:11:51.617906] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-13T20:11:52.418009] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-13T20:11:53.217982] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-13T20:11:53.306095] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T20:11:53.338503] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T20:11:53.342371] [INFO ] [REMOTE ] MITT: Full fetch complete (34098 records). [2025-10-13T20:11:53.342553] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-13T20:11:53.830409] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-13T20:11:53.830536] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-13T20:11:53.831813] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-13T20:11:53.831900] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-13T20:11:53.833248] [DEBUG] [LOCAL ] MITT: Trimmed 34098 records to 22766 (keeping 200 days of data) [2025-10-13T20:11:53.966123] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:11:53.972678] [INFO ] [REMOTE ] MIY: Full fetch complete (9046 records). [2025-10-13T20:11:53.975453] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-13T20:11:54.023267] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-13T20:11:54.585002] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-13T20:11:54.584599] [DEBUG] [LOCAL ] MITT: Primary data saved (22766 records). [2025-10-13T20:11:54.585248] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-13T20:11:54.585167] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-13T20:11:54.585442] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 42.4s. Estimated remaining: 2h 21m 53s. Rate: 7.1 symbols/min [2025-10-13T20:11:54.591216] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-13T20:11:54.617924] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-13T20:11:54.668274] [DEBUG] [LOCAL ] MIY: Trimmed 9046 records to 6239 (keeping 200 days of data) [2025-10-13T20:11:54.785845] [DEBUG] [LOCAL ] MIY: Primary data saved (6239 records). [2025-10-13T20:11:54.794568] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-13T20:11:54.794746] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 18.2s. Estimated remaining: 2h 21m 38s. Rate: 7.1 symbols/min [2025-10-13T20:11:54.824973] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:54.820764] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-13T20:11:55.015218] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:11:55.029160] [DEBUG] [LOCAL ] MKL: Loaded 34596 existing records from primary storage. [2025-10-13T20:11:55.029522] [INFO ] [MAIN ] MKL: Loaded 34596 existing records. [2025-10-13T20:11:55.227796] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:55.241154] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-13T20:11:55.241262] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-13T20:11:55.242037] [DEBUG] [LOCAL ] MLI: Loaded 44093 existing records from primary storage. [2025-10-13T20:11:55.242141] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-13T20:11:55.242592] [INFO ] [MAIN ] MLI: Loaded 44093 existing records. [2025-10-13T20:11:55.242484] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-13T20:11:55.530618] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:11:55.551837] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-13T20:11:55.557211] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-13T20:11:55.583171] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-13T20:11:55.590714] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-13T20:11:55.874434] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T20:11:56.096957] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-13T20:11:56.103490] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:56.225010] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:11:56.387290] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:11:56.417890] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-13T20:11:57.218027] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-13T20:11:57.684243] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T20:11:58.017939] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-13T20:11:58.183740] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T20:11:58.620472] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T20:11:58.817940] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-13T20:11:59.617924] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-13T20:11:59.736306] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T20:12:00.345367] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T20:12:00.417936] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-13T20:12:01.217906] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-13T20:12:01.541060] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T20:12:01.548042] [INFO ] [REMOTE ] MIR: Full fetch complete (73564 records). [2025-10-13T20:12:01.548218] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-13T20:12:01.840928] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T20:12:01.983352] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-13T20:12:01.983430] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-13T20:12:01.984456] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-13T20:12:01.984520] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-13T20:12:01.986014] [DEBUG] [LOCAL ] MIR: Trimmed 73564 records to 51221 (keeping 200 days of data) [2025-10-13T20:12:02.036973] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-13T20:12:02.292366] [DEBUG] [LOCAL ] MIR: Primary data saved (51221 records). [2025-10-13T20:12:02.292515] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-13T20:12:02.292591] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MIR took 50.1s. Estimated remaining: 2h 21m 29s. Rate: 7.1 symbols/min [2025-10-13T20:12:02.478672] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:02.510494] [DEBUG] [LOCAL ] MLM: Loaded 29814 existing records from primary storage. [2025-10-13T20:12:02.510842] [INFO ] [MAIN ] MLM: Loaded 29814 existing records. [2025-10-13T20:12:02.692008] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:02.692208] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-13T20:12:02.692255] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-13T20:12:02.692930] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-13T20:12:02.692987] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-13T20:12:02.831741] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-13T20:12:03.051942] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:03.084466] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T20:12:03.262179] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T20:12:03.617948] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-13T20:12:04.417917] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-13T20:12:04.591538] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:12:04.992132] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T20:12:05.217938] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-13T20:12:06.017906] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-13T20:12:06.163670] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T20:12:06.597023] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:12:06.817922] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-13T20:12:07.238560] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-13T20:12:07.617944] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-13T20:12:07.797182] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:12:08.417900] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-13T20:12:09.025286] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:12:09.218060] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-13T20:12:09.994045] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T20:12:10.017894] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-13T20:12:10.685262] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T20:12:10.817943] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-13T20:12:11.369772] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T20:12:11.618014] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-13T20:12:12.116947] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T20:12:12.417916] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-13T20:12:13.153491] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T20:12:13.217887] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-13T20:12:13.952349] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T20:12:14.018008] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-13T20:12:14.747346] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T20:12:14.817927] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-13T20:12:15.589491] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T20:12:15.617884] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-13T20:12:16.417905] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-13T20:12:16.466919] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T20:12:17.192940] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T20:12:17.217880] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-13T20:12:17.401595] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:12:18.017946] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-13T20:12:18.552720] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T20:12:18.817942] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-13T20:12:19.451198] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T20:12:19.618006] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-13T20:12:20.053364] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T20:12:20.417926] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-13T20:12:20.982998] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T20:12:21.217943] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-13T20:12:22.005224] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T20:12:22.017875] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-13T20:12:22.733510] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T20:12:22.737455] [INFO ] [REMOTE ] MKL: Full fetch complete (49702 records). [2025-10-13T20:12:22.737597] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-13T20:12:22.823131] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-13T20:12:23.130384] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-13T20:12:23.130580] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-13T20:12:23.131447] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-13T20:12:23.131508] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-13T20:12:23.132627] [DEBUG] [LOCAL ] MKL: Trimmed 49702 records to 34005 (keeping 200 days of data) [2025-10-13T20:12:23.348344] [DEBUG] [LOCAL ] MKL: Primary data saved (34005 records). [2025-10-13T20:12:23.348561] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-13T20:12:23.348695] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 28.8s. Estimated remaining: 2h 21m 30s. Rate: 7.1 symbols/min [2025-10-13T20:12:23.533972] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:23.562612] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T20:12:23.593757] [DEBUG] [LOCAL ] MLNK: Loaded 26322 existing records from primary storage. [2025-10-13T20:12:23.594011] [INFO ] [MAIN ] MLNK: Loaded 26322 existing records. [2025-10-13T20:12:23.624489] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-13T20:12:23.769277] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:23.769520] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-13T20:12:23.769579] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-13T20:12:23.770077] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-13T20:12:23.770134] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-13T20:12:24.111779] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:24.417946] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-13T20:12:24.577540] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T20:12:25.091213] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T20:12:25.217893] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-13T20:12:25.919177] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T20:12:25.923582] [INFO ] [REMOTE ] MLI: Full fetch complete (63015 records). [2025-10-13T20:12:25.923697] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-13T20:12:26.022624] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-13T20:12:26.314583] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-13T20:12:26.314695] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-13T20:12:26.315565] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-13T20:12:26.315606] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-13T20:12:26.316871] [DEBUG] [LOCAL ] MLI: Trimmed 63015 records to 43523 (keeping 200 days of data) [2025-10-13T20:12:26.575847] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T20:12:26.635512] [DEBUG] [LOCAL ] MLI: Primary data saved (43523 records). [2025-10-13T20:12:26.635662] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-13T20:12:26.635760] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 31.8s. Estimated remaining: 2h 21m 18s. Rate: 7.1 symbols/min [2025-10-13T20:12:26.815759] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:26.817897] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-13T20:12:26.821355] [DEBUG] [LOCAL ] MLP: Loaded 3045 existing records from primary storage. [2025-10-13T20:12:26.821504] [INFO ] [MAIN ] MLP: Loaded 3045 existing records. [2025-10-13T20:12:27.017416] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:27.017773] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-13T20:12:27.017832] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-13T20:12:27.018233] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-13T20:12:27.018296] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-13T20:12:27.273520] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T20:12:27.439947] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:27.617920] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-13T20:12:28.093950] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T20:12:28.367852] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T20:12:28.417987] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-13T20:12:29.217933] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-13T20:12:29.384293] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T20:12:29.710591] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-13T20:12:30.018048] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-13T20:12:30.818041] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-13T20:12:30.967933] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T20:12:31.562132] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T20:12:31.617893] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-13T20:12:32.076774] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T20:12:32.418079] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-13T20:12:33.217923] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-13T20:12:33.618350] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T20:12:34.018010] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-13T20:12:34.382314] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T20:12:34.385285] [INFO ] [REMOTE ] MLM: Full fetch complete (45133 records). [2025-10-13T20:12:34.385368] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-13T20:12:34.488230] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T20:12:34.782481] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-13T20:12:34.782565] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-13T20:12:34.783299] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-13T20:12:34.783359] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-13T20:12:34.784255] [DEBUG] [LOCAL ] MLM: Trimmed 45133 records to 29307 (keeping 200 days of data) [2025-10-13T20:12:34.843580] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-13T20:12:34.999882] [DEBUG] [LOCAL ] MLM: Primary data saved (29307 records). [2025-10-13T20:12:35.000094] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-13T20:12:35.000201] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 32.7s. Estimated remaining: 2h 21m 9s. Rate: 7.1 symbols/min [2025-10-13T20:12:35.172043] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:35.187108] [DEBUG] [LOCAL ] MLR: Loaded 12698 existing records from primary storage. [2025-10-13T20:12:35.187369] [INFO ] [MAIN ] MLR: Loaded 12698 existing records. [2025-10-13T20:12:35.366832] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:35.367100] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-13T20:12:35.367153] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-13T20:12:35.367639] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-13T20:12:35.367740] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-13T20:12:35.623125] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-13T20:12:35.732168] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:36.261205] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T20:12:36.417920] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-13T20:12:36.693290] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T20:12:37.217927] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-13T20:12:37.245396] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T20:12:38.017905] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-13T20:12:38.315893] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T20:12:38.817901] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-13T20:12:38.975784] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T20:12:39.617929] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-13T20:12:39.764378] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T20:12:40.417990] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-13T20:12:40.469731] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:12:41.217913] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-13T20:12:41.581659] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T20:12:42.017947] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-13T20:12:42.594263] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T20:12:42.797227] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T20:12:42.817886] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-13T20:12:43.617923] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-13T20:12:44.420760] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T20:12:44.420937] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-13T20:12:44.929196] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:12:45.213507] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T20:12:45.218117] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-13T20:12:45.713671] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T20:12:46.017920] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-13T20:12:46.817924] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-13T20:12:47.144905] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T20:12:47.617916] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-13T20:12:47.812541] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T20:12:48.417935] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-13T20:12:48.956734] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T20:12:48.960182] [INFO ] [REMOTE ] MLNK: Full fetch complete (36430 records). [2025-10-13T20:12:48.960426] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-13T20:12:49.224822] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-13T20:12:49.342699] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-13T20:12:49.342796] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-13T20:12:49.344526] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-13T20:12:49.344909] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-13T20:12:49.346584] [DEBUG] [LOCAL ] MLNK: Trimmed 36430 records to 26227 (keeping 200 days of data) [2025-10-13T20:12:49.505064] [DEBUG] [LOCAL ] MLNK: Primary data saved (26227 records). [2025-10-13T20:12:49.505208] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-13T20:12:49.505351] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 26.2s. Estimated remaining: 2h 21m 5s. Rate: 7.1 symbols/min [2025-10-13T20:12:49.678141] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:49.729398] [DEBUG] [LOCAL ] MMC: Loaded 52646 existing records from primary storage. [2025-10-13T20:12:49.729899] [INFO ] [MAIN ] MMC: Loaded 52646 existing records. [2025-10-13T20:12:49.860393] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T20:12:49.892984] [INFO ] [REMOTE ] MKC: Full fetch complete (75715 records). [2025-10-13T20:12:49.924786] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-13T20:12:49.950344] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:49.950862] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-13T20:12:49.950916] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-13T20:12:49.957162] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-13T20:12:49.972935] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-13T20:12:50.034204] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T20:12:50.024445] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-13T20:12:50.695119] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-13T20:12:50.759735] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-13T20:12:50.764066] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-13T20:12:50.763934] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:50.765779] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-13T20:12:50.765868] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-13T20:12:50.767550] [DEBUG] [LOCAL ] MKC: Trimmed 75715 records to 52521 (keeping 200 days of data) [2025-10-13T20:12:50.823133] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-13T20:12:51.093246] [DEBUG] [LOCAL ] MKC: Primary data saved (52521 records). [2025-10-13T20:12:51.093395] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-13T20:12:51.093483] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MKC took 1m 10s. Estimated remaining: 2h 20m 52s. Rate: 7.1 symbols/min [2025-10-13T20:12:51.263774] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:51.275584] [DEBUG] [LOCAL ] MMD: Loaded 11341 existing records from primary storage. [2025-10-13T20:12:51.275814] [INFO ] [MAIN ] MMD: Loaded 11341 existing records. [2025-10-13T20:12:51.453370] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:51.453637] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-13T20:12:51.453736] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-13T20:12:51.454176] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-13T20:12:51.454249] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-13T20:12:51.627182] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-13T20:12:51.810233] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:52.411115] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T20:12:52.417947] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-13T20:12:52.526740] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T20:12:52.943554] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T20:12:53.217945] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-13T20:12:54.018023] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-13T20:12:54.165842] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T20:12:54.651431] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T20:12:54.817996] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-13T20:12:55.285378] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T20:12:55.286436] [INFO ] [REMOTE ] MLP: Full fetch complete (4433 records). [2025-10-13T20:12:55.286508] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-13T20:12:55.626579] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-13T20:12:55.662306] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-13T20:12:55.662406] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-13T20:12:55.662669] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-13T20:12:55.662734] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-13T20:12:55.663238] [DEBUG] [LOCAL ] MLP: Trimmed 4433 records to 3050 (keeping 200 days of data) [2025-10-13T20:12:55.683169] [DEBUG] [LOCAL ] MLP: Primary data saved (3050 records). [2025-10-13T20:12:55.683322] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-13T20:12:55.683426] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLP took 29.0s. Estimated remaining: 2h 20m 41s. Rate: 7.1 symbols/min [2025-10-13T20:12:55.861149] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:12:55.879531] [DEBUG] [LOCAL ] MMI: Loaded 15496 existing records from primary storage. [2025-10-13T20:12:55.879920] [INFO ] [MAIN ] MMI: Loaded 15496 existing records. [2025-10-13T20:12:56.104630] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:12:56.104998] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-13T20:12:56.105048] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-13T20:12:56.105681] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-13T20:12:56.105742] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-13T20:12:56.418853] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-13T20:12:56.488455] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:12:56.570165] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:12:57.116445] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T20:12:57.217998] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-13T20:12:58.017903] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-13T20:12:58.403042] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:12:58.817946] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-13T20:12:59.618015] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-13T20:12:59.660302] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T20:12:59.789886] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T20:13:00.417906] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-13T20:13:00.501955] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T20:13:01.218032] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-13T20:13:02.024094] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-13T20:13:02.026510] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T20:13:02.048289] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T20:13:02.818053] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-13T20:13:03.007487] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T20:13:03.011562] [INFO ] [REMOTE ] MLR: Full fetch complete (18994 records). [2025-10-13T20:13:03.011708] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-13T20:13:03.482419] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-13T20:13:03.482551] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-13T20:13:03.483588] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-13T20:13:03.483717] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-13T20:13:03.484717] [DEBUG] [LOCAL ] MLR: Trimmed 18994 records to 12481 (keeping 200 days of data) [2025-10-13T20:13:03.602038] [DEBUG] [LOCAL ] MLR: Primary data saved (12481 records). [2025-10-13T20:13:03.602206] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-13T20:13:03.602292] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MLR took 28.6s. Estimated remaining: 2h 20m 32s. Rate: 7.1 symbols/min [2025-10-13T20:13:03.626507] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-13T20:13:03.773940] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T20:13:03.853120] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:03.853295] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-13T20:13:03.853333] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-13T20:13:03.853465] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-13T20:13:03.853526] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-13T20:13:03.853572] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-13T20:13:03.853606] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-13T20:13:04.266403] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:04.274008] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T20:13:04.418009] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-13T20:13:05.217914] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-13T20:13:05.253222] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T20:13:05.432241] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:13:05.432481] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-13T20:13:05.432570] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:13:05.432624] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-13T20:13:05.432727] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:13:05.432780] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-13T20:13:05.432835] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-13T20:13:05.432870] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-13T20:13:05.432908] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-13T20:13:05.432951] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMID took 1.8s. Estimated remaining: 2h 20m 19s. Rate: 7.1 symbols/min [2025-10-13T20:13:05.597673] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:05.597806] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-13T20:13:05.597845] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-13T20:13:05.597995] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-13T20:13:05.598051] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-13T20:13:05.598096] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-13T20:13:05.598129] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-13T20:13:05.943079] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:06.017910] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-13T20:13:06.468531] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-13T20:13:06.817931] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-13T20:13:07.617913] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-13T20:13:07.764419] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T20:13:08.208360] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T20:13:08.417915] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-13T20:13:09.217927] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-13T20:13:09.970985] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T20:13:10.017910] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-13T20:13:10.236775] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T20:13:10.817905] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-13T20:13:10.897214] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T20:13:11.092012] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-13T20:13:11.617920] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-13T20:13:12.042604] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T20:13:12.418028] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-13T20:13:13.217929] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-13T20:13:13.660987] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T20:13:14.017899] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-13T20:13:14.061714] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T20:13:14.817944] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-13T20:13:14.935940] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T20:13:15.617928] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-13T20:13:16.417908] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-13T20:13:16.577014] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T20:13:16.611140] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T20:13:17.056933] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T20:13:17.217928] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-13T20:13:17.930084] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:13:17.931857] [INFO ] [REMOTE ] MMD: Full fetch complete (17434 records). [2025-10-13T20:13:17.931933] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-13T20:13:18.023083] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-13T20:13:18.314797] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-13T20:13:18.314905] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-13T20:13:18.315637] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-13T20:13:18.315723] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-13T20:13:18.316507] [DEBUG] [LOCAL ] MMD: Trimmed 17434 records to 10880 (keeping 200 days of data) [2025-10-13T20:13:18.390498] [DEBUG] [LOCAL ] MMD: Primary data saved (10880 records). [2025-10-13T20:13:18.390745] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-13T20:13:18.390890] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMD took 27.3s. Estimated remaining: 2h 20m 13s. Rate: 7.1 symbols/min [2025-10-13T20:13:18.563945] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:18.625985] [DEBUG] [LOCAL ] MMM: Loaded 53899 existing records from primary storage. [2025-10-13T20:13:18.626481] [INFO ] [MAIN ] MMM: Loaded 53899 existing records. [2025-10-13T20:13:18.807728] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:13:18.808055] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-13T20:13:18.808116] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-13T20:13:18.809627] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-13T20:13:18.809720] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-13T20:13:18.823274] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-13T20:13:19.213972] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:19.266239] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T20:13:19.427981] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T20:13:19.617995] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-13T20:13:20.418000] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-13T20:13:21.217932] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-13T20:13:21.840341] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-13T20:13:22.017908] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-13T20:13:22.097754] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T20:13:22.189591] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T20:13:22.817928] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-13T20:13:23.617948] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-13T20:13:23.939361] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T20:13:23.946597] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T20:13:24.044728] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T20:13:24.417923] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-13T20:13:25.217939] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-13T20:13:26.017938] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-13T20:13:26.073957] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T20:13:26.209041] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T20:13:26.818180] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-13T20:13:27.617926] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-13T20:13:27.882717] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T20:13:28.417903] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-13T20:13:28.572922] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T20:13:28.590710] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T20:13:29.217993] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-13T20:13:29.815483] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T20:13:30.017887] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-13T20:13:30.263685] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T20:13:30.817929] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-13T20:13:31.618011] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-13T20:13:31.734987] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T20:13:31.738155] [INFO ] [REMOTE ] MMI: Full fetch complete (21515 records). [2025-10-13T20:13:31.738246] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-13T20:13:31.934572] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T20:13:32.154182] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-13T20:13:32.154412] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-13T20:13:32.155136] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-13T20:13:32.155360] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-13T20:13:32.156716] [DEBUG] [LOCAL ] MMI: Trimmed 21515 records to 15401 (keeping 200 days of data) [2025-10-13T20:13:32.284252] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T20:13:32.333447] [DEBUG] [LOCAL ] MMI: Primary data saved (15401 records). [2025-10-13T20:13:32.333625] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-13T20:13:32.333769] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMI took 36.7s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-13T20:13:32.423198] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-13T20:13:32.524490] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:32.556218] [DEBUG] [LOCAL ] MMS: Loaded 34358 existing records from primary storage. [2025-10-13T20:13:32.556489] [INFO ] [MAIN ] MMS: Loaded 34358 existing records. [2025-10-13T20:13:32.731006] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:13:32.731206] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-13T20:13:32.731250] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-13T20:13:32.731904] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-13T20:13:32.731961] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-13T20:13:33.099616] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:33.217915] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-13T20:13:34.017949] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-13T20:13:34.209621] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T20:13:34.369398] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T20:13:34.793979] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T20:13:34.817928] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-13T20:13:35.102155] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-13T20:13:35.617922] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-13T20:13:36.417984] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-13T20:13:36.770314] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T20:13:36.968256] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T20:13:37.217950] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-13T20:13:37.919832] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:13:37.926608] [INFO ] [REMOTE ] MMC: Full fetch complete (74797 records). [2025-10-13T20:13:37.926851] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-13T20:13:38.023256] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-13T20:13:38.351378] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-13T20:13:38.351512] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-13T20:13:38.352877] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-13T20:13:38.352946] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-13T20:13:38.354941] [DEBUG] [LOCAL ] MMC: Trimmed 74797 records to 51918 (keeping 200 days of data) [2025-10-13T20:13:38.717624] [DEBUG] [LOCAL ] MMC: Primary data saved (51918 records). [2025-10-13T20:13:38.717871] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-13T20:13:38.718051] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMC took 49.2s. Estimated remaining: 2h 19m 59s. Rate: 7.1 symbols/min [2025-10-13T20:13:38.822974] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-13T20:13:38.898427] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:38.911462] [DEBUG] [LOCAL ] MMT: Loaded 10630 existing records from primary storage. [2025-10-13T20:13:38.911811] [INFO ] [MAIN ] MMT: Loaded 10630 existing records. [2025-10-13T20:13:39.117539] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:13:39.117935] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-13T20:13:39.118131] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-13T20:13:39.118575] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-13T20:13:39.118636] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-13T20:13:39.261347] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:13:39.262282] [INFO ] [REMOTE ] MMKT: Full fetch complete (2120 records). [2025-10-13T20:13:39.262369] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-13T20:13:39.633935] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-13T20:13:39.640723] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T20:13:39.647466] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:13:39.652698] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:13:39.663168] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-13T20:13:39.681684] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-13T20:13:39.681810] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-13T20:13:39.687178] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-13T20:13:39.692781] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMKT took 34.3s. Estimated remaining: 2h 19m 45s. Rate: 7.1 symbols/min [2025-10-13T20:13:39.734848] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:39.894281] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:39.911018] [DEBUG] [LOCAL ] MMU: Loaded 17024 existing records from primary storage. [2025-10-13T20:13:39.911238] [INFO ] [MAIN ] MMU: Loaded 17024 existing records. [2025-10-13T20:13:40.052289] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T20:13:40.129348] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:13:40.129528] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-13T20:13:40.129575] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-13T20:13:40.130029] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-13T20:13:40.130087] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-13T20:13:40.423100] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-13T20:13:40.486807] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:40.790439] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T20:13:41.217946] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-13T20:13:41.299118] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T20:13:42.017906] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-13T20:13:42.816967] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T20:13:42.824591] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-13T20:13:43.370515] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T20:13:43.617883] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-13T20:13:43.632363] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T20:13:44.417994] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-13T20:13:45.218034] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-13T20:13:45.620751] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T20:13:45.814167] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T20:13:46.023356] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T20:13:46.022526] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-13T20:13:46.817904] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-13T20:13:47.105858] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:13:47.617992] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-13T20:13:48.417915] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-13T20:13:48.679386] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T20:13:49.011461] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T20:13:49.217883] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-13T20:13:49.268401] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T20:13:50.017917] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-13T20:13:50.530624] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T20:13:50.817935] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-13T20:13:51.617907] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-13T20:13:51.935234] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T20:13:51.961104] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T20:13:52.405931] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T20:13:52.417905] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-13T20:13:53.218038] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-13T20:13:53.227869] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T20:13:54.014564] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:13:54.022211] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-13T20:13:54.024182] [INFO ] [REMOTE ] MMM: Full fetch complete (77056 records). [2025-10-13T20:13:54.024374] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-13T20:13:54.436721] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-13T20:13:54.436846] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-13T20:13:54.438400] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-13T20:13:54.438481] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-13T20:13:54.440517] [DEBUG] [LOCAL ] MMM: Trimmed 77056 records to 53123 (keeping 200 days of data) [2025-10-13T20:13:54.818190] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-13T20:13:54.848077] [DEBUG] [LOCAL ] MMM: Primary data saved (53123 records). [2025-10-13T20:13:54.848228] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-13T20:13:54.848315] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMM took 36.5s. Estimated remaining: 2h 19m 42s. Rate: 7.1 symbols/min [2025-10-13T20:13:54.967533] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T20:13:55.039936] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:13:55.063911] [DEBUG] [LOCAL ] MNR: Loaded 24984 existing records from primary storage. [2025-10-13T20:13:55.064261] [INFO ] [MAIN ] MNR: Loaded 24984 existing records. [2025-10-13T20:13:55.236472] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:13:55.236708] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-13T20:13:55.236765] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-13T20:13:55.237348] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-13T20:13:55.237407] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-13T20:13:55.600604] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:13:55.617894] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-13T20:13:55.748100] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T20:13:56.418034] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-13T20:13:56.568014] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T20:13:57.217905] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-13T20:13:57.395457] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T20:13:58.018006] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-13T20:13:58.504088] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T20:13:58.817913] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-13T20:13:59.056573] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T20:13:59.592850] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T20:13:59.617920] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-13T20:14:00.417914] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-13T20:14:00.694863] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:14:01.218023] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-13T20:14:01.643417] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T20:14:02.017913] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-13T20:14:02.106868] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T20:14:02.733048] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T20:14:02.817944] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-13T20:14:03.541957] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T20:14:03.617992] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-13T20:14:04.417924] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-13T20:14:05.217905] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-13T20:14:05.290041] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T20:14:05.323360] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:14:05.758363] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:14:05.759929] [INFO ] [REMOTE ] MMT: Full fetch complete (16044 records). [2025-10-13T20:14:05.760007] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-13T20:14:06.023101] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-13T20:14:06.124267] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-13T20:14:06.124358] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-13T20:14:06.124801] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-13T20:14:06.124861] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-13T20:14:06.125593] [DEBUG] [LOCAL ] MMT: Trimmed 16044 records to 10402 (keeping 200 days of data) [2025-10-13T20:14:06.185231] [DEBUG] [LOCAL ] MMT: Primary data saved (10402 records). [2025-10-13T20:14:06.185358] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-13T20:14:06.185436] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMT took 27.5s. Estimated remaining: 2h 19m 35s. Rate: 7.1 symbols/min [2025-10-13T20:14:06.353220] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:06.392185] [DEBUG] [LOCAL ] MNSO: Loaded 44943 existing records from primary storage. [2025-10-13T20:14:06.392495] [INFO ] [MAIN ] MNSO: Loaded 44943 existing records. [2025-10-13T20:14:06.571928] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:14:06.572148] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-13T20:14:06.572194] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-13T20:14:06.573152] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-13T20:14:06.573209] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-13T20:14:06.819391] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-13T20:14:06.940701] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:07.083153] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T20:14:07.617928] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-13T20:14:07.923247] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T20:14:08.354280] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T20:14:08.418012] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-13T20:14:09.217934] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-13T20:14:09.860125] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T20:14:10.017929] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-13T20:14:10.610635] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T20:14:10.614859] [INFO ] [REMOTE ] MMS: Full fetch complete (51432 records). [2025-10-13T20:14:10.615001] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-13T20:14:10.824311] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-13T20:14:11.002752] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-13T20:14:11.002836] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-13T20:14:11.003623] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-13T20:14:11.003694] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-13T20:14:11.004714] [DEBUG] [LOCAL ] MMS: Trimmed 51432 records to 33729 (keeping 200 days of data) [2025-10-13T20:14:11.208264] [DEBUG] [LOCAL ] MMS: Primary data saved (33729 records). [2025-10-13T20:14:11.208411] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-13T20:14:11.208491] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMS took 38.9s. Estimated remaining: 2h 19m 24s. Rate: 7.1 symbols/min [2025-10-13T20:14:11.379380] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:11.396671] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-13T20:14:11.396765] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-13T20:14:11.398253] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-13T20:14:11.398139] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:14:11.398405] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-13T20:14:11.405699] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-13T20:14:11.405766] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-13T20:14:11.624140] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-13T20:14:11.759679] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:12.292376] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T20:14:12.301992] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:14:12.305126] [INFO ] [REMOTE ] MMU: Full fetch complete (25133 records). [2025-10-13T20:14:12.305223] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-13T20:14:12.423018] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-13T20:14:12.691761] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-13T20:14:12.691838] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-13T20:14:12.692412] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-13T20:14:12.692452] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-13T20:14:12.693229] [DEBUG] [LOCAL ] MMU: Trimmed 25133 records to 16653 (keeping 200 days of data) [2025-10-13T20:14:12.793497] [DEBUG] [LOCAL ] MMU: Primary data saved (16653 records). [2025-10-13T20:14:12.793627] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-13T20:14:12.793740] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMU took 33.1s. Estimated remaining: 2h 19m 11s. Rate: 7.1 symbols/min [2025-10-13T20:14:12.959335] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:12.959546] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-13T20:14:12.959602] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-13T20:14:12.959737] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-13T20:14:12.959810] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-13T20:14:12.959881] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-13T20:14:12.959950] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-13T20:14:13.223140] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-13T20:14:13.308229] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:14.017997] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-13T20:14:14.150314] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T20:14:14.360015] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:14:14.360302] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-13T20:14:14.360392] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:14:14.360457] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-13T20:14:14.360521] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:14:14.360589] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-13T20:14:14.360673] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-13T20:14:14.360729] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-13T20:14:14.360772] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-13T20:14:14.360821] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNTN took 3.2s. Estimated remaining: 2h 18m 58s. Rate: 7.1 symbols/min [2025-10-13T20:14:14.545769] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T20:14:14.545065] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:14.591737] [DEBUG] [LOCAL ] MOD: Loaded 45599 existing records from primary storage. [2025-10-13T20:14:14.592021] [INFO ] [MAIN ] MOD: Loaded 45599 existing records. [2025-10-13T20:14:14.765452] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:14:14.765685] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-13T20:14:14.765743] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-13T20:14:14.766935] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-13T20:14:14.766995] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-13T20:14:14.826621] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-13T20:14:15.117849] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:15.617903] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-13T20:14:15.920733] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:14:16.417994] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-13T20:14:17.217930] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-13T20:14:17.641025] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T20:14:18.005805] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-13T20:14:18.017943] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-13T20:14:18.763447] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:14:18.817887] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-13T20:14:19.617983] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-13T20:14:20.337267] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-13T20:14:20.417908] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-13T20:14:20.601275] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T20:14:20.890907] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T20:14:21.217888] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-13T20:14:22.017917] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-13T20:14:22.328198] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T20:14:22.356740] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T20:14:22.818001] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-13T20:14:23.617910] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-13T20:14:23.656467] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T20:14:24.417908] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-13T20:14:24.796929] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T20:14:25.099917] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T20:14:25.218009] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-13T20:14:25.946947] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T20:14:26.017898] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-13T20:14:26.818019] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-13T20:14:26.954924] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T20:14:27.392021] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T20:14:27.617911] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-13T20:14:27.874279] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T20:14:28.417995] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-13T20:14:29.217912] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-13T20:14:29.248186] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T20:14:29.306047] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T20:14:30.017944] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-13T20:14:30.507420] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T20:14:30.817938] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-13T20:14:31.617919] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-13T20:14:31.772504] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T20:14:31.931675] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T20:14:31.934814] [INFO ] [REMOTE ] MNR: Full fetch complete (36715 records). [2025-10-13T20:14:31.934935] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-13T20:14:32.374229] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-13T20:14:32.374302] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-13T20:14:32.375070] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-13T20:14:32.375151] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-13T20:14:32.376281] [DEBUG] [LOCAL ] MNR: Trimmed 36715 records to 24761 (keeping 200 days of data) [2025-10-13T20:14:32.434381] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-13T20:14:32.548635] [DEBUG] [LOCAL ] MNR: Primary data saved (24761 records). [2025-10-13T20:14:32.548801] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-13T20:14:32.548899] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNR took 37.7s. Estimated remaining: 2h 18m 56s. Rate: 7.1 symbols/min [2025-10-13T20:14:32.741046] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:32.789686] [DEBUG] [LOCAL ] MODG: Loaded 52294 existing records from primary storage. [2025-10-13T20:14:32.790021] [INFO ] [MAIN ] MODG: Loaded 52294 existing records. [2025-10-13T20:14:32.983281] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:14:32.983513] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-13T20:14:32.983562] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-13T20:14:32.984717] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-13T20:14:32.984778] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-13T20:14:33.232060] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-13T20:14:33.402484] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:34.018069] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-13T20:14:34.272328] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-13T20:14:34.371202] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T20:14:34.566268] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T20:14:34.817924] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-13T20:14:35.617929] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-13T20:14:35.814280] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T20:14:36.417929] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-13T20:14:37.142245] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T20:14:37.167996] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-13T20:14:37.217880] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-13T20:14:37.975308] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T20:14:38.017910] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-13T20:14:38.788819] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T20:14:38.817888] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-13T20:14:39.573755] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T20:14:39.617911] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-13T20:14:40.418045] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-13T20:14:40.531174] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T20:14:40.972131] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T20:14:40.977066] [INFO ] [REMOTE ] MNSO: Full fetch complete (64466 records). [2025-10-13T20:14:40.977232] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-13T20:14:41.226723] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-13T20:14:41.362673] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-13T20:14:41.362759] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-13T20:14:41.363615] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-13T20:14:41.363698] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-13T20:14:41.364960] [DEBUG] [LOCAL ] MNSO: Trimmed 64466 records to 44187 (keeping 200 days of data) [2025-10-13T20:14:41.632539] [DEBUG] [LOCAL ] MNSO: Primary data saved (44187 records). [2025-10-13T20:14:41.632741] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-13T20:14:41.632930] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNSO took 35.4s. Estimated remaining: 2h 18m 48s. Rate: 7.1 symbols/min [2025-10-13T20:14:41.802016] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:41.802189] [DEBUG] [LOCAL ] MOH: No existing data file found in primary storage. [2025-10-13T20:14:41.802227] [WARN ] [MAIN ] MOH: No existing data found, performing full refresh instead. [2025-10-13T20:14:41.802365] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-13T20:14:41.802413] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-13T20:14:41.802462] [DEBUG] [LOCAL ] MOH: No primary data file found to delete. [2025-10-13T20:14:41.802512] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-13T20:14:42.026457] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-13T20:14:42.164229] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:42.785432] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-13T20:14:42.817927] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-13T20:14:42.981829] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:14:43.512933] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T20:14:43.517204] [INFO ] [REMOTE ] MOD: Full fetch complete (66131 records). [2025-10-13T20:14:43.517304] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-13T20:14:43.618328] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-13T20:14:43.924444] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-13T20:14:43.924812] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-13T20:14:43.925764] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-13T20:14:43.925827] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-13T20:14:43.927290] [DEBUG] [LOCAL ] MOD: Trimmed 66131 records to 44860 (keeping 200 days of data) [2025-10-13T20:14:44.194711] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:14:44.236143] [DEBUG] [LOCAL ] MOD: Primary data saved (44860 records). [2025-10-13T20:14:44.236286] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-13T20:14:44.236386] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MOD took 29.9s. Estimated remaining: 2h 18m 36s. Rate: 7.1 symbols/min [2025-10-13T20:14:44.416126] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:14:44.418047] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-13T20:14:44.470580] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-10-13T20:14:44.471054] [INFO ] [MAIN ] MOS: Loaded 54284 existing records. [2025-10-13T20:14:44.661343] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:14:44.661744] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-13T20:14:44.661804] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-13T20:14:44.663493] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-13T20:14:44.663559] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-13T20:14:45.040801] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:14:45.217985] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-13T20:14:45.757509] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T20:14:46.017928] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-13T20:14:46.055750] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-13T20:14:46.477913] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T20:14:46.817998] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-13T20:14:47.617942] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-13T20:14:47.888623] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T20:14:48.327065] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T20:14:48.417917] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-13T20:14:49.119593] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T20:14:49.218004] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-13T20:14:50.017910] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-13T20:14:50.049735] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T20:14:50.640863] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T20:14:50.817931] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-13T20:14:51.572293] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T20:14:51.617888] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-13T20:14:51.975631] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T20:14:52.417924] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-13T20:14:53.217919] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-13T20:14:53.368458] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T20:14:54.017993] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-13T20:14:54.114920] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T20:14:54.817910] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-13T20:14:55.323764] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T20:14:55.617979] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-13T20:14:55.704154] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T20:14:56.417988] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-13T20:14:56.507175] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:14:57.217985] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-13T20:14:57.766285] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-13T20:14:58.017888] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-13T20:14:58.258240] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T20:14:58.696631] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:14:58.817938] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-13T20:14:59.549469] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T20:14:59.617906] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-13T20:15:00.417943] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-13T20:15:00.894895] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-13T20:15:01.217914] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-13T20:15:01.293708] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T20:15:01.302351] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-13T20:15:01.302584] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-13T20:15:01.571062] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T20:15:01.572078] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:15:01.572320] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:15:01.572470] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-13T20:15:01.572619] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-13T20:15:01.572740] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-13T20:15:01.572900] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-13T20:15:01.573019] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MO took 48.8s. Estimated remaining: 2h 18m 34s. Rate: 7.1 symbols/min [2025-10-13T20:15:01.780288] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T20:15:01.795486] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:01.819440] [DEBUG] [LOCAL ] MOV: Loaded 22106 existing records from primary storage. [2025-10-13T20:15:01.819776] [INFO ] [MAIN ] MOV: Loaded 22106 existing records. [2025-10-13T20:15:02.030445] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:02.023248] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-13T20:15:02.030813] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-13T20:15:02.031689] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-13T20:15:02.032319] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-13T20:15:02.032392] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-13T20:15:02.385270] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:02.818000] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-13T20:15:02.985464] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T20:15:03.617982] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-13T20:15:03.773390] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T20:15:04.170469] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T20:15:04.417930] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-13T20:15:05.218026] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-13T20:15:05.582995] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:15:06.017943] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-13T20:15:06.243973] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T20:15:06.626345] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T20:15:06.631593] [INFO ] [REMOTE ] MODG: Full fetch complete (74750 records). [2025-10-13T20:15:06.631782] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-13T20:15:06.831716] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-13T20:15:07.022378] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T20:15:07.067587] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-13T20:15:07.067689] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-13T20:15:07.068725] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-13T20:15:07.068789] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-13T20:15:07.070330] [DEBUG] [LOCAL ] MODG: Trimmed 74750 records to 51582 (keeping 200 days of data) [2025-10-13T20:15:07.384250] [DEBUG] [LOCAL ] MODG: Primary data saved (51582 records). [2025-10-13T20:15:07.384450] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-13T20:15:07.384567] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MODG took 34.8s. Estimated remaining: 2h 18m 23s. Rate: 7.1 symbols/min [2025-10-13T20:15:07.561480] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:07.620004] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-13T20:15:07.625355] [DEBUG] [LOCAL ] MP: Loaded 54471 existing records from primary storage. [2025-10-13T20:15:07.625967] [INFO ] [MAIN ] MP: Loaded 54471 existing records. [2025-10-13T20:15:07.844804] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:07.845066] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-13T20:15:07.845120] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-13T20:15:07.846096] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-13T20:15:07.846154] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-13T20:15:08.191926] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:08.417891] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-13T20:15:08.480981] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T20:15:08.696324] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T20:15:09.217943] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-13T20:15:10.017945] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-13T20:15:10.348742] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T20:15:10.577702] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-13T20:15:10.817941] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-13T20:15:11.485166] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T20:15:11.617940] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-13T20:15:12.417902] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-13T20:15:12.486635] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T20:15:12.540274] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:15:13.217912] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-13T20:15:14.017913] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-13T20:15:14.044046] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T20:15:14.049537] [INFO ] [REMOTE ] MOS: Full fetch complete (77458 records). [2025-10-13T20:15:14.049703] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-13T20:15:14.450324] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-13T20:15:14.450450] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-13T20:15:14.451596] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-13T20:15:14.451685] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-13T20:15:14.453440] [DEBUG] [LOCAL ] MOS: Trimmed 77458 records to 53504 (keeping 200 days of data) [2025-10-13T20:15:14.705224] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T20:15:14.818741] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-13T20:15:14.818634] [DEBUG] [LOCAL ] MOS: Primary data saved (53504 records). [2025-10-13T20:15:14.819662] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-13T20:15:14.819761] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOS took 30.6s. Estimated remaining: 2h 18m 14s. Rate: 7.1 symbols/min [2025-10-13T20:15:14.988978] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:14.995789] [DEBUG] [LOCAL ] MPA: Loaded 5365 existing records from primary storage. [2025-10-13T20:15:14.995979] [INFO ] [MAIN ] MPA: Loaded 5365 existing records. [2025-10-13T20:15:15.167073] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:15.167292] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-13T20:15:15.167336] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-13T20:15:15.167630] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-13T20:15:15.167719] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-13T20:15:15.521192] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:15.571445] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T20:15:15.617886] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-13T20:15:15.739972] [DEBUG] [REMOTE ] MOV: Error fetching primary data for 2025-05: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-13T20:15:15.740095] [WARN ] [REMOTE ] MOV: No data returned for month 2025-05 [2025-10-13T20:15:15.740163] [FATAL] [REMOTE ] MOV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:15:15.740205] [FATAL] [MAIN ] MOV: Failed to fetch primary data. [2025-10-13T20:15:15.740238] [WARN ] [MAIN ] MOV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:15:15.740277] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-13T20:15:15.740331] [DEBUG] [LOCAL ] MOV: No primary data file found to delete. [2025-10-13T20:15:15.740364] [INFO ] [LOCAL ] MOV: Starting deletion of derivative data. [2025-10-13T20:15:15.740544] [DEBUG] [LOCAL ] MOV: Deleted derivative data file. [2025-10-13T20:15:15.740611] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOV took 14.2s. Estimated remaining: 2h 18m 0s. Rate: 7.1 symbols/min [2025-10-13T20:15:15.913511] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:15.913808] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-13T20:15:15.913856] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-13T20:15:15.913987] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-13T20:15:15.914031] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-13T20:15:15.914072] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-13T20:15:15.914107] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-13T20:15:16.299237] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T20:15:16.311853] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:16.417894] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-13T20:15:17.217937] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-13T20:15:18.017917] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-13T20:15:18.442983] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T20:15:18.818005] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-13T20:15:18.950485] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T20:15:18.955570] [INFO ] [REMOTE ] MOH: Full fetch complete (58827 records). [2025-10-13T20:15:18.955762] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-13T20:15:19.346517] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-13T20:15:19.346617] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-13T20:15:19.347504] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-13T20:15:19.347580] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-13T20:15:19.348926] [DEBUG] [LOCAL ] MOH: Trimmed 58827 records to 42417 (keeping 200 days of data) [2025-10-13T20:15:19.620400] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T20:15:19.620536] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-13T20:15:19.653540] [DEBUG] [LOCAL ] MOH: Primary data saved (42417 records). [2025-10-13T20:15:19.653691] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-13T20:15:19.653774] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MOH took 38.0s. Estimated remaining: 2h 17m 49s. Rate: 7.1 symbols/min [2025-10-13T20:15:19.820483] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:19.820695] [DEBUG] [LOCAL ] MPLX: No existing data file found in primary storage. [2025-10-13T20:15:19.820748] [WARN ] [MAIN ] MPLX: No existing data found, performing full refresh instead. [2025-10-13T20:15:19.820880] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-13T20:15:19.820945] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-13T20:15:19.820993] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-13T20:15:19.821026] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-13T20:15:20.146322] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T20:15:20.181485] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:20.417921] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-13T20:15:20.574184] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:15:21.218027] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-13T20:15:21.810317] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T20:15:21.957883] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:15:22.017907] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-13T20:15:22.817920] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-13T20:15:23.541056] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T20:15:23.617969] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-13T20:15:24.417932] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-13T20:15:24.576462] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:15:24.998225] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T20:15:25.217941] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-13T20:15:25.489193] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T20:15:26.017934] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-13T20:15:26.151478] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T20:15:26.817925] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-13T20:15:27.617930] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-13T20:15:27.905753] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T20:15:28.305624] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T20:15:28.418049] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-13T20:15:28.502807] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T20:15:29.217930] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-13T20:15:30.017915] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-13T20:15:30.195671] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T20:15:30.397442] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-13T20:15:30.817908] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-13T20:15:31.009594] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T20:15:31.617985] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-13T20:15:32.417901] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-13T20:15:32.706546] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T20:15:33.217913] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-13T20:15:33.422333] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T20:15:34.017901] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-13T20:15:34.195974] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T20:15:34.705200] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T20:15:34.810909] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T20:15:34.821849] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-13T20:15:35.617926] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-13T20:15:36.160854] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T20:15:36.417942] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-13T20:15:36.571056] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T20:15:37.217911] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-13T20:15:37.849148] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T20:15:38.017935] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-13T20:15:38.818355] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-13T20:15:38.818480] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-13T20:15:39.458220] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T20:15:39.617926] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-13T20:15:40.417900] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-13T20:15:40.592066] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T20:15:41.079150] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T20:15:41.080242] [INFO ] [REMOTE ] MPA: Full fetch complete (7084 records). [2025-10-13T20:15:41.080310] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-13T20:15:41.229522] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-13T20:15:41.446465] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-13T20:15:41.446636] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-13T20:15:41.446890] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-13T20:15:41.446965] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-13T20:15:41.463747] [DEBUG] [LOCAL ] MPA: Trimmed 7084 records to 5337 (keeping 200 days of data) [2025-10-13T20:15:41.476480] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T20:15:41.520047] [DEBUG] [LOCAL ] MPA: Primary data saved (5337 records). [2025-10-13T20:15:41.520165] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-13T20:15:41.520240] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPA took 26.7s. Estimated remaining: 2h 17m 50s. Rate: 7.1 symbols/min [2025-10-13T20:15:41.687690] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:41.693926] [DEBUG] [LOCAL ] MPV: Loaded 4937 existing records from primary storage. [2025-10-13T20:15:41.694100] [INFO ] [MAIN ] MPV: Loaded 4937 existing records. [2025-10-13T20:15:41.875448] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:41.875700] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-13T20:15:41.875766] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-13T20:15:41.876046] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-13T20:15:41.876117] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-13T20:15:42.025076] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-13T20:15:42.234065] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:42.818019] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-13T20:15:43.584158] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-13T20:15:43.617946] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-13T20:15:43.717780] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T20:15:43.724269] [INFO ] [REMOTE ] MPC: Full fetch complete (75750 records). [2025-10-13T20:15:43.724485] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-13T20:15:44.168888] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-13T20:15:44.168964] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-13T20:15:44.169926] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-13T20:15:44.169985] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-13T20:15:44.171474] [DEBUG] [LOCAL ] MPC: Trimmed 75750 records to 52061 (keeping 200 days of data) [2025-10-13T20:15:44.418178] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-13T20:15:44.523263] [DEBUG] [LOCAL ] MPC: Primary data saved (52061 records). [2025-10-13T20:15:44.523568] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-13T20:15:44.523761] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPC took 28.8s. Estimated remaining: 2h 17m 38s. Rate: 7.1 symbols/min [2025-10-13T20:15:44.644785] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T20:15:44.784703] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:44.838327] [DEBUG] [LOCAL ] MPW: Loaded 54273 existing records from primary storage. [2025-10-13T20:15:44.838698] [INFO ] [MAIN ] MPW: Loaded 54273 existing records. [2025-10-13T20:15:45.036810] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:45.037037] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-13T20:15:45.037087] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-13T20:15:45.037888] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-13T20:15:45.037949] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-13T20:15:45.200053] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T20:15:45.218390] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-13T20:15:45.411008] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:46.017949] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-13T20:15:46.087187] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-13T20:15:46.802216] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T20:15:46.823881] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-13T20:15:46.843740] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:15:47.516625] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T20:15:47.618012] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-13T20:15:48.337064] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T20:15:48.417927] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-13T20:15:49.217907] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-13T20:15:50.017900] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-13T20:15:50.146556] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T20:15:50.527283] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-13T20:15:50.817917] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-13T20:15:51.226987] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T20:15:51.617933] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-13T20:15:52.418007] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-13T20:15:53.217941] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-13T20:15:53.416721] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-13T20:15:53.569698] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T20:15:53.740581] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T20:15:54.017943] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-13T20:15:54.321481] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T20:15:54.817930] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-13T20:15:55.454106] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T20:15:55.462779] [INFO ] [REMOTE ] MPLX: Full fetch complete (74093 records). [2025-10-13T20:15:55.462946] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-13T20:15:55.643160] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-13T20:15:55.859482] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-13T20:15:55.859560] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-13T20:15:55.860500] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-13T20:15:55.860563] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-13T20:15:55.862016] [DEBUG] [LOCAL ] MPLX: Trimmed 74093 records to 50742 (keeping 200 days of data) [2025-10-13T20:15:56.201370] [DEBUG] [LOCAL ] MPLX: Primary data saved (50742 records). [2025-10-13T20:15:56.201711] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-13T20:15:56.201817] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPLX took 36.5s. Estimated remaining: 2h 17m 31s. Rate: 7.1 symbols/min [2025-10-13T20:15:56.450829] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-13T20:15:56.454562] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:15:56.463772] [DEBUG] [LOCAL ] MPX: Loaded 4084 existing records from primary storage. [2025-10-13T20:15:56.464092] [INFO ] [MAIN ] MPX: Loaded 4084 existing records. [2025-10-13T20:15:56.661495] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:15:56.661965] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-13T20:15:56.662080] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-13T20:15:56.662530] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-13T20:15:56.662601] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-13T20:15:56.974247] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-13T20:15:57.103796] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:15:57.109856] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T20:15:57.217934] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-13T20:15:58.018025] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-13T20:15:58.344519] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-13T20:15:58.414564] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-13T20:15:58.817932] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-13T20:15:59.119016] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T20:15:59.617943] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-13T20:16:00.222612] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T20:16:00.417947] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-13T20:16:01.217913] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-13T20:16:01.705560] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-13T20:16:02.017917] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-13T20:16:02.161936] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:16:02.658253] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T20:16:02.665849] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-13T20:16:02.817936] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-13T20:16:03.618029] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-13T20:16:03.635940] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T20:16:04.291331] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:16:04.297269] [INFO ] [REMOTE ] MP: Full fetch complete (76995 records). [2025-10-13T20:16:04.297437] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-13T20:16:04.298331] [FATAL] [VALIDATOR ] MP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:16:04.298454] [FATAL] [MAIN ] MP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:16:04.298505] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:16:04.298553] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-13T20:16:04.298619] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-13T20:16:04.298702] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-10-13T20:16:04.298956] [DEBUG] [LOCAL ] MP: Deleted derivative data file. [2025-10-13T20:16:04.299080] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MP took 56.9s. Estimated remaining: 2h 17m 23s. Rate: 7.1 symbols/min [2025-10-13T20:16:04.423062] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-13T20:16:04.469839] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:04.479242] [DEBUG] [LOCAL ] MQT: Loaded 8745 existing records from primary storage. [2025-10-13T20:16:04.479872] [INFO ] [MAIN ] MQT: Loaded 8745 existing records. [2025-10-13T20:16:04.653680] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:16:04.653952] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-13T20:16:04.654000] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-13T20:16:04.654304] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-13T20:16:04.654361] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-13T20:16:05.029315] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:05.217891] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-13T20:16:05.224910] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T20:16:06.017928] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-13T20:16:06.754530] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T20:16:06.817910] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-13T20:16:07.295902] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-13T20:16:07.310208] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T20:16:07.311571] [INFO ] [REMOTE ] MPV: Full fetch complete (7871 records). [2025-10-13T20:16:07.311638] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-13T20:16:07.623052] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-13T20:16:07.682100] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-13T20:16:07.682185] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-13T20:16:07.682486] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-13T20:16:07.682549] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-13T20:16:07.683047] [DEBUG] [LOCAL ] MPV: Trimmed 7871 records to 4856 (keeping 200 days of data) [2025-10-13T20:16:07.716375] [DEBUG] [LOCAL ] MPV: Primary data saved (4856 records). [2025-10-13T20:16:07.716515] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-13T20:16:07.716601] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPV took 26.2s. Estimated remaining: 2h 17m 11s. Rate: 7.1 symbols/min [2025-10-13T20:16:07.890032] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:07.890197] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-13T20:16:07.890235] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-13T20:16:07.890346] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-13T20:16:07.890388] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-13T20:16:07.890431] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-13T20:16:07.890464] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-13T20:16:08.241720] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:08.417967] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-13T20:16:08.441117] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T20:16:09.217935] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-13T20:16:10.017916] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-13T20:16:10.145901] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:16:10.157427] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T20:16:10.680138] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T20:16:10.817914] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-13T20:16:11.617920] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-13T20:16:12.418068] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-13T20:16:12.501129] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T20:16:12.811861] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T20:16:13.217944] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-13T20:16:13.748218] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T20:16:13.775462] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T20:16:14.017902] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-13T20:16:14.817900] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-13T20:16:14.848096] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T20:16:15.617910] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-13T20:16:16.417896] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-13T20:16:16.709632] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:16:16.952262] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T20:16:17.217886] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-13T20:16:17.315780] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:16:18.017896] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-13T20:16:18.095960] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T20:16:18.817937] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-13T20:16:19.219161] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T20:16:19.617929] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-13T20:16:19.656726] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T20:16:20.417929] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-13T20:16:21.217934] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-13T20:16:21.542099] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:16:21.725088] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T20:16:21.850971] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T20:16:22.017925] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-13T20:16:22.817918] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-13T20:16:23.599003] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T20:16:23.617896] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-13T20:16:23.773840] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T20:16:23.781310] [INFO ] [REMOTE ] MPW: Full fetch complete (77506 records). [2025-10-13T20:16:23.781563] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-13T20:16:24.206680] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-13T20:16:24.202666] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T20:16:24.206908] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-13T20:16:24.211131] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-13T20:16:24.211560] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-13T20:16:24.213767] [DEBUG] [LOCAL ] MPW: Trimmed 77506 records to 53499 (keeping 200 days of data) [2025-10-13T20:16:24.436297] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-13T20:16:24.566107] [DEBUG] [LOCAL ] MPW: Primary data saved (53499 records). [2025-10-13T20:16:24.566309] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-13T20:16:24.566437] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 40.0s. Estimated remaining: 2h 17m 8s. Rate: 7.1 symbols/min [2025-10-13T20:16:24.745670] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:24.746028] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-13T20:16:24.746078] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-13T20:16:24.746163] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-13T20:16:24.746201] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-13T20:16:24.746247] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-13T20:16:24.746287] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-13T20:16:25.140015] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:16:25.146368] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:25.148591] [INFO ] [REMOTE ] MQT: Full fetch complete (13209 records). [2025-10-13T20:16:25.149069] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-13T20:16:25.223065] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-13T20:16:25.522788] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-13T20:16:25.522869] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-13T20:16:25.523207] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-13T20:16:25.523247] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-13T20:16:25.523722] [DEBUG] [LOCAL ] MQT: Trimmed 13209 records to 8340 (keeping 200 days of data) [2025-10-13T20:16:25.572761] [DEBUG] [LOCAL ] MQT: Primary data saved (8340 records). [2025-10-13T20:16:25.572896] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-13T20:16:25.572978] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 21.3s. Estimated remaining: 2h 16m 55s. Rate: 7.1 symbols/min [2025-10-13T20:16:25.934007] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T20:16:26.018052] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-13T20:16:26.817947] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-13T20:16:26.934302] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:16:27.618032] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-13T20:16:28.198683] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:16:28.417910] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-13T20:16:28.726139] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T20:16:29.217939] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-13T20:16:29.826760] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T20:16:30.017900] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-13T20:16:30.062238] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T20:16:30.814525] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T20:16:30.817870] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-13T20:16:31.475627] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T20:16:31.617925] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-13T20:16:32.417992] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-13T20:16:32.603971] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:16:33.217933] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-13T20:16:33.753955] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T20:16:34.017903] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-13T20:16:34.230115] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T20:16:34.817917] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-13T20:16:35.623093] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-13T20:16:35.636843] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:16:35.655621] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T20:16:36.198255] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:16:36.199259] [INFO ] [REMOTE ] MPX: Full fetch complete (6626 records). [2025-10-13T20:16:36.199334] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-13T20:16:36.423015] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-13T20:16:36.593023] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-13T20:16:36.593111] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-13T20:16:36.593323] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-13T20:16:36.593364] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-13T20:16:36.593853] [DEBUG] [LOCAL ] MPX: Trimmed 6626 records to 4063 (keeping 200 days of data) [2025-10-13T20:16:36.617840] [DEBUG] [LOCAL ] MPX: Primary data saved (4063 records). [2025-10-13T20:16:36.617912] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-13T20:16:36.618008] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MPX took 40.4s. Estimated remaining: 2h 16m 48s. Rate: 7.1 symbols/min [2025-10-13T20:16:37.218015] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-13T20:16:38.088847] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T20:16:38.097710] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-13T20:16:38.305955] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T20:16:38.817952] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-13T20:16:39.423857] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:16:39.426072] [INFO ] [REMOTE ] MQY: Full fetch complete (26600 records). [2025-10-13T20:16:39.426166] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-13T20:16:39.426867] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:16:39.426974] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:16:39.427020] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:16:39.427086] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-13T20:16:39.427148] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-13T20:16:39.427185] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-13T20:16:39.427223] [DEBUG] [LOCAL ] MQY: No derivative data file found to delete. [2025-10-13T20:16:39.427277] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MQY took 31.7s. Estimated remaining: 2h 16m 36s. Rate: 7.1 symbols/min [2025-10-13T20:16:39.725508] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T20:16:39.733312] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-13T20:16:41.143217] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T20:16:41.151903] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-13T20:16:42.756330] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T20:16:42.767024] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-13T20:16:44.149486] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T20:16:44.157383] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-13T20:16:45.642710] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T20:16:45.650691] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-13T20:16:46.303509] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:16:46.307490] [INFO ] [REMOTE ] MRC: Full fetch complete (54557 records). [2025-10-13T20:16:46.307613] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-13T20:16:46.309182] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:16:46.309448] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:16:46.309545] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:16:46.309632] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-13T20:16:46.309749] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-13T20:16:46.309804] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-13T20:16:46.309882] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-13T20:16:46.309972] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRC took 21.7s. Estimated remaining: 2h 16m 26s. Rate: 7.1 symbols/min [2025-10-13T20:16:46.976799] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:46.978264] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:47.008983] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-13T20:16:47.020841] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-13T20:16:47.044916] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-13T20:16:47.055688] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-13T20:16:47.075386] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-13T20:16:47.076560] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:47.092916] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:47.093208] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-13T20:16:47.071457] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-13T20:16:47.093492] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-13T20:16:47.093413] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-13T20:16:47.093674] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-13T20:16:47.093932] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-13T20:16:47.093756] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-13T20:16:47.094067] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-13T20:16:47.094305] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-13T20:16:47.094491] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-13T20:16:47.094225] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-13T20:16:47.112077] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-13T20:16:47.106774] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-13T20:16:47.112199] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-13T20:16:47.112242] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-13T20:16:47.117638] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-13T20:16:47.117760] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-13T20:16:47.123679] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-13T20:16:47.146998] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-13T20:16:48.559276] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:48.630390] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-13T20:16:48.624983] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:48.657128] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:48.668106] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-13T20:16:48.669823] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-13T20:16:48.703632] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:48.704118] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-13T20:16:48.990047] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:16:48.990566] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-13T20:16:48.990756] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:16:48.990837] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-13T20:16:48.990909] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:16:48.990986] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-13T20:16:48.991064] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-13T20:16:48.991108] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-13T20:16:48.991216] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-13T20:16:48.991299] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.7s. Estimated remaining: 2h 16m 14s. Rate: 7.1 symbols/min [2025-10-13T20:16:49.171742] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:16:49.183262] [DEBUG] [LOCAL ] MSB: Loaded 7881 existing records from primary storage. [2025-10-13T20:16:49.183585] [INFO ] [MAIN ] MSB: Loaded 7881 existing records. [2025-10-13T20:16:49.372020] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:16:49.372311] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-13T20:16:49.372368] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-13T20:16:49.372736] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-13T20:16:49.372802] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-13T20:16:49.782613] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:16:49.783310] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-13T20:16:49.821181] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T20:16:49.825399] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-13T20:16:50.531053] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T20:16:50.531350] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T20:16:50.546116] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-13T20:16:50.543195] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-13T20:16:50.825575] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T20:16:50.830116] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-13T20:16:50.903188] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-13T20:16:50.914299] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-13T20:16:51.723945] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T20:16:51.727865] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-13T20:16:51.911524] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T20:16:52.430292] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-13T20:16:52.440449] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T20:16:52.693842] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T20:16:53.167528] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-13T20:16:53.218062] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-13T20:16:53.574103] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T20:16:54.018046] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-13T20:16:54.061819] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T20:16:54.818048] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-13T20:16:55.617944] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-13T20:16:56.014434] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-13T20:16:56.213219] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T20:16:56.330860] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T20:16:56.418003] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-13T20:16:57.218021] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-13T20:16:58.018011] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-13T20:16:58.626697] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T20:16:58.818171] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-13T20:16:59.251736] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T20:16:59.460696] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T20:16:59.618034] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-13T20:17:00.418010] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-13T20:17:00.449059] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T20:17:01.068826] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-13T20:17:01.217995] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-13T20:17:02.017905] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-13T20:17:02.103547] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T20:17:02.548371] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T20:17:02.817952] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-13T20:17:03.622319] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-13T20:17:03.669893] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:17:04.251527] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-13T20:17:04.417937] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-13T20:17:04.777633] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T20:17:05.217926] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-13T20:17:06.017919] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-13T20:17:06.403618] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:17:06.817919] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-13T20:17:06.864421] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T20:17:07.617917] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-13T20:17:08.019481] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T20:17:08.047539] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T20:17:08.417981] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-13T20:17:09.217950] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-13T20:17:09.315271] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T20:17:09.763894] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:17:09.766282] [INFO ] [REMOTE ] MSA: Full fetch complete (25543 records). [2025-10-13T20:17:09.766469] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-13T20:17:09.767241] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:17:09.767338] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:09.767384] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:09.767429] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-13T20:17:09.767512] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-13T20:17:09.767569] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-13T20:17:09.767615] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-13T20:17:09.767747] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSA took 23.4s. Estimated remaining: 2h 16m 14s. Rate: 7.1 symbols/min [2025-10-13T20:17:09.998295] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:09.998619] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-13T20:17:09.998857] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-13T20:17:09.999043] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-13T20:17:09.999198] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-13T20:17:09.999359] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-13T20:17:09.999563] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-13T20:17:10.023059] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-13T20:17:10.345256] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-13T20:17:10.453948] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:10.817910] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-13T20:17:11.617931] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-13T20:17:11.657288] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T20:17:12.027047] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-13T20:17:12.417949] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-13T20:17:12.474457] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-13T20:17:13.217980] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-13T20:17:13.732050] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T20:17:14.017989] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-13T20:17:14.644960] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-13T20:17:14.817989] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-13T20:17:14.844619] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T20:17:15.618006] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-13T20:17:16.229511] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T20:17:16.417936] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-13T20:17:17.217947] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-13T20:17:17.298167] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T20:17:17.415745] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-13T20:17:18.017999] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-13T20:17:18.817907] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-13T20:17:19.173813] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T20:17:19.444295] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:17:19.446462] [INFO ] [REMOTE ] MSB: Full fetch complete (12932 records). [2025-10-13T20:17:19.446570] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-13T20:17:19.633697] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-13T20:17:19.845415] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-13T20:17:19.845524] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-13T20:17:19.846145] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-13T20:17:19.846211] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-13T20:17:19.846863] [DEBUG] [LOCAL ] MSB: Trimmed 12932 records to 7768 (keeping 200 days of data) [2025-10-13T20:17:19.901970] [DEBUG] [LOCAL ] MSB: Primary data saved (7768 records). [2025-10-13T20:17:19.902106] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-13T20:17:19.902205] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSB took 30.9s. Estimated remaining: 2h 16m 7s. Rate: 7.1 symbols/min [2025-10-13T20:17:20.080237] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:20.080483] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-13T20:17:20.080530] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-13T20:17:20.080671] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-13T20:17:20.080729] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-13T20:17:20.080776] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-13T20:17:20.080810] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-13T20:17:20.430919] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-13T20:17:20.452354] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:20.503786] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-13T20:17:20.932889] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T20:17:21.217951] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-13T20:17:21.558712] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T20:17:22.018018] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-13T20:17:22.738961] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:17:22.759429] [INFO ] [REMOTE ] MS: Full fetch complete (77325 records). [2025-10-13T20:17:22.759873] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-13T20:17:22.761945] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:17:22.762487] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:17:22.770230] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:22.770392] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:22.770475] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-13T20:17:22.770563] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-13T20:17:22.770611] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-13T20:17:22.770699] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-13T20:17:22.770819] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MS took 36.5s. Estimated remaining: 2h 15m 54s. Rate: 7.1 symbols/min [2025-10-13T20:17:22.823204] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-13T20:17:22.957711] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:22.978241] [DEBUG] [LOCAL ] MSD: Loaded 16643 existing records from primary storage. [2025-10-13T20:17:22.978590] [INFO ] [MAIN ] MSD: Loaded 16643 existing records. [2025-10-13T20:17:23.177161] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:17:23.177498] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-13T20:17:23.177549] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-13T20:17:23.178182] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-13T20:17:23.178247] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-13T20:17:23.577591] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:23.618038] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-13T20:17:24.417954] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-13T20:17:24.465913] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T20:17:24.851634] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T20:17:25.217935] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-13T20:17:25.400365] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-13T20:17:26.018002] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-13T20:17:26.759601] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T20:17:26.817984] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-13T20:17:26.910816] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T20:17:27.618013] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-13T20:17:28.319843] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:17:28.325418] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-13T20:17:28.325584] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-13T20:17:28.326414] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:17:28.326724] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:28.326783] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:28.326861] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-13T20:17:28.326941] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-13T20:17:28.326979] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-13T20:17:28.327018] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-13T20:17:28.327079] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MRK took 42.0s. Estimated remaining: 2h 15m 44s. Rate: 7.1 symbols/min [2025-10-13T20:17:28.423146] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-13T20:17:28.515203] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:28.515445] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-13T20:17:28.515519] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-13T20:17:28.515849] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-13T20:17:28.515972] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-13T20:17:28.516130] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-13T20:17:28.516273] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-13T20:17:28.668550] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T20:17:28.930180] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:29.217923] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-13T20:17:29.480990] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T20:17:30.017990] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-13T20:17:30.630008] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T20:17:30.817904] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-13T20:17:30.918112] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T20:17:31.617986] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-13T20:17:32.022552] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T20:17:32.418021] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-13T20:17:32.749455] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T20:17:33.217954] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-13T20:17:33.336572] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T20:17:34.018007] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-13T20:17:34.143239] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T20:17:34.556261] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T20:17:34.818024] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-13T20:17:35.617982] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-13T20:17:36.101224] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T20:17:36.417950] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-13T20:17:36.451281] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T20:17:37.027372] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T20:17:37.217953] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-13T20:17:37.659913] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:17:37.660693] [INFO ] [REMOTE ] MSC: Full fetch complete (2531 records). [2025-10-13T20:17:37.660761] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-13T20:17:37.836752] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-13T20:17:37.836946] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:37.836993] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:37.837031] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-13T20:17:37.837082] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-13T20:17:37.837115] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-13T20:17:37.837157] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-13T20:17:37.837212] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSC took 28.1s. Estimated remaining: 2h 15m 36s. Rate: 7.1 symbols/min [2025-10-13T20:17:38.005477] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:38.005628] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-13T20:17:38.005697] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-13T20:17:38.005808] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-13T20:17:38.005849] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-13T20:17:38.005889] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-13T20:17:38.005921] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-13T20:17:38.025876] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-13T20:17:38.364249] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:38.817912] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-13T20:17:39.623102] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-13T20:17:39.638963] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T20:17:40.161219] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T20:17:40.417931] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-13T20:17:41.134053] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T20:17:41.217987] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-13T20:17:41.504852] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T20:17:42.017931] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-13T20:17:42.599362] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T20:17:42.818006] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-13T20:17:43.452400] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T20:17:43.617934] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-13T20:17:44.426745] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-13T20:17:44.436368] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T20:17:44.436123] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:17:45.218035] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-13T20:17:46.017998] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-13T20:17:46.170014] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T20:17:46.768302] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T20:17:46.817905] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-13T20:17:46.966179] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T20:17:47.617986] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-13T20:17:48.069962] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T20:17:48.417924] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-13T20:17:48.934907] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T20:17:49.217985] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-13T20:17:49.994989] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T20:17:50.017904] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-13T20:17:50.405316] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:17:50.817926] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-13T20:17:51.498433] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T20:17:51.617942] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-13T20:17:51.875220] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T20:17:52.417991] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-13T20:17:53.099560] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T20:17:53.217980] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-13T20:17:53.490885] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T20:17:53.494001] [INFO ] [REMOTE ] MSD: Full fetch complete (22974 records). [2025-10-13T20:17:53.494086] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-13T20:17:53.953446] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-13T20:17:53.953535] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-13T20:17:53.954079] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-13T20:17:53.954141] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-13T20:17:53.954951] [DEBUG] [LOCAL ] MSD: Trimmed 22974 records to 16426 (keeping 200 days of data) [2025-10-13T20:17:54.025439] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-13T20:17:54.056428] [DEBUG] [LOCAL ] MSD: Primary data saved (16426 records). [2025-10-13T20:17:54.056593] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-13T20:17:54.056707] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 31.3s. Estimated remaining: 2h 15m 33s. Rate: 7.1 symbols/min [2025-10-13T20:17:54.224701] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:54.224872] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-13T20:17:54.224911] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-13T20:17:54.225027] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-13T20:17:54.225069] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-13T20:17:54.225130] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-13T20:17:54.225164] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-13T20:17:54.584799] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:54.683167] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T20:17:54.817889] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-13T20:17:55.617918] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-13T20:17:55.687622] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T20:17:55.691744] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T20:17:56.417951] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-13T20:17:57.190274] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T20:17:57.217886] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-13T20:17:57.765047] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:17:57.768215] [INFO ] [REMOTE ] MSCI: Full fetch complete (50060 records). [2025-10-13T20:17:57.768368] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-13T20:17:57.769189] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:17:57.769300] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:57.769372] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:57.769468] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-13T20:17:57.769549] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-13T20:17:57.769588] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-13T20:17:57.769631] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-13T20:17:57.769750] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSCI took 37.9s. Estimated remaining: 2h 15m 21s. Rate: 7.1 symbols/min [2025-10-13T20:17:57.950209] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:57.950438] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-13T20:17:57.950495] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-13T20:17:57.950751] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-13T20:17:57.950943] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-13T20:17:57.951009] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-13T20:17:57.951045] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-13T20:17:58.020175] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-13T20:17:58.141247] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T20:17:58.348340] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:17:58.817934] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-13T20:17:59.177288] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T20:17:59.440476] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:17:59.444909] [INFO ] [REMOTE ] MSDL: Full fetch complete (55258 records). [2025-10-13T20:17:59.445033] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-13T20:17:59.445707] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:17:59.445809] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:17:59.445854] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:17:59.445892] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-13T20:17:59.445951] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-13T20:17:59.445987] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-13T20:17:59.446028] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-13T20:17:59.446083] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSDL took 31.1s. Estimated remaining: 2h 15m 8s. Rate: 7.1 symbols/min [2025-10-13T20:17:59.617911] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-13T20:17:59.621429] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:17:59.621750] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-13T20:17:59.621824] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-13T20:17:59.621962] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-13T20:17:59.622027] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-13T20:17:59.622881] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-13T20:17:59.622932] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-13T20:17:59.987802] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:00.417934] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-13T20:18:01.218005] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-13T20:18:01.565138] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T20:18:01.574907] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:18:01.575384] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-13T20:18:01.575512] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:18:01.575582] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-13T20:18:01.575672] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:18:01.575743] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-13T20:18:01.575807] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-13T20:18:01.575846] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-13T20:18:01.575932] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-13T20:18:01.575987] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSIF took 2.1s. Estimated remaining: 2h 14m 56s. Rate: 7.1 symbols/min [2025-10-13T20:18:01.749895] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:01.750094] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-13T20:18:01.750162] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-13T20:18:01.750294] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-13T20:18:01.750446] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-13T20:18:01.750603] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-13T20:18:01.750729] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-13T20:18:01.861184] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T20:18:02.023098] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-13T20:18:02.159576] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:02.818007] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-13T20:18:03.018087] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T20:18:03.617922] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-13T20:18:04.417922] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-13T20:18:04.610344] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T20:18:04.922109] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T20:18:05.205082] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T20:18:05.217885] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-13T20:18:06.017940] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-13T20:18:06.385348] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T20:18:06.817943] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-13T20:18:07.551825] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T20:18:07.571228] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T20:18:07.617928] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-13T20:18:08.418014] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-13T20:18:08.768619] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T20:18:09.217946] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-13T20:18:09.915294] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T20:18:10.017933] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-13T20:18:10.039070] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T20:18:10.817932] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-13T20:18:11.587367] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:18:11.617891] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-13T20:18:11.643827] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T20:18:12.417927] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-13T20:18:12.713802] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T20:18:13.217938] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-13T20:18:13.843172] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T20:18:14.017917] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-13T20:18:14.669586] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T20:18:14.818010] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-13T20:18:15.617928] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-13T20:18:15.765116] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T20:18:16.163176] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T20:18:16.418055] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-13T20:18:17.158320] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T20:18:17.217936] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-13T20:18:17.744774] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T20:18:18.018019] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-13T20:18:18.817912] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-13T20:18:18.980108] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T20:18:19.191403] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:18:19.335231] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:18:19.338448] [INFO ] [REMOTE ] MSGE: Full fetch complete (39997 records). [2025-10-13T20:18:19.338546] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-13T20:18:19.339084] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:19.339175] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:19.339218] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:19.339256] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-13T20:18:19.339312] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-13T20:18:19.339347] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-13T20:18:19.339386] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-13T20:18:19.339449] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSGE took 41.5s. Estimated remaining: 2h 14m 54s. Rate: 7.1 symbols/min [2025-10-13T20:18:19.503920] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:19.504105] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-13T20:18:19.504142] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-13T20:18:19.504255] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-13T20:18:19.504300] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-13T20:18:19.504341] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-13T20:18:19.504373] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-13T20:18:19.623161] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-13T20:18:19.860531] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:20.417955] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-13T20:18:21.176495] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T20:18:21.217884] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-13T20:18:21.645697] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T20:18:22.017984] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-13T20:18:22.671012] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T20:18:22.817923] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-13T20:18:23.617914] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-13T20:18:23.781306] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T20:18:24.417933] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-13T20:18:24.560615] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T20:18:25.217911] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-13T20:18:25.264918] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T20:18:26.023108] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-13T20:18:26.051293] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T20:18:26.652000] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:18:26.655925] [INFO ] [REMOTE ] MSGS: Full fetch complete (23413 records). [2025-10-13T20:18:26.656121] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-13T20:18:26.657007] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:26.657121] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:26.657208] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:26.657308] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-13T20:18:26.657412] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-13T20:18:26.657473] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-13T20:18:26.657537] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-13T20:18:26.657630] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSGS took 32.6s. Estimated remaining: 2h 14m 44s. Rate: 7.1 symbols/min [2025-10-13T20:18:26.822996] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-13T20:18:26.874923] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:18:26.879126] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:26.887668] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-13T20:18:26.887855] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-13T20:18:26.889027] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-13T20:18:26.889280] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-13T20:18:26.889428] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-13T20:18:26.889920] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-13T20:18:27.260922] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:27.617980] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-13T20:18:28.417942] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-13T20:18:28.778678] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T20:18:29.090935] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T20:18:29.217999] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-13T20:18:29.939636] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T20:18:30.017993] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-13T20:18:30.817999] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-13T20:18:31.312248] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T20:18:31.617907] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-13T20:18:31.883542] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T20:18:32.417988] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-13T20:18:32.474795] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T20:18:33.217927] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-13T20:18:33.608557] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T20:18:33.642085] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-13T20:18:34.018028] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-13T20:18:34.818015] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-13T20:18:34.878059] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T20:18:35.389127] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T20:18:35.617986] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-13T20:18:36.301320] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:18:36.305818] [INFO ] [REMOTE ] MSM: Full fetch complete (51630 records). [2025-10-13T20:18:36.306031] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-13T20:18:36.306963] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:36.307055] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:36.307133] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:36.307215] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-13T20:18:36.307292] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-13T20:18:36.307338] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-13T20:18:36.307421] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-13T20:18:36.307513] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSM took 34.7s. Estimated remaining: 2h 14m 37s. Rate: 7.1 symbols/min [2025-10-13T20:18:36.420943] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-13T20:18:36.544158] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T20:18:36.545929] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:36.576252] [DEBUG] [LOCAL ] MTD: Loaded 15526 existing records from primary storage. [2025-10-13T20:18:36.576558] [INFO ] [MAIN ] MTD: Loaded 15526 existing records. [2025-10-13T20:18:36.753847] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:18:36.754104] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-13T20:18:36.754151] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-13T20:18:36.754624] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-13T20:18:36.754720] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-13T20:18:37.115303] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:37.218023] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-13T20:18:38.018000] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-13T20:18:38.206997] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T20:18:38.294687] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T20:18:38.818016] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-13T20:18:39.611110] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:18:39.615879] [INFO ] [REMOTE ] MSI: Full fetch complete (57651 records). [2025-10-13T20:18:39.616114] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-13T20:18:39.617314] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:39.617412] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:39.617486] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:39.617566] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-13T20:18:39.617710] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-13T20:18:39.617798] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-13T20:18:39.617887] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-13T20:18:39.618000] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MSI took 41.8s. Estimated remaining: 2h 14m 25s. Rate: 7.1 symbols/min [2025-10-13T20:18:39.623339] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-13T20:18:39.825389] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:39.825754] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-13T20:18:39.825881] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-13T20:18:39.826044] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-13T20:18:39.826149] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-13T20:18:39.826328] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-13T20:18:39.826500] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-13T20:18:40.061913] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T20:18:40.274133] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:40.417996] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-13T20:18:41.217929] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-13T20:18:41.612029] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T20:18:42.018010] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-13T20:18:42.301004] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T20:18:42.802873] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T20:18:42.817875] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-13T20:18:43.618014] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-13T20:18:43.871362] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T20:18:44.417991] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-13T20:18:44.581424] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:18:45.217996] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-13T20:18:45.502742] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T20:18:45.756124] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T20:18:46.018032] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-13T20:18:46.817903] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-13T20:18:46.933959] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T20:18:47.617946] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-13T20:18:47.856507] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T20:18:48.418028] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-13T20:18:48.602216] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T20:18:48.962304] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:18:48.967622] [INFO ] [REMOTE ] MT: Full fetch complete (73175 records). [2025-10-13T20:18:48.967855] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-13T20:18:48.969627] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:48.969797] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:48.969845] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:48.969914] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-13T20:18:48.969990] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-13T20:18:48.970029] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-13T20:18:48.970068] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-13T20:18:48.970136] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MT took 29.6s. Estimated remaining: 2h 14m 17s. Rate: 7.1 symbols/min [2025-10-13T20:18:49.200979] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:49.201491] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-13T20:18:49.201617] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-13T20:18:49.201772] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-13T20:18:49.201819] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-13T20:18:49.201863] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-13T20:18:49.201896] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-13T20:18:49.224408] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-13T20:18:49.597812] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:49.627506] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T20:18:50.018100] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-13T20:18:50.817944] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-13T20:18:50.949293] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T20:18:51.124685] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:18:51.618025] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-13T20:18:52.418002] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-13T20:18:52.499524] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T20:18:53.217986] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-13T20:18:53.350130] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T20:18:54.017918] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-13T20:18:54.293092] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T20:18:54.339497] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:18:54.818020] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-13T20:18:55.623119] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-13T20:18:55.636404] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T20:18:56.417988] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-13T20:18:56.706291] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T20:18:56.734988] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T20:18:57.123929] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:18:57.128584] [INFO ] [REMOTE ] MTB: Full fetch complete (67491 records). [2025-10-13T20:18:57.128745] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-13T20:18:57.130023] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:18:57.130324] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:18:57.130397] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:18:57.130477] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-13T20:18:57.130594] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-13T20:18:57.130639] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-13T20:18:57.130732] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-13T20:18:57.130819] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 30.5s. Estimated remaining: 2h 14m 8s. Rate: 7.1 symbols/min [2025-10-13T20:18:57.223156] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-13T20:18:57.304233] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:18:57.304421] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-13T20:18:57.304459] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-13T20:18:57.304577] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-13T20:18:57.304619] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-13T20:18:57.304695] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-13T20:18:57.304744] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-13T20:18:57.650622] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:18:58.018004] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-13T20:18:58.817938] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-13T20:18:59.012555] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T20:18:59.223934] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T20:18:59.618094] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-13T20:18:59.910304] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T20:19:00.417953] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-13T20:19:00.546087] [DEBUG] [REMOTE ] MTG: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T20:19:00.546545] [WARN ] [REMOTE ] MTG: No data returned for month 2025-02 [2025-10-13T20:19:00.546672] [FATAL] [REMOTE ] MTG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:19:00.546822] [FATAL] [MAIN ] MTG: Failed to fetch primary data. [2025-10-13T20:19:00.546896] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:19:00.546951] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-13T20:19:00.547044] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-13T20:19:00.547101] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-13T20:19:00.547167] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-13T20:19:00.547241] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTG took 11.6s. Estimated remaining: 2h 13m 57s. Rate: 7.1 symbols/min [2025-10-13T20:19:00.718585] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:00.718809] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-13T20:19:00.718853] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-13T20:19:00.718965] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-13T20:19:00.719006] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-13T20:19:00.719068] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-13T20:19:00.719101] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-13T20:19:01.074381] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:01.087300] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T20:19:01.217918] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-13T20:19:02.017945] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-13T20:19:02.817951] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-13T20:19:02.841600] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T20:19:03.094174] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T20:19:03.617919] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-13T20:19:04.417927] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-13T20:19:04.771238] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T20:19:05.217915] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-13T20:19:05.431532] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T20:19:05.852123] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T20:19:06.017937] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-13T20:19:06.817937] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-13T20:19:07.245814] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T20:19:07.617956] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-13T20:19:07.673886] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T20:19:08.417904] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-13T20:19:08.497132] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T20:19:08.728815] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T20:19:09.217979] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-13T20:19:09.875524] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T20:19:10.014214] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T20:19:10.023629] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-13T20:19:10.817919] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-13T20:19:11.617912] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-13T20:19:11.654977] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T20:19:12.281149] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T20:19:12.417940] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-13T20:19:12.559357] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T20:19:13.217947] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-13T20:19:13.988479] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T20:19:14.017896] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-13T20:19:14.127306] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T20:19:14.129692] [INFO ] [REMOTE ] MTD: Full fetch complete (21259 records). [2025-10-13T20:19:14.129772] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-13T20:19:14.493201] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-13T20:19:14.493296] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-13T20:19:14.493868] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-13T20:19:14.493933] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-13T20:19:14.494952] [DEBUG] [LOCAL ] MTD: Trimmed 21259 records to 15417 (keeping 200 days of data) [2025-10-13T20:19:14.591452] [DEBUG] [LOCAL ] MTD: Primary data saved (15417 records). [2025-10-13T20:19:14.591609] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-13T20:19:14.591722] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTD took 38.3s. Estimated remaining: 2h 13m 52s. Rate: 7.1 symbols/min [2025-10-13T20:19:14.755550] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:14.755741] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-13T20:19:14.755787] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-13T20:19:14.755891] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-13T20:19:14.755931] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-13T20:19:14.755971] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-13T20:19:14.756002] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-13T20:19:14.827789] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-13T20:19:15.114142] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:15.617934] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-13T20:19:15.660092] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T20:19:16.417956] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-13T20:19:16.575750] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T20:19:17.217952] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-13T20:19:17.470130] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T20:19:17.786153] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T20:19:18.017946] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-13T20:19:18.615870] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T20:19:18.817918] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-13T20:19:19.325224] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T20:19:19.617936] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-13T20:19:19.723215] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T20:19:20.337576] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:19:20.345203] [INFO ] [REMOTE ] MTDR: Full fetch complete (73446 records). [2025-10-13T20:19:20.345394] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-13T20:19:20.346810] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:19:20.346920] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:19:20.346974] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:19:20.347029] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-13T20:19:20.347110] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-13T20:19:20.347156] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-13T20:19:20.347224] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-13T20:19:20.347338] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTDR took 40.7s. Estimated remaining: 2h 13m 42s. Rate: 7.1 symbols/min [2025-10-13T20:19:20.423305] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-13T20:19:20.529285] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:20.529513] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-13T20:19:20.529553] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-13T20:19:20.529708] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-13T20:19:20.529763] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-13T20:19:20.529809] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-13T20:19:20.529844] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-13T20:19:20.889839] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:20.958052] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T20:19:21.218013] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-13T20:19:22.018004] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-13T20:19:22.817924] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-13T20:19:22.902853] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T20:19:23.619878] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-13T20:19:23.624805] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T20:19:23.706430] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T20:19:24.042033] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T20:19:24.417948] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-13T20:19:24.844741] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T20:19:25.217998] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-13T20:19:26.017955] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-13T20:19:26.817913] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-13T20:19:26.938060] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T20:19:26.970251] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T20:19:27.569929] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T20:19:27.617899] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-13T20:19:28.064836] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T20:19:28.417978] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-13T20:19:29.217929] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-13T20:19:29.398892] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T20:19:30.018002] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-13T20:19:30.818125] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-13T20:19:30.976851] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T20:19:31.056594] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T20:19:31.618093] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-13T20:19:31.953507] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T20:19:32.409420] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T20:19:32.418020] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-13T20:19:33.217945] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-13T20:19:33.524436] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T20:19:34.017945] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-13T20:19:34.551632] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T20:19:34.818000] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-13T20:19:34.859544] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T20:19:35.272839] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T20:19:35.617984] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-13T20:19:36.418044] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-13T20:19:36.837061] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T20:19:37.163501] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:19:37.168457] [INFO ] [REMOTE ] MTH: Full fetch complete (63229 records). [2025-10-13T20:19:37.168625] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-13T20:19:37.169684] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:19:37.169781] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:19:37.169825] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:19:37.169868] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-13T20:19:37.169935] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-13T20:19:37.169973] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-13T20:19:37.170013] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-13T20:19:37.170080] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTH took 40.0s. Estimated remaining: 2h 13m 39s. Rate: 7.1 symbols/min [2025-10-13T20:19:37.223170] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-13T20:19:37.359578] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:37.359843] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-13T20:19:37.359887] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-13T20:19:37.360118] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-13T20:19:37.360189] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-13T20:19:37.360249] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-13T20:19:37.360283] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-13T20:19:37.739978] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:38.018043] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-13T20:19:38.380626] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T20:19:38.817950] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-13T20:19:39.547080] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T20:19:39.617900] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-13T20:19:40.054834] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T20:19:40.417997] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-13T20:19:40.969886] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T20:19:41.217977] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-13T20:19:41.664464] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T20:19:42.017907] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-13T20:19:42.174598] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T20:19:42.817947] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-13T20:19:42.913921] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T20:19:43.618041] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-13T20:19:43.967434] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T20:19:44.275722] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:19:44.417927] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-13T20:19:44.945787] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:19:44.946766] [INFO ] [REMOTE ] MTR: Full fetch complete (2433 records). [2025-10-13T20:19:44.946886] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-13T20:19:45.157899] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T20:19:45.158196] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:19:45.158278] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:19:45.158359] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-13T20:19:45.158438] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-13T20:19:45.158477] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-13T20:19:45.158519] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-13T20:19:45.158771] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTR took 30.6s. Estimated remaining: 2h 13m 30s. Rate: 7.1 symbols/min [2025-10-13T20:19:45.223129] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-13T20:19:45.389351] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:45.390064] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-13T20:19:45.390122] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-13T20:19:45.390393] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-13T20:19:45.390449] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-13T20:19:45.390494] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-13T20:19:45.390563] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-13T20:19:45.779711] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:45.998044] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:19:46.006328] [INFO ] [REMOTE ] MTN: Full fetch complete (56267 records). [2025-10-13T20:19:46.006504] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-13T20:19:46.007369] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:19:46.007464] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:19:46.007540] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:19:46.007627] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-13T20:19:46.007761] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-13T20:19:46.007823] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-13T20:19:46.007917] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-13T20:19:46.008035] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTN took 45.5s. Estimated remaining: 2h 13m 17s. Rate: 7.1 symbols/min [2025-10-13T20:19:46.023131] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-13T20:19:46.211430] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:46.211703] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-13T20:19:46.211757] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-13T20:19:46.211878] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-13T20:19:46.211922] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-13T20:19:46.211965] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-13T20:19:46.211997] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-13T20:19:46.585166] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:46.818223] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-13T20:19:47.488425] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T20:19:47.617947] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-13T20:19:47.878904] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T20:19:48.094874] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T20:19:48.098025] [INFO ] [REMOTE ] MTRN: Full fetch complete (23610 records). [2025-10-13T20:19:48.098192] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-13T20:19:48.098638] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:19:48.098743] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:19:48.098787] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:19:48.098851] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-13T20:19:48.098911] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-13T20:19:48.098946] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-13T20:19:48.098984] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-13T20:19:48.099036] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTRN took 27.8s. Estimated remaining: 2h 13m 4s. Rate: 7.1 symbols/min [2025-10-13T20:19:48.265965] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:19:48.266160] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-13T20:19:48.266197] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-13T20:19:48.266307] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-13T20:19:48.266347] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-13T20:19:48.266387] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-13T20:19:48.266419] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-13T20:19:48.422447] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-13T20:19:48.636080] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:19:49.217924] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-13T20:19:49.962184] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:19:50.017886] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-13T20:19:50.786336] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T20:19:50.817883] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-13T20:19:51.160286] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T20:19:51.617940] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-13T20:19:52.417906] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-13T20:19:52.596306] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T20:19:52.715247] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T20:19:53.217922] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-13T20:19:53.831683] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:19:54.017894] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-13T20:19:54.785233] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T20:19:54.817928] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-13T20:19:55.172708] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T20:19:55.617985] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-13T20:19:56.241083] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T20:19:56.417933] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-13T20:19:57.217934] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-13T20:19:57.515135] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T20:19:57.646819] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T20:19:58.017938] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-13T20:19:58.572051] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T20:19:58.817937] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-13T20:19:59.221579] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T20:19:59.617943] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-13T20:20:00.418025] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-13T20:20:00.471133] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T20:20:00.884810] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T20:20:01.217940] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-13T20:20:01.338819] [DEBUG] [REMOTE ] MTW: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-13T20:20:01.339289] [WARN ] [REMOTE ] MTW: No data returned for month 2025-05 [2025-10-13T20:20:01.339392] [FATAL] [REMOTE ] MTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:20:01.339531] [FATAL] [MAIN ] MTW: Failed to fetch primary data. [2025-10-13T20:20:01.339617] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:20:01.339731] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-13T20:20:01.339819] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-13T20:20:01.339872] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-13T20:20:01.339926] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-13T20:20:01.340003] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 16.2s. Estimated remaining: 2h 12m 59s. Rate: 7.1 symbols/min [2025-10-13T20:20:01.543964] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:01.556474] [DEBUG] [LOCAL ] MUA: Loaded 11966 existing records from primary storage. [2025-10-13T20:20:01.556727] [INFO ] [MAIN ] MUA: Loaded 11966 existing records. [2025-10-13T20:20:01.747301] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:20:01.751977] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-13T20:20:01.752202] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-13T20:20:01.752932] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-13T20:20:01.753004] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-13T20:20:01.996948] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T20:20:02.023260] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-13T20:20:02.186382] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:02.817950] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-13T20:20:03.617952] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-13T20:20:03.907278] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T20:20:04.053231] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T20:20:04.417945] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-13T20:20:04.697448] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T20:20:05.217990] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-13T20:20:05.260364] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T20:20:05.263823] [INFO ] [REMOTE ] MTUS: Full fetch complete (41280 records). [2025-10-13T20:20:05.263992] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-13T20:20:05.264886] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:20:05.264972] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:20:05.265040] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:20:05.265117] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-13T20:20:05.265191] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-13T20:20:05.265231] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-13T20:20:05.265306] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-13T20:20:05.265410] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTUS took 28.1s. Estimated remaining: 2h 12m 47s. Rate: 7.1 symbols/min [2025-10-13T20:20:05.460227] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:05.460456] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-13T20:20:05.460493] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-13T20:20:05.460674] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-13T20:20:05.460730] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-13T20:20:05.460774] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-13T20:20:05.460808] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-13T20:20:05.895346] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:06.017999] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-13T20:20:06.063714] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T20:20:06.818125] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-13T20:20:07.069547] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T20:20:07.617953] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-13T20:20:08.373478] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T20:20:08.418000] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-13T20:20:08.910463] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T20:20:09.121454] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T20:20:09.217945] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-13T20:20:10.018030] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-13T20:20:10.377389] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T20:20:10.818012] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-13T20:20:11.617998] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-13T20:20:11.765259] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T20:20:11.940688] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T20:20:12.417912] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-13T20:20:12.654116] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T20:20:13.181065] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T20:20:13.217922] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-13T20:20:14.017945] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-13T20:20:14.290974] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T20:20:14.818016] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-13T20:20:14.883951] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:20:15.617982] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-13T20:20:16.407555] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T20:20:16.418236] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-13T20:20:16.658270] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T20:20:17.217956] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-13T20:20:18.017940] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-13T20:20:18.165996] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T20:20:18.197241] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T20:20:18.818087] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-13T20:20:19.180483] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T20:20:19.493396] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:20:19.498620] [INFO ] [REMOTE ] MTZ: Full fetch complete (63197 records). [2025-10-13T20:20:19.498895] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-13T20:20:19.500095] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:20:19.500235] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:20:19.500280] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:20:19.500322] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-13T20:20:19.500390] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-13T20:20:19.500456] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-13T20:20:19.500498] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-13T20:20:19.500588] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTZ took 31.4s. Estimated remaining: 2h 12m 43s. Rate: 7.1 symbols/min [2025-10-13T20:20:19.623167] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-13T20:20:19.696005] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:19.709891] [DEBUG] [LOCAL ] MUE: Loaded 12230 existing records from primary storage. [2025-10-13T20:20:19.710144] [INFO ] [MAIN ] MUE: Loaded 12230 existing records. [2025-10-13T20:20:19.891606] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:20:19.891853] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-13T20:20:19.891901] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-13T20:20:19.892255] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-13T20:20:19.892323] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-13T20:20:20.251957] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:20.418008] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-13T20:20:20.972009] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T20:20:21.218003] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-13T20:20:21.575735] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T20:20:22.017918] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-13T20:20:22.410444] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:20:22.817948] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-13T20:20:22.894811] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T20:20:23.617992] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-13T20:20:23.877165] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T20:20:24.417923] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-13T20:20:24.605053] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:20:25.218048] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-13T20:20:25.235739] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T20:20:26.017995] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-13T20:20:26.353876] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T20:20:26.817952] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-13T20:20:27.094005] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T20:20:27.617988] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-13T20:20:27.722303] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T20:20:28.244185] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:20:28.246496] [INFO ] [REMOTE ] MTX: Full fetch complete (31069 records). [2025-10-13T20:20:28.246585] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-13T20:20:28.247208] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:20:28.247327] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:20:28.247386] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:20:28.247701] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-13T20:20:28.247784] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-13T20:20:28.247823] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-13T20:20:28.247863] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-13T20:20:28.247923] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTX took 42.2s. Estimated remaining: 2h 12m 35s. Rate: 7.1 symbols/min [2025-10-13T20:20:28.445520] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-13T20:20:28.450934] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:28.452069] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-13T20:20:28.452127] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-13T20:20:28.452250] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-13T20:20:28.452293] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-13T20:20:28.452334] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-13T20:20:28.452368] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-13T20:20:28.842692] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:29.218003] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-13T20:20:29.408052] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T20:20:30.018022] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-13T20:20:30.567628] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T20:20:30.772189] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T20:20:30.818027] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-13T20:20:31.599108] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T20:20:31.601073] [INFO ] [REMOTE ] MUA: Full fetch complete (18580 records). [2025-10-13T20:20:31.601153] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-13T20:20:31.623161] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-13T20:20:31.985810] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-13T20:20:31.985922] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-13T20:20:31.986569] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-13T20:20:31.986611] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-13T20:20:31.987359] [DEBUG] [LOCAL ] MUA: Trimmed 18580 records to 11599 (keeping 200 days of data) [2025-10-13T20:20:32.066924] [DEBUG] [LOCAL ] MUA: Primary data saved (11599 records). [2025-10-13T20:20:32.067106] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-13T20:20:32.067209] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 30.7s. Estimated remaining: 2h 12m 23s. Rate: 7.1 symbols/min [2025-10-13T20:20:32.236193] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:32.236410] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-13T20:20:32.236448] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-13T20:20:32.236564] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-13T20:20:32.236605] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-13T20:20:32.236671] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-13T20:20:32.236726] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-13T20:20:32.424465] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-13T20:20:32.617457] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T20:20:32.623361] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:33.218023] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-13T20:20:33.822960] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T20:20:34.017983] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-13T20:20:34.394370] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T20:20:34.818003] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-13T20:20:35.275092] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T20:20:35.617928] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-13T20:20:36.225795] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:20:36.228895] [INFO ] [REMOTE ] MUC: Full fetch complete (29484 records). [2025-10-13T20:20:36.228993] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-13T20:20:36.229675] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:20:36.229788] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:20:36.229853] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:20:36.229945] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-13T20:20:36.230028] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-13T20:20:36.230091] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-13T20:20:36.230168] [DEBUG] [LOCAL ] MUC: No derivative data file found to delete. [2025-10-13T20:20:36.230240] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 31.0s. Estimated remaining: 2h 12m 12s. Rate: 7.1 symbols/min [2025-10-13T20:20:36.420253] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:36.420848] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-13T20:20:36.420430] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-13T20:20:36.421046] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-13T20:20:36.422317] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-13T20:20:36.422379] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-13T20:20:36.422429] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-13T20:20:36.422516] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-13T20:20:36.832636] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T20:20:36.856814] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:37.217908] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-13T20:20:37.328543] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:20:38.017942] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-13T20:20:38.823251] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-13T20:20:38.824796] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T20:20:39.112768] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T20:20:39.617953] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-13T20:20:40.064071] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:20:40.418030] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-13T20:20:41.181670] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T20:20:41.217953] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-13T20:20:41.453622] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T20:20:42.017944] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-13T20:20:42.775049] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T20:20:42.818069] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-13T20:20:43.059109] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T20:20:43.618138] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-13T20:20:44.417912] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-13T20:20:44.709328] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T20:20:44.724597] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T20:20:45.217951] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-13T20:20:46.017915] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-13T20:20:46.079961] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T20:20:46.245480] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T20:20:46.786616] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T20:20:46.817996] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-13T20:20:47.617942] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-13T20:20:47.845791] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T20:20:48.418001] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-13T20:20:49.218036] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-13T20:20:49.435769] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T20:20:50.018016] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-13T20:20:50.084519] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T20:20:50.340524] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T20:20:50.817987] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-13T20:20:50.883443] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T20:20:51.617989] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-13T20:20:52.345826] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T20:20:52.347441] [INFO ] [REMOTE ] MUE: Full fetch complete (15828 records). [2025-10-13T20:20:52.347518] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-13T20:20:52.418919] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-13T20:20:52.726594] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-13T20:20:52.726752] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-13T20:20:52.727179] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-13T20:20:52.727257] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-13T20:20:52.728198] [DEBUG] [LOCAL ] MUE: Trimmed 15828 records to 11803 (keeping 200 days of data) [2025-10-13T20:20:52.819290] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T20:20:52.848153] [DEBUG] [LOCAL ] MUE: Primary data saved (11803 records). [2025-10-13T20:20:52.848312] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-13T20:20:52.848407] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 33.3s. Estimated remaining: 2h 12m 9s. Rate: 7.1 symbols/min [2025-10-13T20:20:53.022477] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:20:53.022680] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-13T20:20:53.022733] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-13T20:20:53.022845] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-13T20:20:53.022886] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-13T20:20:53.022926] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-13T20:20:53.022958] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-13T20:20:53.229070] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-13T20:20:53.375235] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:20:54.017952] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-13T20:20:54.261413] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T20:20:54.604268] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T20:20:54.818059] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-13T20:20:55.617955] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-13T20:20:55.738969] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T20:20:56.023063] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T20:20:56.418005] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-13T20:20:57.217986] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-13T20:20:57.522517] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T20:20:57.744346] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T20:20:58.018022] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-13T20:20:58.790359] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T20:20:58.817914] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-13T20:20:59.332353] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:20:59.617939] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-13T20:21:00.417929] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-13T20:21:00.541427] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T20:21:00.636576] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T20:21:01.217935] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-13T20:21:02.017919] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-13T20:21:02.427269] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T20:21:02.817921] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-13T20:21:03.067327] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T20:21:03.303026] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T20:21:03.495248] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T20:21:03.617938] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-13T20:21:04.417990] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-13T20:21:05.217927] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-13T20:21:05.513617] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T20:21:05.699978] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T20:21:06.017940] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-13T20:21:06.817889] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-13T20:21:07.144530] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T20:21:07.180050] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T20:21:07.617917] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-13T20:21:08.417918] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-13T20:21:08.839532] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T20:21:09.124579] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T20:21:09.217927] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-13T20:21:09.863717] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T20:21:09.986383] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:21:09.992774] [INFO ] [REMOTE ] MUFG: Full fetch complete (75250 records). [2025-10-13T20:21:09.992930] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-13T20:21:09.993824] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:21:09.993919] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:21:09.993963] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:21:09.994029] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-13T20:21:09.994094] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-13T20:21:09.994132] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-13T20:21:09.994172] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-13T20:21:09.994233] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUFG took 41.7s. Estimated remaining: 2h 12m 6s. Rate: 7.1 symbols/min [2025-10-13T20:21:10.023126] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-13T20:21:10.191194] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:10.191550] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-13T20:21:10.191610] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-13T20:21:10.191790] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-13T20:21:10.191835] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-13T20:21:10.191878] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-13T20:21:10.191913] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-13T20:21:10.560447] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:10.818014] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-13T20:21:11.262801] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T20:21:11.495224] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:21:11.500520] [INFO ] [REMOTE ] MUR: Full fetch complete (76184 records). [2025-10-13T20:21:11.500717] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-13T20:21:11.501533] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:21:11.501671] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:21:11.501773] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:21:11.501872] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-13T20:21:11.501959] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-13T20:21:11.501998] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-13T20:21:11.502037] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-13T20:21:11.502094] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUR took 35.3s. Estimated remaining: 2h 11m 53s. Rate: 7.1 symbols/min [2025-10-13T20:21:11.623010] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-13T20:21:11.686452] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:11.686621] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-13T20:21:11.686704] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-13T20:21:11.686821] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-13T20:21:11.686862] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-13T20:21:11.686905] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-13T20:21:11.686937] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-13T20:21:12.038485] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:12.417912] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-13T20:21:12.724524] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T20:21:13.218027] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-13T20:21:13.768923] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T20:21:14.018003] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-13T20:21:14.306731] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T20:21:14.817944] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-13T20:21:15.367835] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:21:15.369931] [INFO ] [REMOTE ] MUJ: Full fetch complete (19803 records). [2025-10-13T20:21:15.370006] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-13T20:21:15.370421] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:21:15.370521] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:21:15.370594] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:21:15.370724] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-13T20:21:15.370797] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-13T20:21:15.370832] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-13T20:21:15.370935] [DEBUG] [LOCAL ] MUJ: No derivative data file found to delete. [2025-10-13T20:21:15.371020] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUJ took 43.3s. Estimated remaining: 2h 11m 42s. Rate: 7.1 symbols/min [2025-10-13T20:21:15.531369] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T20:21:15.573749] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:15.587802] [DEBUG] [LOCAL ] MVF: Loaded 13305 existing records from primary storage. [2025-10-13T20:21:15.588113] [INFO ] [MAIN ] MVF: Loaded 13305 existing records. [2025-10-13T20:21:15.623068] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-13T20:21:15.771354] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:21:15.771575] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-13T20:21:15.771676] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-13T20:21:15.772128] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-13T20:21:15.772191] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-13T20:21:16.050622] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-13T20:21:16.126503] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:16.417942] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-13T20:21:17.217905] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-13T20:21:17.469361] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T20:21:18.017925] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-13T20:21:18.712136] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T20:21:18.817925] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-13T20:21:18.934536] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T20:21:19.617906] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-13T20:21:20.417899] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-13T20:21:20.518154] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T20:21:20.743784] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:21:20.744108] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-13T20:21:20.744200] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:21:20.744276] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-13T20:21:20.744338] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:21:20.744405] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-13T20:21:20.744467] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-13T20:21:20.744503] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-13T20:21:20.744541] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-13T20:21:20.744587] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSE took 10.8s. Estimated remaining: 2h 11m 31s. Rate: 7.1 symbols/min [2025-10-13T20:21:20.950534] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:20.950808] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-13T20:21:20.951030] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-13T20:21:20.951356] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-13T20:21:20.951512] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-13T20:21:20.951698] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-13T20:21:20.951876] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-13T20:21:21.060005] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T20:21:21.223226] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-13T20:21:21.328977] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:22.017944] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-13T20:21:22.192484] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T20:21:22.818079] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-13T20:21:22.840472] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T20:21:23.617935] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-13T20:21:23.688594] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T20:21:24.417915] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-13T20:21:24.726673] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:21:25.217945] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-13T20:21:25.388323] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T20:21:26.018050] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-13T20:21:26.820311] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-13T20:21:26.824357] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T20:21:26.940941] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T20:21:27.497064] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:21:27.499311] [INFO ] [REMOTE ] MUSA: Full fetch complete (34953 records). [2025-10-13T20:21:27.499390] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-13T20:21:27.499958] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:21:27.500046] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:21:27.500089] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:21:27.500127] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-13T20:21:27.500181] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-13T20:21:27.500215] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-13T20:21:27.500254] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-13T20:21:27.500307] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUSA took 34.7s. Estimated remaining: 2h 11m 22s. Rate: 7.1 symbols/min [2025-10-13T20:21:27.623135] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-13T20:21:27.680565] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:27.692804] [DEBUG] [LOCAL ] MVT: Loaded 10278 existing records from primary storage. [2025-10-13T20:21:27.693075] [INFO ] [MAIN ] MVT: Loaded 10278 existing records. [2025-10-13T20:21:27.872492] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:21:27.872724] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-13T20:21:27.872783] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-13T20:21:27.873088] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-13T20:21:27.873149] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-13T20:21:28.226703] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:28.417888] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-13T20:21:29.133308] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T20:21:29.217926] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-13T20:21:29.457905] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:21:29.842231] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T20:21:30.017907] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-13T20:21:30.817916] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-13T20:21:30.852557] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T20:21:31.617936] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-13T20:21:32.346787] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T20:21:32.417887] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-13T20:21:32.546030] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:21:33.068161] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T20:21:33.217914] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-13T20:21:34.017926] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-13T20:21:34.291919] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T20:21:34.818014] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-13T20:21:35.617941] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-13T20:21:35.685170] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:21:35.721718] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:21:36.210598] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T20:21:36.418038] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-13T20:21:37.217921] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-13T20:21:37.368865] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T20:21:38.017905] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-13T20:21:38.128996] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T20:21:38.817919] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-13T20:21:39.521971] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T20:21:39.617948] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-13T20:21:39.647495] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T20:21:40.417921] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-13T20:21:40.452715] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T20:21:41.182969] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T20:21:41.217925] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-13T20:21:42.017986] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-13T20:21:42.207862] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T20:21:42.798960] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T20:21:42.817884] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-13T20:21:43.607682] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T20:21:43.617903] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-13T20:21:44.417910] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-13T20:21:44.573132] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T20:21:45.214911] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T20:21:45.218143] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-13T20:21:45.965212] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T20:21:46.017903] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-13T20:21:46.736976] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:21:46.738978] [INFO ] [REMOTE ] MVF: Full fetch complete (18583 records). [2025-10-13T20:21:46.739056] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-13T20:21:46.823091] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-13T20:21:47.154514] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-13T20:21:47.154591] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-13T20:21:47.155015] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-13T20:21:47.155075] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-13T20:21:47.155597] [DEBUG] [LOCAL ] MVF: Trimmed 18583 records to 12853 (keeping 200 days of data) [2025-10-13T20:21:47.230124] [DEBUG] [LOCAL ] MVF: Primary data saved (12853 records). [2025-10-13T20:21:47.230252] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-13T20:21:47.230336] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MVF took 31.9s. Estimated remaining: 2h 11m 21s. Rate: 7.1 symbols/min [2025-10-13T20:21:47.397483] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:21:47.397666] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-13T20:21:47.397722] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-13T20:21:47.397841] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-13T20:21:47.397910] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-13T20:21:47.397987] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-13T20:21:47.398041] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-13T20:21:47.623190] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-13T20:21:47.754103] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:21:48.417936] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-13T20:21:48.575132] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T20:21:48.706940] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T20:21:49.217914] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-13T20:21:49.419364] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T20:21:49.999861] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T20:21:50.001428] [INFO ] [REMOTE ] MVO: Full fetch complete (14518 records). [2025-10-13T20:21:50.001511] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-13T20:21:50.023042] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-13T20:21:50.381248] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-13T20:21:50.381323] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-13T20:21:50.381661] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-13T20:21:50.381721] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-13T20:21:50.382376] [DEBUG] [LOCAL ] MVO: Trimmed 14518 records to 8739 (keeping 200 days of data) [2025-10-13T20:21:50.434251] [DEBUG] [LOCAL ] MVO: Primary data saved (8739 records). [2025-10-13T20:21:50.434384] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-13T20:21:50.434460] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 29.7s. Estimated remaining: 2h 11m 9s. Rate: 7.1 symbols/min [2025-10-13T20:21:50.817903] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-13T20:21:50.921536] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T20:21:51.617948] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-13T20:21:52.401553] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T20:21:52.417872] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-13T20:21:52.505533] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T20:21:52.511031] [INFO ] [REMOTE ] MUX: Full fetch complete (59955 records). [2025-10-13T20:21:52.511148] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-13T20:21:52.511951] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:21:52.512046] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:21:52.512093] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:21:52.512168] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-13T20:21:52.512233] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-13T20:21:52.512269] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-13T20:21:52.512307] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-13T20:21:52.512371] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MUX took 41.0s. Estimated remaining: 2h 10m 57s. Rate: 7.1 symbols/min [2025-10-13T20:21:53.217927] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-13T20:21:54.045234] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T20:21:54.048803] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-13T20:21:54.113639] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T20:21:54.582414] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:21:54.584008] [INFO ] [REMOTE ] MVT: Full fetch complete (14210 records). [2025-10-13T20:21:54.584105] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-13T20:21:54.836367] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-13T20:21:55.027023] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-13T20:21:55.027131] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-13T20:21:55.027541] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-13T20:21:55.027623] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-13T20:21:55.028381] [DEBUG] [LOCAL ] MVT: Trimmed 14210 records to 10048 (keeping 200 days of data) [2025-10-13T20:21:55.102909] [DEBUG] [LOCAL ] MVT: Primary data saved (10048 records). [2025-10-13T20:21:55.103054] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-13T20:21:55.103142] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 27.6s. Estimated remaining: 2h 10m 44s. Rate: 7.1 symbols/min [2025-10-13T20:21:56.613729] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T20:21:56.623379] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-13T20:21:58.627938] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T20:21:58.640899] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-13T20:22:00.471707] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T20:22:00.482264] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-13T20:22:02.219312] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T20:22:02.229840] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-13T20:22:03.964049] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:22:03.975173] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-13T20:22:05.821120] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T20:22:05.831226] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-13T20:22:07.557508] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T20:22:07.567388] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-13T20:22:09.147174] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T20:22:09.156866] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-13T20:22:09.835810] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:22:09.842325] [INFO ] [REMOTE ] MWA: Full fetch complete (67330 records). [2025-10-13T20:22:09.842517] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-13T20:22:09.843436] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:22:09.843548] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:22:09.843600] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:22:09.843700] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-13T20:22:09.843784] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-13T20:22:09.843840] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-13T20:22:09.843891] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-13T20:22:09.843963] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 22.6s. Estimated remaining: 2h 10m 40s. Rate: 7.1 symbols/min [2025-10-13T20:22:10.504258] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:10.579457] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:10.579591] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-13T20:22:10.555970] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:10.580683] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:10.581021] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-13T20:22:10.580787] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-13T20:22:10.582351] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-13T20:22:10.581954] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-13T20:22:10.583110] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-13T20:22:10.583268] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-13T20:22:10.583531] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-13T20:22:10.583445] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-13T20:22:10.583825] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-13T20:22:10.584000] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-13T20:22:10.584087] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-13T20:22:10.709680] [DEBUG] [LOCAL ] MXF: Loaded 5767 existing records from primary storage. [2025-10-13T20:22:10.783760] [INFO ] [MAIN ] MXF: Loaded 5767 existing records. [2025-10-13T20:22:10.927208] [DEBUG] [LOCAL ] MX: Loaded 22681 existing records from primary storage. [2025-10-13T20:22:10.952402] [INFO ] [MAIN ] MX: Loaded 22681 existing records. [2025-10-13T20:22:11.489849] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:22:11.561293] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-13T20:22:11.597356] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-13T20:22:11.696955] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:22:11.710405] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-13T20:22:11.738224] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-13T20:22:11.743425] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:11.767023] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-13T20:22:11.767345] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-13T20:22:11.753883] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-13T20:22:11.814080] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:11.819778] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-13T20:22:11.844580] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-13T20:22:11.844876] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-13T20:22:12.530876] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T20:22:12.536113] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:12.516635] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:12.536397] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-13T20:22:12.537632] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-13T20:22:12.537893] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-13T20:22:13.070101] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:22:13.070230] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T20:22:13.071861] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-13T20:22:13.076249] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-13T20:22:13.476865] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T20:22:13.481978] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-13T20:22:13.635889] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T20:22:13.636000] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T20:22:13.637330] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-13T20:22:13.642408] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-13T20:22:14.103983] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T20:22:14.107789] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-13T20:22:14.163720] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T20:22:14.164748] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-13T20:22:14.290416] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T20:22:14.293503] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-13T20:22:14.703546] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T20:22:14.704625] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-13T20:22:14.767121] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:22:14.771078] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-13T20:22:15.045885] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T20:22:15.049832] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-13T20:22:15.198873] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T20:22:15.203004] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-13T20:22:15.350835] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T20:22:15.617894] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-13T20:22:15.911140] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T20:22:16.001320] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T20:22:16.165847] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-13T20:22:16.317146] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T20:22:16.417912] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-13T20:22:17.217902] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-13T20:22:17.287159] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T20:22:18.018006] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-13T20:22:18.345736] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T20:22:18.817928] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-13T20:22:19.268030] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T20:22:19.307575] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T20:22:19.617937] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-13T20:22:20.417949] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-13T20:22:20.778576] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T20:22:21.156229] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T20:22:21.218007] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-13T20:22:22.017907] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-13T20:22:22.028195] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T20:22:22.817943] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-13T20:22:22.863759] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T20:22:23.335199] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T20:22:23.617925] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-13T20:22:24.417948] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-13T20:22:24.528308] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:22:25.149122] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T20:22:25.217906] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-13T20:22:25.777611] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T20:22:26.018000] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-13T20:22:26.453499] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:22:26.454364] [INFO ] [REMOTE ] MXE: Full fetch complete (2618 records). [2025-10-13T20:22:26.454450] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-13T20:22:26.652698] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T20:22:26.652919] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:22:26.652967] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:22:26.653006] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-13T20:22:26.653058] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-13T20:22:26.653093] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-13T20:22:26.653138] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-13T20:22:26.653254] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 16.8s. Estimated remaining: 2h 10m 37s. Rate: 7.1 symbols/min [2025-10-13T20:22:26.817616] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:26.817808] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-13T20:22:26.817851] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-13T20:22:26.817897] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-13T20:22:26.818167] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-13T20:22:26.818237] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-13T20:22:26.818324] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-13T20:22:26.819154] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-13T20:22:27.171584] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:27.598147] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T20:22:27.617914] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-13T20:22:28.205358] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T20:22:28.417996] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-13T20:22:29.217953] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-13T20:22:29.802680] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:22:30.018019] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-13T20:22:30.449180] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T20:22:30.818062] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-13T20:22:31.161456] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T20:22:31.440486] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T20:22:31.617946] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-13T20:22:32.417899] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-13T20:22:32.788813] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T20:22:32.994762] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:22:32.995845] [INFO ] [REMOTE ] MXF: Full fetch complete (10000 records). [2025-10-13T20:22:32.995919] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-13T20:22:33.223074] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-13T20:22:33.421737] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-13T20:22:33.421823] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-13T20:22:33.422098] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-13T20:22:33.422160] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-13T20:22:33.422754] [DEBUG] [LOCAL ] MXF: Trimmed 10000 records to 5650 (keeping 200 days of data) [2025-10-13T20:22:33.461718] [DEBUG] [LOCAL ] MXF: Primary data saved (5650 records). [2025-10-13T20:22:33.461881] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-13T20:22:33.461997] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 23.6s. Estimated remaining: 2h 10m 28s. Rate: 7.1 symbols/min [2025-10-13T20:22:33.641058] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:33.641260] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-13T20:22:33.641299] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-13T20:22:33.641419] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-13T20:22:33.641460] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-13T20:22:33.641501] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-13T20:22:33.641535] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-13T20:22:34.027753] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-13T20:22:34.053085] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:34.420356] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T20:22:34.817942] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-13T20:22:34.913727] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T20:22:35.618009] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-13T20:22:35.804129] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T20:22:36.417995] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-13T20:22:36.655092] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:22:37.218000] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-13T20:22:37.769211] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T20:22:38.017925] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-13T20:22:38.305091] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T20:22:38.817947] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-13T20:22:39.316115] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T20:22:39.618169] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-13T20:22:40.235384] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T20:22:40.417958] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-13T20:22:40.729748] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T20:22:41.217982] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-13T20:22:41.701301] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:22:42.018003] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-13T20:22:42.324485] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T20:22:42.439221] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T20:22:42.441276] [INFO ] [REMOTE ] MYD: Full fetch complete (20191 records). [2025-10-13T20:22:42.441409] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-13T20:22:42.442240] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:22:42.442333] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:22:42.442378] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:22:42.442419] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-13T20:22:42.442513] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-13T20:22:42.442597] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-13T20:22:42.442677] [DEBUG] [LOCAL ] MYD: No derivative data file found to delete. [2025-10-13T20:22:42.442986] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MYD took 32.6s. Estimated remaining: 2h 10m 19s. Rate: 7.1 symbols/min [2025-10-13T20:22:42.608757] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:42.619312] [DEBUG] [LOCAL ] MYN: Loaded 9975 existing records from primary storage. [2025-10-13T20:22:42.619521] [INFO ] [MAIN ] MYN: Loaded 9975 existing records. [2025-10-13T20:22:42.796784] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:22:42.797014] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-13T20:22:42.797061] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-13T20:22:42.797394] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-13T20:22:42.797452] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-13T20:22:42.825707] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-13T20:22:43.162335] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:43.618033] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-13T20:22:44.029052] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T20:22:44.212916] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T20:22:44.417928] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-13T20:22:45.217923] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-13T20:22:45.586982] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T20:22:46.017897] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-13T20:22:46.154122] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:22:46.817925] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-13T20:22:46.979783] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T20:22:47.617986] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-13T20:22:48.133108] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T20:22:48.417907] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-13T20:22:48.462966] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T20:22:49.217936] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-13T20:22:49.269253] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:22:50.017997] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-13T20:22:50.524520] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T20:22:50.817892] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-13T20:22:51.121088] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T20:22:51.123401] [INFO ] [REMOTE ] MX: Full fetch complete (31672 records). [2025-10-13T20:22:51.123480] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-13T20:22:51.488454] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-13T20:22:51.488531] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-13T20:22:51.489155] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-13T20:22:51.489217] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-13T20:22:51.490002] [DEBUG] [LOCAL ] MX: Trimmed 31672 records to 22418 (keeping 200 days of data) [2025-10-13T20:22:51.618077] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-13T20:22:51.622254] [DEBUG] [LOCAL ] MX: Primary data saved (22418 records). [2025-10-13T20:22:51.622337] [INFO ] [MAIN ] MX: Full history saved. [2025-10-13T20:22:51.622430] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MX took 41.8s. Estimated remaining: 2h 10m 12s. Rate: 7.1 symbols/min [2025-10-13T20:22:51.806162] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:22:51.806362] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-13T20:22:51.806398] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-13T20:22:51.806532] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-13T20:22:51.806574] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-13T20:22:51.806615] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-13T20:22:51.806670] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-13T20:22:52.180899] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:22:52.417922] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-13T20:22:53.217934] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-13T20:23:08.392217] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (15.17 seconds). [2025-10-13T20:23:08.395416] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-13T20:23:09.139230] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T20:23:09.141901] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-13T20:23:09.906366] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T20:23:09.909025] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-13T20:23:10.791926] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T20:23:10.795419] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-13T20:23:10.957255] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (18.54 seconds). [2025-10-13T20:23:10.965674] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-13T20:23:11.157504] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (19.54 seconds). [2025-10-13T20:23:11.163179] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-13T20:23:11.405467] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T20:23:11.408964] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-13T20:23:11.645179] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (20.83 seconds). [2025-10-13T20:23:11.651021] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-13T20:23:12.206254] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T20:23:12.209276] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-13T20:23:12.429330] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T20:23:12.437384] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-13T20:23:12.800385] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T20:23:12.803927] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-13T20:23:12.819929] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T20:23:12.825424] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-13T20:23:12.880322] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T20:23:12.885718] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-13T20:23:13.387624] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:23:13.389416] [INFO ] [REMOTE ] MYN: Full fetch complete (15079 records). [2025-10-13T20:23:13.389494] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-13T20:23:13.803680] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-13T20:23:13.803877] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-13T20:23:13.804345] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-13T20:23:13.804422] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-13T20:23:13.805172] [DEBUG] [LOCAL ] MYN: Trimmed 15079 records to 9831 (keeping 200 days of data) [2025-10-13T20:23:13.865761] [DEBUG] [LOCAL ] MYN: Primary data saved (9831 records). [2025-10-13T20:23:13.865937] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-13T20:23:13.866083] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYN took 31.4s. Estimated remaining: 2h 10m 12s. Rate: 7.1 symbols/min [2025-10-13T20:23:13.912331] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T20:23:13.969950] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-13T20:23:14.090243] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T20:23:14.088626] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:14.098600] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-13T20:23:14.104834] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-13T20:23:14.105900] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T20:23:14.105565] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-13T20:23:14.110137] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-13T20:23:14.110204] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-13T20:23:14.110298] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-13T20:23:14.110402] [INFO ] [REMOTE ] MYE: Full fetch complete (36009 records). [2025-10-13T20:23:14.110721] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-13T20:23:14.110609] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-13T20:23:14.158440] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:14.173448] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:14.188466] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:14.199749] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-13T20:23:14.221674] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-13T20:23:14.221862] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-13T20:23:14.222296] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-13T20:23:14.228172] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 47.6s. Estimated remaining: 2h 9m 58s. Rate: 7.1 symbols/min [2025-10-13T20:23:14.636085] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:14.657786] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-13T20:23:14.695508] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-13T20:23:14.722363] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-13T20:23:14.724664] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:14.724937] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-13T20:23:14.725253] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-13T20:23:14.725431] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-13T20:23:14.726421] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-13T20:23:15.140867] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:15.141370] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-13T20:23:15.307497] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T20:23:15.313018] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-13T20:23:15.779877] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T20:23:15.781848] [INFO ] [REMOTE ] MYI: Full fetch complete (28616 records). [2025-10-13T20:23:15.782015] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-13T20:23:15.782451] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:15.782535] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:15.782577] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:15.782663] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-13T20:23:15.782740] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-13T20:23:15.782776] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-13T20:23:15.782815] [DEBUG] [LOCAL ] MYI: No derivative data file found to delete. [2025-10-13T20:23:15.782867] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 42.3s. Estimated remaining: 2h 9m 46s. Rate: 7.1 symbols/min [2025-10-13T20:23:15.977250] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T20:23:15.981498] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:15.991073] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-13T20:23:15.991477] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-13T20:23:15.992664] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-13T20:23:15.992792] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-13T20:23:15.992836] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-13T20:23:15.992883] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-13T20:23:15.992917] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-13T20:23:16.388633] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:23:16.387385] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:16.395522] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-13T20:23:16.395819] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-13T20:23:16.422461] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T20:23:16.431248] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-13T20:23:17.437944] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:23:17.441298] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-13T20:23:17.633261] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:23:17.638671] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-13T20:23:17.723457] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T20:23:17.733757] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-13T20:23:17.785562] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T20:23:17.793062] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-13T20:23:18.276036] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T20:23:18.278621] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-13T20:23:18.453403] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T20:23:18.458460] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-13T20:23:19.155288] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T20:23:19.166418] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T20:23:19.169997] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-13T20:23:19.171492] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-13T20:23:19.359798] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T20:23:19.369429] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-13T20:23:19.690131] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T20:23:19.696054] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-13T20:23:20.043271] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:23:20.046435] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-13T20:23:20.587293] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T20:23:20.594613] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-13T20:23:20.853162] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T20:23:20.938790] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T20:23:21.006843] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T20:23:21.218112] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-13T20:23:22.018015] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-13T20:23:22.254393] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T20:23:22.785184] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T20:23:22.817884] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-13T20:23:23.302769] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:23:23.617946] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-13T20:23:24.377223] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T20:23:24.417957] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-13T20:23:24.536616] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T20:23:25.218026] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-13T20:23:25.645432] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T20:23:26.017924] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-13T20:23:26.707838] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T20:23:26.817999] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-13T20:23:27.236555] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T20:23:27.300876] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T20:23:27.617980] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-13T20:23:28.417958] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-13T20:23:29.161453] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T20:23:29.217902] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-13T20:23:29.302941] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T20:23:30.006277] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:23:30.010728] [INFO ] [REMOTE ] NABL: Full fetch complete (56617 records). [2025-10-13T20:23:30.010872] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-13T20:23:30.012111] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:30.012203] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:30.012247] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:30.012288] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-13T20:23:30.012354] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-13T20:23:30.012393] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-13T20:23:30.012431] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-13T20:23:30.012494] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 38.4s. Estimated remaining: 2h 9m 41s. Rate: 7.1 symbols/min [2025-10-13T20:23:30.024320] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-13T20:23:30.215375] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:30.264614] [DEBUG] [LOCAL ] NAT: Loaded 49886 existing records from primary storage. [2025-10-13T20:23:30.265119] [INFO ] [MAIN ] NAT: Loaded 49886 existing records. [2025-10-13T20:23:30.483545] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:23:30.483860] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-13T20:23:30.483918] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-13T20:23:30.485032] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-13T20:23:30.485092] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-13T20:23:30.823128] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-13T20:23:30.886046] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:30.895006] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T20:23:31.617957] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-13T20:23:32.332623] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T20:23:32.354944] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T20:23:32.418072] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-13T20:23:32.852945] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-13T20:23:32.854486] [INFO ] [REMOTE ] NAN: Full fetch complete (13470 records). [2025-10-13T20:23:32.854579] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-13T20:23:32.855215] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:32.855469] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:32.855514] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:32.855581] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-13T20:23:32.855669] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-13T20:23:32.855731] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-13T20:23:32.855776] [DEBUG] [LOCAL ] NAN: No derivative data file found to delete. [2025-10-13T20:23:32.855842] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAN took 17.1s. Estimated remaining: 2h 9m 29s. Rate: 7.1 symbols/min [2025-10-13T20:23:33.054012] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:33.054227] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-13T20:23:33.054340] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-13T20:23:33.054449] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-13T20:23:33.054501] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-13T20:23:33.054558] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-13T20:23:33.054619] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-13T20:23:33.232572] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-13T20:23:33.441600] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:34.017946] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-13T20:23:34.562746] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T20:23:34.818010] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-13T20:23:35.470820] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T20:23:35.617949] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-13T20:23:36.232035] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T20:23:36.417946] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-13T20:23:37.222689] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-13T20:23:37.227836] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T20:23:38.017934] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-13T20:23:38.393446] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T20:23:38.493679] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T20:23:38.817987] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-13T20:23:39.221882] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T20:23:39.618028] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-13T20:23:40.159339] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:23:40.164767] [INFO ] [REMOTE ] NAC: Full fetch complete (35450 records). [2025-10-13T20:23:40.164945] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-13T20:23:40.165745] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:40.165838] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:40.165882] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:40.165924] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-13T20:23:40.165994] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-13T20:23:40.166032] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-13T20:23:40.166130] [DEBUG] [LOCAL ] NAC: No derivative data file found to delete. [2025-10-13T20:23:40.166238] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAC took 26.3s. Estimated remaining: 2h 9m 20s. Rate: 7.1 symbols/min [2025-10-13T20:23:40.353826] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:40.359453] [DEBUG] [LOCAL ] NAZ: Loaded 2677 existing records from primary storage. [2025-10-13T20:23:40.359730] [INFO ] [MAIN ] NAZ: Loaded 2677 existing records. [2025-10-13T20:23:40.429747] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-13T20:23:40.575468] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:23:40.597726] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:23:40.608877] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-13T20:23:40.609009] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-13T20:23:40.610038] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-13T20:23:40.610105] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-13T20:23:41.000213] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:41.218013] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-13T20:23:41.918459] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T20:23:42.017900] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-13T20:23:42.418528] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T20:23:42.817954] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-13T20:23:43.617952] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-13T20:23:43.740529] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T20:23:44.230439] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T20:23:44.257380] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:23:44.260992] [INFO ] [REMOTE ] NAD: Full fetch complete (48892 records). [2025-10-13T20:23:44.261102] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-13T20:23:44.261912] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:23:44.262004] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:23:44.262051] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:23:44.262092] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-13T20:23:44.262164] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-13T20:23:44.262236] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-13T20:23:44.262296] [DEBUG] [LOCAL ] NAD: No derivative data file found to delete. [2025-10-13T20:23:44.262378] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAD took 30.0s. Estimated remaining: 2h 9m 9s. Rate: 7.1 symbols/min [2025-10-13T20:23:44.419402] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-13T20:23:44.442801] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:23:44.454625] [DEBUG] [LOCAL ] NBB: Loaded 9169 existing records from primary storage. [2025-10-13T20:23:44.455454] [INFO ] [MAIN ] NBB: Loaded 9169 existing records. [2025-10-13T20:23:44.651350] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:23:44.651678] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-13T20:23:44.651782] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-13T20:23:44.652300] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-13T20:23:44.652540] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-13T20:23:45.045177] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:23:45.149793] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T20:23:45.217921] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-13T20:23:46.017998] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-13T20:23:46.237226] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T20:23:46.637627] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T20:23:46.817945] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-13T20:23:47.617943] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-13T20:23:47.737928] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:23:48.417947] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-13T20:23:49.023244] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T20:23:49.023759] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T20:23:49.217955] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-13T20:23:49.892864] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T20:23:50.017985] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-13T20:23:50.563917] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T20:23:50.817942] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-13T20:23:51.358238] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T20:23:51.617988] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-13T20:23:52.417960] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-13T20:23:52.430549] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T20:23:53.217954] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-13T20:23:53.768422] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T20:23:53.880548] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T20:23:54.018039] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-13T20:23:54.817921] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-13T20:23:54.865321] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T20:23:55.342214] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T20:23:55.617989] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-13T20:23:56.244729] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T20:23:56.417928] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-13T20:23:57.218027] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-13T20:23:58.018167] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-13T20:23:58.018086] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T20:23:58.351588] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T20:23:58.619856] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T20:23:58.817983] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-13T20:23:59.617955] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-13T20:23:59.670772] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:24:00.418033] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-13T20:24:01.067578] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T20:24:01.217939] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-13T20:24:01.980364] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T20:24:02.018042] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-13T20:24:02.249861] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T20:24:02.450401] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-13T20:24:02.451520] [INFO ] [REMOTE ] NAZ: Full fetch complete (4236 records). [2025-10-13T20:24:02.451590] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-13T20:24:02.825364] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-13T20:24:02.834951] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-13T20:24:02.835061] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-13T20:24:02.835307] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-13T20:24:02.835353] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-13T20:24:02.836041] [DEBUG] [LOCAL ] NAZ: Trimmed 4236 records to 2646 (keeping 200 days of data) [2025-10-13T20:24:02.853936] [DEBUG] [LOCAL ] NAZ: Primary data saved (2646 records). [2025-10-13T20:24:02.854034] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-13T20:24:02.854126] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAZ took 22.7s. Estimated remaining: 2h 9m 7s. Rate: 7.1 symbols/min [2025-10-13T20:24:03.030683] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:03.030996] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-13T20:24:03.031041] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-13T20:24:03.031170] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-13T20:24:03.031213] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-13T20:24:03.031255] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-13T20:24:03.031289] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-13T20:24:03.400782] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:03.618004] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-13T20:24:04.363508] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T20:24:04.417992] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-13T20:24:04.470952] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T20:24:05.217933] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-13T20:24:05.969967] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T20:24:06.018013] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-13T20:24:06.817989] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-13T20:24:07.011303] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T20:24:07.088140] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T20:24:07.617945] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-13T20:24:08.036911] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T20:24:08.108606] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T20:24:08.112883] [INFO ] [REMOTE ] NATL: Full fetch complete (45059 records). [2025-10-13T20:24:08.113070] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-13T20:24:08.114083] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:24:08.114200] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:24:08.114275] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:24:08.114358] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-13T20:24:08.114446] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-13T20:24:08.114499] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-13T20:24:08.114554] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-13T20:24:08.114634] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NATL took 35.3s. Estimated remaining: 2h 8m 56s. Rate: 7.1 symbols/min [2025-10-13T20:24:08.296508] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:08.296817] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-13T20:24:08.296920] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-13T20:24:08.297022] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-13T20:24:08.297087] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-13T20:24:08.297143] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-13T20:24:08.297195] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-13T20:24:08.423062] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-13T20:24:08.677765] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:09.153972] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T20:24:09.217918] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-13T20:24:10.017921] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-13T20:24:10.817909] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-13T20:24:10.936982] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T20:24:11.234097] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T20:24:11.618013] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-13T20:24:12.255749] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T20:24:12.418032] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-13T20:24:12.673268] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T20:24:13.217960] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-13T20:24:14.018022] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-13T20:24:14.113580] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:24:14.525709] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T20:24:14.602788] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T20:24:14.817944] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-13T20:24:15.617958] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-13T20:24:15.637018] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:24:15.638754] [INFO ] [REMOTE ] NBB: Full fetch complete (13644 records). [2025-10-13T20:24:15.638852] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-13T20:24:16.022134] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-13T20:24:16.022241] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-13T20:24:16.022760] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-13T20:24:16.022828] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-13T20:24:16.023617] [DEBUG] [LOCAL ] NBB: Trimmed 13644 records to 9057 (keeping 200 days of data) [2025-10-13T20:24:16.085172] [DEBUG] [LOCAL ] NBB: Primary data saved (9057 records). [2025-10-13T20:24:16.085375] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-13T20:24:16.085485] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NBB took 31.8s. Estimated remaining: 2h 8m 47s. Rate: 7.1 symbols/min [2025-10-13T20:24:16.273560] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:16.273865] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-13T20:24:16.273908] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-13T20:24:16.274033] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-13T20:24:16.274074] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-13T20:24:16.274116] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-13T20:24:16.274190] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-13T20:24:16.426138] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-13T20:24:16.674016] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:17.129015] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T20:24:17.217896] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-13T20:24:18.017926] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-13T20:24:18.318937] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T20:24:18.732384] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T20:24:18.817918] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-13T20:24:19.196348] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T20:24:19.617953] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-13T20:24:20.347482] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T20:24:20.417896] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-13T20:24:21.217925] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-13T20:24:21.272293] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T20:24:21.897893] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:24:22.017915] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-13T20:24:22.359123] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T20:24:22.817903] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-13T20:24:23.009353] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T20:24:23.617927] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-13T20:24:24.007056] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T20:24:24.418023] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-13T20:24:25.133324] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T20:24:25.217924] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-13T20:24:25.509062] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T20:24:26.017929] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-13T20:24:26.763182] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T20:24:26.817949] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-13T20:24:27.217810] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T20:24:27.617982] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-13T20:24:28.417951] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-13T20:24:28.743473] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T20:24:28.794279] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T20:24:29.217997] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-13T20:24:29.916964] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T20:24:30.017939] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-13T20:24:30.462433] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T20:24:30.817947] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-13T20:24:31.385052] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T20:24:31.617955] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-13T20:24:32.092948] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T20:24:32.155007] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:24:32.159835] [INFO ] [REMOTE ] NBR: Full fetch complete (49065 records). [2025-10-13T20:24:32.160035] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-13T20:24:32.161603] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:24:32.161906] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:24:32.161993] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:24:32.162082] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-13T20:24:32.162182] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-13T20:24:32.162241] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-13T20:24:32.162287] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-13T20:24:32.162368] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBR took 24.0s. Estimated remaining: 2h 8m 44s. Rate: 7.1 symbols/min [2025-10-13T20:24:32.438679] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:32.426772] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-13T20:24:32.445218] [DEBUG] [LOCAL ] NC: Loaded 1965 existing records from primary storage. [2025-10-13T20:24:32.445572] [INFO ] [MAIN ] NC: Loaded 1965 existing records. [2025-10-13T20:24:32.737370] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:24:32.737741] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-13T20:24:32.737820] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-13T20:24:32.738166] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-13T20:24:32.738244] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-13T20:24:33.185901] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:33.217914] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-13T20:24:34.017919] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-13T20:24:34.108262] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T20:24:34.116176] [INFO ] [REMOTE ] NAT: Full fetch complete (72072 records). [2025-10-13T20:24:34.116329] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-13T20:24:34.554841] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-13T20:24:34.555037] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-13T20:24:34.561992] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-13T20:24:34.558917] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T20:24:34.563635] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-13T20:24:34.566684] [DEBUG] [LOCAL ] NAT: Trimmed 72072 records to 49203 (keeping 200 days of data) [2025-10-13T20:24:34.699108] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:24:34.833947] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-13T20:24:34.935661] [DEBUG] [LOCAL ] NAT: Primary data saved (49203 records). [2025-10-13T20:24:34.935860] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-13T20:24:34.935966] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NAT took 1m 5s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-13T20:24:35.125493] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:35.139004] [DEBUG] [LOCAL ] NCA: Loaded 10086 existing records from primary storage. [2025-10-13T20:24:35.139335] [INFO ] [MAIN ] NCA: Loaded 10086 existing records. [2025-10-13T20:24:35.328799] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:24:35.329146] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-13T20:24:35.329202] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-13T20:24:35.329550] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-13T20:24:35.329608] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-13T20:24:35.621723] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-13T20:24:35.712023] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:35.767196] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T20:24:36.254915] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T20:24:36.417999] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-13T20:24:37.013986] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T20:24:37.217931] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-13T20:24:37.792718] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T20:24:38.018008] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-13T20:24:38.817927] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-13T20:24:39.066351] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T20:24:39.507139] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T20:24:39.617906] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-13T20:24:40.359224] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T20:24:40.417924] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-13T20:24:41.217907] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-13T20:24:41.337744] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:24:42.017916] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-13T20:24:42.438373] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T20:24:42.817904] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-13T20:24:42.890614] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T20:24:43.617957] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-13T20:24:44.015311] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T20:24:44.065051] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T20:24:44.417904] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-13T20:24:45.217930] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-13T20:24:45.641346] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-13T20:24:45.822377] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T20:24:46.017927] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-13T20:24:46.817925] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-13T20:24:46.968515] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T20:24:47.310548] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T20:24:47.617919] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-13T20:24:48.148719] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T20:24:48.418011] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-13T20:24:48.925857] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T20:24:49.217936] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-13T20:24:49.747785] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:24:49.748905] [INFO ] [REMOTE ] NC: Full fetch complete (2751 records). [2025-10-13T20:24:49.748979] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-13T20:24:50.023301] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-13T20:24:50.118886] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-13T20:24:50.119052] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-13T20:24:50.119193] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-13T20:24:50.119236] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-13T20:24:50.119630] [DEBUG] [LOCAL ] NC: Trimmed 2751 records to 1951 (keeping 200 days of data) [2025-10-13T20:24:50.132679] [DEBUG] [LOCAL ] NC: Primary data saved (1951 records). [2025-10-13T20:24:50.132818] [INFO ] [MAIN ] NC: Full history saved. [2025-10-13T20:24:50.132906] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NC took 18.0s. Estimated remaining: 2h 8m 28s. Rate: 7.1 symbols/min [2025-10-13T20:24:50.314102] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:50.314277] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-13T20:24:50.314315] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-13T20:24:50.314532] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-13T20:24:50.314617] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-13T20:24:50.314714] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-13T20:24:50.314760] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-13T20:24:50.670278] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:50.817939] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-13T20:24:51.225018] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T20:24:51.618032] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-13T20:24:52.194077] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:24:52.417909] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-13T20:24:52.547921] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T20:24:52.897019] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T20:24:52.900067] [INFO ] [REMOTE ] NBHC: Full fetch complete (32459 records). [2025-10-13T20:24:52.900177] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-13T20:24:52.900738] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:24:52.900822] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:24:52.900866] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:24:52.900903] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-13T20:24:52.900959] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-13T20:24:52.900994] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-13T20:24:52.901032] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-13T20:24:52.901086] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NBHC took 50.0s. Estimated remaining: 2h 8m 16s. Rate: 7.1 symbols/min [2025-10-13T20:24:53.068494] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:24:53.068723] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-13T20:24:53.068777] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-13T20:24:53.068886] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-13T20:24:53.068927] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-13T20:24:53.068966] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-13T20:24:53.068998] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-13T20:24:53.223311] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-13T20:24:53.444330] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:24:54.017929] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-13T20:24:54.516102] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T20:24:54.817996] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-13T20:24:55.617954] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-13T20:24:55.928058] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T20:24:56.195431] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-13T20:24:56.417878] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-13T20:24:56.553940] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T20:24:57.217907] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-13T20:24:58.018006] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-13T20:24:58.139561] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T20:24:58.260111] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T20:24:58.817946] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-13T20:24:59.255748] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T20:24:59.617905] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-13T20:25:00.416699] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T20:25:00.426424] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-13T20:25:00.796136] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T20:25:01.221191] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-13T20:25:01.222093] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:25:01.225394] [INFO ] [REMOTE ] NBXG: Full fetch complete (32424 records). [2025-10-13T20:25:01.225570] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-13T20:25:01.226437] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:25:01.226679] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:25:01.226755] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:25:01.226841] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-13T20:25:01.226918] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-13T20:25:01.226966] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-13T20:25:01.227022] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-13T20:25:01.227318] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 45.1s. Estimated remaining: 2h 8m 7s. Rate: 7.1 symbols/min [2025-10-13T20:25:01.404546] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:01.420177] [DEBUG] [LOCAL ] NCV: Loaded 14204 existing records from primary storage. [2025-10-13T20:25:01.420391] [INFO ] [MAIN ] NCV: Loaded 14204 existing records. [2025-10-13T20:25:01.595920] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:25:01.596164] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-13T20:25:01.596210] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-13T20:25:01.596708] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-13T20:25:01.596792] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-13T20:25:01.991431] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:02.017899] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-13T20:25:02.044444] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T20:25:02.817926] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-13T20:25:03.309490] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T20:25:03.617940] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-13T20:25:04.417947] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-13T20:25:04.841534] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T20:25:05.180401] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T20:25:05.217885] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-13T20:25:05.582382] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-13T20:25:06.017891] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-13T20:25:06.418971] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T20:25:06.818020] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-13T20:25:07.617949] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-13T20:25:07.794744] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:25:08.248920] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T20:25:08.302778] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T20:25:08.417914] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-13T20:25:09.218024] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-13T20:25:10.017951] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-13T20:25:10.393307] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T20:25:10.416991] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T20:25:10.693918] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:25:10.695139] [INFO ] [REMOTE ] NCA: Full fetch complete (14815 records). [2025-10-13T20:25:10.695207] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-13T20:25:10.830602] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-13T20:25:11.053347] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-13T20:25:11.053422] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-13T20:25:11.053794] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-13T20:25:11.053854] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-13T20:25:11.054372] [DEBUG] [LOCAL ] NCA: Trimmed 14815 records to 9998 (keeping 200 days of data) [2025-10-13T20:25:11.119357] [DEBUG] [LOCAL ] NCA: Primary data saved (9998 records). [2025-10-13T20:25:11.119492] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-13T20:25:11.119582] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 36.2s. Estimated remaining: 2h 7m 60s. Rate: 7.1 symbols/min [2025-10-13T20:25:11.283072] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:11.295670] [DEBUG] [LOCAL ] NCZ: Loaded 12549 existing records from primary storage. [2025-10-13T20:25:11.295877] [INFO ] [MAIN ] NCZ: Loaded 12549 existing records. [2025-10-13T20:25:11.467042] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:25:11.467265] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-13T20:25:11.467310] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-13T20:25:11.467709] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-13T20:25:11.467768] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-13T20:25:11.622990] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-13T20:25:11.825470] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:12.417958] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-13T20:25:12.771551] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T20:25:13.075528] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-13T20:25:13.196616] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T20:25:13.217892] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-13T20:25:14.017945] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-13T20:25:14.491871] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T20:25:14.817922] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-13T20:25:15.021916] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T20:25:15.617916] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-13T20:25:15.864519] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T20:25:16.417930] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-13T20:25:16.664510] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T20:25:17.217861] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-13T20:25:17.558524] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T20:25:18.017907] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-13T20:25:18.264363] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T20:25:18.817931] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-13T20:25:19.617907] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-13T20:25:19.862264] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T20:25:20.138712] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:25:20.418006] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-13T20:25:20.584146] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T20:25:21.217918] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-13T20:25:22.017918] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-13T20:25:22.199712] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T20:25:22.528574] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T20:25:22.817930] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-13T20:25:22.885088] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T20:25:23.450125] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T20:25:23.617926] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-13T20:25:24.271305] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:25:24.274540] [INFO ] [REMOTE ] NCDL: Full fetch complete (32769 records). [2025-10-13T20:25:24.274708] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-13T20:25:24.275261] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:25:24.275365] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:25:24.275441] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:25:24.275514] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-13T20:25:24.275588] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-13T20:25:24.275626] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-13T20:25:24.275711] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-13T20:25:24.275783] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 34.1s. Estimated remaining: 2h 7m 54s. Rate: 7.1 symbols/min [2025-10-13T20:25:24.421714] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-13T20:25:24.452984] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:24.454092] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-13T20:25:24.454139] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-13T20:25:24.454287] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-13T20:25:24.454346] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-13T20:25:24.454418] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-13T20:25:24.454453] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-13T20:25:24.833616] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:25.218019] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-13T20:25:25.547599] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:25:26.018053] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-13T20:25:26.817945] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-13T20:25:26.835133] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T20:25:27.401595] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T20:25:27.617950] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-13T20:25:28.074545] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T20:25:28.417948] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-13T20:25:28.522491] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:25:29.217933] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-13T20:25:29.370201] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T20:25:29.856235] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:25:29.862977] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-13T20:25:29.863116] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-13T20:25:29.863967] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:25:29.864139] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:25:29.864215] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:25:29.864295] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-13T20:25:29.864379] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-13T20:25:29.864430] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-13T20:25:29.864484] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-13T20:25:29.864558] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 37.0s. Estimated remaining: 2h 7m 44s. Rate: 7.1 symbols/min [2025-10-13T20:25:30.037571] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-13T20:25:30.040946] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:30.042082] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-13T20:25:30.042133] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-13T20:25:30.042238] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-13T20:25:30.042278] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-13T20:25:30.042319] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-13T20:25:30.042358] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-13T20:25:30.409365] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:30.817952] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-13T20:25:31.161636] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:25:31.617953] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-13T20:25:32.417900] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-13T20:25:32.474880] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:25:32.497092] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T20:25:33.217931] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-13T20:25:33.492978] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T20:25:34.017928] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-13T20:25:34.720958] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:25:34.817941] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-13T20:25:34.827170] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T20:25:35.617937] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-13T20:25:36.417930] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-13T20:25:36.526596] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:25:36.629820] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T20:25:37.217923] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-13T20:25:37.317567] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T20:25:37.319940] [INFO ] [REMOTE ] NCV: Full fetch complete (22531 records). [2025-10-13T20:25:37.320011] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-13T20:25:37.686137] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-13T20:25:37.686255] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-13T20:25:37.686771] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-13T20:25:37.686832] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-13T20:25:37.687707] [DEBUG] [LOCAL ] NCV: Trimmed 22531 records to 14007 (keeping 200 days of data) [2025-10-13T20:25:37.774870] [DEBUG] [LOCAL ] NCV: Primary data saved (14007 records). [2025-10-13T20:25:37.775025] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-13T20:25:37.775108] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 36.5s. Estimated remaining: 2h 7m 35s. Rate: 7.1 symbols/min [2025-10-13T20:25:37.942931] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:37.943087] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-13T20:25:37.943123] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-13T20:25:37.943235] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-13T20:25:37.943275] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-13T20:25:37.943314] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-13T20:25:37.943345] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-13T20:25:38.022077] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-13T20:25:38.300807] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:38.315244] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T20:25:38.817940] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-13T20:25:39.617926] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-13T20:25:39.846323] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T20:25:40.417954] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-13T20:25:40.527802] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:25:40.569568] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T20:25:41.217951] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-13T20:25:41.375604] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T20:25:42.017916] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-13T20:25:42.817942] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-13T20:25:43.154727] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T20:25:43.458839] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T20:25:43.473810] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T20:25:43.477174] [INFO ] [REMOTE ] NCZ: Full fetch complete (21184 records). [2025-10-13T20:25:43.477261] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-13T20:25:43.625818] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-13T20:25:43.863145] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-13T20:25:43.863238] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-13T20:25:43.863778] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-13T20:25:43.863842] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-13T20:25:43.864564] [DEBUG] [LOCAL ] NCZ: Trimmed 21184 records to 12406 (keeping 200 days of data) [2025-10-13T20:25:43.941844] [DEBUG] [LOCAL ] NCZ: Primary data saved (12406 records). [2025-10-13T20:25:43.941984] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-13T20:25:43.942063] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 32.8s. Estimated remaining: 2h 7m 25s. Rate: 7.1 symbols/min [2025-10-13T20:25:44.110293] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:44.110464] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-13T20:25:44.110504] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-13T20:25:44.110622] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-13T20:25:44.110698] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-13T20:25:44.110755] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-13T20:25:44.110790] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-13T20:25:44.432458] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-13T20:25:44.477891] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:45.185296] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T20:25:45.217874] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-13T20:25:45.429214] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T20:25:46.017944] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-13T20:25:46.423244] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T20:25:46.817931] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-13T20:25:47.617927] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-13T20:25:47.880721] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T20:25:47.962630] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T20:25:48.417921] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-13T20:25:49.127571] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T20:25:49.217940] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-13T20:25:49.900603] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T20:25:50.017940] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-13T20:25:50.623035] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:25:50.817992] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-13T20:25:51.464587] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T20:25:51.618013] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-13T20:25:52.417961] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-13T20:25:52.761870] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T20:25:52.910103] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T20:25:53.217998] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-13T20:25:53.830368] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T20:25:54.017953] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-13T20:25:54.270831] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T20:25:54.817936] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-13T20:25:55.198301] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T20:25:55.200539] [INFO ] [REMOTE ] NDMO: Full fetch complete (23809 records). [2025-10-13T20:25:55.200624] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-13T20:25:55.201348] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:25:55.201429] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:25:55.201496] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:25:55.201570] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-13T20:25:55.201669] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-13T20:25:55.201730] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-13T20:25:55.201789] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-13T20:25:55.201872] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NDMO took 30.9s. Estimated remaining: 2h 7m 19s. Rate: 7.1 symbols/min [2025-10-13T20:25:55.430833] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:25:55.431129] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-13T20:25:55.431208] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-13T20:25:55.431444] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-13T20:25:55.431562] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-13T20:25:55.431696] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-13T20:25:55.431926] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-13T20:25:55.618506] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-13T20:25:55.819614] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:25:55.856520] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T20:25:56.417983] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-13T20:25:57.217935] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-13T20:25:57.930348] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-13T20:25:58.017932] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-13T20:25:58.324728] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T20:25:58.375721] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T20:25:58.817936] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-13T20:25:59.617914] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-13T20:25:59.678077] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:26:00.417960] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-13T20:26:00.436978] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:26:00.442021] [INFO ] [REMOTE ] NE: Full fetch complete (75150 records). [2025-10-13T20:26:00.442151] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-13T20:26:00.442903] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:00.442989] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:00.443032] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:00.443072] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-13T20:26:00.443129] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-13T20:26:00.443164] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-13T20:26:00.443203] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-13T20:26:00.443260] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NE took 30.6s. Estimated remaining: 2h 7m 8s. Rate: 7.1 symbols/min [2025-10-13T20:26:00.631248] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:00.631784] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-13T20:26:00.631937] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-13T20:26:00.632185] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-13T20:26:00.632434] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-13T20:26:00.632607] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-13T20:26:00.632697] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-13T20:26:00.987584] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:01.020466] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-13T20:26:01.217989] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-13T20:26:02.018007] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-13T20:26:02.527267] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T20:26:02.818053] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-13T20:26:03.493440] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T20:26:03.618015] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-13T20:26:03.897057] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T20:26:04.229053] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T20:26:04.417955] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-13T20:26:05.217984] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-13T20:26:05.690235] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T20:26:06.017927] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-13T20:26:06.582049] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T20:26:06.818037] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-13T20:26:07.431968] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-13T20:26:07.548498] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T20:26:07.617953] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-13T20:26:07.728338] [DEBUG] [REMOTE ] NET: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T20:26:07.728842] [WARN ] [REMOTE ] NET: No data returned for month 2025-02 [2025-10-13T20:26:07.728977] [FATAL] [REMOTE ] NET: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:26:07.729081] [FATAL] [MAIN ] NET: Failed to fetch primary data. [2025-10-13T20:26:07.729147] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:26:07.729234] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-13T20:26:07.729328] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-13T20:26:07.729420] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-13T20:26:07.729491] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-13T20:26:07.729553] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NET took 7.3s. Estimated remaining: 2h 6m 59s. Rate: 7.1 symbols/min [2025-10-13T20:26:07.911922] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:07.912182] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-13T20:26:07.912236] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-13T20:26:07.912366] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-13T20:26:07.912410] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-13T20:26:07.912464] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-13T20:26:07.912504] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-13T20:26:08.282749] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:08.417987] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-13T20:26:08.832175] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T20:26:08.836502] [INFO ] [REMOTE ] NEA: Full fetch complete (51138 records). [2025-10-13T20:26:08.836810] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-13T20:26:08.837836] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:08.867148] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:08.883034] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:08.886913] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-13T20:26:08.887026] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-13T20:26:08.887187] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-13T20:26:08.887477] [DEBUG] [LOCAL ] NEA: No derivative data file found to delete. [2025-10-13T20:26:08.888233] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEA took 31.1s. Estimated remaining: 2h 6m 46s. Rate: 7.1 symbols/min [2025-10-13T20:26:08.890822] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T20:26:09.102410] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:09.109171] [DEBUG] [LOCAL ] NEXA: Loaded 4821 existing records from primary storage. [2025-10-13T20:26:09.109376] [INFO ] [MAIN ] NEXA: Loaded 4821 existing records. [2025-10-13T20:26:09.223070] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-13T20:26:09.309326] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:26:09.309585] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-13T20:26:09.309635] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-13T20:26:09.309971] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-13T20:26:09.310035] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-13T20:26:09.664232] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:10.017946] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-13T20:26:10.818019] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-13T20:26:11.494535] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T20:26:11.617904] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-13T20:26:11.650053] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T20:26:12.311002] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-13T20:26:12.417921] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-13T20:26:13.218029] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-13T20:26:14.030336] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-13T20:26:14.041992] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-13T20:26:14.054551] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T20:26:14.723080] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-13T20:26:14.818010] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-13T20:26:14.916335] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T20:26:15.617923] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-13T20:26:16.417950] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-13T20:26:17.017196] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-13T20:26:17.149304] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T20:26:17.218048] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-13T20:26:17.747024] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-13T20:26:18.017954] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-13T20:26:18.063207] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:26:18.817986] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-13T20:26:19.618028] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-13T20:26:20.022717] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T20:26:20.273944] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T20:26:20.417933] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-13T20:26:21.217929] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-13T20:26:21.301867] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-13T20:26:21.875567] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T20:26:22.017922] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-13T20:26:22.756280] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-13T20:26:22.774680] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T20:26:22.817908] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-13T20:26:23.376852] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T20:26:23.381872] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-13T20:26:23.382021] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-13T20:26:23.382907] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:23.383036] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:23.383079] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:23.383122] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-13T20:26:23.383178] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-13T20:26:23.383212] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-13T20:26:23.383271] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-13T20:26:23.383349] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 39.4s. Estimated remaining: 2h 6m 42s. Rate: 7.1 symbols/min [2025-10-13T20:26:23.575102] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:23.575431] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-13T20:26:23.575508] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-13T20:26:23.575639] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-13T20:26:23.575718] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-13T20:26:23.575771] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-13T20:26:23.575804] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-13T20:26:23.623143] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-13T20:26:23.993009] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:24.374924] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T20:26:24.417897] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-13T20:26:25.217929] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-13T20:26:25.744691] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-13T20:26:25.795935] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:26:26.017932] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-13T20:26:26.649855] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T20:26:26.817939] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-13T20:26:27.617901] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-13T20:26:27.693767] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T20:26:28.417922] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-13T20:26:29.008382] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T20:26:29.217944] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-13T20:26:29.719588] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-13T20:26:29.762687] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T20:26:30.017913] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-13T20:26:30.817942] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-13T20:26:30.906553] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T20:26:31.617930] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-13T20:26:32.390042] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:26:32.391774] [INFO ] [REMOTE ] NEXA: Full fetch complete (7908 records). [2025-10-13T20:26:32.391843] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-13T20:26:32.423100] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-13T20:26:32.750506] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-13T20:26:32.750587] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-13T20:26:32.750806] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-13T20:26:32.750867] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-13T20:26:32.751252] [DEBUG] [LOCAL ] NEXA: Trimmed 7908 records to 4997 (keeping 200 days of data) [2025-10-13T20:26:32.779262] [DEBUG] [LOCAL ] NEXA: Primary data saved (4997 records). [2025-10-13T20:26:32.779365] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-13T20:26:32.779441] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEXA took 23.9s. Estimated remaining: 2h 6m 34s. Rate: 7.1 symbols/min [2025-10-13T20:26:32.950183] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:32.950349] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-13T20:26:32.950387] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-13T20:26:32.950499] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-13T20:26:32.950541] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-13T20:26:32.950582] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-13T20:26:32.950615] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-13T20:26:33.219534] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-13T20:26:33.306232] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T20:26:33.338954] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:33.373211] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-13T20:26:34.017925] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-13T20:26:34.817952] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-13T20:26:34.859918] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T20:26:35.256922] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T20:26:35.523409] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:26:35.528560] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-13T20:26:35.528741] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-13T20:26:35.529452] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:35.529537] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:35.529579] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:35.529617] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-13T20:26:35.529706] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-13T20:26:35.529757] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-13T20:26:35.529799] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-13T20:26:35.529858] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEM took 40.3s. Estimated remaining: 2h 6m 22s. Rate: 7.1 symbols/min [2025-10-13T20:26:35.625367] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-13T20:26:35.700209] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:35.700373] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-13T20:26:35.700417] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-13T20:26:35.700527] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-13T20:26:35.700566] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-13T20:26:35.700606] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-13T20:26:35.700639] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-13T20:26:36.048136] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:36.417940] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-13T20:26:36.893910] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T20:26:37.217941] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-13T20:26:38.017900] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-13T20:26:38.125860] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:26:38.357918] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T20:26:38.817943] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-13T20:26:39.099110] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T20:26:39.617952] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-13T20:26:39.904633] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T20:26:40.418005] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-13T20:26:41.217908] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-13T20:26:41.308887] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T20:26:41.357089] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T20:26:42.017922] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-13T20:26:42.615240] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T20:26:42.817928] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-13T20:26:43.617903] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-13T20:26:43.689111] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T20:26:43.759623] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T20:26:44.417905] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-13T20:26:44.556274] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T20:26:45.217992] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-13T20:26:45.893339] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:26:46.017911] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-13T20:26:46.386312] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T20:26:46.817909] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-13T20:26:46.898347] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T20:26:47.617927] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-13T20:26:48.066194] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T20:26:48.068824] [INFO ] [REMOTE ] NEU: Full fetch complete (10699 records). [2025-10-13T20:26:48.069072] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-13T20:26:48.070030] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:48.070225] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:48.070271] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:48.070313] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-13T20:26:48.070372] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-13T20:26:48.070407] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-13T20:26:48.070446] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-13T20:26:48.070514] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEU took 40.3s. Estimated remaining: 2h 6m 16s. Rate: 7.1 symbols/min [2025-10-13T20:26:48.246316] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:48.275737] [DEBUG] [LOCAL ] NGL: Loaded 30298 existing records from primary storage. [2025-10-13T20:26:48.276024] [INFO ] [MAIN ] NGL: Loaded 30298 existing records. [2025-10-13T20:26:48.427397] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-13T20:26:48.459589] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:26:48.460826] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-13T20:26:48.460905] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-13T20:26:48.467542] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-13T20:26:48.479584] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-13T20:26:48.480927] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:26:48.862422] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:49.217945] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-13T20:26:50.017920] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-13T20:26:50.127311] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T20:26:50.343316] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T20:26:50.817914] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-13T20:26:51.617919] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-13T20:26:51.893928] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T20:26:51.953864] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T20:26:52.417999] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-13T20:26:53.217914] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-13T20:26:53.312585] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T20:26:53.584391] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:26:54.017907] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-13T20:26:54.325346] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T20:26:54.817985] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-13T20:26:55.617918] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-13T20:26:55.683504] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T20:26:56.319756] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T20:26:56.417892] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-13T20:26:56.744636] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:26:57.082077] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T20:26:57.086144] [INFO ] [REMOTE ] NFG: Full fetch complete (56727 records). [2025-10-13T20:26:57.086250] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-13T20:26:57.086955] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:26:57.087057] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:26:57.087127] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:26:57.087214] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-13T20:26:57.087291] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-13T20:26:57.087329] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-13T20:26:57.087370] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-13T20:26:57.087431] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NFG took 33.7s. Estimated remaining: 2h 6m 8s. Rate: 7.1 symbols/min [2025-10-13T20:26:57.223986] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-13T20:26:57.257116] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:26:57.270624] [DEBUG] [LOCAL ] NGS: Loaded 11435 existing records from primary storage. [2025-10-13T20:26:57.270877] [INFO ] [MAIN ] NGS: Loaded 11435 existing records. [2025-10-13T20:26:57.447696] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:26:57.447931] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-13T20:26:57.448004] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-13T20:26:57.448337] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-13T20:26:57.448394] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-13T20:26:57.793050] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:26:58.017932] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-13T20:26:58.370229] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T20:26:58.818015] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-13T20:26:59.014589] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T20:26:59.617959] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-13T20:27:00.417904] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-13T20:27:00.536078] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:27:00.764612] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:27:01.217954] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-13T20:27:01.596604] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T20:27:02.017960] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-13T20:27:02.325925] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T20:27:02.818005] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-13T20:27:03.587909] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:27:03.590678] [INFO ] [REMOTE ] NFJ: Full fetch complete (30083 records). [2025-10-13T20:27:03.590788] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-13T20:27:03.591590] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:27:03.591701] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:27:03.591748] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:27:03.591788] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-13T20:27:03.591844] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-13T20:27:03.591880] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-13T20:27:03.591929] [DEBUG] [LOCAL ] NFJ: No derivative data file found to delete. [2025-10-13T20:27:03.591985] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NFJ took 30.8s. Estimated remaining: 2h 5m 58s. Rate: 7.1 symbols/min [2025-10-13T20:27:03.623785] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-13T20:27:03.784070] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:03.784352] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-13T20:27:03.784458] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-13T20:27:03.784793] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-13T20:27:03.784872] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-13T20:27:03.785046] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-13T20:27:03.785150] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-13T20:27:03.965129] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T20:27:04.194076] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:04.417901] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-13T20:27:04.906552] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T20:27:05.218035] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-13T20:27:06.017934] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-13T20:27:06.280695] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T20:27:06.344834] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T20:27:06.817896] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-13T20:27:06.955517] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T20:27:07.617902] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-13T20:27:07.638910] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T20:27:08.417907] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-13T20:27:09.136170] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T20:27:09.217901] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-13T20:27:09.604974] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T20:27:10.017937] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-13T20:27:10.817989] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-13T20:27:10.883797] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T20:27:10.974976] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T20:27:11.617918] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-13T20:27:12.349486] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T20:27:12.417955] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-13T20:27:12.655116] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T20:27:13.115042] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:27:13.119416] [INFO ] [REMOTE ] NGG: Full fetch complete (65996 records). [2025-10-13T20:27:13.119506] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-13T20:27:13.120320] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:27:13.120438] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:27:13.120480] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:27:13.120518] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-13T20:27:13.120572] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-13T20:27:13.120610] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-13T20:27:13.120675] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-13T20:27:13.120753] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NGG took 37.6s. Estimated remaining: 2h 5m 50s. Rate: 7.1 symbols/min [2025-10-13T20:27:13.219625] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-13T20:27:13.289450] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:13.289581] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-13T20:27:13.289617] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-13T20:27:13.289865] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-13T20:27:13.289905] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-13T20:27:13.289950] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-13T20:27:13.289982] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-13T20:27:13.633164] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:14.017954] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-13T20:27:14.686071] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T20:27:14.817918] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-13T20:27:14.915539] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T20:27:15.617949] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-13T20:27:16.031089] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T20:27:16.417903] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-13T20:27:16.740516] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T20:27:17.217896] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-13T20:27:17.563046] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T20:27:18.017959] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-13T20:27:18.674095] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T20:27:18.818114] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-13T20:27:18.828745] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T20:27:19.618027] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-13T20:27:20.266095] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T20:27:20.417960] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-13T20:27:20.527689] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:27:21.217929] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-13T20:27:21.587377] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T20:27:22.018096] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-13T20:27:22.613249] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T20:27:22.818006] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-13T20:27:22.894532] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T20:27:23.617992] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-13T20:27:24.083727] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T20:27:24.417913] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-13T20:27:24.500488] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T20:27:25.217921] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-13T20:27:25.559738] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T20:27:25.995061] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T20:27:25.996740] [INFO ] [REMOTE ] NGS: Full fetch complete (17148 records). [2025-10-13T20:27:25.997173] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-13T20:27:26.027613] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-13T20:27:26.397036] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-13T20:27:26.397140] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-13T20:27:26.397544] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-13T20:27:26.397584] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-13T20:27:26.398220] [DEBUG] [LOCAL ] NGS: Trimmed 17148 records to 11252 (keeping 200 days of data) [2025-10-13T20:27:26.473937] [DEBUG] [LOCAL ] NGS: Primary data saved (11252 records). [2025-10-13T20:27:26.474081] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-13T20:27:26.474162] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGS took 29.4s. Estimated remaining: 2h 5m 45s. Rate: 7.1 symbols/min [2025-10-13T20:27:26.638723] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:26.638889] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-13T20:27:26.638925] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-13T20:27:26.639033] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-13T20:27:26.639073] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-13T20:27:26.639113] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-13T20:27:26.639144] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-13T20:27:26.824941] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-13T20:27:27.001973] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:27.415757] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T20:27:27.617934] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-13T20:27:28.150395] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T20:27:28.417919] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-13T20:27:28.645563] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T20:27:29.217918] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-13T20:27:29.668177] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T20:27:30.017890] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-13T20:27:30.415520] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T20:27:30.817886] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-13T20:27:31.206627] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T20:27:31.616526] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:27:31.618989] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-13T20:27:31.620266] [INFO ] [REMOTE ] NGL: Full fetch complete (41449 records). [2025-10-13T20:27:31.620339] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-13T20:27:31.990570] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-13T20:27:31.990672] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-13T20:27:31.991350] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-13T20:27:31.991391] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-13T20:27:31.992315] [DEBUG] [LOCAL ] NGL: Trimmed 41449 records to 29979 (keeping 200 days of data) [2025-10-13T20:27:32.161403] [DEBUG] [LOCAL ] NGL: Primary data saved (29979 records). [2025-10-13T20:27:32.161571] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-13T20:27:32.161731] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGL took 44.1s. Estimated remaining: 2h 5m 35s. Rate: 7.1 symbols/min [2025-10-13T20:27:32.417922] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-13T20:27:32.872000] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T20:27:33.217924] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-13T20:27:33.415085] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T20:27:34.017951] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-13T20:27:34.371973] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T20:27:34.817953] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-13T20:27:34.983106] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T20:27:35.617932] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-13T20:27:35.866274] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T20:27:36.418026] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-13T20:27:36.873889] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T20:27:37.218049] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-13T20:27:37.727165] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:27:38.017930] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-13T20:27:38.431877] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T20:27:38.818032] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-13T20:27:39.221421] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T20:27:39.617996] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-13T20:27:40.019986] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T20:27:40.417998] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-13T20:27:40.814040] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T20:27:40.816467] [INFO ] [REMOTE ] NGVT: Full fetch complete (34242 records). [2025-10-13T20:27:40.816552] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-13T20:27:40.817056] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:27:40.817159] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:27:40.817221] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:27:40.817306] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-13T20:27:40.817382] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-13T20:27:40.817448] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-13T20:27:40.817511] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-13T20:27:40.817592] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGVT took 27.7s. Estimated remaining: 2h 5m 27s. Rate: 7.1 symbols/min [2025-10-13T20:27:40.934031] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T20:27:41.218007] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-13T20:27:42.017937] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-13T20:27:42.374894] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T20:27:42.817961] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-13T20:27:43.169370] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T20:27:43.617936] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-13T20:27:43.698679] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T20:27:44.204401] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T20:27:44.208182] [INFO ] [REMOTE ] NGVC: Full fetch complete (30642 records). [2025-10-13T20:27:44.208295] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-13T20:27:44.208991] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:27:44.209097] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:27:44.209167] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:27:44.209257] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-13T20:27:44.209349] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-13T20:27:44.209410] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-13T20:27:44.209478] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-13T20:27:44.209575] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVC took 40.6s. Estimated remaining: 2h 5m 15s. Rate: 7.1 symbols/min [2025-10-13T20:27:44.417933] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-13T20:27:45.693360] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T20:27:45.699996] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-13T20:27:46.869951] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:27:46.875164] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-13T20:27:47.998411] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T20:27:48.004988] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-13T20:27:48.738793] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T20:27:48.741407] [INFO ] [REMOTE ] NHI: Full fetch complete (31189 records). [2025-10-13T20:27:48.741501] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-13T20:27:48.742060] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:27:48.742149] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:27:48.742235] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:27:48.742307] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-13T20:27:48.742413] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-13T20:27:48.742489] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-13T20:27:48.742577] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-13T20:27:48.742677] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NHI took 22.3s. Estimated remaining: 2h 5m 4s. Rate: 7.1 symbols/min [2025-10-13T20:27:49.357281] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:49.435604] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:49.473939] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:49.484412] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-13T20:27:49.508856] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-13T20:27:49.510495] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:27:49.516048] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-13T20:27:49.516352] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-13T20:27:49.516774] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-13T20:27:49.517000] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-13T20:27:49.516625] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-13T20:27:49.526768] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-13T20:27:49.526387] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-13T20:27:49.520637] [DEBUG] [LOCAL ] NIM: Loaded 3923 existing records from primary storage. [2025-10-13T20:27:49.532981] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-13T20:27:49.533339] [INFO ] [MAIN ] NIM: Loaded 3923 existing records. [2025-10-13T20:27:49.532827] [DEBUG] [LOCAL ] NIE: Loaded 12219 existing records from primary storage. [2025-10-13T20:27:49.540721] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-13T20:27:49.566439] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-13T20:27:49.566257] [INFO ] [MAIN ] NIE: Loaded 12219 existing records. [2025-10-13T20:27:50.247608] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:27:50.409326] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:27:50.423325] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-13T20:27:50.455606] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-13T20:27:50.474023] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-13T20:27:50.529919] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-13T20:27:50.530006] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-13T20:27:50.562232] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-13T20:27:50.598745] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-13T20:27:50.647030] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-13T20:27:50.683803] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:50.739611] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-13T20:27:50.980701] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:51.033965] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-13T20:27:51.534727] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:51.552941] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-13T20:27:51.557304] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:27:51.558840] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-13T20:27:52.000578] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T20:27:52.002995] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-13T20:27:52.422751] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T20:27:52.424841] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-13T20:27:52.458362] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T20:27:52.461565] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-13T20:27:52.500881] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-13T20:27:52.844797] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T20:27:53.102775] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T20:27:53.218058] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-13T20:27:53.388677] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T20:27:53.767905] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T20:27:54.017957] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-13T20:27:54.817959] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-13T20:27:55.612019] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T20:27:55.617884] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-13T20:27:55.860078] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T20:27:56.181103] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T20:27:56.417957] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-13T20:27:57.070700] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T20:27:57.218046] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-13T20:27:57.985680] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T20:27:58.017920] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-13T20:27:58.817955] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-13T20:27:58.921244] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T20:27:59.617934] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-13T20:27:59.704594] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T20:28:00.421765] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-13T20:28:00.537465] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:28:01.217940] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-13T20:28:01.538397] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T20:28:02.017963] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-13T20:28:02.059423] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T20:28:02.817996] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-13T20:28:03.618046] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-13T20:28:03.716472] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T20:28:03.916889] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T20:28:04.417945] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-13T20:28:04.471152] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T20:28:05.217931] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-13T20:28:05.321868] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:28:06.017999] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-13T20:28:06.730668] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T20:28:06.817956] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-13T20:28:07.173710] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T20:28:07.617924] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-13T20:28:07.659696] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T20:28:08.417938] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-13T20:28:08.597633] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:28:09.217927] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-13T20:28:09.320590] [DEBUG] [REMOTE ] NIM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-13T20:28:09.320886] [WARN ] [REMOTE ] NIM: No data returned for month 2025-07 [2025-10-13T20:28:09.320990] [FATAL] [REMOTE ] NIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:28:09.321064] [FATAL] [MAIN ] NIM: Failed to fetch primary data. [2025-10-13T20:28:09.321099] [WARN ] [MAIN ] NIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:28:09.321145] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-13T20:28:09.321199] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-13T20:28:09.321242] [INFO ] [LOCAL ] NIM: Starting deletion of derivative data. [2025-10-13T20:28:09.321733] [DEBUG] [LOCAL ] NIM: Deleted derivative data file. [2025-10-13T20:28:09.322087] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIM took 20.6s. Estimated remaining: 2h 5m 3s. Rate: 7.1 symbols/min [2025-10-13T20:28:09.496513] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:09.528176] [DEBUG] [LOCAL ] NINE: Loaded 28496 existing records from primary storage. [2025-10-13T20:28:09.528535] [INFO ] [MAIN ] NINE: Loaded 28496 existing records. [2025-10-13T20:28:09.718778] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:28:09.719067] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-13T20:28:09.719118] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-13T20:28:09.719731] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-13T20:28:09.719793] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-13T20:28:10.020544] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-13T20:28:10.099686] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:10.220988] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T20:28:10.817936] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-13T20:28:10.986769] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T20:28:11.618000] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-13T20:28:12.400868] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T20:28:12.417886] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-13T20:28:12.439330] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T20:28:13.217944] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-13T20:28:14.017941] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-13T20:28:14.108315] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T20:28:14.147701] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T20:28:14.649756] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T20:28:14.817947] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-13T20:28:15.415803] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T20:28:15.617958] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-13T20:28:16.004003] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T20:28:16.005720] [INFO ] [REMOTE ] NIC: Full fetch complete (12291 records). [2025-10-13T20:28:16.005866] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-13T20:28:16.006400] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:28:16.006489] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:28:16.006533] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:28:16.006599] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-13T20:28:16.006694] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-13T20:28:16.006754] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-13T20:28:16.006797] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-13T20:28:16.006858] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 27.3s. Estimated remaining: 2h 4m 54s. Rate: 7.1 symbols/min [2025-10-13T20:28:16.192756] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:16.256378] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-13T20:28:16.256874] [INFO ] [MAIN ] NIO: Loaded 54582 existing records. [2025-10-13T20:28:16.421096] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-13T20:28:16.451617] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:28:16.452995] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-13T20:28:16.453049] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-13T20:28:16.453977] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-13T20:28:16.454044] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-13T20:28:16.838632] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:17.217938] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-13T20:28:17.814479] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T20:28:18.017940] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-13T20:28:18.817957] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-13T20:28:19.618012] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-13T20:28:19.733236] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T20:28:19.735597] [INFO ] [REMOTE ] NIE: Full fetch complete (16753 records). [2025-10-13T20:28:19.735705] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-13T20:28:20.166290] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-10-13T20:28:20.290128] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-13T20:28:20.290279] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-13T20:28:20.291049] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-13T20:28:20.291133] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-13T20:28:20.304629] [DEBUG] [LOCAL ] NIE: Trimmed 16753 records to 12028 (keeping 200 days of data) [2025-10-13T20:28:20.331673] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-13T20:28:20.418757] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-13T20:28:20.435438] [DEBUG] [LOCAL ] NIE: Primary data saved (12028 records). [2025-10-13T20:28:20.435666] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-13T20:28:20.435808] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIE took 31.7s. Estimated remaining: 2h 4m 43s. Rate: 7.1 symbols/min [2025-10-13T20:28:20.630127] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:20.630541] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-13T20:28:20.630614] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-13T20:28:20.630792] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-13T20:28:20.630837] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-13T20:28:20.630880] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-13T20:28:20.630914] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-13T20:28:21.076806] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:28:21.174762] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:21.218037] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-13T20:28:21.516281] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:28:21.516837] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-13T20:28:21.516966] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:28:21.517060] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-13T20:28:21.517154] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:28:21.517246] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-13T20:28:21.517333] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-13T20:28:21.517387] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-13T20:28:21.517475] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-13T20:28:21.517555] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NIQ took 1.1s. Estimated remaining: 2h 4m 30s. Rate: 7.1 symbols/min [2025-10-13T20:28:21.764370] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:21.764665] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-13T20:28:21.764728] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-13T20:28:21.764902] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-13T20:28:21.764950] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-13T20:28:21.765000] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-13T20:28:21.765038] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-13T20:28:22.023181] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-13T20:28:22.195754] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:22.817953] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-13T20:28:22.996600] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-13T20:28:23.497803] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T20:28:23.617964] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-13T20:28:24.152234] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T20:28:24.418025] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-13T20:28:25.217940] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-13T20:28:25.977142] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T20:28:26.020606] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-13T20:28:26.025325] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-13T20:28:26.792860] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:28:26.817894] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-13T20:28:27.617913] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-13T20:28:27.745996] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:28:28.297118] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T20:28:28.418029] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-13T20:28:29.217930] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-13T20:28:29.566478] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T20:28:30.017914] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-13T20:28:30.126867] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T20:28:30.817951] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-13T20:28:31.364087] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T20:28:31.617923] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-13T20:28:32.424883] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-13T20:28:32.445742] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T20:28:32.779182] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-13T20:28:33.217946] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-13T20:28:33.446961] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T20:28:34.018012] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-13T20:28:34.073542] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T20:28:34.750035] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T20:28:34.818027] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-13T20:28:35.617948] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-13T20:28:36.389868] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T20:28:36.417897] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-13T20:28:36.470345] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T20:28:36.913413] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T20:28:37.217943] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-13T20:28:38.017901] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-13T20:28:38.050740] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:28:38.410814] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T20:28:38.817943] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-13T20:28:39.618024] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-13T20:28:39.957713] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T20:28:40.418019] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-13T20:28:41.126181] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T20:28:41.217907] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-13T20:28:41.283665] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-13T20:28:41.518304] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T20:28:41.521856] [INFO ] [REMOTE ] NINE: Full fetch complete (43286 records). [2025-10-13T20:28:41.521985] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-13T20:28:41.922858] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-13T20:28:41.923084] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-13T20:28:41.924340] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-13T20:28:41.924410] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-13T20:28:41.925987] [DEBUG] [LOCAL ] NINE: Trimmed 43286 records to 28123 (keeping 200 days of data) [2025-10-13T20:28:42.029964] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-13T20:28:42.126839] [DEBUG] [LOCAL ] NINE: Primary data saved (28123 records). [2025-10-13T20:28:42.127055] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-13T20:28:42.127182] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NINE took 32.8s. Estimated remaining: 2h 4m 29s. Rate: 7.1 symbols/min [2025-10-13T20:28:42.319196] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:42.319427] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-13T20:28:42.319471] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-13T20:28:42.319596] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-13T20:28:42.319680] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-13T20:28:42.319758] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-13T20:28:42.319799] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-13T20:28:42.728413] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:42.731673] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T20:28:42.753123] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:28:42.758380] [INFO ] [REMOTE ] NI: Full fetch complete (76882 records). [2025-10-13T20:28:42.758522] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-13T20:28:42.759429] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:28:42.759532] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:28:42.759581] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:28:42.759706] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-13T20:28:42.759807] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-13T20:28:42.759880] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-13T20:28:42.759939] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-13T20:28:42.760013] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NI took 54.0s. Estimated remaining: 2h 4m 16s. Rate: 7.1 symbols/min [2025-10-13T20:28:42.823178] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-13T20:28:42.936052] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:42.954968] [DEBUG] [LOCAL ] NKX: Loaded 13828 existing records from primary storage. [2025-10-13T20:28:42.955312] [INFO ] [MAIN ] NKX: Loaded 13828 existing records. [2025-10-13T20:28:43.140204] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:28:43.140458] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-13T20:28:43.140526] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-13T20:28:43.140786] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-13T20:28:43.140875] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-13T20:28:43.483433] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:43.617920] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-13T20:28:44.246022] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:28:44.250218] [INFO ] [REMOTE ] NJR: Full fetch complete (54530 records). [2025-10-13T20:28:44.250391] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-13T20:28:44.251094] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:28:44.251185] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:28:44.251228] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:28:44.251267] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-13T20:28:44.251322] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-13T20:28:44.251358] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-13T20:28:44.251397] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-13T20:28:44.251453] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NJR took 22.7s. Estimated remaining: 2h 4m 3s. Rate: 7.1 symbols/min [2025-10-13T20:28:44.417997] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-13T20:28:44.417843] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:28:44.419231] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-13T20:28:44.419296] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-13T20:28:44.419413] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-13T20:28:44.419455] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-13T20:28:44.419496] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-13T20:28:44.419530] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-13T20:28:44.770716] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:28:45.218004] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-13T20:28:45.651595] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:28:45.692841] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-13T20:28:46.017935] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-13T20:28:46.817928] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-13T20:28:46.947722] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T20:28:47.383126] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-13T20:28:47.617933] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-13T20:28:48.417944] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-13T20:28:49.113060] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T20:28:49.206404] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-13T20:28:49.217874] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-13T20:28:50.018032] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-13T20:28:50.374555] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-13T20:28:50.818004] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-13T20:28:50.865670] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:28:51.466927] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-13T20:28:51.506816] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T20:28:51.617940] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-13T20:28:52.322958] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T20:28:52.417940] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-13T20:28:53.217924] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-13T20:28:54.018053] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-13T20:28:54.723272] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T20:28:54.817935] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-13T20:28:54.976265] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-13T20:28:55.617904] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-13T20:28:55.828339] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T20:28:55.881379] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-13T20:28:56.394350] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T20:28:56.417918] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-13T20:28:57.051772] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T20:28:57.217920] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-13T20:28:58.017919] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-13T20:28:58.216485] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T20:28:58.817915] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-13T20:28:59.618030] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-13T20:28:59.743089] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T20:29:00.365501] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-13T20:29:00.417927] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-13T20:29:00.472823] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:29:01.217945] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-13T20:29:01.717716] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T20:29:01.920041] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:29:01.926501] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-10-13T20:29:01.926750] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-13T20:29:02.023223] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-13T20:29:02.334608] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-13T20:29:02.334747] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-13T20:29:02.335823] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-13T20:29:02.335888] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-13T20:29:02.337505] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-10-13T20:29:02.655802] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-13T20:29:02.655948] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-13T20:29:02.656027] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 46.6s. Estimated remaining: 2h 4m 1s. Rate: 7.1 symbols/min [2025-10-13T20:29:02.825731] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-13T20:29:02.859316] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:02.861423] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-13T20:29:02.861498] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-13T20:29:02.861661] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-13T20:29:02.861723] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-13T20:29:02.861778] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-13T20:29:02.861813] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-13T20:29:03.172055] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T20:29:03.253828] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:03.617929] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-13T20:29:04.418019] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-13T20:29:04.559101] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T20:29:05.217946] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-13T20:29:05.337585] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T20:29:05.599332] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-13T20:29:06.018004] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-13T20:29:06.287728] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T20:29:06.803003] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T20:29:06.817886] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-13T20:29:07.503144] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T20:29:07.618035] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-13T20:29:08.417944] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-13T20:29:09.217942] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-13T20:29:09.415977] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T20:29:09.900261] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T20:29:10.017955] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-13T20:29:10.419289] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-13T20:29:10.817953] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-13T20:29:10.874986] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T20:29:10.877188] [INFO ] [REMOTE ] NKX: Full fetch complete (19220 records). [2025-10-13T20:29:10.877275] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-13T20:29:11.258757] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-13T20:29:11.258847] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-13T20:29:11.259314] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-13T20:29:11.259354] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-13T20:29:11.259943] [DEBUG] [LOCAL ] NKX: Trimmed 19220 records to 13621 (keeping 200 days of data) [2025-10-13T20:29:11.359109] [DEBUG] [LOCAL ] NKX: Primary data saved (13621 records). [2025-10-13T20:29:11.359311] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-13T20:29:11.359415] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NKX took 28.6s. Estimated remaining: 2h 3m 53s. Rate: 7.1 symbols/min [2025-10-13T20:29:11.542995] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:11.543424] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-13T20:29:11.543506] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-13T20:29:11.543896] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-13T20:29:11.552300] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-13T20:29:11.553713] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-13T20:29:11.553546] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T20:29:11.557087] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-13T20:29:11.623147] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-13T20:29:11.948844] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:12.417963] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-13T20:29:13.218020] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-13T20:29:13.286627] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:29:13.811485] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T20:29:13.813186] [INFO ] [REMOTE ] NL: Full fetch complete (6856 records). [2025-10-13T20:29:13.813334] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-13T20:29:14.022148] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-13T20:29:14.064757] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T20:29:14.067226] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:29:14.067481] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:29:14.067618] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-13T20:29:14.068107] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-13T20:29:14.068618] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-13T20:29:14.068760] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-13T20:29:14.069100] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NL took 29.8s. Estimated remaining: 2h 3m 41s. Rate: 7.1 symbols/min [2025-10-13T20:29:14.353184] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:14.403399] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-13T20:29:14.429059] [DEBUG] [LOCAL ] NMAI: Loaded 13086 existing records from primary storage. [2025-10-13T20:29:14.429344] [INFO ] [MAIN ] NMAI: Loaded 13086 existing records. [2025-10-13T20:29:14.617824] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:29:14.618094] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-13T20:29:14.618152] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-13T20:29:14.618639] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-13T20:29:14.618991] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-13T20:29:14.828297] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-13T20:29:15.012351] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:15.618001] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-13T20:29:16.080608] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T20:29:16.417990] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-13T20:29:16.754853] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T20:29:17.217951] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-13T20:29:17.646431] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-13T20:29:17.787782] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T20:29:18.017929] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-13T20:29:18.330128] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T20:29:18.817906] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-13T20:29:18.898014] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T20:29:19.617939] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-13T20:29:20.417941] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-13T20:29:20.717443] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T20:29:20.867507] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T20:29:21.217965] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-13T20:29:21.240517] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T20:29:22.018030] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-13T20:29:22.306363] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T20:29:22.817923] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-13T20:29:23.070122] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T20:29:23.618057] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-13T20:29:23.675408] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:29:24.417960] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-13T20:29:24.644943] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T20:29:25.217963] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-13T20:29:25.469258] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T20:29:25.665789] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T20:29:25.667471] [INFO ] [REMOTE ] NLOP: Full fetch complete (17663 records). [2025-10-13T20:29:25.667567] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-13T20:29:25.668205] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:29:25.668324] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:29:25.668370] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:29:25.668411] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-13T20:29:25.668476] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-13T20:29:25.668514] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-13T20:29:25.668555] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-13T20:29:25.668615] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NLOP took 23.0s. Estimated remaining: 2h 3m 34s. Rate: 7.1 symbols/min [2025-10-13T20:29:25.856987] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:25.857271] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-13T20:29:25.857330] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-13T20:29:25.857455] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-13T20:29:25.857498] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-13T20:29:25.857545] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-13T20:29:25.857582] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-13T20:29:26.026879] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-13T20:29:26.249583] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:26.818016] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-13T20:29:27.034618] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T20:29:27.617964] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-13T20:29:28.418055] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-13T20:29:29.136897] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-13T20:29:29.218018] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-13T20:29:29.266217] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-13T20:29:29.341549] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T20:29:30.017959] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-13T20:29:30.086047] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T20:29:30.817956] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-13T20:29:31.618011] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-13T20:29:31.809346] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T20:29:32.417934] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-13T20:29:32.492973] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-13T20:29:33.217911] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-13T20:29:33.368215] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T20:29:33.478049] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:29:33.478387] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-13T20:29:33.478487] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:29:33.478540] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-13T20:29:33.478622] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:29:33.478716] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-13T20:29:33.478781] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-13T20:29:33.478817] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-13T20:29:33.478883] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-13T20:29:33.478966] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NMAX took 7.8s. Estimated remaining: 2h 3m 26s. Rate: 7.1 symbols/min [2025-10-13T20:29:33.675625] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:33.676075] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-13T20:29:33.676251] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-13T20:29:33.676514] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-13T20:29:33.676560] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-13T20:29:33.704985] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-13T20:29:33.708149] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-13T20:29:33.789521] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T20:29:34.023174] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-13T20:29:34.076430] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:34.739014] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:29:34.745209] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-13T20:29:34.745508] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-13T20:29:34.746578] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:29:34.746734] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:29:34.746807] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:29:34.746864] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-13T20:29:34.746933] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-13T20:29:34.746971] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-13T20:29:34.747011] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-13T20:29:34.747078] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NKE took 52.6s. Estimated remaining: 2h 3m 13s. Rate: 7.1 symbols/min [2025-10-13T20:29:34.823161] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-13T20:29:34.940805] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:34.955592] [DEBUG] [LOCAL ] NMG: Loaded 9690 existing records from primary storage. [2025-10-13T20:29:34.956030] [INFO ] [MAIN ] NMG: Loaded 9690 existing records. [2025-10-13T20:29:35.182629] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:29:35.182992] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-13T20:29:35.183076] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-13T20:29:35.183452] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-13T20:29:35.183534] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-13T20:29:35.575948] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:35.617911] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-13T20:29:35.846047] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T20:29:36.417922] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-13T20:29:36.655913] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:29:37.218010] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-13T20:29:37.240694] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:29:37.242823] [INFO ] [REMOTE ] NMAI: Full fetch complete (19757 records). [2025-10-13T20:29:37.242899] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-13T20:29:37.599744] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-13T20:29:37.599830] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-13T20:29:37.600332] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-13T20:29:37.600374] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-13T20:29:37.601137] [DEBUG] [LOCAL ] NMAI: Trimmed 19757 records to 12919 (keeping 200 days of data) [2025-10-13T20:29:37.682153] [DEBUG] [LOCAL ] NMAI: Primary data saved (12919 records). [2025-10-13T20:29:37.682292] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-13T20:29:37.682369] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAI took 23.6s. Estimated remaining: 2h 3m 1s. Rate: 7.1 symbols/min [2025-10-13T20:29:37.845844] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:37.853970] [DEBUG] [LOCAL ] NMI: Loaded 4095 existing records from primary storage. [2025-10-13T20:29:37.854157] [INFO ] [MAIN ] NMI: Loaded 4095 existing records. [2025-10-13T20:29:38.029302] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-13T20:29:38.035865] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:29:38.037349] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-13T20:29:38.037405] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-13T20:29:38.037597] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-13T20:29:38.037683] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-13T20:29:38.325463] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T20:29:38.406928] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:38.817933] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-13T20:29:38.960372] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T20:29:39.617936] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-13T20:29:39.844176] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T20:29:40.169695] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T20:29:40.417939] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-13T20:29:41.056099] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T20:29:41.218020] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-13T20:29:42.017920] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-13T20:29:42.235161] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T20:29:42.818042] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-13T20:29:43.617961] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-13T20:29:43.719537] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T20:29:44.017204] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T20:29:44.198975] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T20:29:44.418007] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-13T20:29:45.101055] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T20:29:45.217959] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-13T20:29:46.018020] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-13T20:29:46.067301] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T20:29:46.817946] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-13T20:29:47.231115] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T20:29:47.617959] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-13T20:29:48.315137] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T20:29:48.417946] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-13T20:29:48.982242] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-13T20:29:49.152237] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T20:29:49.218069] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-13T20:29:50.017915] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-13T20:29:50.064368] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T20:29:50.817960] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-13T20:29:51.000004] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T20:29:51.547734] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T20:29:51.617935] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-13T20:29:52.417918] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-13T20:29:52.676120] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:29:53.217921] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-13T20:29:53.991930] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T20:29:54.017899] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-13T20:29:54.583074] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T20:29:54.817927] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-13T20:29:54.909971] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T20:29:55.297386] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T20:29:55.617923] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-13T20:29:56.267302] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T20:29:56.417921] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-13T20:29:57.217963] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-13T20:29:57.623612] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T20:29:57.627131] [INFO ] [REMOTE ] NMG: Full fetch complete (14453 records). [2025-10-13T20:29:57.627210] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-13T20:29:57.999121] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-13T20:29:57.999252] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-13T20:29:57.999717] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-13T20:29:57.999779] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-13T20:29:58.000395] [DEBUG] [LOCAL ] NMG: Trimmed 14453 records to 9936 (keeping 200 days of data) [2025-10-13T20:29:58.027748] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-13T20:29:58.071824] [DEBUG] [LOCAL ] NMG: Primary data saved (9936 records). [2025-10-13T20:29:58.071964] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-13T20:29:58.072106] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMG took 23.3s. Estimated remaining: 2h 2m 60s. Rate: 7.1 symbols/min [2025-10-13T20:29:58.269789] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:29:58.269983] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-13T20:29:58.270052] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-13T20:29:58.270211] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-13T20:29:58.270274] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-13T20:29:58.270322] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-13T20:29:58.270363] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-13T20:29:58.638160] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:29:58.817894] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-13T20:29:59.076397] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T20:29:59.274692] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T20:29:59.617924] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-13T20:29:59.909228] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T20:30:00.417924] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-13T20:30:01.217936] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-13T20:30:01.728235] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:30:02.023339] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-13T20:30:02.029581] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-13T20:30:02.404948] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T20:30:02.523369] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T20:30:02.817921] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-13T20:30:03.463984] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T20:30:03.617935] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-13T20:30:04.417919] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-13T20:30:04.764068] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T20:30:05.162227] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T20:30:05.217903] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-13T20:30:06.017953] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-13T20:30:06.073793] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T20:30:06.080102] [INFO ] [REMOTE ] NLY: Full fetch complete (77170 records). [2025-10-13T20:30:06.080315] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-13T20:30:06.081085] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:30:06.081176] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:30:06.081220] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:30:06.081306] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-13T20:30:06.081383] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-13T20:30:06.081420] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-13T20:30:06.081459] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-13T20:30:06.081542] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NLY took 54.7s. Estimated remaining: 2h 2m 51s. Rate: 7.1 symbols/min [2025-10-13T20:30:06.260259] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:06.260467] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-13T20:30:06.260505] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-13T20:30:06.260620] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-13T20:30:06.260695] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-13T20:30:06.260756] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-13T20:30:06.260792] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-13T20:30:06.657619] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:06.719692] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T20:30:06.818010] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-13T20:30:07.459049] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T20:30:07.618018] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-13T20:30:08.417945] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-13T20:30:08.722901] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T20:30:08.922248] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T20:30:08.923582] [INFO ] [REMOTE ] NMI: Full fetch complete (5827 records). [2025-10-13T20:30:08.923804] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-13T20:30:09.221987] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-13T20:30:09.305726] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-13T20:30:09.305810] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-13T20:30:09.305973] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-13T20:30:09.306011] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-13T20:30:09.306417] [DEBUG] [LOCAL ] NMI: Trimmed 5827 records to 4062 (keeping 200 days of data) [2025-10-13T20:30:09.332686] [DEBUG] [LOCAL ] NMI: Primary data saved (4062 records). [2025-10-13T20:30:09.332842] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-13T20:30:09.332928] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMI took 31.7s. Estimated remaining: 2h 2m 40s. Rate: 7.1 symbols/min [2025-10-13T20:30:09.511122] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:09.517024] [DEBUG] [LOCAL ] NMS: Loaded 2908 existing records from primary storage. [2025-10-13T20:30:09.517254] [INFO ] [MAIN ] NMS: Loaded 2908 existing records. [2025-10-13T20:30:09.694601] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:30:09.694834] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-13T20:30:09.694879] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-13T20:30:09.695124] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-13T20:30:09.695182] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-13T20:30:10.024407] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-13T20:30:10.065779] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:10.417412] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T20:30:10.490634] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T20:30:10.492458] [INFO ] [REMOTE ] NMCO: Full fetch complete (23424 records). [2025-10-13T20:30:10.492705] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-13T20:30:10.493153] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:30:10.493235] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:30:10.493278] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:30:10.493315] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-13T20:30:10.493368] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-13T20:30:10.493401] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-13T20:30:10.493440] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-13T20:30:10.493504] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMCO took 37.0s. Estimated remaining: 2h 2m 27s. Rate: 7.1 symbols/min [2025-10-13T20:30:10.664170] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:10.669899] [DEBUG] [LOCAL ] NMT: Loaded 2879 existing records from primary storage. [2025-10-13T20:30:10.670071] [INFO ] [MAIN ] NMT: Loaded 2879 existing records. [2025-10-13T20:30:10.823073] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-13T20:30:10.851608] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:30:10.852021] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-13T20:30:10.852074] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-13T20:30:10.852290] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-13T20:30:10.852346] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-13T20:30:11.214247] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:11.441312] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T20:30:11.617924] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-13T20:30:12.417932] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-13T20:30:13.082354] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T20:30:13.218016] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-13T20:30:13.568307] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T20:30:14.017936] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-13T20:30:14.578235] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T20:30:14.666530] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T20:30:14.817942] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-13T20:30:15.617929] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-13T20:30:16.235520] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T20:30:16.409388] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T20:30:16.417883] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-13T20:30:16.969540] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T20:30:17.217947] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-13T20:30:17.793474] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T20:30:18.017957] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-13T20:30:18.654829] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T20:30:18.818001] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-13T20:30:19.617947] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-13T20:30:19.741185] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T20:30:20.417963] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-13T20:30:21.004119] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T20:30:21.074234] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:30:21.218001] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-13T20:30:21.875036] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T20:30:22.017952] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-13T20:30:22.817914] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-13T20:30:23.085905] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T20:30:23.618001] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-13T20:30:24.297998] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T20:30:24.417950] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-13T20:30:24.597139] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:30:25.217958] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-13T20:30:25.762466] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T20:30:25.939343] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T20:30:26.018042] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-13T20:30:26.542375] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T20:30:26.817939] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-13T20:30:27.618009] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-13T20:30:28.257670] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T20:30:28.343564] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T20:30:28.417899] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-13T20:30:29.076918] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T20:30:29.218090] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-13T20:30:29.777592] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T20:30:30.017926] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-13T20:30:30.619760] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T20:30:30.817991] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-13T20:30:31.446824] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T20:30:31.617934] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-13T20:30:32.197159] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T20:30:32.417952] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-13T20:30:33.217992] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-13T20:30:33.331405] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T20:30:33.644685] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T20:30:34.017951] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-13T20:30:34.454149] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:30:34.456334] [INFO ] [REMOTE ] NMM: Full fetch complete (21633 records). [2025-10-13T20:30:34.456576] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-13T20:30:34.457222] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:30:34.457317] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:30:34.457360] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:30:34.457401] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-13T20:30:34.457479] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-13T20:30:34.457536] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-13T20:30:34.457580] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-13T20:30:34.457666] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 36.4s. Estimated remaining: 2h 2m 28s. Rate: 7.1 symbols/min [2025-10-13T20:30:34.646728] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:34.646958] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-13T20:30:34.646997] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-13T20:30:34.647124] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-13T20:30:34.647166] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-13T20:30:34.647207] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-13T20:30:34.647240] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-13T20:30:34.823138] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-13T20:30:35.049715] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:35.617918] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-13T20:30:36.417912] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-13T20:30:36.509270] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T20:30:36.908202] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T20:30:37.041960] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T20:30:37.218025] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-13T20:30:38.018007] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-13T20:30:38.461416] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:30:38.817936] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-13T20:30:39.483542] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T20:30:39.586733] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T20:30:39.617933] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-13T20:30:40.417963] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-13T20:30:40.779376] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T20:30:41.001533] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T20:30:41.217915] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-13T20:30:41.797944] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T20:30:42.018009] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-13T20:30:42.818005] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-13T20:30:43.521857] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T20:30:43.544456] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T20:30:43.617935] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-13T20:30:44.417935] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-13T20:30:44.949605] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T20:30:44.953772] [INFO ] [REMOTE ] NMR: Full fetch complete (50996 records). [2025-10-13T20:30:44.953859] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-13T20:30:45.054728] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:30:45.058396] [INFO ] [REMOTE ] NMS: Full fetch complete (4084 records). [2025-10-13T20:30:45.058795] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-13T20:30:45.224726] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-13T20:30:45.711880] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-13T20:30:45.717568] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-13T20:30:45.717471] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-13T20:30:45.718482] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-13T20:30:45.718562] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-13T20:30:45.717700] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-13T20:30:45.718866] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-13T20:30:45.718927] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-13T20:30:45.719578] [DEBUG] [LOCAL ] NMS: Trimmed 4084 records to 2931 (keeping 200 days of data) [2025-10-13T20:30:45.720526] [DEBUG] [LOCAL ] NMR: Trimmed 50996 records to 35423 (keeping 200 days of data) [2025-10-13T20:30:45.819366] [DEBUG] [LOCAL ] NMS: Primary data saved (2931 records). [2025-10-13T20:30:45.820091] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-13T20:30:45.820434] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMS took 36.5s. Estimated remaining: 2h 2m 21s. Rate: 7.1 symbols/min [2025-10-13T20:30:46.008270] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:46.018908] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-13T20:30:46.028513] [DEBUG] [LOCAL ] NNI: Loaded 10443 existing records from primary storage. [2025-10-13T20:30:46.029620] [INFO ] [MAIN ] NNI: Loaded 10443 existing records. [2025-10-13T20:30:46.284077] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:30:46.285467] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-13T20:30:46.286109] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-13T20:30:46.286824] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-13T20:30:46.287194] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-13T20:30:46.709314] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:46.713366] [DEBUG] [LOCAL ] NMR: Primary data saved (35423 records). [2025-10-13T20:30:46.714005] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-13T20:30:46.714206] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMR took 40.6s. Estimated remaining: 2h 2m 8s. Rate: 7.1 symbols/min [2025-10-13T20:30:46.723509] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:30:46.741507] [INFO ] [REMOTE ] NMT: Full fetch complete (4034 records). [2025-10-13T20:30:46.776146] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-13T20:30:46.823162] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-13T20:30:46.996078] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:47.010365] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-13T20:30:47.011730] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-13T20:30:47.011589] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T20:30:47.015512] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-13T20:30:47.021491] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-13T20:30:47.022351] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-13T20:30:47.027870] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-13T20:30:47.591665] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-13T20:30:47.591835] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-13T20:30:47.591998] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-13T20:30:47.592072] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-13T20:30:47.618811] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-13T20:30:47.613618] [DEBUG] [LOCAL ] NMT: Trimmed 4034 records to 2835 (keeping 200 days of data) [2025-10-13T20:30:47.683493] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:47.702523] [DEBUG] [LOCAL ] NMT: Primary data saved (2835 records). [2025-10-13T20:30:47.702621] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-13T20:30:47.702739] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 37.2s. Estimated remaining: 2h 1m 55s. Rate: 7.1 symbols/min [2025-10-13T20:30:47.801317] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:30:47.881706] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:30:47.891296] [DEBUG] [LOCAL ] NNY: Loaded 5676 existing records from primary storage. [2025-10-13T20:30:47.891492] [INFO ] [MAIN ] NNY: Loaded 5676 existing records. [2025-10-13T20:30:48.065221] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:30:48.065453] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-13T20:30:48.065499] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-13T20:30:48.065722] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-13T20:30:48.065778] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-13T20:30:48.413143] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:30:48.417891] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-13T20:30:48.855395] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T20:30:49.217899] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-13T20:30:49.274478] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T20:30:49.915411] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T20:30:50.017958] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-13T20:30:50.817909] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-13T20:30:50.825588] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T20:30:51.558327] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T20:30:51.617896] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-13T20:30:52.320134] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T20:30:52.417934] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-13T20:30:53.217930] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-13T20:30:54.017957] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-13T20:30:54.027468] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T20:30:54.242495] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T20:30:54.670717] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T20:30:54.817954] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-13T20:30:55.617929] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-13T20:30:56.319500] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:30:56.417899] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-13T20:30:56.624291] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T20:30:57.217940] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-13T20:30:57.481289] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:30:58.017920] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-13T20:30:58.767499] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T20:30:58.786349] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T20:30:58.817920] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-13T20:30:59.512383] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T20:30:59.618025] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-13T20:31:00.417913] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-13T20:31:00.660545] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T20:31:01.107630] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T20:31:01.217948] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-13T20:31:02.017937] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-13T20:31:02.125468] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:31:02.807065] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T20:31:02.817927] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-13T20:31:03.324356] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T20:31:03.617933] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-13T20:31:04.306018] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T20:31:04.418010] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-13T20:31:05.217932] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-13T20:31:05.378454] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T20:31:05.958528] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:31:05.959749] [INFO ] [REMOTE ] NNY: Full fetch complete (8440 records). [2025-10-13T20:31:05.959840] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-13T20:31:06.025055] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-13T20:31:06.345003] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-13T20:31:06.345141] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-13T20:31:06.345375] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-13T20:31:06.345416] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-13T20:31:06.345885] [DEBUG] [LOCAL ] NNY: Trimmed 8440 records to 5632 (keeping 200 days of data) [2025-10-13T20:31:06.379370] [DEBUG] [LOCAL ] NNY: Primary data saved (5632 records). [2025-10-13T20:31:06.379469] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-13T20:31:06.379544] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NNY took 18.7s. Estimated remaining: 2h 1m 53s. Rate: 7.1 symbols/min [2025-10-13T20:31:06.547698] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:06.547868] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-13T20:31:06.547906] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-13T20:31:06.548048] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-13T20:31:06.548117] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-13T20:31:06.548194] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-13T20:31:06.548241] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-13T20:31:06.827758] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-13T20:31:06.911182] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:07.199332] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T20:31:07.617929] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-13T20:31:07.793566] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T20:31:08.417915] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-13T20:31:08.791058] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T20:31:09.217932] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-13T20:31:10.017906] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-13T20:31:10.201951] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:31:10.350565] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T20:31:10.817932] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-13T20:31:10.866912] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T20:31:11.617909] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-13T20:31:11.783455] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T20:31:12.417931] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-13T20:31:12.611916] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T20:31:12.933015] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:31:12.935587] [INFO ] [REMOTE ] NMZ: Full fetch complete (31276 records). [2025-10-13T20:31:12.935716] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-13T20:31:12.936268] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:31:12.936358] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:31:12.936408] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:31:12.936458] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-13T20:31:12.936521] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-13T20:31:12.936608] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-13T20:31:12.936708] [DEBUG] [LOCAL ] NMZ: No derivative data file found to delete. [2025-10-13T20:31:12.936794] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NMZ took 38.5s. Estimated remaining: 2h 1m 43s. Rate: 7.1 symbols/min [2025-10-13T20:31:13.131448] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:13.131727] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-13T20:31:13.131779] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-13T20:31:13.131908] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-13T20:31:13.131950] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-13T20:31:13.131992] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-13T20:31:13.132026] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-13T20:31:13.223301] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-13T20:31:13.498050] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:14.017916] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-13T20:31:14.242054] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T20:31:14.817930] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-13T20:31:15.359844] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T20:31:15.468834] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:31:15.470755] [INFO ] [REMOTE ] NNI: Full fetch complete (12925 records). [2025-10-13T20:31:15.470867] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-13T20:31:15.623035] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-13T20:31:15.879179] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-13T20:31:15.879309] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-13T20:31:15.879624] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-13T20:31:15.879700] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-13T20:31:15.880215] [DEBUG] [LOCAL ] NNI: Trimmed 12925 records to 10413 (keeping 200 days of data) [2025-10-13T20:31:15.946717] [DEBUG] [LOCAL ] NNI: Primary data saved (10413 records). [2025-10-13T20:31:15.946867] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-13T20:31:15.946949] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 30.1s. Estimated remaining: 2h 1m 32s. Rate: 7.1 symbols/min [2025-10-13T20:31:16.115177] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:16.115377] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-13T20:31:16.115420] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-13T20:31:16.115531] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-13T20:31:16.115571] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-13T20:31:16.115611] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-13T20:31:16.115664] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-13T20:31:16.423015] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-13T20:31:16.462228] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:16.928945] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T20:31:17.217998] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-13T20:31:17.420939] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T20:31:18.018035] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-13T20:31:18.818031] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-13T20:31:18.875638] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:31:18.925759] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T20:31:19.617902] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-13T20:31:19.992145] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T20:31:20.418017] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-13T20:31:21.218016] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-13T20:31:21.243395] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T20:31:21.443176] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T20:31:22.017928] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-13T20:31:22.268164] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T20:31:22.818017] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-13T20:31:23.617942] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-13T20:31:23.830325] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T20:31:23.872664] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T20:31:24.417949] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-13T20:31:25.217959] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-13T20:31:25.600937] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T20:31:26.017957] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-13T20:31:26.341870] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T20:31:26.530187] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T20:31:26.818033] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-13T20:31:27.617924] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-13T20:31:27.732847] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T20:31:27.794226] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T20:31:28.417965] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-13T20:31:28.609844] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T20:31:29.217943] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-13T20:31:30.018088] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-13T20:31:30.248676] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T20:31:30.455387] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T20:31:30.817955] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-13T20:31:31.329431] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:31:31.617995] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-13T20:31:32.417951] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-13T20:31:32.509773] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:31:32.534829] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T20:31:33.217987] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-13T20:31:34.017910] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-13T20:31:34.339205] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T20:31:34.372002] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:31:34.817926] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-13T20:31:35.617918] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-13T20:31:35.872944] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T20:31:36.320315] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T20:31:36.417933] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-13T20:31:36.665558] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T20:31:37.217951] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-13T20:31:37.807918] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T20:31:37.810008] [INFO ] [REMOTE ] NOA: Full fetch complete (22228 records). [2025-10-13T20:31:37.810079] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-13T20:31:37.810477] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:31:37.810696] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:31:37.810761] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:31:37.810832] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-13T20:31:37.810893] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-13T20:31:37.810928] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-13T20:31:37.810980] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-13T20:31:37.811057] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NOA took 31.4s. Estimated remaining: 2h 1m 31s. Rate: 7.1 symbols/min [2025-10-13T20:31:37.978436] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:37.978591] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-13T20:31:37.978626] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-13T20:31:37.978759] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-13T20:31:37.978798] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-13T20:31:37.978838] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-13T20:31:37.978870] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-13T20:31:38.021756] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-13T20:31:38.342708] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:38.368729] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T20:31:38.817906] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-13T20:31:39.617921] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-13T20:31:39.920230] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T20:31:39.976599] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T20:31:40.417933] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-13T20:31:40.958053] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:31:40.960772] [INFO ] [REMOTE ] NOAH: Full fetch complete (27883 records). [2025-10-13T20:31:40.960867] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-13T20:31:40.961492] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:31:40.961613] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:31:40.961702] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:31:40.961772] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-13T20:31:40.961835] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-13T20:31:40.961871] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-13T20:31:40.961911] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-13T20:31:40.961966] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOAH took 28.0s. Estimated remaining: 2h 1m 20s. Rate: 7.1 symbols/min [2025-10-13T20:31:41.134923] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:41.195982] [DEBUG] [LOCAL ] NOK: Loaded 54402 existing records from primary storage. [2025-10-13T20:31:41.196310] [INFO ] [MAIN ] NOK: Loaded 54402 existing records. [2025-10-13T20:31:41.226146] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-13T20:31:41.382629] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:31:41.382997] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-13T20:31:41.383091] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-13T20:31:41.391343] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-13T20:31:41.404308] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-13T20:31:41.438415] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T20:31:41.767509] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:42.017928] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-13T20:31:42.817992] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-13T20:31:43.010389] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T20:31:43.617901] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-13T20:31:44.105080] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T20:31:44.420567] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-13T20:31:44.425035] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T20:31:44.432468] [INFO ] [REMOTE ] NNN: Full fetch complete (69847 records). [2025-10-13T20:31:44.432705] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-13T20:31:44.433775] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:31:44.433926] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:31:44.434011] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:31:44.434102] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-13T20:31:44.434190] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-13T20:31:44.434246] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-13T20:31:44.434310] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-13T20:31:44.434395] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NNN took 57.7s. Estimated remaining: 2h 1m 9s. Rate: 7.1 symbols/min [2025-10-13T20:31:44.600292] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T20:31:44.658859] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:44.659032] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-13T20:31:44.659068] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-13T20:31:44.659176] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-13T20:31:44.659215] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-13T20:31:44.659255] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-13T20:31:44.659286] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-13T20:31:45.007003] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:45.217917] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-13T20:31:45.768382] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T20:31:46.017959] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-13T20:31:46.511569] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T20:31:46.817952] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-13T20:31:47.305614] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T20:31:47.365818] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:31:47.618027] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-13T20:31:48.417946] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-13T20:31:49.099716] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:31:49.103389] [INFO ] [REMOTE ] NOC: Full fetch complete (61424 records). [2025-10-13T20:31:49.103484] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-13T20:31:49.104167] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:31:49.104264] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:31:49.104338] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:31:49.104428] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-13T20:31:49.104506] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-13T20:31:49.104543] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-13T20:31:49.104581] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-13T20:31:49.104636] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 33.2s. Estimated remaining: 2h 0m 58s. Rate: 7.1 symbols/min [2025-10-13T20:31:49.223096] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-13T20:31:49.273728] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:31:49.273843] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-13T20:31:49.273935] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-13T20:31:49.274063] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-13T20:31:49.274595] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-13T20:31:49.274851] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-13T20:31:49.274978] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-13T20:31:49.636317] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:31:49.757378] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-13T20:31:50.018002] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-13T20:31:50.817925] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-13T20:31:51.083733] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T20:31:51.555552] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:31:51.617944] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-13T20:31:52.417959] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-13T20:31:52.820916] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-13T20:31:53.030029] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T20:31:53.217904] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-13T20:31:53.291804] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T20:31:54.018011] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-13T20:31:54.809055] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T20:31:54.817858] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-13T20:31:55.617941] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-13T20:31:56.206681] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T20:31:56.271574] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-13T20:31:56.303709] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T20:31:56.417899] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-13T20:31:57.217894] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-13T20:31:57.919537] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T20:31:58.017914] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-13T20:31:58.464065] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T20:31:58.817900] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-13T20:31:59.062813] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T20:31:59.250349] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T20:31:59.617934] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-13T20:32:00.050008] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T20:32:00.417920] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-13T20:32:01.045782] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T20:32:01.217896] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-13T20:32:02.017935] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-13T20:32:02.817923] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-13T20:32:03.133211] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T20:32:03.547335] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T20:32:03.617923] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-13T20:32:04.417929] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-13T20:32:04.919525] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T20:32:05.152179] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T20:32:05.217892] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-13T20:32:05.443182] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T20:32:06.017963] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-13T20:32:06.817953] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-13T20:32:07.372008] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T20:32:07.617907] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-13T20:32:07.695490] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T20:32:08.041330] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-13T20:32:08.417926] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-13T20:32:08.629079] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T20:32:09.217999] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-13T20:32:10.018016] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-13T20:32:10.698720] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-13T20:32:10.820191] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-13T20:32:10.826166] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T20:32:11.296194] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T20:32:11.297193] [INFO ] [REMOTE ] NOM: Full fetch complete (1563 records). [2025-10-13T20:32:11.297266] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-13T20:32:11.477322] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-13T20:32:11.477536] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:32:11.477624] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:32:11.477733] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-13T20:32:11.477830] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-13T20:32:11.477886] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-13T20:32:11.477929] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-13T20:32:11.478048] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOM took 27.0s. Estimated remaining: 2h 0m 57s. Rate: 7.1 symbols/min [2025-10-13T20:32:11.638525] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-13T20:32:11.667627] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:11.712675] [DEBUG] [LOCAL ] NOTE: Loaded 41512 existing records from primary storage. [2025-10-13T20:32:11.713002] [INFO ] [MAIN ] NOTE: Loaded 41512 existing records. [2025-10-13T20:32:11.946614] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T20:32:11.962322] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:32:11.963158] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-13T20:32:11.963375] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-13T20:32:11.964045] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-13T20:32:11.964139] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-13T20:32:12.343620] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:12.417929] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-13T20:32:13.217914] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-13T20:32:13.263365] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T20:32:14.017919] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-13T20:32:14.551125] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T20:32:14.817910] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-13T20:32:15.094669] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T20:32:15.526619] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T20:32:15.617940] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-13T20:32:16.417956] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-13T20:32:16.844274] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T20:32:17.217895] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-13T20:32:17.732371] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T20:32:18.018041] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-13T20:32:18.331618] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T20:32:18.817931] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-13T20:32:19.198313] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T20:32:19.574715] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T20:32:19.579812] [INFO ] [REMOTE ] NOG: Full fetch complete (73540 records). [2025-10-13T20:32:19.579967] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-13T20:32:19.582867] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:32:19.583126] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:32:19.583204] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:32:19.583287] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-13T20:32:19.583369] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-13T20:32:19.583410] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-13T20:32:19.583451] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-13T20:32:19.583534] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOG took 41.8s. Estimated remaining: 2h 0m 49s. Rate: 7.1 symbols/min [2025-10-13T20:32:19.623151] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-13T20:32:19.771481] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:19.771994] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-13T20:32:19.772104] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-13T20:32:19.772307] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-13T20:32:19.772359] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-13T20:32:19.772403] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-13T20:32:19.772437] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-13T20:32:20.162606] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:20.202447] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T20:32:20.417927] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-13T20:32:21.217941] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-13T20:32:21.584365] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T20:32:22.017925] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-13T20:32:22.049983] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T20:32:22.817968] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-13T20:32:23.104564] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T20:32:23.617930] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-13T20:32:23.961893] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T20:32:23.969796] [INFO ] [REMOTE ] NOK: Full fetch complete (77644 records). [2025-10-13T20:32:23.970061] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-13T20:32:24.369227] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-13T20:32:24.369524] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-13T20:32:24.371903] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-13T20:32:24.372367] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-13T20:32:24.374270] [DEBUG] [LOCAL ] NOK: Trimmed 77644 records to 53622 (keeping 200 days of data) [2025-10-13T20:32:24.423975] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-13T20:32:24.641955] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T20:32:24.757444] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-13T20:32:24.757680] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-13T20:32:24.757816] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOK took 43.8s. Estimated remaining: 2h 0m 39s. Rate: 7.1 symbols/min [2025-10-13T20:32:24.942459] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:24.942757] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-13T20:32:24.942808] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-13T20:32:24.942933] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-13T20:32:24.942975] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-13T20:32:24.943016] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-13T20:32:24.943050] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-13T20:32:25.233012] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-13T20:32:25.362374] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T20:32:25.375731] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:25.382607] [INFO ] [REMOTE ] NOMD: Full fetch complete (59541 records). [2025-10-13T20:32:25.382956] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-13T20:32:25.383990] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:32:25.384096] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:32:25.384165] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:32:25.384243] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-13T20:32:25.384321] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-13T20:32:25.384362] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-13T20:32:25.384406] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-13T20:32:25.384474] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 36.3s. Estimated remaining: 2h 0m 26s. Rate: 7.1 symbols/min [2025-10-13T20:32:25.582758] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:25.583276] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-13T20:32:25.583356] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-13T20:32:25.583538] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-13T20:32:25.583807] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-13T20:32:25.583938] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-13T20:32:25.584060] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-13T20:32:25.752632] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-13T20:32:26.019450] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-13T20:32:26.019314] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:26.817956] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-13T20:32:27.141160] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T20:32:27.617908] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-13T20:32:27.711327] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T20:32:28.417920] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-13T20:32:28.854516] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:32:28.855105] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-13T20:32:28.855281] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:32:28.855447] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-13T20:32:28.855519] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:32:28.855598] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-13T20:32:28.855706] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-13T20:32:28.855757] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-13T20:32:28.855904] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-13T20:32:28.855977] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NP took 3.5s. Estimated remaining: 2h 0m 15s. Rate: 7.1 symbols/min [2025-10-13T20:32:29.055757] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:29.059043] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-13T20:32:29.059174] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-13T20:32:29.069122] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-13T20:32:29.069246] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-13T20:32:29.069290] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-13T20:32:29.069332] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-13T20:32:29.069363] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-13T20:32:29.218782] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-13T20:32:29.445250] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:29.474921] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T20:32:30.018071] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-13T20:32:30.317542] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:32:30.317927] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-13T20:32:30.318047] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:32:30.318104] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-13T20:32:30.318219] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:32:30.318304] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-13T20:32:30.318380] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-13T20:32:30.318429] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-13T20:32:30.318484] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-13T20:32:30.318544] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NPB took 1.5s. Estimated remaining: 2h 0m 2s. Rate: 7.1 symbols/min [2025-10-13T20:32:30.525391] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:30.525552] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-13T20:32:30.525597] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-13T20:32:30.525782] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-13T20:32:30.525856] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-13T20:32:30.525953] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-13T20:32:30.526023] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-13T20:32:30.823369] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-13T20:32:30.892988] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:31.255244] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T20:32:31.617932] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-13T20:32:32.417928] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-13T20:32:32.730220] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T20:32:32.820942] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T20:32:33.217959] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-13T20:32:34.017926] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-13T20:32:34.521393] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T20:32:34.817937] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-13T20:32:35.172221] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T20:32:35.617934] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-13T20:32:35.960635] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T20:32:36.003674] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T20:32:36.417932] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-13T20:32:37.217914] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-13T20:32:37.520199] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T20:32:37.764625] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:32:38.018013] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-13T20:32:38.817904] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-13T20:32:39.058766] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T20:32:39.088550] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T20:32:39.617910] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-13T20:32:40.417941] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-13T20:32:40.756177] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T20:32:40.759776] [INFO ] [REMOTE ] NOTE: Full fetch complete (62336 records). [2025-10-13T20:32:40.759927] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-13T20:32:41.166491] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T20:32:41.223513] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-13T20:32:41.251580] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-13T20:32:41.251951] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-13T20:32:41.253780] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-13T20:32:41.254491] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-13T20:32:41.255243] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T20:32:41.262415] [DEBUG] [LOCAL ] NOTE: Trimmed 62336 records to 40651 (keeping 200 days of data) [2025-10-13T20:32:41.548872] [DEBUG] [LOCAL ] NOTE: Primary data saved (40651 records). [2025-10-13T20:32:41.549048] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-13T20:32:41.549190] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOTE took 30.1s. Estimated remaining: 1h 59m 55s. Rate: 7.1 symbols/min [2025-10-13T20:32:41.723207] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:32:41.735914] [DEBUG] [LOCAL ] NPFD: Loaded 10119 existing records from primary storage. [2025-10-13T20:32:41.736129] [INFO ] [MAIN ] NPFD: Loaded 10119 existing records. [2025-10-13T20:32:41.910312] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:32:41.910576] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-13T20:32:41.910629] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-13T20:32:41.911023] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-13T20:32:41.911092] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-13T20:32:42.023038] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-13T20:32:42.263204] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:32:42.817902] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-13T20:32:43.118088] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T20:32:43.311993] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T20:32:43.617955] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-13T20:32:43.823682] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T20:32:44.417932] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-13T20:32:45.217961] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-13T20:32:45.233077] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T20:32:45.973208] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-13T20:32:46.017911] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-13T20:32:46.818012] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-13T20:32:47.206150] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T20:32:47.617888] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-13T20:32:47.782579] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T20:32:48.266243] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-13T20:32:48.417921] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-13T20:32:49.217900] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-13T20:32:49.543186] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T20:32:49.909199] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T20:32:49.961406] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T20:32:50.017888] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-13T20:32:50.817918] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-13T20:32:50.840488] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T20:32:51.617915] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-13T20:32:52.417914] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-13T20:32:52.530862] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T20:32:52.783389] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:32:53.218027] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-13T20:32:53.989966] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T20:32:54.017967] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-13T20:32:54.241255] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T20:32:54.817930] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-13T20:32:55.235590] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T20:32:55.553124] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:32:55.558379] [INFO ] [REMOTE ] NOV: Full fetch complete (76599 records). [2025-10-13T20:32:55.558539] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-13T20:32:55.559294] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:32:55.559388] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:32:55.559431] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:32:55.559502] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-13T20:32:55.559565] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-13T20:32:55.559604] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-13T20:32:55.559695] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-13T20:32:55.559820] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOV took 36.0s. Estimated remaining: 1h 59m 50s. Rate: 7.1 symbols/min [2025-10-13T20:32:55.617932] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-13T20:32:56.417926] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-13T20:32:56.432896] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T20:32:57.218037] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-13T20:32:58.017925] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-13T20:32:58.117570] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T20:32:58.576777] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T20:32:58.817995] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-13T20:32:59.181834] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T20:32:59.617962] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-13T20:32:59.676026] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:33:00.417908] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-13T20:33:00.672632] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T20:33:01.218020] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-13T20:33:01.418985] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T20:33:02.017958] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-13T20:33:02.703541] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:33:02.705172] [INFO ] [REMOTE ] NPFD: Full fetch complete (14605 records). [2025-10-13T20:33:02.705251] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-13T20:33:02.823100] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-13T20:33:03.097881] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-13T20:33:03.098119] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-13T20:33:03.098565] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-13T20:33:03.098639] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-13T20:33:03.099362] [DEBUG] [LOCAL ] NPFD: Trimmed 14605 records to 9968 (keeping 200 days of data) [2025-10-13T20:33:03.163010] [DEBUG] [LOCAL ] NPFD: Primary data saved (9968 records). [2025-10-13T20:33:03.163160] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-13T20:33:03.163243] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NPFD took 21.6s. Estimated remaining: 1h 59m 41s. Rate: 7.1 symbols/min [2025-10-13T20:33:03.352023] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-13T20:33:03.617900] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-13T20:33:04.003902] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T20:33:04.092326] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T20:33:04.097337] [INFO ] [REMOTE ] NOW: Full fetch complete (70296 records). [2025-10-13T20:33:04.097477] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-13T20:33:04.101946] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:33:04.102060] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:33:04.102118] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:33:04.102159] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-13T20:33:04.102217] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-13T20:33:04.102252] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-13T20:33:04.102290] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-13T20:33:04.102362] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NOW took 39.3s. Estimated remaining: 1h 59m 29s. Rate: 7.1 symbols/min [2025-10-13T20:33:04.418002] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-13T20:33:04.915009] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T20:33:04.918186] [INFO ] [REMOTE ] NPCT: Full fetch complete (24706 records). [2025-10-13T20:33:04.918322] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-13T20:33:04.919122] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:33:04.919232] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:33:04.919290] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:33:04.919344] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-13T20:33:04.919427] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-13T20:33:04.919524] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-13T20:33:04.919607] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-13T20:33:04.919726] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 34.6s. Estimated remaining: 1h 59m 16s. Rate: 7.1 symbols/min [2025-10-13T20:33:05.526194] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:05.529313] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:05.598294] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-13T20:33:05.602469] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:05.600807] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-13T20:33:05.602700] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-13T20:33:05.623146] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:05.602931] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-13T20:33:05.623628] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-13T20:33:05.623209] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-13T20:33:05.624027] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-13T20:33:05.624426] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-13T20:33:05.624199] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-13T20:33:05.624530] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-13T20:33:05.624628] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-13T20:33:05.624721] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-13T20:33:05.785328] [DEBUG] [LOCAL ] NPK: Loaded 8253 existing records from primary storage. [2025-10-13T20:33:05.820911] [INFO ] [MAIN ] NPK: Loaded 8253 existing records. [2025-10-13T20:33:05.820274] [DEBUG] [LOCAL ] NPV: Loaded 5337 existing records from primary storage. [2025-10-13T20:33:05.867789] [INFO ] [MAIN ] NPV: Loaded 5337 existing records. [2025-10-13T20:33:06.599049] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:33:06.653684] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-13T20:33:06.681630] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-13T20:33:06.728460] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:33:06.756046] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-13T20:33:06.745101] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-13T20:33:06.782803] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-13T20:33:06.793396] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-13T20:33:06.864472] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:06.861142] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-13T20:33:06.931963] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-13T20:33:06.925909] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:06.937668] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-13T20:33:06.926725] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-13T20:33:07.697267] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:07.720711] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:07.722186] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-13T20:33:07.721538] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-13T20:33:07.976143] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:33:08.172791] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T20:33:08.396104] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T20:33:08.417918] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-13T20:33:08.602526] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T20:33:09.217932] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-13T20:33:09.335774] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:33:09.931503] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T20:33:10.017945] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-13T20:33:10.818025] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-13T20:33:10.989515] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T20:33:11.617947] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-13T20:33:12.252718] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T20:33:12.418040] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-13T20:33:12.547732] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T20:33:13.063881] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T20:33:13.217964] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-13T20:33:14.018011] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-13T20:33:14.139970] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:33:14.684217] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T20:33:14.817957] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-13T20:33:15.617930] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-13T20:33:15.769912] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T20:33:16.418016] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-13T20:33:16.766149] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T20:33:17.218044] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-13T20:33:17.910313] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T20:33:17.930539] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T20:33:18.017966] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-13T20:33:18.720588] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T20:33:18.817934] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-13T20:33:19.617998] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-13T20:33:19.726861] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:33:20.417944] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-13T20:33:21.131030] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T20:33:21.217999] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-13T20:33:21.289293] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T20:33:22.017897] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-13T20:33:22.366757] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T20:33:22.817937] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-13T20:33:23.086404] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T20:33:23.617957] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-13T20:33:24.384628] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T20:33:24.417936] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-13T20:33:24.513869] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T20:33:25.162548] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T20:33:25.217933] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-13T20:33:25.948730] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T20:33:26.017946] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-13T20:33:26.817932] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-13T20:33:26.839854] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T20:33:27.617937] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-13T20:33:28.397611] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T20:33:28.430048] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-13T20:33:28.435724] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T20:33:29.118660] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T20:33:29.217910] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-13T20:33:29.925349] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T20:33:30.017940] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-13T20:33:30.817896] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-13T20:33:31.552675] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T20:33:31.617885] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-13T20:33:31.809255] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:33:32.301827] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:33:32.303235] [INFO ] [REMOTE ] NPK: Full fetch complete (10941 records). [2025-10-13T20:33:32.303303] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-13T20:33:32.423127] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-13T20:33:32.670294] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-13T20:33:32.670372] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-13T20:33:32.670695] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-13T20:33:32.670757] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-13T20:33:32.671196] [DEBUG] [LOCAL ] NPK: Trimmed 10941 records to 8253 (keeping 200 days of data) [2025-10-13T20:33:32.726922] [DEBUG] [LOCAL ] NPK: Primary data saved (8253 records). [2025-10-13T20:33:32.727069] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-13T20:33:32.727152] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPK took 27.8s. Estimated remaining: 1h 59m 18s. Rate: 7.1 symbols/min [2025-10-13T20:33:32.895882] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:32.896049] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-13T20:33:32.896087] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-13T20:33:32.896686] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-13T20:33:32.896741] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-13T20:33:32.896785] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-13T20:33:32.896818] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-13T20:33:33.223014] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-13T20:33:33.263747] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:33.287321] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T20:33:34.017920] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-13T20:33:34.206119] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:33:34.817923] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-13T20:33:35.505992] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T20:33:35.617994] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-13T20:33:36.420729] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-13T20:33:36.425583] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T20:33:36.693011] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T20:33:37.035974] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T20:33:37.217955] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-13T20:33:38.017954] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-13T20:33:38.547032] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T20:33:38.817969] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-13T20:33:39.491752] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:33:39.493303] [INFO ] [REMOTE ] NPV: Full fetch complete (7071 records). [2025-10-13T20:33:39.493388] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-13T20:33:39.622277] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-13T20:33:39.943022] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T20:33:39.943261] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-13T20:33:39.952090] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-13T20:33:39.952585] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-13T20:33:39.952712] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-13T20:33:39.953674] [DEBUG] [LOCAL ] NPV: Trimmed 7071 records to 5318 (keeping 200 days of data) [2025-10-13T20:33:39.991982] [DEBUG] [LOCAL ] NPV: Primary data saved (5318 records). [2025-10-13T20:33:39.992160] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-13T20:33:39.992264] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPV took 35.1s. Estimated remaining: 1h 59m 9s. Rate: 7.1 symbols/min [2025-10-13T20:33:40.190575] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:40.203492] [DEBUG] [LOCAL ] NQP: Loaded 9329 existing records from primary storage. [2025-10-13T20:33:40.203772] [INFO ] [MAIN ] NQP: Loaded 9329 existing records. [2025-10-13T20:33:40.424458] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-13T20:33:40.424276] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:33:40.426143] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-13T20:33:40.426380] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-13T20:33:40.426740] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-13T20:33:40.426862] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-13T20:33:40.792774] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T20:33:40.919679] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:41.217921] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-13T20:33:42.018010] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-13T20:33:42.184945] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T20:33:42.286046] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T20:33:42.572529] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:33:42.574824] [INFO ] [REMOTE ] NPO: Full fetch complete (18404 records). [2025-10-13T20:33:42.574894] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-13T20:33:42.575314] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:33:42.575397] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:33:42.575439] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:33:42.575502] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-13T20:33:42.575563] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-13T20:33:42.575598] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-13T20:33:42.575636] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-13T20:33:42.575731] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 37.7s. Estimated remaining: 1h 58m 58s. Rate: 7.1 symbols/min [2025-10-13T20:33:42.753621] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:42.791709] [DEBUG] [LOCAL ] NRDY: Loaded 33215 existing records from primary storage. [2025-10-13T20:33:42.791991] [INFO ] [MAIN ] NRDY: Loaded 33215 existing records. [2025-10-13T20:33:42.823168] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-13T20:33:42.974388] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:33:42.974591] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-13T20:33:42.974639] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-13T20:33:42.975032] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-13T20:33:42.975087] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-13T20:33:43.320410] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:43.617937] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-13T20:33:43.723726] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T20:33:44.418020] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-13T20:33:45.217928] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-13T20:33:45.491811] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T20:33:46.017897] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-13T20:33:46.323871] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T20:33:46.817901] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-13T20:33:47.141074] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-13T20:33:47.408323] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T20:33:47.590832] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T20:33:47.617904] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-13T20:33:48.417967] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-13T20:33:49.136469] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T20:33:49.221155] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-13T20:33:50.017901] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-13T20:33:50.224786] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T20:33:50.764977] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T20:33:50.817892] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-13T20:33:51.617919] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-13T20:33:51.658667] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T20:33:51.662826] [INFO ] [REMOTE ] NPKI: Full fetch complete (55411 records). [2025-10-13T20:33:51.662932] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-13T20:33:51.663512] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:33:51.663594] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:33:51.663636] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:33:51.663734] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-13T20:33:51.663818] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-13T20:33:51.663874] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-13T20:33:51.663919] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-13T20:33:51.663976] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPKI took 46.7s. Estimated remaining: 1h 58m 50s. Rate: 7.1 symbols/min [2025-10-13T20:33:51.882450] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T20:33:51.900936] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:33:51.920857] [DEBUG] [LOCAL ] NREF: Loaded 8112 existing records from primary storage. [2025-10-13T20:33:51.921067] [INFO ] [MAIN ] NREF: Loaded 8112 existing records. [2025-10-13T20:33:52.106440] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:33:52.106672] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-13T20:33:52.106734] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-13T20:33:52.106944] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-13T20:33:52.107001] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-13T20:33:52.426564] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-13T20:33:52.471047] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:33:52.504973] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T20:33:53.217919] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-13T20:33:54.018022] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-13T20:33:54.452590] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T20:33:54.783773] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-13T20:33:54.818097] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-13T20:33:54.997680] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:33:55.617917] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-13T20:33:56.417936] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-13T20:33:56.471320] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T20:33:56.534982] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:33:57.217932] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-13T20:33:57.315272] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:33:57.967217] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T20:33:58.017895] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-13T20:33:58.818010] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-13T20:33:59.169556] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T20:33:59.617935] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-13T20:34:00.417930] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-13T20:34:00.567052] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T20:34:00.569129] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T20:34:01.217936] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-13T20:34:01.410873] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T20:34:02.017997] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-13T20:34:02.189467] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T20:34:02.817923] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-13T20:34:03.617957] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-13T20:34:03.754105] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T20:34:04.229533] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T20:34:04.417909] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-13T20:34:04.445520] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T20:34:05.059546] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:34:05.061379] [INFO ] [REMOTE ] NQP: Full fetch complete (13072 records). [2025-10-13T20:34:05.061482] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-13T20:34:05.223099] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-13T20:34:05.457874] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-13T20:34:05.457955] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-13T20:34:05.458368] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-13T20:34:05.458421] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-13T20:34:05.459005] [DEBUG] [LOCAL ] NQP: Trimmed 13072 records to 9236 (keeping 200 days of data) [2025-10-13T20:34:05.518923] [DEBUG] [LOCAL ] NQP: Primary data saved (9236 records). [2025-10-13T20:34:05.519072] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-13T20:34:05.519159] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 25.5s. Estimated remaining: 1h 58m 44s. Rate: 7.1 symbols/min [2025-10-13T20:34:05.694668] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:05.694871] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-13T20:34:05.694961] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-13T20:34:05.695082] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-13T20:34:05.695122] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-13T20:34:05.695162] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-13T20:34:05.695193] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-13T20:34:06.023021] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-13T20:34:06.060859] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:06.819504] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-13T20:34:06.824203] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T20:34:06.856812] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T20:34:06.861896] [INFO ] [REMOTE ] NPWR: Full fetch complete (59710 records). [2025-10-13T20:34:06.862030] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-13T20:34:06.862895] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:34:06.862997] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:34:06.863045] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:34:06.863120] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-13T20:34:06.863187] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-13T20:34:06.863236] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-13T20:34:06.863281] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-13T20:34:06.863347] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 34.1s. Estimated remaining: 1h 58m 32s. Rate: 7.1 symbols/min [2025-10-13T20:34:07.058593] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:07.107873] [DEBUG] [LOCAL ] NRGV: Loaded 44207 existing records from primary storage. [2025-10-13T20:34:07.108235] [INFO ] [MAIN ] NRGV: Loaded 44207 existing records. [2025-10-13T20:34:07.317253] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:34:07.317494] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-13T20:34:07.317541] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-13T20:34:07.318333] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-13T20:34:07.318391] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-13T20:34:07.631295] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-13T20:34:07.671736] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:08.417935] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-13T20:34:08.935966] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T20:34:09.190619] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T20:34:09.217910] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-13T20:34:09.311997] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T20:34:10.017915] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-13T20:34:10.086834] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T20:34:10.817927] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-13T20:34:11.617914] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-13T20:34:11.887542] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T20:34:12.177862] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T20:34:12.417929] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-13T20:34:12.982323] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T20:34:13.217904] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-13T20:34:14.017924] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-13T20:34:14.029239] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T20:34:14.091798] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T20:34:14.818018] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-13T20:34:15.617935] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-13T20:34:16.095677] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-13T20:34:16.132434] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:34:16.417968] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-13T20:34:16.428406] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T20:34:17.217957] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-13T20:34:18.017902] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-13T20:34:18.349540] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T20:34:18.817900] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-13T20:34:18.983212] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T20:34:19.390149] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T20:34:19.617938] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-13T20:34:19.728287] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T20:34:20.417935] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-13T20:34:21.217906] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-13T20:34:21.369436] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T20:34:21.371190] [INFO ] [REMOTE ] NREF: Full fetch complete (10964 records). [2025-10-13T20:34:21.371361] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-13T20:34:21.490461] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T20:34:21.774835] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-13T20:34:21.774911] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-13T20:34:21.775180] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-13T20:34:21.775218] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-13T20:34:21.775691] [DEBUG] [LOCAL ] NREF: Trimmed 10964 records to 8010 (keeping 200 days of data) [2025-10-13T20:34:21.827720] [DEBUG] [LOCAL ] NREF: Primary data saved (8010 records). [2025-10-13T20:34:21.827867] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-13T20:34:21.827951] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NREF took 30.2s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-13T20:34:21.994350] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:21.994520] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-13T20:34:21.994558] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-13T20:34:21.994736] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-13T20:34:21.994787] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-13T20:34:21.994829] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-13T20:34:21.994861] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-13T20:34:22.026869] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-13T20:34:22.351201] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:22.817911] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-13T20:34:23.325571] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T20:34:23.557746] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T20:34:23.617926] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-13T20:34:24.417933] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-13T20:34:24.549372] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T20:34:24.886980] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T20:34:24.890970] [INFO ] [REMOTE ] NRDY: Full fetch complete (50810 records). [2025-10-13T20:34:24.891076] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-13T20:34:25.223703] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-13T20:34:25.279672] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-13T20:34:25.279760] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-13T20:34:25.280521] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-13T20:34:25.280561] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-13T20:34:25.281711] [DEBUG] [LOCAL ] NRDY: Trimmed 50810 records to 32701 (keeping 200 days of data) [2025-10-13T20:34:25.506447] [DEBUG] [LOCAL ] NRDY: Primary data saved (32701 records). [2025-10-13T20:34:25.506598] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-13T20:34:25.506708] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 42.9s. Estimated remaining: 1h 58m 16s. Rate: 7.1 symbols/min [2025-10-13T20:34:25.677440] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:25.684586] [DEBUG] [LOCAL ] NRP: Loaded 4136 existing records from primary storage. [2025-10-13T20:34:25.684835] [INFO ] [MAIN ] NRP: Loaded 4136 existing records. [2025-10-13T20:34:25.860324] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:34:25.860555] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-13T20:34:25.860608] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-13T20:34:25.860821] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-13T20:34:25.860880] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-13T20:34:26.034512] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-13T20:34:26.220957] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:26.397630] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T20:34:26.817922] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-13T20:34:26.880044] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:34:27.224169] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T20:34:27.617950] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-13T20:34:27.733184] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T20:34:28.417947] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-13T20:34:29.217967] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-13T20:34:29.623301] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T20:34:29.773041] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T20:34:30.017958] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-13T20:34:30.136205] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T20:34:30.699161] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T20:34:30.817941] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-13T20:34:31.617927] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-13T20:34:32.330611] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T20:34:32.418011] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-13T20:34:32.921781] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T20:34:33.217947] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-13T20:34:33.816633] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T20:34:34.017899] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-13T20:34:34.330312] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:34:34.716507] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T20:34:34.818007] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-13T20:34:35.504296] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T20:34:35.617968] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-13T20:34:36.417995] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-13T20:34:37.217940] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-13T20:34:37.375434] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T20:34:37.881709] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T20:34:38.017918] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-13T20:34:38.343440] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T20:34:38.817960] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-13T20:34:39.138046] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:34:39.324825] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T20:34:39.617927] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-13T20:34:40.188132] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T20:34:40.417891] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-13T20:34:41.077733] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T20:34:41.217958] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-13T20:34:42.017953] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-13T20:34:42.817901] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-13T20:34:42.982123] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T20:34:42.987526] [INFO ] [REMOTE ] NRGV: Full fetch complete (62287 records). [2025-10-13T20:34:42.987639] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-13T20:34:43.368910] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-13T20:34:43.369008] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-13T20:34:43.369945] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-13T20:34:43.370010] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-13T20:34:43.371306] [DEBUG] [LOCAL ] NRGV: Trimmed 62287 records to 43608 (keeping 200 days of data) [2025-10-13T20:34:43.620554] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-13T20:34:43.627368] [DEBUG] [LOCAL ] NRGV: Primary data saved (43608 records). [2025-10-13T20:34:43.627503] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-13T20:34:43.627587] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRGV took 36.8s. Estimated remaining: 1h 58m 13s. Rate: 7.1 symbols/min [2025-10-13T20:34:43.796965] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:43.804778] [DEBUG] [LOCAL ] NRT: Loaded 4934 existing records from primary storage. [2025-10-13T20:34:43.810232] [INFO ] [MAIN ] NRT: Loaded 4934 existing records. [2025-10-13T20:34:43.852563] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T20:34:44.005870] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:34:44.006205] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-13T20:34:44.006394] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-13T20:34:44.006664] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-13T20:34:44.006885] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-13T20:34:44.251334] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-13T20:34:44.336628] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:34:44.353274] [INFO ] [REMOTE ] NRP: Full fetch complete (6311 records). [2025-10-13T20:34:44.358513] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-13T20:34:44.427467] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-13T20:34:44.508314] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:44.776534] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-13T20:34:44.776612] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-13T20:34:44.776857] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-13T20:34:44.776916] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-13T20:34:44.777297] [DEBUG] [LOCAL ] NRP: Trimmed 6311 records to 4115 (keeping 200 days of data) [2025-10-13T20:34:44.802496] [DEBUG] [LOCAL ] NRP: Primary data saved (4115 records). [2025-10-13T20:34:44.802575] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-13T20:34:44.802670] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRP took 19.3s. Estimated remaining: 1h 58m 1s. Rate: 7.1 symbols/min [2025-10-13T20:34:44.974301] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:44.974527] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-13T20:34:44.974572] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-13T20:34:44.974742] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-13T20:34:44.974797] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-13T20:34:44.974845] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-13T20:34:44.974880] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-13T20:34:45.223204] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-13T20:34:45.353547] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T20:34:45.388327] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:45.395411] [INFO ] [REMOTE ] NRG: Full fetch complete (76219 records). [2025-10-13T20:34:45.395610] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-13T20:34:45.396525] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:34:45.396632] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:34:45.396713] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:34:45.396760] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-13T20:34:45.396820] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-13T20:34:45.396860] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-13T20:34:45.396921] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-13T20:34:45.397008] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRG took 39.9s. Estimated remaining: 1h 57m 48s. Rate: 7.1 symbols/min [2025-10-13T20:34:45.565400] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:34:45.565574] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-13T20:34:45.565611] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-13T20:34:45.565741] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-13T20:34:45.565783] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-13T20:34:45.565823] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-13T20:34:45.565854] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-13T20:34:45.959529] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:34:46.017918] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-13T20:34:46.317123] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T20:34:46.818063] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-13T20:34:47.567669] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:34:47.617945] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-13T20:34:47.694596] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T20:34:48.417945] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-13T20:34:48.763000] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T20:34:49.217957] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-13T20:34:49.924475] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T20:34:50.017894] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-13T20:34:50.378869] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T20:34:50.818037] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-13T20:34:51.440149] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T20:34:51.509021] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T20:34:51.617968] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-13T20:34:52.417896] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-13T20:34:53.217905] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-13T20:34:53.399802] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T20:34:53.558508] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T20:34:53.681459] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T20:34:54.017941] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-13T20:34:54.719623] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T20:34:54.817956] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-13T20:34:55.512508] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T20:34:55.617923] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-13T20:34:56.301982] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T20:34:56.417934] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-13T20:34:57.159686] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T20:34:57.217921] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-13T20:34:57.949008] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T20:34:58.017938] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-13T20:34:58.817937] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-13T20:34:59.145722] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:34:59.573494] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T20:34:59.617902] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-13T20:35:00.417915] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-13T20:35:00.884074] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T20:35:01.218019] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-13T20:35:01.312893] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T20:35:02.018021] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-13T20:35:02.487251] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T20:35:02.817899] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-13T20:35:02.883495] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T20:35:03.344878] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:35:03.347716] [INFO ] [REMOTE ] NRK: Full fetch complete (27436 records). [2025-10-13T20:35:03.347858] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-13T20:35:03.348951] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:03.349093] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:03.349150] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:03.349209] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-13T20:35:03.349281] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-13T20:35:03.349374] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-13T20:35:03.349444] [DEBUG] [LOCAL ] NRK: No derivative data file found to delete. [2025-10-13T20:35:03.349557] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRK took 41.5s. Estimated remaining: 1h 57m 45s. Rate: 7.1 symbols/min [2025-10-13T20:35:03.546280] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:03.546563] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-13T20:35:03.546608] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-13T20:35:03.546781] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-13T20:35:03.546856] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-13T20:35:03.546901] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-13T20:35:03.546934] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-13T20:35:03.627419] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-13T20:35:03.971009] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:04.255155] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T20:35:04.417956] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-13T20:35:05.217936] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-13T20:35:06.018038] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-13T20:35:06.077277] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T20:35:06.109718] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T20:35:06.818002] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-13T20:35:07.533683] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T20:35:07.617998] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-13T20:35:08.418033] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-13T20:35:08.466430] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T20:35:08.891880] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-13T20:35:09.156502] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:35:09.157591] [INFO ] [REMOTE ] NRT: Full fetch complete (7939 records). [2025-10-13T20:35:09.157727] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-13T20:35:09.223199] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-13T20:35:09.511424] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-13T20:35:09.511506] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-13T20:35:09.511731] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-13T20:35:09.511793] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-13T20:35:09.512184] [DEBUG] [LOCAL ] NRT: Trimmed 7939 records to 4894 (keeping 200 days of data) [2025-10-13T20:35:09.540237] [DEBUG] [LOCAL ] NRT: Primary data saved (4894 records). [2025-10-13T20:35:09.540306] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-13T20:35:09.540421] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 25.9s. Estimated remaining: 1h 57m 35s. Rate: 7.1 symbols/min [2025-10-13T20:35:09.706168] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:09.706345] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-13T20:35:09.706383] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-13T20:35:09.706493] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-13T20:35:09.706533] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-13T20:35:09.706573] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-13T20:35:09.706660] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-13T20:35:10.023178] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-13T20:35:10.089292] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:10.644501] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T20:35:10.818011] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-13T20:35:11.366469] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T20:35:11.617926] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-13T20:35:12.194216] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T20:35:12.417960] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-13T20:35:12.905686] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T20:35:13.217952] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-13T20:35:14.017905] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-13T20:35:14.082922] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:35:14.817919] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-13T20:35:15.030694] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T20:35:15.368577] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T20:35:15.617899] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-13T20:35:16.024884] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T20:35:16.417948] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-13T20:35:17.217897] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-13T20:35:17.525392] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T20:35:17.734867] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T20:35:18.017945] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-13T20:35:18.120186] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:35:18.817945] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-13T20:35:19.298882] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T20:35:19.299821] [INFO ] [REMOTE ] NRUC: Full fetch complete (5369 records). [2025-10-13T20:35:19.299888] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-13T20:35:19.300226] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:19.300306] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:19.300348] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:19.300385] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-13T20:35:19.300456] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-13T20:35:19.300510] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-13T20:35:19.300552] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-13T20:35:19.300604] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 34.5s. Estimated remaining: 1h 57m 27s. Rate: 7.1 symbols/min [2025-10-13T20:35:19.466948] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:19.467122] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-13T20:35:19.467159] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-13T20:35:19.467265] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-13T20:35:19.467305] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-13T20:35:19.467345] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-13T20:35:19.467376] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-13T20:35:19.619853] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-13T20:35:19.839597] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:19.948209] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T20:35:20.417935] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-13T20:35:21.145597] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T20:35:21.217891] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-13T20:35:21.783713] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T20:35:22.018012] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-13T20:35:22.817921] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-13T20:35:23.005247] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T20:35:23.617949] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-13T20:35:24.074347] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T20:35:24.112373] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T20:35:24.418009] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-13T20:35:25.086601] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T20:35:25.217892] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-13T20:35:26.017930] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-13T20:35:26.181759] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T20:35:26.781454] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T20:35:26.817892] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-13T20:35:27.145865] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T20:35:27.617939] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-13T20:35:28.406700] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T20:35:28.417879] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-13T20:35:28.945697] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T20:35:29.217901] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-13T20:35:29.580408] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T20:35:30.017928] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-13T20:35:30.817898] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-13T20:35:31.115268] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T20:35:31.185129] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:35:31.559984] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:35:31.564669] [INFO ] [REMOTE ] NSA: Full fetch complete (61910 records). [2025-10-13T20:35:31.564791] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-13T20:35:31.565609] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:31.565734] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:31.565815] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:31.565898] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-13T20:35:31.565967] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-13T20:35:31.566004] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-13T20:35:31.566225] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-13T20:35:31.566300] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 46.2s. Estimated remaining: 1h 57m 21s. Rate: 7.1 symbols/min [2025-10-13T20:35:31.623142] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-13T20:35:31.750476] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:31.750622] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-13T20:35:31.750689] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-13T20:35:31.750801] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-13T20:35:31.750841] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-13T20:35:31.750882] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-13T20:35:31.750913] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-13T20:35:32.095405] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:32.417947] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-13T20:35:32.922747] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T20:35:33.217952] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-13T20:35:34.017909] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-13T20:35:34.314538] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T20:35:34.341117] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T20:35:34.817928] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-13T20:35:35.462243] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T20:35:35.617907] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-13T20:35:35.886135] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T20:35:36.417932] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-13T20:35:36.929781] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T20:35:37.217909] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-13T20:35:38.017908] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-13T20:35:38.095922] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T20:35:38.140251] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T20:35:38.818004] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-13T20:35:39.459623] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T20:35:39.617904] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-13T20:35:39.790204] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T20:35:39.794756] [INFO ] [REMOTE ] NSC: Full fetch complete (70375 records). [2025-10-13T20:35:39.794863] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-13T20:35:39.795468] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:39.795552] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:39.795594] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:39.795633] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-13T20:35:39.795729] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-13T20:35:39.795772] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-13T20:35:39.795813] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-13T20:35:39.795919] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSC took 36.4s. Estimated remaining: 1h 57m 12s. Rate: 7.1 symbols/min [2025-10-13T20:35:39.964250] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:39.964431] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-13T20:35:39.964467] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-13T20:35:39.964575] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-13T20:35:39.964616] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-13T20:35:39.964686] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-13T20:35:39.964750] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-13T20:35:40.306867] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:40.417887] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-13T20:35:41.217928] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-13T20:35:41.350618] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T20:35:42.017917] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-13T20:35:42.245165] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T20:35:42.289500] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T20:35:42.545783] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:35:42.549412] [INFO ] [REMOTE ] NSP: Full fetch complete (49554 records). [2025-10-13T20:35:42.549492] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-13T20:35:42.550099] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:42.550179] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:42.550223] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:42.550291] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-13T20:35:42.550374] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-13T20:35:42.550422] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-13T20:35:42.550476] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-13T20:35:42.550549] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSP took 33.0s. Estimated remaining: 1h 57m 1s. Rate: 7.1 symbols/min [2025-10-13T20:35:42.715050] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:42.715209] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-13T20:35:42.715246] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-13T20:35:42.715355] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-13T20:35:42.715395] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-13T20:35:42.715434] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-13T20:35:42.715466] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-13T20:35:42.823108] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-13T20:35:43.068310] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:43.617966] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-13T20:35:44.307943] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T20:35:44.417901] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-13T20:35:44.657766] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T20:35:44.980185] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T20:35:45.217924] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-13T20:35:46.017950] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-13T20:35:46.679953] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T20:35:46.817922] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-13T20:35:47.146793] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T20:35:47.617920] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-13T20:35:48.333752] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T20:35:48.417885] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-13T20:35:48.538960] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T20:35:49.217965] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-13T20:35:50.027553] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-13T20:35:50.031301] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T20:35:50.549518] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:35:50.553078] [INFO ] [REMOTE ] NTB: Full fetch complete (30474 records). [2025-10-13T20:35:50.553252] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-13T20:35:50.553902] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:35:50.553998] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:35:50.554071] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:35:50.554162] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-13T20:35:50.554252] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-13T20:35:50.554354] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-13T20:35:50.554421] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-13T20:35:50.554499] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 31.3s. Estimated remaining: 1h 56m 52s. Rate: 7.1 symbols/min [2025-10-13T20:35:50.784490] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:35:50.798503] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-13T20:35:50.798818] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-13T20:35:50.800577] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-13T20:35:50.800462] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T20:35:50.800697] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-13T20:35:50.810875] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-13T20:35:50.811305] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-13T20:35:50.823055] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-13T20:35:51.164843] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:35:51.414663] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T20:35:51.617922] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-13T20:35:52.162697] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T20:35:52.418005] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-13T20:35:53.217925] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-13T20:35:53.404517] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T20:35:54.017941] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-13T20:35:54.817927] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-13T20:35:55.042316] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T20:35:55.443564] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T20:35:55.627232] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-13T20:35:55.634213] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:35:56.417939] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-13T20:35:57.217963] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-13T20:35:57.566828] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T20:35:57.991164] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T20:35:58.017915] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-13T20:35:58.817926] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-13T20:35:58.918516] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-13T20:35:59.464396] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T20:35:59.617917] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-13T20:35:59.911526] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T20:36:00.150319] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T20:36:00.417942] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-13T20:36:00.666287] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-13T20:36:00.666953] [INFO ] [REMOTE ] NTEST: Full fetch complete (1992 records). [2025-10-13T20:36:00.667020] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-13T20:36:00.667340] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:00.667418] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:00.667459] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:00.667496] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-13T20:36:00.667553] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-13T20:36:00.667621] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-13T20:36:00.667722] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-13T20:36:00.667799] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTEST took 29.1s. Estimated remaining: 1h 56m 45s. Rate: 7.1 symbols/min [2025-10-13T20:36:00.833393] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:00.833551] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-13T20:36:00.833592] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-13T20:36:00.833738] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-13T20:36:00.833804] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-13T20:36:00.833868] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-13T20:36:00.833926] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-13T20:36:01.180124] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:01.217925] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-13T20:36:02.017898] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-13T20:36:02.817944] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-13T20:36:03.324352] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T20:36:03.617996] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-13T20:36:03.717141] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T20:36:04.417941] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-13T20:36:05.160313] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T20:36:05.217923] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-13T20:36:05.342773] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T20:36:05.974380] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T20:36:06.017892] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-13T20:36:06.817933] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-13T20:36:07.221115] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-13T20:36:07.624390] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-13T20:36:07.645830] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T20:36:08.417922] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-13T20:36:08.472877] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:36:09.217938] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-13T20:36:09.252207] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T20:36:10.018009] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-13T20:36:10.817942] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-13T20:36:10.911221] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-13T20:36:11.211518] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T20:36:11.617934] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-13T20:36:11.774093] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T20:36:12.417937] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-13T20:36:12.484186] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T20:36:13.218032] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-13T20:36:13.974633] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-13T20:36:14.023018] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-13T20:36:14.046237] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:36:14.818053] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-13T20:36:15.050436] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T20:36:15.184804] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-13T20:36:15.192423] [INFO ] [REMOTE ] NTR: Full fetch complete (75921 records). [2025-10-13T20:36:15.192633] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-13T20:36:15.193872] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:15.194073] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:15.194164] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:15.194257] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-13T20:36:15.194348] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-13T20:36:15.194408] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-13T20:36:15.194476] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-13T20:36:15.194566] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTR took 35.4s. Estimated remaining: 1h 56m 40s. Rate: 7.1 symbols/min [2025-10-13T20:36:15.366433] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:15.366598] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-13T20:36:15.366635] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-13T20:36:15.366771] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-13T20:36:15.366811] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-13T20:36:15.366850] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-13T20:36:15.366880] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-13T20:36:15.623166] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-13T20:36:15.719238] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:16.292561] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T20:36:16.417919] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-13T20:36:17.217907] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-13T20:36:18.013467] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-13T20:36:18.024453] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-13T20:36:18.567890] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T20:36:18.818041] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-13T20:36:18.881829] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T20:36:19.545356] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T20:36:19.617895] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-13T20:36:20.418020] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-13T20:36:20.865023] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T20:36:21.217944] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-13T20:36:21.291887] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T20:36:22.017947] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-13T20:36:22.817963] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-13T20:36:22.890829] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-13T20:36:22.943887] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:36:23.617925] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-13T20:36:23.765247] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T20:36:24.033659] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T20:36:24.418020] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-13T20:36:25.217936] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-13T20:36:25.740843] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:36:26.017920] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-13T20:36:26.544860] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T20:36:26.817953] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-13T20:36:26.869233] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-13T20:36:27.455762] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:36:27.460222] [INFO ] [REMOTE ] NTST: Full fetch complete (61102 records). [2025-10-13T20:36:27.460346] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-13T20:36:27.461309] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:27.461416] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:27.461493] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:27.461584] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-13T20:36:27.461700] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-13T20:36:27.461757] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-13T20:36:27.461803] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-13T20:36:27.461863] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTST took 44.9s. Estimated remaining: 1h 56m 33s. Rate: 7.1 symbols/min [2025-10-13T20:36:27.628780] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-13T20:36:27.632189] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:27.657594] [DEBUG] [LOCAL ] NUV: Loaded 24018 existing records from primary storage. [2025-10-13T20:36:27.657879] [INFO ] [MAIN ] NUV: Loaded 24018 existing records. [2025-10-13T20:36:27.840156] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:36:27.840511] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-13T20:36:27.840565] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-13T20:36:27.841001] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-13T20:36:27.841058] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-13T20:36:28.231402] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:28.234713] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T20:36:28.417901] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-13T20:36:29.217948] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-13T20:36:29.855380] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T20:36:29.894776] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-13T20:36:30.017899] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-13T20:36:30.514028] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T20:36:30.763399] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:36:30.769767] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-13T20:36:30.769946] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-13T20:36:30.770950] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:30.771050] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:30.771145] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:30.771206] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-13T20:36:30.771267] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-13T20:36:30.771311] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-13T20:36:30.771362] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-13T20:36:30.771433] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NU took 40.2s. Estimated remaining: 1h 56m 22s. Rate: 7.1 symbols/min [2025-10-13T20:36:30.823155] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-13T20:36:30.973294] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:31.037459] [DEBUG] [LOCAL ] NUVB: Loaded 52137 existing records from primary storage. [2025-10-13T20:36:31.038049] [INFO ] [MAIN ] NUVB: Loaded 52137 existing records. [2025-10-13T20:36:31.238465] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:36:31.238790] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-13T20:36:31.238846] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-13T20:36:31.239805] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-13T20:36:31.239865] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-13T20:36:31.625075] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-13T20:36:31.671840] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:32.417900] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-13T20:36:32.850439] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T20:36:33.200542] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T20:36:33.217924] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-13T20:36:33.570924] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T20:36:34.017934] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-13T20:36:34.642686] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T20:36:34.818040] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-13T20:36:35.213936] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T20:36:35.617942] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-13T20:36:36.405602] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:36:36.411622] [INFO ] [REMOTE ] NUE: Full fetch complete (74357 records). [2025-10-13T20:36:36.411915] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-13T20:36:36.413635] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:36.413896] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:36.413967] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:36.414044] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-13T20:36:36.414115] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-13T20:36:36.414156] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-13T20:36:36.414197] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-13T20:36:36.414264] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUE took 35.7s. Estimated remaining: 1h 56m 12s. Rate: 7.1 symbols/min [2025-10-13T20:36:36.424725] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-13T20:36:36.599600] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:36.629268] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T20:36:36.646578] [DEBUG] [LOCAL ] NUW: Loaded 7200 existing records from primary storage. [2025-10-13T20:36:36.646890] [INFO ] [MAIN ] NUW: Loaded 7200 existing records. [2025-10-13T20:36:36.832316] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:36:36.832581] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-13T20:36:36.832663] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-13T20:36:36.832908] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-13T20:36:36.832962] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-13T20:36:37.223297] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-13T20:36:37.261513] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:37.865603] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T20:36:38.017943] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-13T20:36:38.817906] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-13T20:36:38.873939] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T20:36:38.923872] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T20:36:39.617928] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-13T20:36:40.020987] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T20:36:40.418025] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-13T20:36:41.157511] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T20:36:41.217905] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-13T20:36:41.250098] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T20:36:42.018077] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-13T20:36:42.818025] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-13T20:36:42.844721] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:36:43.406832] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T20:36:43.617901] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-13T20:36:43.693373] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T20:36:44.417926] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-13T20:36:44.767489] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T20:36:45.218007] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-13T20:36:45.953584] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T20:36:46.017879] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-13T20:36:46.027568] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T20:36:46.817923] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-13T20:36:47.499921] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T20:36:47.618129] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-13T20:36:48.417921] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-13T20:36:48.557488] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T20:36:48.590003] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T20:36:48.859932] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:36:48.863573] [INFO ] [REMOTE ] NUS: Full fetch complete (53466 records). [2025-10-13T20:36:48.863700] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-13T20:36:48.864259] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:36:48.864343] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:36:48.864385] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:36:48.864424] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-13T20:36:48.864478] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-13T20:36:48.864511] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-13T20:36:48.864550] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-13T20:36:48.864604] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUS took 33.7s. Estimated remaining: 1h 56m 6s. Rate: 7.1 symbols/min [2025-10-13T20:36:49.082732] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:49.082938] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-13T20:36:49.082984] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-13T20:36:49.083102] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-13T20:36:49.083144] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-13T20:36:49.083184] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-13T20:36:49.083215] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-13T20:36:49.223183] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-13T20:36:49.577784] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:50.017949] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-13T20:36:50.817910] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-13T20:36:51.065066] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T20:36:51.178048] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T20:36:51.617920] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-13T20:36:52.109374] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T20:36:52.417929] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-13T20:36:52.432505] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T20:36:53.217923] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-13T20:36:53.921639] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T20:36:54.017937] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-13T20:36:54.295916] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T20:36:54.817998] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-13T20:36:55.326392] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T20:36:55.559636] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T20:36:55.617902] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-13T20:36:56.294152] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T20:36:56.417945] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-13T20:36:57.094045] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T20:36:57.217935] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-13T20:36:57.826819] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:36:57.827768] [INFO ] [REMOTE ] NUW: Full fetch complete (11084 records). [2025-10-13T20:36:57.827836] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-13T20:36:58.023109] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-13T20:36:58.188730] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-13T20:36:58.188821] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-13T20:36:58.189096] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-13T20:36:58.189136] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-13T20:36:58.189572] [DEBUG] [LOCAL ] NUW: Trimmed 11084 records to 6833 (keeping 200 days of data) [2025-10-13T20:36:58.231015] [DEBUG] [LOCAL ] NUW: Primary data saved (6833 records). [2025-10-13T20:36:58.231135] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-13T20:36:58.231226] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 21.8s. Estimated remaining: 1h 55m 58s. Rate: 7.1 symbols/min [2025-10-13T20:36:58.396356] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:36:58.396509] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-13T20:36:58.396546] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-13T20:36:58.396707] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-13T20:36:58.396790] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-13T20:36:58.396874] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-13T20:36:58.396919] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-13T20:36:58.745165] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:36:58.817959] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-13T20:36:59.617957] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-13T20:36:59.916473] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T20:37:00.202024] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T20:37:00.417911] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-13T20:37:00.809298] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T20:37:01.218023] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-13T20:37:01.393807] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T20:37:02.017928] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-13T20:37:02.516493] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T20:37:02.817924] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-13T20:37:03.617929] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-13T20:37:03.877248] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T20:37:04.002165] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T20:37:04.415202] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T20:37:04.419957] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-13T20:37:05.217907] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-13T20:37:06.018008] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-13T20:37:06.333606] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T20:37:06.336905] [INFO ] [REMOTE ] NUV: Full fetch complete (34034 records). [2025-10-13T20:37:06.337001] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-13T20:37:06.727780] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-13T20:37:06.727931] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-13T20:37:06.728751] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-13T20:37:06.728873] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-13T20:37:06.757812] [DEBUG] [LOCAL ] NUV: Trimmed 34034 records to 23505 (keeping 200 days of data) [2025-10-13T20:37:06.759822] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-13T20:37:06.818527] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-13T20:37:06.918191] [DEBUG] [LOCAL ] NUV: Primary data saved (23505 records). [2025-10-13T20:37:06.918333] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-13T20:37:06.918419] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUV took 39.5s. Estimated remaining: 1h 55m 50s. Rate: 7.1 symbols/min [2025-10-13T20:37:07.103041] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:07.103225] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-13T20:37:07.103265] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-13T20:37:07.103382] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-13T20:37:07.103428] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-13T20:37:07.103510] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-13T20:37:07.103567] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-13T20:37:07.426185] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T20:37:07.492704] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:07.617919] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-13T20:37:08.234045] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T20:37:08.418045] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-13T20:37:09.218021] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-13T20:37:09.789193] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T20:37:10.017953] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-13T20:37:10.244159] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-13T20:37:10.817918] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-13T20:37:11.019512] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T20:37:11.025832] [INFO ] [REMOTE ] NUVB: Full fetch complete (72967 records). [2025-10-13T20:37:11.025977] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-13T20:37:11.463299] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-13T20:37:11.465813] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-13T20:37:11.467457] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-13T20:37:11.468148] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-13T20:37:11.471175] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T20:37:11.480235] [DEBUG] [LOCAL ] NUVB: Trimmed 72967 records to 51503 (keeping 200 days of data) [2025-10-13T20:37:11.650703] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-13T20:37:11.790379] [DEBUG] [LOCAL ] NUVB: Primary data saved (51503 records). [2025-10-13T20:37:11.790533] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-13T20:37:11.790626] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUVB took 41.0s. Estimated remaining: 1h 55m 39s. Rate: 7.1 symbols/min [2025-10-13T20:37:11.967169] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:11.989125] [DEBUG] [LOCAL ] NVR: Loaded 18768 existing records from primary storage. [2025-10-13T20:37:11.989362] [INFO ] [MAIN ] NVR: Loaded 18768 existing records. [2025-10-13T20:37:12.170179] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:37:12.170397] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-13T20:37:12.170444] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-13T20:37:12.170763] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-13T20:37:12.170821] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-13T20:37:12.424736] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-13T20:37:12.531914] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:13.112196] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:37:13.218036] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-13T20:37:13.570746] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-13T20:37:13.887509] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T20:37:14.017992] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-13T20:37:14.293069] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T20:37:14.817928] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-13T20:37:15.618019] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-13T20:37:16.160391] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T20:37:16.417892] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-13T20:37:16.625998] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-13T20:37:16.808808] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T20:37:17.218013] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-13T20:37:17.710087] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T20:37:18.017914] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-13T20:37:18.476746] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T20:37:18.818013] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-13T20:37:19.617893] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-13T20:37:19.643198] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:37:19.984583] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T20:37:20.418024] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-13T20:37:20.921322] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T20:37:21.217931] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-13T20:37:21.574534] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T20:37:22.017936] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-13T20:37:22.818003] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-13T20:37:23.406752] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T20:37:23.617909] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-13T20:37:23.708220] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T20:37:23.982830] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-13T20:37:24.417963] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-13T20:37:24.642405] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T20:37:25.217957] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-13T20:37:26.018000] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-13T20:37:26.582283] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T20:37:26.817952] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-13T20:37:26.860704] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T20:37:27.046114] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-13T20:37:27.617965] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-13T20:37:28.078970] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T20:37:28.340632] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:37:28.343981] [INFO ] [REMOTE ] NVG: Full fetch complete (39986 records). [2025-10-13T20:37:28.344139] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-13T20:37:28.345462] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:37:28.345881] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:37:28.345967] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:37:28.346055] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-13T20:37:28.346145] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-13T20:37:28.346201] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-13T20:37:28.346280] [DEBUG] [LOCAL ] NVG: No derivative data file found to delete. [2025-10-13T20:37:28.346407] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVG took 39.5s. Estimated remaining: 1h 55m 35s. Rate: 7.1 symbols/min [2025-10-13T20:37:28.423061] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-13T20:37:28.521688] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:28.521926] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-13T20:37:28.521981] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-13T20:37:28.522092] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-13T20:37:28.522133] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-13T20:37:28.522173] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-13T20:37:28.522204] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-13T20:37:28.872725] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:29.073033] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:37:29.076407] [INFO ] [REMOTE ] NVGS: Full fetch complete (41625 records). [2025-10-13T20:37:29.076584] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-13T20:37:29.077439] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:37:29.077536] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:37:29.077605] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:37:29.077671] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-13T20:37:29.077761] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-13T20:37:29.077800] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-13T20:37:29.077840] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-13T20:37:29.077905] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVGS took 30.8s. Estimated remaining: 1h 55m 23s. Rate: 7.1 symbols/min [2025-10-13T20:37:29.228996] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-13T20:37:29.265502] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:29.266026] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-13T20:37:29.266185] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-13T20:37:29.266321] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-13T20:37:29.266364] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-13T20:37:29.266407] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-13T20:37:29.266440] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-13T20:37:29.646802] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:30.017944] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-13T20:37:30.529064] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T20:37:30.817930] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-13T20:37:31.617929] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-13T20:37:31.842345] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T20:37:32.226194] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T20:37:32.418028] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-13T20:37:33.218006] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-13T20:37:33.950501] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T20:37:34.017957] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-13T20:37:34.406168] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-13T20:37:34.789891] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:37:34.817904] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-13T20:37:35.455016] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T20:37:35.617946] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-13T20:37:36.331083] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T20:37:36.417962] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-13T20:37:36.741635] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T20:37:37.217939] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-13T20:37:37.345021] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T20:37:38.017998] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-13T20:37:38.431100] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T20:37:38.817940] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-13T20:37:38.983664] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T20:37:38.986298] [INFO ] [REMOTE ] NVR: Full fetch complete (29044 records). [2025-10-13T20:37:38.986867] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-13T20:37:39.395783] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-13T20:37:39.395929] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-13T20:37:39.396952] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-13T20:37:39.397021] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-13T20:37:39.398399] [DEBUG] [LOCAL ] NVR: Trimmed 29044 records to 18521 (keeping 200 days of data) [2025-10-13T20:37:39.538109] [DEBUG] [LOCAL ] NVR: Primary data saved (18521 records). [2025-10-13T20:37:39.538329] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-13T20:37:39.538445] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 27.7s. Estimated remaining: 1h 55m 15s. Rate: 7.1 symbols/min [2025-10-13T20:37:39.623184] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-13T20:37:39.725220] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:39.725483] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-13T20:37:39.725537] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-13T20:37:39.725798] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-13T20:37:39.725842] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-13T20:37:39.725883] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-13T20:37:39.725917] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-13T20:37:40.128025] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:40.418045] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-13T20:37:41.217911] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-13T20:37:41.700074] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-13T20:37:41.833920] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T20:37:42.023139] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-13T20:37:42.046436] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T20:37:42.823075] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-13T20:37:42.842307] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:37:43.617939] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-13T20:37:44.417925] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-13T20:37:44.454688] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T20:37:44.827070] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-13T20:37:45.175243] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T20:37:45.217912] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-13T20:37:46.017917] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-13T20:37:46.116948] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T20:37:46.669808] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T20:37:46.817930] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-13T20:37:47.410261] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T20:37:47.617930] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-13T20:37:47.989492] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T20:37:48.417938] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-13T20:37:49.217950] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-13T20:37:50.017958] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-13T20:37:50.244590] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-13T20:37:50.300146] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T20:37:50.817961] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-13T20:37:51.369474] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T20:37:51.617930] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-13T20:37:51.652311] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:37:52.418024] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-13T20:37:53.217965] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-13T20:37:53.464626] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T20:37:53.777406] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-13T20:37:54.018007] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-13T20:37:54.206710] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T20:37:54.600796] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T20:37:54.818026] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-13T20:37:55.627973] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-13T20:37:55.630842] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T20:37:55.637774] [INFO ] [REMOTE ] NVO: Full fetch complete (77566 records). [2025-10-13T20:37:55.637962] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-13T20:37:55.639071] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:37:55.639197] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:37:55.639242] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:37:55.639313] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-13T20:37:55.639400] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-13T20:37:55.639462] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-13T20:37:55.639506] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-13T20:37:55.639573] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVO took 48.7s. Estimated remaining: 1h 55m 11s. Rate: 7.1 symbols/min [2025-10-13T20:37:55.823712] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:55.824154] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-13T20:37:55.824234] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-13T20:37:55.824847] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-13T20:37:55.825077] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-13T20:37:55.825213] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-13T20:37:55.825409] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-13T20:37:55.974456] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T20:37:56.245945] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:56.417927] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-13T20:37:57.223130] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-13T20:37:57.237044] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T20:37:58.018054] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-13T20:37:58.441320] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T20:37:58.466570] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T20:37:58.472300] [INFO ] [REMOTE ] NVRI: Full fetch complete (55457 records). [2025-10-13T20:37:58.472441] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-13T20:37:58.473205] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:37:58.473325] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:37:58.473369] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:37:58.473440] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-13T20:37:58.473511] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-13T20:37:58.473549] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-13T20:37:58.473589] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-13T20:37:58.473674] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVRI took 30.1s. Estimated remaining: 1h 54m 60s. Rate: 7.1 symbols/min [2025-10-13T20:37:58.663030] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:37:58.663313] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-13T20:37:58.663358] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-13T20:37:58.663484] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-13T20:37:58.663528] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-13T20:37:58.663571] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-13T20:37:58.663603] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-13T20:37:58.830045] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-13T20:37:59.041826] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:37:59.076300] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T20:37:59.617966] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-13T20:38:00.370503] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T20:38:00.417908] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-13T20:38:01.217937] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-13T20:38:01.369885] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T20:38:02.017902] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-13T20:38:02.608611] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-13T20:38:02.817974] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-13T20:38:02.965260] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T20:38:03.617956] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-13T20:38:03.668209] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T20:38:04.418020] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-13T20:38:04.646491] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T20:38:05.217965] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-13T20:38:05.460301] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T20:38:06.017924] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-13T20:38:06.136509] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T20:38:06.791220] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T20:38:06.817936] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-13T20:38:07.513320] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:38:07.519078] [INFO ] [REMOTE ] NVST: Full fetch complete (73764 records). [2025-10-13T20:38:07.519244] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-13T20:38:07.520167] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:07.520290] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:07.520336] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:07.520377] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-13T20:38:07.520435] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-13T20:38:07.520472] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-13T20:38:07.520513] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-13T20:38:07.520576] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVST took 28.0s. Estimated remaining: 1h 54m 52s. Rate: 7.1 symbols/min [2025-10-13T20:38:07.621300] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-13T20:38:07.709944] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:07.710361] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-13T20:38:07.710428] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-13T20:38:07.710694] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-13T20:38:07.710781] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-13T20:38:07.710918] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-13T20:38:07.711068] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-13T20:38:07.849303] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T20:38:08.150869] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:08.360483] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:38:08.365902] [INFO ] [REMOTE ] NVS: Full fetch complete (74461 records). [2025-10-13T20:38:08.366072] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-13T20:38:08.366977] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:08.367084] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:08.367129] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:08.367171] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-13T20:38:08.367228] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-13T20:38:08.367265] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-13T20:38:08.367309] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-13T20:38:08.367370] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVS took 39.3s. Estimated remaining: 1h 54m 39s. Rate: 7.1 symbols/min [2025-10-13T20:38:08.423224] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-13T20:38:08.547489] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:08.547680] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-13T20:38:08.547733] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-13T20:38:08.547869] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-13T20:38:08.547945] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-13T20:38:08.548046] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-13T20:38:08.548092] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-13T20:38:08.895659] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:09.217924] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-13T20:38:10.017924] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-13T20:38:10.299696] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T20:38:10.392085] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T20:38:10.817962] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-13T20:38:11.626476] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-13T20:38:11.629322] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T20:38:12.134359] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T20:38:12.417899] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-13T20:38:13.217927] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-13T20:38:13.413352] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T20:38:13.588405] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T20:38:14.018043] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-13T20:38:14.817945] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-13T20:38:15.036905] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T20:38:15.617890] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-13T20:38:15.883342] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T20:38:16.246243] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T20:38:16.417944] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-13T20:38:17.217917] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-13T20:38:17.528780] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T20:38:17.812615] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T20:38:18.017965] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-13T20:38:18.537842] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T20:38:18.818004] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-13T20:38:19.176981] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T20:38:19.618023] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-13T20:38:20.208545] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T20:38:20.417935] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-13T20:38:21.217898] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-13T20:38:21.668003] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T20:38:21.703791] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T20:38:22.017922] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-13T20:38:22.817925] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-13T20:38:23.003452] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T20:38:23.143913] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T20:38:23.617939] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-13T20:38:24.417950] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-13T20:38:24.775307] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T20:38:24.997688] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T20:38:25.217920] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-13T20:38:25.557399] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T20:38:26.017996] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-13T20:38:26.817910] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-13T20:38:27.086440] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T20:38:27.617901] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-13T20:38:27.946716] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T20:38:27.997794] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T20:38:28.417962] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-13T20:38:29.217911] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-13T20:38:29.408174] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T20:38:29.799727] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T20:38:30.017962] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-13T20:38:30.278821] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T20:38:30.817932] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-13T20:38:31.405826] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T20:38:31.617921] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-13T20:38:32.193222] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:38:32.195744] [INFO ] [REMOTE ] NWN: Full fetch complete (37093 records). [2025-10-13T20:38:32.195816] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-13T20:38:32.196387] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:32.196479] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:32.196521] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:32.196558] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-13T20:38:32.196611] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-13T20:38:32.196671] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-13T20:38:32.196758] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-13T20:38:32.196834] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWN took 24.7s. Estimated remaining: 1h 54m 39s. Rate: 7.1 symbols/min [2025-10-13T20:38:32.396733] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:32.404476] [DEBUG] [LOCAL ] NXC: Loaded 4152 existing records from primary storage. [2025-10-13T20:38:32.404706] [INFO ] [MAIN ] NXC: Loaded 4152 existing records. [2025-10-13T20:38:32.425292] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-13T20:38:32.605982] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T20:38:32.626067] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:38:32.637095] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-13T20:38:32.637197] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-13T20:38:32.637949] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-13T20:38:32.638048] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-13T20:38:32.991136] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:33.217919] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-13T20:38:33.881952] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T20:38:34.017911] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-13T20:38:34.817957] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-13T20:38:35.102456] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T20:38:35.434289] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T20:38:35.617959] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-13T20:38:36.252941] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:38:36.258057] [INFO ] [REMOTE ] NVT: Full fetch complete (74216 records). [2025-10-13T20:38:36.258158] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-13T20:38:36.259765] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:36.259872] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:36.260211] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:36.260456] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-13T20:38:36.260617] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-13T20:38:36.260811] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-13T20:38:36.260986] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-13T20:38:36.261122] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVT took 40.6s. Estimated remaining: 1h 54m 28s. Rate: 7.1 symbols/min [2025-10-13T20:38:36.419904] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-13T20:38:36.468181] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:36.473328] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T20:38:36.473799] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-13T20:38:36.485099] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-13T20:38:36.485395] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-13T20:38:36.485671] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-13T20:38:36.486149] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-13T20:38:36.486394] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-13T20:38:36.846922] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:37.217915] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-13T20:38:37.517393] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:38:37.517781] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-13T20:38:37.517865] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:38:37.517913] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-13T20:38:37.517945] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:38:37.518028] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-13T20:38:37.518097] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-13T20:38:37.518132] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-13T20:38:37.518170] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-13T20:38:37.518216] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NXDR took 1.3s. Estimated remaining: 1h 54m 16s. Rate: 7.1 symbols/min [2025-10-13T20:38:38.017912] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-13T20:38:38.145233] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T20:38:38.817924] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-13T20:38:39.437010] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:38:39.440614] [INFO ] [REMOTE ] NX: Full fetch complete (47735 records). [2025-10-13T20:38:39.440806] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-13T20:38:39.441787] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:39.441889] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:39.441944] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:39.441987] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-13T20:38:39.442071] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-13T20:38:39.442128] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-13T20:38:39.442175] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-13T20:38:39.442238] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NX took 31.1s. Estimated remaining: 1h 54m 4s. Rate: 7.1 symbols/min [2025-10-13T20:38:39.617907] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-13T20:38:39.653754] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T20:38:40.421420] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-13T20:38:40.435686] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T20:38:41.217928] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-13T20:38:41.246206] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:38:41.251827] [INFO ] [REMOTE ] NWG: Full fetch complete (73265 records). [2025-10-13T20:38:41.252006] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-13T20:38:41.252702] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:38:41.252788] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:38:41.252833] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:38:41.252899] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-13T20:38:41.252963] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-13T20:38:41.252999] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-13T20:38:41.253064] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-13T20:38:41.253126] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NWG took 42.8s. Estimated remaining: 1h 53m 52s. Rate: 7.1 symbols/min [2025-10-13T20:38:41.812467] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T20:38:42.017963] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-13T20:38:42.708970] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T20:38:42.817949] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-13T20:38:43.457603] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T20:38:43.617941] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-13T20:38:44.239439] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-13T20:38:44.417938] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-13T20:38:45.076471] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T20:38:45.218016] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-13T20:38:45.864300] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T20:38:46.017971] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-13T20:38:46.696966] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T20:38:46.817914] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-13T20:38:47.326541] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T20:38:47.617945] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-13T20:38:48.378798] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T20:38:48.417897] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-13T20:38:49.042173] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:38:49.043047] [INFO ] [REMOTE ] NXC: Full fetch complete (5697 records). [2025-10-13T20:38:49.043113] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-13T20:38:49.386452] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-13T20:38:49.386536] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-13T20:38:49.386758] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-13T20:38:49.386819] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-13T20:38:49.387188] [DEBUG] [LOCAL ] NXC: Trimmed 5697 records to 4109 (keeping 200 days of data) [2025-10-13T20:38:49.411983] [DEBUG] [LOCAL ] NXC: Primary data saved (4109 records). [2025-10-13T20:38:49.412074] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-13T20:38:49.412150] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NXC took 17.2s. Estimated remaining: 1h 53m 44s. Rate: 7.1 symbols/min [2025-10-13T20:38:50.003440] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:50.102630] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:50.137226] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:50.142874] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-13T20:38:50.159624] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:38:50.159984] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-13T20:38:50.163248] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-13T20:38:50.163350] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-13T20:38:50.163400] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-13T20:38:50.163481] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-13T20:38:50.282156] [DEBUG] [LOCAL ] NXG: Loaded 10588 existing records from primary storage. [2025-10-13T20:38:50.328740] [INFO ] [MAIN ] NXG: Loaded 10588 existing records. [2025-10-13T20:38:50.400345] [DEBUG] [LOCAL ] NXDT: Loaded 15274 existing records from primary storage. [2025-10-13T20:38:50.440419] [INFO ] [MAIN ] NXDT: Loaded 15274 existing records. [2025-10-13T20:38:50.621178] [DEBUG] [LOCAL ] NXE: Loaded 53783 existing records from primary storage. [2025-10-13T20:38:50.658174] [INFO ] [MAIN ] NXE: Loaded 53783 existing records. [2025-10-13T20:38:51.065269] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:51.033129] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:38:51.065859] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-13T20:38:51.104639] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:38:51.121176] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-13T20:38:51.121313] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-13T20:38:51.121424] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-13T20:38:51.121534] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-13T20:38:51.157129] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-13T20:38:51.173033] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-13T20:38:51.173005] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-13T20:38:51.195602] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-13T20:38:51.183912] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:38:51.247144] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-13T20:38:51.247330] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-13T20:38:51.313005] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-13T20:38:51.331012] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-13T20:38:52.314931] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:52.341632] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:52.337876] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-13T20:38:52.344620] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:38:52.344976] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-13T20:38:52.345327] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-13T20:38:52.431682] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T20:38:52.435554] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-13T20:38:53.275060] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T20:38:53.278165] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-13T20:38:53.455053] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T20:38:53.580685] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T20:38:53.985808] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T20:38:54.024142] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-13T20:38:54.031487] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T20:38:54.817914] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-13T20:38:54.889029] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:38:55.617903] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-13T20:38:55.912190] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T20:38:56.417905] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-13T20:38:56.526080] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:38:57.217929] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-13T20:38:57.598423] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T20:38:58.017941] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-13T20:38:58.817920] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-13T20:38:58.837958] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T20:38:59.153514] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T20:38:59.617945] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-13T20:38:59.784709] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T20:39:00.417936] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-13T20:39:00.683867] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T20:39:01.217905] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-13T20:39:01.505961] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:39:02.017922] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-13T20:39:02.308975] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:39:02.817912] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-13T20:39:02.916365] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T20:39:03.617922] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-13T20:39:03.635884] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T20:39:04.417920] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-13T20:39:04.707489] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T20:39:04.954986] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T20:39:05.218029] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-13T20:39:06.018010] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-13T20:39:06.034422] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T20:39:06.817917] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-13T20:39:07.617967] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-13T20:39:07.976213] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T20:39:07.997321] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T20:39:08.418023] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-13T20:39:08.609384] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:39:09.217943] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-13T20:39:09.267409] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:39:10.017922] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-13T20:39:10.123552] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:39:10.817963] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-13T20:39:11.007858] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T20:39:11.617903] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-13T20:39:11.822027] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T20:39:12.417901] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-13T20:39:12.608392] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T20:39:13.065669] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T20:39:13.217931] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-13T20:39:14.021869] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-13T20:39:14.023624] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T20:39:14.025809] [INFO ] [REMOTE ] NXG: Full fetch complete (14488 records). [2025-10-13T20:39:14.025890] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-13T20:39:14.403179] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-13T20:39:14.403256] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-13T20:39:14.403598] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-13T20:39:14.403639] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-13T20:39:14.404171] [DEBUG] [LOCAL ] NXG: Trimmed 14488 records to 10468 (keeping 200 days of data) [2025-10-13T20:39:14.471269] [DEBUG] [LOCAL ] NXG: Primary data saved (10468 records). [2025-10-13T20:39:14.471414] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-13T20:39:14.471497] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 25.1s. Estimated remaining: 1h 53m 44s. Rate: 7.1 symbols/min [2025-10-13T20:39:14.646086] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:14.652280] [DEBUG] [LOCAL ] NXN: Loaded 2354 existing records from primary storage. [2025-10-13T20:39:14.652460] [INFO ] [MAIN ] NXN: Loaded 2354 existing records. [2025-10-13T20:39:14.830392] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-13T20:39:14.836889] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:39:14.837154] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-13T20:39:14.838058] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-13T20:39:14.838302] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-13T20:39:14.838366] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-13T20:39:15.210755] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:15.617901] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-13T20:39:16.038769] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T20:39:16.080152] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T20:39:16.417926] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-13T20:39:16.674262] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T20:39:17.138993] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T20:39:17.218067] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-13T20:39:17.897094] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:39:17.898937] [INFO ] [REMOTE ] NXDT: Full fetch complete (24350 records). [2025-10-13T20:39:17.899028] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-13T20:39:18.023049] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-13T20:39:18.272098] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-13T20:39:18.272175] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-13T20:39:18.272700] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-13T20:39:18.272761] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-13T20:39:18.273377] [DEBUG] [LOCAL ] NXDT: Trimmed 24350 records to 15006 (keeping 200 days of data) [2025-10-13T20:39:18.364735] [DEBUG] [LOCAL ] NXDT: Primary data saved (15006 records). [2025-10-13T20:39:18.364871] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-13T20:39:18.364950] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 29.0s. Estimated remaining: 1h 53m 33s. Rate: 7.1 symbols/min [2025-10-13T20:39:18.538054] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:18.552437] [DEBUG] [LOCAL ] NXP: Loaded 12605 existing records from primary storage. [2025-10-13T20:39:18.552715] [INFO ] [MAIN ] NXP: Loaded 12605 existing records. [2025-10-13T20:39:18.733303] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:39:18.733507] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-13T20:39:18.733583] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-13T20:39:18.733911] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-13T20:39:18.733968] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-13T20:39:18.823220] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-13T20:39:18.844204] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:39:18.873595] [INFO ] [REMOTE ] NXJ: Full fetch complete (20486 records). [2025-10-13T20:39:18.887975] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-13T20:39:18.901711] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:39:18.915593] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:39:18.934359] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:39:18.947510] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-13T20:39:18.957963] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-13T20:39:18.969280] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-13T20:39:18.987181] [DEBUG] [LOCAL ] NXJ: No derivative data file found to delete. [2025-10-13T20:39:18.992460] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXJ took 29.5s. Estimated remaining: 1h 53m 21s. Rate: 7.1 symbols/min [2025-10-13T20:39:19.306725] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:19.325509] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-13T20:39:19.325419] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:19.326340] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-13T20:39:19.326456] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-13T20:39:19.326521] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-13T20:39:19.326582] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-13T20:39:19.326617] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-13T20:39:19.608119] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T20:39:19.618138] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-13T20:39:19.693730] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:20.328741] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T20:39:20.417925] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-13T20:39:21.068075] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T20:39:21.217915] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-13T20:39:21.847905] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T20:39:22.017926] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-13T20:39:22.817942] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-13T20:39:23.057329] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:39:23.427505] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T20:39:23.617947] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-13T20:39:24.417927] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-13T20:39:24.842864] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T20:39:25.217934] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-13T20:39:25.280172] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T20:39:25.792799] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T20:39:26.017926] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-13T20:39:26.817960] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-13T20:39:27.618012] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-13T20:39:27.636268] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T20:39:27.883334] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T20:39:28.248761] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T20:39:28.417947] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-13T20:39:29.217948] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-13T20:39:29.361452] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:39:29.856923] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T20:39:30.018017] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-13T20:39:30.818031] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-13T20:39:30.990264] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T20:39:31.617950] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-13T20:39:32.417898] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-13T20:39:32.764038] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T20:39:32.840203] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T20:39:32.927035] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T20:39:33.217926] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-13T20:39:34.017901] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-13T20:39:34.095725] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T20:39:34.377312] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T20:39:34.817932] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-13T20:39:35.394125] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T20:39:35.617928] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-13T20:39:36.417928] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-13T20:39:36.660134] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T20:39:37.217915] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-13T20:39:37.576421] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T20:39:38.017939] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-13T20:39:38.609476] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T20:39:38.817908] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-13T20:39:38.877717] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T20:39:39.260886] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:39:39.261986] [INFO ] [REMOTE ] NXN: Full fetch complete (3553 records). [2025-10-13T20:39:39.262089] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-13T20:39:39.623041] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-13T20:39:39.629472] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-13T20:39:39.629549] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-13T20:39:39.629733] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-13T20:39:39.629797] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-13T20:39:39.630247] [DEBUG] [LOCAL ] NXN: Trimmed 3553 records to 2241 (keeping 200 days of data) [2025-10-13T20:39:39.644998] [DEBUG] [LOCAL ] NXN: Primary data saved (2241 records). [2025-10-13T20:39:39.645119] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-13T20:39:39.645216] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 25.2s. Estimated remaining: 1h 53m 19s. Rate: 7.1 symbols/min [2025-10-13T20:39:39.822522] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:39.822712] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-13T20:39:39.822760] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-13T20:39:39.822872] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-13T20:39:39.822912] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-13T20:39:39.822953] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-13T20:39:39.822984] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-13T20:39:40.183295] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:40.418032] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-13T20:39:40.928863] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T20:39:41.217930] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-13T20:39:42.017900] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-13T20:39:42.405707] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T20:39:42.452905] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T20:39:42.606321] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-13T20:39:42.817939] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-13T20:39:43.617916] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-13T20:39:44.417896] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-13T20:39:44.679800] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:39:44.724898] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T20:39:44.982917] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T20:39:45.217947] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-13T20:39:45.760900] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T20:39:46.017948] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-13T20:39:46.817974] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-13T20:39:47.618013] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-13T20:39:47.741500] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T20:39:47.983827] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T20:39:48.022327] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-13T20:39:48.417966] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-13T20:39:48.933957] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T20:39:49.217939] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-13T20:39:49.630011] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T20:39:50.017971] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-13T20:39:50.817951] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-13T20:39:51.147704] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:39:51.181175] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T20:39:51.617924] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-13T20:39:52.417927] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-13T20:39:52.501471] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T20:39:52.883763] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T20:39:53.217941] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-13T20:39:53.612597] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T20:39:54.017964] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-13T20:39:54.802776] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T20:39:54.804552] [INFO ] [REMOTE ] NXP: Full fetch complete (16781 records). [2025-10-13T20:39:54.804624] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-13T20:39:54.825573] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-13T20:39:55.184987] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-13T20:39:55.185059] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-13T20:39:55.185483] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-13T20:39:55.185546] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-13T20:39:55.186097] [DEBUG] [LOCAL ] NXP: Trimmed 16781 records to 12302 (keeping 200 days of data) [2025-10-13T20:39:55.262523] [DEBUG] [LOCAL ] NXP: Primary data saved (12302 records). [2025-10-13T20:39:55.262684] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-13T20:39:55.262781] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXP took 36.9s. Estimated remaining: 1h 53m 14s. Rate: 7.1 symbols/min [2025-10-13T20:39:55.435038] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:55.435209] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-13T20:39:55.435247] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-13T20:39:55.435406] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-13T20:39:55.435455] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-13T20:39:55.435498] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-13T20:39:55.435534] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-13T20:39:55.619979] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-13T20:39:55.798638] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:56.017266] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:39:56.417959] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-13T20:39:57.218031] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-13T20:39:57.279792] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T20:39:57.285807] [INFO ] [REMOTE ] NXE: Full fetch complete (76749 records). [2025-10-13T20:39:57.285979] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-13T20:39:57.677427] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-13T20:39:57.677516] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-13T20:39:57.678624] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-13T20:39:57.678722] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-13T20:39:57.680210] [DEBUG] [LOCAL ] NXE: Trimmed 76749 records to 53013 (keeping 200 days of data) [2025-10-13T20:39:58.010451] [DEBUG] [LOCAL ] NXE: Primary data saved (53013 records). [2025-10-13T20:39:58.010849] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-13T20:39:58.011123] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXE took 1m 9s. Estimated remaining: 1h 53m 3s. Rate: 7.1 symbols/min [2025-10-13T20:39:58.029583] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-13T20:39:58.121948] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T20:39:58.225951] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:39:58.226216] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-13T20:39:58.226452] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-13T20:39:58.226575] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-13T20:39:58.226618] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-13T20:39:58.226696] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-13T20:39:58.226750] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-13T20:39:58.367844] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T20:39:58.633887] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:39:58.638602] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T20:39:58.817938] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-13T20:39:59.617944] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-13T20:40:00.053069] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T20:40:00.067496] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T20:40:00.068886] [INFO ] [REMOTE ] NYC: Full fetch complete (1886 records). [2025-10-13T20:40:00.069141] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-13T20:40:00.257925] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T20:40:00.258145] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:00.258254] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:00.258329] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-13T20:40:00.258392] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-13T20:40:00.258428] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-13T20:40:00.258465] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-13T20:40:00.258519] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NYC took 20.6s. Estimated remaining: 1h 52m 51s. Rate: 7.1 symbols/min [2025-10-13T20:40:00.423180] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-13T20:40:00.424785] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:00.425961] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-13T20:40:00.426015] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-13T20:40:00.426127] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-13T20:40:00.426169] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-13T20:40:00.426211] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-13T20:40:00.426243] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-13T20:40:00.774903] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:01.217917] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-13T20:40:01.318699] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T20:40:01.320856] [INFO ] [REMOTE ] NXRT: Full fetch complete (25522 records). [2025-10-13T20:40:01.320957] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-13T20:40:01.321450] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:40:01.321539] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:01.321581] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:01.321618] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-13T20:40:01.321719] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-13T20:40:01.321770] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-13T20:40:01.321811] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-13T20:40:01.321867] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 42.3s. Estimated remaining: 1h 52m 39s. Rate: 7.1 symbols/min [2025-10-13T20:40:01.489493] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:01.489698] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-13T20:40:01.489749] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-13T20:40:01.489866] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-13T20:40:01.489906] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-13T20:40:01.489946] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-13T20:40:01.489977] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-13T20:40:01.852501] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:02.017938] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-13T20:40:02.817931] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-13T20:40:03.184190] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T20:40:03.617952] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-13T20:40:04.020800] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T20:40:04.417922] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-13T20:40:05.225290] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-13T20:40:05.231568] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T20:40:05.665685] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-13T20:40:05.726805] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T20:40:06.017941] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-13T20:40:06.817976] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-13T20:40:07.149907] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T20:40:07.618046] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-13T20:40:07.625095] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T20:40:07.826132] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T20:40:08.418009] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-13T20:40:09.218051] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-13T20:40:10.017975] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-13T20:40:10.325004] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T20:40:10.378888] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-13T20:40:10.818021] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-13T20:40:11.038063] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T20:40:11.161896] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T20:40:11.618012] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-13T20:40:12.417971] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-13T20:40:12.741660] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T20:40:13.217913] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-13T20:40:13.767159] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T20:40:14.017952] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-13T20:40:14.189375] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-13T20:40:14.817921] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-13T20:40:15.018138] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T20:40:15.617937] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-13T20:40:16.051815] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T20:40:16.418172] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-13T20:40:16.620997] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T20:40:17.217953] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-13T20:40:17.461427] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-13T20:40:18.018036] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-13T20:40:18.355265] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T20:40:18.610784] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T20:40:18.818020] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-13T20:40:19.617950] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-13T20:40:20.392610] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T20:40:20.417927] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-13T20:40:20.612241] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-13T20:40:21.217902] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-13T20:40:21.535964] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T20:40:22.017912] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-13T20:40:22.091526] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T20:40:22.610596] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T20:40:22.817960] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-13T20:40:23.617890] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-13T20:40:23.833221] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T20:40:24.174116] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T20:40:24.417925] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-13T20:40:25.217937] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-13T20:40:25.775190] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T20:40:25.779980] [INFO ] [REMOTE ] NYT: Full fetch complete (71671 records). [2025-10-13T20:40:25.780158] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-13T20:40:25.781042] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:40:25.781131] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:25.781177] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:25.781216] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-13T20:40:25.781272] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-13T20:40:25.781308] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-13T20:40:25.781348] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-13T20:40:25.781441] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 30.5s. Estimated remaining: 1h 52m 39s. Rate: 7.1 symbols/min [2025-10-13T20:40:25.962039] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:25.962220] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-13T20:40:25.962259] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-13T20:40:25.962368] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-13T20:40:25.962409] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-13T20:40:25.962451] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-13T20:40:25.962493] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-13T20:40:26.019687] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-13T20:40:26.346010] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:26.423059] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T20:40:26.438746] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-13T20:40:26.817922] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-13T20:40:27.452413] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T20:40:27.617927] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-13T20:40:28.261533] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:40:28.264702] [INFO ] [REMOTE ] NZF: Full fetch complete (42517 records). [2025-10-13T20:40:28.264795] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-13T20:40:28.265432] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:40:28.265516] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:28.265559] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:28.265624] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-13T20:40:28.265846] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-13T20:40:28.265892] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-13T20:40:28.265932] [DEBUG] [LOCAL ] NZF: No derivative data file found to delete. [2025-10-13T20:40:28.266012] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 30.3s. Estimated remaining: 1h 52m 27s. Rate: 7.1 symbols/min [2025-10-13T20:40:28.421946] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-13T20:40:28.446891] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:28.447073] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-13T20:40:28.447117] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-13T20:40:28.447259] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-13T20:40:28.447313] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-13T20:40:28.447357] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-13T20:40:28.447391] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-13T20:40:28.819421] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:29.217918] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-13T20:40:29.293321] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-13T20:40:29.350881] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T20:40:30.017927] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-13T20:40:30.697744] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T20:40:30.817901] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-13T20:40:31.617921] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-13T20:40:32.417940] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-13T20:40:32.495937] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T20:40:32.706271] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T20:40:32.785200] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-13T20:40:33.217931] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-13T20:40:34.017963] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-13T20:40:34.173228] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T20:40:34.817932] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-13T20:40:34.841327] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T20:40:35.034829] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T20:40:35.617928] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-13T20:40:36.417940] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-13T20:40:36.700045] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T20:40:37.217922] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-13T20:40:37.605812] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-13T20:40:37.848794] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T20:40:38.017931] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-13T20:40:38.662600] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T20:40:38.817953] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-13T20:40:39.617942] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-13T20:40:39.901053] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T20:40:40.417922] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-13T20:40:40.635451] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T20:40:40.818460] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T20:40:41.057799] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:40:41.065208] [INFO ] [REMOTE ] OBDC: Full fetch complete (74714 records). [2025-10-13T20:40:41.065333] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-13T20:40:41.066150] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:40:41.066237] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:41.066279] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:41.066317] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-13T20:40:41.066372] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-13T20:40:41.066406] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-13T20:40:41.066444] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-13T20:40:41.066499] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBDC took 39.7s. Estimated remaining: 1h 52m 21s. Rate: 7.1 symbols/min [2025-10-13T20:40:41.231013] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-13T20:40:41.234473] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:41.245933] [DEBUG] [LOCAL ] OCFT: Loaded 7771 existing records from primary storage. [2025-10-13T20:40:41.246230] [INFO ] [MAIN ] OCFT: Loaded 7771 existing records. [2025-10-13T20:40:41.433579] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:40:41.433821] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-13T20:40:41.433890] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-13T20:40:41.434294] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-13T20:40:41.434360] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-13T20:40:41.817699] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:42.017901] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-13T20:40:42.168922] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T20:40:42.817937] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-13T20:40:43.617933] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-13T20:40:43.832567] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T20:40:44.328904] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T20:40:44.417974] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-13T20:40:44.507778] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-13T20:40:45.084503] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T20:40:45.217953] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-13T20:40:46.017901] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-13T20:40:46.087065] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T20:40:46.817936] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-13T20:40:47.458453] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:40:47.464580] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-13T20:40:47.464902] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-13T20:40:47.466333] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:40:47.466464] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:40:47.466510] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:40:47.466555] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-13T20:40:47.466634] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-13T20:40:47.466723] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-13T20:40:47.466784] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-13T20:40:47.466861] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 47.2s. Estimated remaining: 1h 52m 12s. Rate: 7.1 symbols/min [2025-10-13T20:40:47.626612] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-13T20:40:47.664995] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:40:47.677842] [DEBUG] [LOCAL ] ODC: Loaded 8491 existing records from primary storage. [2025-10-13T20:40:47.678166] [INFO ] [MAIN ] ODC: Loaded 8491 existing records. [2025-10-13T20:40:47.875075] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:40:47.875404] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-13T20:40:47.875464] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-13T20:40:47.875751] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-13T20:40:47.875845] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-13T20:40:48.042757] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T20:40:48.349771] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:40:48.418023] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-13T20:40:48.735006] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T20:40:49.217940] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-13T20:40:50.017904] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-13T20:40:50.060595] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T20:40:50.085695] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T20:40:50.817892] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-13T20:40:50.892957] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T20:40:51.618019] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-13T20:40:51.908119] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T20:40:52.147839] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T20:40:52.418018] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-13T20:40:53.217943] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-13T20:40:53.275377] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:40:54.018072] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-13T20:40:54.817926] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-13T20:40:54.856339] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T20:40:54.929969] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T20:40:55.617893] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-13T20:40:55.779424] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T20:40:56.417934] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-13T20:40:56.453089] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T20:40:57.217920] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-13T20:40:57.231240] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T20:40:58.017938] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-13T20:40:58.814883] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T20:40:58.817870] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-13T20:40:58.862539] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T20:40:59.617920] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-13T20:40:59.677041] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T20:41:00.274406] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T20:41:00.418012] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-13T20:41:01.218031] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-13T20:41:01.496480] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T20:41:02.017931] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-13T20:41:02.798151] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T20:41:02.817883] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-13T20:41:02.878539] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T20:41:03.535394] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T20:41:03.617939] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-13T20:41:04.417946] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-13T20:41:04.548096] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T20:41:04.805577] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T20:41:04.810293] [INFO ] [REMOTE ] OC: Full fetch complete (63867 records). [2025-10-13T20:41:04.810415] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-13T20:41:04.811108] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:41:04.811205] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:41:04.811246] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:41:04.811345] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-13T20:41:04.811433] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-13T20:41:04.811482] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-13T20:41:04.811537] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-13T20:41:04.811609] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OC took 36.5s. Estimated remaining: 1h 52m 8s. Rate: 7.1 symbols/min [2025-10-13T20:41:04.978247] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:05.021775] [DEBUG] [LOCAL ] ODV: Loaded 28529 existing records from primary storage. [2025-10-13T20:41:05.022045] [INFO ] [MAIN ] ODV: Loaded 28529 existing records. [2025-10-13T20:41:05.198071] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:41:05.198315] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-13T20:41:05.198377] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-13T20:41:05.198719] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-13T20:41:05.198776] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-13T20:41:05.227229] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-13T20:41:05.545788] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:06.017926] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-13T20:41:06.574756] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:41:06.817907] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-13T20:41:07.046373] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T20:41:07.296524] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T20:41:07.297431] [INFO ] [REMOTE ] OCFT: Full fetch complete (11646 records). [2025-10-13T20:41:07.297501] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-13T20:41:07.623008] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-13T20:41:07.704096] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-13T20:41:07.704163] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-13T20:41:07.704455] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-13T20:41:07.704796] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-13T20:41:07.705514] [DEBUG] [LOCAL ] OCFT: Trimmed 11646 records to 7465 (keeping 200 days of data) [2025-10-13T20:41:07.747818] [DEBUG] [LOCAL ] OCFT: Primary data saved (7465 records). [2025-10-13T20:41:07.747957] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-13T20:41:07.748064] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OCFT took 26.7s. Estimated remaining: 1h 51m 56s. Rate: 7.1 symbols/min [2025-10-13T20:41:07.914033] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:07.914194] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-13T20:41:07.914231] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-13T20:41:07.914338] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-13T20:41:07.914378] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-13T20:41:07.914418] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-13T20:41:07.914450] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-13T20:41:08.264883] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:08.417927] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-13T20:41:08.525009] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T20:41:09.218007] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-13T20:41:09.461890] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T20:41:10.017944] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-13T20:41:10.637323] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T20:41:10.817934] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-13T20:41:10.961983] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T20:41:11.342445] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:41:11.344384] [INFO ] [REMOTE ] OBK: Full fetch complete (23571 records). [2025-10-13T20:41:11.344474] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-13T20:41:11.344959] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:41:11.345162] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:41:11.345229] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:41:11.345297] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-13T20:41:11.345358] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-13T20:41:11.345393] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-13T20:41:11.345432] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-13T20:41:11.345487] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OBK took 45.6s. Estimated remaining: 1h 51m 46s. Rate: 7.1 symbols/min [2025-10-13T20:41:11.518804] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:11.519016] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-13T20:41:11.519055] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-13T20:41:11.519176] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-13T20:41:11.519227] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-13T20:41:11.519308] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-13T20:41:11.519356] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-13T20:41:11.624764] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-13T20:41:11.892261] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:12.415762] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:41:12.417925] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-13T20:41:12.420310] [INFO ] [REMOTE ] ODC: Full fetch complete (11085 records). [2025-10-13T20:41:12.420451] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-13T20:41:12.801019] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-13T20:41:12.801133] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-13T20:41:12.801446] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-13T20:41:12.801506] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-13T20:41:12.802002] [DEBUG] [LOCAL ] ODC: Trimmed 11085 records to 8484 (keeping 200 days of data) [2025-10-13T20:41:12.856362] [DEBUG] [LOCAL ] ODC: Primary data saved (8484 records). [2025-10-13T20:41:12.856516] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-13T20:41:12.856601] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODC took 25.4s. Estimated remaining: 1h 51m 34s. Rate: 7.1 symbols/min [2025-10-13T20:41:13.024982] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:13.025131] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-13T20:41:13.025167] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-13T20:41:13.025270] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-13T20:41:13.025316] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-13T20:41:13.025394] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-13T20:41:13.025438] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-13T20:41:13.218550] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-13T20:41:13.367399] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T20:41:13.435670] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:14.018026] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-13T20:41:14.522808] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T20:41:14.817923] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-13T20:41:15.114425] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T20:41:15.617927] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-13T20:41:16.257899] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T20:41:16.417912] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-13T20:41:16.797624] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T20:41:17.217945] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-13T20:41:17.764926] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T20:41:18.017975] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-13T20:41:18.179212] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T20:41:18.817927] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-13T20:41:19.617921] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-13T20:41:19.697927] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T20:41:20.195322] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T20:41:20.418021] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-13T20:41:20.680359] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:41:21.217915] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-13T20:41:21.982776] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T20:41:22.017915] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-13T20:41:22.698308] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T20:41:22.817901] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-13T20:41:23.303553] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T20:41:23.617977] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-13T20:41:24.414458] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T20:41:24.422795] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-13T20:41:25.081360] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T20:41:25.217943] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-13T20:41:26.030511] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-13T20:41:26.034161] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T20:41:26.795609] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T20:41:26.817902] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-13T20:41:27.080695] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T20:41:27.617940] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-13T20:41:28.389120] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T20:41:28.417889] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-13T20:41:29.217932] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-13T20:41:29.307762] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T20:41:29.577307] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T20:41:30.017919] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-13T20:41:30.817965] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-13T20:41:30.882191] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T20:41:31.586878] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T20:41:31.595375] [INFO ] [REMOTE ] ODV: Full fetch complete (34433 records). [2025-10-13T20:41:31.595667] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-13T20:41:31.623309] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-13T20:41:32.084404] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-13T20:41:32.093076] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-13T20:41:32.101723] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:41:32.100938] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-13T20:41:32.107185] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-13T20:41:32.108634] [DEBUG] [LOCAL ] ODV: Trimmed 34433 records to 28490 (keeping 200 days of data) [2025-10-13T20:41:32.270260] [DEBUG] [LOCAL ] ODV: Primary data saved (28490 records). [2025-10-13T20:41:32.270397] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-13T20:41:32.270483] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. ODV took 27.5s. Estimated remaining: 1h 51m 31s. Rate: 7.1 symbols/min [2025-10-13T20:41:32.419087] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-13T20:41:32.439793] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:32.439962] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-13T20:41:32.439999] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-13T20:41:32.440108] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-13T20:41:32.440148] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-13T20:41:32.440188] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-13T20:41:32.440219] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-13T20:41:32.788711] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:33.192841] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T20:41:33.217881] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-13T20:41:33.381214] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T20:41:34.017921] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-13T20:41:34.759185] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T20:41:34.817915] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-13T20:41:35.170815] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T20:41:35.617940] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-13T20:41:36.417935] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-13T20:41:36.467963] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T20:41:37.217945] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-13T20:41:37.579006] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T20:41:37.626877] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T20:41:38.017913] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-13T20:41:38.817920] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-13T20:41:39.017693] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T20:41:39.617916] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-13T20:41:39.894370] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T20:41:40.177786] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T20:41:40.417963] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-13T20:41:41.217930] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-13T20:41:41.262208] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T20:41:41.672784] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T20:41:42.018020] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-13T20:41:42.818012] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-13T20:41:42.877835] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T20:41:43.120557] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T20:41:43.617921] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-13T20:41:44.196239] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T20:41:44.198435] [INFO ] [REMOTE ] OFG: Full fetch complete (33709 records). [2025-10-13T20:41:44.198551] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-13T20:41:44.199146] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:41:44.199239] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:41:44.199324] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:41:44.199417] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-13T20:41:44.199514] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-13T20:41:44.199762] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-13T20:41:44.199843] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-13T20:41:44.200002] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 32.9s. Estimated remaining: 1h 51m 24s. Rate: 7.1 symbols/min [2025-10-13T20:41:44.375210] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:44.375500] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-13T20:41:44.375549] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-13T20:41:44.375694] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-13T20:41:44.375750] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-13T20:41:44.375822] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-13T20:41:44.375858] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-13T20:41:44.430199] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-13T20:41:44.753240] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:44.785394] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:41:45.217922] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-13T20:41:45.866580] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:41:45.870515] [INFO ] [REMOTE ] OEC: Full fetch complete (52567 records). [2025-10-13T20:41:45.870842] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-13T20:41:45.872492] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:41:45.872589] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:41:45.872633] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:41:45.872730] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-13T20:41:45.872801] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-13T20:41:45.872842] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-13T20:41:45.872903] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-13T20:41:45.872992] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OEC took 38.1s. Estimated remaining: 1h 51m 12s. Rate: 7.1 symbols/min [2025-10-13T20:41:46.021938] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-13T20:41:46.057019] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:46.057621] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-13T20:41:46.057950] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-13T20:41:46.058329] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-13T20:41:46.058510] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-13T20:41:46.058855] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-13T20:41:46.058961] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-13T20:41:46.407379] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T20:41:46.486698] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:46.817914] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-13T20:41:47.617933] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-13T20:41:47.777317] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T20:41:48.417954] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-13T20:41:48.797294] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T20:41:48.834040] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T20:41:49.217939] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-13T20:41:50.017928] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-13T20:41:50.192842] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T20:41:50.624594] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T20:41:50.818069] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-13T20:41:51.477836] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T20:41:51.482914] [INFO ] [REMOTE ] OGE: Full fetch complete (66382 records). [2025-10-13T20:41:51.483199] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-13T20:41:51.484231] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:41:51.484371] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:41:51.484418] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:41:51.484460] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-13T20:41:51.484528] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-13T20:41:51.484566] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-13T20:41:51.484604] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-13T20:41:51.484703] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGE took 38.6s. Estimated remaining: 1h 51m 2s. Rate: 7.1 symbols/min [2025-10-13T20:41:51.625790] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-13T20:41:51.659452] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:41:51.659761] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-13T20:41:51.659808] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-13T20:41:51.659928] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-13T20:41:51.659968] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-13T20:41:51.660008] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-13T20:41:51.660042] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-13T20:41:52.022043] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:41:52.119939] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T20:41:52.418008] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-13T20:41:52.774829] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T20:41:53.218058] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-13T20:41:54.018024] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-13T20:41:54.073180] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:41:54.637081] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T20:41:54.818043] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-13T20:41:55.617941] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-13T20:41:55.912114] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T20:41:56.300376] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T20:41:56.417969] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-13T20:41:57.217912] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-13T20:41:57.260022] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T20:41:58.017977] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-13T20:41:58.059296] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T20:41:58.818020] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-13T20:41:59.123223] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T20:41:59.617949] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-13T20:41:59.665770] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T20:42:00.050768] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T20:42:00.417962] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-13T20:42:01.217977] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-13T20:42:01.475678] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T20:42:01.959265] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T20:42:02.018069] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-13T20:42:02.817914] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-13T20:42:03.093386] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T20:42:03.385786] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T20:42:03.617908] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-13T20:42:04.417925] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-13T20:42:04.734057] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T20:42:04.876256] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T20:42:05.217913] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-13T20:42:06.017899] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-13T20:42:06.411178] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T20:42:06.817942] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-13T20:42:06.931928] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T20:42:07.167006] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T20:42:07.617923] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-13T20:42:08.417904] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-13T20:42:08.768954] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T20:42:09.217935] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-13T20:42:09.563065] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T20:42:09.847113] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T20:42:10.018006] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-13T20:42:10.633477] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:42:10.637327] [INFO ] [REMOTE ] OGS: Full fetch complete (47565 records). [2025-10-13T20:42:10.637505] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-13T20:42:10.638592] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:42:10.638731] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:42:10.638784] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:42:10.638833] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-13T20:42:10.638900] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-13T20:42:10.638938] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-13T20:42:10.638979] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-13T20:42:10.639044] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 26.4s. Estimated remaining: 1h 50m 59s. Rate: 7.1 symbols/min [2025-10-13T20:42:10.820428] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:10.820527] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-13T20:42:10.837232] [DEBUG] [LOCAL ] OIA: Loaded 13690 existing records from primary storage. [2025-10-13T20:42:10.837595] [INFO ] [MAIN ] OIA: Loaded 13690 existing records. [2025-10-13T20:42:11.031353] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:42:11.042839] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-13T20:42:11.042948] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-13T20:42:11.044462] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T20:42:11.053534] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-13T20:42:11.054144] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-13T20:42:11.405469] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:11.617921] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-13T20:42:12.417913] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-13T20:42:12.693164] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T20:42:12.756606] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T20:42:13.217929] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-13T20:42:14.017897] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-13T20:42:14.323288] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:42:14.376857] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T20:42:14.818012] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-13T20:42:15.582849] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T20:42:15.617895] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-13T20:42:15.886437] [DEBUG] [REMOTE ] OI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-13T20:42:15.886930] [WARN ] [REMOTE ] OI: No data returned for month 2025-08 [2025-10-13T20:42:15.892619] [FATAL] [REMOTE ] OI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:42:15.892758] [FATAL] [MAIN ] OI: Failed to fetch primary data. [2025-10-13T20:42:15.902743] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:42:15.904081] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T20:42:15.903465] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-13T20:42:15.910550] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-13T20:42:15.910993] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-13T20:42:15.911051] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-13T20:42:15.911099] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OI took 24.4s. Estimated remaining: 1h 50m 49s. Rate: 7.1 symbols/min [2025-10-13T20:42:16.081181] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:16.081406] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-13T20:42:16.081456] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-13T20:42:16.081566] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-13T20:42:16.081609] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-13T20:42:16.081680] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-13T20:42:16.081735] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-13T20:42:16.423040] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-13T20:42:16.444958] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:17.217975] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-13T20:42:18.017959] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-13T20:42:18.359290] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T20:42:18.545406] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:42:18.550440] [INFO ] [REMOTE ] OGN: Full fetch complete (76400 records). [2025-10-13T20:42:18.550569] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-13T20:42:18.551373] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:42:18.551466] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:42:18.551509] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:42:18.551547] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-13T20:42:18.551604] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-13T20:42:18.551639] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-13T20:42:18.551731] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-13T20:42:18.551796] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OGN took 46.3s. Estimated remaining: 1h 50m 38s. Rate: 7.1 symbols/min [2025-10-13T20:42:18.737306] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:18.779157] [DEBUG] [LOCAL ] OIS: Loaded 40743 existing records from primary storage. [2025-10-13T20:42:18.779504] [INFO ] [MAIN ] OIS: Loaded 40743 existing records. [2025-10-13T20:42:18.823057] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-13T20:42:18.967394] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:42:18.967625] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-13T20:42:18.967719] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-13T20:42:18.976285] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-13T20:42:18.989998] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-13T20:42:19.068584] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T20:42:19.378360] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:19.617930] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-13T20:42:20.417924] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-13T20:42:20.628318] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T20:42:20.789032] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:42:21.217970] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-13T20:42:22.017899] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-13T20:42:22.132259] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T20:42:22.723736] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T20:42:22.817965] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-13T20:42:23.624293] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-13T20:42:23.652891] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T20:42:24.278777] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T20:42:24.417970] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-13T20:42:24.634281] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T20:42:25.217912] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-13T20:42:25.888006] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T20:42:26.017921] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-13T20:42:26.087614] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T20:42:26.817946] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-13T20:42:27.617906] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-13T20:42:27.712432] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T20:42:28.346211] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T20:42:28.417930] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-13T20:42:29.217908] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-13T20:42:29.372618] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T20:42:29.656041] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T20:42:30.017937] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-13T20:42:30.817921] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-13T20:42:30.966322] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T20:42:31.441181] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T20:42:31.591410] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:42:31.596858] [INFO ] [REMOTE ] OHI: Full fetch complete (74759 records). [2025-10-13T20:42:31.597225] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-13T20:42:31.598669] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:42:31.598771] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:42:31.598815] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:42:31.598871] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-13T20:42:31.598974] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-13T20:42:31.599210] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-13T20:42:31.599262] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-13T20:42:31.599346] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OHI took 45.7s. Estimated remaining: 1h 50m 32s. Rate: 7.1 symbols/min [2025-10-13T20:42:31.623022] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-13T20:42:31.783537] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:31.784017] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-13T20:42:31.784084] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-13T20:42:31.784259] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-13T20:42:31.784317] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-13T20:42:31.784362] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-13T20:42:31.784397] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-13T20:42:32.147619] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:32.417919] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-13T20:42:33.217925] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-13T20:42:33.317976] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:42:33.854580] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T20:42:34.017973] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-13T20:42:34.130500] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T20:42:34.817951] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-13T20:42:35.617919] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-13T20:42:35.667459] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T20:42:35.710070] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T20:42:36.417933] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-13T20:42:37.219892] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-13T20:42:37.222826] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T20:42:37.550474] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T20:42:38.017957] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-13T20:42:38.817942] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-13T20:42:38.941422] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T20:42:39.619399] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-13T20:42:39.625890] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T20:42:40.316011] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T20:42:40.417948] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-13T20:42:41.217907] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-13T20:42:41.609087] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-13T20:42:42.023072] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-13T20:42:42.036295] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T20:42:42.817948] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-13T20:42:42.862124] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T20:42:43.476206] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T20:42:43.617972] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-13T20:42:44.147976] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T20:42:44.152589] [INFO ] [REMOTE ] OIS: Full fetch complete (57007 records). [2025-10-13T20:42:44.152754] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-13T20:42:44.423674] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-13T20:42:44.575437] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-13T20:42:44.575799] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-13T20:42:44.577718] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-13T20:42:44.591206] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T20:42:44.590442] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-13T20:42:44.596935] [DEBUG] [LOCAL ] OIS: Trimmed 57007 records to 40057 (keeping 200 days of data) [2025-10-13T20:42:44.872000] [DEBUG] [LOCAL ] OIS: Primary data saved (40057 records). [2025-10-13T20:42:44.872188] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-13T20:42:44.872287] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIS took 26.3s. Estimated remaining: 1h 50m 26s. Rate: 7.1 symbols/min [2025-10-13T20:42:45.069915] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:45.070179] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-13T20:42:45.070219] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-13T20:42:45.070348] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-13T20:42:45.070389] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-13T20:42:45.070430] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-13T20:42:45.070465] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-13T20:42:45.223186] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-13T20:42:45.463614] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:46.018008] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-13T20:42:46.112828] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T20:42:46.803303] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:42:46.804998] [INFO ] [REMOTE ] OIA: Full fetch complete (20600 records). [2025-10-13T20:42:46.805076] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-13T20:42:46.826474] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-13T20:42:47.242093] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-13T20:42:47.245354] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-13T20:42:47.246698] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-13T20:42:47.246798] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-13T20:42:47.251013] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T20:42:47.251589] [DEBUG] [LOCAL ] OIA: Trimmed 20600 records to 13178 (keeping 200 days of data) [2025-10-13T20:42:47.356135] [DEBUG] [LOCAL ] OIA: Primary data saved (13178 records). [2025-10-13T20:42:47.356331] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-13T20:42:47.356439] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIA took 36.7s. Estimated remaining: 1h 50m 15s. Rate: 7.1 symbols/min [2025-10-13T20:42:47.543596] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:47.543886] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-13T20:42:47.543931] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-13T20:42:47.544083] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-13T20:42:47.544140] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-13T20:42:47.544188] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-13T20:42:47.544228] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-13T20:42:47.631329] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-13T20:42:47.960891] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:48.418018] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-13T20:42:49.217975] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-13T20:42:49.322190] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T20:42:49.370566] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-13T20:42:50.017956] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-13T20:42:50.448485] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T20:42:50.817962] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-13T20:42:50.892434] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T20:42:51.443757] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:42:51.447837] [INFO ] [REMOTE ] OII: Full fetch complete (61463 records). [2025-10-13T20:42:51.447938] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-13T20:42:51.448604] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:42:51.448707] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:42:51.448753] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:42:51.448821] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-13T20:42:51.448884] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-13T20:42:51.448920] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-13T20:42:51.448961] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-13T20:42:51.449018] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OII took 35.5s. Estimated remaining: 1h 50m 4s. Rate: 7.1 symbols/min [2025-10-13T20:42:51.616086] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:42:51.617924] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-13T20:42:51.628035] [DEBUG] [LOCAL ] OLP: Loaded 10232 existing records from primary storage. [2025-10-13T20:42:51.628258] [INFO ] [MAIN ] OLP: Loaded 10232 existing records. [2025-10-13T20:42:51.805428] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:42:51.805633] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-13T20:42:51.805713] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-13T20:42:51.805955] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-13T20:42:51.806011] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-13T20:42:52.162942] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:42:52.417946] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-13T20:42:52.697242] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-13T20:42:53.217970] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-13T20:42:53.496952] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T20:42:53.932126] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T20:42:54.017918] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-13T20:42:54.129434] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T20:42:54.817922] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-13T20:42:55.617910] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-13T20:42:55.866912] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T20:42:56.239462] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T20:42:56.417918] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-13T20:42:56.556991] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T20:42:57.217912] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-13T20:42:57.252078] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T20:42:58.018037] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-13T20:42:58.817936] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-13T20:42:59.626736] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-13T20:42:59.652127] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-13T20:42:59.876310] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T20:43:00.417961] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-13T20:43:00.533896] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:43:00.949619] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-13T20:43:01.217926] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-13T20:43:02.017966] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-13T20:43:02.136710] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T20:43:02.387288] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T20:43:02.818462] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-13T20:43:03.441403] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T20:43:03.617897] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-13T20:43:04.022520] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T20:43:04.417946] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-13T20:43:05.217949] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-13T20:43:06.017917] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-13T20:43:06.177223] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T20:43:06.488331] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-13T20:43:06.827447] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-13T20:43:06.833970] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T20:43:06.882394] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T20:43:07.617936] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-13T20:43:08.418024] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-13T20:43:08.635687] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T20:43:09.217973] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-13T20:43:09.308440] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T20:43:10.017957] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-13T20:43:10.241493] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-13T20:43:10.817905] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-13T20:43:10.921435] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T20:43:11.182505] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T20:43:11.617915] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-13T20:43:12.417973] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-13T20:43:13.217961] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-13T20:43:13.333711] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T20:43:13.533128] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-13T20:43:13.589546] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T20:43:13.653239] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T20:43:13.658505] [INFO ] [REMOTE ] OKE: Full fetch complete (77114 records). [2025-10-13T20:43:13.658711] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-13T20:43:13.659528] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:13.659612] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:13.659703] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:13.659773] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-13T20:43:13.659850] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-13T20:43:13.659904] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-13T20:43:13.659946] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-13T20:43:13.660042] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKE took 42.1s. Estimated remaining: 1h 50m 2s. Rate: 7.1 symbols/min [2025-10-13T20:43:13.835212] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:13.835390] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-13T20:43:13.835436] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-13T20:43:13.835563] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-13T20:43:13.835611] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-13T20:43:13.835688] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-13T20:43:13.835750] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-13T20:43:14.023352] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-13T20:43:14.196022] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:14.817900] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-13T20:43:14.967812] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T20:43:14.969603] [INFO ] [REMOTE ] OLP: Full fetch complete (14164 records). [2025-10-13T20:43:14.969701] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-13T20:43:15.327535] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-13T20:43:15.327608] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-13T20:43:15.327973] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-13T20:43:15.328079] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-13T20:43:15.328581] [DEBUG] [LOCAL ] OLP: Trimmed 14164 records to 10049 (keeping 200 days of data) [2025-10-13T20:43:15.390488] [DEBUG] [LOCAL ] OLP: Primary data saved (10049 records). [2025-10-13T20:43:15.390615] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-13T20:43:15.390721] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLP took 23.9s. Estimated remaining: 1h 49m 51s. Rate: 7.1 symbols/min [2025-10-13T20:43:15.558512] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:15.558683] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-13T20:43:15.558738] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-13T20:43:15.558853] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-13T20:43:15.558897] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-13T20:43:15.558940] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-13T20:43:15.558976] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-13T20:43:15.623195] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-13T20:43:15.926116] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:16.417928] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-13T20:43:16.599261] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T20:43:17.164415] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:43:17.217885] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-13T20:43:18.024785] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-13T20:43:18.027515] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T20:43:18.817904] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-13T20:43:19.102730] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T20:43:19.163716] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T20:43:19.169188] [INFO ] [REMOTE ] OLN: Full fetch complete (74250 records). [2025-10-13T20:43:19.169340] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-13T20:43:19.170232] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:19.170323] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:19.170365] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:19.170403] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-13T20:43:19.170457] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-13T20:43:19.170493] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-13T20:43:19.170530] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-13T20:43:19.170585] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLN took 31.8s. Estimated remaining: 1h 49m 40s. Rate: 7.1 symbols/min [2025-10-13T20:43:19.367363] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:19.367547] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-13T20:43:19.367584] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-13T20:43:19.367717] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-13T20:43:19.367763] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-13T20:43:19.367804] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-13T20:43:19.367838] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-13T20:43:19.623154] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-13T20:43:19.722487] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:20.417922] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-13T20:43:20.807141] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-13T20:43:21.217918] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-13T20:43:21.283305] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T20:43:22.017943] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-13T20:43:22.301744] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T20:43:22.719602] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T20:43:22.817911] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-13T20:43:23.623026] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-13T20:43:23.639499] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T20:43:24.352192] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T20:43:24.417903] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-13T20:43:25.217946] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-13T20:43:25.576563] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T20:43:25.785881] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T20:43:26.018013] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-13T20:43:26.817926] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-13T20:43:27.606078] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T20:43:27.620525] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-13T20:43:28.233875] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-10-13T20:43:28.417946] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-13T20:43:28.806092] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T20:43:29.090130] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T20:43:29.217907] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-13T20:43:30.017916] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-13T20:43:30.817952] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-13T20:43:30.986588] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T20:43:31.227112] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-13T20:43:31.617904] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-13T20:43:31.708952] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T20:43:32.417932] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-13T20:43:32.537732] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T20:43:33.218043] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-13T20:43:34.017957] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-13T20:43:34.271912] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T20:43:34.506750] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-13T20:43:34.817965] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-13T20:43:34.943327] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T20:43:35.617971] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-13T20:43:35.681743] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T20:43:36.417936] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-13T20:43:36.553016] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T20:43:37.217938] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-13T20:43:37.535775] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T20:43:38.024305] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-13T20:43:38.050581] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T20:43:38.726955] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:43:38.733476] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-13T20:43:38.733614] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-13T20:43:38.734491] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:38.734622] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:38.734720] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:38.734794] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-13T20:43:38.734861] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-13T20:43:38.734897] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-13T20:43:38.734935] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-13T20:43:38.734992] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OKLO took 53.9s. Estimated remaining: 1h 49m 37s. Rate: 7.1 symbols/min [2025-10-13T20:43:38.818718] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-13T20:43:38.918700] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:38.928393] [DEBUG] [LOCAL ] ONIT: Loaded 7690 existing records from primary storage. [2025-10-13T20:43:38.928688] [INFO ] [MAIN ] ONIT: Loaded 7690 existing records. [2025-10-13T20:43:39.137896] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:43:39.138161] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-13T20:43:39.138393] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-13T20:43:39.138943] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-13T20:43:39.142360] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T20:43:39.139003] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-13T20:43:39.496420] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:39.617930] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-13T20:43:40.176067] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T20:43:40.417966] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-13T20:43:41.189904] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T20:43:41.217895] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-13T20:43:42.007466] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T20:43:42.018252] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-13T20:43:42.756477] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T20:43:42.817894] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-13T20:43:43.617900] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-13T20:43:43.814542] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T20:43:44.418009] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-13T20:43:44.436929] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T20:43:44.706155] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T20:43:45.217945] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-13T20:43:46.017904] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-13T20:43:46.062591] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T20:43:46.223930] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T20:43:46.656347] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:43:46.661510] [INFO ] [REMOTE ] OMC: Full fetch complete (76613 records). [2025-10-13T20:43:46.661698] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-13T20:43:46.662450] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:46.662536] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:46.662578] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:46.662616] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-13T20:43:46.662699] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-13T20:43:46.662750] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-13T20:43:46.662791] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-13T20:43:46.662846] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 33.0s. Estimated remaining: 1h 49m 28s. Rate: 7.1 symbols/min [2025-10-13T20:43:46.826770] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-13T20:43:46.829386] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:46.866323] [DEBUG] [LOCAL ] ONL: Loaded 30363 existing records from primary storage. [2025-10-13T20:43:46.866713] [INFO ] [MAIN ] ONL: Loaded 30363 existing records. [2025-10-13T20:43:47.043240] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:43:47.043468] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-13T20:43:47.043513] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-13T20:43:47.043793] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-13T20:43:47.043848] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-13T20:43:47.427686] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:47.564195] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:43:47.569303] [INFO ] [REMOTE ] OMI: Full fetch complete (64729 records). [2025-10-13T20:43:47.569465] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-13T20:43:47.570263] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:47.570357] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:47.570402] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:47.570441] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-13T20:43:47.570515] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-13T20:43:47.570571] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-13T20:43:47.570615] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-13T20:43:47.570704] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMI took 28.4s. Estimated remaining: 1h 49m 16s. Rate: 7.1 symbols/min [2025-10-13T20:43:47.623166] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-13T20:43:47.759607] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:47.759823] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-13T20:43:47.759877] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-13T20:43:47.759990] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-13T20:43:47.760032] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-13T20:43:47.760075] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-13T20:43:47.760136] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-13T20:43:48.142855] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:48.418015] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-13T20:43:49.217927] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-13T20:43:49.576407] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T20:43:50.006373] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T20:43:50.017872] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-13T20:43:50.571587] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T20:43:50.817923] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-13T20:43:50.841950] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T20:43:51.617916] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-13T20:43:52.133488] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:43:52.138443] [INFO ] [REMOTE ] OMF: Full fetch complete (66921 records). [2025-10-13T20:43:52.138567] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-13T20:43:52.139227] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:43:52.139317] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:43:52.139359] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:43:52.139396] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-13T20:43:52.139450] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-13T20:43:52.139486] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-13T20:43:52.139525] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-13T20:43:52.139580] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMF took 36.7s. Estimated remaining: 1h 49m 6s. Rate: 7.1 symbols/min [2025-10-13T20:43:52.308409] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:43:52.330444] [DEBUG] [LOCAL ] ONTF: Loaded 22763 existing records from primary storage. [2025-10-13T20:43:52.330737] [INFO ] [MAIN ] ONTF: Loaded 22763 existing records. [2025-10-13T20:43:52.418480] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-13T20:43:52.508869] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:43:52.509230] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-13T20:43:52.509340] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-13T20:43:52.509803] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-13T20:43:52.509898] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-13T20:43:52.890955] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:43:52.896247] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T20:43:53.217916] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-13T20:43:53.710191] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T20:43:54.017974] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-13T20:43:54.817902] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-13T20:43:55.163113] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T20:43:55.403554] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-13T20:43:55.617895] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-13T20:43:55.978353] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T20:43:56.417924] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-13T20:43:57.217935] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-13T20:43:57.855910] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-13T20:43:58.017899] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-13T20:43:58.061358] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T20:43:58.063121] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T20:43:58.817930] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-13T20:43:59.617934] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-13T20:44:00.379599] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T20:44:00.417948] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-13T20:44:00.510323] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T20:44:00.518957] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-13T20:44:01.218042] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-13T20:44:01.774797] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T20:44:02.018031] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-13T20:44:02.817968] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-13T20:44:03.412996] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T20:44:03.615405] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T20:44:03.618108] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-13T20:44:03.710058] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:44:04.417923] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-13T20:44:05.217932] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-13T20:44:05.645637] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T20:44:05.802314] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T20:44:05.817712] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T20:44:06.017941] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-13T20:44:06.817950] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-13T20:44:07.133966] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:44:07.617921] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-13T20:44:07.673796] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:44:08.417971] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-13T20:44:08.770726] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T20:44:09.210552] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T20:44:09.217885] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-13T20:44:09.847355] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:44:09.848887] [INFO ] [REMOTE ] ONIT: Full fetch complete (11098 records). [2025-10-13T20:44:09.848962] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-13T20:44:10.018621] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-13T20:44:10.237280] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-13T20:44:10.237389] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-13T20:44:10.237948] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-13T20:44:10.238042] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-13T20:44:10.238805] [DEBUG] [LOCAL ] ONIT: Trimmed 11098 records to 7639 (keeping 200 days of data) [2025-10-13T20:44:10.292691] [DEBUG] [LOCAL ] ONIT: Primary data saved (7639 records). [2025-10-13T20:44:10.292890] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-13T20:44:10.292994] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONIT took 31.6s. Estimated remaining: 1h 49m 2s. Rate: 7.1 symbols/min [2025-10-13T20:44:10.473509] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:10.473757] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-13T20:44:10.473808] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-13T20:44:10.473931] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-13T20:44:10.473994] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-13T20:44:10.474064] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-13T20:44:10.474134] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-13T20:44:10.820999] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-13T20:44:10.840762] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:11.306314] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T20:44:11.617936] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-13T20:44:12.133569] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T20:44:12.417946] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-13T20:44:13.185488] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T20:44:13.217920] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-13T20:44:13.484956] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T20:44:14.017927] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-13T20:44:14.750980] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T20:44:14.817973] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-13T20:44:15.617892] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-13T20:44:16.013625] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T20:44:16.235539] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-13T20:44:16.417885] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-13T20:44:16.618191] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T20:44:17.217894] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-13T20:44:17.622428] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T20:44:18.017957] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-13T20:44:18.760181] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T20:44:18.817896] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-13T20:44:19.106019] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T20:44:19.108915] [INFO ] [REMOTE ] ONL: Full fetch complete (42854 records). [2025-10-13T20:44:19.108997] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-13T20:44:19.492816] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-13T20:44:19.492892] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-13T20:44:19.493567] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-13T20:44:19.493606] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-13T20:44:19.494831] [DEBUG] [LOCAL ] ONL: Trimmed 42854 records to 29682 (keeping 200 days of data) [2025-10-13T20:44:19.618284] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-13T20:44:19.690555] [DEBUG] [LOCAL ] ONL: Primary data saved (29682 records). [2025-10-13T20:44:19.690711] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-13T20:44:19.690801] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONL took 33.0s. Estimated remaining: 1h 48m 54s. Rate: 7.1 symbols/min [2025-10-13T20:44:19.890901] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:19.891069] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-13T20:44:19.891119] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-13T20:44:19.891230] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-13T20:44:19.891273] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-13T20:44:19.891316] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-13T20:44:19.891394] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-13T20:44:20.239431] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:20.417882] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-13T20:44:20.804474] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T20:44:20.988794] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-13T20:44:21.217929] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-13T20:44:21.644494] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:44:22.017925] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-13T20:44:22.817908] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-13T20:44:23.172857] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T20:44:23.413413] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T20:44:23.617927] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-13T20:44:23.856513] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T20:44:24.417918] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-13T20:44:24.631708] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T20:44:25.217938] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-13T20:44:25.710454] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T20:44:25.715671] [INFO ] [REMOTE ] ONON: Full fetch complete (77215 records). [2025-10-13T20:44:25.715822] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-13T20:44:25.716746] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:44:25.716874] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:44:25.716947] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:44:25.717038] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-13T20:44:25.717151] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-13T20:44:25.717248] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-13T20:44:25.717315] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-13T20:44:25.717384] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONON took 38.1s. Estimated remaining: 1h 48m 45s. Rate: 7.1 symbols/min [2025-10-13T20:44:25.821416] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T20:44:26.017974] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-13T20:44:26.817940] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-13T20:44:27.617901] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-13T20:44:27.829685] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T20:44:27.867689] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T20:44:28.359291] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:44:28.361831] [INFO ] [REMOTE ] ONTF: Full fetch complete (31441 records). [2025-10-13T20:44:28.361909] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-13T20:44:28.423980] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-13T20:44:28.726915] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-13T20:44:28.726996] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-13T20:44:28.727674] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-13T20:44:28.727735] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-13T20:44:28.728744] [DEBUG] [LOCAL ] ONTF: Trimmed 31441 records to 22596 (keeping 200 days of data) [2025-10-13T20:44:28.856261] [DEBUG] [LOCAL ] ONTF: Primary data saved (22596 records). [2025-10-13T20:44:28.856395] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-13T20:44:28.856474] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 36.7s. Estimated remaining: 1h 48m 34s. Rate: 7.1 symbols/min [2025-10-13T20:44:29.217999] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-13T20:44:30.299750] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T20:44:30.305433] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-13T20:44:30.494584] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T20:44:30.817953] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-13T20:44:31.365468] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T20:44:31.618005] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-13T20:44:32.349533] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T20:44:32.417924] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-13T20:44:32.734596] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T20:44:33.217936] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-13T20:44:34.225024] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T20:44:34.235475] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-13T20:44:34.303734] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T20:44:34.817911] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-13T20:44:35.907841] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T20:44:35.920328] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-13T20:44:36.013362] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T20:44:36.417969] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-13T20:44:37.612737] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T20:44:37.617312] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-13T20:44:37.851418] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T20:44:38.017922] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-13T20:44:38.656529] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T20:44:38.791607] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:44:38.796364] [INFO ] [REMOTE ] ONTO: Full fetch complete (66255 records). [2025-10-13T20:44:38.796504] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-13T20:44:38.797256] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:44:38.797349] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:44:38.797391] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:44:38.797427] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-13T20:44:38.797481] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-13T20:44:38.797515] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-13T20:44:38.797551] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-13T20:44:38.797606] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 28.5s. Estimated remaining: 1h 48m 26s. Rate: 7.1 symbols/min [2025-10-13T20:44:38.817888] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-13T20:44:39.424563] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:44:39.426682] [INFO ] [REMOTE ] OOMA: Full fetch complete (25622 records). [2025-10-13T20:44:39.426753] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-13T20:44:39.427201] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:44:39.427282] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:44:39.427325] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:44:39.427362] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-13T20:44:39.427507] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-13T20:44:39.427562] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-13T20:44:39.427604] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-13T20:44:39.427677] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. OOMA took 19.7s. Estimated remaining: 1h 48m 14s. Rate: 7.1 symbols/min [2025-10-13T20:44:40.048238] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:40.142851] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:40.140868] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:40.089999] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:40.143541] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-13T20:44:40.143784] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-13T20:44:40.144452] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-13T20:44:40.144518] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-13T20:44:40.144697] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-13T20:44:40.144795] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-13T20:44:40.144597] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-13T20:44:40.145012] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-13T20:44:40.145113] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-13T20:44:40.145262] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-13T20:44:40.145158] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-13T20:44:40.145358] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-13T20:44:40.403875] [DEBUG] [LOCAL ] OPP: Loaded 12307 existing records from primary storage. [2025-10-13T20:44:40.410486] [INFO ] [MAIN ] OPP: Loaded 12307 existing records. [2025-10-13T20:44:40.422826] [DEBUG] [LOCAL ] OPAD: Loaded 24192 existing records from primary storage. [2025-10-13T20:44:40.493826] [INFO ] [MAIN ] OPAD: Loaded 24192 existing records. [2025-10-13T20:44:41.356711] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:41.382626] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:44:41.431206] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-13T20:44:41.436705] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-13T20:44:41.425702] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:44:41.457521] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-13T20:44:41.469957] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-13T20:44:41.504498] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-13T20:44:41.504424] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:41.505295] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-13T20:44:41.507048] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-13T20:44:41.506946] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-13T20:44:41.507223] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-13T20:44:41.507329] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-13T20:44:42.271833] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:42.302865] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-13T20:44:42.310971] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:44:42.317362] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-13T20:44:42.320450] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T20:44:42.817929] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-13T20:44:43.057084] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:44:43.215997] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T20:44:43.418327] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T20:44:43.487571] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T20:44:43.618021] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-13T20:44:44.418042] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-13T20:44:44.474885] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T20:44:45.217930] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-13T20:44:45.854555] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T20:44:46.017934] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-13T20:44:46.491502] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T20:44:46.773409] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T20:44:46.817946] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-13T20:44:47.485428] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T20:44:47.617963] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-13T20:44:48.417922] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-13T20:44:48.468908] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T20:44:49.217971] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-13T20:44:49.328570] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T20:44:50.017973] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-13T20:44:50.116285] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T20:44:50.780528] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T20:44:50.817936] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-13T20:44:51.517745] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T20:44:51.617941] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-13T20:44:52.418024] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-13T20:44:52.453273] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T20:44:53.184089] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T20:44:53.217926] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-13T20:44:54.017941] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-13T20:44:54.183559] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T20:44:54.817944] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-13T20:44:55.617947] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-13T20:44:55.737242] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T20:44:56.084078] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T20:44:56.413314] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T20:44:56.417873] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-13T20:44:57.217897] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-13T20:44:57.291795] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T20:44:57.982181] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T20:44:58.017934] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-13T20:44:58.817938] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-13T20:44:58.907211] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T20:44:59.537876] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:44:59.539213] [INFO ] [REMOTE ] OPY: Full fetch complete (10153 records). [2025-10-13T20:44:59.539284] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-13T20:44:59.623119] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-13T20:44:59.721473] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T20:44:59.721753] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:44:59.721820] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:44:59.721869] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-13T20:44:59.721922] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-13T20:44:59.721955] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-13T20:44:59.721993] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-13T20:44:59.722046] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPY took 20.3s. Estimated remaining: 1h 48m 11s. Rate: 7.1 symbols/min [2025-10-13T20:44:59.885135] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:44:59.885310] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-13T20:44:59.885347] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-13T20:44:59.885451] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-13T20:44:59.885491] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-13T20:44:59.885531] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-13T20:44:59.885562] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-13T20:45:00.234042] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:00.417928] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-13T20:45:01.217957] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-13T20:45:01.893884] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-13T20:45:02.018019] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-13T20:45:02.233564] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T20:45:02.270813] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T20:45:02.818063] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-13T20:45:03.617930] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-13T20:45:04.062438] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T20:45:04.417965] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-13T20:45:04.462367] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T20:45:04.472829] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:45:05.137010] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T20:45:05.217928] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-13T20:45:06.017930] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-13T20:45:06.761889] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T20:45:06.817894] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-13T20:45:07.617931] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-13T20:45:07.752961] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T20:45:08.417918] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-13T20:45:08.587077] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T20:45:08.751703] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T20:45:08.754172] [INFO ] [REMOTE ] OPP: Full fetch complete (17534 records). [2025-10-13T20:45:08.754242] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-13T20:45:09.127263] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-13T20:45:09.127383] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-13T20:45:09.127925] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-13T20:45:09.128020] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-13T20:45:09.128633] [DEBUG] [LOCAL ] OPP: Trimmed 17534 records to 12202 (keeping 200 days of data) [2025-10-13T20:45:09.205024] [DEBUG] [LOCAL ] OPP: Primary data saved (12202 records). [2025-10-13T20:45:09.205170] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-13T20:45:09.205248] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPP took 29.8s. Estimated remaining: 1h 48m 3s. Rate: 7.1 symbols/min [2025-10-13T20:45:09.225893] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-13T20:45:09.323735] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T20:45:09.400345] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:45:09.400523] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-13T20:45:09.400561] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-13T20:45:09.400705] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-13T20:45:09.400756] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-13T20:45:09.400799] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-13T20:45:09.400831] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-13T20:45:09.792217] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:10.017971] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-13T20:45:10.817940] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-13T20:45:11.223206] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T20:45:11.617911] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-13T20:45:11.822477] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T20:45:12.417917] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-13T20:45:12.857341] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T20:45:13.217961] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-13T20:45:13.436705] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T20:45:14.018031] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-13T20:45:14.019171] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T20:45:14.733773] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T20:45:14.817919] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-13T20:45:15.617928] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-13T20:45:15.903991] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T20:45:16.322215] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T20:45:16.417901] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-13T20:45:16.530860] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T20:45:17.218031] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-13T20:45:17.949896] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T20:45:18.017958] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-13T20:45:18.818035] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-13T20:45:18.916888] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:45:19.617948] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-13T20:45:19.628166] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T20:45:19.801880] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T20:45:20.417956] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-13T20:45:21.076309] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T20:45:21.217946] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-13T20:45:22.017935] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-13T20:45:22.069517] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T20:45:22.519071] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T20:45:22.817925] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-13T20:45:23.617909] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-13T20:45:23.708789] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T20:45:24.328279] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T20:45:24.417923] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-13T20:45:25.217964] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-13T20:45:25.607155] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T20:45:25.693366] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:45:26.008897] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:45:26.013898] [INFO ] [REMOTE ] OPFI: Full fetch complete (68111 records). [2025-10-13T20:45:26.014090] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-13T20:45:26.015559] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:45:26.015855] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:45:26.015927] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:45:26.015980] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-13T20:45:26.016045] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-13T20:45:26.016081] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-13T20:45:26.016121] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-13T20:45:26.016197] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPFI took 46.6s. Estimated remaining: 1h 47m 59s. Rate: 7.1 symbols/min [2025-10-13T20:45:26.026690] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-13T20:45:26.193599] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:45:26.243945] [DEBUG] [LOCAL ] ORC: Loaded 53224 existing records from primary storage. [2025-10-13T20:45:26.244250] [INFO ] [MAIN ] ORC: Loaded 53224 existing records. [2025-10-13T20:45:26.419381] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:45:26.419585] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-13T20:45:26.419631] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-13T20:45:26.420120] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-13T20:45:26.420174] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-13T20:45:26.787058] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:26.817910] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-13T20:45:27.617958] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-13T20:45:28.423573] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-13T20:45:28.426434] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-13T20:45:28.893164] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-13T20:45:29.093165] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T20:45:29.143634] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:45:29.148585] [INFO ] [REMOTE ] OR: Full fetch complete (65653 records). [2025-10-13T20:45:29.148723] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-13T20:45:29.149523] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:45:29.149613] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:45:29.149688] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:45:29.149742] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-13T20:45:29.149801] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-13T20:45:29.149835] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-13T20:45:29.149873] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-13T20:45:29.149926] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OR took 29.4s. Estimated remaining: 1h 47m 48s. Rate: 7.1 symbols/min [2025-10-13T20:45:29.223233] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-13T20:45:29.318933] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:45:29.319119] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-13T20:45:29.319155] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-13T20:45:29.319260] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-13T20:45:29.319300] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-13T20:45:29.319340] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-13T20:45:29.319374] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-13T20:45:29.672608] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:30.017955] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-13T20:45:30.817968] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-13T20:45:30.866130] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T20:45:31.618024] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-13T20:45:32.417917] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-13T20:45:32.466113] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-13T20:45:32.785092] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T20:45:33.218010] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-13T20:45:33.573060] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T20:45:33.578319] [INFO ] [REMOTE ] OPAD: Full fetch complete (27145 records). [2025-10-13T20:45:33.578471] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-13T20:45:33.965367] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-13T20:45:33.965479] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-13T20:45:33.966282] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-13T20:45:33.966357] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-13T20:45:33.976120] [DEBUG] [LOCAL ] OPAD: Trimmed 27145 records to 24462 (keeping 200 days of data) [2025-10-13T20:45:34.035952] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-13T20:45:34.050335] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T20:45:34.147861] [DEBUG] [LOCAL ] OPAD: Primary data saved (24462 records). [2025-10-13T20:45:34.148041] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-13T20:45:34.148141] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OPAD took 54.7s. Estimated remaining: 1h 47m 38s. Rate: 7.1 symbols/min [2025-10-13T20:45:34.338135] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:45:34.338583] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-13T20:45:34.338633] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-13T20:45:34.338798] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-13T20:45:34.338839] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-13T20:45:34.338879] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-13T20:45:34.338921] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-13T20:45:34.683758] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:34.817955] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-13T20:45:35.623093] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-13T20:45:35.648752] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-13T20:45:36.150092] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-13T20:45:36.229432] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T20:45:36.418045] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-13T20:45:37.217941] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-13T20:45:37.420579] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T20:45:38.017917] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-13T20:45:38.437212] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T20:45:38.817943] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-13T20:45:39.386190] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T20:45:39.623028] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-13T20:45:39.639350] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T20:45:40.418022] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-13T20:45:40.800170] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T20:45:41.153378] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:45:41.157208] [INFO ] [REMOTE ] ORA: Full fetch complete (48645 records). [2025-10-13T20:45:41.157343] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-13T20:45:41.158014] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:45:41.158112] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:45:41.158169] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:45:41.158232] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-13T20:45:41.158342] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-13T20:45:41.158392] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-13T20:45:41.158433] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-13T20:45:41.158556] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 32.0s. Estimated remaining: 1h 47m 29s. Rate: 7.1 symbols/min [2025-10-13T20:45:41.223297] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-13T20:45:41.348670] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:45:41.380724] [DEBUG] [LOCAL ] ORN: Loaded 31322 existing records from primary storage. [2025-10-13T20:45:41.381040] [INFO ] [MAIN ] ORN: Loaded 31322 existing records. [2025-10-13T20:45:41.560416] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:45:41.560630] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-13T20:45:41.560713] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-13T20:45:41.561218] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-13T20:45:41.561293] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-13T20:45:41.919953] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:45:42.017931] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-13T20:45:42.263903] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-13T20:45:42.817940] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-13T20:45:43.324628] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T20:45:43.352921] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T20:45:43.617949] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-13T20:45:44.418039] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-13T20:45:44.998538] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:45:45.217941] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-13T20:45:45.430354] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-13T20:45:46.017967] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-13T20:45:46.400982] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T20:45:46.817898] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-13T20:45:46.913828] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T20:45:47.140553] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T20:45:47.617924] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-13T20:45:48.417950] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-13T20:45:48.868432] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T20:45:48.955184] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T20:45:49.217960] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-13T20:45:50.017920] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-13T20:45:50.671872] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-13T20:45:50.817934] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-13T20:45:51.040986] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T20:45:51.522024] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T20:45:51.617888] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-13T20:45:52.418016] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-13T20:45:52.882478] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T20:45:53.217909] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-13T20:45:53.477820] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-13T20:45:54.018027] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-13T20:45:54.662904] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-13T20:45:54.817906] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-13T20:45:54.870621] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T20:45:55.617924] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-13T20:45:56.418014] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-13T20:45:56.930345] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-13T20:45:56.993538] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T20:45:57.217937] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-13T20:45:57.366209] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T20:45:57.573412] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T20:45:58.017951] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-13T20:45:58.818090] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-13T20:45:59.617946] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-13T20:45:59.877748] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T20:46:00.005931] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-13T20:46:00.368408] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T20:46:00.374293] [INFO ] [REMOTE ] ORC: Full fetch complete (75407 records). [2025-10-13T20:46:00.374460] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-13T20:46:00.423140] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-13T20:46:00.771625] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-13T20:46:00.771735] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-13T20:46:00.772833] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-13T20:46:00.772896] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-13T20:46:00.774348] [DEBUG] [LOCAL ] ORC: Trimmed 75407 records to 52499 (keeping 200 days of data) [2025-10-13T20:46:00.911109] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T20:46:01.131619] [DEBUG] [LOCAL ] ORC: Primary data saved (52499 records). [2025-10-13T20:46:01.131878] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-13T20:46:01.132011] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 35.1s. Estimated remaining: 1h 47m 26s. Rate: 7.1 symbols/min [2025-10-13T20:46:01.223113] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-13T20:46:01.335560] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:01.335787] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-13T20:46:01.335841] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-13T20:46:01.335977] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-13T20:46:01.336028] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-13T20:46:01.336081] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-13T20:46:01.336124] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-13T20:46:01.718620] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:02.017900] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-13T20:46:02.288816] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T20:46:02.817956] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-13T20:46:03.616075] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T20:46:03.627000] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-13T20:46:03.999627] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-13T20:46:04.289780] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T20:46:04.417921] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-13T20:46:05.197834] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:46:05.217913] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-13T20:46:05.815115] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T20:46:06.017957] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-13T20:46:06.605392] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T20:46:06.817898] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-13T20:46:06.961797] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T20:46:06.967188] [INFO ] [REMOTE ] ORI: Full fetch complete (69832 records). [2025-10-13T20:46:06.967439] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-13T20:46:06.970024] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:46:06.970141] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:46:06.970214] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:46:06.970292] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-13T20:46:06.970369] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-13T20:46:06.970435] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-13T20:46:06.970494] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-13T20:46:06.970634] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORI took 32.8s. Estimated remaining: 1h 47m 16s. Rate: 7.1 symbols/min [2025-10-13T20:46:07.170093] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:07.170390] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-13T20:46:07.170436] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-13T20:46:07.170574] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-13T20:46:07.170618] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-13T20:46:07.170699] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-13T20:46:07.170752] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-13T20:46:07.591084] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:07.617953] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-13T20:46:08.148604] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T20:46:08.417921] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-13T20:46:09.217973] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-13T20:46:09.393192] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T20:46:09.661474] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T20:46:09.665989] [INFO ] [REMOTE ] ORN: Full fetch complete (45261 records). [2025-10-13T20:46:09.666168] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-13T20:46:10.023044] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-13T20:46:10.072856] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-13T20:46:10.072945] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-13T20:46:10.073710] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-13T20:46:10.073771] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-13T20:46:10.074800] [DEBUG] [LOCAL ] ORN: Trimmed 45261 records to 30834 (keeping 200 days of data) [2025-10-13T20:46:10.246522] [DEBUG] [LOCAL ] ORN: Primary data saved (30834 records). [2025-10-13T20:46:10.246682] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-13T20:46:10.246777] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORN took 29.1s. Estimated remaining: 1h 47m 5s. Rate: 7.1 symbols/min [2025-10-13T20:46:10.423349] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:10.423595] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-13T20:46:10.423675] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-13T20:46:10.423798] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-13T20:46:10.423844] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-13T20:46:10.423918] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-13T20:46:10.423990] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-13T20:46:10.805340] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:10.818022] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-13T20:46:10.819375] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:46:10.824856] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-13T20:46:10.824973] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-13T20:46:10.825796] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:46:10.825892] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:46:10.825935] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:46:10.825974] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-13T20:46:10.826029] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-13T20:46:10.826221] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-13T20:46:10.826376] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-13T20:46:10.826454] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORCL took 41.7s. Estimated remaining: 1h 46m 53s. Rate: 7.1 symbols/min [2025-10-13T20:46:10.997161] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:10.997329] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-13T20:46:10.997371] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-13T20:46:10.997475] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-13T20:46:10.997515] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-13T20:46:10.997555] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-13T20:46:10.997607] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-13T20:46:11.144254] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:46:11.153345] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-13T20:46:11.162585] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:46:11.162876] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-13T20:46:11.162958] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:46:11.212237] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-13T20:46:11.258548] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-13T20:46:11.284510] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-13T20:46:11.309823] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-13T20:46:11.331118] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OTF took 1.1s. Estimated remaining: 1h 46m 41s. Rate: 7.1 symbols/min [2025-10-13T20:46:11.417510] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:11.619500] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-13T20:46:11.627527] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:11.629510] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-13T20:46:11.629817] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-13T20:46:11.629983] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-13T20:46:11.630052] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-13T20:46:11.630118] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-13T20:46:11.630331] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-13T20:46:11.821190] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-13T20:46:12.201767] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:12.418002] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-13T20:46:13.218010] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-13T20:46:13.472797] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T20:46:13.658872] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T20:46:14.017974] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-13T20:46:14.817944] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-13T20:46:15.107906] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T20:46:15.617915] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-13T20:46:15.773432] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T20:46:16.125942] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:46:16.417933] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-13T20:46:17.217923] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-13T20:46:17.370087] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T20:46:18.026897] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-13T20:46:18.058481] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T20:46:18.817926] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-13T20:46:18.915925] [DEBUG] [REMOTE ] OUT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T20:46:18.916392] [WARN ] [REMOTE ] OUT: No data returned for month 2025-02 [2025-10-13T20:46:18.916491] [FATAL] [REMOTE ] OUT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:46:18.916595] [FATAL] [MAIN ] OUT: Failed to fetch primary data. [2025-10-13T20:46:18.916635] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:46:18.916727] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-13T20:46:18.916802] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-13T20:46:18.916840] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-13T20:46:18.916880] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-13T20:46:18.916937] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OUT took 7.5s. Estimated remaining: 1h 46m 32s. Rate: 7.1 symbols/min [2025-10-13T20:46:19.100003] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:19.100226] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-13T20:46:19.100282] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-13T20:46:19.100511] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-13T20:46:19.100579] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-13T20:46:19.100668] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-13T20:46:19.100734] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-13T20:46:19.284011] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T20:46:19.487889] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:19.617918] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-13T20:46:20.417954] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-13T20:46:20.539841] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-13T20:46:21.217914] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-13T20:46:21.488246] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T20:46:21.953316] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:46:22.017950] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-13T20:46:22.817976] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-13T20:46:23.590922] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:46:23.618012] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-13T20:46:23.777288] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-13T20:46:24.418062] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-13T20:46:24.820338] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-13T20:46:25.228717] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-13T20:46:25.250472] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T20:46:26.017951] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-13T20:46:26.160272] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T20:46:26.817908] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-13T20:46:27.091174] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T20:46:27.617932] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-13T20:46:28.013472] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T20:46:28.418053] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-13T20:46:28.505882] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-13T20:46:29.217952] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-13T20:46:29.504425] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T20:46:30.017917] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-13T20:46:30.302268] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T20:46:30.527218] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T20:46:30.817912] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-13T20:46:31.617935] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-13T20:46:31.680201] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T20:46:32.417896] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-13T20:46:32.511874] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T20:46:33.218019] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-13T20:46:34.017923] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-13T20:46:34.108331] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-13T20:46:34.399475] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T20:46:34.817928] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-13T20:46:34.916521] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T20:46:35.617913] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-13T20:46:35.795381] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T20:46:36.417922] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-13T20:46:36.736426] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T20:46:37.084156] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:46:37.089493] [INFO ] [REMOTE ] OSK: Full fetch complete (60941 records). [2025-10-13T20:46:37.089765] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-13T20:46:37.090984] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:46:37.091098] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:46:37.091145] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:46:37.091190] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-13T20:46:37.091262] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-13T20:46:37.091301] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-13T20:46:37.091342] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-13T20:46:37.091415] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSK took 30.1s. Estimated remaining: 1h 46m 28s. Rate: 7.1 symbols/min [2025-10-13T20:46:37.223079] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-13T20:46:37.282268] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:37.282509] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-13T20:46:37.282551] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-13T20:46:37.282698] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-13T20:46:37.282783] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-13T20:46:37.282827] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-13T20:46:37.282862] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-13T20:46:37.661388] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:38.017910] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-13T20:46:38.279910] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-13T20:46:38.817996] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-13T20:46:39.111257] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T20:46:39.617931] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-13T20:46:39.857834] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T20:46:40.418012] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-13T20:46:40.591674] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T20:46:40.803683] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T20:46:40.808762] [INFO ] [REMOTE ] OSCR: Full fetch complete (77154 records). [2025-10-13T20:46:40.808887] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-13T20:46:40.809566] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:46:40.809681] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:46:40.809734] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:46:40.809773] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-13T20:46:40.809827] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-13T20:46:40.809863] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-13T20:46:40.809900] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-13T20:46:40.809955] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OSCR took 39.7s. Estimated remaining: 1h 46m 17s. Rate: 7.1 symbols/min [2025-10-13T20:46:40.976696] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:40.986003] [DEBUG] [LOCAL ] OWLT: Loaded 9274 existing records from primary storage. [2025-10-13T20:46:40.986195] [INFO ] [MAIN ] OWLT: Loaded 9274 existing records. [2025-10-13T20:46:41.159074] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:46:41.159262] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-13T20:46:41.159308] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-13T20:46:41.159547] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-13T20:46:41.159603] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-13T20:46:41.226700] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-13T20:46:41.511526] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:41.592540] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T20:46:42.017932] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-13T20:46:42.817949] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-13T20:46:43.074228] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T20:46:43.617908] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-13T20:46:43.691445] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T20:46:44.028599] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T20:46:44.417918] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-13T20:46:45.218032] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-13T20:46:45.575905] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T20:46:45.940461] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T20:46:46.017892] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-13T20:46:46.215373] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T20:46:46.648409] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T20:46:46.818027] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-13T20:46:47.617925] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-13T20:46:48.381166] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T20:46:48.417910] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-13T20:46:48.530328] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T20:46:49.217935] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-13T20:46:49.882781] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T20:46:50.017938] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-13T20:46:50.318677] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T20:46:50.726453] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T20:46:50.817916] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-13T20:46:51.617924] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-13T20:46:52.417926] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-13T20:46:52.727600] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T20:46:53.072829] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:46:53.080948] [INFO ] [REMOTE ] OTIS: Full fetch complete (75604 records). [2025-10-13T20:46:53.081085] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-13T20:46:53.081965] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:46:53.082057] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:46:53.082099] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:46:53.082140] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-13T20:46:53.082196] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-13T20:46:53.082231] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-13T20:46:53.082270] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-13T20:46:53.082340] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OTIS took 42.3s. Estimated remaining: 1h 46m 11s. Rate: 7.1 symbols/min [2025-10-13T20:46:53.222616] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-13T20:46:53.254922] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:46:53.255801] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-13T20:46:53.255858] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-13T20:46:53.256018] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-13T20:46:53.256073] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-13T20:46:53.256118] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-13T20:46:53.256204] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-13T20:46:53.627553] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:46:53.661222] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T20:46:53.965353] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T20:46:54.018016] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-13T20:46:54.817906] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-13T20:46:55.036015] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T20:46:55.617909] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-13T20:46:56.337538] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T20:46:56.417891] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-13T20:46:56.534244] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T20:46:57.217951] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-13T20:46:57.875950] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T20:46:58.017958] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-13T20:46:58.083765] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T20:46:58.818485] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-13T20:46:59.218103] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T20:46:59.582845] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T20:46:59.584522] [INFO ] [REMOTE ] OWLT: Full fetch complete (11894 records). [2025-10-13T20:46:59.584590] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-13T20:46:59.623116] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-13T20:46:59.940608] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-13T20:46:59.940713] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-13T20:46:59.940982] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-13T20:46:59.941022] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-13T20:46:59.941465] [DEBUG] [LOCAL ] OWLT: Trimmed 11894 records to 9242 (keeping 200 days of data) [2025-10-13T20:46:59.993952] [DEBUG] [LOCAL ] OWLT: Primary data saved (9242 records). [2025-10-13T20:46:59.994085] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-13T20:46:59.994164] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OWLT took 19.2s. Estimated remaining: 1h 46m 2s. Rate: 7.1 symbols/min [2025-10-13T20:47:00.160566] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:00.160748] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-13T20:47:00.160792] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-13T20:47:00.160897] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-13T20:47:00.160940] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-13T20:47:00.161017] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-13T20:47:00.161094] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-13T20:47:00.423041] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-13T20:47:00.509445] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:01.217961] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-13T20:47:01.284562] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T20:47:01.887326] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:47:01.893005] [INFO ] [REMOTE ] OVV: Full fetch complete (76950 records). [2025-10-13T20:47:01.893195] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-13T20:47:01.894308] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:47:01.894458] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:47:01.894502] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:47:01.894571] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-13T20:47:01.894637] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-13T20:47:01.894752] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-13T20:47:01.894823] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-13T20:47:01.894894] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OVV took 43.0s. Estimated remaining: 1h 45m 50s. Rate: 7.1 symbols/min [2025-10-13T20:47:02.023150] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-13T20:47:02.070470] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:02.071467] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-13T20:47:02.071510] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-13T20:47:02.071620] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-13T20:47:02.071694] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-13T20:47:02.071750] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-13T20:47:02.071784] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-13T20:47:02.455840] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:02.554415] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T20:47:02.817955] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-13T20:47:03.617947] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-13T20:47:04.417925] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-13T20:47:04.455955] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T20:47:04.882201] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-10-13T20:47:05.218027] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-13T20:47:05.325476] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:47:06.018011] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-13T20:47:06.365395] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:47:06.601525] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T20:47:06.817912] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-13T20:47:07.617940] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-13T20:47:07.911035] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T20:47:08.365001] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T20:47:08.417937] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-13T20:47:09.217955] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-13T20:47:09.964397] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T20:47:10.017936] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-13T20:47:10.287544] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-13T20:47:10.817911] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-13T20:47:11.171495] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T20:47:11.452510] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T20:47:11.617920] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-13T20:47:12.417951] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-13T20:47:12.753993] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T20:47:13.218018] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-13T20:47:13.517188] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T20:47:14.017927] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-13T20:47:14.568364] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:47:14.817928] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-13T20:47:14.943058] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-13T20:47:15.466746] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T20:47:15.617928] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-13T20:47:16.417910] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-13T20:47:17.090500] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-13T20:47:17.217935] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-13T20:47:18.017969] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-13T20:47:18.154086] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-13T20:47:18.404006] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T20:47:18.714728] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:47:18.718976] [INFO ] [REMOTE ] OXM: Full fetch complete (45931 records). [2025-10-13T20:47:18.719203] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-13T20:47:18.720161] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:47:18.720257] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:47:18.720303] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:47:18.720346] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-13T20:47:18.720492] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-13T20:47:18.720554] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-13T20:47:18.720601] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-13T20:47:18.720718] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OXM took 25.6s. Estimated remaining: 1h 45m 46s. Rate: 7.1 symbols/min [2025-10-13T20:47:18.826187] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-13T20:47:18.912959] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:18.928856] [DEBUG] [LOCAL ] PAC: Loaded 11728 existing records from primary storage. [2025-10-13T20:47:18.929349] [INFO ] [MAIN ] PAC: Loaded 11728 existing records. [2025-10-13T20:47:19.118857] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:47:19.119131] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-13T20:47:19.119181] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-13T20:47:19.119499] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-13T20:47:19.119566] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-13T20:47:19.513860] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:19.550010] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-13T20:47:19.574437] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:47:19.579694] [INFO ] [REMOTE ] OWL: Full fetch complete (77142 records). [2025-10-13T20:47:19.579826] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-13T20:47:19.580492] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:47:19.580579] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:47:19.580621] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:47:19.580703] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-13T20:47:19.580773] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-13T20:47:19.580811] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-13T20:47:19.580851] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-13T20:47:19.580910] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OWL took 42.5s. Estimated remaining: 1h 45m 34s. Rate: 7.1 symbols/min [2025-10-13T20:47:19.623113] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-13T20:47:19.765520] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:19.807056] [DEBUG] [LOCAL ] PACK: Loaded 32336 existing records from primary storage. [2025-10-13T20:47:19.807443] [INFO ] [MAIN ] PACK: Loaded 32336 existing records. [2025-10-13T20:47:19.997186] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:47:19.997609] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-13T20:47:19.997691] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-13T20:47:19.998275] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-13T20:47:19.998338] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-13T20:47:20.426691] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-13T20:47:20.453098] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:20.621567] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T20:47:21.217972] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-13T20:47:22.010570] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T20:47:22.017875] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-13T20:47:22.632566] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T20:47:22.654296] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T20:47:22.817948] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-13T20:47:23.617971] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-13T20:47:24.418006] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-13T20:47:24.770085] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T20:47:25.015000] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T20:47:25.185318] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-13T20:47:25.217886] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-13T20:47:26.017927] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-13T20:47:26.818064] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-13T20:47:27.617913] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-13T20:47:27.829943] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-13T20:47:27.863832] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T20:47:28.106555] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T20:47:28.418035] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-13T20:47:28.709942] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:47:29.218008] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-13T20:47:30.017936] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-13T20:47:30.817888] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-13T20:47:30.942360] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-13T20:47:30.953544] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T20:47:31.058357] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T20:47:31.617895] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-13T20:47:32.115242] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T20:47:32.417930] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-13T20:47:33.217907] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-13T20:47:33.694008] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T20:47:34.018026] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-13T20:47:34.661972] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T20:47:34.817894] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-13T20:47:34.997882] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-13T20:47:35.618009] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-13T20:47:35.853847] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T20:47:35.993350] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T20:47:36.417956] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-13T20:47:37.035138] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T20:47:37.136561] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T20:47:37.217976] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-13T20:47:38.017924] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-13T20:47:38.078760] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:47:38.765428] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:47:38.770471] [INFO ] [REMOTE ] PAAS: Full fetch complete (77033 records). [2025-10-13T20:47:38.770596] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-13T20:47:38.771420] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:47:38.771533] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:47:38.771576] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:47:38.771612] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-13T20:47:38.771690] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-13T20:47:38.771744] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-13T20:47:38.771786] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-13T20:47:38.771842] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. PAAS took 36.9s. Estimated remaining: 1h 45m 30s. Rate: 7.1 symbols/min [2025-10-13T20:47:38.826183] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-13T20:47:38.946613] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:38.946822] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-13T20:47:38.946866] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-13T20:47:38.946975] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-13T20:47:38.947017] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-13T20:47:38.947059] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-13T20:47:38.947093] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-13T20:47:39.301998] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:39.618035] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-13T20:47:39.866567] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T20:47:40.417927] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-13T20:47:41.219317] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-13T20:47:41.225138] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T20:47:42.017932] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-13T20:47:42.134070] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T20:47:42.137331] [INFO ] [REMOTE ] PAC: Full fetch complete (16639 records). [2025-10-13T20:47:42.137815] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-13T20:47:42.540240] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-13T20:47:42.540418] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-13T20:47:42.541258] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-13T20:47:42.541325] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-13T20:47:42.542135] [DEBUG] [LOCAL ] PAC: Trimmed 16639 records to 11639 (keeping 200 days of data) [2025-10-13T20:47:42.627634] [DEBUG] [LOCAL ] PAC: Primary data saved (11639 records). [2025-10-13T20:47:42.627875] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-13T20:47:42.628007] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAC took 23.9s. Estimated remaining: 1h 45m 20s. Rate: 7.1 symbols/min [2025-10-13T20:47:42.820740] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-13T20:47:42.822578] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:42.822948] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-13T20:47:42.835418] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-13T20:47:42.854308] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-13T20:47:42.854624] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-13T20:47:42.856322] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-13T20:47:42.867844] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-13T20:47:42.868459] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-13T20:47:43.259832] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:43.428736] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:47:43.617910] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-13T20:47:43.958628] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T20:47:44.359288] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T20:47:44.417889] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-13T20:47:45.217978] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-13T20:47:45.479385] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T20:47:46.018000] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-13T20:47:46.817957] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-13T20:47:47.461952] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T20:47:47.604826] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-13T20:47:47.617884] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-13T20:47:47.674083] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:47:48.417963] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-13T20:47:48.492458] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T20:47:48.498267] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-13T20:47:48.498491] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-13T20:47:48.499626] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:47:48.499785] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:47:48.499835] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:47:48.499883] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-13T20:47:48.499951] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-13T20:47:48.499999] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-13T20:47:48.500062] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-13T20:47:48.500140] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. OXY took 48.5s. Estimated remaining: 1h 45m 10s. Rate: 7.1 symbols/min [2025-10-13T20:47:48.682031] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:47:48.682292] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-13T20:47:48.682331] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-13T20:47:48.682457] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-13T20:47:48.682499] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-13T20:47:48.682540] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-13T20:47:48.682573] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-13T20:47:49.071235] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:47:49.217961] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-13T20:47:49.683366] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T20:47:50.017955] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-13T20:47:50.817960] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-13T20:47:50.858000] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T20:47:51.417945] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T20:47:51.617931] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-13T20:47:51.911385] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:47:52.417926] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-13T20:47:53.155071] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T20:47:53.217893] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-13T20:47:53.802305] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T20:47:54.017930] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-13T20:47:54.574997] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T20:47:54.817937] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-13T20:47:55.619564] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-13T20:47:55.622688] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T20:47:55.796449] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T20:47:56.417940] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-13T20:47:57.217953] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-13T20:47:57.533711] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T20:47:57.645560] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T20:47:58.017927] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-13T20:47:58.486299] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T20:47:58.817908] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-13T20:47:59.471337] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T20:47:59.617901] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-13T20:48:00.009065] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T20:48:00.418028] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-13T20:48:01.217915] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-13T20:48:01.543528] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T20:48:02.012278] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T20:48:02.023178] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-13T20:48:02.485072] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T20:48:02.817935] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-13T20:48:03.404078] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T20:48:03.408929] [INFO ] [REMOTE ] PACK: Full fetch complete (44631 records). [2025-10-13T20:48:03.409063] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-13T20:48:03.625998] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-13T20:48:03.829876] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-13T20:48:03.829952] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-13T20:48:03.830729] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-13T20:48:03.830812] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-13T20:48:03.831767] [DEBUG] [LOCAL ] PACK: Trimmed 44631 records to 31890 (keeping 200 days of data) [2025-10-13T20:48:04.013051] [DEBUG] [LOCAL ] PACK: Primary data saved (31890 records). [2025-10-13T20:48:04.013194] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-13T20:48:04.013275] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PACK took 44.4s. Estimated remaining: 1h 45m 5s. Rate: 7.1 symbols/min [2025-10-13T20:48:04.183538] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:04.187974] [DEBUG] [LOCAL ] PAI: Loaded 2718 existing records from primary storage. [2025-10-13T20:48:04.188189] [INFO ] [MAIN ] PAI: Loaded 2718 existing records. [2025-10-13T20:48:04.371607] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:48:04.371944] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-13T20:48:04.371995] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-13T20:48:04.372182] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-13T20:48:04.372239] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-13T20:48:04.436393] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-13T20:48:04.747940] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:04.779444] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T20:48:05.179620] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T20:48:05.217921] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-13T20:48:05.384093] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T20:48:06.017932] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-13T20:48:06.685087] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T20:48:06.817908] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-13T20:48:06.917215] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T20:48:07.475397] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T20:48:07.479040] [INFO ] [REMOTE ] PACS: Full fetch complete (50365 records). [2025-10-13T20:48:07.479128] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-13T20:48:07.479949] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:48:07.480082] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:48:07.480125] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:48:07.480163] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-13T20:48:07.480217] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-13T20:48:07.480252] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-13T20:48:07.480292] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-13T20:48:07.480344] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACS took 28.7s. Estimated remaining: 1h 44m 54s. Rate: 7.1 symbols/min [2025-10-13T20:48:07.622827] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-13T20:48:07.658694] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:07.658885] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-13T20:48:07.658938] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-13T20:48:07.659084] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-13T20:48:07.659133] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-13T20:48:07.659174] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-13T20:48:07.659206] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-13T20:48:08.010695] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:08.395278] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T20:48:08.417895] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-13T20:48:08.969144] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T20:48:09.217925] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-13T20:48:09.632836] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T20:48:09.635390] [INFO ] [REMOTE ] PAG: Full fetch complete (30291 records). [2025-10-13T20:48:09.635483] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-13T20:48:09.636032] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:48:09.636119] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:48:09.636163] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:48:09.636202] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-13T20:48:09.636263] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-13T20:48:09.636299] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-13T20:48:09.636338] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-13T20:48:09.636435] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAG took 27.0s. Estimated remaining: 1h 44m 43s. Rate: 7.1 symbols/min [2025-10-13T20:48:09.810306] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:09.810771] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-13T20:48:09.810840] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-13T20:48:09.811003] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-13T20:48:09.811049] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-13T20:48:09.811096] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-13T20:48:09.811147] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-13T20:48:10.023159] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-13T20:48:10.199799] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:10.817924] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-13T20:48:11.617945] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-13T20:48:11.934758] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:48:11.957322] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-13T20:48:11.957452] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:48:11.957570] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-13T20:48:11.957677] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:48:11.957763] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-13T20:48:11.960910] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-13T20:48:11.961034] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-13T20:48:11.961101] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-13T20:48:11.961394] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 4.5s. Estimated remaining: 1h 44m 32s. Rate: 7.1 symbols/min [2025-10-13T20:48:11.971707] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T20:48:12.190538] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:12.190917] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-13T20:48:12.190975] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-13T20:48:12.191115] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-13T20:48:12.191166] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-13T20:48:12.191210] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-13T20:48:12.191247] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-13T20:48:12.424790] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-13T20:48:12.475506] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T20:48:12.632193] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:13.217923] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-13T20:48:14.017946] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-13T20:48:14.412163] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T20:48:14.620693] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T20:48:14.732933] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T20:48:14.817923] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-13T20:48:15.617919] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-13T20:48:16.417963] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-13T20:48:16.419449] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T20:48:17.217931] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-13T20:48:17.544690] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T20:48:17.935477] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T20:48:18.017927] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-13T20:48:18.512339] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T20:48:18.817949] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-13T20:48:19.617946] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-13T20:48:19.852925] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T20:48:20.239140] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T20:48:20.417935] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-13T20:48:20.744346] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T20:48:21.218011] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-13T20:48:21.497891] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T20:48:22.017968] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-13T20:48:22.580324] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T20:48:22.817898] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-13T20:48:23.617958] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-13T20:48:23.999475] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T20:48:24.050967] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T20:48:24.274769] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T20:48:24.417928] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-13T20:48:24.978109] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T20:48:25.217940] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-13T20:48:26.017911] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-13T20:48:26.654363] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T20:48:26.679156] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T20:48:26.817923] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-13T20:48:27.617976] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-13T20:48:28.128231] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T20:48:28.207766] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T20:48:28.417931] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-13T20:48:29.217953] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-13T20:48:30.017954] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-13T20:48:30.348114] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T20:48:30.379102] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T20:48:30.818013] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-13T20:48:31.229824] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T20:48:31.617928] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-13T20:48:32.417948] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-13T20:48:32.675523] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T20:48:32.731333] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T20:48:32.820117] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T20:48:33.218040] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-13T20:48:33.897012] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T20:48:34.017964] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-13T20:48:34.818030] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-13T20:48:35.509390] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T20:48:35.537012] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T20:48:35.542673] [INFO ] [REMOTE ] PAGS: Full fetch complete (75919 records). [2025-10-13T20:48:35.542889] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-13T20:48:35.543900] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:48:35.544006] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:48:35.544053] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:48:35.544098] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-13T20:48:35.544199] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-13T20:48:35.544290] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-13T20:48:35.544337] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-13T20:48:35.544406] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAGS took 47.0s. Estimated remaining: 1h 44m 30s. Rate: 7.1 symbols/min [2025-10-13T20:48:35.623081] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-13T20:48:35.735433] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:35.735682] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-13T20:48:35.735740] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-13T20:48:35.735884] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-13T20:48:35.735969] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-13T20:48:35.736039] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-13T20:48:35.736077] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-13T20:48:36.104724] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:36.126683] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T20:48:36.127515] [INFO ] [REMOTE ] PAI: Full fetch complete (4063 records). [2025-10-13T20:48:36.127582] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-13T20:48:36.423076] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-13T20:48:36.502540] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-13T20:48:36.502673] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-13T20:48:36.502885] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-13T20:48:36.502981] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-13T20:48:36.503837] [DEBUG] [LOCAL ] PAI: Trimmed 4063 records to 2704 (keeping 200 days of data) [2025-10-13T20:48:36.521528] [DEBUG] [LOCAL ] PAI: Primary data saved (2704 records). [2025-10-13T20:48:36.521593] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-13T20:48:36.521694] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAI took 32.5s. Estimated remaining: 1h 44m 18s. Rate: 7.1 symbols/min [2025-10-13T20:48:36.700960] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:36.701154] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-13T20:48:36.701197] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-13T20:48:36.701326] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-13T20:48:36.701374] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-13T20:48:36.701422] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-13T20:48:36.701461] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-13T20:48:37.082395] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:37.093033] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:48:37.096687] [INFO ] [REMOTE ] PAM: Full fetch complete (41731 records). [2025-10-13T20:48:37.096793] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-13T20:48:37.097377] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:48:37.097465] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:48:37.097530] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:48:37.097632] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-13T20:48:37.097745] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-13T20:48:37.097789] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-13T20:48:37.097830] [DEBUG] [LOCAL ] PAM: No derivative data file found to delete. [2025-10-13T20:48:37.097889] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 27.5s. Estimated remaining: 1h 44m 6s. Rate: 7.1 symbols/min [2025-10-13T20:48:37.223057] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-13T20:48:37.270848] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:37.271079] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-13T20:48:37.271116] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-13T20:48:37.271236] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-13T20:48:37.271277] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-13T20:48:37.271317] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-13T20:48:37.271350] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-13T20:48:37.625323] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:38.018033] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-13T20:48:38.817934] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-13T20:48:39.383212] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T20:48:39.617977] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-13T20:48:39.802763] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-13T20:48:39.855035] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T20:48:40.418039] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-13T20:48:40.699830] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T20:48:41.217945] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-13T20:48:41.395002] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T20:48:42.018036] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-13T20:48:42.443385] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:48:42.818021] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-13T20:48:43.617910] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-13T20:48:43.688928] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T20:48:43.913317] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T20:48:44.417921] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-13T20:48:44.985616] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T20:48:45.217952] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-13T20:48:46.017942] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-13T20:48:46.671677] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T20:48:46.795681] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-13T20:48:46.817875] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-13T20:48:47.092327] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T20:48:47.617932] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-13T20:48:48.417925] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-13T20:48:49.120685] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-13T20:48:49.176187] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T20:48:49.217899] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-13T20:48:49.249602] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T20:48:50.017892] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-13T20:48:50.707784] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:48:50.712274] [INFO ] [REMOTE ] PAR: Full fetch complete (48234 records). [2025-10-13T20:48:50.712399] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-13T20:48:50.713218] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:48:50.713312] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:48:50.713377] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:48:50.713430] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-13T20:48:50.713485] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-13T20:48:50.713523] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-13T20:48:50.713563] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-13T20:48:50.713620] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 38.8s. Estimated remaining: 1h 44m 0s. Rate: 7.1 symbols/min [2025-10-13T20:48:50.817950] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-13T20:48:50.894514] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:48:50.894908] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-13T20:48:50.894959] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-13T20:48:50.895161] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-13T20:48:50.895231] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-13T20:48:50.895285] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-13T20:48:50.895405] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-13T20:48:51.073191] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T20:48:51.294399] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:48:51.617930] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-13T20:48:52.085156] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T20:48:52.417910] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-13T20:48:52.827168] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T20:48:53.217904] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-13T20:48:54.017898] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-13T20:48:54.288446] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T20:48:54.817930] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-13T20:48:55.340801] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T20:48:55.425848] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T20:48:55.617925] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-13T20:48:56.107209] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T20:48:56.417953] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-13T20:48:57.096495] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T20:48:57.217919] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-13T20:48:57.906818] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T20:48:58.017921] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-13T20:48:58.317589] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T20:48:58.817942] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-13T20:48:59.584511] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T20:48:59.617898] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-13T20:49:00.097787] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T20:49:00.417933] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-13T20:49:01.217963] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-13T20:49:01.468492] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T20:49:01.565363] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T20:49:02.017899] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-13T20:49:02.336001] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T20:49:02.817914] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-13T20:49:03.617932] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-13T20:49:03.806265] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T20:49:04.418054] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-13T20:49:04.823471] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T20:49:05.143867] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-13T20:49:05.217904] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-13T20:49:05.518113] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T20:49:06.017918] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-13T20:49:06.651145] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:49:06.654184] [INFO ] [REMOTE ] PAXS: Full fetch complete (30055 records). [2025-10-13T20:49:06.654413] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-13T20:49:06.655132] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:06.655233] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:06.655281] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:06.655329] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-13T20:49:06.655400] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-13T20:49:06.655439] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-13T20:49:06.655482] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-13T20:49:06.655552] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAXS took 29.6s. Estimated remaining: 1h 43m 55s. Rate: 7.1 symbols/min [2025-10-13T20:49:06.820047] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-13T20:49:06.928345] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:06.928536] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-13T20:49:06.928572] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-13T20:49:06.928764] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-13T20:49:06.928838] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-13T20:49:06.928915] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-13T20:49:06.928983] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-13T20:49:07.476467] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:07.617954] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-13T20:49:07.667784] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T20:49:08.307550] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:49:08.312808] [INFO ] [REMOTE ] PARR: Full fetch complete (68575 records). [2025-10-13T20:49:08.312983] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-13T20:49:08.313808] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:08.313905] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:08.313949] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:08.314018] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-13T20:49:08.314094] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-13T20:49:08.314131] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-13T20:49:08.314171] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-13T20:49:08.314238] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PARR took 32.8s. Estimated remaining: 1h 43m 44s. Rate: 7.1 symbols/min [2025-10-13T20:49:08.424389] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-13T20:49:08.518527] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:08.519183] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-13T20:49:08.519292] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-13T20:49:08.519455] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-13T20:49:08.519539] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-13T20:49:08.519685] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-13T20:49:08.519781] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-13T20:49:08.695074] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T20:49:08.922245] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:09.217915] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-13T20:49:10.017924] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-13T20:49:10.627827] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-13T20:49:10.659431] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T20:49:10.817926] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-13T20:49:11.380180] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T20:49:11.617911] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-13T20:49:12.313403] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:49:12.417925] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-13T20:49:13.217971] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-13T20:49:13.867317] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T20:49:14.019891] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-13T20:49:14.026125] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-13T20:49:14.817946] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-13T20:49:14.848471] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T20:49:15.601539] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T20:49:15.617881] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-13T20:49:16.268688] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T20:49:16.417928] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-13T20:49:17.217924] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-13T20:49:17.310325] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T20:49:18.017943] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-13T20:49:18.800821] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-13T20:49:18.818173] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-13T20:49:18.852066] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T20:49:19.621313] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-13T20:49:19.623717] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T20:49:20.395339] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T20:49:20.417923] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-13T20:49:21.218009] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-13T20:49:22.021497] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-13T20:49:22.099516] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T20:49:22.250579] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-13T20:49:22.804128] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T20:49:22.817874] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-13T20:49:23.431417] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:49:23.435603] [INFO ] [REMOTE ] PAY: Full fetch complete (53307 records). [2025-10-13T20:49:23.435868] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-13T20:49:23.437220] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:23.437326] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:23.437404] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:23.437492] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-13T20:49:23.437574] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-13T20:49:23.437625] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-13T20:49:23.437728] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-13T20:49:23.437836] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAY took 32.7s. Estimated remaining: 1h 43m 39s. Rate: 7.1 symbols/min [2025-10-13T20:49:23.614332] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:23.614710] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-13T20:49:23.614851] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-13T20:49:23.615026] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-13T20:49:23.615176] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-13T20:49:23.615275] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-13T20:49:23.615403] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-13T20:49:23.634588] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-13T20:49:23.729784] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T20:49:24.011510] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:24.417901] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-13T20:49:24.476777] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T20:49:24.482015] [INFO ] [REMOTE ] PATH: Full fetch complete (77374 records). [2025-10-13T20:49:24.482135] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-13T20:49:24.482812] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:24.482907] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:24.482981] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:24.483072] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-13T20:49:24.483151] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-13T20:49:24.483189] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-13T20:49:24.483228] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-13T20:49:24.483283] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PATH took 48.0s. Estimated remaining: 1h 43m 27s. Rate: 7.1 symbols/min [2025-10-13T20:49:24.648974] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:24.649168] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-13T20:49:24.649207] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-13T20:49:24.649344] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-13T20:49:24.649407] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-13T20:49:24.649454] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-13T20:49:24.649488] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-13T20:49:24.997517] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:25.217921] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-13T20:49:26.017963] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-13T20:49:26.177097] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T20:49:26.663309] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T20:49:26.817976] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-13T20:49:27.618671] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-13T20:49:27.624500] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T20:49:28.418115] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-13T20:49:28.464567] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T20:49:29.217929] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-13T20:49:29.293253] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T20:49:29.986494] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T20:49:30.017891] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-13T20:49:30.818088] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-13T20:49:30.943764] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T20:49:31.422907] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T20:49:31.617973] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-13T20:49:32.394859] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T20:49:32.417892] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-13T20:49:33.171448] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T20:49:33.217930] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-13T20:49:34.002177] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T20:49:34.017898] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-13T20:49:34.817957] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-13T20:49:35.045796] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T20:49:35.527037] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T20:49:35.617925] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-13T20:49:36.316441] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T20:49:36.417953] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-13T20:49:37.217949] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-13T20:49:37.456427] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T20:49:38.017939] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-13T20:49:38.179928] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T20:49:38.630927] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T20:49:38.818005] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-13T20:49:39.427384] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:49:39.617896] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-13T20:49:40.417949] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-13T20:49:40.565733] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T20:49:41.217920] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-13T20:49:41.329910] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T20:49:41.989120] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T20:49:42.017976] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-13T20:49:42.817906] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-13T20:49:43.162590] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T20:49:43.280510] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T20:49:43.509370] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:49:43.515313] [INFO ] [REMOTE ] PAYC: Full fetch complete (52643 records). [2025-10-13T20:49:43.515414] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-13T20:49:43.518881] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:43.518989] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:43.519094] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:43.519167] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-13T20:49:43.519229] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-13T20:49:43.519265] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-13T20:49:43.519304] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-13T20:49:43.519359] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAYC took 36.9s. Estimated remaining: 1h 43m 23s. Rate: 7.1 symbols/min [2025-10-13T20:49:43.623130] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-13T20:49:43.706605] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:43.707039] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-13T20:49:43.707087] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-13T20:49:43.707203] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-13T20:49:43.707265] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-13T20:49:43.707340] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-13T20:49:43.707388] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-13T20:49:44.055709] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:44.417953] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-13T20:49:44.950926] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:49:44.955117] [INFO ] [REMOTE ] PB: Full fetch complete (58652 records). [2025-10-13T20:49:44.955200] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-13T20:49:44.955776] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:44.955858] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:44.955900] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:44.955937] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-13T20:49:44.956020] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-13T20:49:44.956076] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-13T20:49:44.956118] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-13T20:49:44.956172] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PB took 36.6s. Estimated remaining: 1h 43m 12s. Rate: 7.1 symbols/min [2025-10-13T20:49:45.153770] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:49:45.154046] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-13T20:49:45.154087] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-13T20:49:45.154214] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-13T20:49:45.154257] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-13T20:49:45.154300] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-13T20:49:45.154333] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-13T20:49:45.222423] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-13T20:49:45.556857] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:49:45.611064] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T20:49:46.018026] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-13T20:49:46.817953] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-13T20:49:47.143632] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T20:49:47.617933] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-13T20:49:47.777061] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T20:49:48.042617] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T20:49:48.417945] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-13T20:49:49.217942] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-13T20:49:49.384697] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T20:49:50.018029] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-13T20:49:50.204151] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T20:49:50.248262] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T20:49:50.817931] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-13T20:49:51.513631] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T20:49:51.605556] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:49:51.610498] [INFO ] [REMOTE ] PBA: Full fetch complete (71084 records). [2025-10-13T20:49:51.610635] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-13T20:49:51.611469] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:49:51.611557] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:49:51.611600] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:49:51.611661] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-13T20:49:51.611745] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-13T20:49:51.611784] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-13T20:49:51.611822] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-13T20:49:51.611879] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 28.2s. Estimated remaining: 1h 43m 2s. Rate: 7.1 symbols/min [2025-10-13T20:49:51.617909] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-13T20:49:52.417937] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-13T20:49:52.679396] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T20:49:53.217939] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-13T20:49:54.017970] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-13T20:49:54.180704] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T20:49:54.559882] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T20:49:54.818059] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-13T20:49:55.617971] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-13T20:49:55.914530] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T20:49:56.417940] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-13T20:49:56.500807] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T20:49:57.028240] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T20:49:57.217918] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-13T20:49:58.017959] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-13T20:49:58.245976] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T20:49:58.628505] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T20:49:58.817948] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-13T20:49:59.481169] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T20:49:59.617953] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-13T20:50:00.142133] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T20:50:00.417970] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-13T20:50:01.217950] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-13T20:50:01.821461] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T20:50:02.017964] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-13T20:50:02.204518] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-13T20:50:02.818011] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-13T20:50:03.350155] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T20:50:03.476105] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-13T20:50:03.502315] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:50:03.508035] [INFO ] [REMOTE ] PBF: Full fetch complete (76221 records). [2025-10-13T20:50:03.508227] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-13T20:50:03.509154] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:03.509272] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:03.509317] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:03.509397] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-13T20:50:03.509485] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-13T20:50:03.509556] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-13T20:50:03.509608] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-13T20:50:03.509701] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBF took 39.0s. Estimated remaining: 1h 42m 55s. Rate: 7.1 symbols/min [2025-10-13T20:50:03.618010] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-13T20:50:04.418060] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-13T20:50:05.417557] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T20:50:05.428069] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-13T20:50:05.932443] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T20:50:06.017942] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-13T20:50:06.625449] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T20:50:06.628943] [INFO ] [REMOTE ] PBH: Full fetch complete (43854 records). [2025-10-13T20:50:06.629076] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-13T20:50:06.629784] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:06.629885] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:06.629936] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:06.630010] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-13T20:50:06.630087] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-13T20:50:06.630179] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-13T20:50:06.630250] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-13T20:50:06.630309] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBH took 23.1s. Estimated remaining: 1h 42m 45s. Rate: 7.1 symbols/min [2025-10-13T20:50:07.484286] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T20:50:07.496667] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-13T20:50:09.406886] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T20:50:09.421884] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-13T20:50:11.319271] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T20:50:11.331090] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-13T20:50:11.960605] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T20:50:11.965600] [INFO ] [REMOTE ] PBI: Full fetch complete (71791 records). [2025-10-13T20:50:11.965782] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-13T20:50:11.966462] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:11.966548] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:11.966591] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:11.966627] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-13T20:50:11.966722] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-13T20:50:11.966766] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-13T20:50:11.966806] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-13T20:50:11.966862] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBI took 27.0s. Estimated remaining: 1h 42m 35s. Rate: 7.1 symbols/min [2025-10-13T20:50:12.534598] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:12.560577] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-13T20:50:12.560809] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-13T20:50:12.681451] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:12.710947] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-13T20:50:12.743993] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-13T20:50:12.743919] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:12.746054] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-13T20:50:12.745708] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-13T20:50:12.746539] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-13T20:50:12.766519] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-13T20:50:12.766632] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-13T20:50:12.766142] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:12.766759] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-13T20:50:12.772097] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-13T20:50:12.772044] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-13T20:50:12.787127] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-13T20:50:12.787007] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-13T20:50:12.926138] [DEBUG] [LOCAL ] PCF: Loaded 9140 existing records from primary storage. [2025-10-13T20:50:12.946867] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-13T20:50:12.991338] [INFO ] [MAIN ] PCF: Loaded 9140 existing records. [2025-10-13T20:50:12.991486] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-13T20:50:13.037712] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-13T20:50:13.088853] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-13T20:50:13.747424] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:50:13.783077] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-13T20:50:13.788293] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-13T20:50:13.813500] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-13T20:50:13.872244] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-13T20:50:13.912887] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:14.037008] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-13T20:50:14.084898] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:14.145532] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-13T20:50:14.333722] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:14.374367] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-13T20:50:14.537673] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:14.538029] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-13T20:50:15.586485] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T20:50:15.591429] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-13T20:50:15.640087] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T20:50:15.644201] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-13T20:50:16.182302] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T20:50:16.194784] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-13T20:50:16.272596] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T20:50:16.285539] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-13T20:50:16.664453] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T20:50:16.667732] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-13T20:50:16.763063] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T20:50:16.767135] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-13T20:50:17.381566] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T20:50:17.385504] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-13T20:50:17.850123] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T20:50:18.024920] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-13T20:50:18.055739] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T20:50:18.071360] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T20:50:18.257918] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T20:50:18.817950] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-13T20:50:18.977760] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T20:50:19.617979] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-13T20:50:20.417912] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-13T20:50:20.730131] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T20:50:20.912776] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-13T20:50:21.218045] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-13T20:50:22.018027] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-13T20:50:22.111790] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T20:50:22.356856] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T20:50:22.817886] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-13T20:50:23.126390] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T20:50:23.617907] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-13T20:50:24.418059] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-13T20:50:25.078016] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-13T20:50:25.217902] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-13T20:50:25.450862] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T20:50:25.745388] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T20:50:26.018022] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-13T20:50:26.818009] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-13T20:50:27.154885] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T20:50:27.618132] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-13T20:50:27.622115] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-13T20:50:27.662484] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T20:50:28.417958] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-13T20:50:28.795157] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T20:50:29.218012] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-13T20:50:30.017926] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-13T20:50:30.415974] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T20:50:30.817966] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-13T20:50:31.040263] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T20:50:31.461052] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-13T20:50:31.617934] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-13T20:50:31.665547] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T20:50:32.418022] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-13T20:50:33.217943] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-13T20:50:33.318258] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T20:50:33.605156] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T20:50:33.605917] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T20:50:33.619478] [INFO ] [REMOTE ] PBT: Full fetch complete (24801 records). [2025-10-13T20:50:33.619582] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-13T20:50:33.620124] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:33.620250] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:33.620306] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:33.620375] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-13T20:50:33.620450] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-13T20:50:33.620508] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-13T20:50:33.620553] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-13T20:50:33.620609] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PBT took 21.6s. Estimated remaining: 1h 42m 32s. Rate: 7.1 symbols/min [2025-10-13T20:50:33.808941] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:33.819144] [DEBUG] [LOCAL ] PCM: Loaded 6856 existing records from primary storage. [2025-10-13T20:50:33.819362] [INFO ] [MAIN ] PCM: Loaded 6856 existing records. [2025-10-13T20:50:33.991101] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:50:33.991295] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-13T20:50:33.991339] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-13T20:50:33.991556] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-13T20:50:33.991618] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-13T20:50:34.023097] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-13T20:50:34.337420] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:34.817914] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-13T20:50:34.929103] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T20:50:35.617949] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-13T20:50:36.417959] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-13T20:50:36.543516] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T20:50:37.014833] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-13T20:50:37.120298] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T20:50:37.218056] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-13T20:50:37.968005] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:50:37.969554] [INFO ] [REMOTE ] PCF: Full fetch complete (13763 records). [2025-10-13T20:50:37.969627] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-13T20:50:38.023831] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-13T20:50:38.340798] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-13T20:50:38.340907] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-13T20:50:38.341618] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-13T20:50:38.341705] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-13T20:50:38.342273] [DEBUG] [LOCAL ] PCF: Trimmed 13763 records to 9089 (keeping 200 days of data) [2025-10-13T20:50:38.404173] [DEBUG] [LOCAL ] PCF: Primary data saved (9089 records). [2025-10-13T20:50:38.404361] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-13T20:50:38.404462] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PCF took 26.4s. Estimated remaining: 1h 42m 22s. Rate: 7.1 symbols/min [2025-10-13T20:50:38.589588] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:38.589888] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-13T20:50:38.589931] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-13T20:50:38.590054] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-13T20:50:38.590097] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-13T20:50:38.590138] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-13T20:50:38.590172] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-13T20:50:38.823068] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-13T20:50:38.909023] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T20:50:38.997513] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:39.617919] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-13T20:50:40.417901] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-13T20:50:40.439819] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T20:50:40.918624] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-13T20:50:41.217959] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-13T20:50:42.018035] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-13T20:50:42.349279] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T20:50:42.534966] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:50:42.817919] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-13T20:50:43.617897] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-13T20:50:43.766262] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T20:50:43.932630] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:50:44.418021] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-13T20:50:44.532756] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T20:50:45.218033] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-13T20:50:45.529875] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T20:50:46.017964] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-13T20:50:46.817919] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-13T20:50:47.201919] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T20:50:47.617919] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-13T20:50:47.691280] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T20:50:48.059021] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-13T20:50:48.418037] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-13T20:50:48.841523] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T20:50:49.187801] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T20:50:49.217940] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-13T20:50:50.017967] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-13T20:50:50.817903] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-13T20:50:50.887629] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T20:50:51.356226] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-13T20:50:51.617948] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-13T20:50:52.187307] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T20:50:52.320319] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T20:50:52.417953] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-13T20:50:53.217951] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-13T20:50:54.017906] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-13T20:50:54.396860] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T20:50:54.474148] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T20:50:54.480929] [INFO ] [REMOTE ] PCG: Full fetch complete (77348 records). [2025-10-13T20:50:54.481104] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-13T20:50:54.481947] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:54.482085] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:54.482165] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:54.482248] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-13T20:50:54.482333] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-13T20:50:54.482372] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-13T20:50:54.482413] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-13T20:50:54.482517] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PCG took 42.5s. Estimated remaining: 1h 42m 17s. Rate: 7.1 symbols/min [2025-10-13T20:50:54.663342] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:54.663583] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-13T20:50:54.663672] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-13T20:50:54.663978] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-13T20:50:54.664095] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-13T20:50:54.664381] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-13T20:50:54.664469] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-13T20:50:54.836712] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-13T20:50:54.933430] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-13T20:50:55.083561] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:55.617903] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-13T20:50:55.686422] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T20:50:56.417945] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-13T20:50:56.949295] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T20:50:57.217936] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-13T20:50:57.252821] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T20:50:58.017970] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-13T20:50:58.428860] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T20:50:58.818018] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-13T20:50:58.843807] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T20:50:58.848930] [INFO ] [REMOTE ] PBR: Full fetch complete (77385 records). [2025-10-13T20:50:58.849074] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-13T20:50:58.849962] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:50:58.850073] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:50:58.850117] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:50:58.850156] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-13T20:50:58.850213] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-13T20:50:58.850248] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-13T20:50:58.850286] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-13T20:50:58.850341] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 46.9s. Estimated remaining: 1h 42m 7s. Rate: 7.1 symbols/min [2025-10-13T20:50:59.022219] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:50:59.036127] [DEBUG] [LOCAL ] PCQ: Loaded 12219 existing records from primary storage. [2025-10-13T20:50:59.036384] [INFO ] [MAIN ] PCQ: Loaded 12219 existing records. [2025-10-13T20:50:59.234719] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:50:59.234997] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-13T20:50:59.235123] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-13T20:50:59.235485] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-13T20:50:59.235546] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-13T20:50:59.584752] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:50:59.617880] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-13T20:51:00.144920] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T20:51:00.417903] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-13T20:51:00.552752] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T20:51:01.217942] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-13T20:51:01.257355] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T20:51:01.258744] [INFO ] [REMOTE ] PCM: Full fetch complete (10389 records). [2025-10-13T20:51:01.258812] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-13T20:51:01.619025] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-13T20:51:01.619103] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-13T20:51:01.619357] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-13T20:51:01.619396] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-13T20:51:01.620308] [DEBUG] [LOCAL ] PCM: Trimmed 10389 records to 6785 (keeping 200 days of data) [2025-10-13T20:51:01.663692] [DEBUG] [LOCAL ] PCM: Primary data saved (6785 records). [2025-10-13T20:51:01.663848] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-13T20:51:01.663957] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 28.0s. Estimated remaining: 1h 41m 56s. Rate: 7.1 symbols/min [2025-10-13T20:51:01.835023] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:01.835187] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-13T20:51:01.835223] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-13T20:51:01.835333] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-13T20:51:01.835373] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-13T20:51:01.835413] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-13T20:51:01.835462] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-13T20:51:02.026277] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-13T20:51:02.185857] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:02.590523] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T20:51:02.688073] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T20:51:02.817937] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-13T20:51:03.617916] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-13T20:51:04.241419] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:51:04.244325] [INFO ] [REMOTE ] PCN: Full fetch complete (34027 records). [2025-10-13T20:51:04.244413] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-13T20:51:04.244931] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:51:04.245023] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:51:04.245067] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:51:04.245104] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-13T20:51:04.245160] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-13T20:51:04.245195] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-13T20:51:04.245234] [DEBUG] [LOCAL ] PCN: No derivative data file found to delete. [2025-10-13T20:51:04.245287] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCN took 25.8s. Estimated remaining: 1h 41m 45s. Rate: 7.1 symbols/min [2025-10-13T20:51:04.433969] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-13T20:51:04.439061] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:04.440412] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-13T20:51:04.440554] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-13T20:51:04.440796] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-13T20:51:04.440902] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-13T20:51:04.441199] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-13T20:51:04.441457] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-13T20:51:04.781079] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T20:51:04.859956] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:05.009473] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T20:51:05.217964] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-13T20:51:05.540092] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-13T20:51:06.017920] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-13T20:51:06.382853] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T20:51:06.817917] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-13T20:51:07.617936] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-13T20:51:07.648189] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T20:51:08.084505] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T20:51:08.417920] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-13T20:51:09.218036] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-13T20:51:09.513761] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T20:51:10.017950] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-13T20:51:10.800288] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T20:51:10.817896] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-13T20:51:10.896034] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T20:51:11.304032] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T20:51:11.617954] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-13T20:51:12.416564] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T20:51:12.419530] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-13T20:51:12.880054] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T20:51:13.217953] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-13T20:51:13.623401] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T20:51:14.018050] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-13T20:51:14.817946] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-13T20:51:14.903951] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T20:51:15.618009] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-13T20:51:16.417901] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-13T20:51:16.591404] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T20:51:16.673357] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T20:51:16.824748] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T20:51:17.218014] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-13T20:51:18.017952] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-13T20:51:18.817950] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-13T20:51:18.952386] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T20:51:19.617959] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-13T20:51:19.708606] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T20:51:19.748231] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T20:51:20.147464] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T20:51:20.417919] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-13T20:51:20.789369] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T20:51:21.218056] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-13T20:51:22.017966] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-13T20:51:22.817928] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-13T20:51:22.922891] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T20:51:23.058319] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T20:51:23.617955] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-13T20:51:24.219743] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T20:51:24.418018] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-13T20:51:24.508572] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T20:51:24.510739] [INFO ] [REMOTE ] PCQ: Full fetch complete (16982 records). [2025-10-13T20:51:24.510954] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-13T20:51:24.884120] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-13T20:51:24.884244] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-13T20:51:24.885008] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-13T20:51:24.885072] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-13T20:51:24.885881] [DEBUG] [LOCAL ] PCQ: Trimmed 16982 records to 12156 (keeping 200 days of data) [2025-10-13T20:51:24.970269] [DEBUG] [LOCAL ] PCQ: Primary data saved (12156 records). [2025-10-13T20:51:24.970467] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-13T20:51:24.970567] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCQ took 26.1s. Estimated remaining: 1h 41m 42s. Rate: 7.1 symbols/min [2025-10-13T20:51:25.190725] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:25.190975] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-13T20:51:25.191016] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-13T20:51:25.191177] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-13T20:51:25.191227] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-13T20:51:25.191269] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-13T20:51:25.191303] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-13T20:51:25.223103] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-13T20:51:25.566147] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:25.595622] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T20:51:26.017974] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-13T20:51:26.291682] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T20:51:26.818010] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-13T20:51:27.617953] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-13T20:51:27.703832] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T20:51:27.973861] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T20:51:27.974706] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-10-13T20:51:27.974779] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-13T20:51:28.162268] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-13T20:51:28.162523] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:51:28.162595] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:51:28.162692] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-13T20:51:28.162768] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-13T20:51:28.162806] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-13T20:51:28.162846] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-13T20:51:28.162907] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PDCC took 23.9s. Estimated remaining: 1h 41m 31s. Rate: 7.1 symbols/min [2025-10-13T20:51:28.351981] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:28.352238] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-13T20:51:28.352277] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-13T20:51:28.352418] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-13T20:51:28.352514] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-13T20:51:28.352596] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-13T20:51:28.352662] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-13T20:51:28.418844] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-13T20:51:28.744640] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:28.795296] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T20:51:29.217968] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-13T20:51:30.017925] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-13T20:51:30.217033] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T20:51:30.764811] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T20:51:30.818009] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-13T20:51:31.618046] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-13T20:51:31.928358] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T20:51:32.417918] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-13T20:51:32.673131] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T20:51:32.788611] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T20:51:33.217976] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-13T20:51:34.018022] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-13T20:51:34.160330] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T20:51:34.716733] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T20:51:34.818033] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-13T20:51:35.617956] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-13T20:51:36.417927] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-13T20:51:36.501952] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T20:51:36.609963] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-13T20:51:37.152544] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T20:51:37.217937] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-13T20:51:38.017901] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-13T20:51:38.113224] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T20:51:38.808279] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T20:51:38.818070] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-13T20:51:39.617974] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-13T20:51:40.051156] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T20:51:40.417968] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-13T20:51:40.911145] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-13T20:51:40.960796] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T20:51:41.217961] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-13T20:51:42.017897] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-13T20:51:42.138889] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T20:51:42.720696] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T20:51:42.817922] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-13T20:51:43.617960] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-13T20:51:44.121454] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-13T20:51:44.358798] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T20:51:44.386747] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:51:44.393735] [INFO ] [REMOTE ] PD: Full fetch complete (67666 records). [2025-10-13T20:51:44.393934] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-13T20:51:44.396150] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:51:44.396253] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:51:44.396309] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:51:44.396373] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-13T20:51:44.396451] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-13T20:51:44.396489] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-13T20:51:44.396530] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-13T20:51:44.396598] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PD took 42.7s. Estimated remaining: 1h 41m 26s. Rate: 7.1 symbols/min [2025-10-13T20:51:44.426328] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-13T20:51:44.581785] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:44.582056] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-13T20:51:44.582107] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-13T20:51:44.582251] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-13T20:51:44.582305] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-13T20:51:44.582348] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-13T20:51:44.582383] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-13T20:51:44.951196] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:45.218026] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-13T20:51:46.017974] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-13T20:51:46.379219] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T20:51:46.817923] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-13T20:51:46.910266] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T20:51:47.127172] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T20:51:47.617952] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-13T20:51:48.126320] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T20:51:48.417950] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-13T20:51:49.075760] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T20:51:49.217954] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-13T20:51:49.885775] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T20:51:49.929041] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:51:49.935519] [INFO ] [REMOTE ] PCOR: Full fetch complete (69020 records). [2025-10-13T20:51:49.935760] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-13T20:51:49.936597] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:51:49.936845] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:51:49.936917] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:51:49.936993] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-13T20:51:49.937064] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-13T20:51:49.937103] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-13T20:51:49.937144] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-13T20:51:49.937211] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PCOR took 55.5s. Estimated remaining: 1h 41m 17s. Rate: 7.1 symbols/min [2025-10-13T20:51:50.023032] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-13T20:51:50.134043] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:50.155354] [DEBUG] [LOCAL ] PDS: Loaded 17700 existing records from primary storage. [2025-10-13T20:51:50.155700] [INFO ] [MAIN ] PDS: Loaded 17700 existing records. [2025-10-13T20:51:50.354533] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:51:50.354836] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-13T20:51:50.354898] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-13T20:51:50.355422] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-13T20:51:50.355491] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-13T20:51:50.737270] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:50.818000] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-13T20:51:51.618497] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-13T20:51:51.623069] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T20:51:52.131244] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T20:51:52.418022] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-13T20:51:53.217978] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-13T20:51:53.411430] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T20:51:53.521887] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T20:51:54.017941] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-13T20:51:54.674817] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T20:51:54.817942] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-13T20:51:55.420623] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T20:51:55.425303] [INFO ] [REMOTE ] PDM: Full fetch complete (56827 records). [2025-10-13T20:51:55.425472] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-13T20:51:55.426496] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:51:55.426590] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:51:55.426635] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:51:55.426743] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-13T20:51:55.426817] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-13T20:51:55.426855] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-13T20:51:55.426946] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-13T20:51:55.427030] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDM took 27.3s. Estimated remaining: 1h 41m 7s. Rate: 7.1 symbols/min [2025-10-13T20:51:55.618726] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:51:55.628867] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-13T20:51:55.634689] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T20:51:55.664665] [DEBUG] [LOCAL ] PDT: Loaded 17761 existing records from primary storage. [2025-10-13T20:51:55.665002] [INFO ] [MAIN ] PDT: Loaded 17761 existing records. [2025-10-13T20:51:55.849221] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:51:55.849514] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-13T20:51:55.849563] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-13T20:51:55.849825] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-13T20:51:55.849882] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-13T20:51:56.215587] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:51:56.417967] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-13T20:51:57.217945] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-13T20:51:57.497197] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:51:57.628494] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T20:51:58.017932] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-13T20:51:58.299431] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T20:51:58.817958] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-13T20:51:59.026975] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T20:51:59.617930] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-13T20:51:59.888149] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T20:52:00.417943] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-13T20:52:01.166993] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T20:52:01.217957] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-13T20:52:02.017965] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-13T20:52:02.424688] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T20:52:02.735079] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T20:52:02.817936] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-13T20:52:03.235114] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T20:52:03.617923] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-13T20:52:03.805677] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:52:04.417942] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-13T20:52:04.766929] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T20:52:05.112215] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T20:52:05.217960] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-13T20:52:06.017948] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-13T20:52:06.817933] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-13T20:52:07.118524] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T20:52:07.182090] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T20:52:07.617947] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-13T20:52:07.903906] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T20:52:08.417968] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-13T20:52:08.450147] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T20:52:08.455365] [INFO ] [REMOTE ] PDI: Full fetch complete (72580 records). [2025-10-13T20:52:08.455532] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-13T20:52:08.456362] [FATAL] [VALIDATOR ] PDI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:52:08.456489] [FATAL] [MAIN ] PDI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:52:08.456536] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:52:08.456605] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-13T20:52:08.456717] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-13T20:52:08.456768] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-13T20:52:08.456812] [DEBUG] [LOCAL ] PDI: No derivative data file found to delete. [2025-10-13T20:52:08.456874] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDI took 43.5s. Estimated remaining: 1h 41m 1s. Rate: 7.1 symbols/min [2025-10-13T20:52:08.647828] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:08.648088] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-13T20:52:08.648144] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-13T20:52:08.648275] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-13T20:52:08.648317] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-13T20:52:08.648360] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-13T20:52:08.648393] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-13T20:52:09.041103] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:09.218065] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-13T20:52:09.545566] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T20:52:10.017948] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-13T20:52:10.238538] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T20:52:10.815063] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T20:52:10.819385] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-13T20:52:11.618002] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-13T20:52:11.958294] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T20:52:12.417967] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-13T20:52:13.051578] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T20:52:13.218012] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-13T20:52:13.475847] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:52:14.017930] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-13T20:52:14.343751] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:52:14.817929] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-13T20:52:15.216756] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T20:52:15.617926] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-13T20:52:16.202757] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T20:52:16.417896] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-13T20:52:16.801581] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T20:52:17.217933] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-13T20:52:17.691991] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T20:52:18.017926] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-13T20:52:18.200054] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T20:52:18.817921] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-13T20:52:19.093618] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T20:52:19.617948] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-13T20:52:19.827061] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T20:52:20.417979] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-13T20:52:21.047415] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T20:52:21.218028] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-13T20:52:21.462054] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T20:52:21.465111] [INFO ] [REMOTE ] PDT: Full fetch complete (25271 records). [2025-10-13T20:52:21.465244] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-13T20:52:21.873616] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-13T20:52:21.873770] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-13T20:52:21.874539] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-13T20:52:21.874615] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-13T20:52:21.875920] [DEBUG] [LOCAL ] PDT: Trimmed 25271 records to 17559 (keeping 200 days of data) [2025-10-13T20:52:21.996079] [DEBUG] [LOCAL ] PDT: Primary data saved (17559 records). [2025-10-13T20:52:21.996277] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-13T20:52:21.996372] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDT took 26.6s. Estimated remaining: 1h 40m 54s. Rate: 7.1 symbols/min [2025-10-13T20:52:22.018877] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-13T20:52:22.174394] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:22.174659] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-13T20:52:22.174719] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-13T20:52:22.174841] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-13T20:52:22.174885] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-13T20:52:22.174926] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-13T20:52:22.174961] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-13T20:52:22.542137] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T20:52:22.588962] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:22.817903] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-13T20:52:22.933423] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T20:52:22.935360] [INFO ] [REMOTE ] PDS: Full fetch complete (25536 records). [2025-10-13T20:52:22.935450] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-13T20:52:23.315812] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-13T20:52:23.315995] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-13T20:52:23.317032] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-13T20:52:23.317097] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-13T20:52:23.318097] [DEBUG] [LOCAL ] PDS: Trimmed 25536 records to 17330 (keeping 200 days of data) [2025-10-13T20:52:23.415289] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T20:52:23.425080] [INFO ] [REMOTE ] PDO: Full fetch complete (46870 records). [2025-10-13T20:52:23.426918] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-13T20:52:23.429167] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:52:23.430057] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:52:23.431427] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:52:23.433128] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-13T20:52:23.433251] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-13T20:52:23.433692] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-13T20:52:23.434070] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-13T20:52:23.434194] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDO took 39.0s. Estimated remaining: 1h 40m 43s. Rate: 7.1 symbols/min [2025-10-13T20:52:23.618462] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-13T20:52:23.653380] [DEBUG] [LOCAL ] PDS: Primary data saved (17330 records). [2025-10-13T20:52:23.651860] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:23.653573] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-13T20:52:23.653679] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-13T20:52:23.653792] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDS took 33.7s. Estimated remaining: 1h 40m 31s. Rate: 7.1 symbols/min [2025-10-13T20:52:23.653878] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-13T20:52:23.730535] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-13T20:52:23.757930] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-13T20:52:23.764048] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-13T20:52:23.764152] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-13T20:52:23.929442] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:23.959011] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-13T20:52:23.962683] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-13T20:52:23.962845] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-13T20:52:23.963950] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-13T20:52:23.964047] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-13T20:52:23.964129] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-13T20:52:24.418435] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-13T20:52:24.538979] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:24.647129] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T20:52:24.650866] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:25.217928] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-13T20:52:26.017956] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-13T20:52:26.263298] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T20:52:26.295867] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T20:52:26.817928] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-13T20:52:27.617898] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-13T20:52:27.854345] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T20:52:27.857532] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T20:52:28.417980] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-13T20:52:28.885442] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T20:52:29.217971] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-13T20:52:29.399358] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T20:52:30.017935] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-13T20:52:30.817924] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-13T20:52:30.866123] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T20:52:31.425672] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T20:52:31.617930] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-13T20:52:32.418015] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-13T20:52:32.696529] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T20:52:32.708673] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T20:52:33.217932] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-13T20:52:34.018013] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-13T20:52:34.096828] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T20:52:34.817947] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-13T20:52:34.879395] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:52:34.969778] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T20:52:35.617929] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-13T20:52:36.427956] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-13T20:52:36.453274] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T20:52:37.217980] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-13T20:52:37.295465] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T20:52:37.595129] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T20:52:38.017935] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-13T20:52:38.817939] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-13T20:52:39.056233] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T20:52:39.482500] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T20:52:39.617956] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-13T20:52:40.105338] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T20:52:40.107257] [INFO ] [REMOTE ] PDX: Full fetch complete (23775 records). [2025-10-13T20:52:40.107344] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-13T20:52:40.107977] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:52:40.108223] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:52:40.108285] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:52:40.108355] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-13T20:52:40.108426] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-13T20:52:40.108463] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-13T20:52:40.108503] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-13T20:52:40.108560] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 31.7s. Estimated remaining: 1h 40m 26s. Rate: 7.1 symbols/min [2025-10-13T20:52:40.298610] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:40.314207] [DEBUG] [LOCAL ] PEO: Loaded 11325 existing records from primary storage. [2025-10-13T20:52:40.314554] [INFO ] [MAIN ] PEO: Loaded 11325 existing records. [2025-10-13T20:52:40.421737] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-13T20:52:40.531920] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T20:52:40.553746] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:52:40.566087] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-13T20:52:40.566351] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-13T20:52:40.566972] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-13T20:52:40.567044] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-13T20:52:40.989143] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:41.217954] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-13T20:52:41.905558] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T20:52:42.017954] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-13T20:52:42.193318] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:52:42.817958] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-13T20:52:43.618030] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-13T20:52:43.909596] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T20:52:44.417981] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-13T20:52:44.458564] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T20:52:45.217953] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-13T20:52:45.366907] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T20:52:46.017915] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-13T20:52:46.171391] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T20:52:46.192674] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T20:52:46.817961] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-13T20:52:47.617963] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-13T20:52:47.775580] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T20:52:48.288175] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T20:52:48.417913] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-13T20:52:48.482024] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T20:52:49.217957] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-13T20:52:49.959199] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T20:52:50.017970] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-13T20:52:50.303715] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T20:52:50.817976] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-13T20:52:51.030565] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T20:52:51.617948] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-13T20:52:52.409336] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T20:52:52.417930] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-13T20:52:52.588032] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T20:52:53.199077] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T20:52:53.217892] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-13T20:52:54.017947] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-13T20:52:54.672407] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T20:52:54.818073] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-13T20:52:55.396321] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T20:52:55.618025] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-13T20:52:55.915506] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T20:52:56.417954] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-13T20:52:57.021512] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T20:52:57.217922] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-13T20:52:57.298801] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T20:52:58.017957] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-13T20:52:58.634941] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:52:58.640464] [INFO ] [REMOTE ] PEB: Full fetch complete (72580 records). [2025-10-13T20:52:58.640736] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-13T20:52:58.641930] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:52:58.642023] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:52:58.642067] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:52:58.642108] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-13T20:52:58.642185] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-13T20:52:58.642249] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-13T20:52:58.642298] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-13T20:52:58.642367] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEB took 36.6s. Estimated remaining: 1h 40m 22s. Rate: 7.1 symbols/min [2025-10-13T20:52:58.822129] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-13T20:52:58.825879] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:52:58.866833] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T20:52:58.890123] [DEBUG] [LOCAL ] PERF: Loaded 14504 existing records from primary storage. [2025-10-13T20:52:58.890464] [INFO ] [MAIN ] PERF: Loaded 14504 existing records. [2025-10-13T20:52:59.077978] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:52:59.078349] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-13T20:52:59.078402] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-13T20:52:59.078738] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-13T20:52:59.078799] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-13T20:52:59.459258] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:52:59.617951] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-13T20:53:00.210349] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T20:53:00.417959] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-13T20:53:00.433135] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T20:53:01.217906] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-13T20:53:01.658020] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T20:53:01.979159] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T20:53:01.980986] [INFO ] [REMOTE ] PEO: Full fetch complete (16237 records). [2025-10-13T20:53:01.981068] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-13T20:53:02.023635] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-13T20:53:02.389899] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-13T20:53:02.390021] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-13T20:53:02.390635] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-13T20:53:02.390726] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-13T20:53:02.391689] [DEBUG] [LOCAL ] PEO: Trimmed 16237 records to 11174 (keeping 200 days of data) [2025-10-13T20:53:02.472227] [DEBUG] [LOCAL ] PEO: Primary data saved (11174 records). [2025-10-13T20:53:02.472429] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-13T20:53:02.472536] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEO took 22.4s. Estimated remaining: 1h 40m 11s. Rate: 7.1 symbols/min [2025-10-13T20:53:02.648170] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:02.648425] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-13T20:53:02.648526] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-13T20:53:02.648615] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-13T20:53:02.648689] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-13T20:53:02.648765] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-13T20:53:02.648802] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-13T20:53:02.826335] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-13T20:53:03.040808] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:03.305049] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T20:53:03.617949] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-13T20:53:03.919620] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T20:53:04.417927] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-13T20:53:04.714056] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:53:04.714525] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-13T20:53:04.714711] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:53:04.714789] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-13T20:53:04.714859] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:53:04.714936] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-13T20:53:04.715011] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-13T20:53:04.715051] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-13T20:53:04.715093] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-13T20:53:04.715158] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEW took 2.2s. Estimated remaining: 1h 40m 0s. Rate: 7.1 symbols/min [2025-10-13T20:53:04.862263] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:53:04.917277] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:04.926243] [DEBUG] [LOCAL ] PFD: Loaded 5461 existing records from primary storage. [2025-10-13T20:53:04.926501] [INFO ] [MAIN ] PFD: Loaded 5461 existing records. [2025-10-13T20:53:05.130530] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:53:05.130846] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-13T20:53:05.130900] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-13T20:53:05.131152] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-13T20:53:05.131209] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-13T20:53:05.223106] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-13T20:53:05.517333] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:06.018019] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-13T20:53:06.749531] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T20:53:06.817924] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-13T20:53:07.139078] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:53:07.591163] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:53:07.597771] [INFO ] [REMOTE ] PEG: Full fetch complete (76359 records). [2025-10-13T20:53:07.597965] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-13T20:53:07.599182] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:53:07.599357] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:53:07.599419] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:53:07.599477] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-13T20:53:07.599584] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-13T20:53:07.599638] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-13T20:53:07.599837] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-13T20:53:07.599942] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEG took 44.2s. Estimated remaining: 1h 39m 50s. Rate: 7.1 symbols/min [2025-10-13T20:53:07.623059] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-13T20:53:07.787718] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:07.787976] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-13T20:53:07.788087] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-13T20:53:07.788223] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-13T20:53:07.788280] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-13T20:53:07.788358] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-13T20:53:07.788406] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-13T20:53:08.190109] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:08.417935] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-13T20:53:08.486438] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T20:53:09.217945] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-13T20:53:09.336287] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T20:53:09.682957] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T20:53:10.017955] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-13T20:53:10.817940] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-13T20:53:10.922241] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T20:53:11.313690] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T20:53:11.617957] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-13T20:53:12.417923] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-13T20:53:13.082571] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T20:53:13.217942] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-13T20:53:13.932064] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:53:13.935841] [INFO ] [REMOTE ] PEN: Full fetch complete (43938 records). [2025-10-13T20:53:13.935942] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-13T20:53:13.936588] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:53:13.936693] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:53:13.936741] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:53:13.936780] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-13T20:53:13.936834] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-13T20:53:13.936870] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-13T20:53:13.936908] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-13T20:53:13.937002] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEN took 50.3s. Estimated remaining: 1h 39m 40s. Rate: 7.1 symbols/min [2025-10-13T20:53:14.023191] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-13T20:53:14.119758] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:14.120030] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-13T20:53:14.120085] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-13T20:53:14.120198] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-13T20:53:14.120239] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-13T20:53:14.120352] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-13T20:53:14.120401] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-13T20:53:14.491420] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:14.523843] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-13T20:53:14.809631] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T20:53:14.817879] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-13T20:53:15.516776] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T20:53:15.617941] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-13T20:53:16.287045] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T20:53:16.417923] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-13T20:53:17.217932] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-13T20:53:17.326481] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T20:53:18.017926] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-13T20:53:18.817911] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-13T20:53:19.086941] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T20:53:19.617896] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-13T20:53:19.681101] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-13T20:53:19.713934] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T20:53:20.418021] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-13T20:53:20.871058] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T20:53:21.217976] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-13T20:53:22.017932] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-13T20:53:22.051330] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T20:53:22.281073] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T20:53:22.817937] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-13T20:53:23.617921] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-13T20:53:23.766841] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T20:53:24.110560] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T20:53:24.422303] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-13T20:53:24.636050] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-13T20:53:25.215372] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T20:53:25.218005] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-13T20:53:26.018012] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-13T20:53:26.818011] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-13T20:53:26.942072] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T20:53:27.506404] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T20:53:27.507933] [INFO ] [REMOTE ] PFD: Full fetch complete (7488 records). [2025-10-13T20:53:27.508038] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-13T20:53:27.623089] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-13T20:53:27.897723] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-13T20:53:27.897838] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-13T20:53:27.898342] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-13T20:53:27.898439] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-13T20:53:27.899154] [DEBUG] [LOCAL ] PFD: Trimmed 7488 records to 5416 (keeping 200 days of data) [2025-10-13T20:53:27.939227] [DEBUG] [LOCAL ] PFD: Primary data saved (5416 records). [2025-10-13T20:53:27.939434] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-13T20:53:27.939545] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 23.2s. Estimated remaining: 1h 39m 34s. Rate: 7.1 symbols/min [2025-10-13T20:53:28.130514] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:28.142615] [DEBUG] [LOCAL ] PFH: Loaded 6837 existing records from primary storage. [2025-10-13T20:53:28.142928] [INFO ] [MAIN ] PFH: Loaded 6837 existing records. [2025-10-13T20:53:28.342106] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:53:28.342873] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-13T20:53:28.342945] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-13T20:53:28.343462] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-13T20:53:28.343524] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-13T20:53:28.430467] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-13T20:53:28.766776] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T20:53:28.766077] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:28.770607] [INFO ] [REMOTE ] PERF: Full fetch complete (22122 records). [2025-10-13T20:53:28.770795] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-13T20:53:28.914153] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-13T20:53:29.212297] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-13T20:53:29.212408] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-13T20:53:29.213221] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-13T20:53:29.213302] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-13T20:53:29.214324] [DEBUG] [LOCAL ] PERF: Trimmed 22122 records to 14341 (keeping 200 days of data) [2025-10-13T20:53:29.217968] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-13T20:53:29.325260] [DEBUG] [LOCAL ] PERF: Primary data saved (14341 records). [2025-10-13T20:53:29.325474] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-13T20:53:29.325585] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PERF took 30.7s. Estimated remaining: 1h 39m 23s. Rate: 7.1 symbols/min [2025-10-13T20:53:29.506639] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:29.524262] [DEBUG] [LOCAL ] PFL: Loaded 14264 existing records from primary storage. [2025-10-13T20:53:29.524586] [INFO ] [MAIN ] PFL: Loaded 14264 existing records. [2025-10-13T20:53:29.713804] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:53:29.714112] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-13T20:53:29.714170] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-13T20:53:29.714442] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-13T20:53:29.714536] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-13T20:53:30.024636] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-13T20:53:30.135319] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:30.138577] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T20:53:30.234292] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T20:53:30.818014] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-13T20:53:31.618026] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-13T20:53:32.424438] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-13T20:53:32.448488] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T20:53:32.540189] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T20:53:32.803536] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-13T20:53:33.155175] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T20:53:33.217953] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-13T20:53:34.017967] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-13T20:53:34.200077] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T20:53:34.735554] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T20:53:34.818051] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-13T20:53:35.583341] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T20:53:35.617882] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-13T20:53:36.415189] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T20:53:36.417882] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-13T20:53:37.217917] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-13T20:53:38.017943] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-13T20:53:38.818062] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-13T20:53:38.859798] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T20:53:38.960500] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T20:53:39.254841] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-13T20:53:39.617924] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-13T20:53:39.827698] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T20:53:40.417958] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-13T20:53:40.428750] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T20:53:41.217963] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-13T20:53:41.409515] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T20:53:42.017974] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-13T20:53:42.027665] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T20:53:42.817936] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-13T20:53:42.976732] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T20:53:43.571903] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T20:53:43.617904] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-13T20:53:44.236516] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T20:53:44.417971] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-13T20:53:45.217897] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-13T20:53:45.288427] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T20:53:45.790237] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T20:53:45.791378] [INFO ] [REMOTE ] PFH: Full fetch complete (10017 records). [2025-10-13T20:53:45.791451] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-13T20:53:46.023138] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-13T20:53:46.181888] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-13T20:53:46.181987] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-13T20:53:46.182416] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-13T20:53:46.182459] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-13T20:53:46.182968] [DEBUG] [LOCAL ] PFH: Trimmed 10017 records to 6756 (keeping 200 days of data) [2025-10-13T20:53:46.226624] [DEBUG] [LOCAL ] PFH: Primary data saved (6756 records). [2025-10-13T20:53:46.226836] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-13T20:53:46.226943] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFH took 18.3s. Estimated remaining: 1h 39m 18s. Rate: 7.1 symbols/min [2025-10-13T20:53:46.405546] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:46.405778] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-13T20:53:46.405826] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-13T20:53:46.406007] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-13T20:53:46.406049] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-13T20:53:46.406090] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-13T20:53:46.406125] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-13T20:53:46.772288] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:46.817922] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-13T20:53:47.009134] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T20:53:47.617936] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-13T20:53:48.418038] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-13T20:53:48.594556] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T20:53:49.217931] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-13T20:53:49.365303] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T20:53:50.017959] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-13T20:53:50.278761] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-13T20:53:50.817963] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-13T20:53:50.915255] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T20:53:51.083057] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T20:53:51.617938] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-13T20:53:52.417941] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-13T20:53:53.159464] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T20:53:53.217926] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-13T20:53:53.395351] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T20:53:53.708876] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-13T20:53:54.017924] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-13T20:53:54.817961] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-13T20:53:54.981485] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T20:53:55.617961] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-13T20:53:56.417908] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-13T20:53:56.492672] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T20:53:56.541364] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T20:53:56.544300] [INFO ] [REMOTE ] PFL: Full fetch complete (20445 records). [2025-10-13T20:53:56.544386] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-13T20:53:56.860602] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-13T20:53:56.995958] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-13T20:53:56.996051] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-13T20:53:56.996762] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-13T20:53:56.996834] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-13T20:53:56.997484] [DEBUG] [LOCAL ] PFL: Trimmed 20445 records to 14271 (keeping 200 days of data) [2025-10-13T20:53:57.091505] [DEBUG] [LOCAL ] PFL: Primary data saved (14271 records). [2025-10-13T20:53:57.091729] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-13T20:53:57.091844] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFL took 27.8s. Estimated remaining: 1h 39m 11s. Rate: 7.1 symbols/min [2025-10-13T20:53:57.248578] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-13T20:53:57.327409] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:53:57.354797] [DEBUG] [LOCAL ] PFN: Loaded 22464 existing records from primary storage. [2025-10-13T20:53:57.355175] [INFO ] [MAIN ] PFN: Loaded 22464 existing records. [2025-10-13T20:53:57.545320] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:53:57.545686] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-13T20:53:57.545751] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-13T20:53:57.546165] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-13T20:53:57.546225] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-13T20:53:57.927269] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:53:58.029963] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-13T20:53:58.036887] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T20:53:58.817956] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-13T20:53:59.618049] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-13T20:53:59.659820] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-13T20:53:59.697399] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T20:54:00.417933] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-13T20:54:00.568871] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T20:54:00.764860] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T20:54:01.217975] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-13T20:54:01.262052] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T20:54:01.267834] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-13T20:54:01.268100] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-13T20:54:01.269206] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:54:01.269309] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:54:01.269353] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:54:01.269394] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-13T20:54:01.269490] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-13T20:54:01.269528] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-13T20:54:01.269567] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-13T20:54:01.269634] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFE took 53.7s. Estimated remaining: 1h 39m 0s. Rate: 7.1 symbols/min [2025-10-13T20:54:01.463747] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:01.474582] [DEBUG] [LOCAL ] PFO: Loaded 6137 existing records from primary storage. [2025-10-13T20:54:01.474873] [INFO ] [MAIN ] PFO: Loaded 6137 existing records. [2025-10-13T20:54:01.654745] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:54:01.655033] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-13T20:54:01.655087] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-13T20:54:01.655323] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-13T20:54:01.655380] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-13T20:54:02.022755] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-13T20:54:02.042786] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:02.331880] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T20:54:02.817947] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-13T20:54:03.605954] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:54:03.611000] [INFO ] [REMOTE ] PFGC: Full fetch complete (67217 records). [2025-10-13T20:54:03.611148] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-13T20:54:03.611940] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:54:03.612028] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:54:03.612081] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:54:03.612142] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-13T20:54:03.612232] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-13T20:54:03.612299] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-13T20:54:03.612346] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-13T20:54:03.612412] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFGC took 49.7s. Estimated remaining: 1h 38m 49s. Rate: 7.1 symbols/min [2025-10-13T20:54:03.624030] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-13T20:54:03.805534] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:03.805829] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-13T20:54:03.805878] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-13T20:54:03.806028] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-13T20:54:03.806100] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-13T20:54:03.806160] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-13T20:54:03.806256] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-13T20:54:04.206474] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:04.225458] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-13T20:54:04.418037] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-13T20:54:04.976926] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T20:54:05.217953] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-13T20:54:05.882535] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T20:54:06.017937] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-13T20:54:06.767284] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T20:54:06.817944] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-13T20:54:07.138570] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T20:54:07.617935] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-13T20:54:08.390100] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T20:54:08.417914] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-13T20:54:08.630111] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T20:54:09.218028] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-13T20:54:09.865712] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T20:54:09.894310] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T20:54:10.017927] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-13T20:54:10.818034] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-13T20:54:11.617938] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-13T20:54:11.795938] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T20:54:12.338379] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T20:54:12.417959] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-13T20:54:12.966417] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T20:54:13.218059] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-13T20:54:14.017974] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-13T20:54:14.112464] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:54:14.823056] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-13T20:54:14.837747] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T20:54:15.056517] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T20:54:15.522695] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T20:54:15.617928] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-13T20:54:16.417939] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-13T20:54:17.089114] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T20:54:17.217929] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-13T20:54:17.322504] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T20:54:18.017964] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-13T20:54:18.825542] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-13T20:54:18.827902] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T20:54:19.148323] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T20:54:19.503267] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T20:54:19.617942] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-13T20:54:20.417928] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-13T20:54:20.840348] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T20:54:21.218017] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-13T20:54:21.796034] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T20:54:22.017928] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-13T20:54:22.778256] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T20:54:22.817883] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-13T20:54:22.935045] [DEBUG] [REMOTE ] PFS: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-13T20:54:22.936695] [WARN ] [REMOTE ] PFS: No data returned for month 2025-07 [2025-10-13T20:54:22.936595] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T20:54:22.940147] [FATAL] [REMOTE ] PFS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:54:22.945973] [FATAL] [MAIN ] PFS: Failed to fetch primary data. [2025-10-13T20:54:22.946145] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:54:22.946218] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-13T20:54:22.946281] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-13T20:54:22.946318] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-13T20:54:22.946356] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-13T20:54:22.946400] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFS took 19.3s. Estimated remaining: 1h 38m 46s. Rate: 7.1 symbols/min [2025-10-13T20:54:23.112410] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:23.112579] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-13T20:54:23.112616] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-13T20:54:23.112742] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-13T20:54:23.112782] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-13T20:54:23.112822] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-13T20:54:23.112853] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-13T20:54:23.458820] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:23.617888] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-13T20:54:24.417977] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-13T20:54:24.845432] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T20:54:25.099182] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T20:54:25.217972] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-13T20:54:25.921945] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T20:54:26.017978] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-13T20:54:26.818045] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-13T20:54:27.381129] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T20:54:27.617930] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-13T20:54:28.418014] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-13T20:54:28.574524] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T20:54:29.002277] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:54:29.218059] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-13T20:54:29.234228] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T20:54:30.017946] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-13T20:54:30.499894] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T20:54:30.588298] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T20:54:30.817922] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-13T20:54:31.617905] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-13T20:54:31.938066] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T20:54:32.327023] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:54:32.328091] [INFO ] [REMOTE ] PFO: Full fetch complete (7882 records). [2025-10-13T20:54:32.328161] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-13T20:54:32.423005] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-13T20:54:32.690362] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-13T20:54:32.690443] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-13T20:54:32.690685] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-13T20:54:32.690746] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-13T20:54:32.691147] [DEBUG] [LOCAL ] PFO: Trimmed 7882 records to 6093 (keeping 200 days of data) [2025-10-13T20:54:32.726801] [DEBUG] [LOCAL ] PFO: Primary data saved (6093 records). [2025-10-13T20:54:32.726899] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-13T20:54:32.726975] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFO took 31.5s. Estimated remaining: 1h 38m 38s. Rate: 7.1 symbols/min [2025-10-13T20:54:32.917675] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:32.917841] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-13T20:54:32.917881] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-13T20:54:32.918014] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-13T20:54:32.918069] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-13T20:54:32.918112] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-13T20:54:32.918144] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-13T20:54:33.232795] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-13T20:54:33.272417] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:33.286711] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T20:54:33.292117] [INFO ] [REMOTE ] PFLT: Full fetch complete (63618 records). [2025-10-13T20:54:33.292276] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-13T20:54:33.293049] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:54:33.293137] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:54:33.293205] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:54:33.293276] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-13T20:54:33.293340] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-13T20:54:33.293378] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-13T20:54:33.293417] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-13T20:54:33.293478] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFLT took 47.1s. Estimated remaining: 1h 38m 26s. Rate: 7.1 symbols/min [2025-10-13T20:54:33.466148] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:33.473084] [DEBUG] [LOCAL ] PGP: Loaded 5760 existing records from primary storage. [2025-10-13T20:54:33.473293] [INFO ] [MAIN ] PGP: Loaded 5760 existing records. [2025-10-13T20:54:33.650006] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:54:33.650254] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-13T20:54:33.650306] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-13T20:54:33.650582] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-13T20:54:33.650677] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-13T20:54:34.007532] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:34.017942] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-13T20:54:34.472479] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T20:54:34.817971] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-13T20:54:35.569824] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T20:54:35.617882] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-13T20:54:36.141055] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T20:54:36.374159] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T20:54:36.417942] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-13T20:54:37.172618] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T20:54:37.217914] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-13T20:54:37.726276] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-13T20:54:38.017917] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-13T20:54:38.817918] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-13T20:54:38.940601] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T20:54:39.617950] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-13T20:54:39.870914] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T20:54:39.874001] [INFO ] [REMOTE ] PFN: Full fetch complete (31064 records). [2025-10-13T20:54:39.874074] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-13T20:54:40.248970] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-13T20:54:40.249112] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-13T20:54:40.250453] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-13T20:54:40.250798] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-13T20:54:40.252476] [DEBUG] [LOCAL ] PFN: Trimmed 31064 records to 22306 (keeping 200 days of data) [2025-10-13T20:54:40.385786] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T20:54:40.417288] [DEBUG] [LOCAL ] PFN: Primary data saved (22306 records). [2025-10-13T20:54:40.417445] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-13T20:54:40.417533] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFN took 43.3s. Estimated remaining: 1h 38m 17s. Rate: 7.1 symbols/min [2025-10-13T20:54:40.423071] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-13T20:54:40.598439] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:40.598691] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-13T20:54:40.598756] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-13T20:54:40.598921] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-13T20:54:40.598984] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-13T20:54:40.599036] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-13T20:54:40.599076] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-13T20:54:40.967330] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:41.217914] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-13T20:54:42.018011] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-13T20:54:42.589005] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T20:54:42.817970] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-13T20:54:43.229122] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T20:54:43.263381] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T20:54:43.617947] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-13T20:54:44.417931] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-13T20:54:44.936094] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-13T20:54:45.157795] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T20:54:45.217917] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-13T20:54:45.473012] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T20:54:46.017925] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-13T20:54:46.817930] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-13T20:54:46.982733] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T20:54:47.617895] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-13T20:54:47.972069] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T20:54:48.297475] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T20:54:48.417921] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-13T20:54:49.217921] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-13T20:54:49.402927] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T20:54:49.654576] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T20:54:50.017912] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-13T20:54:50.464609] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T20:54:50.817934] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-13T20:54:51.617932] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-13T20:54:52.195197] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T20:54:52.417913] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-13T20:54:52.840434] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T20:54:53.105697] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-13T20:54:53.217890] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-13T20:54:54.017921] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-13T20:54:54.373704] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T20:54:54.464994] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T20:54:54.817955] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-13T20:54:55.546631] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T20:54:55.617910] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-13T20:54:56.098421] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T20:54:56.386040] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T20:54:56.417896] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-13T20:54:57.085932] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T20:54:57.217944] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-13T20:54:57.894978] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T20:54:57.896788] [INFO ] [REMOTE ] PGP: Full fetch complete (7885 records). [2025-10-13T20:54:57.896875] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-13T20:54:58.023079] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-13T20:54:58.427052] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-13T20:54:58.427135] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-13T20:54:58.427351] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-13T20:54:58.427394] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-13T20:54:58.428104] [DEBUG] [LOCAL ] PGP: Trimmed 7885 records to 5713 (keeping 200 days of data) [2025-10-13T20:54:58.468409] [DEBUG] [LOCAL ] PGP: Primary data saved (5713 records). [2025-10-13T20:54:58.468784] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-13T20:54:58.468884] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PGP took 25.2s. Estimated remaining: 1h 38m 13s. Rate: 7.1 symbols/min [2025-10-13T20:54:58.641270] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:54:58.682706] [DEBUG] [LOCAL ] PGRE: Loaded 47465 existing records from primary storage. [2025-10-13T20:54:58.682998] [INFO ] [MAIN ] PGRE: Loaded 47465 existing records. [2025-10-13T20:54:58.823144] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-13T20:54:58.859804] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:54:58.859957] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-13T20:54:58.860002] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-13T20:54:58.860702] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-13T20:54:58.860759] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-13T20:54:59.206424] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:54:59.617959] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-13T20:55:00.417942] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-13T20:55:00.672022] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-13T20:55:01.080987] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-13T20:55:01.104338] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T20:55:01.217892] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-13T20:55:01.773975] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T20:55:02.017952] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-13T20:55:02.558347] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:55:02.562166] [INFO ] [REMOTE ] PFSI: Full fetch complete (41177 records). [2025-10-13T20:55:02.562310] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-13T20:55:02.563038] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:55:02.563125] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:55:02.563167] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:55:02.563206] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-13T20:55:02.563260] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-13T20:55:02.563295] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-13T20:55:02.563334] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-13T20:55:02.563389] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 39.6s. Estimated remaining: 1h 38m 2s. Rate: 7.1 symbols/min [2025-10-13T20:55:02.741077] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:02.748004] [DEBUG] [LOCAL ] PGZ: Loaded 5545 existing records from primary storage. [2025-10-13T20:55:02.748225] [INFO ] [MAIN ] PGZ: Loaded 5545 existing records. [2025-10-13T20:55:02.826853] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-13T20:55:02.936912] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:55:02.937132] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-13T20:55:02.937178] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-13T20:55:02.937427] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-13T20:55:02.937484] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-13T20:55:03.307077] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:03.339010] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:55:03.617925] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-13T20:55:04.418018] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-13T20:55:05.121181] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-13T20:55:05.217980] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-13T20:55:05.610734] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T20:55:05.658173] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-13T20:55:06.018174] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-13T20:55:06.818051] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-13T20:55:06.907371] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T20:55:07.176288] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T20:55:07.618012] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-13T20:55:08.417977] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-13T20:55:08.543364] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T20:55:08.778487] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T20:55:08.938467] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T20:55:08.944414] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-13T20:55:08.944680] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-13T20:55:08.945770] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:55:08.945877] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:55:08.945998] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:55:08.946078] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-13T20:55:08.946232] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-13T20:55:08.946293] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-13T20:55:08.946342] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-13T20:55:08.946424] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 36.2s. Estimated remaining: 1h 37m 53s. Rate: 7.1 symbols/min [2025-10-13T20:55:09.144023] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:09.144425] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-13T20:55:09.144487] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-13T20:55:09.144618] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-13T20:55:09.144885] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-13T20:55:09.144949] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-13T20:55:09.144986] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-13T20:55:09.223033] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-13T20:55:09.507554] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:09.890511] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T20:55:09.895572] [INFO ] [REMOTE ] PGR: Full fetch complete (76112 records). [2025-10-13T20:55:09.895760] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-13T20:55:09.896606] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:55:09.896718] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:55:09.896761] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:55:09.896801] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-13T20:55:09.896857] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-13T20:55:09.896892] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-13T20:55:09.896931] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-13T20:55:09.896987] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGR took 29.5s. Estimated remaining: 1h 37m 42s. Rate: 7.1 symbols/min [2025-10-13T20:55:10.023131] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-13T20:55:10.086234] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:10.086542] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-13T20:55:10.086589] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-13T20:55:10.086745] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-13T20:55:10.086791] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-13T20:55:10.086836] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-13T20:55:10.086870] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-13T20:55:10.477303] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:10.817949] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-13T20:55:11.279416] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T20:55:11.617924] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-13T20:55:12.322393] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T20:55:12.417952] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-13T20:55:12.551928] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T20:55:13.082218] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T20:55:13.217924] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-13T20:55:14.018032] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-13T20:55:14.772765] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T20:55:14.818003] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-13T20:55:15.558973] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T20:55:15.617916] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-13T20:55:15.805374] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T20:55:16.417931] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-13T20:55:17.217940] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-13T20:55:17.274868] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T20:55:17.843377] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T20:55:18.017932] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-13T20:55:18.159746] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T20:55:18.817966] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-13T20:55:19.401764] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T20:55:19.617920] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-13T20:55:20.314689] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T20:55:20.417961] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-13T20:55:20.538259] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T20:55:20.925779] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T20:55:21.217944] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-13T20:55:22.017939] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-13T20:55:22.720498] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T20:55:22.817965] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-13T20:55:22.932156] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T20:55:23.617961] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-13T20:55:24.215980] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T20:55:24.418039] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-13T20:55:25.218006] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-13T20:55:25.344109] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T20:55:25.943369] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T20:55:25.999575] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T20:55:26.017910] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-13T20:55:26.817970] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-13T20:55:27.389264] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T20:55:27.390562] [INFO ] [REMOTE ] PGZ: Full fetch complete (8796 records). [2025-10-13T20:55:27.390688] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-13T20:55:27.622988] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-13T20:55:27.788828] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-13T20:55:27.788930] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-13T20:55:27.789211] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-13T20:55:27.789343] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-13T20:55:27.790087] [DEBUG] [LOCAL ] PGZ: Trimmed 8796 records to 5497 (keeping 200 days of data) [2025-10-13T20:55:27.851396] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T20:55:27.851956] [DEBUG] [LOCAL ] PGZ: Primary data saved (5497 records). [2025-10-13T20:55:27.861807] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-13T20:55:27.862466] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 25.3s. Estimated remaining: 1h 37m 37s. Rate: 7.1 symbols/min [2025-10-13T20:55:28.028709] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:28.045080] [DEBUG] [LOCAL ] PHI: Loaded 15249 existing records from primary storage. [2025-10-13T20:55:28.045329] [INFO ] [MAIN ] PHI: Loaded 15249 existing records. [2025-10-13T20:55:28.218626] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:55:28.218881] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-13T20:55:28.218927] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-13T20:55:28.219223] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-13T20:55:28.219278] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-13T20:55:28.424508] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-13T20:55:28.574946] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:29.217894] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-13T20:55:29.411881] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T20:55:29.968181] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T20:55:30.017920] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-13T20:55:30.817911] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-13T20:55:31.109944] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T20:55:31.617963] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-13T20:55:31.730549] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T20:55:32.091350] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T20:55:32.417919] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-13T20:55:33.217944] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-13T20:55:33.524718] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T20:55:34.017967] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-13T20:55:34.150765] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T20:55:34.294900] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T20:55:34.817920] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-13T20:55:35.617905] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-13T20:55:35.760247] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T20:55:36.289747] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T20:55:36.295033] [INFO ] [REMOTE ] PGRE: Full fetch complete (64143 records). [2025-10-13T20:55:36.295500] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-13T20:55:36.423166] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-13T20:55:36.599197] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T20:55:36.756152] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-13T20:55:36.756234] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-13T20:55:36.757244] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-13T20:55:36.757311] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-13T20:55:36.758758] [DEBUG] [LOCAL ] PGRE: Trimmed 64143 records to 46921 (keeping 200 days of data) [2025-10-13T20:55:37.042422] [DEBUG] [LOCAL ] PGRE: Primary data saved (46921 records). [2025-10-13T20:55:37.042569] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-13T20:55:37.042705] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 38.6s. Estimated remaining: 1h 37m 29s. Rate: 7.1 symbols/min [2025-10-13T20:55:37.218017] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-13T20:55:38.017969] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-13T20:55:38.110346] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T20:55:38.194546] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T20:55:38.817935] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-13T20:55:39.617963] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-13T20:55:39.737219] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T20:55:39.833597] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T20:55:40.417923] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-13T20:55:41.214588] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T20:55:41.222437] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-13T20:55:41.684592] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T20:55:42.017941] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-13T20:55:42.769806] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T20:55:42.817913] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-13T20:55:43.351665] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:55:43.355775] [INFO ] [REMOTE ] PHG: Full fetch complete (65174 records). [2025-10-13T20:55:43.355899] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-13T20:55:43.356688] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:55:43.356781] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:55:43.356824] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:55:43.356862] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-13T20:55:43.356916] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-13T20:55:43.356950] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-13T20:55:43.356989] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-13T20:55:43.357043] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PHG took 33.5s. Estimated remaining: 1h 37m 20s. Rate: 7.1 symbols/min [2025-10-13T20:55:43.552787] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T20:55:43.618009] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-13T20:55:44.417936] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-13T20:55:45.244117] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T20:55:45.253282] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-13T20:55:45.450419] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T20:55:46.017947] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-13T20:55:46.611322] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T20:55:46.690613] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T20:55:46.817925] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-13T20:55:47.617943] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-13T20:55:47.861888] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T20:55:48.144952] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T20:55:48.149488] [INFO ] [REMOTE ] PH: Full fetch complete (55516 records). [2025-10-13T20:55:48.149675] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-13T20:55:48.150593] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:55:48.150724] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:55:48.150786] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:55:48.150844] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-13T20:55:48.150919] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-13T20:55:48.150967] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-13T20:55:48.151023] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-13T20:55:48.151098] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 39.2s. Estimated remaining: 1h 37m 10s. Rate: 7.1 symbols/min [2025-10-13T20:55:48.417954] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-13T20:55:49.511477] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T20:55:49.515177] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-13T20:55:50.681575] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T20:55:50.686943] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-13T20:55:51.646685] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T20:55:51.649548] [INFO ] [REMOTE ] PHI: Full fetch complete (20918 records). [2025-10-13T20:55:51.649712] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-13T20:55:52.052201] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-13T20:55:52.052301] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-13T20:55:52.052902] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-13T20:55:52.052967] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-13T20:55:52.053752] [DEBUG] [LOCAL ] PHI: Trimmed 20918 records to 15150 (keeping 200 days of data) [2025-10-13T20:55:52.154553] [DEBUG] [LOCAL ] PHI: Primary data saved (15150 records). [2025-10-13T20:55:52.154722] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-13T20:55:52.154815] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHI took 24.3s. Estimated remaining: 1h 36m 59s. Rate: 7.1 symbols/min [2025-10-13T20:55:52.918734] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:52.995735] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-13T20:55:53.055739] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-13T20:55:53.019079] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:53.104476] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:53.108803] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:55:53.109447] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-13T20:55:53.106670] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-13T20:55:53.109936] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-13T20:55:53.109037] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-13T20:55:53.109775] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-13T20:55:53.110266] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-13T20:55:53.110404] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-13T20:55:53.110591] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-13T20:55:53.110162] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-13T20:55:53.110914] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-13T20:55:53.111105] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-13T20:55:53.111033] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-13T20:55:53.111505] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-13T20:55:53.111309] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-13T20:55:53.111629] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-13T20:55:53.135864] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-13T20:55:53.551957] [DEBUG] [LOCAL ] PHK: Loaded 27005 existing records from primary storage. [2025-10-13T20:55:53.761666] [INFO ] [MAIN ] PHK: Loaded 27005 existing records. [2025-10-13T20:55:54.343948] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:54.365627] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-13T20:55:54.547588] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:54.493762] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:54.587071] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-13T20:55:54.587417] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-13T20:55:54.586604] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:55:54.589459] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-13T20:55:54.589607] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-13T20:55:54.590191] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-13T20:55:54.590254] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-13T20:55:54.949836] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:55:54.950147] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-13T20:55:55.879497] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T20:55:55.887194] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-13T20:55:55.937885] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T20:55:55.945572] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-13T20:55:56.348169] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T20:55:56.354834] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-13T20:55:56.531177] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T20:55:56.543051] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-13T20:55:57.272884] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T20:55:57.280193] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-13T20:55:57.417121] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T20:55:57.795356] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T20:55:58.018016] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-13T20:55:58.302413] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T20:55:58.402608] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T20:55:58.818029] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-13T20:55:59.337699] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T20:55:59.617931] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-13T20:56:00.417973] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-13T20:56:00.449215] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T20:56:01.122855] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T20:56:01.217947] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-13T20:56:01.812885] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T20:56:02.017976] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-13T20:56:02.817912] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-13T20:56:03.077021] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T20:56:03.617969] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-13T20:56:03.881880] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T20:56:04.210993] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T20:56:04.417948] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-13T20:56:05.153189] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T20:56:05.217915] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-13T20:56:05.948121] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T20:56:06.017913] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-13T20:56:06.281271] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T20:56:06.818007] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-13T20:56:07.301149] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T20:56:07.617926] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-13T20:56:08.417906] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-13T20:56:08.755423] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T20:56:09.096114] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T20:56:09.217910] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-13T20:56:09.844872] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T20:56:10.017973] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-13T20:56:10.682672] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T20:56:10.817930] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-13T20:56:11.319622] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T20:56:11.617916] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-13T20:56:12.238729] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T20:56:12.417964] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-13T20:56:12.997045] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T20:56:13.218026] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-13T20:56:13.867333] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T20:56:14.017933] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-13T20:56:14.544620] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T20:56:14.818013] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-13T20:56:15.556910] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T20:56:15.617938] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-13T20:56:15.980753] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T20:56:15.984271] [INFO ] [REMOTE ] PHK: Full fetch complete (39348 records). [2025-10-13T20:56:15.984451] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-13T20:56:16.362172] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-13T20:56:16.362248] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-13T20:56:16.362952] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-13T20:56:16.363014] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-13T20:56:16.364308] [DEBUG] [LOCAL ] PHK: Trimmed 39348 records to 26688 (keeping 200 days of data) [2025-10-13T20:56:16.423730] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-13T20:56:16.532402] [DEBUG] [LOCAL ] PHK: Primary data saved (26688 records). [2025-10-13T20:56:16.532551] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-13T20:56:16.532713] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHK took 24.4s. Estimated remaining: 1h 36m 58s. Rate: 7.1 symbols/min [2025-10-13T20:56:16.704255] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:16.704449] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-13T20:56:16.704488] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-13T20:56:16.704605] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-13T20:56:16.704695] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-13T20:56:16.704763] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-13T20:56:16.704807] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-13T20:56:17.057584] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:17.217914] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-13T20:56:17.641418] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T20:56:17.946098] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T20:56:18.018033] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-13T20:56:18.817950] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-13T20:56:19.052385] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T20:56:19.617899] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-13T20:56:19.685947] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T20:56:20.385422] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T20:56:20.417890] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-13T20:56:21.217913] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-13T20:56:21.372548] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T20:56:22.017927] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-13T20:56:22.220760] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T20:56:22.255459] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T20:56:22.817933] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-13T20:56:23.617915] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-13T20:56:23.701945] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T20:56:23.957821] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T20:56:23.962226] [INFO ] [REMOTE ] PHR: Full fetch complete (52676 records). [2025-10-13T20:56:23.962344] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-13T20:56:23.963057] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:56:23.963146] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:56:23.963190] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:56:23.963264] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-13T20:56:23.963347] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-13T20:56:23.963399] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-13T20:56:23.963459] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-13T20:56:23.963535] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHR took 31.8s. Estimated remaining: 1h 36m 49s. Rate: 7.1 symbols/min [2025-10-13T20:56:24.142053] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:24.149292] [DEBUG] [LOCAL ] PIM: Loaded 4859 existing records from primary storage. [2025-10-13T20:56:24.149531] [INFO ] [MAIN ] PIM: Loaded 4859 existing records. [2025-10-13T20:56:24.287812] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T20:56:24.397342] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:56:24.397567] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-13T20:56:24.397615] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-13T20:56:24.397907] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-13T20:56:24.397970] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-13T20:56:24.428035] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-13T20:56:24.752743] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:25.217961] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-13T20:56:25.768633] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:56:25.771598] [INFO ] [REMOTE ] PHIN: Full fetch complete (47247 records). [2025-10-13T20:56:25.771719] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-13T20:56:25.772385] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:56:25.772489] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:56:25.772533] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:56:25.772572] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-13T20:56:25.772625] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-13T20:56:25.772696] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-13T20:56:25.772753] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-13T20:56:25.772854] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHIN took 33.6s. Estimated remaining: 1h 36m 38s. Rate: 7.1 symbols/min [2025-10-13T20:56:25.946632] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:25.962469] [DEBUG] [LOCAL ] PINE: Loaded 14423 existing records from primary storage. [2025-10-13T20:56:25.962763] [INFO ] [MAIN ] PINE: Loaded 14423 existing records. [2025-10-13T20:56:26.027551] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-13T20:56:26.155704] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:56:26.156296] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-13T20:56:26.156358] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-13T20:56:26.156756] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-13T20:56:26.156829] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-13T20:56:26.544960] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:26.550309] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:56:26.818009] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-13T20:56:27.617972] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-13T20:56:27.866611] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T20:56:27.890079] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T20:56:28.360999] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T20:56:28.417905] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-13T20:56:29.218002] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-13T20:56:30.018040] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-13T20:56:30.361975] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T20:56:30.405439] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-13T20:56:30.818033] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-13T20:56:31.156958] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T20:56:31.438231] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T20:56:31.617957] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-13T20:56:32.328907] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T20:56:32.417944] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-13T20:56:33.217926] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-13T20:56:34.018040] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-13T20:56:34.218449] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T20:56:34.398589] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T20:56:34.817948] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-13T20:56:35.608079] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T20:56:35.614735] [INFO ] [REMOTE ] PHM: Full fetch complete (74551 records). [2025-10-13T20:56:35.614891] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-13T20:56:35.615739] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:56:35.615845] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:56:35.615887] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:56:35.615925] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-13T20:56:35.615980] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-13T20:56:35.616015] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-13T20:56:35.616056] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-13T20:56:35.616113] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHM took 43.5s. Estimated remaining: 1h 36m 30s. Rate: 7.1 symbols/min [2025-10-13T20:56:35.627553] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-13T20:56:35.807522] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:35.807903] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-13T20:56:35.807999] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-13T20:56:35.808232] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-13T20:56:35.808302] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-13T20:56:35.808395] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-13T20:56:35.808462] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-13T20:56:36.161715] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T20:56:36.260139] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:36.417955] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-13T20:56:36.897572] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T20:56:37.125765] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T20:56:37.217961] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-13T20:56:37.823224] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T20:56:38.018019] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-13T20:56:38.817921] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-13T20:56:39.070683] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T20:56:39.617941] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-13T20:56:40.288465] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T20:56:40.417941] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-13T20:56:41.100532] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T20:56:41.217928] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-13T20:56:41.546424] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T20:56:42.017951] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-13T20:56:42.817952] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-13T20:56:42.993730] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T20:56:43.245699] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T20:56:43.617955] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-13T20:56:44.417942] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-13T20:56:44.507433] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T20:56:45.039560] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T20:56:45.218033] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-13T20:56:45.606749] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T20:56:45.880323] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T20:56:46.017958] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-13T20:56:46.817951] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-13T20:56:47.617947] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-13T20:56:48.154666] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T20:56:48.240294] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T20:56:48.365251] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T20:56:48.418005] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-13T20:56:49.217966] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-13T20:56:49.493695] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T20:56:50.017995] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-13T20:56:50.690075] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T20:56:50.818051] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-13T20:56:51.457802] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-13T20:56:51.607150] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T20:56:51.617887] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-13T20:56:52.171289] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T20:56:52.172466] [INFO ] [REMOTE ] PIM: Full fetch complete (6434 records). [2025-10-13T20:56:52.172539] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-13T20:56:52.423174] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-13T20:56:52.538293] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-13T20:56:52.538374] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-13T20:56:52.538602] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-13T20:56:52.538641] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-13T20:56:52.539071] [DEBUG] [LOCAL ] PIM: Trimmed 6434 records to 4811 (keeping 200 days of data) [2025-10-13T20:56:52.566613] [DEBUG] [LOCAL ] PIM: Primary data saved (4811 records). [2025-10-13T20:56:52.566715] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-13T20:56:52.566797] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PIM took 28.6s. Estimated remaining: 1h 36m 25s. Rate: 7.1 symbols/min [2025-10-13T20:56:52.732940] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:52.733076] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-13T20:56:52.733112] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-13T20:56:52.733237] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-13T20:56:52.733279] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-13T20:56:52.733330] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-13T20:56:52.733428] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-13T20:56:53.100025] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:53.217925] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-13T20:56:54.018012] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-13T20:56:54.068137] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T20:56:54.179533] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T20:56:54.818040] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-13T20:56:55.190320] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T20:56:55.618006] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-13T20:56:55.801026] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T20:56:56.417944] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-13T20:56:57.217948] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-13T20:56:57.315095] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T20:56:57.361430] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T20:56:58.017940] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-13T20:56:58.087384] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T20:56:58.090137] [INFO ] [REMOTE ] PINE: Full fetch complete (21091 records). [2025-10-13T20:56:58.090276] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-13T20:56:58.479890] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-13T20:56:58.480032] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-13T20:56:58.480891] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-13T20:56:58.480956] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-13T20:56:58.481710] [DEBUG] [LOCAL ] PINE: Trimmed 21091 records to 14333 (keeping 200 days of data) [2025-10-13T20:56:58.579014] [DEBUG] [LOCAL ] PINE: Primary data saved (14333 records). [2025-10-13T20:56:58.579285] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-13T20:56:58.579425] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PINE took 32.8s. Estimated remaining: 1h 36m 15s. Rate: 7.1 symbols/min [2025-10-13T20:56:58.728782] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:56:58.754823] [INFO ] [REMOTE ] PII: Full fetch complete (70773 records). [2025-10-13T20:56:58.780202] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-13T20:56:58.805321] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:58.805458] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-13T20:56:58.805500] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-13T20:56:58.805609] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-13T20:56:58.805680] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-13T20:56:58.805742] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-13T20:56:58.805775] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-13T20:56:58.825862] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-13T20:56:58.826533] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:56:58.844173] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:56:58.877125] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:56:58.889013] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-13T20:56:58.911002] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-13T20:56:58.911168] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-13T20:56:58.922166] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-13T20:56:58.932638] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PII took 42.4s. Estimated remaining: 1h 36m 4s. Rate: 7.1 symbols/min [2025-10-13T20:56:59.351759] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:56:59.395956] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:59.391477] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-13T20:56:59.396300] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-13T20:56:59.396800] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-13T20:56:59.396849] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-13T20:56:59.396896] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-13T20:56:59.396928] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-13T20:56:59.619340] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-13T20:56:59.773366] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:56:59.928949] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T20:57:00.418018] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-13T20:57:01.218024] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-13T20:57:01.807325] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T20:57:02.018052] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-13T20:57:02.293846] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T20:57:02.340768] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T20:57:02.817971] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-13T20:57:03.617922] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-13T20:57:04.149184] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T20:57:04.417915] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-13T20:57:04.679374] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T20:57:04.879678] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T20:57:05.217964] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-13T20:57:06.017921] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-13T20:57:06.535073] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T20:57:06.559772] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T20:57:06.818018] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-13T20:57:07.511843] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T20:57:07.617912] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-13T20:57:08.417924] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-13T20:57:08.791373] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T20:57:09.217947] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-13T20:57:09.474257] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T20:57:09.725243] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T20:57:10.017917] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-13T20:57:10.818018] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-13T20:57:11.074073] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T20:57:11.105202] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:57:11.617961] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-13T20:57:12.022341] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T20:57:12.253873] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T20:57:12.258873] [INFO ] [REMOTE ] PINS: Full fetch complete (77350 records). [2025-10-13T20:57:12.258984] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-13T20:57:12.259699] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:57:12.259789] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:57:12.259835] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:57:12.259875] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-13T20:57:12.259928] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-13T20:57:12.259963] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-13T20:57:12.260000] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-13T20:57:12.260053] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PINS took 36.6s. Estimated remaining: 1h 35m 57s. Rate: 7.1 symbols/min [2025-10-13T20:57:12.429502] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-13T20:57:12.435614] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:57:12.452979] [DEBUG] [LOCAL ] PKE: Loaded 13854 existing records from primary storage. [2025-10-13T20:57:12.453232] [INFO ] [MAIN ] PKE: Loaded 13854 existing records. [2025-10-13T20:57:12.624981] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:57:12.625230] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-13T20:57:12.625276] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-13T20:57:12.625564] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-13T20:57:12.625622] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-13T20:57:12.975917] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:57:13.217929] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-13T20:57:13.597413] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T20:57:14.017934] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-13T20:57:14.061169] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T20:57:14.817917] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-13T20:57:15.617964] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-13T20:57:15.706440] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T20:57:16.055555] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T20:57:16.417920] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-13T20:57:16.856548] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T20:57:17.217930] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-13T20:57:17.323824] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T20:57:18.018022] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-13T20:57:18.223310] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T20:57:18.509767] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T20:57:18.817937] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-13T20:57:19.617949] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-13T20:57:20.417961] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-13T20:57:20.622906] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T20:57:20.700484] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T20:57:21.217897] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-13T20:57:21.472026] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T20:57:22.017912] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-13T20:57:22.196567] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T20:57:22.818019] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-13T20:57:22.889386] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T20:57:23.617951] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-13T20:57:23.977967] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T20:57:24.238029] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T20:57:24.417924] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-13T20:57:25.217944] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-13T20:57:25.568907] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T20:57:26.017960] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-13T20:57:26.433055] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T20:57:26.817907] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-13T20:57:27.319571] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T20:57:27.617925] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-13T20:57:27.847622] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T20:57:28.417970] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-13T20:57:29.217923] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-13T20:57:29.299496] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T20:57:29.425851] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T20:57:30.017937] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-13T20:57:30.359252] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T20:57:30.818006] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-13T20:57:31.263490] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T20:57:31.265461] [INFO ] [REMOTE ] PIPR: Full fetch complete (20574 records). [2025-10-13T20:57:31.265539] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-13T20:57:31.266179] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:57:31.266270] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:57:31.266338] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:57:31.266404] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-13T20:57:31.266473] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-13T20:57:31.266509] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-13T20:57:31.266548] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-13T20:57:31.266607] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PIPR took 38.7s. Estimated remaining: 1h 35m 53s. Rate: 7.1 symbols/min [2025-10-13T20:57:31.446287] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:57:31.446516] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-13T20:57:31.446554] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-13T20:57:31.446705] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-13T20:57:31.446757] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-13T20:57:31.446802] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-13T20:57:31.446838] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-13T20:57:31.625373] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-13T20:57:31.823081] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:57:31.993686] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T20:57:32.394492] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T20:57:32.417928] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-13T20:57:33.042340] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T20:57:33.044971] [INFO ] [REMOTE ] PJT: Full fetch complete (32032 records). [2025-10-13T20:57:33.045049] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-13T20:57:33.045541] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:57:33.045623] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:57:33.045716] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:57:33.045763] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-13T20:57:33.045818] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-13T20:57:33.045851] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-13T20:57:33.045889] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-13T20:57:33.045940] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PJT took 34.5s. Estimated remaining: 1h 35m 42s. Rate: 7.1 symbols/min [2025-10-13T20:57:33.226095] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-13T20:57:33.230425] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:57:33.230573] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-13T20:57:33.230842] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-13T20:57:33.231723] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-13T20:57:33.231774] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-13T20:57:33.231825] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-13T20:57:33.231861] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-13T20:57:33.610923] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:57:34.017957] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-13T20:57:34.326385] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T20:57:34.330530] [INFO ] [REMOTE ] PKE: Full fetch complete (17956 records). [2025-10-13T20:57:34.330729] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-13T20:57:34.714827] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-13T20:57:34.714936] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-13T20:57:34.715605] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-13T20:57:34.715698] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-13T20:57:34.716433] [DEBUG] [LOCAL ] PKE: Trimmed 17956 records to 13869 (keeping 200 days of data) [2025-10-13T20:57:34.815470] [DEBUG] [LOCAL ] PKE: Primary data saved (13869 records). [2025-10-13T20:57:34.815739] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-13T20:57:34.815850] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PKE took 22.6s. Estimated remaining: 1h 35m 31s. Rate: 7.1 symbols/min [2025-10-13T20:57:34.821215] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-13T20:57:34.998591] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:57:34.998930] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-13T20:57:34.998985] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-13T20:57:34.999108] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-13T20:57:34.999150] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-13T20:57:34.999190] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-13T20:57:34.999223] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-13T20:57:35.377932] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:57:35.396708] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T20:57:35.617950] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-13T20:57:36.418067] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-13T20:57:36.527380] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T20:57:36.698113] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T20:57:37.217943] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-13T20:57:38.017969] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-13T20:57:38.339009] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T20:57:38.817926] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-13T20:57:39.007349] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T20:57:39.515475] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T20:57:39.617940] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-13T20:57:40.417925] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-13T20:57:40.605263] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T20:57:41.217943] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-13T20:57:41.263905] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T20:57:41.731362] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T20:57:41.968394] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T20:57:41.974265] [INFO ] [REMOTE ] PK: Full fetch complete (76010 records). [2025-10-13T20:57:41.974500] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-13T20:57:41.975439] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:57:41.975558] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:57:41.975700] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:57:41.975796] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-13T20:57:41.975905] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-13T20:57:41.975965] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-13T20:57:41.976012] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-13T20:57:41.976080] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PK took 43.0s. Estimated remaining: 1h 35m 22s. Rate: 7.1 symbols/min [2025-10-13T20:57:42.023039] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-13T20:57:42.180677] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:57:42.181012] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-13T20:57:42.181070] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-13T20:57:42.181211] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-13T20:57:42.181262] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-13T20:57:42.181307] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-13T20:57:42.181344] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-13T20:57:42.565992] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:57:42.818011] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-13T20:57:43.617959] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-13T20:57:43.826474] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T20:57:44.417920] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-13T20:57:44.706264] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T20:57:44.932786] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T20:57:45.218005] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-13T20:57:46.018028] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-13T20:57:46.221194] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T20:57:46.601487] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:57:46.817945] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-13T20:57:47.618013] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-13T20:57:48.177287] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T20:57:48.363051] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T20:57:48.417939] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-13T20:57:48.880179] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T20:57:49.217956] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-13T20:57:49.904061] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T20:57:50.018025] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-13T20:57:50.459067] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T20:57:50.818044] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-13T20:57:51.617919] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-13T20:57:52.157412] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-13T20:57:52.417902] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-13T20:57:52.474602] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T20:57:52.644694] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T20:57:53.217932] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-13T20:57:54.017895] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-13T20:57:54.360058] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T20:57:54.576073] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-13T20:57:54.818037] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-13T20:57:55.548968] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T20:57:55.617884] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-13T20:57:56.418000] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-13T20:57:56.945857] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T20:57:56.981801] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T20:57:57.217918] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-13T20:57:57.543921] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T20:57:58.017954] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-13T20:57:58.817956] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-13T20:57:59.181406] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T20:57:59.281356] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T20:57:59.617936] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-13T20:57:59.756315] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T20:58:00.417912] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-13T20:58:01.217920] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-13T20:58:01.573617] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T20:58:01.741773] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-13T20:58:02.017952] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-13T20:58:02.458635] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T20:58:02.519250] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T20:58:02.521492] [INFO ] [REMOTE ] PKST: Full fetch complete (28936 records). [2025-10-13T20:58:02.521562] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-13T20:58:02.522099] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:02.522179] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:02.522221] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:02.522285] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-13T20:58:02.522345] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-13T20:58:02.522380] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-13T20:58:02.522419] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-13T20:58:02.522470] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKST took 29.5s. Estimated remaining: 1h 35m 18s. Rate: 7.1 symbols/min [2025-10-13T20:58:02.694353] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:02.694531] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-13T20:58:02.694570] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-13T20:58:02.694701] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-13T20:58:02.694753] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-13T20:58:02.694803] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-13T20:58:02.694838] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-13T20:58:02.833515] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-13T20:58:03.056539] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:03.617919] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-13T20:58:04.417929] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-13T20:58:05.217898] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-13T20:58:05.364015] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-13T20:58:05.629334] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T20:58:05.964308] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T20:58:06.017896] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-13T20:58:06.543743] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T20:58:06.817931] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-13T20:58:07.499382] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T20:58:07.617934] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-13T20:58:08.323987] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T20:58:08.327624] [INFO ] [REMOTE ] PKG: Full fetch complete (57317 records). [2025-10-13T20:58:08.327742] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-13T20:58:08.328374] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:08.328463] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:08.328507] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:08.328546] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-13T20:58:08.328604] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-13T20:58:08.328695] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-13T20:58:08.328768] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-13T20:58:08.328832] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 37.1s. Estimated remaining: 1h 35m 9s. Rate: 7.1 symbols/min [2025-10-13T20:58:08.423063] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-13T20:58:08.508303] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:08.508464] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-13T20:58:08.508501] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-13T20:58:08.508613] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-13T20:58:08.508686] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-13T20:58:08.508778] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-13T20:58:08.508852] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-13T20:58:08.874427] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:09.217910] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-13T20:58:09.264010] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-13T20:58:09.287183] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T20:58:10.017927] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-13T20:58:10.820424] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-13T20:58:10.825824] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T20:58:11.617940] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-13T20:58:11.928003] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T20:58:12.418002] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-13T20:58:12.596521] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-13T20:58:13.217918] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-13T20:58:13.578305] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T20:58:13.579099] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T20:58:13.592269] [INFO ] [REMOTE ] PKX: Full fetch complete (36241 records). [2025-10-13T20:58:13.592416] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-13T20:58:13.592998] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:13.593083] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:13.593137] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:13.593222] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-13T20:58:13.593345] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-13T20:58:13.593411] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-13T20:58:13.593500] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-13T20:58:13.593601] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKX took 38.8s. Estimated remaining: 1h 34m 59s. Rate: 7.1 symbols/min [2025-10-13T20:58:13.764167] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:13.764380] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-13T20:58:13.764433] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-13T20:58:13.764545] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-13T20:58:13.764595] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-13T20:58:13.764703] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-13T20:58:13.764760] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-13T20:58:14.023107] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-13T20:58:14.116846] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:14.146741] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T20:58:14.817944] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-13T20:58:15.468831] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:58:15.474590] [INFO ] [REMOTE ] PL: Full fetch complete (76588 records). [2025-10-13T20:58:15.474827] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-13T20:58:15.475825] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:15.475917] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:15.475986] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:15.476063] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-13T20:58:15.476138] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-13T20:58:15.476177] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-13T20:58:15.476217] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-13T20:58:15.476281] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PL took 33.5s. Estimated remaining: 1h 34m 48s. Rate: 7.1 symbols/min [2025-10-13T20:58:15.626795] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-13T20:58:15.709828] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:15.710088] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-13T20:58:15.710257] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-13T20:58:15.710442] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-13T20:58:15.710519] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-13T20:58:15.710603] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-13T20:58:15.710779] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-13T20:58:16.085732] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:16.114998] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-13T20:58:16.417922] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-13T20:58:17.217940] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-13T20:58:17.465911] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T20:58:17.496582] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T20:58:18.017905] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-13T20:58:18.396764] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T20:58:18.818030] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-13T20:58:19.617916] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-13T20:58:19.891100] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T20:58:20.417902] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-13T20:58:20.722362] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T20:58:20.901407] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T20:58:21.218020] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-13T20:58:22.017959] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-13T20:58:22.155810] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T20:58:22.456516] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T20:58:22.817948] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-13T20:58:23.067353] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T20:58:23.617931] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-13T20:58:24.417999] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-13T20:58:24.720837] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T20:58:24.952931] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T20:58:25.217942] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-13T20:58:26.018039] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-13T20:58:26.588518] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T20:58:26.661023] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T20:58:26.817912] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-13T20:58:27.395308] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T20:58:27.618017] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-13T20:58:28.417947] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-13T20:58:28.502858] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T20:58:29.033258] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T20:58:29.217940] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-13T20:58:30.018004] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-13T20:58:30.312166] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T20:58:30.314158] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T20:58:30.817959] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-13T20:58:31.442999] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T20:58:31.617955] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-13T20:58:32.074575] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T20:58:32.418014] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-13T20:58:32.911630] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T20:58:33.217948] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-13T20:58:34.017937] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-13T20:58:34.057141] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T20:58:34.680435] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T20:58:34.817925] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-13T20:58:35.081626] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T20:58:35.617934] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-13T20:58:36.417968] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-13T20:58:36.676803] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T20:58:37.106767] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T20:58:37.217940] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-13T20:58:38.017950] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-13T20:58:38.077328] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T20:58:38.817956] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-13T20:58:39.213160] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T20:58:39.232034] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T20:58:39.617966] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-13T20:58:40.401014] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T20:58:40.417882] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-13T20:58:40.770307] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T20:58:41.218067] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-13T20:58:42.018029] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-13T20:58:42.096224] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T20:58:42.458919] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T20:58:42.818057] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-13T20:58:43.359592] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T20:58:43.361786] [INFO ] [REMOTE ] PLOW: Full fetch complete (28343 records). [2025-10-13T20:58:43.361992] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-13T20:58:43.362610] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:43.362718] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:43.362764] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:43.362811] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-13T20:58:43.362891] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-13T20:58:43.362950] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-13T20:58:43.362996] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-13T20:58:43.363056] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PLOW took 29.8s. Estimated remaining: 1h 34m 47s. Rate: 7.1 symbols/min [2025-10-13T20:58:43.546200] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:43.546439] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-13T20:58:43.546506] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-13T20:58:43.546670] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-13T20:58:43.546731] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-13T20:58:43.546777] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-13T20:58:43.546852] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-13T20:58:43.620498] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-13T20:58:43.944881] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:44.081994] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T20:58:44.352861] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T20:58:44.357099] [INFO ] [REMOTE ] PLYM: Full fetch complete (47111 records). [2025-10-13T20:58:44.357194] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-13T20:58:44.357940] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:44.358086] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:44.358144] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:44.358227] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-13T20:58:44.358347] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-13T20:58:44.358426] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-13T20:58:44.358511] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-13T20:58:44.358628] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLYM took 28.9s. Estimated remaining: 1h 34m 36s. Rate: 7.1 symbols/min [2025-10-13T20:58:44.425562] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-13T20:58:44.547690] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:44.573782] [DEBUG] [LOCAL ] PML: Loaded 21832 existing records from primary storage. [2025-10-13T20:58:44.574144] [INFO ] [MAIN ] PML: Loaded 21832 existing records. [2025-10-13T20:58:44.774941] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:58:44.775262] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-13T20:58:44.775339] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-13T20:58:44.775878] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-13T20:58:44.775936] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-13T20:58:45.160917] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:45.217955] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-13T20:58:45.245003] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T20:58:45.249754] [INFO ] [REMOTE ] PLNT: Full fetch complete (70095 records). [2025-10-13T20:58:45.249895] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-13T20:58:45.250551] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:45.250666] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:45.250727] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:45.250775] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-13T20:58:45.250851] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-13T20:58:45.250893] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-13T20:58:45.250936] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-13T20:58:45.250993] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLNT took 36.9s. Estimated remaining: 1h 34m 25s. Rate: 7.1 symbols/min [2025-10-13T20:58:45.419092] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:45.432147] [DEBUG] [LOCAL ] PMM: Loaded 10748 existing records from primary storage. [2025-10-13T20:58:45.432372] [INFO ] [MAIN ] PMM: Loaded 10748 existing records. [2025-10-13T20:58:45.608523] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:58:45.608767] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-13T20:58:45.608817] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-13T20:58:45.609124] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-13T20:58:45.609211] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-13T20:58:45.957601] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:46.017918] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-13T20:58:46.396985] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T20:58:46.818006] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-13T20:58:46.997299] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T20:58:47.617927] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-13T20:58:48.417939] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-13T20:58:48.610196] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T20:58:49.217998] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-13T20:58:49.342835] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T20:58:49.677617] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T20:58:49.957091] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T20:58:49.966707] [INFO ] [REMOTE ] PLD: Full fetch complete (76971 records). [2025-10-13T20:58:49.967078] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-13T20:58:49.968861] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:58:49.969003] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:58:49.969047] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:58:49.969094] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-13T20:58:49.969200] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-13T20:58:49.969257] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-13T20:58:49.969300] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-13T20:58:49.969420] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLD took 47.4s. Estimated remaining: 1h 34m 15s. Rate: 7.1 symbols/min [2025-10-13T20:58:50.023140] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-13T20:58:50.220526] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:58:50.235779] [DEBUG] [LOCAL ] PMO: Loaded 10158 existing records from primary storage. [2025-10-13T20:58:50.236122] [INFO ] [MAIN ] PMO: Loaded 10158 existing records. [2025-10-13T20:58:50.429857] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:58:50.430151] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-13T20:58:50.430199] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-13T20:58:50.430529] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-13T20:58:50.430596] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-13T20:58:50.791403] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:58:50.817949] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-13T20:58:51.083370] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T20:58:51.618011] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-13T20:58:52.417929] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-13T20:58:52.664804] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T20:58:52.780479] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T20:58:53.218026] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-13T20:58:53.598226] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T20:58:53.996408] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T20:58:54.017895] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-13T20:58:54.817956] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-13T20:58:54.987758] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T20:58:55.617940] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-13T20:58:55.825826] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T20:58:56.417964] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-13T20:58:56.720343] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T20:58:57.217926] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-13T20:58:58.017939] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-13T20:58:58.071387] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T20:58:58.399336] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T20:58:58.818010] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-13T20:58:58.877019] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T20:58:59.617991] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-13T20:59:00.417931] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-13T20:59:00.699243] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T20:59:00.971623] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-13T20:59:01.217966] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-13T20:59:01.717067] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T20:59:02.017957] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-13T20:59:02.462708] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T20:59:02.817963] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-13T20:59:03.617923] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-13T20:59:03.915920] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T20:59:04.417994] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-13T20:59:04.737559] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T20:59:05.219076] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-13T20:59:05.218966] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (3.20 seconds). [2025-10-13T20:59:05.249259] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T20:59:06.017955] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-13T20:59:06.222168] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T20:59:06.677528] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T20:59:06.817910] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-13T20:59:07.617900] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-13T20:59:07.654514] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T20:59:08.417931] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-13T20:59:09.005312] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T20:59:09.217905] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-13T20:59:09.298366] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T20:59:10.017918] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-13T20:59:10.568967] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T20:59:10.817927] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-13T20:59:10.844635] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T20:59:11.612987] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T20:59:11.617873] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-13T20:59:12.392374] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T20:59:12.417904] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-13T20:59:13.217911] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-13T20:59:13.332386] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T20:59:14.017933] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-13T20:59:14.817899] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-13T20:59:15.025581] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T20:59:15.028477] [INFO ] [REMOTE ] PML: Full fetch complete (29649 records). [2025-10-13T20:59:15.028555] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-13T20:59:15.432883] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-13T20:59:15.433112] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-13T20:59:15.440460] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-13T20:59:15.441223] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-13T20:59:15.441503] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T20:59:15.445877] [DEBUG] [LOCAL ] PML: Trimmed 29649 records to 21647 (keeping 200 days of data) [2025-10-13T20:59:15.560398] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-13T20:59:15.616483] [DEBUG] [LOCAL ] PML: Primary data saved (21647 records). [2025-10-13T20:59:15.616626] [INFO ] [MAIN ] PML: Full history saved. [2025-10-13T20:59:15.616745] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PML took 31.3s. Estimated remaining: 1h 34m 13s. Rate: 7.1 symbols/min [2025-10-13T20:59:15.627828] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-13T20:59:15.790639] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:15.790849] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-13T20:59:15.790890] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-13T20:59:15.791003] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-13T20:59:15.791045] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-13T20:59:15.791086] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-13T20:59:15.791119] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-13T20:59:16.155266] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:16.417928] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-13T20:59:16.431095] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T20:59:16.433487] [INFO ] [REMOTE ] PMO: Full fetch complete (16472 records). [2025-10-13T20:59:16.433678] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-13T20:59:16.802399] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-13T20:59:16.802478] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-13T20:59:16.802975] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-13T20:59:16.803039] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-13T20:59:16.803573] [DEBUG] [LOCAL ] PMO: Trimmed 16472 records to 9938 (keeping 200 days of data) [2025-10-13T20:59:16.867825] [DEBUG] [LOCAL ] PMO: Primary data saved (9938 records). [2025-10-13T20:59:16.868041] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-13T20:59:16.868176] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PMO took 26.9s. Estimated remaining: 1h 34m 2s. Rate: 7.1 symbols/min [2025-10-13T20:59:17.044683] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:17.044940] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-13T20:59:17.045016] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-13T20:59:17.045155] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-13T20:59:17.045207] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-13T20:59:17.045251] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-13T20:59:17.045285] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-13T20:59:17.207001] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T20:59:17.233681] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-13T20:59:17.439720] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:18.017999] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-13T20:59:18.783415] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T20:59:18.785324] [INFO ] [REMOTE ] PMM: Full fetch complete (17886 records). [2025-10-13T20:59:18.785401] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-13T20:59:18.820561] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-13T20:59:19.127439] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T20:59:19.211474] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-13T20:59:19.211559] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-13T20:59:19.212105] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-13T20:59:19.212166] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-13T20:59:19.212698] [DEBUG] [LOCAL ] PMM: Trimmed 17886 records to 10253 (keeping 200 days of data) [2025-10-13T20:59:19.264477] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T20:59:19.281312] [DEBUG] [LOCAL ] PMM: Primary data saved (10253 records). [2025-10-13T20:59:19.281469] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-13T20:59:19.281555] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PMM took 34.0s. Estimated remaining: 1h 33m 51s. Rate: 7.1 symbols/min [2025-10-13T20:59:19.448495] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:19.448725] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-13T20:59:19.448775] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-13T20:59:19.448910] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-13T20:59:19.448952] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-13T20:59:19.449036] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-13T20:59:19.449080] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-13T20:59:19.619316] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-13T20:59:19.823183] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:20.417966] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-13T20:59:20.693871] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:59:20.694212] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-13T20:59:20.694324] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:59:20.694432] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-13T20:59:20.694515] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:59:20.694606] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-13T20:59:20.694719] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-13T20:59:20.694765] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-13T20:59:20.694807] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-13T20:59:20.694853] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMTV took 1.4s. Estimated remaining: 1h 33m 40s. Rate: 7.1 symbols/min [2025-10-13T20:59:20.863811] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:20.863972] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-13T20:59:20.864008] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-13T20:59:20.864142] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-13T20:59:20.864206] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-13T20:59:20.864299] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-13T20:59:20.864352] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-13T20:59:21.223348] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-13T20:59:21.228274] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:21.789826] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-13T20:59:22.018012] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-13T20:59:22.817943] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-13T20:59:22.935092] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T20:59:23.250844] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T20:59:23.617924] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-13T20:59:24.090317] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T20:59:24.267150] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-13T20:59:24.417892] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-13T20:59:25.218012] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-13T20:59:25.473634] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T20:59:25.474111] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-13T20:59:25.474228] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T20:59:25.474287] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-13T20:59:25.474325] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T20:59:25.474393] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-13T20:59:25.474465] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-13T20:59:25.474503] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-13T20:59:25.474549] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-13T20:59:25.474602] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMTW took 4.8s. Estimated remaining: 1h 33m 30s. Rate: 7.1 symbols/min [2025-10-13T20:59:25.647147] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:25.647373] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-13T20:59:25.647428] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-13T20:59:25.647544] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-13T20:59:25.647586] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-13T20:59:25.647626] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-13T20:59:25.647692] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-13T20:59:26.015299] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:26.017879] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-13T20:59:26.561762] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-13T20:59:26.818003] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-13T20:59:27.617929] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-13T20:59:27.685009] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T20:59:28.046267] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T20:59:28.417937] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-13T20:59:28.996199] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T20:59:29.217929] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-13T20:59:29.539828] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T20:59:30.017936] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-13T20:59:30.817957] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-13T20:59:31.086218] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T20:59:31.161682] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T20:59:31.166824] [INFO ] [REMOTE ] PM: Full fetch complete (77325 records). [2025-10-13T20:59:31.166960] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-13T20:59:31.167680] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:59:31.167774] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:59:31.167826] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:59:31.167872] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-13T20:59:31.167940] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-13T20:59:31.168026] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-13T20:59:31.168090] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-13T20:59:31.168181] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PM took 47.8s. Estimated remaining: 1h 33m 21s. Rate: 7.1 symbols/min [2025-10-13T20:59:31.344528] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:31.354216] [DEBUG] [LOCAL ] PNI: Loaded 6871 existing records from primary storage. [2025-10-13T20:59:31.354430] [INFO ] [MAIN ] PNI: Loaded 6871 existing records. [2025-10-13T20:59:31.541219] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:59:31.541582] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-13T20:59:31.541869] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-13T20:59:31.542198] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-13T20:59:31.542265] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-13T20:59:31.620904] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-13T20:59:31.744748] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T20:59:31.995610] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:32.192273] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T20:59:32.417918] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-13T20:59:33.218019] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-13T20:59:34.017902] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-13T20:59:34.276206] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T20:59:34.595398] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-13T20:59:34.818005] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-13T20:59:35.183491] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T20:59:35.617936] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-13T20:59:36.015776] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-13T20:59:36.417953] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-13T20:59:36.755996] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T20:59:37.217934] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-13T20:59:37.893357] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T20:59:37.960353] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T20:59:38.017952] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-13T20:59:38.817947] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-13T20:59:39.311287] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T20:59:39.488427] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T20:59:39.617910] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-13T20:59:40.417938] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-13T20:59:41.217982] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-13T20:59:41.302504] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T20:59:41.341871] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T20:59:41.582751] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T20:59:42.018004] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-13T20:59:42.818000] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-13T20:59:43.225677] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-13T20:59:43.617889] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-13T20:59:43.645092] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T20:59:44.076367] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T20:59:44.417999] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-13T20:59:45.218058] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-13T20:59:45.920826] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T20:59:45.921541] [INFO ] [REMOTE ] PMTU: Full fetch complete (1200 records). [2025-10-13T20:59:45.921744] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-13T20:59:46.024159] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-13T20:59:46.091924] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T20:59:46.163791] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-13T20:59:46.164467] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:59:46.164551] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:59:46.164632] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-13T20:59:46.164742] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-13T20:59:46.164788] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-13T20:59:46.164831] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-13T20:59:46.164897] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTU took 29.3s. Estimated remaining: 1h 33m 15s. Rate: 7.1 symbols/min [2025-10-13T20:59:46.342329] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:46.380451] [DEBUG] [LOCAL ] PNNT: Loaded 33721 existing records from primary storage. [2025-10-13T20:59:46.380857] [INFO ] [MAIN ] PNNT: Loaded 33721 existing records. [2025-10-13T20:59:46.562259] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T20:59:46.562570] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-13T20:59:46.562621] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-13T20:59:46.563766] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-13T20:59:46.563827] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-13T20:59:46.822517] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-13T20:59:46.907890] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T20:59:46.946723] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:47.617957] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-13T20:59:48.265743] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T20:59:48.270343] [INFO ] [REMOTE ] PMT: Full fetch complete (58247 records). [2025-10-13T20:59:48.270501] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-13T20:59:48.271257] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T20:59:48.271364] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T20:59:48.271433] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T20:59:48.271511] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-13T20:59:48.271584] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-13T20:59:48.271620] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-13T20:59:48.271693] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-13T20:59:48.271765] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMT took 32.7s. Estimated remaining: 1h 33m 4s. Rate: 7.1 symbols/min [2025-10-13T20:59:48.423134] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-13T20:59:48.451079] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T20:59:48.451384] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-13T20:59:48.452254] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-13T20:59:48.452394] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-13T20:59:48.452481] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-13T20:59:48.452537] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-13T20:59:48.452572] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-13T20:59:48.831734] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T20:59:48.889691] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T20:59:49.217924] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-13T20:59:49.238607] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T20:59:50.018026] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-13T20:59:50.817954] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-13T20:59:51.136347] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T20:59:51.556059] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T20:59:51.617887] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-13T20:59:52.417985] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-13T20:59:52.487168] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T20:59:53.096463] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T20:59:53.217955] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-13T20:59:53.920232] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T20:59:53.950277] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T20:59:54.018032] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-13T20:59:54.631971] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T20:59:54.818005] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-13T20:59:55.617961] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-13T20:59:56.154912] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T20:59:56.417947] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-13T20:59:57.079066] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T20:59:57.218066] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-13T20:59:57.983988] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T20:59:58.018046] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-13T20:59:58.817939] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-13T20:59:58.904472] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T20:59:59.617945] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-13T20:59:59.656282] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:00:00.417944] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-13T21:00:00.575858] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T21:00:01.217915] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-13T21:00:01.287195] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T21:00:02.018013] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-13T21:00:02.067310] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T21:00:02.598128] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T21:00:02.817963] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-13T21:00:03.292434] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T21:00:03.618045] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-13T21:00:04.418069] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-13T21:00:04.617742] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T21:00:04.743132] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:00:05.217963] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-13T21:00:06.018044] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-13T21:00:06.182256] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:00:06.323040] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T21:00:06.818012] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-13T21:00:07.476170] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T21:00:07.617945] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-13T21:00:08.262200] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T21:00:08.263447] [INFO ] [REMOTE ] PNI: Full fetch complete (9704 records). [2025-10-13T21:00:08.263522] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-13T21:00:08.434038] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-13T21:00:08.685003] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-13T21:00:08.685147] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-13T21:00:08.685554] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-13T21:00:08.685783] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-13T21:00:08.687000] [DEBUG] [LOCAL ] PNI: Trimmed 9704 records to 6765 (keeping 200 days of data) [2025-10-13T21:00:08.733714] [DEBUG] [LOCAL ] PNI: Primary data saved (6765 records). [2025-10-13T21:00:08.734210] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-13T21:00:08.734337] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PNI took 37.6s. Estimated remaining: 1h 33m 0s. Rate: 7.1 symbols/min [2025-10-13T21:00:08.863573] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T21:00:08.978196] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:08.978485] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-13T21:00:08.978525] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-13T21:00:08.979522] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-13T21:00:08.979568] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-13T21:00:08.979614] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-13T21:00:08.979674] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-13T21:00:09.223263] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-13T21:00:09.374919] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:10.018046] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-13T21:00:10.309800] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T21:00:10.817924] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-13T21:00:11.034379] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T21:00:11.618065] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-13T21:00:11.733914] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T21:00:12.417941] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-13T21:00:12.738853] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T21:00:13.186556] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T21:00:13.188354] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:00:13.204056] [INFO ] [REMOTE ] PNC: Full fetch complete (75026 records). [2025-10-13T21:00:13.204327] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-13T21:00:13.205591] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:13.205763] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:13.205843] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:13.205934] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-13T21:00:13.206055] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-13T21:00:13.206132] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-13T21:00:13.206219] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-13T21:00:13.206328] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNC took 47.7s. Estimated remaining: 1h 32m 50s. Rate: 7.1 symbols/min [2025-10-13T21:00:13.223087] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-13T21:00:13.400122] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:13.400362] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-13T21:00:13.400408] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-13T21:00:13.400529] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-13T21:00:13.400571] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-13T21:00:13.400614] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-13T21:00:13.400680] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-13T21:00:13.817224] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:14.018016] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-13T21:00:14.817928] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-13T21:00:14.995726] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:00:15.574378] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T21:00:15.617912] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-13T21:00:16.417909] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-13T21:00:16.550345] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T21:00:16.947309] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T21:00:16.952072] [INFO ] [REMOTE ] PNNT: Full fetch complete (47823 records). [2025-10-13T21:00:16.952170] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-13T21:00:17.223215] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-13T21:00:17.369859] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-13T21:00:17.369941] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-13T21:00:17.370729] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-13T21:00:17.370792] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-13T21:00:17.371938] [DEBUG] [LOCAL ] PNNT: Trimmed 47823 records to 33433 (keeping 200 days of data) [2025-10-13T21:00:17.567841] [DEBUG] [LOCAL ] PNNT: Primary data saved (33433 records). [2025-10-13T21:00:17.568032] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-13T21:00:17.568130] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNNT took 31.4s. Estimated remaining: 1h 32m 40s. Rate: 7.1 symbols/min [2025-10-13T21:00:17.741466] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:17.741841] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-13T21:00:17.741898] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-13T21:00:17.742051] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-13T21:00:17.742127] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-13T21:00:17.742207] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-13T21:00:17.742271] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-13T21:00:18.030384] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-13T21:00:18.118622] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:18.149844] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T21:00:18.823028] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-13T21:00:18.842450] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:00:19.364248] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T21:00:19.618020] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-13T21:00:20.315760] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T21:00:20.417923] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-13T21:00:21.217931] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-13T21:00:21.293253] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T21:00:21.951685] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:00:21.956513] [INFO ] [REMOTE ] PNR: Full fetch complete (68845 records). [2025-10-13T21:00:21.956620] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-13T21:00:21.957373] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:21.957467] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:21.957510] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:21.957549] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-13T21:00:21.957605] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-13T21:00:21.957667] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-13T21:00:21.957734] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-13T21:00:21.957794] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNR took 33.7s. Estimated remaining: 1h 32m 30s. Rate: 7.1 symbols/min [2025-10-13T21:00:22.026373] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-13T21:00:22.129184] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:22.129360] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-13T21:00:22.129434] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-13T21:00:22.129595] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-13T21:00:22.129687] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-13T21:00:22.129850] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-13T21:00:22.129959] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-13T21:00:22.273718] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T21:00:22.529112] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:22.817962] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-13T21:00:23.617918] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-13T21:00:23.962682] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T21:00:24.417903] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-13T21:00:24.613434] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T21:00:25.217909] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-13T21:00:25.491566] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T21:00:26.017900] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-13T21:00:26.118458] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T21:00:26.208294] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T21:00:26.817927] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-13T21:00:27.617912] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-13T21:00:27.842723] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T21:00:28.417902] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-13T21:00:28.470595] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:00:28.947787] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T21:00:29.218007] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-13T21:00:30.017921] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-13T21:00:30.179561] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T21:00:30.808403] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T21:00:30.818122] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-13T21:00:31.617961] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-13T21:00:31.850573] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T21:00:32.417933] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-13T21:00:32.648690] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T21:00:33.217989] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-13T21:00:33.373848] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T21:00:34.018060] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-13T21:00:34.168935] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:00:34.818056] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-13T21:00:34.947922] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T21:00:35.617948] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-13T21:00:36.048264] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T21:00:36.321594] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T21:00:36.417962] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-13T21:00:37.218006] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-13T21:00:37.330013] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T21:00:38.017935] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-13T21:00:38.336121] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T21:00:38.817914] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-13T21:00:38.924807] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:00:39.617918] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-13T21:00:39.855327] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T21:00:40.417896] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-13T21:00:40.782585] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T21:00:41.217936] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-13T21:00:41.524681] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T21:00:41.574071] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:00:41.967360] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:00:41.972749] [INFO ] [REMOTE ] PNW: Full fetch complete (65649 records). [2025-10-13T21:00:41.972953] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-13T21:00:41.974036] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:41.974130] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:41.974176] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:41.974221] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-13T21:00:41.974285] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-13T21:00:41.974321] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-13T21:00:41.974361] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-13T21:00:41.974424] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNW took 33.2s. Estimated remaining: 1h 32m 26s. Rate: 7.1 symbols/min [2025-10-13T21:00:42.023058] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-13T21:00:42.164454] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:42.164718] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-13T21:00:42.164789] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-13T21:00:42.164925] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-13T21:00:42.164968] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-13T21:00:42.165010] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-13T21:00:42.165044] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-13T21:00:42.534802] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:42.818015] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-13T21:00:43.617926] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-13T21:00:43.920552] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T21:00:44.417999] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-13T21:00:44.728549] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T21:00:45.218007] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-13T21:00:45.475181] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T21:00:46.017947] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-13T21:00:46.183860] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T21:00:46.818040] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-13T21:00:46.817928] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T21:00:47.617911] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-13T21:00:47.858970] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T21:00:48.417891] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-13T21:00:48.465172] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:00:48.853772] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:00:48.873792] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T21:00:48.878211] [INFO ] [REMOTE ] POR: Full fetch complete (68005 records). [2025-10-13T21:00:48.878332] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-13T21:00:48.879765] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:48.880039] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:48.880113] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:48.880198] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-13T21:00:48.880304] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-13T21:00:48.880372] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-13T21:00:48.880429] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-13T21:00:48.880519] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. POR took 35.7s. Estimated remaining: 1h 32m 17s. Rate: 7.1 symbols/min [2025-10-13T21:00:49.078277] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:49.103250] [DEBUG] [LOCAL ] PPT: Loaded 20141 existing records from primary storage. [2025-10-13T21:00:49.103732] [INFO ] [MAIN ] PPT: Loaded 20141 existing records. [2025-10-13T21:00:49.223139] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-13T21:00:49.304463] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:00:49.304975] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-13T21:00:49.305032] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-13T21:00:49.305526] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-13T21:00:49.305595] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-13T21:00:49.715850] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:50.018008] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-13T21:00:50.817937] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-13T21:00:50.864140] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:00:51.617992] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-13T21:00:51.911454] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T21:00:52.417912] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-13T21:00:52.615146] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:00:52.829589] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T21:00:53.218032] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-13T21:00:53.901443] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:00:53.906153] [INFO ] [REMOTE ] POST: Full fetch complete (55097 records). [2025-10-13T21:00:53.906299] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-13T21:00:53.906995] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:53.907082] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:53.907123] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:53.907160] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-13T21:00:53.907215] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-13T21:00:53.907249] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-13T21:00:53.907287] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-13T21:00:53.907342] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POST took 36.3s. Estimated remaining: 1h 32m 7s. Rate: 7.1 symbols/min [2025-10-13T21:00:54.023044] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-13T21:00:54.078730] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:54.079614] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-13T21:00:54.079802] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-13T21:00:54.079912] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-13T21:00:54.079953] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-13T21:00:54.079994] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-13T21:00:54.080025] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-13T21:00:54.444623] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:54.472389] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T21:00:54.817919] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-13T21:00:55.253445] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T21:00:55.555760] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T21:00:55.561114] [INFO ] [REMOTE ] PPG: Full fetch complete (73413 records). [2025-10-13T21:00:55.561259] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-13T21:00:55.562207] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:00:55.562305] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:00:55.562371] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:00:55.562442] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-13T21:00:55.562506] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-13T21:00:55.562541] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-13T21:00:55.562578] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-13T21:00:55.562637] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. PPG took 33.6s. Estimated remaining: 1h 31m 56s. Rate: 7.1 symbols/min [2025-10-13T21:00:55.625410] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-13T21:00:55.770622] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:00:55.770850] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-13T21:00:55.770891] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-13T21:00:55.771028] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-13T21:00:55.771069] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-13T21:00:55.771109] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-13T21:00:55.771140] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-13T21:00:56.126275] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:00:56.418011] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-13T21:00:57.218018] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-13T21:00:57.579923] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T21:00:57.602335] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T21:00:58.017905] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-13T21:00:58.817897] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-13T21:00:59.101713] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T21:00:59.245293] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T21:00:59.617942] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-13T21:00:59.916208] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T21:01:00.417934] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-13T21:01:01.217898] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-13T21:01:01.606960] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T21:01:01.758904] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T21:01:02.017919] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-13T21:01:02.817920] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-13T21:01:03.085617] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T21:01:03.617917] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-13T21:01:03.945858] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T21:01:04.133333] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T21:01:04.417959] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-13T21:01:05.217906] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-13T21:01:05.256693] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:01:06.017914] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-13T21:01:06.264184] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T21:01:06.339283] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T21:01:06.817930] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-13T21:01:07.247538] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T21:01:07.617905] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-13T21:01:08.006092] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T21:01:08.417935] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-13T21:01:09.055860] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T21:01:09.217953] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-13T21:01:10.017924] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-13T21:01:10.326691] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T21:01:10.817892] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-13T21:01:10.856996] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:01:11.172489] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T21:01:11.617994] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-13T21:01:12.418013] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-13T21:01:12.693436] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T21:01:13.217957] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-13T21:01:13.255286] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:01:13.540955] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T21:01:14.017992] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-13T21:01:14.817915] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-13T21:01:15.196207] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T21:01:15.257739] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T21:01:15.618013] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-13T21:01:15.950779] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T21:01:16.418005] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-13T21:01:16.624128] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T21:01:16.626413] [INFO ] [REMOTE ] PPT: Full fetch complete (28657 records). [2025-10-13T21:01:16.626485] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-13T21:01:17.006223] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-13T21:01:17.006606] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T21:01:17.006735] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-13T21:01:17.011592] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-13T21:01:17.011967] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-13T21:01:17.012631] [INFO ] [REMOTE ] PPL: Full fetch complete (77021 records). [2025-10-13T21:01:17.012867] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-13T21:01:17.013336] [DEBUG] [LOCAL ] PPT: Trimmed 28657 records to 19957 (keeping 200 days of data) [2025-10-13T21:01:17.014201] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:01:17.014303] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:01:17.014384] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:01:17.014865] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-13T21:01:17.014969] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-13T21:01:17.015022] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-13T21:01:17.015066] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-13T21:01:17.015126] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPL took 35.0s. Estimated remaining: 1h 31m 53s. Rate: 7.1 symbols/min [2025-10-13T21:01:17.136233] [DEBUG] [LOCAL ] PPT: Primary data saved (19957 records). [2025-10-13T21:01:17.136469] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-13T21:01:17.136558] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPT took 28.3s. Estimated remaining: 1h 31m 41s. Rate: 7.1 symbols/min [2025-10-13T21:01:17.217893] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-13T21:01:18.017941] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-13T21:01:19.152629] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T21:01:19.163757] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-13T21:01:19.596590] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T21:01:19.617879] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-13T21:01:20.942818] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:01:20.949576] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-13T21:01:21.319904] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-13T21:01:21.331250] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-13T21:01:21.928429] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T21:01:22.017891] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-13T21:01:22.638030] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T21:01:22.641929] [INFO ] [REMOTE ] PRA: Full fetch complete (44202 records). [2025-10-13T21:01:22.642089] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-13T21:01:22.642707] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:01:22.642833] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:01:22.642877] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:01:22.642915] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-13T21:01:22.642990] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-13T21:01:22.643025] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-13T21:01:22.643064] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-13T21:01:22.643126] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PRA took 27.1s. Estimated remaining: 1h 31m 32s. Rate: 7.1 symbols/min [2025-10-13T21:01:23.320815] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:01:23.332556] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-13T21:01:25.269024] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T21:01:25.280490] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-13T21:01:27.381473] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T21:01:27.397315] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-13T21:01:29.485024] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T21:01:29.497583] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-13T21:01:31.511778] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T21:01:31.523414] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-13T21:01:32.206418] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:01:32.212136] [INFO ] [REMOTE ] PR: Full fetch complete (77207 records). [2025-10-13T21:01:32.212343] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-13T21:01:32.213358] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:01:32.213456] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:01:32.213500] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:01:32.213562] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-13T21:01:32.213681] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-13T21:01:32.213760] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-13T21:01:32.213812] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-13T21:01:32.213937] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PR took 38.3s. Estimated remaining: 1h 31m 24s. Rate: 7.1 symbols/min [2025-10-13T21:01:32.779781] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:32.856895] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:32.922420] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:32.923731] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:32.925561] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-13T21:01:32.924223] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-13T21:01:32.925935] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-13T21:01:32.926134] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-13T21:01:32.925839] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-13T21:01:32.929890] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-13T21:01:32.930094] [DEBUG] [LOCAL ] PRH: Loaded 4848 existing records from primary storage. [2025-10-13T21:01:32.930399] [INFO ] [MAIN ] PRH: Loaded 4848 existing records. [2025-10-13T21:01:32.935827] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-13T21:01:32.943671] [DEBUG] [LOCAL ] PRCS: Loaded 2790 existing records from primary storage. [2025-10-13T21:01:32.943767] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-13T21:01:32.953614] [INFO ] [MAIN ] PRCS: Loaded 2790 existing records. [2025-10-13T21:01:32.967441] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-13T21:01:32.953449] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-13T21:01:33.060616] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-13T21:01:33.107041] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-13T21:01:33.484461] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:01:33.658127] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:01:33.712190] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-13T21:01:33.729687] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-13T21:01:33.734946] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-13T21:01:33.728140] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-13T21:01:33.791068] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-13T21:01:33.873606] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-13T21:01:33.873800] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-13T21:01:33.865176] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-13T21:01:34.197293] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:34.253960] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:34.291175] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-13T21:01:34.291396] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-13T21:01:34.863289] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:34.878383] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-13T21:01:34.877997] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:34.879727] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-13T21:01:35.581260] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T21:01:35.583273] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-13T21:01:35.705997] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T21:01:35.723501] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-13T21:01:35.725547] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:01:35.732129] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-13T21:01:36.296547] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T21:01:36.297779] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-13T21:01:36.306609] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T21:01:36.308783] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-13T21:01:36.720324] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-13T21:01:36.732164] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-13T21:01:36.920194] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T21:01:36.921458] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-13T21:01:36.956046] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T21:01:36.962143] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-13T21:01:37.099103] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T21:01:37.102448] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-13T21:01:37.302051] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-13T21:01:37.303372] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-13T21:01:37.786618] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T21:01:37.908985] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T21:01:38.017925] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-13T21:01:38.316555] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T21:01:38.506469] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T21:01:38.506146] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T21:01:38.817928] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-13T21:01:39.422778] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T21:01:39.618018] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-13T21:01:40.418018] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-13T21:01:41.219084] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-13T21:01:41.220050] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T21:01:41.539316] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:01:41.803601] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T21:01:42.017955] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-13T21:01:42.818052] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-13T21:01:43.461348] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:01:43.462141] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T21:01:43.617940] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-13T21:01:44.316472] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T21:01:44.417939] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-13T21:01:45.108848] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T21:01:45.217956] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-13T21:01:45.808363] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T21:01:46.017942] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-13T21:01:46.618286] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T21:01:46.817916] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-13T21:01:47.255815] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T21:01:47.256625] [INFO ] [REMOTE ] PRCS: Full fetch complete (3862 records). [2025-10-13T21:01:47.256751] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-13T21:01:47.606546] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-13T21:01:47.606630] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-13T21:01:47.606795] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-13T21:01:47.606844] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-13T21:01:47.607202] [DEBUG] [LOCAL ] PRCS: Trimmed 3862 records to 2774 (keeping 200 days of data) [2025-10-13T21:01:47.619534] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-13T21:01:47.624210] [DEBUG] [LOCAL ] PRCS: Primary data saved (2774 records). [2025-10-13T21:01:47.625091] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-13T21:01:47.625195] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 15.4s. Estimated remaining: 1h 31m 18s. Rate: 7.1 symbols/min [2025-10-13T21:01:47.804050] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:47.804274] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-13T21:01:47.804314] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-13T21:01:47.804433] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-13T21:01:47.804475] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-13T21:01:47.804518] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-13T21:01:47.804551] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-13T21:01:48.163129] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:48.418015] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-13T21:01:49.217931] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-13T21:01:49.397113] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T21:01:49.931011] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:01:50.017893] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-13T21:01:50.041568] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T21:01:50.818013] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-13T21:01:51.350051] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T21:01:51.617895] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-13T21:01:51.804934] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T21:01:52.156188] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T21:01:52.157200] [INFO ] [REMOTE ] PRH: Full fetch complete (7499 records). [2025-10-13T21:01:52.157269] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-13T21:01:52.423066] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-13T21:01:52.559946] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-13T21:01:52.560026] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-13T21:01:52.560246] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-13T21:01:52.560287] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-13T21:01:52.560759] [DEBUG] [LOCAL ] PRH: Trimmed 7499 records to 4777 (keeping 200 days of data) [2025-10-13T21:01:52.590486] [DEBUG] [LOCAL ] PRH: Primary data saved (4777 records). [2025-10-13T21:01:52.590613] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-13T21:01:52.590722] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRH took 20.4s. Estimated remaining: 1h 31m 8s. Rate: 7.1 symbols/min [2025-10-13T21:01:52.759831] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:01:52.760021] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-13T21:01:52.760060] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-13T21:01:52.760171] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-13T21:01:52.760215] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-13T21:01:52.760305] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-13T21:01:52.760346] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-13T21:01:53.122571] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:01:53.217905] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-13T21:01:53.558124] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T21:01:54.017999] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-13T21:01:54.817915] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-13T21:01:55.009677] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:01:55.390814] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T21:01:55.617904] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-13T21:01:56.118167] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T21:01:56.417927] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-13T21:01:57.217927] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-13T21:01:57.362631] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T21:01:58.017901] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-13T21:01:58.051405] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:01:58.330553] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T21:01:58.817998] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-13T21:01:59.362540] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T21:01:59.617934] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-13T21:01:59.945228] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T21:02:00.418055] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-13T21:02:01.217946] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-13T21:02:01.357091] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:02:02.016944] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T21:02:02.023724] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-13T21:02:02.626974] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T21:02:02.817935] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-13T21:02:03.618004] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-13T21:02:03.867882] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T21:02:04.067322] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T21:02:04.417902] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-13T21:02:04.722054] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T21:02:05.217901] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-13T21:02:06.017952] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-13T21:02:06.187075] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T21:02:06.238098] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T21:02:06.817987] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-13T21:02:07.389545] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T21:02:07.524608] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:02:07.529781] [INFO ] [REMOTE ] PRGO: Full fetch complete (68258 records). [2025-10-13T21:02:07.529933] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-13T21:02:07.532001] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:07.532117] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:07.532159] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:07.532197] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-13T21:02:07.532252] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-13T21:02:07.532287] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-13T21:02:07.532325] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-13T21:02:07.532383] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRGO took 35.3s. Estimated remaining: 1h 31m 2s. Rate: 7.1 symbols/min [2025-10-13T21:02:07.623088] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-13T21:02:07.705832] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:07.706009] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-13T21:02:07.706045] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-13T21:02:07.706158] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-13T21:02:07.706198] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-13T21:02:07.706237] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-13T21:02:07.706268] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-13T21:02:08.060252] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:08.417930] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-13T21:02:08.879894] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T21:02:09.217982] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-13T21:02:09.943776] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T21:02:10.017893] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-13T21:02:10.349992] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T21:02:10.817952] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-13T21:02:11.433078] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T21:02:11.436439] [INFO ] [REMOTE ] PRG: Full fetch complete (44008 records). [2025-10-13T21:02:11.436535] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-13T21:02:11.437204] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:11.437294] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:11.437336] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:11.437375] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-13T21:02:11.437429] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-13T21:02:11.437463] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-13T21:02:11.437502] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-13T21:02:11.437558] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRG took 39.2s. Estimated remaining: 1h 30m 52s. Rate: 7.1 symbols/min [2025-10-13T21:02:11.638086] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-13T21:02:11.641343] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:11.641677] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-13T21:02:11.642602] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-13T21:02:11.642829] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-13T21:02:11.643202] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-13T21:02:11.643263] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-13T21:02:11.643541] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-13T21:02:11.766052] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T21:02:12.049491] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:12.418003] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-13T21:02:12.820689] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T21:02:13.217981] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-13T21:02:13.744883] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T21:02:13.746998] [INFO ] [REMOTE ] PRI: Full fetch complete (25389 records). [2025-10-13T21:02:13.747083] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-13T21:02:13.747611] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:13.747730] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:13.747949] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:13.748111] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-13T21:02:13.748176] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-13T21:02:13.748212] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-13T21:02:13.748250] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-13T21:02:13.748355] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRI took 26.1s. Estimated remaining: 1h 30m 41s. Rate: 7.1 symbols/min [2025-10-13T21:02:13.930691] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:13.930918] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-13T21:02:13.930977] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-13T21:02:13.931147] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-13T21:02:13.931192] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-13T21:02:13.931233] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-13T21:02:13.931266] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-13T21:02:14.023018] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-13T21:02:14.273505] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T21:02:14.336351] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:14.818062] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-13T21:02:15.265361] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T21:02:15.617922] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-13T21:02:16.376026] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T21:02:16.417993] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-13T21:02:17.217936] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-13T21:02:17.257817] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T21:02:18.017907] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-13T21:02:18.055046] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T21:02:18.344300] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T21:02:18.818006] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-13T21:02:19.617993] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-13T21:02:19.791122] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:02:20.417929] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-13T21:02:20.543288] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T21:02:21.217908] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-13T21:02:21.280506] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T21:02:21.590934] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T21:02:22.017924] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-13T21:02:22.817946] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-13T21:02:22.996521] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T21:02:23.617950] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-13T21:02:23.654051] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:02:24.417956] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-13T21:02:24.513411] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T21:02:25.169453] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:02:25.217890] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-13T21:02:25.629811] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T21:02:26.017931] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-13T21:02:26.823000] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-13T21:02:26.847454] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:02:27.223037] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T21:02:27.617921] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-13T21:02:28.369622] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T21:02:28.417889] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-13T21:02:29.218016] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-13T21:02:29.314500] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T21:02:30.017935] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-13T21:02:30.223017] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T21:02:30.790507] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T21:02:30.817892] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-13T21:02:30.927734] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T21:02:31.617924] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-13T21:02:32.417911] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-13T21:02:32.472763] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T21:02:32.770038] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T21:02:33.218011] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-13T21:02:34.017905] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-13T21:02:34.127704] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:02:34.819637] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-13T21:02:34.823835] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T21:02:35.143404] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T21:02:35.617988] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-13T21:02:36.385511] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T21:02:36.417908] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-13T21:02:36.799152] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T21:02:37.187204] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:02:37.192777] [INFO ] [REMOTE ] PRKS: Full fetch complete (61204 records). [2025-10-13T21:02:37.192988] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-13T21:02:37.194081] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:37.194202] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:37.194257] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:37.194307] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-13T21:02:37.194368] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-13T21:02:37.194415] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-13T21:02:37.194468] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-13T21:02:37.194543] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRKS took 29.7s. Estimated remaining: 1h 30m 39s. Rate: 7.1 symbols/min [2025-10-13T21:02:37.223066] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-13T21:02:37.442957] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:37.443152] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-13T21:02:37.443195] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-13T21:02:37.443327] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-13T21:02:37.443374] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-13T21:02:37.443421] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-13T21:02:37.443458] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-13T21:02:37.907680] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:38.017922] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-13T21:02:38.466056] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:02:38.818008] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-13T21:02:39.617905] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-13T21:02:39.757614] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T21:02:40.417912] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-13T21:02:40.657602] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T21:02:41.044422] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T21:02:41.217940] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-13T21:02:42.017931] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-13T21:02:42.119204] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T21:02:42.817988] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-13T21:02:43.014389] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T21:02:43.085216] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T21:02:43.618004] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-13T21:02:44.059722] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T21:02:44.061707] [INFO ] [REMOTE ] PRLB: Full fetch complete (30062 records). [2025-10-13T21:02:44.061804] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-13T21:02:44.062453] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:44.062542] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:44.062586] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:44.062624] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-13T21:02:44.062720] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-13T21:02:44.062767] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-13T21:02:44.062810] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-13T21:02:44.062867] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRLB took 32.6s. Estimated remaining: 1h 30m 30s. Rate: 7.1 symbols/min [2025-10-13T21:02:44.247207] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:44.247515] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-13T21:02:44.247584] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-13T21:02:44.247812] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-13T21:02:44.248004] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-13T21:02:44.248150] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-13T21:02:44.248223] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-13T21:02:44.422867] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-13T21:02:44.583424] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T21:02:44.669470] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:45.217920] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-13T21:02:46.017937] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-13T21:02:46.161564] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T21:02:46.734405] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T21:02:46.817882] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-13T21:02:47.517689] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T21:02:47.617945] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-13T21:02:48.135688] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T21:02:48.417936] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-13T21:02:49.218023] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-13T21:02:49.323108] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:02:49.785622] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T21:02:49.868936] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:02:49.873549] [INFO ] [REMOTE ] PRIM: Full fetch complete (63196 records). [2025-10-13T21:02:49.873717] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-13T21:02:49.874790] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:49.874895] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:49.874941] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:49.874987] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-13T21:02:49.875055] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-13T21:02:49.875094] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-13T21:02:49.875136] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-13T21:02:49.875258] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 57.3s. Estimated remaining: 1h 30m 20s. Rate: 7.1 symbols/min [2025-10-13T21:02:50.025517] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-13T21:02:50.060791] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:50.061039] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-13T21:02:50.061078] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-13T21:02:50.061200] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-13T21:02:50.061255] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-13T21:02:50.061560] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-13T21:02:50.061622] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-13T21:02:50.449051] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:50.817953] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-13T21:02:51.593195] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T21:02:51.617908] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-13T21:02:52.418111] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-13T21:02:52.658526] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:02:52.731182] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T21:02:52.782119] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:02:52.782579] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-13T21:02:52.782705] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:02:52.782761] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-13T21:02:52.782797] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:02:52.782868] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-13T21:02:52.782938] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-13T21:02:52.782978] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-13T21:02:52.783020] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-13T21:02:52.783074] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRSU took 2.9s. Estimated remaining: 1h 30m 10s. Rate: 7.1 symbols/min [2025-10-13T21:02:52.959051] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:52.968016] [DEBUG] [LOCAL ] PRT: Loaded 5280 existing records from primary storage. [2025-10-13T21:02:52.968342] [INFO ] [MAIN ] PRT: Loaded 5280 existing records. [2025-10-13T21:02:53.154900] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:02:53.155182] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-13T21:02:53.155233] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-13T21:02:53.155496] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-13T21:02:53.155553] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-13T21:02:53.223140] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-13T21:02:53.545307] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:53.977935] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:02:53.984550] [INFO ] [REMOTE ] PRM: Full fetch complete (64095 records). [2025-10-13T21:02:53.984792] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-13T21:02:53.985985] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:02:53.986086] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:02:53.986133] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:02:53.986204] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-13T21:02:53.986280] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-13T21:02:53.986320] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-13T21:02:53.986362] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-13T21:02:53.986433] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRM took 40.2s. Estimated remaining: 1h 29m 59s. Rate: 7.1 symbols/min [2025-10-13T21:02:54.023079] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-13T21:02:54.208297] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:02:54.208594] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-13T21:02:54.208679] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-13T21:02:54.208812] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-13T21:02:54.208857] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-13T21:02:54.208900] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-13T21:02:54.208934] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-13T21:02:54.601797] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:02:54.818028] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-13T21:02:55.618027] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-13T21:02:55.663881] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T21:02:56.084685] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T21:02:56.418035] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-13T21:02:57.054888] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T21:02:57.217932] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-13T21:02:57.257538] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T21:02:58.018012] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-13T21:02:58.817996] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-13T21:02:58.974055] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T21:02:59.617900] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-13T21:03:00.028676] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T21:03:00.068779] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T21:03:00.418019] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-13T21:03:01.217921] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-13T21:03:01.379810] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T21:03:01.692759] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T21:03:02.018001] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-13T21:03:02.061082] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T21:03:02.817991] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-13T21:03:03.617913] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-13T21:03:03.924719] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T21:03:04.328864] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T21:03:04.418036] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-13T21:03:05.185209] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:03:05.217933] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-13T21:03:05.399901] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T21:03:06.018025] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-13T21:03:06.817920] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-13T21:03:07.282970] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T21:03:07.597534] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T21:03:07.617889] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-13T21:03:08.404014] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:03:08.417878] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-13T21:03:09.223070] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-13T21:03:09.234236] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T21:03:10.017917] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-13T21:03:10.417223] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T21:03:10.645425] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:03:10.649929] [INFO ] [REMOTE ] PRO: Full fetch complete (52586 records). [2025-10-13T21:03:10.650020] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-13T21:03:10.650625] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:03:10.650733] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:03:10.650777] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:03:10.650815] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-13T21:03:10.651066] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-13T21:03:10.651287] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-13T21:03:10.651337] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-13T21:03:10.651454] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRO took 26.6s. Estimated remaining: 1h 29m 53s. Rate: 7.1 symbols/min [2025-10-13T21:03:10.823195] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-13T21:03:10.828285] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:10.829766] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-13T21:03:10.829987] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-13T21:03:10.830145] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-13T21:03:10.830198] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-13T21:03:10.830243] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-13T21:03:10.830275] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-13T21:03:11.208415] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:11.248479] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T21:03:11.617942] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-13T21:03:12.417993] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-13T21:03:12.837690] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T21:03:13.064334] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T21:03:13.205539] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:03:13.217894] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-13T21:03:14.017918] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-13T21:03:14.053437] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T21:03:14.775987] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T21:03:14.780942] [INFO ] [REMOTE ] PRMB: Full fetch complete (75675 records). [2025-10-13T21:03:14.781062] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-13T21:03:14.781863] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:03:14.781948] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:03:14.781991] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:03:14.782034] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-13T21:03:14.782089] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-13T21:03:14.782123] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-13T21:03:14.782161] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-13T21:03:14.782215] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRMB took 37.6s. Estimated remaining: 1h 29m 43s. Rate: 7.1 symbols/min [2025-10-13T21:03:14.823164] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-13T21:03:14.955725] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:14.955921] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-13T21:03:14.955961] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-13T21:03:14.956076] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-13T21:03:14.956118] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-13T21:03:14.956159] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-13T21:03:14.956190] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-13T21:03:15.362315] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:15.557948] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T21:03:15.617944] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-13T21:03:16.417947] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-13T21:03:17.152469] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T21:03:17.217945] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-13T21:03:17.487395] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T21:03:17.655429] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T21:03:18.017911] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-13T21:03:18.740084] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T21:03:18.817932] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-13T21:03:19.617944] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-13T21:03:20.418022] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-13T21:03:20.681018] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T21:03:20.935466] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T21:03:21.201898] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:03:21.217903] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-13T21:03:22.017946] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-13T21:03:22.495177] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T21:03:22.817930] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-13T21:03:22.844228] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:03:23.613603] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T21:03:23.617875] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-13T21:03:24.417990] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-13T21:03:24.787565] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T21:03:24.788904] [INFO ] [REMOTE ] PRT: Full fetch complete (8818 records). [2025-10-13T21:03:24.788977] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-13T21:03:25.203559] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-13T21:03:25.203675] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-13T21:03:25.203947] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-13T21:03:25.203993] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-13T21:03:25.204434] [DEBUG] [LOCAL ] PRT: Trimmed 8818 records to 5172 (keeping 200 days of data) [2025-10-13T21:03:25.220867] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-13T21:03:25.240429] [DEBUG] [LOCAL ] PRT: Primary data saved (5172 records). [2025-10-13T21:03:25.240590] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-13T21:03:25.240706] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 32.5s. Estimated remaining: 1h 29m 36s. Rate: 7.1 symbols/min [2025-10-13T21:03:25.424406] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:25.435490] [DEBUG] [LOCAL ] PSBD: Loaded 7654 existing records from primary storage. [2025-10-13T21:03:25.435757] [INFO ] [MAIN ] PSBD: Loaded 7654 existing records. [2025-10-13T21:03:25.607791] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:03:25.608043] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-13T21:03:25.608098] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-13T21:03:25.608328] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-13T21:03:25.608385] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-13T21:03:25.850426] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T21:03:25.969756] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:26.017908] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-13T21:03:26.195283] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T21:03:26.680740] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-13T21:03:26.817905] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-13T21:03:27.617923] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-13T21:03:27.648572] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T21:03:28.417982] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-13T21:03:29.098223] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T21:03:29.100378] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:03:29.217993] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-13T21:03:30.018068] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-13T21:03:30.695535] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T21:03:30.817935] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-13T21:03:30.935381] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T21:03:31.599335] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T21:03:31.604291] [INFO ] [REMOTE ] PRU: Full fetch complete (73793 records). [2025-10-13T21:03:31.604421] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-13T21:03:31.606823] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:03:31.607073] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:03:31.607123] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:03:31.607196] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-13T21:03:31.607275] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-13T21:03:31.607313] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-13T21:03:31.607353] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-13T21:03:31.607427] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRU took 37.6s. Estimated remaining: 1h 29m 26s. Rate: 7.1 symbols/min [2025-10-13T21:03:31.623182] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-13T21:03:31.788692] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:31.800320] [DEBUG] [LOCAL ] PSF: Loaded 7034 existing records from primary storage. [2025-10-13T21:03:31.800634] [INFO ] [MAIN ] PSF: Loaded 7034 existing records. [2025-10-13T21:03:31.986589] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:03:31.986904] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-13T21:03:31.986953] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-13T21:03:31.987287] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-13T21:03:31.987348] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-13T21:03:32.352263] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:32.417919] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-13T21:03:32.519185] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T21:03:33.217932] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-13T21:03:33.292005] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T21:03:33.544892] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T21:03:34.017991] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-13T21:03:34.817947] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-13T21:03:34.920620] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T21:03:35.617926] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-13T21:03:36.340618] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T21:03:36.417997] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-13T21:03:36.558814] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:03:37.181941] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T21:03:37.217995] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-13T21:03:38.018020] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-13T21:03:38.045731] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T21:03:38.444718] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:03:38.817946] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-13T21:03:39.618008] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-13T21:03:39.671167] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T21:03:40.021224] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-13T21:03:40.417992] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-13T21:03:40.832377] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T21:03:41.217991] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-13T21:03:41.946922] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T21:03:42.017942] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-13T21:03:42.445850] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T21:03:42.818023] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-13T21:03:43.617916] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-13T21:03:43.699357] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T21:03:43.701605] [INFO ] [REMOTE ] PSBD: Full fetch complete (10247 records). [2025-10-13T21:03:43.701723] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-13T21:03:44.079597] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-13T21:03:44.079736] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-13T21:03:44.080202] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-13T21:03:44.080246] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-13T21:03:44.080769] [DEBUG] [LOCAL ] PSBD: Trimmed 10247 records to 7776 (keeping 200 days of data) [2025-10-13T21:03:44.131597] [DEBUG] [LOCAL ] PSBD: Primary data saved (7776 records). [2025-10-13T21:03:44.131793] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-13T21:03:44.131895] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PSBD took 18.9s. Estimated remaining: 1h 29m 20s. Rate: 7.1 symbols/min [2025-10-13T21:03:44.305766] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:44.306011] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-13T21:03:44.306049] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-13T21:03:44.306168] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-13T21:03:44.306210] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-13T21:03:44.306249] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-13T21:03:44.306283] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-13T21:03:44.423104] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-13T21:03:44.684193] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:44.982784] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T21:03:45.218018] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-13T21:03:45.381473] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T21:03:46.018025] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-13T21:03:46.642793] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T21:03:46.643994] [INFO ] [REMOTE ] PRVS: Full fetch complete (1255 records). [2025-10-13T21:03:46.644327] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-13T21:03:46.681388] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T21:03:46.820263] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-13T21:03:46.893532] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-13T21:03:46.893782] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:03:46.893851] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:03:46.893925] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-13T21:03:46.893997] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-13T21:03:46.894035] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-13T21:03:46.894073] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-13T21:03:46.894133] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRVS took 36.2s. Estimated remaining: 1h 29m 9s. Rate: 7.1 symbols/min [2025-10-13T21:03:47.077634] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:03:47.077894] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-13T21:03:47.077935] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-13T21:03:47.078088] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-13T21:03:47.078130] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-13T21:03:47.078178] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-13T21:03:47.078404] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-13T21:03:47.449003] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:03:47.618032] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-13T21:03:48.221418] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T21:03:48.417988] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-13T21:03:49.116989] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T21:03:49.218006] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-13T21:03:49.352374] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T21:03:49.690445] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T21:03:50.018011] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-13T21:03:50.817923] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-13T21:03:51.424465] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:03:51.617979] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-13T21:03:52.272729] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T21:03:52.418006] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-13T21:03:53.212784] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:03:53.217872] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-13T21:03:53.348681] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:03:54.017919] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-13T21:03:54.056263] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T21:03:54.817984] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-13T21:03:55.617929] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-13T21:03:55.675248] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:03:56.417908] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-13T21:03:56.523217] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:03:57.072451] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T21:03:57.218025] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-13T21:03:58.017971] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-13T21:03:58.155377] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T21:03:58.817991] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-13T21:03:58.853626] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:03:59.617984] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-13T21:03:59.760207] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:04:00.417915] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-13T21:04:00.666126] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T21:04:01.094507] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:04:01.217946] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-13T21:04:01.943323] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T21:04:02.018003] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-13T21:04:02.077707] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:04:02.818017] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-13T21:04:03.608302] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T21:04:03.617884] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-13T21:04:03.781177] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T21:04:04.163051] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T21:04:04.417949] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-13T21:04:05.217944] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-13T21:04:05.992723] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T21:04:06.017982] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-13T21:04:06.817991] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-13T21:04:06.951965] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T21:04:07.427134] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T21:04:07.499158] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T21:04:07.617983] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-13T21:04:08.417980] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-13T21:04:08.900962] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T21:04:09.089313] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T21:04:09.091092] [INFO ] [REMOTE ] PSF: Full fetch complete (9735 records). [2025-10-13T21:04:09.091225] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-13T21:04:09.223026] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-13T21:04:09.506662] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-13T21:04:09.506790] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-13T21:04:09.507159] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-13T21:04:09.507210] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-13T21:04:09.508185] [DEBUG] [LOCAL ] PSF: Trimmed 9735 records to 6960 (keeping 200 days of data) [2025-10-13T21:04:09.568898] [DEBUG] [LOCAL ] PSF: Primary data saved (6960 records). [2025-10-13T21:04:09.569052] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-13T21:04:09.569151] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSF took 38.0s. Estimated remaining: 1h 29m 6s. Rate: 7.1 symbols/min [2025-10-13T21:04:09.745017] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:09.745195] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-13T21:04:09.745233] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-13T21:04:09.745348] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-13T21:04:09.745390] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-13T21:04:09.745432] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-13T21:04:09.745467] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-13T21:04:10.027861] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-13T21:04:10.113908] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:10.738831] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:04:10.742277] [INFO ] [REMOTE ] PSFE: Full fetch complete (42866 records). [2025-10-13T21:04:10.742387] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-13T21:04:10.743212] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:10.743303] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:10.743347] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:10.743389] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-13T21:04:10.743452] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-13T21:04:10.743493] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-13T21:04:10.743533] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-13T21:04:10.743593] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSFE took 26.6s. Estimated remaining: 1h 28m 55s. Rate: 7.1 symbols/min [2025-10-13T21:04:10.819422] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-13T21:04:10.947465] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:10.986997] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T21:04:11.034961] [DEBUG] [LOCAL ] PSQH: Loaded 35671 existing records from primary storage. [2025-10-13T21:04:11.035363] [INFO ] [MAIN ] PSQH: Loaded 35671 existing records. [2025-10-13T21:04:11.226037] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:04:11.226358] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-13T21:04:11.226426] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-13T21:04:11.226935] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-13T21:04:11.226996] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-13T21:04:11.610011] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:11.617905] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-13T21:04:12.417903] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-13T21:04:12.546850] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T21:04:13.217940] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-13T21:04:13.747381] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T21:04:13.850858] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-13T21:04:14.017980] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-13T21:04:14.817927] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-13T21:04:14.950260] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T21:04:15.115895] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T21:04:15.617937] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-13T21:04:16.296139] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:04:16.304501] [INFO ] [REMOTE ] PSA: Full fetch complete (58867 records). [2025-10-13T21:04:16.304713] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-13T21:04:16.306893] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:16.306990] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:16.307035] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:16.307077] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-13T21:04:16.307135] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-13T21:04:16.307173] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-13T21:04:16.307216] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-13T21:04:16.307313] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 1m 2s. Estimated remaining: 1h 28m 45s. Rate: 7.1 symbols/min [2025-10-13T21:04:16.423022] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-13T21:04:16.491270] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:16.491862] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-13T21:04:16.491936] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-13T21:04:16.492212] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-13T21:04:16.492284] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-13T21:04:16.492350] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-13T21:04:16.492412] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-13T21:04:16.778811] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T21:04:16.905117] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:17.217947] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-13T21:04:17.886414] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:04:18.017990] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-13T21:04:18.817921] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-13T21:04:18.871273] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:04:19.614982] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T21:04:19.623782] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-13T21:04:20.417933] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-13T21:04:20.820981] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T21:04:21.217906] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-13T21:04:21.267040] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:04:22.017926] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-13T21:04:22.425160] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T21:04:22.780502] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T21:04:22.788781] [INFO ] [REMOTE ] PSN: Full fetch complete (66634 records). [2025-10-13T21:04:22.789262] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-13T21:04:22.790638] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:22.790869] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:22.790945] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:22.791053] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-13T21:04:22.791162] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-13T21:04:22.791255] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-13T21:04:22.791341] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-13T21:04:22.791444] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSN took 35.9s. Estimated remaining: 1h 28m 36s. Rate: 7.1 symbols/min [2025-10-13T21:04:22.822746] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-13T21:04:23.041112] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:23.069139] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-13T21:04:23.070063] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-13T21:04:23.071953] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-13T21:04:23.072025] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-13T21:04:23.072078] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-13T21:04:23.072115] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-13T21:04:23.071634] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:04:23.615043] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:23.617883] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-13T21:04:24.417982] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-13T21:04:24.679202] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T21:04:24.863440] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T21:04:25.217999] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-13T21:04:25.995333] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T21:04:26.017886] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-13T21:04:26.295953] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T21:04:26.817991] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-13T21:04:27.506131] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T21:04:27.617985] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-13T21:04:28.417980] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-13T21:04:28.459134] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:04:28.802459] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T21:04:29.218041] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-13T21:04:30.017917] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-13T21:04:30.362579] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T21:04:30.801485] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:04:30.817950] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-13T21:04:31.499510] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:04:31.617986] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-13T21:04:32.417895] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-13T21:04:32.784003] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T21:04:32.899930] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T21:04:33.218015] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-13T21:04:33.917870] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T21:04:34.018061] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-13T21:04:34.818012] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-13T21:04:35.078536] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:04:35.198447] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T21:04:35.618025] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-13T21:04:36.417999] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-13T21:04:36.456582] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T21:04:37.112410] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:04:37.218022] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-13T21:04:38.017996] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-13T21:04:38.357667] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T21:04:38.817913] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-13T21:04:39.113555] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T21:04:39.199786] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T21:04:39.617974] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-13T21:04:40.418056] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-13T21:04:40.472350] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T21:04:41.105480] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:04:41.217974] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-13T21:04:41.577895] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:04:42.017943] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-13T21:04:42.817931] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-13T21:04:43.205510] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T21:04:43.537099] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T21:04:43.617949] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-13T21:04:44.267887] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:04:44.272327] [INFO ] [REMOTE ] PSO: Full fetch complete (51921 records). [2025-10-13T21:04:44.272477] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-13T21:04:44.273531] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:44.273677] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:44.273759] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:44.273832] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-13T21:04:44.273918] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-13T21:04:44.273957] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-13T21:04:44.273996] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-13T21:04:44.274110] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSO took 34.7s. Estimated remaining: 1h 28m 32s. Rate: 7.1 symbols/min [2025-10-13T21:04:44.431581] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-13T21:04:44.467770] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:44.469692] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-13T21:04:44.469856] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-13T21:04:44.470202] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-13T21:04:44.470417] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-13T21:04:44.470491] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-13T21:04:44.470530] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-13T21:04:44.591309] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T21:04:44.623120] [INFO ] [REMOTE ] PSQH: Full fetch complete (53473 records). [2025-10-13T21:04:44.648361] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-13T21:04:45.158138] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:45.223105] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-13T21:04:45.288543] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-13T21:04:45.288633] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-13T21:04:45.289842] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-13T21:04:45.289907] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-13T21:04:45.291936] [DEBUG] [LOCAL ] PSQH: Trimmed 53473 records to 35345 (keeping 200 days of data) [2025-10-13T21:04:45.508256] [DEBUG] [LOCAL ] PSQH: Primary data saved (35345 records). [2025-10-13T21:04:45.508452] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-13T21:04:45.508562] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSQH took 34.8s. Estimated remaining: 1h 28m 21s. Rate: 7.1 symbols/min [2025-10-13T21:04:45.687207] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:45.687439] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-13T21:04:45.687478] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-13T21:04:45.687634] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-13T21:04:45.687716] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-13T21:04:45.687766] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-13T21:04:45.687799] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-13T21:04:46.023544] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-13T21:04:46.057361] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:46.448381] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T21:04:46.572255] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-13T21:04:46.817992] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-13T21:04:47.617908] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-13T21:04:47.753046] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T21:04:48.096121] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T21:04:48.417986] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-13T21:04:48.460936] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T21:04:49.217948] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-13T21:04:50.017936] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-13T21:04:50.298823] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T21:04:50.359564] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T21:04:50.817944] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-13T21:04:51.617939] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-13T21:04:52.062672] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T21:04:52.417904] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-13T21:04:52.614801] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T21:04:52.727016] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:04:53.107417] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T21:04:53.217943] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-13T21:04:54.017918] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-13T21:04:54.327208] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T21:04:54.817974] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-13T21:04:55.617917] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-13T21:04:55.920621] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T21:04:56.037196] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T21:04:56.064539] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T21:04:56.070334] [INFO ] [REMOTE ] PSTG: Full fetch complete (76156 records). [2025-10-13T21:04:56.070509] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-13T21:04:56.071616] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:56.071735] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:56.071782] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:56.071828] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-13T21:04:56.071897] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-13T21:04:56.071939] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-13T21:04:56.071981] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-13T21:04:56.072047] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSTG took 39.8s. Estimated remaining: 1h 28m 14s. Rate: 7.1 symbols/min [2025-10-13T21:04:56.257000] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:56.257225] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-13T21:04:56.257265] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-13T21:04:56.257403] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-13T21:04:56.257448] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-13T21:04:56.257520] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-13T21:04:56.257558] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-13T21:04:56.431867] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-13T21:04:56.625182] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:57.217985] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-13T21:04:58.018019] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-13T21:04:58.552051] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T21:04:58.645590] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:04:58.648204] [INFO ] [REMOTE ] PSTL: Full fetch complete (29431 records). [2025-10-13T21:04:58.648286] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-13T21:04:58.649028] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:04:58.649118] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:04:58.649161] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:04:58.649204] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-13T21:04:58.649292] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-13T21:04:58.649348] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-13T21:04:58.649417] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-13T21:04:58.649519] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTL took 35.9s. Estimated remaining: 1h 28m 3s. Rate: 7.1 symbols/min [2025-10-13T21:04:58.825038] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-13T21:04:58.829449] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:04:58.831064] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-13T21:04:58.831328] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-13T21:04:58.831478] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-13T21:04:58.840213] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-13T21:04:58.851134] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-13T21:04:58.854092] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-13T21:04:58.902124] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:04:59.224108] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:04:59.617949] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-13T21:04:59.796998] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:05:00.417946] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-13T21:05:01.218398] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-13T21:05:01.402236] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T21:05:01.480331] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T21:05:02.018003] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-13T21:05:02.817978] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-13T21:05:03.102976] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T21:05:03.573098] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-13T21:05:03.617985] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-13T21:05:04.378448] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:05:04.417919] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-13T21:05:05.218056] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-13T21:05:05.577505] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-13T21:05:05.618026] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:05:06.018035] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-13T21:05:06.818026] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-13T21:05:06.993793] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:05:07.439206] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T21:05:07.617948] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-13T21:05:07.873059] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T21:05:08.417943] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-13T21:05:09.217914] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-13T21:05:09.736517] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T21:05:10.017899] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-13T21:05:10.054334] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:05:10.096180] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T21:05:10.817975] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-13T21:05:11.419556] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T21:05:11.422099] [INFO ] [REMOTE ] PTA: Full fetch complete (22606 records). [2025-10-13T21:05:11.422338] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-13T21:05:11.422975] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:05:11.423089] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:05:11.423146] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:05:11.423220] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-13T21:05:11.423292] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-13T21:05:11.423332] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-13T21:05:11.423372] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-13T21:05:11.423432] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PTA took 25.9s. Estimated remaining: 1h 27m 56s. Rate: 7.1 symbols/min [2025-10-13T21:05:11.612039] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:11.612359] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-13T21:05:11.612405] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-13T21:05:11.612540] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-13T21:05:11.612595] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-13T21:05:11.612638] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-13T21:05:11.612723] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-13T21:05:11.624032] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-13T21:05:12.023339] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:12.063751] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T21:05:12.417983] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-13T21:05:13.217940] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-13T21:05:13.482785] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T21:05:13.990927] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T21:05:14.017897] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-13T21:05:14.817948] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-13T21:05:14.984284] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T21:05:15.536124] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T21:05:15.618002] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-13T21:05:16.417938] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-13T21:05:16.837289] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T21:05:17.218002] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-13T21:05:17.361014] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T21:05:17.906060] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T21:05:17.937313] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:05:17.942895] [INFO ] [REMOTE ] PSX: Full fetch complete (76628 records). [2025-10-13T21:05:17.943086] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-13T21:05:17.944191] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:05:17.944293] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:05:17.944338] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:05:17.944383] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-13T21:05:17.944446] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-13T21:05:17.944485] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-13T21:05:17.944526] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-13T21:05:17.944626] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSX took 33.7s. Estimated remaining: 1h 27m 47s. Rate: 7.1 symbols/min [2025-10-13T21:05:18.023139] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-13T21:05:18.142574] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:18.142893] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-13T21:05:18.142957] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-13T21:05:18.143119] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-13T21:05:18.143178] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-13T21:05:18.143244] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-13T21:05:18.143292] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-13T21:05:18.551567] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:18.817986] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-13T21:05:19.617994] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-13T21:05:19.882297] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T21:05:20.418024] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-13T21:05:20.780836] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T21:05:20.811586] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T21:05:21.218085] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-13T21:05:22.017913] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-13T21:05:22.069816] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:05:22.503448] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T21:05:22.817933] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-13T21:05:23.583554] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:05:23.587791] [INFO ] [REMOTE ] PTY: Full fetch complete (53630 records). [2025-10-13T21:05:23.587909] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-13T21:05:23.588522] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:05:23.588609] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:05:23.588683] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:05:23.588758] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-13T21:05:23.588842] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-13T21:05:23.588896] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-13T21:05:23.588940] [DEBUG] [LOCAL ] PTY: No derivative data file found to delete. [2025-10-13T21:05:23.588999] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTY took 27.5s. Estimated remaining: 1h 27m 38s. Rate: 7.1 symbols/min [2025-10-13T21:05:23.620355] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-13T21:05:23.762254] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:23.795410] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:05:23.798201] [DEBUG] [LOCAL ] PVL: Loaded 4749 existing records from primary storage. [2025-10-13T21:05:23.807833] [INFO ] [MAIN ] PVL: Loaded 4749 existing records. [2025-10-13T21:05:23.982102] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:05:23.982343] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-13T21:05:23.982391] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-13T21:05:23.982680] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-13T21:05:23.982738] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-13T21:05:24.335186] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:24.417937] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-13T21:05:25.217982] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-13T21:05:25.295553] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T21:05:25.588032] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T21:05:26.017945] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-13T21:05:26.816018] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T21:05:26.824611] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-13T21:05:27.570720] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T21:05:27.617926] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-13T21:05:28.418049] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-13T21:05:28.592893] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-13T21:05:29.217982] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-13T21:05:29.354199] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T21:05:30.018000] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-13T21:05:30.323892] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T21:05:30.611736] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T21:05:30.817930] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-13T21:05:31.618020] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-13T21:05:31.676703] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T21:05:32.417909] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-13T21:05:32.780751] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T21:05:33.217904] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-13T21:05:33.348950] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T21:05:33.897880] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T21:05:34.017905] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-13T21:05:34.126007] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T21:05:34.817941] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-13T21:05:35.617917] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-13T21:05:35.933545] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T21:05:36.417991] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-13T21:05:36.456476] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:05:37.084970] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T21:05:37.217976] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-13T21:05:37.348368] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T21:05:37.942722] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T21:05:38.017928] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-13T21:05:38.817945] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-13T21:05:39.618032] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-13T21:05:39.944361] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T21:05:40.279385] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T21:05:40.417895] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-13T21:05:40.467058] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T21:05:41.214203] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T21:05:41.217877] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-13T21:05:42.017919] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-13T21:05:42.117572] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T21:05:42.817995] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-13T21:05:43.541378] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T21:05:43.618015] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-13T21:05:43.830231] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T21:05:44.275937] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T21:05:44.418006] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-13T21:05:45.217983] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-13T21:05:45.269897] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T21:05:45.271248] [INFO ] [REMOTE ] PVL: Full fetch complete (7185 records). [2025-10-13T21:05:45.271336] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-13T21:05:45.632672] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-13T21:05:45.632759] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-13T21:05:45.632943] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-13T21:05:45.632980] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-13T21:05:45.633363] [DEBUG] [LOCAL ] PVL: Trimmed 7185 records to 4696 (keeping 200 days of data) [2025-10-13T21:05:45.661251] [DEBUG] [LOCAL ] PVL: Primary data saved (4696 records). [2025-10-13T21:05:45.661381] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-13T21:05:45.661463] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PVL took 22.1s. Estimated remaining: 1h 27m 34s. Rate: 7.1 symbols/min [2025-10-13T21:05:45.829488] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:45.829707] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-13T21:05:45.829758] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-13T21:05:45.829873] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-13T21:05:45.829932] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-13T21:05:45.829974] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-13T21:05:45.830006] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-13T21:05:46.023847] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-13T21:05:46.221739] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:46.817932] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-13T21:05:46.972262] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T21:05:46.976592] [INFO ] [REMOTE ] PUK: Full fetch complete (64820 records). [2025-10-13T21:05:46.976772] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-13T21:05:46.977418] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:05:46.977509] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:05:46.977552] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:05:46.977588] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-13T21:05:46.977669] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-13T21:05:46.977740] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-13T21:05:46.977800] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-13T21:05:46.977860] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUK took 48.3s. Estimated remaining: 1h 27m 23s. Rate: 7.1 symbols/min [2025-10-13T21:05:47.174340] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:47.192519] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-13T21:05:47.192606] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-13T21:05:47.193325] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-13T21:05:47.194766] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T21:05:47.194854] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-13T21:05:47.205311] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-13T21:05:47.205528] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-13T21:05:47.557069] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:47.617917] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-13T21:05:48.426634] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-13T21:05:48.429349] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:05:49.143559] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T21:05:49.217900] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-13T21:05:49.858229] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:05:50.017993] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-13T21:05:50.715511] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T21:05:50.817901] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-13T21:05:51.530863] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:05:51.535160] [INFO ] [REMOTE ] PVH: Full fetch complete (70562 records). [2025-10-13T21:05:51.535260] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-13T21:05:51.536034] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:05:51.536124] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:05:51.536166] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:05:51.536202] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-13T21:05:51.536256] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-13T21:05:51.536289] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-13T21:05:51.536326] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-13T21:05:51.536437] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PVH took 33.6s. Estimated remaining: 1h 27m 13s. Rate: 7.1 symbols/min [2025-10-13T21:05:51.623062] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-13T21:05:51.714438] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:51.714876] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-13T21:05:51.714933] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-13T21:05:51.715038] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-13T21:05:51.715080] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-13T21:05:51.715120] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-13T21:05:51.715153] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-13T21:05:52.094072] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:52.124634] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T21:05:52.417986] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-13T21:05:53.182952] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:05:53.217980] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-13T21:05:54.017936] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-13T21:05:54.325487] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:05:54.620485] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T21:05:54.817948] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-13T21:05:55.147281] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:05:55.147766] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-13T21:05:55.147898] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:05:55.148013] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-13T21:05:55.148090] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:05:55.148166] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-13T21:05:55.148240] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-13T21:05:55.148281] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-13T21:05:55.148447] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-13T21:05:55.148537] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PXED took 3.6s. Estimated remaining: 1h 27m 3s. Rate: 7.1 symbols/min [2025-10-13T21:05:55.333812] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:05:55.334065] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-13T21:05:55.334129] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-13T21:05:55.334285] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-13T21:05:55.334360] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-13T21:05:55.334448] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-13T21:05:55.334519] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-13T21:05:55.560339] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T21:05:55.623155] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-13T21:05:55.753708] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:05:56.417946] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-13T21:05:57.217997] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-13T21:05:57.366015] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:05:58.018004] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-13T21:05:58.817949] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-13T21:05:59.170073] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T21:05:59.228446] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-13T21:05:59.264943] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T21:05:59.617945] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-13T21:06:00.429794] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-13T21:06:00.437032] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T21:06:01.217927] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-13T21:06:01.318324] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T21:06:01.876455] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T21:06:01.881857] [INFO ] [REMOTE ] PUMP: Full fetch complete (71253 records). [2025-10-13T21:06:01.882008] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-13T21:06:01.883220] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:01.883317] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:01.883365] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:01.883413] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-13T21:06:01.883485] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-13T21:06:01.883524] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-13T21:06:01.883565] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-13T21:06:01.883632] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PUMP took 50.5s. Estimated remaining: 1h 26m 54s. Rate: 7.1 symbols/min [2025-10-13T21:06:02.033056] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-13T21:06:02.074067] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:06:02.107867] [DEBUG] [LOCAL ] QD: Loaded 28119 existing records from primary storage. [2025-10-13T21:06:02.108269] [INFO ] [MAIN ] QD: Loaded 28119 existing records. [2025-10-13T21:06:02.298138] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:06:02.298421] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-13T21:06:02.298476] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-13T21:06:02.298950] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-13T21:06:02.299011] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-13T21:06:02.683245] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:06:02.817992] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-13T21:06:03.223908] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-13T21:06:03.617998] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-13T21:06:03.651547] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T21:06:04.417948] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-13T21:06:04.800088] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T21:06:05.217935] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-13T21:06:06.017912] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-13T21:06:06.043604] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:06:06.253173] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-13T21:06:06.643803] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:06:06.817940] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-13T21:06:07.584690] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:06:07.617982] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-13T21:06:08.417934] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-13T21:06:08.441066] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T21:06:08.962791] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T21:06:09.217948] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-13T21:06:10.017981] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-13T21:06:10.500023] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T21:06:10.817914] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-13T21:06:11.083452] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-13T21:06:11.617984] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-13T21:06:11.850630] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T21:06:12.239942] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T21:06:12.417940] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-13T21:06:13.217990] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-13T21:06:13.685937] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T21:06:14.018026] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-13T21:06:14.310566] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-13T21:06:14.817940] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-13T21:06:15.250112] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T21:06:15.307276] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T21:06:15.617929] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-13T21:06:15.799780] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T21:06:16.417914] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-13T21:06:16.766140] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T21:06:17.134980] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:06:17.138286] [INFO ] [REMOTE ] PX: Full fetch complete (50071 records). [2025-10-13T21:06:17.138453] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-13T21:06:17.139278] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:17.139371] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:17.139437] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:17.139514] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-13T21:06:17.139601] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-13T21:06:17.139663] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-13T21:06:17.139732] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-13T21:06:17.139801] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PX took 30.2s. Estimated remaining: 1h 26m 48s. Rate: 7.1 symbols/min [2025-10-13T21:06:17.223159] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-13T21:06:17.331789] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:06:17.332065] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-13T21:06:17.332116] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-13T21:06:17.332208] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-13T21:06:17.332276] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-13T21:06:17.332338] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-13T21:06:17.332409] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-13T21:06:17.736487] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:06:18.017939] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-13T21:06:18.817906] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-13T21:06:19.102754] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T21:06:19.491020] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:06:19.617991] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-13T21:06:20.417976] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-13T21:06:21.217998] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-13T21:06:21.376911] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:06:21.771353] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-13T21:06:21.808466] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T21:06:22.018056] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-13T21:06:22.818020] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-13T21:06:23.070449] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T21:06:23.289793] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T21:06:23.617926] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-13T21:06:24.058198] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T21:06:24.418631] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-13T21:06:24.418546] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T21:06:24.425103] [INFO ] [REMOTE ] PWR: Full fetch complete (68589 records). [2025-10-13T21:06:24.425354] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-13T21:06:24.426417] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:24.426530] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:24.426578] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:24.426619] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-13T21:06:24.426754] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-13T21:06:24.426814] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-13T21:06:24.426871] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-13T21:06:24.426949] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PWR took 38.8s. Estimated remaining: 1h 26m 39s. Rate: 7.1 symbols/min [2025-10-13T21:06:24.654118] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:06:24.654384] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-13T21:06:24.654447] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-13T21:06:24.654601] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-13T21:06:24.654695] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-13T21:06:24.654778] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-13T21:06:24.654835] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-13T21:06:25.224801] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:06:25.220502] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-13T21:06:25.628769] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T21:06:25.634157] [INFO ] [REMOTE ] QD: Full fetch complete (39973 records). [2025-10-13T21:06:25.634461] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-13T21:06:26.018096] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-13T21:06:26.033251] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-13T21:06:26.033356] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-13T21:06:26.034431] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-13T21:06:26.034626] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-13T21:06:26.035871] [DEBUG] [LOCAL ] QD: Trimmed 39973 records to 27616 (keeping 200 days of data) [2025-10-13T21:06:26.206741] [DEBUG] [LOCAL ] QD: Primary data saved (27616 records). [2025-10-13T21:06:26.206940] [INFO ] [MAIN ] QD: Full history saved. [2025-10-13T21:06:26.207043] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QD took 24.3s. Estimated remaining: 1h 26m 29s. Rate: 7.1 symbols/min [2025-10-13T21:06:26.385315] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:06:26.385568] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-13T21:06:26.385605] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-13T21:06:26.385746] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-13T21:06:26.385791] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-13T21:06:26.385833] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-13T21:06:26.385866] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-13T21:06:26.764889] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:06:26.817947] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-13T21:06:27.618037] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-13T21:06:27.973209] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-10-13T21:06:28.213918] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T21:06:28.417918] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-13T21:06:28.641626] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-13T21:06:29.218003] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-13T21:06:29.371282] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T21:06:30.018021] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-13T21:06:30.290772] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T21:06:30.818016] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-13T21:06:31.617921] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-13T21:06:31.745018] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:06:31.797283] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-13T21:06:32.415223] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T21:06:32.424333] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-13T21:06:33.217946] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-13T21:06:34.018053] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-13T21:06:34.531167] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-13T21:06:34.703441] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-13T21:06:34.817903] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-13T21:06:35.180263] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T21:06:35.617947] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-13T21:06:35.841157] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T21:06:36.417981] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-13T21:06:37.129518] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-13T21:06:37.217902] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-13T21:06:38.018041] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-13T21:06:38.344125] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:06:38.490257] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-13T21:06:38.818010] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-13T21:06:39.516615] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-13T21:06:39.617924] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-13T21:06:39.692048] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T21:06:40.417992] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-13T21:06:41.217909] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-13T21:06:41.699537] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-13T21:06:41.776899] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T21:06:42.017931] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-13T21:06:42.209616] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T21:06:42.587214] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T21:06:42.752028] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:06:42.757499] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-13T21:06:42.757686] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-13T21:06:42.758622] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:42.758734] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:42.758779] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:42.758821] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-13T21:06:42.758885] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-13T21:06:42.758924] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-13T21:06:42.758964] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-13T21:06:42.759026] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QBTS took 47.6s. Estimated remaining: 1h 26m 23s. Rate: 7.1 symbols/min [2025-10-13T21:06:42.823039] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-13T21:06:42.946860] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:06:42.947095] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-13T21:06:42.947133] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-13T21:06:42.947258] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-13T21:06:42.947300] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-13T21:06:42.947343] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-13T21:06:42.947378] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-13T21:06:43.315489] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:06:43.617981] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-13T21:06:44.417972] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-13T21:06:45.106681] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-13T21:06:45.217947] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-13T21:06:45.256835] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T21:06:46.017913] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-13T21:06:46.212068] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T21:06:46.817946] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-13T21:06:47.617979] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-13T21:06:47.721876] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T21:06:48.073574] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-13T21:06:48.417926] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-13T21:06:48.811096] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T21:06:49.107228] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:06:49.217947] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-13T21:06:50.018002] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-13T21:06:50.818004] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-13T21:06:50.994295] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T21:06:51.049466] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-13T21:06:51.618034] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-13T21:06:51.738780] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T21:06:52.418001] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-13T21:06:52.715912] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T21:06:53.217918] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-13T21:06:53.504488] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T21:06:54.017946] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-13T21:06:54.676385] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T21:06:54.682220] [INFO ] [REMOTE ] QSR: Full fetch complete (75475 records). [2025-10-13T21:06:54.682412] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-13T21:06:54.683439] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:54.683696] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:54.683753] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:54.683800] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-13T21:06:54.683868] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-13T21:06:54.683907] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-13T21:06:54.683948] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-13T21:06:54.684051] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QSR took 28.5s. Estimated remaining: 1h 26m 16s. Rate: 7.1 symbols/min [2025-10-13T21:06:54.817936] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-13T21:06:54.858123] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:06:55.211037] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-13T21:06:55.617971] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-13T21:06:56.212507] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T21:06:56.354496] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T21:06:56.360404] [INFO ] [REMOTE ] QS: Full fetch complete (77496 records). [2025-10-13T21:06:56.360692] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-13T21:06:56.362016] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:56.362103] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:56.362147] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:56.362210] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-13T21:06:56.362281] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-13T21:06:56.362317] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-13T21:06:56.362356] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-13T21:06:56.362471] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 31.9s. Estimated remaining: 1h 26m 5s. Rate: 7.1 symbols/min [2025-10-13T21:06:56.417939] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-13T21:06:57.146598] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:06:57.151793] [INFO ] [REMOTE ] QGEN: Full fetch complete (69898 records). [2025-10-13T21:06:57.151933] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-13T21:06:57.152681] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:06:57.152769] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:06:57.152817] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:06:57.152886] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-13T21:06:57.152979] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-13T21:06:57.153026] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-13T21:06:57.153076] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-13T21:06:57.153232] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QGEN took 40.0s. Estimated remaining: 1h 25m 54s. Rate: 7.1 symbols/min [2025-10-13T21:06:57.217932] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-13T21:06:58.779808] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T21:06:58.788942] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-13T21:07:00.319278] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T21:07:00.328411] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-13T21:07:01.734096] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T21:07:01.744379] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-13T21:07:03.161191] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T21:07:03.169374] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-13T21:07:04.692134] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T21:07:04.702025] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-13T21:07:06.419265] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T21:07:06.430211] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-13T21:07:07.174077] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T21:07:07.178600] [INFO ] [REMOTE ] QTWO: Full fetch complete (57401 records). [2025-10-13T21:07:07.178765] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-13T21:07:07.179589] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:07:07.179700] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:07:07.179748] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:07:07.179813] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-13T21:07:07.179881] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-13T21:07:07.179918] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-13T21:07:07.179958] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-13T21:07:07.180030] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QTWO took 24.4s. Estimated remaining: 1h 25m 46s. Rate: 7.1 symbols/min [2025-10-13T21:07:07.788479] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:07.895781] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:07.944797] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:07.944995] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-13T21:07:07.976669] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-13T21:07:07.981513] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-13T21:07:07.981712] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-13T21:07:07.980839] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:07.981935] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-13T21:07:07.983682] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-13T21:07:07.983997] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-13T21:07:07.983799] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-13T21:07:08.006938] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-13T21:07:08.021800] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-13T21:07:08.027603] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-13T21:07:08.039392] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-13T21:07:08.064451] [DEBUG] [LOCAL ] QVCD: Loaded 4791 existing records from primary storage. [2025-10-13T21:07:08.159831] [INFO ] [MAIN ] QVCD: Loaded 4791 existing records. [2025-10-13T21:07:08.166193] [DEBUG] [LOCAL ] QUAD: Loaded 23714 existing records from primary storage. [2025-10-13T21:07:08.327052] [INFO ] [MAIN ] QUAD: Loaded 23714 existing records. [2025-10-13T21:07:08.829598] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:07:08.994752] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-13T21:07:09.153935] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:09.065507] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-13T21:07:09.112119] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:07:09.155266] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-13T21:07:09.156574] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-13T21:07:09.156689] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-13T21:07:09.162055] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-13T21:07:09.177758] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-13T21:07:09.183016] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-13T21:07:09.251248] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-13T21:07:09.306595] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:09.421216] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-13T21:07:10.025299] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:10.063631] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-13T21:07:10.062990] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:10.064727] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-13T21:07:10.084603] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T21:07:10.087520] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-13T21:07:10.778810] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T21:07:10.781291] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-13T21:07:10.810921] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T21:07:10.812785] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-13T21:07:11.297220] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T21:07:11.304288] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-13T21:07:11.359808] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T21:07:11.361832] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-13T21:07:11.416779] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T21:07:11.418440] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-13T21:07:11.988705] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T21:07:11.989997] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-13T21:07:12.207869] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T21:07:12.213179] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-13T21:07:12.347192] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T21:07:12.408777] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-10-13T21:07:12.418704] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-13T21:07:12.681158] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T21:07:12.761300] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T21:07:13.217933] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-13T21:07:13.589160] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T21:07:14.018013] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-13T21:07:14.120684] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T21:07:14.708919] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T21:07:14.817989] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-13T21:07:15.620570] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-13T21:07:15.625440] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T21:07:16.417992] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-13T21:07:16.886226] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T21:07:17.217945] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-13T21:07:17.341686] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T21:07:18.018005] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-13T21:07:18.823071] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-13T21:07:18.841435] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:07:19.376456] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T21:07:19.526989] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T21:07:19.617942] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-13T21:07:20.254796] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-13T21:07:20.418038] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-13T21:07:21.102953] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T21:07:21.217986] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-13T21:07:21.888443] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T21:07:22.017943] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-13T21:07:22.817975] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-13T21:07:23.617999] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-13T21:07:23.810157] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T21:07:24.174566] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T21:07:24.390118] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:07:24.391785] [INFO ] [REMOTE ] QVCD: Full fetch complete (6329 records). [2025-10-13T21:07:24.391891] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-13T21:07:24.423055] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-13T21:07:24.806219] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-13T21:07:24.806338] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-13T21:07:24.806689] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-13T21:07:24.806755] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-13T21:07:24.807194] [DEBUG] [LOCAL ] QVCD: Trimmed 6329 records to 4711 (keeping 200 days of data) [2025-10-13T21:07:24.840817] [DEBUG] [LOCAL ] QVCD: Primary data saved (4711 records). [2025-10-13T21:07:24.840990] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-13T21:07:24.841088] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 17.6s. Estimated remaining: 1h 25m 41s. Rate: 7.1 symbols/min [2025-10-13T21:07:25.019877] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:25.020114] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-13T21:07:25.020153] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-13T21:07:25.020271] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-13T21:07:25.020313] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-13T21:07:25.020354] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-13T21:07:25.020388] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-13T21:07:25.223797] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-13T21:07:25.402888] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:25.611567] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T21:07:26.017915] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-13T21:07:26.071101] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T21:07:26.817930] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-13T21:07:27.202387] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T21:07:27.617917] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-13T21:07:27.684340] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T21:07:28.418004] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-13T21:07:29.217997] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-13T21:07:29.471533] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:07:29.769219] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T21:07:30.018008] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-13T21:07:30.043401] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T21:07:30.817919] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-13T21:07:31.149782] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T21:07:31.618036] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-13T21:07:32.063447] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T21:07:32.104512] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:07:32.106469] [INFO ] [REMOTE ] QVCC: Full fetch complete (12074 records). [2025-10-13T21:07:32.106558] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-13T21:07:32.107244] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:07:32.107333] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:07:32.107399] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:07:32.107448] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-13T21:07:32.107520] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-13T21:07:32.107588] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-13T21:07:32.107673] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-13T21:07:32.107770] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 24.9s. Estimated remaining: 1h 25m 32s. Rate: 7.1 symbols/min [2025-10-13T21:07:32.285822] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:32.286078] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-13T21:07:32.286118] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-13T21:07:32.286243] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-13T21:07:32.286288] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-13T21:07:32.286330] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-13T21:07:32.286364] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-13T21:07:32.425745] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-13T21:07:32.670586] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:33.217903] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-13T21:07:33.499741] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T21:07:33.502699] [INFO ] [REMOTE ] QUAD: Full fetch complete (34290 records). [2025-10-13T21:07:33.502789] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-13T21:07:33.881762] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-13T21:07:33.881872] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-13T21:07:33.883041] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-13T21:07:33.883112] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-13T21:07:33.884245] [DEBUG] [LOCAL ] QUAD: Trimmed 34290 records to 23402 (keeping 200 days of data) [2025-10-13T21:07:34.020139] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-13T21:07:34.031514] [DEBUG] [LOCAL ] QUAD: Primary data saved (23402 records). [2025-10-13T21:07:34.031705] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-13T21:07:34.031812] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 26.9s. Estimated remaining: 1h 25m 21s. Rate: 7.1 symbols/min [2025-10-13T21:07:34.205192] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:34.205469] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-13T21:07:34.205516] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-13T21:07:34.205688] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-13T21:07:34.205742] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-13T21:07:34.205785] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-13T21:07:34.205818] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-13T21:07:34.591109] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:34.609397] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T21:07:34.818032] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-13T21:07:35.617920] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-13T21:07:35.803793] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:07:36.369223] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:07:36.417907] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-13T21:07:36.904927] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T21:07:37.218019] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-13T21:07:37.970169] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T21:07:38.017906] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-13T21:07:38.818073] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-13T21:07:39.488723] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T21:07:39.603825] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T21:07:39.617883] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-13T21:07:40.208998] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T21:07:40.417982] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-13T21:07:41.218013] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-13T21:07:41.459956] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:07:42.017970] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-13T21:07:42.076292] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T21:07:42.103622] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T21:07:42.817948] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-13T21:07:43.565705] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T21:07:43.617932] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-13T21:07:43.972921] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T21:07:44.417945] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-13T21:07:45.217994] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-13T21:07:45.249946] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T21:07:46.017916] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-13T21:07:46.183081] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:07:46.421193] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:07:46.817991] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-13T21:07:47.617993] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-13T21:07:48.068873] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T21:07:48.131907] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T21:07:48.417941] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-13T21:07:49.059683] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T21:07:49.217980] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-13T21:07:50.017902] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-13T21:07:50.387685] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T21:07:50.586016] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-13T21:07:50.818026] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-13T21:07:51.617990] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-13T21:07:51.644334] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T21:07:52.417915] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-13T21:07:52.943231] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T21:07:52.991309] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T21:07:53.217921] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-13T21:07:53.486638] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T21:07:53.951070] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:07:53.956695] [INFO ] [REMOTE ] QXO: Full fetch complete (75485 records). [2025-10-13T21:07:53.956898] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-13T21:07:53.958018] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:07:53.958126] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:07:53.958170] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:07:53.958217] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-13T21:07:53.958299] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-13T21:07:53.958356] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-13T21:07:53.958402] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-13T21:07:53.958494] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QXO took 46.8s. Estimated remaining: 1h 25m 17s. Rate: 7.1 symbols/min [2025-10-13T21:07:54.026893] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-13T21:07:54.143364] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:07:54.143602] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-13T21:07:54.143660] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-13T21:07:54.143784] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-13T21:07:54.143827] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-13T21:07:54.143867] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-13T21:07:54.143899] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-13T21:07:54.524401] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:07:54.817976] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-13T21:07:55.617947] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-13T21:07:55.794290] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T21:07:55.885853] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T21:07:56.417943] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-13T21:07:56.591794] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T21:07:57.217971] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-13T21:07:57.584505] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T21:07:58.018001] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-13T21:07:58.601113] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T21:07:58.817973] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-13T21:07:59.334188] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:07:59.617940] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-13T21:08:00.063490] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T21:08:00.417981] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-13T21:08:00.905909] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:08:00.909131] [INFO ] [REMOTE ] R: Full fetch complete (42034 records). [2025-10-13T21:08:00.909223] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-13T21:08:00.909915] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:00.910002] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:00.910046] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:00.910085] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-13T21:08:00.910153] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-13T21:08:00.910192] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-13T21:08:00.910233] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-13T21:08:00.910299] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. R took 36.1s. Estimated remaining: 1h 25m 8s. Rate: 7.1 symbols/min [2025-10-13T21:08:01.087101] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:01.087413] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-13T21:08:01.087638] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-13T21:08:01.087908] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-13T21:08:01.088146] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-13T21:08:01.088310] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-13T21:08:01.088368] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-13T21:08:01.219414] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-13T21:08:01.240316] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T21:08:01.543617] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:02.017945] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-13T21:08:02.662908] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T21:08:02.724186] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:08:02.728454] [INFO ] [REMOTE ] RACE: Full fetch complete (47824 records). [2025-10-13T21:08:02.728552] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-13T21:08:02.729428] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:02.729514] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:02.729557] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:02.729598] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-13T21:08:02.729685] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-13T21:08:02.729743] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-13T21:08:02.729786] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-13T21:08:02.729848] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RACE took 28.7s. Estimated remaining: 1h 24m 57s. Rate: 7.1 symbols/min [2025-10-13T21:08:02.823081] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-13T21:08:02.928879] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:02.929097] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-13T21:08:02.929133] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-13T21:08:02.929253] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-13T21:08:02.929294] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-13T21:08:02.929335] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-13T21:08:02.929367] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-13T21:08:03.288681] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:03.617976] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-13T21:08:04.082031] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T21:08:04.417973] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-13T21:08:04.755402] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T21:08:05.217918] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-13T21:08:05.950768] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T21:08:06.017935] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-13T21:08:06.769965] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:08:06.817942] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-13T21:08:07.545933] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T21:08:07.617910] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-13T21:08:08.407860] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:08:08.417888] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-13T21:08:09.217910] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-13T21:08:09.358231] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T21:08:09.565872] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T21:08:10.018055] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-13T21:08:10.276090] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T21:08:10.818040] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-13T21:08:11.410140] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T21:08:11.414355] [INFO ] [REMOTE ] RA: Full fetch complete (31630 records). [2025-10-13T21:08:11.414467] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-13T21:08:11.415194] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:11.415304] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:11.415366] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:11.415429] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-13T21:08:11.415518] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-13T21:08:11.415577] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-13T21:08:11.415669] [DEBUG] [LOCAL ] RA: No derivative data file found to delete. [2025-10-13T21:08:11.415780] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RA took 39.3s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-13T21:08:11.616763] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:11.617232] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-13T21:08:11.617406] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-13T21:08:11.617736] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-13T21:08:11.617877] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-13T21:08:11.617986] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-13T21:08:11.618456] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-13T21:08:11.619749] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-13T21:08:11.937097] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T21:08:12.049163] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:12.417913] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-13T21:08:12.710796] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T21:08:13.217948] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-13T21:08:14.018016] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-13T21:08:14.236878] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:08:14.260265] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T21:08:14.817992] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-13T21:08:15.617900] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-13T21:08:16.417990] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-13T21:08:16.549483] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-13T21:08:16.570757] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T21:08:16.710779] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T21:08:17.218054] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-13T21:08:17.681244] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T21:08:18.017943] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-13T21:08:18.817886] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-13T21:08:19.199826] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T21:08:19.309778] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T21:08:19.618001] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-13T21:08:20.097582] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T21:08:20.417915] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-13T21:08:21.217909] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-13T21:08:21.413991] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T21:08:21.927984] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T21:08:22.017879] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-13T21:08:22.326398] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T21:08:22.818008] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-13T21:08:23.403350] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T21:08:23.617943] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-13T21:08:23.885703] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T21:08:24.417938] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-13T21:08:25.146426] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T21:08:25.217901] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-13T21:08:25.431749] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T21:08:26.017934] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-13T21:08:26.705607] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T21:08:26.755640] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T21:08:26.817924] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-13T21:08:27.346184] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T21:08:27.348695] [INFO ] [REMOTE ] RBC: Full fetch complete (21411 records). [2025-10-13T21:08:27.348811] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-13T21:08:27.349379] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:27.349467] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:27.349513] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:27.349556] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-13T21:08:27.349618] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-13T21:08:27.349688] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-13T21:08:27.349776] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-13T21:08:27.349841] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RBC took 24.6s. Estimated remaining: 1h 24m 43s. Rate: 7.1 symbols/min [2025-10-13T21:08:27.531126] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:27.541495] [DEBUG] [LOCAL ] RBOT: Loaded 6007 existing records from primary storage. [2025-10-13T21:08:27.541800] [INFO ] [MAIN ] RBOT: Loaded 6007 existing records. [2025-10-13T21:08:27.623052] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-13T21:08:27.737682] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:08:27.737948] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-13T21:08:27.738025] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-13T21:08:27.738349] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-13T21:08:27.738409] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-13T21:08:28.113583] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:28.417923] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-13T21:08:29.217903] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-13T21:08:29.370412] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T21:08:29.691038] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T21:08:29.695764] [INFO ] [REMOTE ] RAMP: Full fetch complete (53735 records). [2025-10-13T21:08:29.695870] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-13T21:08:29.696493] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:29.696595] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:29.696689] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:29.696787] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-13T21:08:29.696869] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-13T21:08:29.696906] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-13T21:08:29.696946] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-13T21:08:29.697000] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 35.7s. Estimated remaining: 1h 24m 33s. Rate: 7.1 symbols/min [2025-10-13T21:08:29.866538] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:29.866783] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-13T21:08:29.866828] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-13T21:08:29.866961] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-13T21:08:29.867031] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-13T21:08:29.867085] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-13T21:08:29.867120] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-13T21:08:30.018395] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-13T21:08:30.228541] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:30.255474] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-13T21:08:30.817982] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-13T21:08:31.617902] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-13T21:08:31.677008] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T21:08:31.765512] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T21:08:32.417902] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-13T21:08:33.217996] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-13T21:08:33.945263] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-13T21:08:34.017895] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-13T21:08:34.075965] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T21:08:34.076533] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T21:08:34.817942] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-13T21:08:35.588503] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:08:35.617879] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-13T21:08:35.942233] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T21:08:36.387943] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T21:08:36.417936] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-13T21:08:37.027026] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T21:08:37.217985] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-13T21:08:38.017927] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-13T21:08:38.818019] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-13T21:08:39.345588] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T21:08:39.550873] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T21:08:39.617889] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-13T21:08:40.031772] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T21:08:40.417987] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-13T21:08:41.217933] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-13T21:08:41.977315] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-13T21:08:42.017903] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-13T21:08:42.060153] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T21:08:42.817940] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-13T21:08:42.851549] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T21:08:42.956604] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:08:43.617934] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-13T21:08:44.418013] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-13T21:08:44.468593] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:08:45.218003] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-13T21:08:45.270939] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T21:08:46.017941] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-13T21:08:46.155518] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-13T21:08:46.817926] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-13T21:08:47.290011] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T21:08:47.617916] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-13T21:08:47.788338] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T21:08:48.417976] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-13T21:08:48.443826] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T21:08:48.976715] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T21:08:48.982075] [INFO ] [REMOTE ] RBA: Full fetch complete (65590 records). [2025-10-13T21:08:48.982245] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-13T21:08:48.982937] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:48.983027] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:48.983068] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:48.983106] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-13T21:08:48.983190] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-13T21:08:48.983244] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-13T21:08:48.983286] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-13T21:08:48.983343] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBA took 48.1s. Estimated remaining: 1h 24m 28s. Rate: 7.1 symbols/min [2025-10-13T21:08:49.163066] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:49.215674] [DEBUG] [LOCAL ] RC: Loaded 49637 existing records from primary storage. [2025-10-13T21:08:49.216395] [INFO ] [MAIN ] RC: Loaded 49637 existing records. [2025-10-13T21:08:49.234447] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-13T21:08:49.352352] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-13T21:08:49.456341] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:08:49.456602] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-13T21:08:49.456683] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-13T21:08:49.457300] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-13T21:08:49.457359] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-13T21:08:49.860369] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:50.018039] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-13T21:08:50.284053] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T21:08:50.286308] [INFO ] [REMOTE ] RBOT: Full fetch complete (9127 records). [2025-10-13T21:08:50.286384] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-13T21:08:50.674501] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-13T21:08:50.674601] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-13T21:08:50.675044] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-13T21:08:50.675109] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-13T21:08:50.675584] [DEBUG] [LOCAL ] RBOT: Trimmed 9127 records to 5922 (keeping 200 days of data) [2025-10-13T21:08:50.711048] [DEBUG] [LOCAL ] RBOT: Primary data saved (5922 records). [2025-10-13T21:08:50.711192] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-13T21:08:50.711318] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBOT took 23.4s. Estimated remaining: 1h 24m 17s. Rate: 7.1 symbols/min [2025-10-13T21:08:50.818068] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-13T21:08:50.895680] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:50.895935] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-13T21:08:50.895985] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-13T21:08:50.896110] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-13T21:08:50.896151] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-13T21:08:50.896192] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-13T21:08:50.896223] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-13T21:08:51.276217] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:51.617935] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-13T21:08:52.177697] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T21:08:52.417930] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-13T21:08:52.549356] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T21:08:52.594915] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:08:53.218009] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-13T21:08:54.017986] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-13T21:08:54.156265] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T21:08:54.161788] [INFO ] [REMOTE ] RBLX: Full fetch complete (77394 records). [2025-10-13T21:08:54.161935] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-13T21:08:54.162819] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:08:54.162909] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:08:54.162953] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:08:54.162997] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-13T21:08:54.163088] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-13T21:08:54.163180] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-13T21:08:54.163234] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-13T21:08:54.163297] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBLX took 42.7s. Estimated remaining: 1h 24m 7s. Rate: 7.1 symbols/min [2025-10-13T21:08:54.355100] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:08:54.355533] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-13T21:08:54.355633] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-13T21:08:54.356035] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-13T21:08:54.356251] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-13T21:08:54.356371] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-13T21:08:54.356461] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-13T21:08:54.598541] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T21:08:54.720498] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-13T21:08:54.817243] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:08:54.817880] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-13T21:08:55.580755] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T21:08:55.617890] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-13T21:08:56.315276] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T21:08:56.417988] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-13T21:08:57.217999] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-13T21:08:57.821034] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T21:08:58.017969] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-13T21:08:58.137806] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T21:08:58.519799] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T21:08:58.817973] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-13T21:08:59.618012] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-13T21:09:00.340044] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T21:09:00.417885] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-13T21:09:00.819857] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T21:09:01.124553] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T21:09:01.217888] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-13T21:09:01.938182] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T21:09:02.017941] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-13T21:09:02.693905] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T21:09:02.817945] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-13T21:09:03.511158] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T21:09:03.618019] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-13T21:09:04.213087] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T21:09:04.417994] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-13T21:09:04.701076] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-13T21:09:04.702143] [INFO ] [REMOTE ] RCD: Full fetch complete (6551 records). [2025-10-13T21:09:04.702271] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-13T21:09:04.702888] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:09:04.702978] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:09:04.703024] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:09:04.703068] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-13T21:09:04.703134] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-13T21:09:04.703173] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-13T21:09:04.703214] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-13T21:09:04.703276] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RCD took 10.5s. Estimated remaining: 1h 23m 59s. Rate: 7.1 symbols/min [2025-10-13T21:09:04.889085] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:04.889284] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-13T21:09:04.889323] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-13T21:09:04.889446] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-13T21:09:04.889487] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-13T21:09:04.889555] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-13T21:09:04.889589] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-13T21:09:05.223039] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-13T21:09:05.264149] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:05.961101] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T21:09:06.018011] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-13T21:09:06.817982] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-13T21:09:07.465032] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T21:09:07.618036] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-13T21:09:08.234962] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T21:09:08.417971] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-13T21:09:08.420012] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T21:09:09.218038] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-13T21:09:10.017912] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-13T21:09:10.112590] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T21:09:10.636814] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T21:09:10.817939] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-13T21:09:11.617925] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-13T21:09:12.236949] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-13T21:09:12.260211] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T21:09:12.417935] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-13T21:09:12.585613] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T21:09:12.949006] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T21:09:13.218004] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-13T21:09:13.702391] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T21:09:14.018042] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-13T21:09:14.558980] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T21:09:14.817912] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-13T21:09:15.243999] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T21:09:15.617978] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-13T21:09:16.417936] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-13T21:09:17.217920] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-13T21:09:17.380390] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T21:09:18.017909] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-13T21:09:18.376883] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T21:09:18.377811] [INFO ] [REMOTE ] RCB: Full fetch complete (3726 records). [2025-10-13T21:09:18.377884] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-13T21:09:18.378369] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:09:18.378457] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:09:18.378500] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:09:18.378599] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-13T21:09:18.378695] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-13T21:09:18.378752] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-13T21:09:18.378795] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-13T21:09:18.378855] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RCB took 27.7s. Estimated remaining: 1h 23m 53s. Rate: 7.1 symbols/min [2025-10-13T21:09:18.572193] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:18.572981] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-13T21:09:18.573149] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-13T21:09:18.573320] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-13T21:09:18.573445] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-13T21:09:18.573587] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-13T21:09:18.573674] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-13T21:09:18.827045] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-13T21:09:18.848017] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-13T21:09:19.069342] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:19.075088] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T21:09:19.617976] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-13T21:09:20.417915] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-13T21:09:21.217991] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-13T21:09:21.265900] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-13T21:09:21.652823] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T21:09:22.017943] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-13T21:09:22.548048] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T21:09:22.817902] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-13T21:09:22.852500] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-13T21:09:23.617902] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-13T21:09:23.693337] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T21:09:24.392382] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:09:24.397595] [INFO ] [REMOTE ] RBRK: Full fetch complete (76146 records). [2025-10-13T21:09:24.397794] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-13T21:09:24.398558] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:09:24.398692] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:09:24.398762] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:09:24.398869] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-13T21:09:24.398953] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-13T21:09:24.398991] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-13T21:09:24.399033] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-13T21:09:24.399092] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RBRK took 54.7s. Estimated remaining: 1h 23m 43s. Rate: 7.1 symbols/min [2025-10-13T21:09:24.423122] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-13T21:09:24.584842] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:24.599040] [DEBUG] [LOCAL ] RCS: Loaded 12263 existing records from primary storage. [2025-10-13T21:09:24.599304] [INFO ] [MAIN ] RCS: Loaded 12263 existing records. [2025-10-13T21:09:24.794266] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T21:09:24.830446] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:09:24.842182] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-13T21:09:24.842461] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-13T21:09:24.843051] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-13T21:09:24.843132] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-13T21:09:25.196835] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:25.217896] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-13T21:09:26.017919] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-13T21:09:26.199257] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T21:09:26.249298] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T21:09:26.817914] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-13T21:09:27.617902] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-13T21:09:27.897411] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T21:09:27.936525] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T21:09:28.417922] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-13T21:09:29.218069] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-13T21:09:29.421723] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T21:09:30.017945] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-13T21:09:30.259696] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T21:09:30.817936] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-13T21:09:30.924383] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T21:09:31.060251] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T21:09:31.617984] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-13T21:09:32.417930] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-13T21:09:32.478297] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T21:09:33.026720] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T21:09:33.218009] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-13T21:09:34.018033] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-13T21:09:34.251482] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T21:09:34.306152] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T21:09:34.817987] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-13T21:09:35.521453] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T21:09:35.617936] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-13T21:09:36.417997] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-13T21:09:37.125471] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T21:09:37.217978] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-13T21:09:37.499893] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T21:09:38.017984] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-13T21:09:38.131056] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:09:38.817920] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-13T21:09:39.211835] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:09:39.617939] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-13T21:09:39.715799] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T21:09:39.788672] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:09:40.418052] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-13T21:09:41.217999] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-13T21:09:41.632635] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T21:09:42.023060] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-13T21:09:42.032114] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T21:09:42.037689] [INFO ] [REMOTE ] RC: Full fetch complete (70898 records). [2025-10-13T21:09:42.037812] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-13T21:09:42.444740] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-13T21:09:42.444846] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-13T21:09:42.446203] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-13T21:09:42.446269] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-13T21:09:42.448053] [DEBUG] [LOCAL ] RC: Trimmed 70898 records to 48895 (keeping 200 days of data) [2025-10-13T21:09:42.767915] [DEBUG] [LOCAL ] RC: Primary data saved (48895 records). [2025-10-13T21:09:42.768336] [INFO ] [MAIN ] RC: Full history saved. [2025-10-13T21:09:42.768490] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RC took 53.8s. Estimated remaining: 1h 23m 38s. Rate: 7.1 symbols/min [2025-10-13T21:09:42.819558] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-13T21:09:43.009011] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:43.010506] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-13T21:09:43.012491] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-13T21:09:43.012392] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T21:09:43.013278] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-13T21:09:43.017439] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-13T21:09:43.024151] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-13T21:09:43.030110] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-13T21:09:43.070191] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T21:09:43.411098] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:43.618009] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-13T21:09:44.417997] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-13T21:09:44.583756] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:09:45.088998] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T21:09:45.217977] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-13T21:09:45.492531] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T21:09:45.889964] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T21:09:46.018044] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-13T21:09:46.817974] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-13T21:09:47.122530] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T21:09:47.568058] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:09:47.573051] [INFO ] [REMOTE ] RCI: Full fetch complete (70127 records). [2025-10-13T21:09:47.573200] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-13T21:09:47.574009] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:09:47.574100] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:09:47.574145] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:09:47.574186] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-13T21:09:47.574248] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-13T21:09:47.574283] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-13T21:09:47.574322] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-13T21:09:47.574382] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCI took 42.9s. Estimated remaining: 1h 23m 29s. Rate: 7.1 symbols/min [2025-10-13T21:09:47.623091] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-13T21:09:47.768440] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:47.768771] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-13T21:09:47.768843] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-13T21:09:47.769040] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-13T21:09:47.769101] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-13T21:09:47.769148] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-13T21:09:47.769209] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-13T21:09:48.142299] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:48.418065] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-13T21:09:49.217978] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-13T21:09:49.878727] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-13T21:09:49.928055] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T21:09:50.017946] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-13T21:09:50.154531] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T21:09:50.157075] [INFO ] [REMOTE ] RCS: Full fetch complete (19153 records). [2025-10-13T21:09:50.157175] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-13T21:09:50.519674] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-13T21:09:50.519767] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-13T21:09:50.520191] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-13T21:09:50.520252] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-13T21:09:50.520844] [DEBUG] [LOCAL ] RCS: Trimmed 19153 records to 12146 (keeping 200 days of data) [2025-10-13T21:09:50.593626] [DEBUG] [LOCAL ] RCS: Primary data saved (12146 records). [2025-10-13T21:09:50.593788] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-13T21:09:50.593933] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 26.2s. Estimated remaining: 1h 23m 19s. Rate: 7.1 symbols/min [2025-10-13T21:09:50.762484] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:50.762745] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-13T21:09:50.762814] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-13T21:09:50.763004] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-13T21:09:50.763071] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-13T21:09:50.763194] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-13T21:09:50.763238] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-13T21:09:50.823959] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-13T21:09:51.088712] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T21:09:51.171988] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:51.617942] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-13T21:09:52.417934] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-13T21:09:52.505931] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T21:09:53.061458] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T21:09:53.066232] [INFO ] [REMOTE ] RCL: Full fetch complete (74942 records). [2025-10-13T21:09:53.066350] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-13T21:09:53.067223] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:09:53.067312] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:09:53.067353] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:09:53.067391] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-13T21:09:53.067449] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-13T21:09:53.067488] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-13T21:09:53.067535] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-13T21:09:53.067621] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCL took 34.7s. Estimated remaining: 1h 23m 8s. Rate: 7.1 symbols/min [2025-10-13T21:09:53.218933] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-13T21:09:53.245064] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:09:53.246010] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-13T21:09:53.246080] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-13T21:09:53.246272] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-13T21:09:53.246340] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-13T21:09:53.246493] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-13T21:09:53.246590] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-13T21:09:53.403354] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T21:09:53.635501] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:09:54.017910] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-13T21:09:54.817947] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-13T21:09:54.902842] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T21:09:55.617909] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-13T21:09:55.944708] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T21:09:56.417933] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-13T21:09:57.218026] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-13T21:09:57.377608] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T21:09:57.435424] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-13T21:09:58.017923] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-13T21:09:58.473865] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-13T21:09:58.766336] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T21:09:58.817885] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-13T21:09:59.617926] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-13T21:10:00.417909] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-13T21:10:00.457156] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:10:00.524286] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-13T21:10:01.079029] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:10:01.217978] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-13T21:10:02.018141] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-13T21:10:02.611343] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-13T21:10:02.818007] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-13T21:10:03.287766] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T21:10:03.617934] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-13T21:10:03.893730] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-13T21:10:04.418027] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-13T21:10:04.699552] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T21:10:05.060016] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T21:10:05.217912] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-13T21:10:06.017900] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-13T21:10:06.714427] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-13T21:10:06.820071] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-13T21:10:06.822792] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T21:10:07.617938] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-13T21:10:07.849362] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T21:10:08.417938] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-13T21:10:09.217916] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-13T21:10:09.468938] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-13T21:10:09.607093] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T21:10:10.025445] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-13T21:10:10.031366] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T21:10:10.668844] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T21:10:10.817946] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-13T21:10:11.618040] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-13T21:10:12.231164] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T21:10:12.418056] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-13T21:10:12.592816] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T21:10:12.600379] [INFO ] [REMOTE ] RCUS: Full fetch complete (59945 records). [2025-10-13T21:10:12.600734] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-13T21:10:12.601839] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:10:12.604034] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:10:12.604146] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:10:12.604236] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-13T21:10:12.604337] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-13T21:10:12.604386] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-13T21:10:12.604433] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-13T21:10:12.604530] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCUS took 29.8s. Estimated remaining: 1h 23m 3s. Rate: 7.1 symbols/min [2025-10-13T21:10:12.866781] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:10:12.867064] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-13T21:10:12.867118] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-13T21:10:12.867270] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-13T21:10:12.867318] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-13T21:10:12.867365] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-13T21:10:12.867422] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-13T21:10:13.232860] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-13T21:10:13.430466] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:10:13.465283] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-13T21:10:14.017945] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-13T21:10:14.776236] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-13T21:10:14.817922] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-13T21:10:14.957863] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T21:10:15.617985] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-13T21:10:16.418037] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-13T21:10:16.795637] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-13T21:10:17.099246] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-13T21:10:17.218067] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-13T21:10:17.378811] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:10:18.017973] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-13T21:10:18.088508] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T21:10:18.818005] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-13T21:10:19.617973] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-13T21:10:19.826405] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T21:10:19.876761] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-13T21:10:20.417984] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-13T21:10:21.219086] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-13T21:10:21.222699] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T21:10:21.289128] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-13T21:10:22.017974] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-13T21:10:22.747173] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T21:10:22.817913] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-13T21:10:23.145436] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-13T21:10:23.617936] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-13T21:10:24.417933] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-13T21:10:24.455680] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-13T21:10:24.627020] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T21:10:25.217944] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-13T21:10:26.029135] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-13T21:10:26.053852] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:10:26.299386] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-13T21:10:26.447101] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T21:10:26.454926] [INFO ] [REMOTE ] RDW: Full fetch complete (74900 records). [2025-10-13T21:10:26.455167] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-13T21:10:26.456440] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:10:26.456580] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:10:26.456638] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:10:26.456747] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-13T21:10:26.456831] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-13T21:10:26.456880] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-13T21:10:26.456935] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-13T21:10:26.457018] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDW took 33.4s. Estimated remaining: 1h 22m 57s. Rate: 7.1 symbols/min [2025-10-13T21:10:26.648407] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:10:26.648787] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-13T21:10:26.648839] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-13T21:10:26.648949] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-13T21:10:26.648990] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-13T21:10:26.649030] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-13T21:10:26.649062] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-13T21:10:26.821694] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-13T21:10:27.014753] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:10:27.079428] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:10:27.618004] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-13T21:10:28.417936] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-13T21:10:29.101579] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:10:29.105684] [INFO ] [REMOTE ] RDN: Full fetch complete (65581 records). [2025-10-13T21:10:29.105811] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-13T21:10:29.106553] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:10:29.106668] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:10:29.106725] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:10:29.106763] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-13T21:10:29.106819] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-13T21:10:29.106854] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-13T21:10:29.106892] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-13T21:10:29.106946] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDN took 38.5s. Estimated remaining: 1h 22m 46s. Rate: 7.1 symbols/min [2025-10-13T21:10:29.222177] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-13T21:10:29.294868] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:10:29.324739] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T21:10:29.376631] [DEBUG] [LOCAL ] RERE: Loaded 41850 existing records from primary storage. [2025-10-13T21:10:29.377021] [INFO ] [MAIN ] RERE: Loaded 41850 existing records. [2025-10-13T21:10:29.579037] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:10:29.579337] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-13T21:10:29.579411] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-13T21:10:29.580122] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-13T21:10:29.580184] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-13T21:10:29.930308] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-10-13T21:10:29.983406] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:10:30.017879] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-13T21:10:30.820711] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-13T21:10:30.822461] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T21:10:30.827700] [INFO ] [REMOTE ] RDDT: Full fetch complete (77498 records). [2025-10-13T21:10:30.827805] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-13T21:10:30.828593] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:10:30.828704] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:10:30.828751] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:10:30.828947] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-13T21:10:30.829023] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-13T21:10:30.829059] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-13T21:10:30.829099] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-13T21:10:30.829158] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDDT took 43.3s. Estimated remaining: 1h 22m 36s. Rate: 7.1 symbols/min [2025-10-13T21:10:30.999262] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:10:31.027619] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T21:10:31.080573] [DEBUG] [LOCAL ] RES: Loaded 47720 existing records from primary storage. [2025-10-13T21:10:31.080954] [INFO ] [MAIN ] RES: Loaded 47720 existing records. [2025-10-13T21:10:31.257072] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:10:31.257268] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-13T21:10:31.257314] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-13T21:10:31.257828] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-13T21:10:31.257884] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-13T21:10:31.609572] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:10:31.617880] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-13T21:10:32.419258] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-13T21:10:32.419157] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T21:10:33.226797] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-13T21:10:33.246196] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:10:34.017902] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-13T21:10:34.188672] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T21:10:34.818018] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-13T21:10:34.880629] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T21:10:35.617916] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-13T21:10:35.721908] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T21:10:36.417923] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-13T21:10:36.607505] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T21:10:37.217972] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-13T21:10:37.305633] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T21:10:37.998188] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T21:10:38.017902] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-13T21:10:38.688306] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T21:10:38.818037] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-13T21:10:39.617975] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-13T21:10:39.761270] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T21:10:40.225906] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:10:40.417946] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-13T21:10:41.217986] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-13T21:10:41.422206] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T21:10:41.968362] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T21:10:42.017918] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-13T21:10:42.817902] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-13T21:10:42.886905] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T21:10:43.441168] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T21:10:43.617925] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-13T21:10:44.417933] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-13T21:10:44.555955] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:10:44.915139] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T21:10:45.217932] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-13T21:10:45.787749] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T21:10:45.987046] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:10:45.992377] [INFO ] [REMOTE ] RDY: Full fetch complete (68430 records). [2025-10-13T21:10:45.992566] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-13T21:10:45.993281] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:10:45.993393] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:10:45.993439] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:10:45.993478] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-13T21:10:45.993533] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-13T21:10:45.993569] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-13T21:10:45.993607] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-13T21:10:45.993692] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDY took 33.4s. Estimated remaining: 1h 22m 30s. Rate: 7.1 symbols/min [2025-10-13T21:10:46.023159] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-13T21:10:46.167767] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:10:46.168012] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-13T21:10:46.168063] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-13T21:10:46.168175] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-13T21:10:46.168215] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-13T21:10:46.168255] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-13T21:10:46.168285] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-13T21:10:46.549026] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:10:46.817970] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-13T21:10:47.617934] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-13T21:10:47.848891] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T21:10:48.418042] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-13T21:10:48.505107] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:10:48.982662] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T21:10:49.217941] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-13T21:10:50.018027] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-13T21:10:50.098668] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T21:10:50.585926] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T21:10:50.818034] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-13T21:10:51.483399] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T21:10:51.617939] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-13T21:10:52.201862] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T21:10:52.417978] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-13T21:10:53.010149] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T21:10:53.217974] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-13T21:10:53.526378] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T21:10:54.017946] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-13T21:10:54.526696] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T21:10:54.817931] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-13T21:10:55.617981] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-13T21:10:55.733475] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T21:10:56.418009] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-13T21:10:56.623988] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T21:10:57.217943] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-13T21:10:57.317723] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T21:10:58.017902] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-13T21:10:58.116038] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T21:10:58.409878] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T21:10:58.817917] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-13T21:10:59.617946] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-13T21:10:59.693628] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:11:00.418003] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-13T21:11:00.480955] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T21:11:01.057361] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T21:11:01.217983] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-13T21:11:02.017938] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-13T21:11:02.064200] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T21:11:02.758410] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T21:11:02.763535] [INFO ] [REMOTE ] RERE: Full fetch complete (57668 records). [2025-10-13T21:11:02.763700] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-13T21:11:02.824604] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-13T21:11:03.181514] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-13T21:11:03.181622] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-13T21:11:03.182549] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-13T21:11:03.182618] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-13T21:11:03.183982] [DEBUG] [LOCAL ] RERE: Trimmed 57668 records to 41410 (keeping 200 days of data) [2025-10-13T21:11:03.453782] [DEBUG] [LOCAL ] RERE: Primary data saved (41410 records). [2025-10-13T21:11:03.454008] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-13T21:11:03.454127] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RERE took 34.3s. Estimated remaining: 1h 22m 24s. Rate: 7.1 symbols/min [2025-10-13T21:11:03.601449] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T21:11:03.631239] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-13T21:11:03.667800] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:03.668404] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-13T21:11:03.668075] [INFO ] [REMOTE ] RES: Full fetch complete (68599 records). [2025-10-13T21:11:03.668548] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-13T21:11:03.668601] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-13T21:11:03.668967] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-13T21:11:03.669094] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-13T21:11:03.669153] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-13T21:11:03.669217] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-13T21:11:04.538479] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-13T21:11:04.537997] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:04.539071] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-13T21:11:04.539260] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-13T21:11:04.541817] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-13T21:11:04.542276] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-13T21:11:04.544515] [DEBUG] [LOCAL ] RES: Trimmed 68599 records to 46986 (keeping 200 days of data) [2025-10-13T21:11:04.854128] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T21:11:04.959260] [DEBUG] [LOCAL ] RES: Primary data saved (46986 records). [2025-10-13T21:11:04.959434] [INFO ] [MAIN ] RES: Full history saved. [2025-10-13T21:11:04.959530] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RES took 34.1s. Estimated remaining: 1h 22m 13s. Rate: 7.1 symbols/min [2025-10-13T21:11:05.224366] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-13T21:11:05.242029] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:05.243741] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-13T21:11:05.243923] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-13T21:11:05.244092] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-13T21:11:05.244145] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-13T21:11:05.244194] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-13T21:11:05.244231] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-13T21:11:05.682017] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T21:11:05.782233] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:06.017932] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-13T21:11:06.144316] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:11:06.817898] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-13T21:11:07.336027] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T21:11:07.617946] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-13T21:11:07.872796] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T21:11:08.193748] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T21:11:08.198783] [INFO ] [REMOTE ] RELX: Full fetch complete (67464 records). [2025-10-13T21:11:08.198958] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-13T21:11:08.199822] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:11:08.199917] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:11:08.199960] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:11:08.199998] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-13T21:11:08.200059] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-13T21:11:08.200129] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-13T21:11:08.200194] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-13T21:11:08.200270] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RELX took 41.7s. Estimated remaining: 1h 22m 3s. Rate: 7.1 symbols/min [2025-10-13T21:11:08.372054] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:08.372234] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-13T21:11:08.372269] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-13T21:11:08.372405] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-13T21:11:08.372470] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-13T21:11:08.372520] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-13T21:11:08.372554] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-13T21:11:08.426619] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-13T21:11:08.668748] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T21:11:08.751135] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:09.217918] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-13T21:11:09.957777] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T21:11:10.017892] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-13T21:11:10.641272] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T21:11:10.817906] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-13T21:11:11.068728] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T21:11:11.617926] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-13T21:11:12.417985] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-13T21:11:12.559545] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T21:11:12.763776] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T21:11:13.217924] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-13T21:11:14.017940] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-13T21:11:14.093904] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:11:14.407987] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T21:11:14.818013] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-13T21:11:15.618070] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-13T21:11:15.936885] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:11:16.409045] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:11:16.417877] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-13T21:11:17.218040] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-13T21:11:17.288662] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T21:11:17.981321] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:11:18.017910] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-13T21:11:18.191199] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:11:18.817931] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-13T21:11:19.618000] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-13T21:11:19.768987] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T21:11:20.417929] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-13T21:11:20.531672] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T21:11:20.671427] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T21:11:21.217945] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-13T21:11:22.025299] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-13T21:11:22.037263] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T21:11:22.073455] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T21:11:22.817998] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-13T21:11:23.617985] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-13T21:11:23.691941] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T21:11:23.726323] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T21:11:24.417933] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-13T21:11:25.168244] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:11:25.172918] [INFO ] [REMOTE ] REVG: Full fetch complete (57766 records). [2025-10-13T21:11:25.173147] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-13T21:11:25.174063] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:11:25.174157] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:11:25.174201] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:11:25.174241] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-13T21:11:25.174307] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-13T21:11:25.174347] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-13T21:11:25.174386] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-13T21:11:25.174451] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REVG took 39.2s. Estimated remaining: 1h 21m 58s. Rate: 7.1 symbols/min [2025-10-13T21:11:25.223077] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-13T21:11:25.362011] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:25.362334] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-13T21:11:25.362382] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-13T21:11:25.362496] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-13T21:11:25.362539] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-13T21:11:25.362582] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-13T21:11:25.362615] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-13T21:11:25.786249] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:25.813821] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-13T21:11:26.017946] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-13T21:11:26.817941] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-13T21:11:26.946323] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T21:11:27.142096] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T21:11:27.617936] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-13T21:11:28.185405] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:11:28.188049] [INFO ] [REMOTE ] REX: Full fetch complete (20849 records). [2025-10-13T21:11:28.188153] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-13T21:11:28.188704] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:11:28.188803] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:11:28.188873] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:11:28.188963] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-13T21:11:28.189123] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-13T21:11:28.189183] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-13T21:11:28.189229] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-13T21:11:28.189291] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REX took 24.7s. Estimated remaining: 1h 21m 47s. Rate: 7.1 symbols/min [2025-10-13T21:11:28.368592] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:28.386433] [DEBUG] [LOCAL ] RFI: Loaded 10606 existing records from primary storage. [2025-10-13T21:11:28.386913] [INFO ] [MAIN ] RFI: Loaded 10606 existing records. [2025-10-13T21:11:28.423259] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-13T21:11:28.579174] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:11:28.579521] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-13T21:11:28.579708] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-13T21:11:28.580179] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-13T21:11:28.580267] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-13T21:11:28.740795] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T21:11:28.999538] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:29.217945] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-13T21:11:30.017926] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-13T21:11:30.131228] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T21:11:30.448068] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-13T21:11:30.817922] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-13T21:11:31.617930] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-13T21:11:31.732480] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T21:11:32.031423] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T21:11:32.418042] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-13T21:11:33.217983] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-13T21:11:33.324409] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T21:11:33.482385] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T21:11:34.017988] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-13T21:11:34.817991] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-13T21:11:34.990862] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:11:35.623208] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-13T21:11:35.648382] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T21:11:35.668617] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T21:11:36.417996] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-13T21:11:37.217916] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-13T21:11:37.425618] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:11:38.017991] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-13T21:11:38.078115] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T21:11:38.817944] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-13T21:11:39.618424] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-13T21:11:39.938552] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:11:40.417883] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-13T21:11:40.498038] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T21:11:40.605685] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T21:11:41.217988] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-13T21:11:42.017989] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-13T21:11:42.154639] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:11:42.650851] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:11:42.817936] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-13T21:11:42.929937] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T21:11:43.617963] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-13T21:11:43.873059] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (6.66 seconds). [2025-10-13T21:11:44.417931] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-13T21:11:44.764733] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T21:11:45.118589] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:11:45.123911] [INFO ] [REMOTE ] REXR: Full fetch complete (74771 records). [2025-10-13T21:11:45.124046] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-13T21:11:45.125151] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:11:45.125254] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:11:45.125302] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:11:45.125346] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-13T21:11:45.125440] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-13T21:11:45.125505] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-13T21:11:45.125570] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-13T21:11:45.125679] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REXR took 40.2s. Estimated remaining: 1h 21m 42s. Rate: 7.1 symbols/min [2025-10-13T21:11:45.224356] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-13T21:11:45.319285] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:45.336012] [DEBUG] [LOCAL ] RFL: Loaded 11446 existing records from primary storage. [2025-10-13T21:11:45.336351] [INFO ] [MAIN ] RFL: Loaded 11446 existing records. [2025-10-13T21:11:45.523225] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:11:45.523494] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-13T21:11:45.523546] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-13T21:11:45.523936] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-13T21:11:45.523994] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-13T21:11:45.881244] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:46.017938] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-13T21:11:46.732376] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T21:11:46.817900] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-13T21:11:47.181902] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-13T21:11:47.484229] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T21:11:47.486814] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (3.87 seconds). [2025-10-13T21:11:47.492174] [INFO ] [REMOTE ] REZI: Full fetch complete (65606 records). [2025-10-13T21:11:47.492270] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-13T21:11:47.493027] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:11:47.493122] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:11:47.493165] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:11:47.493205] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-13T21:11:47.493266] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-13T21:11:47.493302] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-13T21:11:47.493341] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-13T21:11:47.493399] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REZI took 39.3s. Estimated remaining: 1h 21m 31s. Rate: 7.1 symbols/min [2025-10-13T21:11:47.623120] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-13T21:11:47.689134] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:11:47.696043] [DEBUG] [LOCAL ] RFM: Loaded 4203 existing records from primary storage. [2025-10-13T21:11:47.696927] [INFO ] [MAIN ] RFM: Loaded 4203 existing records. [2025-10-13T21:11:47.875828] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:11:47.876070] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-13T21:11:47.876119] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-13T21:11:47.876322] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-13T21:11:47.876361] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-13T21:11:48.253543] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:11:48.342617] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T21:11:48.417918] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-13T21:11:49.217998] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-13T21:11:49.934914] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T21:11:50.017991] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-13T21:11:50.354044] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T21:11:50.742987] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T21:11:50.817978] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-13T21:11:51.617936] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-13T21:11:52.283500] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T21:11:52.417972] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-13T21:11:52.834955] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T21:11:53.217917] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-13T21:11:53.426455] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T21:11:53.973928] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T21:11:54.017917] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-13T21:11:54.817905] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-13T21:11:54.982699] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T21:11:55.432311] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T21:11:55.617929] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-13T21:11:56.417905] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-13T21:11:56.783492] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T21:11:57.218022] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-13T21:11:58.017939] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-13T21:11:58.207321] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T21:11:58.582602] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-13T21:11:58.818016] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-13T21:11:59.618026] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-13T21:11:59.630616] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T21:12:00.418043] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-13T21:12:00.674693] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T21:12:00.784890] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T21:12:01.217913] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-13T21:12:01.367398] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T21:12:02.017991] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-13T21:12:02.104416] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T21:12:02.818011] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-13T21:12:03.442621] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:12:03.448336] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-13T21:12:03.448497] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-13T21:12:03.449513] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:12:03.449634] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:12:03.449726] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:12:03.449801] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-13T21:12:03.449867] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-13T21:12:03.449903] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-13T21:12:03.449944] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-13T21:12:03.450003] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RF took 38.3s. Estimated remaining: 1h 21m 25s. Rate: 7.1 symbols/min [2025-10-13T21:12:03.629139] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-13T21:12:03.671110] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:12:03.671849] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T21:12:03.674178] [INFO ] [REMOTE ] RFI: Full fetch complete (15475 records). [2025-10-13T21:12:03.674383] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-13T21:12:03.804204] [DEBUG] [LOCAL ] RFMZ: Loaded 8849 existing records from primary storage. [2025-10-13T21:12:03.820168] [INFO ] [MAIN ] RFMZ: Loaded 8849 existing records. [2025-10-13T21:12:04.217920] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:12:04.222524] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-13T21:12:04.222595] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-13T21:12:04.223061] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-13T21:12:04.233754] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-13T21:12:04.434919] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-13T21:12:04.469590] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-13T21:12:04.497983] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-13T21:12:04.504994] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-13T21:12:04.509558] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-13T21:12:04.599303] [DEBUG] [LOCAL ] RFI: Trimmed 15475 records to 10454 (keeping 200 days of data) [2025-10-13T21:12:04.784050] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:12:04.803668] [DEBUG] [LOCAL ] RFI: Primary data saved (10454 records). [2025-10-13T21:12:04.803877] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-13T21:12:04.804000] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFI took 36.6s. Estimated remaining: 1h 21m 15s. Rate: 7.1 symbols/min [2025-10-13T21:12:04.981565] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:12:04.981791] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-13T21:12:04.981835] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-13T21:12:04.981947] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-13T21:12:04.981989] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-13T21:12:04.982028] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-13T21:12:04.982060] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-13T21:12:05.222736] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:12:05.221952] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-13T21:12:05.339660] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:12:05.411615] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:12:06.009675] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T21:12:06.017877] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-13T21:12:06.818038] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-13T21:12:07.385985] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T21:12:07.506389] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:12:07.617905] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-13T21:12:08.417926] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-13T21:12:09.106035] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T21:12:09.107569] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T21:12:09.217900] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-13T21:12:10.017939] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-13T21:12:10.793392] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T21:12:10.794822] [INFO ] [REMOTE ] RFL: Full fetch complete (13173 records). [2025-10-13T21:12:10.794897] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-13T21:12:10.823062] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-13T21:12:10.992197] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T21:12:11.206583] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-13T21:12:11.206711] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-13T21:12:11.207155] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-13T21:12:11.207220] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-13T21:12:11.208077] [DEBUG] [LOCAL ] RFL: Trimmed 13173 records to 11381 (keeping 200 days of data) [2025-10-13T21:12:11.275555] [DEBUG] [LOCAL ] RFL: Primary data saved (11381 records). [2025-10-13T21:12:11.275728] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-13T21:12:11.275820] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFL took 26.1s. Estimated remaining: 1h 21m 6s. Rate: 7.1 symbols/min [2025-10-13T21:12:11.448810] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:12:11.449007] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-13T21:12:11.449043] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-13T21:12:11.449151] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-13T21:12:11.449192] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-13T21:12:11.449232] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-13T21:12:11.449263] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-13T21:12:11.625713] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-13T21:12:11.771141] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T21:12:11.852837] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:12:12.417992] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-13T21:12:12.690829] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T21:12:13.217947] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-13T21:12:14.017965] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-13T21:12:14.062363] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:12:14.448002] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T21:12:14.681126] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T21:12:14.817941] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-13T21:12:15.619553] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-13T21:12:15.623070] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T21:12:16.417940] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-13T21:12:17.196638] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T21:12:17.217921] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-13T21:12:17.245298] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T21:12:17.904933] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T21:12:18.017983] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-13T21:12:18.817975] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-13T21:12:19.379925] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T21:12:19.380885] [INFO ] [REMOTE ] RFM: Full fetch complete (5843 records). [2025-10-13T21:12:19.380956] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-13T21:12:19.539280] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T21:12:19.627494] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-13T21:12:19.805323] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-13T21:12:19.805409] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-13T21:12:19.805623] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-13T21:12:19.805697] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-13T21:12:19.806141] [DEBUG] [LOCAL ] RFM: Trimmed 5843 records to 4122 (keeping 200 days of data) [2025-10-13T21:12:19.831849] [DEBUG] [LOCAL ] RFM: Primary data saved (4122 records). [2025-10-13T21:12:19.831962] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-13T21:12:19.832042] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFM took 32.3s. Estimated remaining: 1h 20m 57s. Rate: 7.1 symbols/min [2025-10-13T21:12:20.015100] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:12:20.021872] [DEBUG] [LOCAL ] RGT: Loaded 2744 existing records from primary storage. [2025-10-13T21:12:20.022130] [INFO ] [MAIN ] RGT: Loaded 2744 existing records. [2025-10-13T21:12:20.204352] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:12:20.204699] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-13T21:12:20.204764] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-13T21:12:20.205011] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-13T21:12:20.205077] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-13T21:12:20.424847] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-13T21:12:20.597069] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:12:20.614440] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:12:21.218001] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-13T21:12:22.017985] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-13T21:12:22.080211] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:12:22.096200] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T21:12:22.817919] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-13T21:12:22.940001] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T21:12:23.305255] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T21:12:23.617944] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-13T21:12:24.417935] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-13T21:12:24.527558] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T21:12:25.217998] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-13T21:12:25.547807] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T21:12:26.017942] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-13T21:12:26.091964] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T21:12:26.672878] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T21:12:26.817997] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-13T21:12:27.617936] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-13T21:12:27.926865] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T21:12:28.292960] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T21:12:28.417907] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-13T21:12:28.962866] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T21:12:29.217947] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-13T21:12:30.017972] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-13T21:12:30.459906] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T21:12:30.713900] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:12:30.715366] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12237 records). [2025-10-13T21:12:30.715478] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-13T21:12:30.823217] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-13T21:12:31.098832] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-13T21:12:31.099151] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-13T21:12:31.099532] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-13T21:12:31.099576] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-13T21:12:31.100113] [DEBUG] [LOCAL ] RFMZ: Trimmed 12237 records to 8651 (keeping 200 days of data) [2025-10-13T21:12:31.159786] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8651 records). [2025-10-13T21:12:31.159968] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-13T21:12:31.160106] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFMZ took 27.7s. Estimated remaining: 1h 20m 50s. Rate: 7.1 symbols/min [2025-10-13T21:12:31.339031] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:12:31.339285] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-13T21:12:31.339330] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-13T21:12:31.339487] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-13T21:12:31.339530] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-13T21:12:31.339571] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-13T21:12:31.339607] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-13T21:12:31.625342] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-13T21:12:31.720405] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:12:31.944610] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T21:12:32.418001] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-13T21:12:33.118316] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T21:12:33.218017] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-13T21:12:33.845369] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T21:12:34.017921] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-13T21:12:34.102506] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:12:34.817946] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-13T21:12:35.496993] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T21:12:35.617945] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-13T21:12:36.102604] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T21:12:36.417946] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-13T21:12:37.003543] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T21:12:37.217971] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-13T21:12:37.628000] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T21:12:37.864430] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:12:37.867727] [INFO ] [REMOTE ] RGA: Full fetch complete (45023 records). [2025-10-13T21:12:37.867818] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-13T21:12:37.868531] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:12:37.868615] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:12:37.868691] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:12:37.868750] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-13T21:12:37.868812] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-13T21:12:37.868849] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-13T21:12:37.868889] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-13T21:12:37.868945] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGA took 33.1s. Estimated remaining: 1h 20m 41s. Rate: 7.1 symbols/min [2025-10-13T21:12:38.017969] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-13T21:12:38.817967] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-13T21:12:39.419525] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T21:12:39.617925] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-13T21:12:39.734551] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T21:12:40.186695] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T21:12:40.417948] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-13T21:12:41.127546] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T21:12:41.217976] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-13T21:12:41.849348] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T21:12:42.017945] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-13T21:12:42.549240] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T21:12:42.817991] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-13T21:12:43.362549] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T21:12:43.617929] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-13T21:12:44.417970] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-13T21:12:45.110032] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T21:12:45.217910] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-13T21:12:45.763869] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T21:12:45.764574] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T21:12:45.765880] [INFO ] [REMOTE ] RGT: Full fetch complete (4038 records). [2025-10-13T21:12:45.770781] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-13T21:12:46.023427] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-13T21:12:46.146204] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-13T21:12:46.146290] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-13T21:12:46.146517] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-13T21:12:46.146565] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-13T21:12:46.146988] [DEBUG] [LOCAL ] RGT: Trimmed 4038 records to 2702 (keeping 200 days of data) [2025-10-13T21:12:46.164774] [DEBUG] [LOCAL ] RGT: Primary data saved (2702 records). [2025-10-13T21:12:46.164922] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-13T21:12:46.165023] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 26.3s. Estimated remaining: 1h 20m 32s. Rate: 7.1 symbols/min [2025-10-13T21:12:46.817947] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-13T21:12:47.267164] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:12:47.617989] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-13T21:12:48.636961] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:12:48.647920] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-13T21:12:48.908205] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T21:12:49.217939] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-13T21:12:49.793313] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T21:12:49.795979] [INFO ] [REMOTE ] RGR: Full fetch complete (28749 records). [2025-10-13T21:12:49.796083] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-13T21:12:49.796708] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:12:49.796799] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:12:49.796841] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:12:49.796881] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-13T21:12:49.796943] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-13T21:12:49.796980] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-13T21:12:49.797017] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-13T21:12:49.797074] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGR took 38.5s. Estimated remaining: 1h 20m 22s. Rate: 7.1 symbols/min [2025-10-13T21:12:50.941901] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-13T21:12:50.958944] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-13T21:12:53.002697] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T21:12:53.013132] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-13T21:12:54.827510] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T21:12:54.838300] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-13T21:12:56.748388] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T21:12:56.759556] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-13T21:12:58.643222] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T21:12:58.653117] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-13T21:13:00.621883] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T21:13:00.632272] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-13T21:13:01.452042] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T21:13:01.457086] [INFO ] [REMOTE ] RH: Full fetch complete (65370 records). [2025-10-13T21:13:01.457305] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-13T21:13:01.458148] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:01.458244] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:01.458288] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:01.458327] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-13T21:13:01.458392] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-13T21:13:01.458429] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-13T21:13:01.458469] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-13T21:13:01.458530] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RH took 30.3s. Estimated remaining: 1h 20m 15s. Rate: 7.1 symbols/min [2025-10-13T21:13:02.139398] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:02.175543] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-13T21:13:02.219053] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-13T21:13:02.260239] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-13T21:13:02.247099] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:02.261907] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-13T21:13:02.282900] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-13T21:13:02.284195] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-13T21:13:02.311843] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:02.318318] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-13T21:13:02.284086] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:02.348919] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-13T21:13:02.318556] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-13T21:13:02.385457] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-13T21:13:02.413074] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-13T21:13:02.396176] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-13T21:13:02.417325] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-13T21:13:02.417788] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-13T21:13:02.423676] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-13T21:13:02.434299] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-13T21:13:02.485266] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-13T21:13:02.518971] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-13T21:13:03.045044] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-10-13T21:13:03.164294] [INFO ] [MAIN ] RIG: Loaded 54450 existing records. [2025-10-13T21:13:03.525281] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:03.588575] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:03.608989] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-13T21:13:03.641588] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-13T21:13:03.689223] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:03.722333] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-13T21:13:03.757609] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:13:03.759123] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-13T21:13:03.759180] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-13T21:13:03.759756] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-13T21:13:03.759842] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-13T21:13:04.020766] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:13:04.049964] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-13T21:13:04.061168] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:13:04.061253] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-13T21:13:04.061392] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:13:04.061730] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-13T21:13:04.072365] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-13T21:13:04.077566] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-13T21:13:04.082764] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-13T21:13:04.082838] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 2.6s. Estimated remaining: 1h 20m 5s. Rate: 7.1 symbols/min [2025-10-13T21:13:04.246615] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:04.247076] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-13T21:13:04.324309] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:04.324486] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-13T21:13:04.324564] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-13T21:13:04.324726] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-13T21:13:04.324771] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-13T21:13:04.324813] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-13T21:13:04.324846] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-13T21:13:04.690875] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:04.691185] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-13T21:13:05.165161] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T21:13:05.173277] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-13T21:13:05.422106] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:13:05.432638] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-13T21:13:06.387585] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T21:13:06.396853] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-13T21:13:06.449577] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-13T21:13:06.461345] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-13T21:13:06.492845] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T21:13:06.504318] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-13T21:13:06.683429] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T21:13:06.692963] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-13T21:13:07.489083] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T21:13:07.496618] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-13T21:13:07.919335] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T21:13:07.929306] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-13T21:13:08.539745] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T21:13:08.551064] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-13T21:13:08.643158] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-13T21:13:08.654293] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-13T21:13:09.772875] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T21:13:09.783021] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-13T21:13:10.479845] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-13T21:13:10.490834] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-13T21:13:10.653214] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-13T21:13:10.665227] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-13T21:13:11.146014] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-13T21:13:11.156857] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-13T21:13:11.582849] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T21:13:11.593437] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-13T21:13:12.238985] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T21:13:12.250018] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-13T21:13:12.652589] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T21:13:12.664626] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-13T21:13:12.923608] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T21:13:12.933489] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-13T21:13:13.206212] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T21:13:13.218037] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-13T21:13:13.676772] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T21:13:14.017985] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-13T21:13:14.738249] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T21:13:14.817939] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-13T21:13:14.920804] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-13T21:13:15.370853] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-13T21:13:15.617931] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-13T21:13:15.744565] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T21:13:16.419030] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-13T21:13:16.422075] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T21:13:17.218015] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-13T21:13:17.725812] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T21:13:18.017999] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-13T21:13:18.321599] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T21:13:18.817938] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-13T21:13:18.869143] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T21:13:19.618046] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-13T21:13:20.277122] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-13T21:13:20.417929] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-13T21:13:20.835302] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T21:13:20.877428] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-13T21:13:21.217938] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-13T21:13:22.018017] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-13T21:13:22.463373] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T21:13:22.817941] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-13T21:13:23.337711] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T21:13:23.617917] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-13T21:13:23.924890] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T21:13:24.417974] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-13T21:13:25.141419] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T21:13:25.217930] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-13T21:13:25.666891] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T21:13:25.927389] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:13:25.934862] [INFO ] [REMOTE ] RHP: Full fetch complete (57696 records). [2025-10-13T21:13:25.935082] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-13T21:13:25.936117] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:25.936217] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:25.936262] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:25.936304] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-13T21:13:25.936371] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-13T21:13:25.936413] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-13T21:13:25.936453] [DEBUG] [LOCAL ] RHP: No derivative data file found to delete. [2025-10-13T21:13:25.936517] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHP took 24.4s. Estimated remaining: 1h 20m 0s. Rate: 7.1 symbols/min [2025-10-13T21:13:26.027234] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-13T21:13:26.124717] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:26.124930] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-13T21:13:26.124968] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-13T21:13:26.125083] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-13T21:13:26.125127] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-13T21:13:26.125170] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-13T21:13:26.125205] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-13T21:13:26.531743] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:26.703521] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-13T21:13:26.817994] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-13T21:13:27.542381] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:13:27.548135] [INFO ] [REMOTE ] RHI: Full fetch complete (69910 records). [2025-10-13T21:13:27.548360] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-13T21:13:27.549920] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:27.550068] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:27.550115] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:27.550186] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-13T21:13:27.550260] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-13T21:13:27.550297] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-13T21:13:27.550339] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-13T21:13:27.550407] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHI took 26.1s. Estimated remaining: 1h 19m 50s. Rate: 7.1 symbols/min [2025-10-13T21:13:27.623202] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-13T21:13:27.750141] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:27.750715] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-13T21:13:27.750770] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-13T21:13:27.750882] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-13T21:13:27.750923] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-13T21:13:27.750963] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-13T21:13:27.750994] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-13T21:13:28.119291] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:28.238021] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-13T21:13:28.417940] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-13T21:13:29.217986] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-13T21:13:29.530945] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T21:13:29.737303] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T21:13:30.018030] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-13T21:13:30.817983] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-13T21:13:30.984696] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T21:13:31.617935] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-13T21:13:32.200039] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T21:13:32.417936] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-13T21:13:32.734225] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T21:13:32.740197] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-10-13T21:13:32.740349] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-13T21:13:33.147941] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-13T21:13:33.148076] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-13T21:13:33.149376] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-13T21:13:33.159842] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-13T21:13:33.163873] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:13:33.169912] [INFO ] [REMOTE ] RIO: Full fetch complete (76973 records). [2025-10-13T21:13:33.170199] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-13T21:13:33.170112] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53673 (keeping 200 days of data) [2025-10-13T21:13:33.172129] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:33.172699] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:33.172969] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:33.173056] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-13T21:13:33.173273] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-13T21:13:33.173353] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-13T21:13:33.173550] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-13T21:13:33.173679] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RIO took 29.1s. Estimated remaining: 1h 19m 40s. Rate: 7.1 symbols/min [2025-10-13T21:13:33.255402] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-13T21:13:33.415232] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T21:13:33.485929] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:33.488486] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-13T21:13:33.489172] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-13T21:13:33.490314] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-13T21:13:33.491002] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-13T21:13:33.491803] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-13T21:13:33.493210] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-13T21:13:33.939108] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:34.045329] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-13T21:13:34.098162] [DEBUG] [LOCAL ] RIG: Primary data saved (53673 records). [2025-10-13T21:13:34.098319] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-13T21:13:34.098411] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 32.6s. Estimated remaining: 1h 19m 30s. Rate: 7.1 symbols/min [2025-10-13T21:13:34.265318] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:34.265501] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-13T21:13:34.265601] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-13T21:13:34.265739] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-13T21:13:34.265782] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-13T21:13:34.265823] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-13T21:13:34.265855] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-13T21:13:34.398466] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T21:13:34.631025] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:34.818006] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-13T21:13:35.544299] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T21:13:35.617941] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-13T21:13:36.258102] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T21:13:36.380050] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T21:13:36.417880] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-13T21:13:37.217987] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-13T21:13:37.282276] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T21:13:38.017942] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-13T21:13:38.818015] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-13T21:13:39.091541] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T21:13:39.617992] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-13T21:13:39.662637] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T21:13:39.909671] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T21:13:40.417934] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-13T21:13:41.218018] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-13T21:13:41.432145] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T21:13:42.017914] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-13T21:13:42.269704] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:13:42.271748] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T21:13:42.818027] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-13T21:13:43.581337] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:13:43.617878] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-13T21:13:44.417906] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-13T21:13:44.916320] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-13T21:13:45.049551] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T21:13:45.217978] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-13T21:13:46.018002] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-13T21:13:46.167373] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T21:13:46.817995] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-13T21:13:46.997980] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T21:13:47.294624] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-13T21:13:47.617927] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-13T21:13:48.417929] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-13T21:13:48.836730] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T21:13:49.217917] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-13T21:13:49.433230] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T21:13:50.018072] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-13T21:13:50.164611] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T21:13:50.236507] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T21:13:50.817971] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-13T21:13:51.617915] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-13T21:13:51.781209] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:13:51.909873] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T21:13:52.417921] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-13T21:13:53.217997] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-13T21:13:53.648310] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T21:13:54.017939] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-13T21:13:54.493121] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T21:13:54.730096] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:13:54.817899] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-13T21:13:55.617937] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-13T21:13:56.223754] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-13T21:13:56.417999] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-13T21:13:56.928742] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T21:13:57.094705] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:13:57.096824] [INFO ] [REMOTE ] RIV: Full fetch complete (17637 records). [2025-10-13T21:13:57.096899] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-13T21:13:57.097374] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:57.098345] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:57.098467] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:57.098549] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-13T21:13:57.098628] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-13T21:13:57.098708] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-13T21:13:57.098766] [DEBUG] [LOCAL ] RIV: No derivative data file found to delete. [2025-10-13T21:13:57.098852] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIV took 29.5s. Estimated remaining: 1h 19m 26s. Rate: 7.1 symbols/min [2025-10-13T21:13:57.223096] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-13T21:13:57.293015] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:57.293460] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-13T21:13:57.293606] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-13T21:13:57.293760] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-13T21:13:57.293803] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-13T21:13:57.293871] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-13T21:13:57.293905] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-13T21:13:57.683118] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:57.715546] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T21:13:58.018016] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-13T21:13:58.735891] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:13:58.741162] [INFO ] [REMOTE ] RITM: Full fetch complete (76222 records). [2025-10-13T21:13:58.741291] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-13T21:13:58.742224] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:13:58.742321] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:13:58.742363] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:13:58.742401] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-13T21:13:58.742482] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-13T21:13:58.742540] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-13T21:13:58.742584] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-13T21:13:58.742664] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 32.8s. Estimated remaining: 1h 19m 15s. Rate: 7.1 symbols/min [2025-10-13T21:13:58.821047] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-13T21:13:58.932563] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:13:58.932982] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-13T21:13:58.933139] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-13T21:13:58.933266] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-13T21:13:58.933308] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-13T21:13:58.933348] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-13T21:13:58.933379] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-13T21:13:59.399353] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T21:13:59.445849] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:13:59.618008] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-13T21:14:00.418054] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-13T21:14:00.547875] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T21:14:00.599799] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T21:14:01.217939] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-13T21:14:02.018048] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-13T21:14:02.233321] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T21:14:02.817906] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-13T21:14:03.034432] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T21:14:03.617901] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-13T21:14:03.914452] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T21:14:04.417917] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-13T21:14:04.512956] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T21:14:05.217900] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-13T21:14:05.336912] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T21:14:06.017932] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-13T21:14:06.181702] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T21:14:06.186254] [INFO ] [REMOTE ] RJF: Full fetch complete (67931 records). [2025-10-13T21:14:06.186370] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-13T21:14:06.187117] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:14:06.187211] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:14:06.187281] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:14:06.187367] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-13T21:14:06.187445] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-13T21:14:06.187483] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-13T21:14:06.187523] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-13T21:14:06.187580] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 33.0s. Estimated remaining: 1h 19m 6s. Rate: 7.1 symbols/min [2025-10-13T21:14:06.374774] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:06.375194] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-13T21:14:06.375368] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-13T21:14:06.375602] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-13T21:14:06.375684] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-13T21:14:06.375755] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-13T21:14:06.375827] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-13T21:14:06.641662] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T21:14:06.823136] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-13T21:14:06.828426] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:07.425315] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T21:14:07.617914] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-13T21:14:08.417907] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-13T21:14:08.791303] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T21:14:09.096726] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:14:09.217985] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-13T21:14:10.018021] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-13T21:14:10.207469] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T21:14:10.817992] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-13T21:14:11.617913] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-13T21:14:11.672935] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T21:14:12.112552] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-13T21:14:12.256777] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T21:14:12.417968] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-13T21:14:13.218029] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-13T21:14:13.294632] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:14:13.929615] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T21:14:14.017994] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-13T21:14:14.823128] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-13T21:14:14.839319] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:14:14.971800] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T21:14:15.617933] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-13T21:14:16.417972] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-13T21:14:16.750704] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T21:14:17.217937] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-13T21:14:17.287921] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T21:14:18.018032] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-13T21:14:18.818865] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-13T21:14:18.822571] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-13T21:14:18.887034] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T21:14:19.450815] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T21:14:19.617943] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-13T21:14:20.423042] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-13T21:14:20.442817] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T21:14:21.217907] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-13T21:14:21.353831] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:14:22.017986] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-13T21:14:22.268513] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T21:14:22.693267] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:14:22.698677] [INFO ] [REMOTE ] RKT: Full fetch complete (77053 records). [2025-10-13T21:14:22.698810] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-13T21:14:22.699588] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:14:22.699699] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:14:22.699750] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:14:22.699791] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-13T21:14:22.699893] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-13T21:14:22.699949] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-13T21:14:22.699992] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-13T21:14:22.700053] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RKT took 48.6s. Estimated remaining: 1h 19m 1s. Rate: 7.1 symbols/min [2025-10-13T21:14:22.821935] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-13T21:14:22.889334] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:22.926069] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T21:14:22.948437] [DEBUG] [LOCAL ] RLTY: Loaded 11311 existing records from primary storage. [2025-10-13T21:14:22.948772] [INFO ] [MAIN ] RLTY: Loaded 11311 existing records. [2025-10-13T21:14:23.139291] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:14:23.139562] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-13T21:14:23.139618] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-13T21:14:23.140056] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-13T21:14:23.140118] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-13T21:14:23.482353] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:23.617991] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-13T21:14:24.327382] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T21:14:24.417987] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-13T21:14:24.700600] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T21:14:25.217984] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-13T21:14:25.901807] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T21:14:26.017990] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-13T21:14:26.217800] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T21:14:26.817975] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-13T21:14:27.431712] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T21:14:27.435609] [INFO ] [REMOTE ] RLI: Full fetch complete (47797 records). [2025-10-13T21:14:27.435735] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-13T21:14:27.436381] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:14:27.436473] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:14:27.436523] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:14:27.436566] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-13T21:14:27.436630] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-13T21:14:27.436705] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-13T21:14:27.436763] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-13T21:14:27.436822] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 28.7s. Estimated remaining: 1h 18m 51s. Rate: 7.1 symbols/min [2025-10-13T21:14:27.614752] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:27.617944] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-13T21:14:27.668783] [DEBUG] [LOCAL ] RLX: Loaded 48848 existing records from primary storage. [2025-10-13T21:14:27.669170] [INFO ] [MAIN ] RLX: Loaded 48848 existing records. [2025-10-13T21:14:27.846955] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:14:27.847570] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-13T21:14:27.847632] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-13T21:14:27.859140] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-13T21:14:27.864347] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-13T21:14:27.984096] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T21:14:28.248507] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:28.417933] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-13T21:14:29.168890] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:14:29.217895] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-13T21:14:29.789129] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T21:14:30.017943] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-13T21:14:30.817917] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-13T21:14:31.078487] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T21:14:31.617933] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-13T21:14:31.698382] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T21:14:32.244714] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:14:32.248294] [INFO ] [REMOTE ] RL: Full fetch complete (59502 records). [2025-10-13T21:14:32.248400] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-13T21:14:32.249148] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:14:32.249276] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:14:32.249318] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:14:32.249384] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-13T21:14:32.249448] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-13T21:14:32.249483] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-13T21:14:32.249522] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-13T21:14:32.249579] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 35.2s. Estimated remaining: 1h 18m 41s. Rate: 7.1 symbols/min [2025-10-13T21:14:32.431985] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-13T21:14:32.436223] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:32.449241] [DEBUG] [LOCAL ] RM: Loaded 7610 existing records from primary storage. [2025-10-13T21:14:32.449548] [INFO ] [MAIN ] RM: Loaded 7610 existing records. [2025-10-13T21:14:32.672769] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T21:14:32.670477] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:14:32.682418] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-13T21:14:32.682743] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-13T21:14:32.683367] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-13T21:14:32.683433] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-13T21:14:33.037758] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:33.217931] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-13T21:14:34.017901] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-13T21:14:34.028039] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T21:14:34.195110] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T21:14:34.817917] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-13T21:14:35.081976] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T21:14:35.617921] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-13T21:14:35.872268] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T21:14:36.417926] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-13T21:14:37.218056] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-13T21:14:37.542326] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:14:38.017985] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-13T21:14:38.120007] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T21:14:38.153471] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:14:38.817928] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-13T21:14:39.617917] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-13T21:14:39.812949] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:14:40.418035] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-13T21:14:40.445044] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T21:14:40.500960] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T21:14:41.217895] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-13T21:14:41.337386] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T21:14:42.017939] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-13T21:14:42.045906] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T21:14:42.818008] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-13T21:14:43.013258] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T21:14:43.617899] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-13T21:14:43.690266] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T21:14:44.417909] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-13T21:14:44.569917] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T21:14:45.217910] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-13T21:14:45.351326] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T21:14:46.017944] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-13T21:14:46.247333] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T21:14:46.817947] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-13T21:14:47.617900] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-13T21:14:47.686363] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T21:14:48.142059] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T21:14:48.417974] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-13T21:14:48.489635] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T21:14:49.218033] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-13T21:14:50.018019] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-13T21:14:50.054391] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T21:14:50.059202] [INFO ] [REMOTE ] RLJ: Full fetch complete (68840 records). [2025-10-13T21:14:50.059325] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-13T21:14:50.060120] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:14:50.060212] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:14:50.060255] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:14:50.060339] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-13T21:14:50.060415] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-13T21:14:50.060493] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-13T21:14:50.060544] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-13T21:14:50.060601] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLJ took 43.9s. Estimated remaining: 1h 18m 36s. Rate: 7.1 symbols/min [2025-10-13T21:14:50.228438] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:50.228706] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-13T21:14:50.228758] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-13T21:14:50.228870] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-13T21:14:50.228911] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-13T21:14:50.228951] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-13T21:14:50.228981] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-13T21:14:50.585525] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-13T21:14:50.623844] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:50.817939] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-13T21:14:51.280215] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T21:14:51.617903] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-13T21:14:51.672794] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T21:14:52.418017] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-13T21:14:53.217910] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-13T21:14:53.275185] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T21:14:53.452411] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T21:14:54.018371] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-13T21:14:54.018891] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T21:14:54.818019] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-13T21:14:54.840406] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T21:14:54.842049] [INFO ] [REMOTE ] RLTY: Full fetch complete (17430 records). [2025-10-13T21:14:54.842121] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-13T21:14:55.255527] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-13T21:14:55.255639] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-13T21:14:55.256260] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-13T21:14:55.256306] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-13T21:14:55.257312] [DEBUG] [LOCAL ] RLTY: Trimmed 17430 records to 11147 (keeping 200 days of data) [2025-10-13T21:14:55.326764] [DEBUG] [LOCAL ] RLTY: Primary data saved (11147 records). [2025-10-13T21:14:55.326913] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-13T21:14:55.327004] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLTY took 32.6s. Estimated remaining: 1h 18m 26s. Rate: 7.1 symbols/min [2025-10-13T21:14:55.501636] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:55.501840] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-13T21:14:55.501880] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-13T21:14:55.502012] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-13T21:14:55.502054] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-13T21:14:55.502095] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-13T21:14:55.502129] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-13T21:14:55.623059] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-13T21:14:55.868079] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:14:55.880913] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T21:14:56.417919] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-13T21:14:56.584259] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:14:57.218052] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-13T21:14:58.028756] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-13T21:14:58.031816] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:14:58.289198] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T21:14:58.752575] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:14:58.753933] [INFO ] [REMOTE ] RM: Full fetch complete (11517 records). [2025-10-13T21:14:58.754007] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-13T21:14:58.823116] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-13T21:14:59.114394] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-13T21:14:59.114475] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-13T21:14:59.114789] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-13T21:14:59.114848] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-13T21:14:59.115315] [DEBUG] [LOCAL ] RM: Trimmed 11517 records to 7540 (keeping 200 days of data) [2025-10-13T21:14:59.164022] [DEBUG] [LOCAL ] RM: Primary data saved (7540 records). [2025-10-13T21:14:59.164138] [INFO ] [MAIN ] RM: Full history saved. [2025-10-13T21:14:59.164221] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 26.9s. Estimated remaining: 1h 18m 17s. Rate: 7.1 symbols/min [2025-10-13T21:14:59.330668] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:14:59.330847] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-13T21:14:59.330889] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-13T21:14:59.330998] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-13T21:14:59.331038] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-13T21:14:59.331082] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-13T21:14:59.331114] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-13T21:14:59.623147] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-13T21:14:59.685172] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:00.417975] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-13T21:15:00.612390] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T21:15:01.217980] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-13T21:15:01.530592] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T21:15:01.594768] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T21:15:01.788819] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T21:15:02.018230] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-13T21:15:02.818037] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-13T21:15:03.400114] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T21:15:03.617945] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-13T21:15:03.853572] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T21:15:04.417977] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-13T21:15:04.845125] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T21:15:04.860590] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T21:15:05.217946] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-13T21:15:06.017943] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-13T21:15:06.817905] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-13T21:15:07.063768] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:15:07.617926] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-13T21:15:07.834003] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T21:15:07.885893] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T21:15:08.067195] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T21:15:08.417938] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-13T21:15:09.218027] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-13T21:15:09.574935] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T21:15:10.017947] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-13T21:15:10.724822] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T21:15:10.818006] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-13T21:15:11.213629] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T21:15:11.617913] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-13T21:15:12.418042] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-13T21:15:12.744311] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-13T21:15:12.752032] [INFO ] [REMOTE ] RLX: Full fetch complete (70098 records). [2025-10-13T21:15:12.752231] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-13T21:15:13.115532] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T21:15:13.187138] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-13T21:15:13.187246] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-13T21:15:13.188440] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-13T21:15:13.188519] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-13T21:15:13.190280] [DEBUG] [LOCAL ] RLX: Trimmed 70098 records to 48124 (keeping 200 days of data) [2025-10-13T21:15:13.238611] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-13T21:15:13.423751] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T21:15:13.518349] [DEBUG] [LOCAL ] RLX: Primary data saved (48124 records). [2025-10-13T21:15:13.518515] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-13T21:15:13.518613] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLX took 46.1s. Estimated remaining: 1h 18m 10s. Rate: 7.1 symbols/min [2025-10-13T21:15:13.687540] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:13.687762] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-13T21:15:13.687862] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-13T21:15:13.688049] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-13T21:15:13.688107] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-13T21:15:13.688159] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-13T21:15:13.688197] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-13T21:15:13.873865] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T21:15:14.020069] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-13T21:15:14.047397] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:14.817911] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-13T21:15:15.617939] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-13T21:15:15.704968] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T21:15:15.753012] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T21:15:16.417921] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-13T21:15:16.578531] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T21:15:17.217939] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-13T21:15:17.953743] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T21:15:18.017901] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-13T21:15:18.200368] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T21:15:18.818001] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-13T21:15:18.847969] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T21:15:19.617371] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T21:15:19.619474] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-13T21:15:20.418022] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-13T21:15:20.839259] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T21:15:20.918406] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T21:15:21.217996] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-13T21:15:22.017976] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-13T21:15:22.586118] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T21:15:22.784193] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:15:22.817899] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-13T21:15:23.617922] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-13T21:15:23.916445] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-13T21:15:23.917472] [INFO ] [REMOTE ] RMI: Full fetch complete (6053 records). [2025-10-13T21:15:23.917567] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-13T21:15:23.918069] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:15:23.918157] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:15:23.918225] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:15:23.918298] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-13T21:15:23.918363] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-13T21:15:23.918461] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-13T21:15:23.918551] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-13T21:15:23.918702] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMI took 24.8s. Estimated remaining: 1h 18m 2s. Rate: 7.1 symbols/min [2025-10-13T21:15:24.125920] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:24.136856] [DEBUG] [LOCAL ] RMMZ: Loaded 4879 existing records from primary storage. [2025-10-13T21:15:24.137179] [INFO ] [MAIN ] RMMZ: Loaded 4879 existing records. [2025-10-13T21:15:24.342300] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:15:24.343744] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-13T21:15:24.343806] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-13T21:15:24.344571] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-13T21:15:24.344637] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-13T21:15:24.422116] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-13T21:15:24.640861] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:15:24.721082] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:25.217934] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-13T21:15:25.706584] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T21:15:26.017927] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-13T21:15:26.532849] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T21:15:26.535063] [INFO ] [REMOTE ] RMAX: Full fetch complete (29690 records). [2025-10-13T21:15:26.535135] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-13T21:15:26.535759] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:15:26.535841] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:15:26.535883] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:15:26.535928] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-13T21:15:26.535982] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-13T21:15:26.536017] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-13T21:15:26.536078] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-13T21:15:26.536191] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMAX took 36.5s. Estimated remaining: 1h 17m 52s. Rate: 7.1 symbols/min [2025-10-13T21:15:26.702242] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:26.722350] [DEBUG] [LOCAL ] RMT: Loaded 17653 existing records from primary storage. [2025-10-13T21:15:26.722590] [INFO ] [MAIN ] RMT: Loaded 17653 existing records. [2025-10-13T21:15:26.818268] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-13T21:15:26.900297] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:15:26.900607] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-13T21:15:26.900787] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-13T21:15:26.901268] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-13T21:15:26.901397] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-13T21:15:27.252479] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T21:15:27.295983] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:27.617923] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-13T21:15:27.821017] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T21:15:28.418032] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-13T21:15:29.203545] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T21:15:29.217906] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-13T21:15:29.255622] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:15:30.017929] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-13T21:15:30.069863] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T21:15:30.774474] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T21:15:30.817993] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-13T21:15:31.617931] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-13T21:15:31.825572] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T21:15:32.417976] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-13T21:15:32.736210] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T21:15:33.043401] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:15:33.047543] [INFO ] [REMOTE ] RMD: Full fetch complete (60765 records). [2025-10-13T21:15:33.047701] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-13T21:15:33.048400] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:15:33.048487] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:15:33.048531] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:15:33.048570] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-13T21:15:33.048632] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-13T21:15:33.048709] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-13T21:15:33.048766] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-13T21:15:33.048919] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMD took 37.7s. Estimated remaining: 1h 17m 43s. Rate: 7.1 symbols/min [2025-10-13T21:15:33.223781] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-13T21:15:33.223639] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:33.225281] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-13T21:15:33.225353] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-13T21:15:33.225481] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-13T21:15:33.225522] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-13T21:15:33.225564] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-13T21:15:33.225596] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-13T21:15:33.589807] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:34.017996] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-13T21:15:34.182061] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T21:15:34.817945] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-13T21:15:35.617902] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-13T21:15:35.696192] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:15:35.734874] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T21:15:36.214980] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T21:15:36.417939] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-13T21:15:36.978760] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T21:15:37.217997] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-13T21:15:37.966229] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T21:15:38.017942] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-13T21:15:38.817920] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-13T21:15:39.111344] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T21:15:39.617948] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-13T21:15:40.232360] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T21:15:40.285355] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T21:15:40.417938] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-13T21:15:41.087348] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T21:15:41.217944] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-13T21:15:42.017899] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-13T21:15:42.677437] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:15:42.817903] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-13T21:15:42.995415] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T21:15:43.617989] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-13T21:15:44.170404] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T21:15:44.171990] [INFO ] [REMOTE ] RMM: Full fetch complete (14774 records). [2025-10-13T21:15:44.172067] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-13T21:15:44.172482] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:15:44.172569] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:15:44.172613] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:15:44.172694] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-13T21:15:44.172782] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-13T21:15:44.172823] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-13T21:15:44.172864] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-13T21:15:44.172927] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 30.7s. Estimated remaining: 1h 17m 35s. Rate: 7.1 symbols/min [2025-10-13T21:15:44.365581] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:44.365837] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-13T21:15:44.365897] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-13T21:15:44.366017] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-13T21:15:44.366060] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-13T21:15:44.366102] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-13T21:15:44.366176] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-13T21:15:44.423289] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-13T21:15:44.787174] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:44.826998] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T21:15:45.092158] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T21:15:45.218094] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-13T21:15:46.018041] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-13T21:15:46.400094] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T21:15:46.817963] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-13T21:15:47.153621] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T21:15:47.567808] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T21:15:47.617924] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-13T21:15:48.417938] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-13T21:15:48.916561] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T21:15:49.181093] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T21:15:49.217900] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-13T21:15:49.872634] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T21:15:50.021633] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-13T21:15:50.619670] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T21:15:50.621539] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6900 records). [2025-10-13T21:15:50.621928] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-13T21:15:50.823145] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-13T21:15:50.989360] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-13T21:15:50.989444] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-13T21:15:50.989741] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-13T21:15:50.989814] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-13T21:15:50.990196] [DEBUG] [LOCAL ] RMMZ: Trimmed 6900 records to 4799 (keeping 200 days of data) [2025-10-13T21:15:51.019845] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4799 records). [2025-10-13T21:15:51.019929] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-13T21:15:51.020023] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMMZ took 27.1s. Estimated remaining: 1h 17m 26s. Rate: 7.1 symbols/min [2025-10-13T21:15:51.188174] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:15:51.208870] [DEBUG] [LOCAL ] RNP: Loaded 16376 existing records from primary storage. [2025-10-13T21:15:51.209147] [INFO ] [MAIN ] RNP: Loaded 16376 existing records. [2025-10-13T21:15:51.388826] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:15:51.389070] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-13T21:15:51.389118] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-13T21:15:51.389418] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-13T21:15:51.389474] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-13T21:15:51.625439] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-13T21:15:51.748815] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:15:52.053782] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T21:15:52.418035] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-13T21:15:52.849728] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T21:15:53.041535] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T21:15:53.218012] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-13T21:15:54.017974] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-13T21:15:54.395280] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T21:15:54.817930] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-13T21:15:55.085922] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T21:15:55.617942] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-13T21:15:56.417927] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-13T21:15:56.660113] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T21:15:56.689875] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T21:15:57.217927] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-13T21:15:57.479014] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T21:15:58.017983] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-13T21:15:58.245045] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T21:15:58.817912] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-13T21:15:59.100422] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T21:15:59.516827] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T21:15:59.617909] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-13T21:16:00.418014] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-13T21:16:00.860950] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T21:16:01.218021] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-13T21:16:01.617130] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:16:02.017931] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-13T21:16:02.817903] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-13T21:16:03.123819] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T21:16:03.197208] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T21:16:03.617922] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-13T21:16:03.968325] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T21:16:04.417895] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-13T21:16:04.759309] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T21:16:05.217993] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-13T21:16:06.017921] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-13T21:16:06.127811] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T21:16:06.130996] [INFO ] [REMOTE ] RMT: Full fetch complete (25517 records). [2025-10-13T21:16:06.154231] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-13T21:16:06.156288] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T21:16:06.528339] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-13T21:16:06.528424] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-13T21:16:06.529235] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-13T21:16:06.529297] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-13T21:16:06.530382] [DEBUG] [LOCAL ] RMT: Trimmed 25517 records to 17360 (keeping 200 days of data) [2025-10-13T21:16:06.637462] [DEBUG] [LOCAL ] RMT: Primary data saved (17360 records). [2025-10-13T21:16:06.637615] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-13T21:16:06.637729] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMT took 40.1s. Estimated remaining: 1h 17m 20s. Rate: 7.1 symbols/min [2025-10-13T21:16:06.803584] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:06.803802] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-13T21:16:06.803846] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-13T21:16:06.803959] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-13T21:16:06.804000] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-13T21:16:06.804041] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-13T21:16:06.804072] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-13T21:16:06.823983] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-13T21:16:07.095756] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T21:16:07.177435] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:07.617921] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-13T21:16:08.417895] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-13T21:16:08.723266] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T21:16:08.966729] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T21:16:09.217936] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-13T21:16:09.576932] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:16:10.017994] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-13T21:16:10.818040] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-13T21:16:11.028697] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T21:16:11.071569] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T21:16:11.618029] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-13T21:16:12.099827] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T21:16:12.417933] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-13T21:16:13.217909] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-13T21:16:13.332020] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:16:13.386130] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T21:16:14.017915] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-13T21:16:14.251706] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T21:16:14.817936] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-13T21:16:15.020396] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T21:16:15.617907] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-13T21:16:16.417986] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-13T21:16:16.662292] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T21:16:17.015547] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T21:16:17.017990] [INFO ] [REMOTE ] RNGR: Full fetch complete (28154 records). [2025-10-13T21:16:17.018070] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-13T21:16:17.018733] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:17.018799] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:17.018835] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:17.018900] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-13T21:16:17.018964] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-13T21:16:17.018999] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-13T21:16:17.019038] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-13T21:16:17.019112] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RNGR took 32.8s. Estimated remaining: 1h 17m 12s. Rate: 7.1 symbols/min [2025-10-13T21:16:17.186433] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:17.186674] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-13T21:16:17.186730] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-13T21:16:17.186841] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-13T21:16:17.186882] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-13T21:16:17.186921] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-13T21:16:17.186957] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-13T21:16:17.223009] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-13T21:16:17.547592] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:18.017976] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-13T21:16:18.135817] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T21:16:18.141290] [INFO ] [REMOTE ] RNG: Full fetch complete (69109 records). [2025-10-13T21:16:18.141423] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-13T21:16:18.142170] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:18.142261] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:18.142304] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:18.142345] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-13T21:16:18.142407] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-13T21:16:18.142443] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-13T21:16:18.142482] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-13T21:16:18.142541] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNG took 45.1s. Estimated remaining: 1h 17m 2s. Rate: 7.1 symbols/min [2025-10-13T21:16:18.326928] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:18.327290] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-13T21:16:18.327392] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-13T21:16:18.327720] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-13T21:16:18.327774] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-13T21:16:18.327819] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-13T21:16:18.327876] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-13T21:16:18.465923] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (3.65 seconds). [2025-10-13T21:16:18.722877] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:18.818006] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-13T21:16:19.497230] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T21:16:19.617929] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-13T21:16:19.863632] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T21:16:19.867529] [INFO ] [REMOTE ] RNP: Full fetch complete (23771 records). [2025-10-13T21:16:19.867692] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-13T21:16:20.268787] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-13T21:16:20.268906] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-13T21:16:20.269800] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-13T21:16:20.269866] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-13T21:16:20.270993] [DEBUG] [LOCAL ] RNP: Trimmed 23771 records to 16180 (keeping 200 days of data) [2025-10-13T21:16:20.375852] [DEBUG] [LOCAL ] RNP: Primary data saved (16180 records). [2025-10-13T21:16:20.376023] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-13T21:16:20.376120] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNP took 29.4s. Estimated remaining: 1h 16m 51s. Rate: 7.1 symbols/min [2025-10-13T21:16:20.423154] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-13T21:16:20.565036] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:20.565255] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-13T21:16:20.565292] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-13T21:16:20.565405] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-13T21:16:20.565447] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-13T21:16:20.565486] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-13T21:16:20.565519] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-13T21:16:20.917128] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:21.223689] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-13T21:16:21.226249] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T21:16:21.248898] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T21:16:22.017941] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-13T21:16:22.818019] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-13T21:16:23.100613] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T21:16:23.617926] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-13T21:16:24.378534] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T21:16:24.417936] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-13T21:16:24.570944] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-13T21:16:24.812847] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T21:16:25.218040] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-13T21:16:26.018033] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-13T21:16:26.091255] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T21:16:26.817985] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-13T21:16:26.917976] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T21:16:27.617992] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-13T21:16:27.791744] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T21:16:27.960778] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:16:28.417931] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-13T21:16:29.191008] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T21:16:29.217933] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-13T21:16:30.017945] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-13T21:16:30.153870] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:16:30.817932] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-13T21:16:31.384516] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T21:16:31.617977] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-13T21:16:31.890794] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T21:16:32.031510] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T21:16:32.418025] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-13T21:16:33.207898] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T21:16:33.217874] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-13T21:16:34.017908] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-13T21:16:34.211307] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T21:16:34.817906] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-13T21:16:34.907939] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:16:35.477981] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T21:16:35.617933] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-13T21:16:36.417941] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-13T21:16:36.659467] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T21:16:37.124141] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:16:37.218010] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-13T21:16:37.690364] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T21:16:38.017997] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-13T21:16:38.817946] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-13T21:16:39.046310] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T21:16:39.210986] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T21:16:39.617918] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-13T21:16:40.094764] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T21:16:40.417923] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-13T21:16:40.949007] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T21:16:41.217983] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-13T21:16:42.017944] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-13T21:16:42.047162] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:16:42.817903] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-13T21:16:42.866725] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T21:16:43.261374] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:16:43.617982] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-13T21:16:44.264806] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T21:16:44.417945] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-13T21:16:45.217919] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-13T21:16:45.462793] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T21:16:45.612729] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T21:16:46.017883] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-13T21:16:46.334278] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T21:16:46.817933] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-13T21:16:47.341224] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T21:16:47.343383] [INFO ] [REMOTE ] ROG: Full fetch complete (30744 records). [2025-10-13T21:16:47.343459] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-13T21:16:47.344032] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:47.344115] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:47.344156] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:47.344193] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-13T21:16:47.344245] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-13T21:16:47.344279] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-13T21:16:47.344319] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-13T21:16:47.344374] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. ROG took 29.2s. Estimated remaining: 1h 16m 48s. Rate: 7.1 symbols/min [2025-10-13T21:16:47.509202] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:47.509463] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-13T21:16:47.509537] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-13T21:16:47.509721] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-13T21:16:47.509794] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-13T21:16:47.509853] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-13T21:16:47.509886] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-13T21:16:47.620090] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-13T21:16:47.876410] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:47.902105] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T21:16:48.417936] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-13T21:16:49.129376] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T21:16:49.219297] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-13T21:16:49.222612] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T21:16:49.857170] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T21:16:49.861396] [INFO ] [REMOTE ] ROK: Full fetch complete (62311 records). [2025-10-13T21:16:49.861601] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-13T21:16:49.862425] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:49.862513] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:49.862556] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:49.862595] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-13T21:16:49.862680] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-13T21:16:49.862737] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-13T21:16:49.862780] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-13T21:16:49.862840] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. ROK took 29.5s. Estimated remaining: 1h 16m 38s. Rate: 7.1 symbols/min [2025-10-13T21:16:50.030718] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-13T21:16:50.035335] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:50.036429] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-13T21:16:50.036480] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-13T21:16:50.036569] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-13T21:16:50.036605] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-13T21:16:50.036674] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-13T21:16:50.036730] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-13T21:16:50.404230] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:50.817939] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-13T21:16:51.577999] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:16:51.617930] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-13T21:16:52.418027] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-13T21:16:52.601708] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:16:52.667493] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T21:16:52.827618] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T21:16:52.831508] [INFO ] [REMOTE ] RNR: Full fetch complete (50711 records). [2025-10-13T21:16:52.831691] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-13T21:16:52.832377] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:52.832490] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:52.832560] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:52.832680] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-13T21:16:52.832765] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-13T21:16:52.832802] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-13T21:16:52.832842] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-13T21:16:52.832901] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. RNR took 46.2s. Estimated remaining: 1h 16m 28s. Rate: 7.1 symbols/min [2025-10-13T21:16:53.026331] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:53.048359] [DEBUG] [LOCAL ] RPT: Loaded 19290 existing records from primary storage. [2025-10-13T21:16:53.048695] [INFO ] [MAIN ] RPT: Loaded 19290 existing records. [2025-10-13T21:16:53.223138] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-13T21:16:53.227852] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:16:53.229463] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-13T21:16:53.229541] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-13T21:16:53.229888] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-13T21:16:53.229962] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-13T21:16:53.640784] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:53.924429] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:16:53.928602] [INFO ] [REMOTE ] RNST: Full fetch complete (52636 records). [2025-10-13T21:16:53.929011] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-13T21:16:53.929867] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:16:53.929961] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:16:53.930005] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:16:53.930043] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-13T21:16:53.930102] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-13T21:16:53.930140] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-13T21:16:53.930179] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-13T21:16:53.930240] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 36.9s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-13T21:16:54.023096] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-13T21:16:54.130558] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:16:54.130811] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-13T21:16:54.130853] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-13T21:16:54.130971] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-13T21:16:54.131012] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-13T21:16:54.131051] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-13T21:16:54.131082] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-13T21:16:54.542725] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:16:54.817919] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-13T21:16:55.179283] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T21:16:55.617982] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-13T21:16:56.347884] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T21:16:56.417992] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-13T21:16:57.217982] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-13T21:16:57.448298] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T21:16:58.017992] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-13T21:16:58.402557] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T21:16:58.817948] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-13T21:16:59.618000] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-13T21:16:59.688468] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (4.07 seconds). [2025-10-13T21:16:59.815297] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T21:16:59.923029] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T21:17:00.417978] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-13T21:17:00.903543] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T21:17:01.218000] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-13T21:17:02.017918] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-13T21:17:02.139544] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T21:17:02.332828] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T21:17:02.818013] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-13T21:17:03.111589] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T21:17:03.619533] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-13T21:17:04.030009] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T21:17:04.418004] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-13T21:17:05.217941] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-13T21:17:05.243386] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T21:17:06.017939] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-13T21:17:06.294299] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T21:17:06.817932] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-13T21:17:07.399956] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T21:17:07.617908] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-13T21:17:07.928440] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-13T21:17:08.418010] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-13T21:17:09.217979] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-13T21:17:09.337154] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T21:17:09.685171] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T21:17:10.017920] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-13T21:17:10.341231] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T21:17:10.811846] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (3.99 seconds). [2025-10-13T21:17:10.822365] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-13T21:17:11.617979] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-13T21:17:11.905909] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T21:17:12.418035] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-13T21:17:13.217983] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-13T21:17:13.499714] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T21:17:14.018016] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-13T21:17:14.148757] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (4.13 seconds). [2025-10-13T21:17:14.275221] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-13T21:17:14.537351] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:17:14.817939] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-13T21:17:14.917372] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T21:17:15.617945] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-13T21:17:16.417916] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-13T21:17:16.722490] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T21:17:16.907467] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T21:17:17.217989] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-13T21:17:17.579523] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T21:17:18.018007] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-13T21:17:18.818007] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-13T21:17:19.050467] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T21:17:19.589343] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T21:17:19.617892] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-13T21:17:20.241633] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:17:20.244042] [INFO ] [REMOTE ] RPT: Full fetch complete (28465 records). [2025-10-13T21:17:20.244178] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-13T21:17:20.423892] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-13T21:17:20.626113] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-13T21:17:20.626212] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-13T21:17:20.627037] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-13T21:17:20.627101] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-13T21:17:20.628151] [DEBUG] [LOCAL ] RPT: Trimmed 28465 records to 19122 (keeping 200 days of data) [2025-10-13T21:17:20.742975] [DEBUG] [LOCAL ] RPT: Primary data saved (19122 records). [2025-10-13T21:17:20.743149] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-13T21:17:20.743241] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. RPT took 27.9s. Estimated remaining: 1h 16m 15s. Rate: 7.1 symbols/min [2025-10-13T21:17:20.914806] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:17:20.914991] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-13T21:17:20.915028] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-13T21:17:20.915149] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-13T21:17:20.915189] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-13T21:17:20.915229] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-13T21:17:20.915260] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-13T21:17:21.218316] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-13T21:17:21.271960] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:17:21.363393] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:17:22.017912] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-13T21:17:22.063666] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T21:17:22.817968] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-13T21:17:23.248508] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T21:17:23.617987] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-13T21:17:23.786663] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:17:24.318671] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T21:17:24.417921] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-13T21:17:25.217980] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-13T21:17:25.365913] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:17:25.590459] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T21:17:25.593576] [INFO ] [REMOTE ] RQI: Full fetch complete (42848 records). [2025-10-13T21:17:25.593690] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-13T21:17:25.594478] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:17:25.594567] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:17:25.594611] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:17:25.594686] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-13T21:17:25.594769] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-13T21:17:25.594807] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-13T21:17:25.594846] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-13T21:17:25.594903] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. RQI took 31.7s. Estimated remaining: 1h 16m 5s. Rate: 7.1 symbols/min [2025-10-13T21:17:25.782576] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:17:25.782810] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-13T21:17:25.782939] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-13T21:17:25.783028] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-13T21:17:25.783067] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-13T21:17:25.783107] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-13T21:17:25.783139] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-13T21:17:26.029533] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-13T21:17:26.160466] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:17:26.817916] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-13T21:17:26.929541] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:17:27.618019] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-13T21:17:27.945599] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T21:17:27.983546] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-13T21:17:27.988505] [INFO ] [REMOTE ] RPM: Full fetch complete (59058 records). [2025-10-13T21:17:27.988723] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-13T21:17:27.989801] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:17:27.989899] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:17:27.989944] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:17:27.989987] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-13T21:17:27.990054] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-13T21:17:27.990093] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-13T21:17:27.990134] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-13T21:17:27.990200] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPM took 38.1s. Estimated remaining: 1h 15m 55s. Rate: 7.1 symbols/min [2025-10-13T21:17:28.174004] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:17:28.174248] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-13T21:17:28.174290] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-13T21:17:28.174422] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-13T21:17:28.174465] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-13T21:17:28.174506] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-13T21:17:28.174540] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-13T21:17:28.423058] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-13T21:17:28.581897] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:17:28.629487] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T21:17:29.217942] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-13T21:17:29.662539] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T21:17:30.018010] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-13T21:17:30.749078] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:17:30.753982] [INFO ] [REMOTE ] ROL: Full fetch complete (72560 records). [2025-10-13T21:17:30.754101] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-13T21:17:30.754816] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:17:30.754900] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:17:30.754942] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:17:30.754980] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-13T21:17:30.755035] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-13T21:17:30.755068] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-13T21:17:30.755106] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-13T21:17:30.755161] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. ROL took 43.4s. Estimated remaining: 1h 15m 45s. Rate: 7.1 symbols/min [2025-10-13T21:17:30.822981] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-13T21:17:30.924172] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:17:30.931692] [DEBUG] [LOCAL ] RSF: Loaded 4383 existing records from primary storage. [2025-10-13T21:17:30.931874] [INFO ] [MAIN ] RSF: Loaded 4383 existing records. [2025-10-13T21:17:31.112916] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:17:31.113299] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-13T21:17:31.113372] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-13T21:17:31.124938] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-13T21:17:31.130343] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-13T21:17:31.233433] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-13T21:17:31.525432] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:17:31.617931] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-13T21:17:32.417936] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-13T21:17:32.813440] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-13T21:17:33.179264] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T21:17:33.217932] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-13T21:17:34.017975] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-13T21:17:34.195669] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T21:17:34.687851] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T21:17:34.817748] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T21:17:34.817890] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-13T21:17:35.617939] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-13T21:17:36.417992] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-13T21:17:36.724310] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T21:17:37.063290] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T21:17:37.217908] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-13T21:17:37.327724] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T21:17:37.667386] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T21:17:38.017932] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-13T21:17:38.817932] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-13T21:17:39.364912] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T21:17:39.617942] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-13T21:17:40.018292] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T21:17:40.417909] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-13T21:17:40.862665] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T21:17:41.217926] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-13T21:17:41.912830] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T21:17:42.018069] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-13T21:17:42.382006] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-13T21:17:42.817983] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-13T21:17:43.497370] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:17:43.617921] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-13T21:17:44.288575] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T21:17:44.379568] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T21:17:44.417978] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-13T21:17:45.218009] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-13T21:17:45.520910] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T21:17:45.896353] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T21:17:46.017941] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-13T21:17:46.817927] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-13T21:17:47.618028] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-13T21:17:47.842048] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T21:17:48.262021] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:17:48.418012] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-13T21:17:49.217906] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-13T21:17:49.378557] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T21:17:49.820287] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T21:17:50.017897] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-13T21:17:50.588771] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:17:50.589964] [INFO ] [REMOTE ] RSF: Full fetch complete (5687 records). [2025-10-13T21:17:50.590067] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-13T21:17:50.825916] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-13T21:17:50.942117] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-13T21:17:50.942308] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-13T21:17:50.942592] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-13T21:17:50.942737] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-13T21:17:50.943136] [DEBUG] [LOCAL ] RSF: Trimmed 5687 records to 4321 (keeping 200 days of data) [2025-10-13T21:17:50.969736] [DEBUG] [LOCAL ] RSF: Primary data saved (4321 records). [2025-10-13T21:17:50.969803] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-13T21:17:50.969877] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RSF took 20.2s. Estimated remaining: 1h 15m 40s. Rate: 7.1 symbols/min [2025-10-13T21:17:51.132888] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:17:51.133015] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-13T21:17:51.133050] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-13T21:17:51.133156] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-13T21:17:51.133195] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-13T21:17:51.133234] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-13T21:17:51.133280] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-13T21:17:51.480379] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:17:51.617899] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-13T21:17:51.721891] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (4.10 seconds). [2025-10-13T21:17:52.204003] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T21:17:52.417904] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-13T21:17:53.217946] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-13T21:17:53.444510] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T21:17:53.557387] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T21:17:54.017934] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-13T21:17:54.817925] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-13T21:17:54.879108] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:17:55.617944] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-13T21:17:55.853995] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T21:17:56.417996] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-13T21:17:56.595132] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T21:17:57.191434] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T21:17:57.217922] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-13T21:17:57.702122] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T21:17:58.017931] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-13T21:17:58.817991] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-13T21:17:59.196022] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T21:17:59.280858] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T21:17:59.617940] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-13T21:18:00.418036] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-13T21:18:00.758605] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T21:18:01.217993] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-13T21:18:01.359343] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T21:18:01.361809] [INFO ] [REMOTE ] RS: Full fetch complete (38589 records). [2025-10-13T21:18:01.361884] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-13T21:18:01.362360] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:01.362482] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:01.362525] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:01.362565] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-13T21:18:01.362619] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-13T21:18:01.362685] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-13T21:18:01.362747] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-13T21:18:01.362803] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RS took 33.4s. Estimated remaining: 1h 15m 32s. Rate: 7.1 symbols/min [2025-10-13T21:18:01.537352] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:01.537613] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-13T21:18:01.537762] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-13T21:18:01.538038] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-13T21:18:01.538225] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-13T21:18:01.538304] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-13T21:18:01.538342] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-13T21:18:01.900797] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:02.017982] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-13T21:18:02.536339] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-10-13T21:18:02.817945] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-13T21:18:03.452487] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T21:18:03.629621] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-13T21:18:03.636060] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:18:04.417937] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-13T21:18:04.657082] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:18:05.217981] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-13T21:18:05.593142] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T21:18:06.018064] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-13T21:18:06.818079] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-13T21:18:07.548411] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T21:18:07.554202] [INFO ] [REMOTE ] RRC: Full fetch complete (76112 records). [2025-10-13T21:18:07.554403] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-13T21:18:07.555494] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:07.555842] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:07.556101] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:07.556200] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-13T21:18:07.556333] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-13T21:18:07.556409] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-13T21:18:07.556498] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-13T21:18:07.556680] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RRC took 46.8s. Estimated remaining: 1h 15m 23s. Rate: 7.1 symbols/min [2025-10-13T21:18:07.746550] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:07.772948] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:18:07.789696] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-13T21:18:07.820732] [DEBUG] [LOCAL ] RSKD: Loaded 33861 existing records from primary storage. [2025-10-13T21:18:07.821129] [INFO ] [MAIN ] RSKD: Loaded 33861 existing records. [2025-10-13T21:18:08.003912] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:18:08.004200] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-13T21:18:08.004275] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-13T21:18:08.005155] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-13T21:18:08.005228] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-13T21:18:08.406060] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:08.417894] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-13T21:18:09.209527] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (4.79 seconds). [2025-10-13T21:18:09.220314] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-13T21:18:09.505832] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T21:18:09.788139] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T21:18:10.017903] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-13T21:18:10.438168] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (5.22 seconds). [2025-10-13T21:18:10.817947] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-13T21:18:11.035618] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T21:18:11.290204] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T21:18:11.296553] [INFO ] [REMOTE ] RRX: Full fetch complete (58230 records). [2025-10-13T21:18:11.296806] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-13T21:18:11.297733] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:11.297842] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:11.297933] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:11.298075] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-13T21:18:11.298162] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-13T21:18:11.298216] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-13T21:18:11.298277] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-13T21:18:11.298352] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 45.7s. Estimated remaining: 1h 15m 13s. Rate: 7.1 symbols/min [2025-10-13T21:18:11.491875] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:11.509682] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-13T21:18:11.509912] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-13T21:18:11.510701] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-13T21:18:11.511313] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:18:11.511520] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-13T21:18:11.518620] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-13T21:18:11.518708] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-13T21:18:11.620685] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-13T21:18:11.891464] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:12.417924] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-13T21:18:13.217902] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-13T21:18:13.532381] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T21:18:13.590471] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T21:18:14.017921] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-13T21:18:14.817947] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-13T21:18:15.617905] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-13T21:18:15.716745] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T21:18:16.417900] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-13T21:18:16.492539] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T21:18:17.099171] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T21:18:17.217892] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-13T21:18:18.017924] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-13T21:18:18.514872] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T21:18:18.527113] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (5.31 seconds). [2025-10-13T21:18:18.617512] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T21:18:18.817919] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-13T21:18:19.617976] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-13T21:18:19.687449] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:18:20.418013] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-13T21:18:21.217985] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-13T21:18:21.333954] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T21:18:21.863256] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T21:18:22.017889] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-13T21:18:22.616754] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T21:18:22.817987] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-13T21:18:23.236244] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (4.42 seconds). [2025-10-13T21:18:23.617944] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-13T21:18:23.771049] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T21:18:24.255928] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T21:18:24.417915] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-13T21:18:24.604678] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T21:18:25.217985] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-13T21:18:26.017921] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-13T21:18:26.193297] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:18:26.722008] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:18:26.727217] [INFO ] [REMOTE ] RSG: Full fetch complete (67734 records). [2025-10-13T21:18:26.727444] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-13T21:18:26.728355] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:26.728454] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:26.728502] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:26.728543] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-13T21:18:26.728608] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-13T21:18:26.728669] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-13T21:18:26.728736] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-13T21:18:26.728802] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSG took 35.8s. Estimated remaining: 1h 15m 7s. Rate: 7.1 symbols/min [2025-10-13T21:18:26.817918] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-13T21:18:26.936760] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T21:18:27.618030] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-13T21:18:28.142968] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T21:18:28.417976] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-13T21:18:29.098311] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:18:29.217946] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-13T21:18:29.587011] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T21:18:30.017940] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-13T21:18:30.782819] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T21:18:30.817889] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-13T21:18:31.617972] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-13T21:18:31.732809] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T21:18:32.417909] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-13T21:18:32.444048] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T21:18:33.224776] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-13T21:18:33.243245] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:18:34.018021] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-13T21:18:34.395183] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T21:18:34.818003] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-13T21:18:35.638711] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T21:18:35.648242] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-13T21:18:36.061567] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-13T21:18:36.418038] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-13T21:18:37.216555] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:18:37.226071] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-13T21:18:37.662715] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T21:18:37.666604] [INFO ] [REMOTE ] RSKD: Full fetch complete (48327 records). [2025-10-13T21:18:37.666734] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-13T21:18:37.989029] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T21:18:38.037240] [INFO ] [REMOTE ] RTO: Full fetch complete (58247 records). [2025-10-13T21:18:38.057626] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-13T21:18:38.074250] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:38.079459] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:38.089083] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:38.089181] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-13T21:18:38.091755] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-13T21:18:38.091946] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-13T21:18:38.092050] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-13T21:18:38.092150] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-13T21:18:38.093240] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-13T21:18:38.093320] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-13T21:18:38.093518] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-13T21:18:38.093676] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RTO took 26.8s. Estimated remaining: 1h 14m 59s. Rate: 7.1 symbols/min [2025-10-13T21:18:38.095343] [DEBUG] [LOCAL ] RSKD: Trimmed 48327 records to 33455 (keeping 200 days of data) [2025-10-13T21:18:38.298190] [DEBUG] [LOCAL ] RSKD: Primary data saved (33455 records). [2025-10-13T21:18:38.298364] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-13T21:18:38.298464] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 30.7s. Estimated remaining: 1h 14m 48s. Rate: 7.1 symbols/min [2025-10-13T21:18:48.547285] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (13.73 seconds). [2025-10-13T21:18:48.558057] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-13T21:18:49.018752] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T21:18:49.023579] [INFO ] [REMOTE ] RSI: Full fetch complete (69170 records). [2025-10-13T21:18:49.023799] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-13T21:18:49.024766] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:18:49.024894] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:18:49.024944] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:18:49.024983] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-13T21:18:49.025102] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-13T21:18:49.025152] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-13T21:18:49.025195] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-13T21:18:49.025259] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 47.7s. Estimated remaining: 1h 14m 40s. Rate: 7.1 symbols/min [2025-10-13T21:18:49.713379] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:49.723973] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-13T21:18:49.712106] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:49.743135] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-13T21:18:49.742937] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-13T21:18:49.748063] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-13T21:18:49.779104] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:49.754393] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-13T21:18:49.747795] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-13T21:18:49.801495] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-13T21:18:49.801297] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:18:49.801728] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-13T21:18:49.801975] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-13T21:18:49.802171] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-13T21:18:49.802320] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-13T21:18:49.801686] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-13T21:18:49.802496] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-13T21:18:49.802705] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-13T21:18:49.808269] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-13T21:18:49.802978] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-13T21:18:49.808204] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-13T21:18:49.833753] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-13T21:18:49.857489] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-13T21:18:49.922728] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-13T21:18:50.010022] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-13T21:18:50.101402] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-13T21:18:50.163337] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-13T21:18:50.328244] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-13T21:18:51.025769] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:51.088411] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-13T21:18:51.203525] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:51.245438] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:51.246018] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-13T21:18:51.275002] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-13T21:18:51.446889] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:18:51.447275] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-13T21:18:52.476074] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T21:18:52.483114] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-13T21:18:52.986780] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T21:18:52.996812] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-13T21:18:53.029345] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T21:18:53.038381] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-13T21:18:53.132965] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:18:53.144538] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-13T21:18:53.362608] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T21:18:53.369008] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-13T21:18:54.577565] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T21:18:54.583233] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-13T21:18:54.726619] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T21:18:54.736799] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-13T21:18:54.767385] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T21:18:54.777159] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-13T21:18:54.936477] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T21:18:54.947257] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-13T21:18:56.016289] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T21:18:56.023382] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-13T21:18:56.431876] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:18:56.441200] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-13T21:18:56.893368] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T21:18:56.904833] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-13T21:18:57.154040] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T21:18:57.161043] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-13T21:18:57.967602] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:18:57.978000] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-13T21:18:58.343916] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T21:18:58.349886] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-13T21:18:58.940529] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T21:18:58.952793] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-13T21:18:59.066870] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (4.33 seconds). [2025-10-13T21:18:59.076954] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-13T21:18:59.611855] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T21:18:59.617846] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-13T21:19:00.940031] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T21:19:00.950621] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T21:19:00.963735] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-13T21:19:00.965698] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-13T21:19:01.217757] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (3.24 seconds). [2025-10-13T21:19:01.230396] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-13T21:19:02.425338] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T21:19:02.431722] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-13T21:19:02.653025] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T21:19:02.668981] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-13T21:19:02.730380] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T21:19:02.740980] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-13T21:19:03.407902] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T21:19:03.414484] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-13T21:19:03.985933] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:19:03.988892] [INFO ] [REMOTE ] RVT: Full fetch complete (38989 records). [2025-10-13T21:19:03.988976] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-13T21:19:03.989719] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:19:03.989803] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:03.989846] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:03.989886] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-13T21:19:03.989947] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-13T21:19:03.989983] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-13T21:19:03.990020] [DEBUG] [LOCAL ] RVT: No derivative data file found to delete. [2025-10-13T21:19:03.990089] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 15.0s. Estimated remaining: 1h 14m 34s. Rate: 7.1 symbols/min [2025-10-13T21:19:04.177891] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:04.223793] [DEBUG] [LOCAL ] RWT: Loaded 41423 existing records from primary storage. [2025-10-13T21:19:04.224248] [INFO ] [MAIN ] RWT: Loaded 41423 existing records. [2025-10-13T21:19:04.425902] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:19:04.426873] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-13T21:19:04.427125] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-13T21:19:04.427796] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-13T21:19:04.427910] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-13T21:19:04.570408] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T21:19:04.637635] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-13T21:19:04.812373] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T21:19:04.849946] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-13T21:19:04.919717] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:04.920208] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-13T21:19:05.694605] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (6.74 seconds). [2025-10-13T21:19:05.706696] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-13T21:19:06.491537] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T21:19:06.502575] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-13T21:19:06.572979] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T21:19:06.583779] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-13T21:19:06.649611] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T21:19:06.817944] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-13T21:19:07.747288] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T21:19:07.762933] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-13T21:19:08.215395] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T21:19:08.271953] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T21:19:08.348155] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T21:19:08.417929] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-13T21:19:09.217979] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-13T21:19:10.023500] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-13T21:19:10.033967] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T21:19:10.114369] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-13T21:19:10.719850] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T21:19:10.817917] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-13T21:19:11.617946] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-13T21:19:11.848877] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T21:19:12.417975] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-13T21:19:12.473177] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T21:19:13.217997] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-13T21:19:13.970193] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-13T21:19:14.018020] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-13T21:19:14.818524] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-13T21:19:14.819783] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T21:19:14.826255] [INFO ] [REMOTE ] RVTY: Full fetch complete (66785 records). [2025-10-13T21:19:14.826419] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-13T21:19:14.827411] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:19:14.827502] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:14.827573] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:14.827673] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-13T21:19:14.827768] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-13T21:19:14.827811] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-13T21:19:14.827856] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-13T21:19:14.827999] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVTY took 25.8s. Estimated remaining: 1h 14m 26s. Rate: 7.1 symbols/min [2025-10-13T21:19:15.012689] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:15.013041] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-13T21:19:15.013377] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-13T21:19:15.013619] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-13T21:19:15.013812] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-13T21:19:15.013901] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-13T21:19:15.014148] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-13T21:19:15.162395] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T21:19:15.444271] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:15.618002] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-13T21:19:16.102174] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-13T21:19:16.417944] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-13T21:19:17.060528] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T21:19:17.217936] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-13T21:19:17.733960] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T21:19:18.018020] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-13T21:19:18.817936] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-13T21:19:19.854022] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:19:19.855493] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-13T21:19:20.408470] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T21:19:20.417872] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-13T21:19:20.963029] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T21:19:21.217909] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-13T21:19:21.424834] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (6.61 seconds). [2025-10-13T21:19:21.634740] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T21:19:22.017973] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-13T21:19:22.439141] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T21:19:22.817937] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-13T21:19:23.439670] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T21:19:23.617988] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-13T21:19:24.130943] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T21:19:24.417948] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-13T21:19:25.015094] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (6.20 seconds). [2025-10-13T21:19:25.217972] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-13T21:19:25.441263] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T21:19:26.017906] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-13T21:19:26.468562] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T21:19:26.668853] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:19:26.676750] [INFO ] [REMOTE ] RTX: Full fetch complete (77342 records). [2025-10-13T21:19:26.677032] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-13T21:19:26.678333] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:19:26.678621] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:26.678746] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:26.678837] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-13T21:19:26.678923] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-13T21:19:26.678970] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-13T21:19:26.679019] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-13T21:19:26.679096] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTX took 37.7s. Estimated remaining: 1h 14m 19s. Rate: 7.1 symbols/min [2025-10-13T21:19:26.831201] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-13T21:19:26.866044] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:26.866272] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-13T21:19:26.866497] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-13T21:19:26.866706] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-13T21:19:26.866759] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-13T21:19:26.866802] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-13T21:19:26.866836] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-13T21:19:27.236844] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:27.617977] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-13T21:19:28.056746] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T21:19:28.057612] [INFO ] [REMOTE ] RWTN: Full fetch complete (3132 records). [2025-10-13T21:19:28.057863] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-13T21:19:28.241228] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-13T21:19:28.241472] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:28.241542] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:28.241615] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-13T21:19:28.241712] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-13T21:19:28.241760] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-13T21:19:28.241802] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-13T21:19:28.241861] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RWTN took 13.4s. Estimated remaining: 1h 14m 8s. Rate: 7.1 symbols/min [2025-10-13T21:19:28.415868] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:28.416196] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-13T21:19:28.416336] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-13T21:19:28.416537] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-13T21:19:28.416584] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-13T21:19:28.416630] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-13T21:19:28.416704] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-13T21:19:28.448365] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-13T21:19:28.742670] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T21:19:28.866709] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:29.069193] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T21:19:29.217972] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-13T21:19:30.017975] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-13T21:19:30.292364] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:19:30.292781] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-13T21:19:30.292879] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:19:30.292930] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-13T21:19:30.292991] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:19:30.293065] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-13T21:19:30.293134] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-13T21:19:30.293172] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-13T21:19:30.293213] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-13T21:19:30.293262] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTP took 2.1s. Estimated remaining: 1h 13m 58s. Rate: 7.1 symbols/min [2025-10-13T21:19:30.473698] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:30.529487] [DEBUG] [LOCAL ] RXO: Loaded 48815 existing records from primary storage. [2025-10-13T21:19:30.529893] [INFO ] [MAIN ] RXO: Loaded 48815 existing records. [2025-10-13T21:19:30.725437] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:19:30.725929] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-13T21:19:30.726047] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-13T21:19:30.726634] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-13T21:19:30.726743] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-13T21:19:30.830338] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-13T21:19:31.049581] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T21:19:31.137428] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:31.475901] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T21:19:31.617935] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-13T21:19:32.417932] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-13T21:19:33.217984] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-13T21:19:33.273664] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T21:19:33.686817] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T21:19:33.784720] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T21:19:34.018065] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-13T21:19:34.818049] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-13T21:19:35.343727] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T21:19:35.449480] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T21:19:35.453953] [INFO ] [REMOTE ] RWT: Full fetch complete (58271 records). [2025-10-13T21:19:35.454065] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-13T21:19:35.632281] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-13T21:19:35.850269] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-13T21:19:35.850393] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-13T21:19:35.851417] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-13T21:19:35.851485] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-13T21:19:35.853199] [DEBUG] [LOCAL ] RWT: Trimmed 58271 records to 40818 (keeping 200 days of data) [2025-10-13T21:19:36.106336] [DEBUG] [LOCAL ] RWT: Primary data saved (40818 records). [2025-10-13T21:19:36.106491] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-13T21:19:36.106579] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWT took 32.1s. Estimated remaining: 1h 13m 49s. Rate: 7.1 symbols/min [2025-10-13T21:19:36.283419] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:36.334617] [DEBUG] [LOCAL ] RY: Loaded 48560 existing records from primary storage. [2025-10-13T21:19:36.335039] [INFO ] [MAIN ] RY: Loaded 48560 existing records. [2025-10-13T21:19:36.430767] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-13T21:19:36.532494] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:19:36.532824] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-13T21:19:36.532879] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-13T21:19:36.533526] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-13T21:19:36.533586] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-13T21:19:36.891980] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:37.020306] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T21:19:37.217984] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-13T21:19:37.310443] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T21:19:38.017933] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-13T21:19:38.522545] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T21:19:38.818039] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-13T21:19:38.944233] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T21:19:39.349718] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T21:19:39.617933] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-13T21:19:40.313572] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T21:19:40.417983] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-13T21:19:40.784087] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (28.37 seconds). [2025-10-13T21:19:41.148576] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T21:19:41.217940] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-13T21:19:42.017937] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-13T21:19:42.779789] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T21:19:42.784428] [INFO ] [REMOTE ] RVLV: Full fetch complete (68504 records). [2025-10-13T21:19:42.784538] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-13T21:19:42.785516] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:19:42.785612] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:42.785764] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:42.785830] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-13T21:19:42.785894] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-13T21:19:42.785934] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-13T21:19:42.785973] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-13T21:19:42.786033] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RVLV took 53.8s. Estimated remaining: 1h 13m 40s. Rate: 7.1 symbols/min [2025-10-13T21:19:42.818520] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-13T21:19:42.985852] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:42.987979] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T21:19:43.032131] [DEBUG] [LOCAL ] RYAM: Loaded 35637 existing records from primary storage. [2025-10-13T21:19:43.032427] [INFO ] [MAIN ] RYAM: Loaded 35637 existing records. [2025-10-13T21:19:43.205891] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:19:43.206126] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-13T21:19:43.206172] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-13T21:19:43.206541] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-13T21:19:43.206597] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-13T21:19:43.560498] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:43.617925] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-13T21:19:44.253380] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T21:19:44.418005] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-13T21:19:44.916850] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T21:19:45.217994] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-13T21:19:45.842633] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T21:19:46.017985] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-13T21:19:46.527781] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T21:19:46.817943] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-13T21:19:47.342858] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T21:19:47.377352] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T21:19:47.378286] [INFO ] [REMOTE ] RWTO: Full fetch complete (4824 records). [2025-10-13T21:19:47.378353] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-13T21:19:47.554810] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T21:19:47.555076] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:19:47.555165] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:19:47.555226] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-13T21:19:47.555304] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-13T21:19:47.555353] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-13T21:19:47.555405] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-13T21:19:47.555506] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTO took 20.9s. Estimated remaining: 1h 13m 30s. Rate: 7.1 symbols/min [2025-10-13T21:19:47.623126] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-13T21:19:47.725789] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:19:47.771771] [DEBUG] [LOCAL ] RYAN: Loaded 45390 existing records from primary storage. [2025-10-13T21:19:47.772119] [INFO ] [MAIN ] RYAN: Loaded 45390 existing records. [2025-10-13T21:19:47.944699] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:19:47.944962] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-13T21:19:47.945021] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-13T21:19:47.945476] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-13T21:19:47.945534] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-13T21:19:48.293853] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:19:48.417894] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-13T21:19:49.217938] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-13T21:19:50.001696] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:19:50.017874] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-13T21:19:50.805122] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-10-13T21:19:50.817884] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-13T21:19:51.617901] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-13T21:19:51.647168] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:19:52.417917] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-13T21:19:52.513914] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T21:19:53.086587] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T21:19:53.153489] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (3.94 seconds). [2025-10-13T21:19:53.217911] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-13T21:19:54.017920] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-13T21:19:54.084910] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T21:19:54.722917] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T21:19:54.817942] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-13T21:19:55.617945] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-13T21:19:55.918871] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T21:19:56.256604] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:19:56.417928] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-13T21:19:56.889311] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T21:19:57.217934] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-13T21:19:58.017980] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-13T21:19:58.179898] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T21:19:58.771823] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T21:19:58.817918] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-13T21:19:59.617981] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-13T21:19:59.902121] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T21:20:00.417981] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-13T21:20:00.511060] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T21:20:01.137536] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T21:20:01.217912] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-13T21:20:02.018042] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-13T21:20:02.238111] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T21:20:02.689791] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:20:02.817977] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-13T21:20:03.617993] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-13T21:20:03.751405] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T21:20:04.268966] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T21:20:04.418009] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-13T21:20:05.223019] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-13T21:20:05.239329] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T21:20:06.018007] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-13T21:20:06.817909] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-13T21:20:07.080801] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T21:20:07.617939] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-13T21:20:07.654921] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T21:20:08.363852] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T21:20:08.417896] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-13T21:20:09.041692] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T21:20:09.045550] [INFO ] [REMOTE ] RYAM: Full fetch complete (48855 records). [2025-10-13T21:20:09.045688] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-13T21:20:09.046440] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:20:09.046526] [FATAL] [MAIN ] RYAM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:20:09.046568] [WARN ] [MAIN ] RYAM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:20:09.046612] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-13T21:20:09.046730] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-13T21:20:09.046788] [INFO ] [LOCAL ] RYAM: Starting deletion of derivative data. [2025-10-13T21:20:09.046999] [DEBUG] [LOCAL ] RYAM: Deleted derivative data file. [2025-10-13T21:20:09.047110] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RYAM took 26.3s. Estimated remaining: 1h 13m 26s. Rate: 7.1 symbols/min [2025-10-13T21:20:09.219040] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:09.219164] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-13T21:20:09.242338] [DEBUG] [LOCAL ] RYI: Loaded 21850 existing records from primary storage. [2025-10-13T21:20:09.242604] [INFO ] [MAIN ] RYI: Loaded 21850 existing records. [2025-10-13T21:20:09.471623] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:09.471958] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-13T21:20:09.472091] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-13T21:20:09.472768] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-13T21:20:09.476342] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-13T21:20:09.476223] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T21:20:09.838081] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:10.017938] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-13T21:20:10.478318] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (6.06 seconds). [2025-10-13T21:20:10.718877] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T21:20:10.817925] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-13T21:20:11.617920] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-13T21:20:11.776615] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T21:20:12.417916] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-13T21:20:12.572034] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:20:13.217989] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-13T21:20:13.252846] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T21:20:13.631892] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T21:20:14.017935] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-13T21:20:14.787229] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:20:14.792266] [INFO ] [REMOTE ] RXO: Full fetch complete (68152 records). [2025-10-13T21:20:14.792424] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-13T21:20:14.793259] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:20:14.793353] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:20:14.793396] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:20:14.793433] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-13T21:20:14.793492] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-13T21:20:14.793526] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-13T21:20:14.793716] [DEBUG] [LOCAL ] RXO: Deleted derivative data file. [2025-10-13T21:20:14.793814] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RXO took 44.5s. Estimated remaining: 1h 13m 16s. Rate: 7.1 symbols/min [2025-10-13T21:20:14.823679] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-13T21:20:14.964682] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:15.008679] [DEBUG] [LOCAL ] RYN: Loaded 46093 existing records from primary storage. [2025-10-13T21:20:15.009012] [INFO ] [MAIN ] RYN: Loaded 46093 existing records. [2025-10-13T21:20:15.191120] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:15.191663] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-13T21:20:15.191724] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-13T21:20:15.192427] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-13T21:20:15.192493] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-13T21:20:15.546869] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:15.617883] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-13T21:20:16.417967] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-13T21:20:16.745060] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T21:20:17.199639] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:20:17.217887] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-13T21:20:17.684339] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T21:20:17.839762] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (4.62 seconds). [2025-10-13T21:20:18.017933] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-13T21:20:18.509137] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:20:18.817932] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-13T21:20:19.207156] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T21:20:19.617993] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-13T21:20:20.278665] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:20:20.300545] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:20:20.305430] [INFO ] [REMOTE ] RY: Full fetch complete (68630 records). [2025-10-13T21:20:20.305557] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-13T21:20:20.306267] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:20:20.306356] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:20:20.306398] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:20:20.306435] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-13T21:20:20.306535] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-13T21:20:20.306577] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-13T21:20:20.306874] [DEBUG] [LOCAL ] RY: Deleted derivative data file. [2025-10-13T21:20:20.306970] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RY took 44.2s. Estimated remaining: 1h 13m 7s. Rate: 7.1 symbols/min [2025-10-13T21:20:20.423055] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-13T21:20:20.477908] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:20.486071] [DEBUG] [LOCAL ] RZB: Loaded 6096 existing records from primary storage. [2025-10-13T21:20:20.486627] [INFO ] [MAIN ] RZB: Loaded 6096 existing records. [2025-10-13T21:20:20.672688] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:20.672920] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-13T21:20:20.672966] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-13T21:20:20.673147] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-13T21:20:20.673211] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-13T21:20:21.041436] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:21.217971] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-13T21:20:22.018010] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-13T21:20:22.060811] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T21:20:22.066179] [INFO ] [REMOTE ] RYAN: Full fetch complete (63900 records). [2025-10-13T21:20:22.066296] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-13T21:20:22.066942] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T21:20:22.067059] [FATAL] [MAIN ] RYAN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:20:22.067119] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:20:22.067185] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-13T21:20:22.067247] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-13T21:20:22.067282] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-13T21:20:22.067438] [DEBUG] [LOCAL ] RYAN: Deleted derivative data file. [2025-10-13T21:20:22.067582] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAN took 34.5s. Estimated remaining: 1h 12m 57s. Rate: 7.1 symbols/min [2025-10-13T21:20:22.238184] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:22.277714] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:20:22.292194] [DEBUG] [LOCAL ] RZC: Loaded 6854 existing records from primary storage. [2025-10-13T21:20:22.292431] [INFO ] [MAIN ] RZC: Loaded 6854 existing records. [2025-10-13T21:20:22.463961] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:22.464259] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-13T21:20:22.464319] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-13T21:20:22.465684] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-13T21:20:22.465755] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-13T21:20:22.813119] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:22.817880] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-13T21:20:23.140150] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T21:20:23.617906] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-13T21:20:23.644163] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T21:20:24.417924] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-13T21:20:24.926220] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T21:20:25.217924] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-13T21:20:25.308116] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T21:20:25.917708] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T21:20:26.017998] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-13T21:20:26.817974] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-13T21:20:26.843078] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T21:20:27.525411] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T21:20:27.617923] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-13T21:20:28.417920] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-13T21:20:28.681904] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T21:20:28.998040] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T21:20:29.217944] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-13T21:20:30.002456] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T21:20:30.017980] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-13T21:20:30.764169] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T21:20:30.818033] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-13T21:20:31.617934] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-13T21:20:32.243670] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T21:20:32.417993] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-13T21:20:32.587766] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:20:33.168497] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T21:20:33.218050] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-13T21:20:33.914614] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T21:20:34.017994] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-13T21:20:34.817899] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-13T21:20:35.209478] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T21:20:35.618017] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-13T21:20:36.313160] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T21:20:36.417995] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-13T21:20:36.506638] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T21:20:37.217935] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-13T21:20:37.683376] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T21:20:38.017931] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-13T21:20:38.817899] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-13T21:20:38.931726] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:20:39.183035] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T21:20:39.243841] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T21:20:39.617919] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-13T21:20:40.417999] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-13T21:20:41.217986] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-13T21:20:42.017940] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-13T21:20:42.719857] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T21:20:42.817924] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-13T21:20:42.897480] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T21:20:42.961712] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-13T21:20:43.617935] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-13T21:20:44.348859] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T21:20:44.417979] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-13T21:20:44.545807] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T21:20:45.031073] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T21:20:45.217977] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-13T21:20:46.017990] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-13T21:20:46.580602] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T21:20:46.581794] [INFO ] [REMOTE ] RZC: Full fetch complete (9697 records). [2025-10-13T21:20:46.581866] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-13T21:20:46.821890] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-13T21:20:47.007335] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-13T21:20:47.012658] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T21:20:47.008775] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-13T21:20:47.022611] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-13T21:20:47.024246] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-13T21:20:47.025976] [DEBUG] [LOCAL ] RZC: Trimmed 9697 records to 6775 (keeping 200 days of data) [2025-10-13T21:20:47.041839] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (5.02 seconds). [2025-10-13T21:20:47.088470] [DEBUG] [LOCAL ] RZC: Primary data saved (6775 records). [2025-10-13T21:20:47.088615] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-13T21:20:47.088738] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RZC took 25.0s. Estimated remaining: 1h 12m 53s. Rate: 7.1 symbols/min [2025-10-13T21:20:47.254943] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:47.314950] [DEBUG] [LOCAL ] S: Loaded 54310 existing records from primary storage. [2025-10-13T21:20:47.315283] [INFO ] [MAIN ] S: Loaded 54310 existing records. [2025-10-13T21:20:47.496825] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:47.497310] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-13T21:20:47.497372] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-13T21:20:47.498032] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-13T21:20:47.498111] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-13T21:20:47.613812] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T21:20:47.619362] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-13T21:20:47.910145] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:48.417960] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-13T21:20:49.028304] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T21:20:49.033588] [INFO ] [REMOTE ] RYN: Full fetch complete (65031 records). [2025-10-13T21:20:49.033765] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-13T21:20:49.225540] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-13T21:20:49.366825] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T21:20:49.469004] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-13T21:20:49.469114] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-13T21:20:49.470338] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-13T21:20:49.470407] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-13T21:20:49.472200] [DEBUG] [LOCAL ] RYN: Trimmed 65031 records to 45397 (keeping 200 days of data) [2025-10-13T21:20:49.787329] [DEBUG] [LOCAL ] RYN: Primary data saved (45397 records). [2025-10-13T21:20:49.787544] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-13T21:20:49.787686] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYN took 35.0s. Estimated remaining: 1h 12m 43s. Rate: 7.1 symbols/min [2025-10-13T21:20:49.961123] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:50.009446] [DEBUG] [LOCAL ] SA: Loaded 44639 existing records from primary storage. [2025-10-13T21:20:50.009869] [INFO ] [MAIN ] SA: Loaded 44639 existing records. [2025-10-13T21:20:50.023075] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-13T21:20:50.190867] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:50.191242] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-13T21:20:50.191300] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-13T21:20:50.192050] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-13T21:20:50.192109] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-13T21:20:50.560831] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:50.817919] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-13T21:20:51.019739] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T21:20:51.022665] [INFO ] [REMOTE ] RYI: Full fetch complete (31992 records). [2025-10-13T21:20:51.022749] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-13T21:20:51.414422] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-13T21:20:51.414527] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-13T21:20:51.415478] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-13T21:20:51.415543] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-13T21:20:51.416590] [DEBUG] [LOCAL ] RYI: Trimmed 31992 records to 21711 (keeping 200 days of data) [2025-10-13T21:20:51.562483] [DEBUG] [LOCAL ] RYI: Primary data saved (21711 records). [2025-10-13T21:20:51.562696] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-13T21:20:51.562811] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RYI took 42.5s. Estimated remaining: 1h 12m 33s. Rate: 7.1 symbols/min [2025-10-13T21:20:51.629380] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-13T21:20:51.664938] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T21:20:51.765086] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:51.802753] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-13T21:20:51.819594] [DEBUG] [LOCAL ] SABA: Loaded 9412 existing records from primary storage. [2025-10-13T21:20:51.820060] [INFO ] [MAIN ] SABA: Loaded 9412 existing records. [2025-10-13T21:20:52.005182] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:52.005490] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-13T21:20:52.005544] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-13T21:20:52.005847] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-13T21:20:52.005923] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-13T21:20:52.368399] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:52.417976] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-13T21:20:52.939322] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T21:20:53.204815] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T21:20:53.217894] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-13T21:20:54.017978] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-13T21:20:54.193584] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T21:20:54.504706] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:20:54.505623] [INFO ] [REMOTE ] RZB: Full fetch complete (8504 records). [2025-10-13T21:20:54.505715] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-13T21:20:54.826903] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-13T21:20:54.861772] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-13T21:20:54.861889] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-13T21:20:54.862187] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-13T21:20:54.862227] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-13T21:20:54.862711] [DEBUG] [LOCAL ] RZB: Trimmed 8504 records to 6002 (keeping 200 days of data) [2025-10-13T21:20:54.901497] [DEBUG] [LOCAL ] RZB: Primary data saved (6002 records). [2025-10-13T21:20:54.901674] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-13T21:20:54.901803] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZB took 34.6s. Estimated remaining: 1h 12m 23s. Rate: 7.1 symbols/min [2025-10-13T21:20:55.068121] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:20:55.101710] [DEBUG] [LOCAL ] SAFE: Loaded 30699 existing records from primary storage. [2025-10-13T21:20:55.101993] [INFO ] [MAIN ] SAFE: Loaded 30699 existing records. [2025-10-13T21:20:55.296629] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:20:55.296907] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-13T21:20:55.296954] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-13T21:20:55.297342] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-13T21:20:55.297398] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-13T21:20:55.630595] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-13T21:20:55.722056] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:20:56.354500] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T21:20:56.417931] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-13T21:20:57.217920] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-13T21:20:57.681408] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T21:20:57.992638] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:20:58.018002] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-13T21:20:58.817925] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-13T21:20:58.838256] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T21:20:59.149261] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-10-13T21:20:59.617908] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-13T21:21:00.211403] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T21:21:00.399327] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T21:21:00.417873] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-13T21:21:01.217933] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-13T21:21:01.809444] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T21:21:02.017924] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-13T21:21:02.818009] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-13T21:21:03.179302] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T21:21:03.323046] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T21:21:03.427112] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T21:21:03.617934] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-13T21:21:04.387668] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T21:21:04.418042] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-13T21:21:05.218033] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-13T21:21:05.956708] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T21:21:06.017925] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-13T21:21:06.489111] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T21:21:06.817937] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-13T21:21:07.516563] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T21:21:07.617992] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-13T21:21:08.106044] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T21:21:08.417910] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-13T21:21:09.217976] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-13T21:21:09.262749] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:21:09.658221] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T21:21:10.017977] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-13T21:21:10.525163] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T21:21:10.817926] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-13T21:21:11.618000] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-13T21:21:12.026010] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T21:21:12.418007] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-13T21:21:12.419426] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T21:21:12.760067] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T21:21:13.217981] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-13T21:21:14.017903] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-13T21:21:14.396628] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T21:21:14.486414] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T21:21:14.686279] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T21:21:14.817941] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-13T21:21:15.534095] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:21:15.535544] [INFO ] [REMOTE ] SABA: Full fetch complete (15284 records). [2025-10-13T21:21:15.535610] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-13T21:21:15.623206] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-13T21:21:15.920524] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-13T21:21:15.920617] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-13T21:21:15.921046] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-13T21:21:15.921095] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-13T21:21:15.921700] [DEBUG] [LOCAL ] SABA: Trimmed 15284 records to 9326 (keeping 200 days of data) [2025-10-13T21:21:15.981187] [DEBUG] [LOCAL ] SABA: Primary data saved (9326 records). [2025-10-13T21:21:15.981312] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-13T21:21:15.981391] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SABA took 24.4s. Estimated remaining: 1h 12m 18s. Rate: 7.1 symbols/min [2025-10-13T21:21:16.147725] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:16.167523] [DEBUG] [LOCAL ] SAH: Loaded 21834 existing records from primary storage. [2025-10-13T21:21:16.167796] [INFO ] [MAIN ] SAH: Loaded 21834 existing records. [2025-10-13T21:21:16.340538] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:21:16.340754] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-13T21:21:16.340802] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-13T21:21:16.341283] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-13T21:21:16.341339] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-13T21:21:16.423153] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-13T21:21:16.692467] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:17.105853] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:21:17.217917] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-13T21:21:18.017927] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-13T21:21:18.781402] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T21:21:18.821770] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-13T21:21:18.835605] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T21:21:18.837691] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-13T21:21:19.617917] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-13T21:21:20.350663] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T21:21:20.417916] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-13T21:21:21.217935] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-13T21:21:21.879735] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-13T21:21:22.017912] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-13T21:21:22.273152] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T21:21:22.329817] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T21:21:22.817925] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-13T21:21:23.617928] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-13T21:21:24.068926] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T21:21:24.394140] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T21:21:24.399703] [INFO ] [REMOTE ] SA: Full fetch complete (62936 records). [2025-10-13T21:21:24.399839] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-13T21:21:24.423016] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-13T21:21:24.821340] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T21:21:24.826280] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-13T21:21:24.826362] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-13T21:21:24.827340] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-13T21:21:24.827405] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-13T21:21:24.828663] [DEBUG] [LOCAL ] SA: Trimmed 62936 records to 44307 (keeping 200 days of data) [2025-10-13T21:21:25.105496] [DEBUG] [LOCAL ] SA: Primary data saved (44307 records). [2025-10-13T21:21:25.105630] [INFO ] [MAIN ] SA: Full history saved. [2025-10-13T21:21:25.105750] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SA took 35.3s. Estimated remaining: 1h 12m 10s. Rate: 7.1 symbols/min [2025-10-13T21:21:25.223222] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-13T21:21:25.300270] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:25.300454] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-13T21:21:25.300504] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-13T21:21:25.300612] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-13T21:21:25.300680] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-13T21:21:25.300742] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-13T21:21:25.300776] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-13T21:21:25.653973] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:25.854335] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T21:21:26.017906] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-13T21:21:26.320222] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T21:21:26.817940] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-13T21:21:27.230001] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-13T21:21:27.384047] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T21:21:27.617975] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-13T21:21:27.946386] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T21:21:28.417993] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-13T21:21:29.217896] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-13T21:21:29.618973] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:21:30.018005] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-13T21:21:30.237592] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T21:21:30.817941] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-13T21:21:31.095828] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-13T21:21:31.357246] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T21:21:31.617924] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-13T21:21:32.417933] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-13T21:21:32.726103] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-13T21:21:33.217940] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-13T21:21:33.365978] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T21:21:33.372080] [INFO ] [REMOTE ] S: Full fetch complete (77544 records). [2025-10-13T21:21:33.372258] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-13T21:21:33.615375] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-13T21:21:33.779052] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-13T21:21:33.779136] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-13T21:21:33.780279] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-13T21:21:33.780343] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-13T21:21:33.781871] [DEBUG] [LOCAL ] S: Trimmed 77544 records to 53533 (keeping 200 days of data) [2025-10-13T21:21:34.018081] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-13T21:21:34.112476] [DEBUG] [LOCAL ] S: Primary data saved (53533 records). [2025-10-13T21:21:34.112616] [INFO ] [MAIN ] S: Full history saved. [2025-10-13T21:21:34.112727] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. S took 47.0s. Estimated remaining: 1h 12m 1s. Rate: 7.1 symbols/min [2025-10-13T21:21:34.278440] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:34.299075] [DEBUG] [LOCAL ] SAM: Loaded 21699 existing records from primary storage. [2025-10-13T21:21:34.299528] [INFO ] [MAIN ] SAM: Loaded 21699 existing records. [2025-10-13T21:21:34.404771] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T21:21:34.485000] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:21:34.485229] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-13T21:21:34.485303] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-13T21:21:34.486016] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-13T21:21:34.486079] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-13T21:21:34.818193] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-13T21:21:34.847016] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:35.618019] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-13T21:21:35.957782] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T21:21:35.961890] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T21:21:36.417993] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-13T21:21:37.218048] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-13T21:21:37.474356] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T21:21:38.017906] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-13T21:21:38.028176] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T21:21:38.032028] [INFO ] [REMOTE ] SAFE: Full fetch complete (44585 records). [2025-10-13T21:21:38.032157] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-13T21:21:38.420472] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-13T21:21:38.420552] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-13T21:21:38.421555] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-13T21:21:38.421621] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-13T21:21:38.422671] [DEBUG] [LOCAL ] SAFE: Trimmed 44585 records to 30391 (keeping 200 days of data) [2025-10-13T21:21:38.611319] [DEBUG] [LOCAL ] SAFE: Primary data saved (30391 records). [2025-10-13T21:21:38.611685] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-13T21:21:38.611781] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAFE took 43.7s. Estimated remaining: 1h 11m 52s. Rate: 7.1 symbols/min [2025-10-13T21:21:38.783406] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:38.818015] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-13T21:21:38.836849] [DEBUG] [LOCAL ] SAN: Loaded 53743 existing records from primary storage. [2025-10-13T21:21:38.837281] [INFO ] [MAIN ] SAN: Loaded 53743 existing records. [2025-10-13T21:21:39.020374] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:21:39.020610] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-13T21:21:39.020684] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-13T21:21:39.021551] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-13T21:21:39.021611] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-13T21:21:39.229604] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T21:21:39.379233] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:39.399902] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T21:21:39.618040] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-13T21:21:39.972823] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-13T21:21:40.417922] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-13T21:21:40.739328] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-13T21:21:41.217974] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-13T21:21:41.525142] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-13T21:21:41.525855] [INFO ] [REMOTE ] SAJ: Full fetch complete (920 records). [2025-10-13T21:21:41.525926] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-13T21:21:41.709095] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-13T21:21:41.709414] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:21:41.709484] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:21:41.709555] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-13T21:21:41.709717] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-13T21:21:41.709774] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-13T21:21:41.709820] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-13T21:21:41.709875] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAJ took 16.6s. Estimated remaining: 1h 11m 42s. Rate: 7.1 symbols/min [2025-10-13T21:21:41.875520] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:41.926677] [DEBUG] [LOCAL ] SAND: Loaded 52596 existing records from primary storage. [2025-10-13T21:21:41.926984] [INFO ] [MAIN ] SAND: Loaded 52596 existing records. [2025-10-13T21:21:42.023158] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-13T21:21:42.104342] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:21:42.104538] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-13T21:21:42.104583] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-13T21:21:42.105115] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-13T21:21:42.105172] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-13T21:21:42.461722] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:42.817937] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-13T21:21:43.101283] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T21:21:43.617927] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-13T21:21:44.418049] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-13T21:21:44.848527] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T21:21:44.947054] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T21:21:45.217931] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-13T21:21:46.018005] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-13T21:21:46.349168] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T21:21:46.383355] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T21:21:46.817889] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-13T21:21:47.170997] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T21:21:47.617975] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-13T21:21:48.417920] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-13T21:21:48.662375] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T21:21:48.731876] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T21:21:49.217982] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-13T21:21:50.017904] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-13T21:21:50.286092] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T21:21:50.817910] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-13T21:21:50.974373] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T21:21:51.186229] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T21:21:51.618023] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-13T21:21:52.417897] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-13T21:21:52.496283] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T21:21:53.218004] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-13T21:21:53.377492] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:21:53.416100] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T21:21:54.018033] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-13T21:21:54.817976] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-13T21:21:54.887583] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T21:21:54.890093] [INFO ] [REMOTE ] SAH: Full fetch complete (30701 records). [2025-10-13T21:21:54.890167] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-13T21:21:55.293968] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-13T21:21:55.296964] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-13T21:21:55.297713] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-13T21:21:55.298009] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-13T21:21:55.300409] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T21:21:55.312271] [DEBUG] [LOCAL ] SAH: Trimmed 30701 records to 21515 (keeping 200 days of data) [2025-10-13T21:21:55.452305] [DEBUG] [LOCAL ] SAH: Primary data saved (21515 records). [2025-10-13T21:21:55.452433] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-13T21:21:55.452520] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 39.5s. Estimated remaining: 1h 11m 35s. Rate: 7.1 symbols/min [2025-10-13T21:21:55.623575] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:21:55.620043] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-13T21:21:55.634492] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T21:21:55.693225] [DEBUG] [LOCAL ] SAP: Loaded 50626 existing records from primary storage. [2025-10-13T21:21:55.693573] [INFO ] [MAIN ] SAP: Loaded 50626 existing records. [2025-10-13T21:21:55.869512] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:21:55.869770] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-13T21:21:55.869818] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-13T21:21:55.870169] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-13T21:21:55.870225] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-13T21:21:56.222591] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:21:56.417894] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-13T21:21:57.217917] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-13T21:21:57.379862] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T21:21:58.017936] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-13T21:21:58.107937] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T21:21:58.206717] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T21:21:58.817994] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-13T21:21:59.617902] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-13T21:21:59.868129] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T21:22:00.266867] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T21:22:00.418028] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-13T21:22:00.837631] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T21:22:01.217969] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-13T21:22:02.017918] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-13T21:22:02.342241] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T21:22:02.817918] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-13T21:22:03.106384] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T21:22:03.535476] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T21:22:03.617897] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-13T21:22:04.417940] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-13T21:22:04.558194] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T21:22:05.142144] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T21:22:05.217915] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-13T21:22:05.600577] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T21:22:06.017934] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-13T21:22:06.817934] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-13T21:22:07.093944] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T21:22:07.135384] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T21:22:07.617969] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-13T21:22:08.417919] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-13T21:22:08.638746] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T21:22:09.168463] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:22:09.217990] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-13T21:22:10.017906] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-13T21:22:10.354540] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T21:22:10.570899] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T21:22:10.817974] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-13T21:22:11.617982] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-13T21:22:12.097520] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T21:22:12.402460] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T21:22:12.409043] [INFO ] [REMOTE ] SAND: Full fetch complete (74486 records). [2025-10-13T21:22:12.409238] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-13T21:22:12.424502] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-13T21:22:12.868054] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-13T21:22:12.868150] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-13T21:22:12.869319] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-13T21:22:12.869383] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-13T21:22:12.870921] [DEBUG] [LOCAL ] SAND: Trimmed 74486 records to 51843 (keeping 200 days of data) [2025-10-13T21:22:13.135091] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T21:22:13.225744] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-13T21:22:13.249478] [DEBUG] [LOCAL ] SAND: Primary data saved (51843 records). [2025-10-13T21:22:13.249628] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-13T21:22:13.249752] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAND took 31.5s. Estimated remaining: 1h 11m 29s. Rate: 7.1 symbols/min [2025-10-13T21:22:13.415704] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:13.435292] [DEBUG] [LOCAL ] SAR: Loaded 17332 existing records from primary storage. [2025-10-13T21:22:13.435539] [INFO ] [MAIN ] SAR: Loaded 17332 existing records. [2025-10-13T21:22:13.553310] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T21:22:13.626253] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:22:13.626481] [INFO ] [REMOTE ] SAM: Full fetch complete (31078 records). [2025-10-13T21:22:13.626940] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-13T21:22:13.627119] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-13T21:22:13.627442] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-13T21:22:13.633415] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-13T21:22:13.663554] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-13T21:22:14.045832] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-13T21:22:14.443625] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:14.489109] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-13T21:22:14.489216] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-13T21:22:14.490487] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-13T21:22:14.490561] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-13T21:22:14.491582] [DEBUG] [LOCAL ] SAM: Trimmed 31078 records to 21459 (keeping 200 days of data) [2025-10-13T21:22:14.630787] [DEBUG] [LOCAL ] SAM: Primary data saved (21459 records). [2025-10-13T21:22:14.630978] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-13T21:22:14.631076] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAM took 40.5s. Estimated remaining: 1h 11m 19s. Rate: 7.1 symbols/min [2025-10-13T21:22:14.796629] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:14.823319] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-13T21:22:14.843973] [DEBUG] [LOCAL ] SARO: Loaded 49125 existing records from primary storage. [2025-10-13T21:22:14.844299] [INFO ] [MAIN ] SARO: Loaded 49125 existing records. [2025-10-13T21:22:15.018963] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:22:15.019226] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-13T21:22:15.019273] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-13T21:22:15.019847] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-13T21:22:15.019907] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-13T21:22:15.210294] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T21:22:15.293415] [INFO ] [REMOTE ] SAN: Full fetch complete (76319 records). [2025-10-13T21:22:15.317347] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-13T21:22:15.505595] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:15.636798] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-13T21:22:15.813955] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-13T21:22:15.814097] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-13T21:22:15.815342] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-13T21:22:15.815421] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-13T21:22:15.826077] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T21:22:15.830616] [DEBUG] [LOCAL ] SAN: Trimmed 76319 records to 52978 (keeping 200 days of data) [2025-10-13T21:22:16.145960] [DEBUG] [LOCAL ] SAN: Primary data saved (52978 records). [2025-10-13T21:22:16.146190] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-13T21:22:16.146286] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 37.5s. Estimated remaining: 1h 11m 8s. Rate: 7.1 symbols/min [2025-10-13T21:22:16.313099] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:16.313386] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-13T21:22:16.313461] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-13T21:22:16.313892] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-13T21:22:16.313949] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-13T21:22:16.313992] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-13T21:22:16.314024] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-13T21:22:16.422831] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-13T21:22:16.691445] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:16.723762] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-13T21:22:17.217898] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-13T21:22:17.426372] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T21:22:17.730429] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T21:22:18.017919] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-13T21:22:18.588724] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T21:22:18.817914] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-13T21:22:19.332636] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T21:22:19.618023] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-13T21:22:20.404886] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:22:20.417875] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-13T21:22:20.652201] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T21:22:21.218011] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-13T21:22:21.765932] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T21:22:21.793794] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T21:22:22.017924] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-13T21:22:22.818040] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-13T21:22:23.090825] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T21:22:23.100128] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-13T21:22:23.617937] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-13T21:22:24.418040] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-13T21:22:24.895216] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T21:22:25.217997] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-13T21:22:25.288053] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T21:22:25.695027] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T21:22:26.018016] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-13T21:22:26.817977] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-13T21:22:27.617933] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-13T21:22:27.669596] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T21:22:27.957215] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T21:22:28.257469] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T21:22:28.417962] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-13T21:22:29.218041] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-13T21:22:30.017975] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-13T21:22:30.365774] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T21:22:30.646439] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T21:22:30.689890] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T21:22:30.817915] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-13T21:22:31.617927] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-13T21:22:31.965074] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T21:22:32.426685] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-13T21:22:32.449168] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T21:22:33.217984] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-13T21:22:33.425430] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T21:22:34.017976] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-13T21:22:34.343491] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T21:22:34.817902] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-13T21:22:35.143098] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T21:22:35.617969] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-13T21:22:36.417915] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-13T21:22:36.504572] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T21:22:36.843248] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T21:22:37.217912] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-13T21:22:37.610371] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T21:22:38.017966] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-13T21:22:38.638586] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T21:22:38.817984] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-13T21:22:39.415897] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T21:22:39.618051] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-13T21:22:39.785465] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T21:22:39.791024] [INFO ] [REMOTE ] SAP: Full fetch complete (71916 records). [2025-10-13T21:22:39.791191] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-13T21:22:40.186302] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-13T21:22:40.186378] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-13T21:22:40.187417] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-13T21:22:40.187478] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-13T21:22:40.188925] [DEBUG] [LOCAL ] SAP: Trimmed 71916 records to 49885 (keeping 200 days of data) [2025-10-13T21:22:40.418125] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-13T21:22:40.515175] [DEBUG] [LOCAL ] SAP: Primary data saved (49885 records). [2025-10-13T21:22:40.515310] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-13T21:22:40.515423] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAP took 45.1s. Estimated remaining: 1h 11m 4s. Rate: 7.1 symbols/min [2025-10-13T21:22:40.690160] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:40.690379] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-13T21:22:40.690478] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-13T21:22:40.690972] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-13T21:22:40.691041] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-13T21:22:40.691098] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-13T21:22:40.691238] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-13T21:22:40.885834] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T21:22:41.076202] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:41.217978] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-13T21:22:41.628990] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-13T21:22:42.026611] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-13T21:22:42.032094] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T21:22:42.367821] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-13T21:22:42.817926] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-13T21:22:43.618157] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-13T21:22:44.155893] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T21:22:44.160880] [INFO ] [REMOTE ] SARO: Full fetch complete (68683 records). [2025-10-13T21:22:44.160992] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-13T21:22:44.423174] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-13T21:22:44.563368] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-13T21:22:44.563445] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-13T21:22:44.564430] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-13T21:22:44.564514] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-13T21:22:44.565875] [DEBUG] [LOCAL ] SARO: Trimmed 68683 records to 48347 (keeping 200 days of data) [2025-10-13T21:22:44.688215] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T21:22:44.807456] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-13T21:22:44.879366] [DEBUG] [LOCAL ] SARO: Primary data saved (48347 records). [2025-10-13T21:22:44.879502] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-13T21:22:44.879596] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SARO took 30.2s. Estimated remaining: 1h 10m 55s. Rate: 7.1 symbols/min [2025-10-13T21:22:45.044777] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:45.044942] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-13T21:22:45.044979] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-13T21:22:45.045118] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-13T21:22:45.045190] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-13T21:22:45.045266] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-13T21:22:45.045304] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-13T21:22:45.220997] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-13T21:22:45.410228] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:45.751111] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T21:22:46.017926] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-13T21:22:46.364610] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T21:22:46.818024] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-13T21:22:47.157012] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-13T21:22:47.617927] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-13T21:22:47.872722] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-13T21:22:47.873426] [INFO ] [REMOTE ] SAT: Full fetch complete (1517 records). [2025-10-13T21:22:47.873490] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-13T21:22:48.054820] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-13T21:22:48.055072] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:22:48.055126] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:22:48.055191] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-13T21:22:48.055255] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-13T21:22:48.055289] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-13T21:22:48.055328] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-13T21:22:48.055383] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAT took 31.9s. Estimated remaining: 1h 10m 45s. Rate: 7.1 symbols/min [2025-10-13T21:22:48.227547] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:22:48.260360] [DEBUG] [LOCAL ] SB: Loaded 33523 existing records from primary storage. [2025-10-13T21:22:48.260675] [INFO ] [MAIN ] SB: Loaded 33523 existing records. [2025-10-13T21:22:48.421247] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-13T21:22:48.448350] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:22:48.449161] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-13T21:22:48.449207] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-13T21:22:48.449629] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-13T21:22:48.449724] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-13T21:22:48.802364] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:22:48.932609] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T21:22:49.217937] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-13T21:22:49.551742] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T21:22:50.017972] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-13T21:22:50.817925] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-13T21:22:51.134137] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T21:22:51.617924] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-13T21:22:52.417920] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-13T21:22:53.217992] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-13T21:23:05.363956] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (13.75 seconds). [2025-10-13T21:23:05.365168] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-13T21:23:06.717459] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (13.50 seconds). [2025-10-13T21:23:06.722072] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-13T21:23:07.379425] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T21:23:07.380387] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-13T21:23:07.723399] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T21:23:07.724414] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-13T21:23:07.811859] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (15.39 seconds). [2025-10-13T21:23:07.819936] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-13T21:23:08.044844] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (17.23 seconds). [2025-10-13T21:23:08.045850] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-13T21:23:08.200574] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T21:23:08.201604] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-13T21:23:08.327863] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-13T21:23:08.329000] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-13T21:23:08.570628] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T21:23:08.571587] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-13T21:23:08.694381] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T21:23:08.697690] [INFO ] [REMOTE ] SAR: Full fetch complete (23674 records). [2025-10-13T21:23:08.697761] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-13T21:23:08.780738] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T21:23:08.803978] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-13T21:23:08.863968] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-13T21:23:08.883894] [INFO ] [REMOTE ] SAY: Full fetch complete (1363 records). [2025-10-13T21:23:08.926021] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-13T21:23:09.212920] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-13T21:23:09.231676] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-13T21:23:09.261610] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-13T21:23:09.294721] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-13T21:23:09.294897] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-13T21:23:09.295160] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:23:09.296390] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:23:09.296818] [DEBUG] [LOCAL ] SAR: Trimmed 23674 records to 17161 (keeping 200 days of data) [2025-10-13T21:23:09.297251] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-13T21:23:09.297727] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-13T21:23:09.298170] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-13T21:23:09.298296] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-13T21:23:09.298382] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAY took 28.8s. Estimated remaining: 1h 10m 40s. Rate: 7.1 symbols/min [2025-10-13T21:23:09.422793] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T21:23:09.495746] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-13T21:23:09.509726] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T21:23:09.593920] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-13T21:23:09.597675] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:09.600730] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-13T21:23:09.601337] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-13T21:23:09.601506] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-13T21:23:09.601954] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-13T21:23:09.602681] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-13T21:23:09.603907] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-13T21:23:09.985430] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:09.986916] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-13T21:23:09.995608] [DEBUG] [LOCAL ] SAR: Primary data saved (17161 records). [2025-10-13T21:23:09.995804] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-13T21:23:09.995900] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAR took 56.7s. Estimated remaining: 1h 10m 29s. Rate: 7.1 symbols/min [2025-10-13T21:23:10.171710] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:10.205514] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:23:10.205951] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-13T21:23:10.206064] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:23:10.206125] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-13T21:23:10.206213] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:23:10.206287] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-13T21:23:10.206351] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-13T21:23:10.206386] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-13T21:23:10.206426] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-13T21:23:10.206494] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 0.9s. Estimated remaining: 1h 10m 19s. Rate: 7.1 symbols/min [2025-10-13T21:23:10.335937] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T21:23:10.337627] [DEBUG] [LOCAL ] SBH: Loaded 50548 existing records from primary storage. [2025-10-13T21:23:10.339482] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-13T21:23:10.350914] [INFO ] [MAIN ] SBH: Loaded 50548 existing records. [2025-10-13T21:23:10.473534] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:10.612699] [DEBUG] [LOCAL ] SBI: Loaded 7485 existing records from primary storage. [2025-10-13T21:23:10.619738] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:10.620263] [INFO ] [MAIN ] SBI: Loaded 7485 existing records. [2025-10-13T21:23:10.642375] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-13T21:23:10.666928] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-13T21:23:10.699431] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-13T21:23:10.704723] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-13T21:23:10.923609] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:10.950839] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-13T21:23:10.975754] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-13T21:23:11.016555] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-13T21:23:11.027671] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T21:23:11.027969] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-13T21:23:11.048606] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-13T21:23:11.290417] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T21:23:11.431625] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-13T21:23:11.431137] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:11.465448] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-13T21:23:11.562019] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T21:23:11.567387] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-13T21:23:11.646827] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:11.647107] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-13T21:23:11.985895] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-13T21:23:11.987302] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-13T21:23:12.335528] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T21:23:12.336462] [INFO ] [REMOTE ] SAZ: Full fetch complete (1840 records). [2025-10-13T21:23:12.336533] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-13T21:23:12.452231] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T21:23:12.465583] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-13T21:23:12.544474] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T21:23:12.544744] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:23:12.544814] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:23:12.544954] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-13T21:23:12.545039] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-13T21:23:12.545080] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-13T21:23:12.545120] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-13T21:23:12.545184] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SAZ took 27.7s. Estimated remaining: 1h 10m 9s. Rate: 7.1 symbols/min [2025-10-13T21:23:12.725824] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:12.755357] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T21:23:12.769450] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-13T21:23:12.769821] [DEBUG] [LOCAL ] SBR: Loaded 7784 existing records from primary storage. [2025-10-13T21:23:12.771323] [INFO ] [MAIN ] SBR: Loaded 7784 existing records. [2025-10-13T21:23:12.964835] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:12.965810] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-13T21:23:12.965873] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-13T21:23:12.966294] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-13T21:23:12.966354] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-13T21:23:13.264380] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T21:23:13.311551] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-13T21:23:13.355793] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:13.356690] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-13T21:23:13.394564] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T21:23:13.405587] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-13T21:23:13.976354] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T21:23:14.017980] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-13T21:23:14.216409] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T21:23:14.234228] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T21:23:14.555173] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T21:23:14.634362] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T21:23:14.817974] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-13T21:23:15.606588] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:23:15.617886] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-13T21:23:16.323097] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T21:23:16.417966] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-13T21:23:17.218016] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-13T21:23:17.258768] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T21:23:18.017963] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-13T21:23:18.530430] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T21:23:18.817976] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-13T21:23:18.917134] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T21:23:19.612835] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T21:23:19.617881] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-13T21:23:20.388386] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:23:20.417992] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-13T21:23:21.218042] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-13T21:23:21.726949] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T21:23:22.017922] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-13T21:23:22.099212] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T21:23:22.817965] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-13T21:23:23.623173] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-13T21:23:23.651713] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:23:24.078169] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T21:23:24.417971] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-13T21:23:24.436398] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T21:23:25.217894] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-13T21:23:25.681089] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T21:23:25.755524] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T21:23:26.017973] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-13T21:23:26.817976] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-13T21:23:27.617989] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-13T21:23:27.775362] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T21:23:28.016974] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T21:23:28.024429] [INFO ] [REMOTE ] SB: Full fetch complete (49773 records). [2025-10-13T21:23:28.024575] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-13T21:23:28.423076] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-13T21:23:28.497135] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T21:23:28.496742] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-13T21:23:28.497292] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-13T21:23:28.500526] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-13T21:23:28.500926] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-13T21:23:28.501998] [DEBUG] [LOCAL ] SB: Trimmed 49773 records to 33010 (keeping 200 days of data) [2025-10-13T21:23:28.698964] [DEBUG] [LOCAL ] SB: Primary data saved (33010 records). [2025-10-13T21:23:28.699113] [INFO ] [MAIN ] SB: Full history saved. [2025-10-13T21:23:28.699197] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SB took 40.6s. Estimated remaining: 1h 10m 2s. Rate: 7.1 symbols/min [2025-10-13T21:23:28.866219] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:28.910607] [DEBUG] [LOCAL ] SBS: Loaded 50102 existing records from primary storage. [2025-10-13T21:23:28.910980] [INFO ] [MAIN ] SBS: Loaded 50102 existing records. [2025-10-13T21:23:29.125902] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:29.126172] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-13T21:23:29.126241] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-13T21:23:29.128001] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-13T21:23:29.128089] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-13T21:23:29.223133] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-13T21:23:29.290035] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T21:23:29.539671] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:29.946420] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T21:23:30.017926] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-13T21:23:30.782609] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T21:23:30.817905] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-13T21:23:31.621734] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-13T21:23:31.655007] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T21:23:32.418062] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-13T21:23:33.086941] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T21:23:33.201058] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:23:33.217894] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-13T21:23:34.017970] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-13T21:23:34.767795] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:23:34.770332] [INFO ] [REMOTE ] SBI: Full fetch complete (10417 records). [2025-10-13T21:23:34.770461] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-13T21:23:34.826164] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-13T21:23:34.965457] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T21:23:35.191752] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-13T21:23:35.191858] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-13T21:23:35.192257] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-13T21:23:35.192301] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-13T21:23:35.192854] [DEBUG] [LOCAL ] SBI: Trimmed 10417 records to 7413 (keeping 200 days of data) [2025-10-13T21:23:35.237810] [DEBUG] [LOCAL ] SBI: Primary data saved (7413 records). [2025-10-13T21:23:35.238005] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-13T21:23:35.238119] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 25.0s. Estimated remaining: 1h 9m 53s. Rate: 7.1 symbols/min [2025-10-13T21:23:35.411278] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:35.429458] [DEBUG] [LOCAL ] SBSI: Loaded 15034 existing records from primary storage. [2025-10-13T21:23:35.429785] [INFO ] [MAIN ] SBSI: Loaded 15034 existing records. [2025-10-13T21:23:35.608560] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:35.608862] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-13T21:23:35.608912] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-13T21:23:35.609333] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-13T21:23:35.609391] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-13T21:23:35.623194] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-13T21:23:35.986068] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:36.418047] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-13T21:23:36.640771] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T21:23:37.207134] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T21:23:37.218799] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-13T21:23:37.480010] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T21:23:38.018027] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-13T21:23:38.817924] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-13T21:23:38.988157] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T21:23:39.492354] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T21:23:39.494216] [INFO ] [REMOTE ] SBR: Full fetch complete (11303 records). [2025-10-13T21:23:39.494293] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-13T21:23:39.619745] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-13T21:23:39.723870] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T21:23:39.931138] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-13T21:23:39.931214] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-13T21:23:39.931550] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-13T21:23:39.931588] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-13T21:23:39.932085] [DEBUG] [LOCAL ] SBR: Trimmed 11303 records to 7759 (keeping 200 days of data) [2025-10-13T21:23:39.983076] [DEBUG] [LOCAL ] SBR: Primary data saved (7759 records). [2025-10-13T21:23:39.983216] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-13T21:23:39.983301] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBR took 27.4s. Estimated remaining: 1h 9m 44s. Rate: 7.1 symbols/min [2025-10-13T21:23:40.160558] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:40.212274] [DEBUG] [LOCAL ] SBSW: Loaded 53859 existing records from primary storage. [2025-10-13T21:23:40.212589] [INFO ] [MAIN ] SBSW: Loaded 53859 existing records. [2025-10-13T21:23:40.401110] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:23:40.401322] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-13T21:23:40.401389] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-13T21:23:40.402575] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-13T21:23:40.402636] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-13T21:23:40.423711] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-13T21:23:40.692110] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T21:23:40.780830] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:41.217991] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-13T21:23:42.017909] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-13T21:23:42.285183] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:23:42.817925] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-13T21:23:43.075471] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T21:23:43.340293] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:23:43.617904] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-13T21:23:44.417956] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-13T21:23:44.597251] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T21:23:44.955483] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T21:23:45.218013] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-13T21:23:45.280809] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T21:23:46.017934] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-13T21:23:46.817953] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-13T21:23:46.964678] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:23:47.617998] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-13T21:23:47.884741] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T21:23:47.922947] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T21:23:48.417981] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-13T21:23:49.215162] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T21:23:49.224307] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-13T21:23:49.452199] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T21:23:50.017929] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-13T21:23:50.817913] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-13T21:23:51.028616] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:23:51.329742] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T21:23:51.377264] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T21:23:51.617920] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-13T21:23:52.417914] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-13T21:23:53.085732] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T21:23:53.217914] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-13T21:23:53.346770] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T21:23:54.017963] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-13T21:23:54.818005] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-13T21:23:55.221289] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T21:23:55.574206] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T21:23:55.617920] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-13T21:23:55.767329] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T21:23:56.417923] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-13T21:23:57.218011] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-13T21:23:57.390789] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T21:23:57.850969] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T21:23:57.858335] [INFO ] [REMOTE ] SBH: Full fetch complete (72914 records). [2025-10-13T21:23:57.858512] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-13T21:23:58.024546] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-13T21:23:58.275040] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-13T21:23:58.275171] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-13T21:23:58.276690] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-13T21:23:58.276759] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-13T21:23:58.278931] [DEBUG] [LOCAL ] SBH: Trimmed 72914 records to 49842 (keeping 200 days of data) [2025-10-13T21:23:58.608682] [DEBUG] [LOCAL ] SBH: Primary data saved (49842 records). [2025-10-13T21:23:58.608891] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-13T21:23:58.609081] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 48.6s. Estimated remaining: 1h 9m 38s. Rate: 7.1 symbols/min [2025-10-13T21:23:58.805534] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:23:58.805857] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-13T21:23:58.805911] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-13T21:23:58.806034] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-13T21:23:58.806078] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-13T21:23:58.806175] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-13T21:23:58.806217] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-13T21:23:58.837820] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-13T21:23:59.191928] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:23:59.281035] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T21:23:59.443087] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:23:59.450766] [INFO ] [REMOTE ] SBS: Full fetch complete (70066 records). [2025-10-13T21:23:59.450978] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-13T21:23:59.621261] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-13T21:23:59.655462] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T21:23:59.877348] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-13T21:23:59.877463] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-13T21:23:59.878722] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-13T21:23:59.878787] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-13T21:23:59.880400] [DEBUG] [LOCAL ] SBS: Trimmed 70066 records to 49348 (keeping 200 days of data) [2025-10-13T21:24:00.192533] [DEBUG] [LOCAL ] SBS: Primary data saved (49348 records). [2025-10-13T21:24:00.192813] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-13T21:24:00.192929] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBS took 31.5s. Estimated remaining: 1h 9m 28s. Rate: 7.1 symbols/min [2025-10-13T21:24:00.418013] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-13T21:24:01.218030] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-13T21:24:01.383003] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:24:01.601365] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-13T21:24:01.622553] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T21:24:02.018020] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-13T21:24:02.252839] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-13T21:24:02.818020] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-13T21:24:03.139937] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-13T21:24:03.617934] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-13T21:24:04.417966] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-13T21:24:05.217952] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-13T21:24:05.325907] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T21:24:05.328163] [INFO ] [REMOTE ] SBSI: Full fetch complete (21083 records). [2025-10-13T21:24:05.328472] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-13T21:24:05.521723] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-13T21:24:05.727296] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-13T21:24:05.727406] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-13T21:24:05.728072] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-13T21:24:05.728161] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-13T21:24:05.746036] [DEBUG] [LOCAL ] SBSI: Trimmed 21083 records to 14868 (keeping 200 days of data) [2025-10-13T21:24:05.798843] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-13T21:24:05.870678] [DEBUG] [LOCAL ] SBSI: Primary data saved (14868 records). [2025-10-13T21:24:05.870839] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-13T21:24:05.870931] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSI took 30.6s. Estimated remaining: 1h 9m 19s. Rate: 7.1 symbols/min [2025-10-13T21:24:06.017978] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-13T21:24:06.817991] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-13T21:24:07.048113] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-13T21:24:07.617977] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-13T21:24:08.113076] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T21:24:08.162599] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T21:24:08.417980] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-13T21:24:09.217987] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-13T21:24:09.982203] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T21:24:10.017911] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-13T21:24:10.403068] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T21:24:10.584034] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T21:24:10.817983] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-13T21:24:11.282565] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T21:24:11.617986] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-13T21:24:12.000373] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T21:24:12.417989] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-13T21:24:13.218036] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-13T21:24:13.492966] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-13T21:24:13.494259] [INFO ] [REMOTE ] SBXD: Full fetch complete (3117 records). [2025-10-13T21:24:13.494359] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-13T21:24:13.787678] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-13T21:24:13.788078] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:24:13.788170] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:24:13.788326] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-13T21:24:13.788438] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-13T21:24:13.788540] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-13T21:24:13.788618] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-13T21:24:13.788756] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBXD took 15.2s. Estimated remaining: 1h 9m 10s. Rate: 7.1 symbols/min [2025-10-13T21:24:14.566190] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-13T21:24:14.578291] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-13T21:24:16.447905] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T21:24:16.453964] [INFO ] [REMOTE ] SBSW: Full fetch complete (76555 records). [2025-10-13T21:24:16.454110] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-13T21:24:16.850794] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-13T21:24:16.850945] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-13T21:24:16.852100] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-13T21:24:16.852165] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-13T21:24:16.853760] [DEBUG] [LOCAL ] SBSW: Trimmed 76555 records to 53150 (keeping 200 days of data) [2025-10-13T21:24:17.179374] [DEBUG] [LOCAL ] SBSW: Primary data saved (53150 records). [2025-10-13T21:24:17.179516] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-13T21:24:17.179599] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 37.2s. Estimated remaining: 1h 9m 1s. Rate: 7.1 symbols/min [2025-10-13T21:24:17.775695] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:17.859074] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:17.859997] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:17.917493] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:17.938301] [DEBUG] [LOCAL ] SCD: Loaded 13228 existing records from primary storage. [2025-10-13T21:24:17.938877] [INFO ] [MAIN ] SCD: Loaded 13228 existing records. [2025-10-13T21:24:18.209701] [DEBUG] [LOCAL ] SCCO: Loaded 50367 existing records from primary storage. [2025-10-13T21:24:18.208958] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:18.212240] [INFO ] [MAIN ] SCCO: Loaded 50367 existing records. [2025-10-13T21:24:18.217783] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-13T21:24:18.249884] [DEBUG] [LOCAL ] SCI: Loaded 47192 existing records from primary storage. [2025-10-13T21:24:18.277322] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-13T21:24:18.277535] [INFO ] [MAIN ] SCI: Loaded 47192 existing records. [2025-10-13T21:24:18.299897] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-13T21:24:18.317050] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-13T21:24:18.323324] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-13T21:24:18.465160] [INFO ] [MAIN ] SCHW: Loaded 54465 existing records. [2025-10-13T21:24:18.694622] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:18.770100] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-13T21:24:18.801533] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-13T21:24:18.851144] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-13T21:24:18.877122] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-13T21:24:18.973846] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:19.063985] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-13T21:24:19.174620] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-13T21:24:19.210743] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:19.232083] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-13T21:24:19.253782] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-13T21:24:19.253874] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-13T21:24:19.259430] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-13T21:24:19.269858] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-13T21:24:19.275153] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-13T21:24:19.830777] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:19.866974] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-13T21:24:20.230718] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:20.263128] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-13T21:24:20.466063] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:20.468509] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-13T21:24:20.490426] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:20.491239] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-13T21:24:20.539928] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T21:24:20.542533] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-13T21:24:21.303426] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T21:24:21.306053] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-13T21:24:22.026270] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:24:22.036857] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-13T21:24:22.053295] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T21:24:22.056085] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-13T21:24:22.086170] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:24:22.095491] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-13T21:24:22.167805] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:24:22.178963] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-13T21:24:22.821612] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:24:22.823909] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-13T21:24:23.471206] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T21:24:23.615057] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:24:23.618602] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T21:24:23.621305] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-13T21:24:24.065695] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T21:24:24.417994] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-13T21:24:24.899700] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T21:24:25.163532] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T21:24:25.217979] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-13T21:24:26.017919] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-13T21:24:26.240600] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T21:24:26.817913] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-13T21:24:27.617926] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-13T21:24:27.776118] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T21:24:28.418008] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-13T21:24:28.523603] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T21:24:29.053891] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T21:24:29.217917] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-13T21:24:29.593548] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T21:24:30.017977] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-13T21:24:30.817963] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-13T21:24:30.948028] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T21:24:31.154267] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T21:24:31.617978] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-13T21:24:32.417934] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-13T21:24:32.502335] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T21:24:32.783736] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T21:24:33.218022] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-13T21:24:34.017974] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-13T21:24:34.124344] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T21:24:34.817920] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-13T21:24:35.263910] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T21:24:35.617932] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-13T21:24:35.887792] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T21:24:36.175108] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T21:24:36.417926] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-13T21:24:37.217906] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-13T21:24:37.564554] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T21:24:38.002360] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T21:24:38.017878] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-13T21:24:38.482459] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T21:24:38.818007] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-13T21:24:39.504377] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T21:24:39.506046] [INFO ] [REMOTE ] SCD: Full fetch complete (16612 records). [2025-10-13T21:24:39.506145] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-13T21:24:39.623217] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-13T21:24:39.882839] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-13T21:24:39.882937] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-13T21:24:39.883464] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-13T21:24:39.883506] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-13T21:24:39.884116] [DEBUG] [LOCAL ] SCD: Trimmed 16612 records to 13134 (keeping 200 days of data) [2025-10-13T21:24:39.973378] [DEBUG] [LOCAL ] SCD: Primary data saved (13134 records). [2025-10-13T21:24:39.973996] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-13T21:24:39.974274] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 22.8s. Estimated remaining: 1h 8m 56s. Rate: 7.1 symbols/min [2025-10-13T21:24:40.145844] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:40.162639] [DEBUG] [LOCAL ] SCL: Loaded 14996 existing records from primary storage. [2025-10-13T21:24:40.163012] [INFO ] [MAIN ] SCL: Loaded 14996 existing records. [2025-10-13T21:24:40.348474] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:40.349072] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-13T21:24:40.349257] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-13T21:24:40.349828] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-13T21:24:40.350019] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-13T21:24:40.422433] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-13T21:24:40.691485] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-13T21:24:40.789716] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:41.217971] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-13T21:24:41.370015] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:24:42.017967] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-13T21:24:42.066467] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T21:24:42.370025] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T21:24:42.817951] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-13T21:24:43.617983] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-13T21:24:43.620375] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T21:24:44.417978] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-13T21:24:44.912915] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T21:24:45.218012] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-13T21:24:45.582481] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T21:24:45.671187] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T21:24:45.838246] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T21:24:46.017909] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-13T21:24:46.817905] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-13T21:24:47.349968] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T21:24:47.354862] [INFO ] [REMOTE ] SCI: Full fetch complete (67466 records). [2025-10-13T21:24:47.354978] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-13T21:24:47.623068] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-13T21:24:47.738033] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-13T21:24:47.738133] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-13T21:24:47.739209] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-13T21:24:47.739271] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-13T21:24:47.741718] [DEBUG] [LOCAL ] SCI: Trimmed 67466 records to 46560 (keeping 200 days of data) [2025-10-13T21:24:48.034336] [DEBUG] [LOCAL ] SCI: Primary data saved (46560 records). [2025-10-13T21:24:48.034688] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-13T21:24:48.036480] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCI took 30.9s. Estimated remaining: 1h 8m 47s. Rate: 7.1 symbols/min [2025-10-13T21:24:48.202003] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:48.223229] [DEBUG] [LOCAL ] SCM: Loaded 20313 existing records from primary storage. [2025-10-13T21:24:48.223472] [INFO ] [MAIN ] SCM: Loaded 20313 existing records. [2025-10-13T21:24:48.406825] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:48.407218] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-13T21:24:48.407358] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-13T21:24:48.407985] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-13T21:24:48.408058] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-13T21:24:48.443275] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-13T21:24:48.711220] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T21:24:48.808510] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:49.205008] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T21:24:49.217882] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-13T21:24:49.546489] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T21:24:50.017920] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-13T21:24:50.070938] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T21:24:50.817930] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-13T21:24:51.154269] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T21:24:51.618002] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-13T21:24:52.416313] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T21:24:52.426087] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-13T21:24:53.217991] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-13T21:24:53.394687] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T21:24:53.511100] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T21:24:54.017984] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-13T21:24:54.274824] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T21:24:54.818035] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-13T21:24:54.993035] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T21:24:55.617960] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-13T21:24:56.417983] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-13T21:24:56.555510] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T21:24:56.561565] [INFO ] [REMOTE ] SCHW: Full fetch complete (77705 records). [2025-10-13T21:24:56.561760] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-13T21:24:56.684564] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T21:24:56.990253] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-13T21:24:56.990368] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-13T21:24:56.991701] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-13T21:24:56.991781] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-13T21:24:56.993878] [DEBUG] [LOCAL ] SCHW: Trimmed 77705 records to 53685 (keeping 200 days of data) [2025-10-13T21:24:57.223757] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-13T21:24:57.238910] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T21:24:57.367362] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-13T21:24:57.367552] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-13T21:24:57.367683] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCHW took 40.2s. Estimated remaining: 1h 8m 39s. Rate: 7.1 symbols/min [2025-10-13T21:24:57.571281] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:57.616080] [DEBUG] [LOCAL ] SCS: Loaded 44139 existing records from primary storage. [2025-10-13T21:24:57.616480] [INFO ] [MAIN ] SCS: Loaded 44139 existing records. [2025-10-13T21:24:57.802257] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:24:57.802521] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-13T21:24:57.802572] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-13T21:24:57.803480] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-13T21:24:57.803542] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-13T21:24:58.025758] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-13T21:24:58.174268] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:24:58.817929] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-13T21:24:58.878018] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T21:24:58.885405] [INFO ] [REMOTE ] SCCO: Full fetch complete (71423 records). [2025-10-13T21:24:58.885571] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-13T21:24:59.324325] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T21:24:59.323529] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-13T21:24:59.324477] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-13T21:24:59.325873] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-13T21:24:59.325980] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-13T21:24:59.333681] [DEBUG] [LOCAL ] SCCO: Trimmed 71423 records to 49604 (keeping 200 days of data) [2025-10-13T21:24:59.627329] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-13T21:24:59.676490] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T21:24:59.685410] [DEBUG] [LOCAL ] SCCO: Primary data saved (49604 records). [2025-10-13T21:24:59.685616] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-13T21:24:59.685765] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCCO took 42.5s. Estimated remaining: 1h 8m 29s. Rate: 7.1 symbols/min [2025-10-13T21:24:59.860730] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:24:59.891068] [DEBUG] [LOCAL ] SD: Loaded 29127 existing records from primary storage. [2025-10-13T21:24:59.891510] [INFO ] [MAIN ] SD: Loaded 29127 existing records. [2025-10-13T21:25:00.072613] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:00.072931] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-13T21:25:00.072993] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-13T21:25:00.073685] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-13T21:25:00.073747] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-13T21:25:00.424080] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-13T21:25:00.459447] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:00.754909] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T21:25:01.217999] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-13T21:25:01.931372] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T21:25:02.018013] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-13T21:25:02.502882] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T21:25:02.817977] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-13T21:25:03.438966] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T21:25:03.617977] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-13T21:25:04.053967] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T21:25:04.417973] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-13T21:25:04.447449] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T21:25:05.221771] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-13T21:25:05.876034] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T21:25:06.017966] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-13T21:25:06.336742] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T21:25:06.817960] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-13T21:25:07.153465] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:25:07.460097] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T21:25:07.617977] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-13T21:25:08.417976] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-13T21:25:09.157088] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T21:25:09.217984] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-13T21:25:09.249070] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T21:25:10.018003] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-13T21:25:10.045638] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T21:25:10.047770] [INFO ] [REMOTE ] SCL: Full fetch complete (21346 records). [2025-10-13T21:25:10.047845] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-13T21:25:10.436766] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-13T21:25:10.436946] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-13T21:25:10.437618] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-13T21:25:10.437713] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-13T21:25:10.438821] [DEBUG] [LOCAL ] SCL: Trimmed 21346 records to 14767 (keeping 200 days of data) [2025-10-13T21:25:10.545233] [DEBUG] [LOCAL ] SCL: Primary data saved (14767 records). [2025-10-13T21:25:10.545379] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-13T21:25:10.545461] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 30.6s. Estimated remaining: 1h 8m 21s. Rate: 7.1 symbols/min [2025-10-13T21:25:10.719335] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:10.730548] [DEBUG] [LOCAL ] SDHC: Loaded 10511 existing records from primary storage. [2025-10-13T21:25:10.730805] [INFO ] [MAIN ] SDHC: Loaded 10511 existing records. [2025-10-13T21:25:10.826627] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-13T21:25:10.915089] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:10.915520] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-13T21:25:10.915574] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-13T21:25:10.915983] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-13T21:25:10.916043] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-13T21:25:11.308778] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:11.333075] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T21:25:11.618010] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-13T21:25:11.983979] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T21:25:12.418029] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-13T21:25:12.604044] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T21:25:13.217965] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-13T21:25:13.292218] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T21:25:14.017991] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-13T21:25:14.544264] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T21:25:14.818008] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-13T21:25:15.578300] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T21:25:15.617987] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-13T21:25:15.783392] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T21:25:16.418009] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-13T21:25:16.763250] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T21:25:17.217918] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-13T21:25:17.540818] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T21:25:18.018016] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-13T21:25:18.054725] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T21:25:18.818046] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-13T21:25:19.261885] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:25:19.617983] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-13T21:25:20.178478] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T21:25:20.417899] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-13T21:25:20.706624] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T21:25:21.217967] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-13T21:25:21.733450] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T21:25:22.017932] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-13T21:25:22.302342] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T21:25:22.818060] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-13T21:25:23.038534] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T21:25:23.043598] [INFO ] [REMOTE ] SD: Full fetch complete (41033 records). [2025-10-13T21:25:23.043907] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-13T21:25:23.604773] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-13T21:25:23.604894] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-13T21:25:23.605887] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-13T21:25:23.606015] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-13T21:25:23.607398] [DEBUG] [LOCAL ] SD: Trimmed 41033 records to 28755 (keeping 200 days of data) [2025-10-13T21:25:23.659342] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-13T21:25:23.795867] [DEBUG] [LOCAL ] SD: Primary data saved (28755 records). [2025-10-13T21:25:23.796024] [INFO ] [MAIN ] SD: Full history saved. [2025-10-13T21:25:23.796118] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SD took 24.1s. Estimated remaining: 1h 8m 14s. Rate: 7.1 symbols/min [2025-10-13T21:25:23.970202] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:23.981310] [DEBUG] [LOCAL ] SDHY: Loaded 11075 existing records from primary storage. [2025-10-13T21:25:23.981492] [INFO ] [MAIN ] SDHY: Loaded 11075 existing records. [2025-10-13T21:25:24.157225] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:24.157604] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-13T21:25:24.157867] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-13T21:25:24.158322] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-13T21:25:24.158518] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-13T21:25:24.427030] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-13T21:25:24.404667] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T21:25:24.581111] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:24.589167] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T21:25:25.217968] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-13T21:25:25.474681] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T21:25:25.478092] [INFO ] [REMOTE ] SCM: Full fetch complete (28832 records). [2025-10-13T21:25:25.478176] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-13T21:25:25.857372] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T21:25:25.891071] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-13T21:25:25.891163] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-13T21:25:25.892048] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-13T21:25:25.892111] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-13T21:25:25.892965] [DEBUG] [LOCAL ] SCM: Trimmed 28832 records to 20105 (keeping 200 days of data) [2025-10-13T21:25:26.018402] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-13T21:25:26.038677] [DEBUG] [LOCAL ] SCM: Primary data saved (20105 records). [2025-10-13T21:25:26.038869] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-13T21:25:26.038977] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCM took 38.0s. Estimated remaining: 1h 8m 4s. Rate: 7.1 symbols/min [2025-10-13T21:25:26.222397] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:26.267499] [DEBUG] [LOCAL ] SDRL: Loaded 42101 existing records from primary storage. [2025-10-13T21:25:26.267967] [INFO ] [MAIN ] SDRL: Loaded 42101 existing records. [2025-10-13T21:25:26.451456] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:26.451760] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-13T21:25:26.451816] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-13T21:25:26.452746] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-13T21:25:26.452871] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-13T21:25:26.818052] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-13T21:25:26.832403] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:26.843140] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T21:25:27.617966] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-13T21:25:28.418133] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-13T21:25:28.421151] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T21:25:28.439794] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T21:25:29.217959] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-13T21:25:29.261747] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T21:25:29.975715] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T21:25:30.017996] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-13T21:25:30.817988] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-13T21:25:30.832718] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T21:25:31.617973] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-13T21:25:31.655942] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T21:25:32.365810] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:25:32.367635] [INFO ] [REMOTE ] SDHC: Full fetch complete (17109 records). [2025-10-13T21:25:32.367741] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-13T21:25:32.426349] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-13T21:25:32.773884] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-13T21:25:32.773980] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-13T21:25:32.774481] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-13T21:25:32.774530] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-13T21:25:32.775396] [DEBUG] [LOCAL ] SDHC: Trimmed 17109 records to 10329 (keeping 200 days of data) [2025-10-13T21:25:32.842093] [DEBUG] [LOCAL ] SDHC: Primary data saved (10329 records). [2025-10-13T21:25:32.842280] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-13T21:25:32.842375] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 22.3s. Estimated remaining: 1h 7m 55s. Rate: 7.1 symbols/min [2025-10-13T21:25:33.020737] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:33.076208] [DEBUG] [LOCAL ] SE: Loaded 54109 existing records from primary storage. [2025-10-13T21:25:33.076685] [INFO ] [MAIN ] SE: Loaded 54109 existing records. [2025-10-13T21:25:33.228852] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-13T21:25:33.276459] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:33.277022] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-13T21:25:33.285588] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T21:25:33.285678] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-13T21:25:33.289127] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-13T21:25:33.289262] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-13T21:25:33.643109] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:34.018000] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-13T21:25:34.771743] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T21:25:34.823054] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-13T21:25:34.839986] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T21:25:35.617929] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-13T21:25:35.764517] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T21:25:36.417961] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-13T21:25:37.217998] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-13T21:25:37.361512] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:25:37.466209] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T21:25:38.017930] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-13T21:25:38.817992] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-13T21:25:39.206984] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T21:25:39.573596] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T21:25:39.583348] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T21:25:39.617877] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-13T21:25:40.417959] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-13T21:25:41.151124] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:25:41.155850] [INFO ] [REMOTE ] SCS: Full fetch complete (60844 records). [2025-10-13T21:25:41.155965] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-13T21:25:41.223147] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-13T21:25:41.548579] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-13T21:25:41.548683] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-13T21:25:41.549779] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-13T21:25:41.549843] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-13T21:25:41.551114] [DEBUG] [LOCAL ] SCS: Trimmed 60844 records to 43552 (keeping 200 days of data) [2025-10-13T21:25:41.828383] [DEBUG] [LOCAL ] SCS: Primary data saved (43552 records). [2025-10-13T21:25:41.828513] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-13T21:25:41.828592] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SCS took 44.5s. Estimated remaining: 1h 7m 47s. Rate: 7.1 symbols/min [2025-10-13T21:25:41.998312] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:42.021106] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-13T21:25:42.041935] [DEBUG] [LOCAL ] SEE: Loaded 48909 existing records from primary storage. [2025-10-13T21:25:42.042267] [INFO ] [MAIN ] SEE: Loaded 48909 existing records. [2025-10-13T21:25:42.220368] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T21:25:42.249793] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:42.257735] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-13T21:25:42.258099] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-13T21:25:42.258972] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-13T21:25:42.259031] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-13T21:25:42.612044] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:42.795766] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T21:25:42.817969] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-13T21:25:43.269368] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T21:25:43.617925] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-13T21:25:44.423088] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-13T21:25:44.441134] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:25:45.221810] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-13T21:25:45.227575] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T21:25:46.017974] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-13T21:25:46.366152] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T21:25:46.817983] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-13T21:25:46.895310] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:25:47.407901] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T21:25:47.615855] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T21:25:47.619067] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-13T21:25:48.417924] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-13T21:25:49.169435] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T21:25:49.217957] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-13T21:25:49.499706] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T21:25:49.866253] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T21:25:50.017917] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-13T21:25:50.817922] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-13T21:25:51.542264] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:25:51.543783] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T21:25:51.555959] [INFO ] [REMOTE ] SDHY: Full fetch complete (15699 records). [2025-10-13T21:25:51.556452] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-13T21:25:51.623033] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-13T21:25:51.956698] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-13T21:25:51.956804] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-13T21:25:51.957293] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-13T21:25:51.957339] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-13T21:25:51.958024] [DEBUG] [LOCAL ] SDHY: Trimmed 15699 records to 11002 (keeping 200 days of data) [2025-10-13T21:25:52.033205] [DEBUG] [LOCAL ] SDHY: Primary data saved (11002 records). [2025-10-13T21:25:52.033423] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-13T21:25:52.033526] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 28.2s. Estimated remaining: 1h 7m 39s. Rate: 7.1 symbols/min [2025-10-13T21:25:52.206215] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:25:52.222427] [DEBUG] [LOCAL ] SEG: Loaded 13415 existing records from primary storage. [2025-10-13T21:25:52.222972] [INFO ] [MAIN ] SEG: Loaded 13415 existing records. [2025-10-13T21:25:52.416285] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:25:52.416561] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-13T21:25:52.416638] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-13T21:25:52.417172] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-13T21:25:52.417234] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-13T21:25:52.428555] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-13T21:25:52.813006] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:25:53.218021] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-13T21:25:53.298408] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T21:25:54.001963] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T21:25:54.017873] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-13T21:25:54.051759] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T21:25:54.817985] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-13T21:25:54.829805] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T21:25:55.618012] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-13T21:25:56.417957] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-13T21:25:56.460294] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T21:25:57.217901] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-13T21:25:57.405632] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:25:57.942540] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T21:25:57.996694] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:25:58.017887] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-13T21:25:58.818003] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-13T21:25:59.568794] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T21:25:59.617884] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-13T21:25:59.796924] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T21:26:00.417978] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-13T21:26:01.027328] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T21:26:01.217930] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-13T21:26:02.018005] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-13T21:26:02.225148] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T21:26:02.408147] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:26:02.817927] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-13T21:26:03.617932] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-13T21:26:03.740969] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T21:26:03.797152] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:26:04.417965] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-13T21:26:05.217932] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-13T21:26:05.248933] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T21:26:05.659158] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T21:26:06.017923] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-13T21:26:06.652161] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:26:06.769339] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T21:26:06.818004] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-13T21:26:07.617971] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-13T21:26:07.794795] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T21:26:08.417929] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-13T21:26:09.217902] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-13T21:26:09.290266] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T21:26:09.988386] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T21:26:10.017875] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-13T21:26:10.594578] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T21:26:10.753847] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T21:26:10.756353] [INFO ] [REMOTE ] SEG: Full fetch complete (19755 records). [2025-10-13T21:26:10.756423] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-13T21:26:10.823274] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-13T21:26:11.132228] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-13T21:26:11.132306] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-13T21:26:11.132803] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-13T21:26:11.132865] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-13T21:26:11.133476] [DEBUG] [LOCAL ] SEG: Trimmed 19755 records to 13059 (keeping 200 days of data) [2025-10-13T21:26:11.212184] [DEBUG] [LOCAL ] SEG: Primary data saved (13059 records). [2025-10-13T21:26:11.212331] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-13T21:26:11.212413] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SEG took 19.2s. Estimated remaining: 1h 7m 33s. Rate: 7.1 symbols/min [2025-10-13T21:26:11.380786] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:11.431467] [DEBUG] [LOCAL ] SEI: Loaded 50532 existing records from primary storage. [2025-10-13T21:26:11.431878] [INFO ] [MAIN ] SEI: Loaded 50532 existing records. [2025-10-13T21:26:11.612141] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:11.612366] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-13T21:26:11.612415] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-13T21:26:11.613005] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-13T21:26:11.613067] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-13T21:26:11.624383] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-13T21:26:11.988086] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:12.418012] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-13T21:26:12.983816] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T21:26:12.989281] [INFO ] [REMOTE ] SDRL: Full fetch complete (61642 records). [2025-10-13T21:26:12.989535] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-13T21:26:13.227096] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-13T21:26:13.427110] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-13T21:26:13.427299] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-13T21:26:13.428524] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-13T21:26:13.428607] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-13T21:26:13.433914] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-13T21:26:13.445333] [DEBUG] [LOCAL ] SDRL: Trimmed 61642 records to 41480 (keeping 200 days of data) [2025-10-13T21:26:13.690833] [DEBUG] [LOCAL ] SDRL: Primary data saved (41480 records). [2025-10-13T21:26:13.690956] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-13T21:26:13.691031] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SDRL took 47.7s. Estimated remaining: 1h 7m 23s. Rate: 7.1 symbols/min [2025-10-13T21:26:13.870185] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:13.913813] [DEBUG] [LOCAL ] SEM: Loaded 43588 existing records from primary storage. [2025-10-13T21:26:13.914185] [INFO ] [MAIN ] SEM: Loaded 43588 existing records. [2025-10-13T21:26:14.020933] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-13T21:26:14.107105] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:26:14.135829] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:14.136443] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-13T21:26:14.136497] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-13T21:26:14.137666] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-13T21:26:14.137735] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-13T21:26:14.480564] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:14.817888] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-13T21:26:14.917313] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:26:15.617996] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-13T21:26:16.028173] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T21:26:16.172116] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T21:26:16.417920] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-13T21:26:17.217896] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-13T21:26:17.251194] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:26:18.017990] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-13T21:26:18.250048] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T21:26:18.255621] [INFO ] [REMOTE ] SE: Full fetch complete (77084 records). [2025-10-13T21:26:18.255771] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-13T21:26:18.653857] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-13T21:26:18.653971] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-13T21:26:18.655180] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-13T21:26:18.655241] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-13T21:26:18.656883] [DEBUG] [LOCAL ] SE: Trimmed 77084 records to 53312 (keeping 200 days of data) [2025-10-13T21:26:18.829467] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-13T21:26:18.989464] [DEBUG] [LOCAL ] SE: Primary data saved (53312 records). [2025-10-13T21:26:18.989607] [INFO ] [MAIN ] SE: Full history saved. [2025-10-13T21:26:18.989717] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SE took 46.1s. Estimated remaining: 1h 7m 14s. Rate: 7.1 symbols/min [2025-10-13T21:26:19.126230] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T21:26:19.210245] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:19.252072] [DEBUG] [LOCAL ] SEMR: Loaded 42445 existing records from primary storage. [2025-10-13T21:26:19.252579] [INFO ] [MAIN ] SEMR: Loaded 42445 existing records. [2025-10-13T21:26:19.441495] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:19.441829] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-13T21:26:19.441917] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-13T21:26:19.442625] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-13T21:26:19.442757] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-13T21:26:19.628775] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-13T21:26:19.688493] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T21:26:19.857061] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:20.417997] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-13T21:26:20.824461] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T21:26:21.217891] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-13T21:26:21.425417] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:26:22.014037] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T21:26:22.023606] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-13T21:26:22.817906] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-13T21:26:22.940162] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T21:26:23.418365] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T21:26:23.617994] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-13T21:26:24.417931] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-13T21:26:24.458395] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:26:25.073176] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T21:26:25.218027] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-13T21:26:25.621312] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T21:26:26.017983] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-13T21:26:26.424798] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T21:26:26.817982] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-13T21:26:27.618023] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-13T21:26:27.676954] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:26:28.205132] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T21:26:28.418021] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-13T21:26:28.944041] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T21:26:28.949501] [INFO ] [REMOTE ] SEE: Full fetch complete (69832 records). [2025-10-13T21:26:28.949672] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-13T21:26:29.223013] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-13T21:26:29.359195] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-13T21:26:29.359315] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-13T21:26:29.360536] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-13T21:26:29.360606] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-13T21:26:29.362509] [DEBUG] [LOCAL ] SEE: Trimmed 69832 records to 48210 (keeping 200 days of data) [2025-10-13T21:26:29.679951] [DEBUG] [LOCAL ] SEE: Primary data saved (48210 records). [2025-10-13T21:26:29.680116] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-13T21:26:29.680201] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEE took 47.9s. Estimated remaining: 1h 7m 6s. Rate: 7.1 symbols/min [2025-10-13T21:26:29.877479] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:29.929063] [DEBUG] [LOCAL ] SES: Loaded 52349 existing records from primary storage. [2025-10-13T21:26:29.929383] [INFO ] [MAIN ] SES: Loaded 52349 existing records. [2025-10-13T21:26:30.021171] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-13T21:26:30.147184] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:30.150077] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-13T21:26:30.149856] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T21:26:30.150257] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-13T21:26:30.159858] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-13T21:26:30.160000] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-13T21:26:30.519836] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:30.818026] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-13T21:26:31.328435] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T21:26:31.617960] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-13T21:26:31.727598] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:26:32.418028] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-13T21:26:32.489812] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T21:26:32.868625] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T21:26:33.218014] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-13T21:26:34.018015] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-13T21:26:34.404221] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T21:26:34.582481] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T21:26:34.817986] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-13T21:26:35.228636] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T21:26:35.617895] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-13T21:26:36.292873] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T21:26:36.417922] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-13T21:26:36.983422] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T21:26:37.217918] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-13T21:26:37.847341] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T21:26:38.017972] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-13T21:26:38.817922] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-13T21:26:39.163525] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T21:26:39.617995] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-13T21:26:39.754037] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:26:40.387557] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T21:26:40.417960] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-13T21:26:41.217928] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-13T21:26:42.017896] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-13T21:26:42.072138] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-13T21:26:42.188515] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T21:26:42.809149] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T21:26:42.817922] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-13T21:26:43.617975] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-13T21:26:43.720432] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T21:26:44.242896] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:26:44.248451] [INFO ] [REMOTE ] SEI: Full fetch complete (70557 records). [2025-10-13T21:26:44.248626] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-13T21:26:44.425450] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-13T21:26:44.636195] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-13T21:26:44.636289] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-13T21:26:44.637378] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-13T21:26:44.637449] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-13T21:26:44.639088] [DEBUG] [LOCAL ] SEI: Trimmed 70557 records to 49889 (keeping 200 days of data) [2025-10-13T21:26:44.950943] [DEBUG] [LOCAL ] SEI: Primary data saved (49889 records). [2025-10-13T21:26:44.951078] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-13T21:26:44.951208] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 33.7s. Estimated remaining: 1h 6m 59s. Rate: 7.1 symbols/min [2025-10-13T21:26:45.119977] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:45.159308] [DEBUG] [LOCAL ] SF: Loaded 42272 existing records from primary storage. [2025-10-13T21:26:45.159680] [INFO ] [MAIN ] SF: Loaded 42272 existing records. [2025-10-13T21:26:45.227573] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-13T21:26:45.337243] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:45.337425] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-13T21:26:45.337471] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-13T21:26:45.338531] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-13T21:26:45.338602] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-13T21:26:45.726125] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:45.925607] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T21:26:46.017964] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-13T21:26:46.099154] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T21:26:46.632546] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:26:46.637575] [INFO ] [REMOTE ] SEM: Full fetch complete (61555 records). [2025-10-13T21:26:46.637747] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-13T21:26:46.828427] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-13T21:26:47.023396] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-13T21:26:47.023491] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-13T21:26:47.024492] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-13T21:26:47.024559] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-13T21:26:47.026082] [DEBUG] [LOCAL ] SEM: Trimmed 61555 records to 43110 (keeping 200 days of data) [2025-10-13T21:26:47.292493] [DEBUG] [LOCAL ] SEM: Primary data saved (43110 records). [2025-10-13T21:26:47.292925] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-13T21:26:47.293028] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 33.6s. Estimated remaining: 1h 6m 49s. Rate: 7.1 symbols/min [2025-10-13T21:26:47.462417] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:47.469760] [DEBUG] [LOCAL ] SFB: Loaded 4239 existing records from primary storage. [2025-10-13T21:26:47.469931] [INFO ] [MAIN ] SFB: Loaded 4239 existing records. [2025-10-13T21:26:47.629614] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-13T21:26:47.649503] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:47.649887] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-13T21:26:47.649936] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-13T21:26:47.650537] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-13T21:26:47.650594] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-13T21:26:48.013056] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:48.307525] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T21:26:48.314976] [INFO ] [REMOTE ] SEMR: Full fetch complete (59766 records). [2025-10-13T21:26:48.315136] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-13T21:26:48.422680] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-13T21:26:48.687709] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-13T21:26:48.786093] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-13T21:26:48.786265] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-13T21:26:48.793129] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-13T21:26:48.791570] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-13T21:26:48.793264] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-13T21:26:48.798227] [DEBUG] [LOCAL ] SEMR: Trimmed 59766 records to 41958 (keeping 200 days of data) [2025-10-13T21:26:49.054172] [DEBUG] [LOCAL ] SEMR: Primary data saved (41958 records). [2025-10-13T21:26:49.054347] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-13T21:26:49.054443] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 30.1s. Estimated remaining: 1h 6m 39s. Rate: 7.1 symbols/min [2025-10-13T21:26:49.222153] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-13T21:26:49.235391] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:26:49.259481] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:26:49.289770] [DEBUG] [LOCAL ] SFBS: Loaded 21351 existing records from primary storage. [2025-10-13T21:26:49.290119] [INFO ] [MAIN ] SFBS: Loaded 21351 existing records. [2025-10-13T21:26:49.465850] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:26:49.466125] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-13T21:26:49.466176] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-13T21:26:49.467136] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-13T21:26:49.467195] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-13T21:26:49.826527] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:26:50.017980] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-13T21:26:50.817931] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-13T21:26:51.054878] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T21:26:51.617953] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-13T21:26:51.973904] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T21:26:52.056186] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-13T21:26:52.380335] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T21:26:52.417899] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-13T21:26:53.217966] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-13T21:26:54.017980] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-13T21:26:54.078825] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:26:54.817987] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-13T21:26:55.064928] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T21:26:55.617957] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-13T21:26:55.746519] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-13T21:26:55.916961] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-13T21:26:56.417903] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-13T21:26:56.532913] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T21:26:57.217976] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-13T21:26:57.977426] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T21:26:58.017902] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-13T21:26:58.303990] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T21:26:58.817921] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-13T21:26:59.428303] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T21:26:59.544815] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T21:26:59.617949] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-13T21:27:00.406232] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T21:27:00.417886] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-13T21:27:01.217991] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-13T21:27:01.948229] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T21:27:01.949029] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T21:27:02.017970] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-13T21:27:02.786461] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T21:27:02.817912] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-13T21:27:03.617984] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-13T21:27:04.417916] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-13T21:27:04.616512] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T21:27:04.982423] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T21:27:05.064212] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-13T21:27:05.217973] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-13T21:27:06.018029] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-13T21:27:06.372265] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T21:27:06.817999] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-13T21:27:07.263084] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T21:27:07.617991] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-13T21:27:07.651590] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T21:27:08.417964] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-13T21:27:09.218017] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-13T21:27:09.393364] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T21:27:09.698591] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T21:27:10.017981] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-13T21:27:10.543182] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T21:27:10.817929] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-13T21:27:11.617955] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-13T21:27:11.836498] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T21:27:12.418010] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-13T21:27:12.966200] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T21:27:12.967174] [INFO ] [REMOTE ] SFB: Full fetch complete (5823 records). [2025-10-13T21:27:12.967241] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-13T21:27:13.163786] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:27:13.231044] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-13T21:27:13.354521] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-13T21:27:13.354595] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-13T21:27:13.354794] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-13T21:27:13.354854] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-13T21:27:13.355229] [DEBUG] [LOCAL ] SFB: Trimmed 5823 records to 4134 (keeping 200 days of data) [2025-10-13T21:27:13.381132] [DEBUG] [LOCAL ] SFB: Primary data saved (4134 records). [2025-10-13T21:27:13.381231] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-13T21:27:13.381313] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 26.1s. Estimated remaining: 1h 6m 35s. Rate: 7.1 symbols/min [2025-10-13T21:27:13.544572] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:13.586599] [DEBUG] [LOCAL ] SFL: Loaded 45894 existing records from primary storage. [2025-10-13T21:27:13.586925] [INFO ] [MAIN ] SFL: Loaded 45894 existing records. [2025-10-13T21:27:13.766781] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:13.767167] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-13T21:27:13.767331] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-13T21:27:13.768510] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-13T21:27:13.768570] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-13T21:27:14.021002] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-13T21:27:14.133720] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:14.319806] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (5.90 seconds). [2025-10-13T21:27:14.348686] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T21:27:14.817991] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-13T21:27:15.617918] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-13T21:27:15.708888] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T21:27:16.248214] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:27:16.417982] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-13T21:27:17.217961] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-13T21:27:18.017953] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-13T21:27:18.052042] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-13T21:27:18.061014] [INFO ] [REMOTE ] SES: Full fetch complete (75624 records). [2025-10-13T21:27:18.061145] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-13T21:27:18.490340] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-13T21:27:18.491214] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-13T21:27:18.492884] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-13T21:27:18.494395] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T21:27:18.503424] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-13T21:27:18.506353] [DEBUG] [LOCAL ] SES: Trimmed 75624 records to 51577 (keeping 200 days of data) [2025-10-13T21:27:18.665172] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T21:27:18.826505] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-13T21:27:18.875346] [DEBUG] [LOCAL ] SES: Primary data saved (51577 records). [2025-10-13T21:27:18.875553] [INFO ] [MAIN ] SES: Full history saved. [2025-10-13T21:27:18.875681] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 49.2s. Estimated remaining: 1h 6m 26s. Rate: 7.1 symbols/min [2025-10-13T21:27:19.060768] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:19.082472] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T21:27:19.143596] [DEBUG] [LOCAL ] SG: Loaded 54245 existing records from primary storage. [2025-10-13T21:27:19.144083] [INFO ] [MAIN ] SG: Loaded 54245 existing records. [2025-10-13T21:27:19.332188] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:19.332547] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-13T21:27:19.332609] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-13T21:27:19.333832] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-13T21:27:19.333892] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-13T21:27:19.623187] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-13T21:27:19.706988] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:20.391934] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:27:20.417899] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-13T21:27:21.217919] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-13T21:27:21.272518] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:27:21.764473] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T21:27:21.769351] [INFO ] [REMOTE ] SF: Full fetch complete (60070 records). [2025-10-13T21:27:21.769529] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-13T21:27:22.024697] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-13T21:27:22.189927] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-13T21:27:22.190082] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-13T21:27:22.191432] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-13T21:27:22.191498] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-13T21:27:22.193481] [DEBUG] [LOCAL ] SF: Trimmed 60070 records to 41716 (keeping 200 days of data) [2025-10-13T21:27:22.481752] [DEBUG] [LOCAL ] SF: Primary data saved (41716 records). [2025-10-13T21:27:22.481955] [INFO ] [MAIN ] SF: Full history saved. [2025-10-13T21:27:22.482062] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SF took 37.5s. Estimated remaining: 1h 6m 16s. Rate: 7.1 symbols/min [2025-10-13T21:27:22.673062] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:22.720574] [DEBUG] [LOCAL ] SGHC: Loaded 47289 existing records from primary storage. [2025-10-13T21:27:22.721191] [INFO ] [MAIN ] SGHC: Loaded 47289 existing records. [2025-10-13T21:27:22.829316] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-13T21:27:22.971952] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:22.976023] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-13T21:27:22.977272] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:27:22.977368] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-13T21:27:22.989673] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-13T21:27:22.989738] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-13T21:27:23.365713] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:23.449171] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T21:27:23.617984] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-13T21:27:23.804705] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T21:27:23.808664] [INFO ] [REMOTE ] SFBS: Full fetch complete (30207 records). [2025-10-13T21:27:23.808838] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-13T21:27:24.179796] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-13T21:27:24.179882] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-13T21:27:24.180618] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-13T21:27:24.180683] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-13T21:27:24.181435] [DEBUG] [LOCAL ] SFBS: Trimmed 30207 records to 21145 (keeping 200 days of data) [2025-10-13T21:27:24.317359] [DEBUG] [LOCAL ] SFBS: Primary data saved (21145 records). [2025-10-13T21:27:24.317493] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-13T21:27:24.317584] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 35.3s. Estimated remaining: 1h 6m 6s. Rate: 7.1 symbols/min [2025-10-13T21:27:24.418817] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-13T21:27:24.490838] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:24.491010] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-13T21:27:24.491046] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-13T21:27:24.491152] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-13T21:27:24.491192] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-13T21:27:24.491231] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-13T21:27:24.491284] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-13T21:27:24.851495] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:25.217915] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-13T21:27:25.416344] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:27:25.416700] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-13T21:27:25.416792] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:27:25.416837] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-13T21:27:25.416871] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:27:25.416908] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-13T21:27:25.416966] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-13T21:27:25.417001] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-13T21:27:25.417042] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-13T21:27:25.417087] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SGI took 1.1s. Estimated remaining: 1h 5m 56s. Rate: 7.1 symbols/min [2025-10-13T21:27:25.610233] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:25.632892] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-13T21:27:25.650453] [DEBUG] [LOCAL ] SGU: Loaded 6661 existing records from primary storage. [2025-10-13T21:27:25.650720] [INFO ] [MAIN ] SGU: Loaded 6661 existing records. [2025-10-13T21:27:25.863984] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:25.864291] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-13T21:27:25.864406] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-13T21:27:25.864816] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-13T21:27:25.864878] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-13T21:27:26.047266] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-13T21:27:26.053949] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T21:27:26.264684] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:26.817988] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-13T21:27:27.617981] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-13T21:27:27.836173] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:27:28.168592] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T21:27:28.426392] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-13T21:27:28.432770] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T21:27:29.034566] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T21:27:29.218013] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-13T21:27:29.887598] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T21:27:30.017901] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-13T21:27:30.686428] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T21:27:30.817967] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-13T21:27:31.617982] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-13T21:27:32.331766] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T21:27:32.348102] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T21:27:32.417914] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-13T21:27:33.094180] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-13T21:27:33.217917] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-13T21:27:33.936784] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T21:27:34.018020] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-13T21:27:34.744516] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T21:27:34.817892] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-13T21:27:35.569787] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T21:27:35.617909] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-13T21:27:36.417920] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-13T21:27:37.109908] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T21:27:37.123711] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T21:27:37.217930] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-13T21:27:38.017986] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-13T21:27:38.489422] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T21:27:38.491071] [INFO ] [REMOTE ] SGU: Full fetch complete (9026 records). [2025-10-13T21:27:38.491145] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-13T21:27:38.819122] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-13T21:27:38.891077] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-13T21:27:38.891202] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-13T21:27:38.891585] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-13T21:27:38.891801] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-13T21:27:38.907007] [DEBUG] [LOCAL ] SGU: Trimmed 9026 records to 6595 (keeping 200 days of data) [2025-10-13T21:27:38.940791] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T21:27:38.977843] [DEBUG] [LOCAL ] SGU: Primary data saved (6595 records). [2025-10-13T21:27:38.978083] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-13T21:27:38.978200] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SGU took 13.6s. Estimated remaining: 1h 5m 48s. Rate: 7.1 symbols/min [2025-10-13T21:27:39.176566] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:39.234517] [DEBUG] [LOCAL ] SHAK: Loaded 49551 existing records from primary storage. [2025-10-13T21:27:39.235012] [INFO ] [MAIN ] SHAK: Loaded 49551 existing records. [2025-10-13T21:27:39.416433] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:39.416727] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-13T21:27:39.416785] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-13T21:27:39.417317] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-13T21:27:39.417374] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-13T21:27:39.623173] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-13T21:27:39.797781] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:40.417962] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-13T21:27:40.795107] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T21:27:41.160379] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T21:27:41.217971] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-13T21:27:42.018013] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-13T21:27:42.354166] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T21:27:42.817967] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-13T21:27:42.948746] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T21:27:43.623984] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-13T21:27:43.630044] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T21:27:44.372410] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:27:44.417928] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-13T21:27:45.206363] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:27:45.217880] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-13T21:27:45.938100] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T21:27:46.017969] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-13T21:27:46.817970] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-13T21:27:46.950491] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T21:27:47.509346] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T21:27:47.618004] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-13T21:27:48.423039] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-13T21:27:48.431830] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T21:27:48.948887] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T21:27:49.217978] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-13T21:27:49.861546] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T21:27:50.017960] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-13T21:27:50.818025] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-13T21:27:50.942992] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T21:27:51.617988] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-13T21:27:52.090192] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-13T21:27:52.417978] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-13T21:27:52.517175] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T21:27:52.765631] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T21:27:53.217990] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-13T21:27:53.990742] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T21:27:53.996441] [INFO ] [REMOTE ] SGHC: Full fetch complete (64532 records). [2025-10-13T21:27:53.996600] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-13T21:27:54.028056] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-13T21:27:54.392939] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-13T21:27:54.393043] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-13T21:27:54.394142] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-13T21:27:54.394211] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-13T21:27:54.395996] [DEBUG] [LOCAL ] SGHC: Trimmed 64532 records to 46842 (keeping 200 days of data) [2025-10-13T21:27:54.701678] [DEBUG] [LOCAL ] SGHC: Primary data saved (46842 records). [2025-10-13T21:27:54.702009] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-13T21:27:54.702151] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGHC took 32.2s. Estimated remaining: 1h 5m 42s. Rate: 7.1 symbols/min [2025-10-13T21:27:54.820670] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-13T21:27:54.892126] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:54.923383] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:27:54.954782] [DEBUG] [LOCAL ] SHCO: Loaded 25780 existing records from primary storage. [2025-10-13T21:27:54.955116] [INFO ] [MAIN ] SHCO: Loaded 25780 existing records. [2025-10-13T21:27:55.134066] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:55.134367] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-13T21:27:55.134419] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-13T21:27:55.135033] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-13T21:27:55.135095] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-13T21:27:55.512100] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:55.617920] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-13T21:27:55.944834] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:27:56.418059] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-13T21:27:56.773322] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T21:27:56.978412] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T21:27:57.217964] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-13T21:27:57.947289] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:27:57.952582] [INFO ] [REMOTE ] SFL: Full fetch complete (65677 records). [2025-10-13T21:27:57.952769] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-13T21:27:58.023100] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-13T21:27:58.350798] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-13T21:27:58.350904] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-13T21:27:58.352228] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-13T21:27:58.352294] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-13T21:27:58.353958] [DEBUG] [LOCAL ] SFL: Trimmed 65677 records to 45269 (keeping 200 days of data) [2025-10-13T21:27:58.643142] [DEBUG] [LOCAL ] SFL: Primary data saved (45269 records). [2025-10-13T21:27:58.643352] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-13T21:27:58.643468] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SFL took 45.3s. Estimated remaining: 1h 5m 32s. Rate: 7.1 symbols/min [2025-10-13T21:27:58.815431] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:27:58.818035] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-13T21:27:58.873248] [DEBUG] [LOCAL ] SHEL: Loaded 54452 existing records from primary storage. [2025-10-13T21:27:58.873637] [INFO ] [MAIN ] SHEL: Loaded 54452 existing records. [2025-10-13T21:27:59.071786] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:27:59.072044] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-13T21:27:59.072118] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-13T21:27:59.072747] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-13T21:27:59.072806] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-13T21:27:59.451741] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:27:59.483028] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T21:27:59.617894] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-13T21:27:59.789316] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:27:59.940993] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T21:28:00.417962] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-13T21:28:01.218034] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-13T21:28:01.580869] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T21:28:01.781239] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T21:28:02.018013] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-13T21:28:02.817971] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-13T21:28:03.618036] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-13T21:28:03.782473] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T21:28:03.788023] [INFO ] [REMOTE ] SG: Full fetch complete (77309 records). [2025-10-13T21:28:03.788144] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-13T21:28:04.196968] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T21:28:04.229440] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-13T21:28:04.229627] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-13T21:28:04.231036] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-13T21:28:04.231108] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-13T21:28:04.233273] [DEBUG] [LOCAL ] SG: Trimmed 77309 records to 53486 (keeping 200 days of data) [2025-10-13T21:28:04.424725] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-13T21:28:04.578952] [DEBUG] [LOCAL ] SG: Primary data saved (53486 records). [2025-10-13T21:28:04.579249] [INFO ] [MAIN ] SG: Full history saved. [2025-10-13T21:28:04.579357] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SG took 45.7s. Estimated remaining: 1h 5m 23s. Rate: 7.1 symbols/min [2025-10-13T21:28:04.769239] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:04.798997] [DEBUG] [LOCAL ] SHG: Loaded 26806 existing records from primary storage. [2025-10-13T21:28:04.799343] [INFO ] [MAIN ] SHG: Loaded 26806 existing records. [2025-10-13T21:28:04.993672] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:04.994298] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-13T21:28:04.994672] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-13T21:28:04.995122] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-13T21:28:04.995177] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-13T21:28:05.361278] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:05.361828] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-13T21:28:05.416631] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T21:28:05.699378] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T21:28:06.018057] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-13T21:28:06.641137] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (5.42 seconds). [2025-10-13T21:28:06.671509] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T21:28:06.817926] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-13T21:28:07.072229] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T21:28:07.617923] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-13T21:28:08.418022] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-13T21:28:08.658116] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T21:28:08.839197] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-13T21:28:09.217920] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-13T21:28:09.648074] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T21:28:10.017960] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-13T21:28:10.817973] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-13T21:28:10.890395] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T21:28:11.618044] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-13T21:28:11.791569] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T21:28:12.049435] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T21:28:12.418005] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-13T21:28:12.931194] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T21:28:13.217992] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-13T21:28:13.712851] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T21:28:14.018006] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-13T21:28:14.817995] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-13T21:28:15.070809] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T21:28:15.141780] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T21:28:15.617926] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-13T21:28:16.417973] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-13T21:28:16.725491] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T21:28:17.048936] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:28:17.217910] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-13T21:28:17.825144] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:28:18.017976] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-13T21:28:18.817898] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-13T21:28:18.967180] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T21:28:18.997530] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T21:28:19.001080] [INFO ] [REMOTE ] SHCO: Full fetch complete (37520 records). [2025-10-13T21:28:19.001189] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-13T21:28:19.381034] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-13T21:28:19.381115] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-13T21:28:19.381952] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-13T21:28:19.382015] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-13T21:28:19.382921] [DEBUG] [LOCAL ] SHCO: Trimmed 37520 records to 25352 (keeping 200 days of data) [2025-10-13T21:28:19.527485] [DEBUG] [LOCAL ] SHCO: Primary data saved (25352 records). [2025-10-13T21:28:19.527638] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-13T21:28:19.527766] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 24.8s. Estimated remaining: 1h 5m 16s. Rate: 7.1 symbols/min [2025-10-13T21:28:19.625253] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-13T21:28:19.701884] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:19.745937] [DEBUG] [LOCAL ] SHO: Loaded 50269 existing records from primary storage. [2025-10-13T21:28:19.746256] [INFO ] [MAIN ] SHO: Loaded 50269 existing records. [2025-10-13T21:28:19.920755] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:19.920965] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-13T21:28:19.921050] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-13T21:28:19.922213] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-13T21:28:19.922272] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-13T21:28:20.274577] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:20.417964] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-13T21:28:20.980607] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T21:28:21.088385] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T21:28:21.217999] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-13T21:28:22.015240] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T21:28:22.024880] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-13T21:28:22.817980] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-13T21:28:23.179552] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T21:28:23.387532] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T21:28:23.617961] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-13T21:28:24.109383] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:28:24.417989] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-13T21:28:25.218049] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-13T21:28:25.574855] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-13T21:28:25.739841] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T21:28:26.018000] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-13T21:28:26.642301] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:28:26.647896] [INFO ] [REMOTE ] SHAK: Full fetch complete (70799 records). [2025-10-13T21:28:26.648119] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-13T21:28:26.824481] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-13T21:28:27.047032] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-13T21:28:27.047118] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-13T21:28:27.048528] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-13T21:28:27.048594] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-13T21:28:27.050196] [DEBUG] [LOCAL ] SHAK: Trimmed 70799 records to 48873 (keeping 200 days of data) [2025-10-13T21:28:27.400880] [DEBUG] [LOCAL ] SHAK: Primary data saved (48873 records). [2025-10-13T21:28:27.401098] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-13T21:28:27.401201] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHAK took 48.4s. Estimated remaining: 1h 5m 8s. Rate: 7.1 symbols/min [2025-10-13T21:28:27.585468] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:27.591446] [DEBUG] [LOCAL ] SHOC: Loaded 3425 existing records from primary storage. [2025-10-13T21:28:27.591694] [INFO ] [MAIN ] SHOC: Loaded 3425 existing records. [2025-10-13T21:28:27.618042] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-13T21:28:27.787602] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:27.788169] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-13T21:28:27.788282] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-13T21:28:27.788879] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-13T21:28:27.788953] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-13T21:28:27.923707] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T21:28:28.208914] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:28.417981] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-13T21:28:28.876300] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T21:28:28.914140] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T21:28:29.217989] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-13T21:28:30.017949] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-13T21:28:30.344181] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T21:28:30.397100] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T21:28:30.817923] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-13T21:28:30.959603] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T21:28:31.617968] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-13T21:28:32.350135] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T21:28:32.417912] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-13T21:28:32.569318] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:28:33.218012] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-13T21:28:34.018006] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-13T21:28:34.060665] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:28:34.534796] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T21:28:34.817896] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-13T21:28:34.956345] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T21:28:35.617917] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-13T21:28:35.630691] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T21:28:36.417957] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-13T21:28:37.217987] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-13T21:28:37.343612] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T21:28:37.503020] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T21:28:37.508988] [INFO ] [REMOTE ] SHEL: Full fetch complete (77695 records). [2025-10-13T21:28:37.509157] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-13T21:28:37.863463] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T21:28:37.915731] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-13T21:28:37.915848] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-13T21:28:37.917097] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-13T21:28:37.917168] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-13T21:28:37.918952] [DEBUG] [LOCAL ] SHEL: Trimmed 77695 records to 53673 (keeping 200 days of data) [2025-10-13T21:28:38.018416] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-13T21:28:38.253840] [DEBUG] [LOCAL ] SHEL: Primary data saved (53673 records). [2025-10-13T21:28:38.253989] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-13T21:28:38.254071] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHEL took 39.6s. Estimated remaining: 1h 4m 60s. Rate: 7.1 symbols/min [2025-10-13T21:28:38.420384] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:38.467083] [DEBUG] [LOCAL ] SHW: Loaded 51079 existing records from primary storage. [2025-10-13T21:28:38.467397] [INFO ] [MAIN ] SHW: Loaded 51079 existing records. [2025-10-13T21:28:38.640431] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:38.640663] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-13T21:28:38.640723] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-13T21:28:38.641826] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-13T21:28:38.641882] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-13T21:28:38.825472] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-13T21:28:39.016464] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:39.571272] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:28:39.617907] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-13T21:28:39.704524] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T21:28:39.979002] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T21:28:40.417962] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-13T21:28:41.217951] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-13T21:28:41.699265] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T21:28:42.002214] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T21:28:42.017904] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-13T21:28:42.817905] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-13T21:28:43.390728] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T21:28:43.617959] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-13T21:28:43.781424] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T21:28:44.417959] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-13T21:28:45.218007] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-13T21:28:46.010034] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T21:28:46.026051] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-13T21:28:46.047867] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T21:28:46.415629] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-13T21:28:46.541128] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T21:28:46.817912] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-13T21:28:47.618001] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-13T21:28:48.399838] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T21:28:48.417884] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-13T21:28:48.602278] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T21:28:48.606185] [INFO ] [REMOTE ] SHG: Full fetch complete (40932 records). [2025-10-13T21:28:48.606363] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-13T21:28:49.016855] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-13T21:28:49.016968] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-13T21:28:49.018082] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-13T21:28:49.018150] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-13T21:28:49.019795] [DEBUG] [LOCAL ] SHG: Trimmed 40932 records to 26434 (keeping 200 days of data) [2025-10-13T21:28:49.199379] [DEBUG] [LOCAL ] SHG: Primary data saved (26434 records). [2025-10-13T21:28:49.199573] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-13T21:28:49.199770] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHG took 44.6s. Estimated remaining: 1h 4m 52s. Rate: 7.1 symbols/min [2025-10-13T21:28:49.223224] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-13T21:28:49.383622] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:49.383889] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-13T21:28:49.383932] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-13T21:28:49.384058] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-13T21:28:49.384101] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-13T21:28:49.384142] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-13T21:28:49.384189] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-13T21:28:49.748104] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:50.017905] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-13T21:28:50.219573] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:28:50.718917] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:28:50.720171] [INFO ] [REMOTE ] SHOC: Full fetch complete (7038 records). [2025-10-13T21:28:50.720349] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-13T21:28:50.780382] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T21:28:50.821721] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-13T21:28:50.851868] [INFO ] [REMOTE ] SHO: Full fetch complete (70883 records). [2025-10-13T21:28:50.852560] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-13T21:28:51.433494] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-13T21:28:51.436011] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-13T21:28:51.436344] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-13T21:28:51.436427] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-13T21:28:51.448070] [DEBUG] [LOCAL ] SHOC: Trimmed 7038 records to 3343 (keeping 200 days of data) [2025-10-13T21:28:51.519129] [DEBUG] [LOCAL ] SHOC: Primary data saved (3343 records). [2025-10-13T21:28:51.534754] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-13T21:28:51.537059] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHOC took 24.1s. Estimated remaining: 1h 4m 42s. Rate: 7.1 symbols/min [2025-10-13T21:28:51.620793] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-13T21:28:51.621164] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-13T21:28:51.650595] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-13T21:28:51.662712] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-13T21:28:51.663125] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-13T21:28:51.737464] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:51.738381] [DEBUG] [LOCAL ] SHO: Trimmed 70883 records to 49497 (keeping 200 days of data) [2025-10-13T21:28:51.862241] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:28:51.866366] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-13T21:28:51.869150] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:28:51.871943] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-13T21:28:51.879556] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:28:51.879766] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-13T21:28:51.880072] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-13T21:28:51.893900] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-13T21:28:51.894116] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-13T21:28:51.898346] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SI took 2.7s. Estimated remaining: 1h 4m 32s. Rate: 7.1 symbols/min [2025-10-13T21:28:51.899914] [DEBUG] [LOCAL ] SID: Loaded 43228 existing records from primary storage. [2025-10-13T21:28:52.062853] [INFO ] [MAIN ] SID: Loaded 43228 existing records. [2025-10-13T21:28:52.391878] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:52.472705] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:52.478810] [DEBUG] [LOCAL ] SHO: Primary data saved (49497 records). [2025-10-13T21:28:52.479204] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-13T21:28:52.479278] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-13T21:28:52.479717] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-13T21:28:52.479919] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 33.0s. Estimated remaining: 1h 4m 22s. Rate: 7.1 symbols/min [2025-10-13T21:28:52.491391] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-13T21:28:52.501319] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-13T21:28:52.797970] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:28:52.879007] [DEBUG] [LOCAL ] SIG: Loaded 46469 existing records from primary storage. [2025-10-13T21:28:52.910293] [INFO ] [MAIN ] SIG: Loaded 46469 existing records. [2025-10-13T21:28:53.140121] [DEBUG] [LOCAL ] SII: Loaded 24196 existing records from primary storage. [2025-10-13T21:28:53.192374] [INFO ] [MAIN ] SII: Loaded 24196 existing records. [2025-10-13T21:28:53.237973] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:53.271138] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-13T21:28:53.336248] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:53.332469] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-13T21:28:53.348605] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-13T21:28:53.358289] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-13T21:28:53.372366] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-13T21:28:53.410725] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-13T21:28:53.600821] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-13T21:28:53.600451] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:28:53.605690] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-13T21:28:53.605797] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-13T21:28:53.606130] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-13T21:28:53.622114] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-13T21:28:54.169635] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:54.180247] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-13T21:28:54.242717] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:28:54.817977] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-13T21:28:54.966234] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:28:55.374968] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T21:28:55.587446] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T21:28:55.620555] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-13T21:28:55.625832] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T21:28:56.417919] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-13T21:28:57.217991] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-13T21:28:57.375908] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T21:28:58.017957] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-13T21:28:58.114983] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T21:28:58.817915] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-13T21:28:58.936775] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T21:28:59.623174] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-13T21:28:59.634020] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:29:00.417990] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-13T21:29:00.476675] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T21:29:01.218002] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-13T21:29:01.617271] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T21:29:01.912060] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-13T21:29:02.017969] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-13T21:29:02.817987] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-13T21:29:02.925679] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T21:29:03.203297] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T21:29:03.617924] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-13T21:29:04.419007] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-13T21:29:04.423862] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T21:29:05.217927] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-13T21:29:05.328286] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T21:29:05.362637] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:29:06.018027] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-13T21:29:06.818000] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-13T21:29:07.346351] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T21:29:07.618043] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-13T21:29:07.950507] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:29:08.314804] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T21:29:08.417926] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-13T21:29:09.217904] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-13T21:29:10.017910] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-13T21:29:10.073461] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:29:10.122684] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T21:29:10.818311] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-13T21:29:11.576425] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T21:29:11.581805] [INFO ] [REMOTE ] SHW: Full fetch complete (73046 records). [2025-10-13T21:29:11.581923] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-13T21:29:11.624203] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-13T21:29:11.796636] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (4.18 seconds). [2025-10-13T21:29:12.022684] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-13T21:29:12.022984] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-13T21:29:12.024132] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-13T21:29:12.024207] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-13T21:29:12.026337] [DEBUG] [LOCAL ] SHW: Trimmed 73046 records to 50346 (keeping 200 days of data) [2025-10-13T21:29:12.166269] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T21:29:12.368992] [DEBUG] [LOCAL ] SHW: Primary data saved (50346 records). [2025-10-13T21:29:12.369142] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-13T21:29:12.369229] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHW took 34.1s. Estimated remaining: 1h 4m 16s. Rate: 7.1 symbols/min [2025-10-13T21:29:12.430589] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-13T21:29:12.537577] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:12.569134] [DEBUG] [LOCAL ] SILA: Loaded 31008 existing records from primary storage. [2025-10-13T21:29:12.569402] [INFO ] [MAIN ] SILA: Loaded 31008 existing records. [2025-10-13T21:29:12.743220] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:12.743511] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-13T21:29:12.743555] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-13T21:29:12.743905] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-13T21:29:12.743961] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-13T21:29:13.119556] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:13.218043] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-13T21:29:13.296130] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T21:29:13.558385] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T21:29:14.017984] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-13T21:29:14.795560] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T21:29:14.817894] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-13T21:29:15.436987] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T21:29:15.617976] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-13T21:29:16.324213] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T21:29:16.418042] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-13T21:29:17.207975] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:29:17.218014] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-13T21:29:18.018007] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-13T21:29:18.424373] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T21:29:18.817957] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-13T21:29:19.200397] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-13T21:29:19.516188] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T21:29:19.617921] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-13T21:29:20.093953] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T21:29:20.418003] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-13T21:29:21.217956] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-13T21:29:21.276366] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:29:22.024035] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-13T21:29:22.027349] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T21:29:22.542911] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T21:29:22.817954] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-13T21:29:23.547104] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T21:29:23.617889] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-13T21:29:24.158975] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T21:29:24.417958] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-13T21:29:25.013873] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:29:25.018549] [INFO ] [REMOTE ] SIG: Full fetch complete (67794 records). [2025-10-13T21:29:25.018677] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-13T21:29:25.222388] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-13T21:29:25.434570] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T21:29:25.437859] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-13T21:29:25.442449] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-13T21:29:25.443801] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-13T21:29:25.443991] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-13T21:29:25.445331] [DEBUG] [LOCAL ] SIG: Trimmed 67794 records to 45713 (keeping 200 days of data) [2025-10-13T21:29:25.727310] [DEBUG] [LOCAL ] SIG: Primary data saved (45713 records). [2025-10-13T21:29:25.727469] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-13T21:29:25.727557] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SIG took 33.8s. Estimated remaining: 1h 4m 9s. Rate: 7.1 symbols/min [2025-10-13T21:29:25.895236] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:25.936787] [DEBUG] [LOCAL ] SITC: Loaded 42127 existing records from primary storage. [2025-10-13T21:29:25.937102] [INFO ] [MAIN ] SITC: Loaded 42127 existing records. [2025-10-13T21:29:26.023213] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-13T21:29:26.120234] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:26.120702] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-13T21:29:26.120762] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-13T21:29:26.121572] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-13T21:29:26.121628] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-13T21:29:26.501267] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:26.747776] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T21:29:26.817894] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-13T21:29:27.281271] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T21:29:27.617959] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-13T21:29:28.178807] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T21:29:28.417982] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-13T21:29:28.510841] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T21:29:29.217991] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-13T21:29:29.776391] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T21:29:30.017945] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-13T21:29:30.550115] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T21:29:30.817959] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-13T21:29:31.046032] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T21:29:31.049601] [INFO ] [REMOTE ] SII: Full fetch complete (30802 records). [2025-10-13T21:29:31.049944] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-13T21:29:31.436408] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-13T21:29:31.436539] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-13T21:29:31.437479] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-13T21:29:31.437573] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-13T21:29:31.438677] [DEBUG] [LOCAL ] SII: Trimmed 30802 records to 23960 (keeping 200 days of data) [2025-10-13T21:29:31.596328] [DEBUG] [LOCAL ] SII: Primary data saved (23960 records). [2025-10-13T21:29:31.596491] [INFO ] [MAIN ] SII: Full history saved. [2025-10-13T21:29:31.596588] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 39.1s. Estimated remaining: 1h 3m 60s. Rate: 7.1 symbols/min [2025-10-13T21:29:31.630552] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-13T21:29:31.781335] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:31.818883] [DEBUG] [LOCAL ] SITE: Loaded 35824 existing records from primary storage. [2025-10-13T21:29:31.819223] [INFO ] [MAIN ] SITE: Loaded 35824 existing records. [2025-10-13T21:29:32.016353] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:32.016664] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-13T21:29:32.016730] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-13T21:29:32.017265] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-13T21:29:32.017324] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-13T21:29:32.388190] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:32.417915] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-13T21:29:32.456560] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T21:29:32.982315] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T21:29:33.217978] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-13T21:29:34.017917] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-13T21:29:34.050627] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T21:29:34.056171] [INFO ] [REMOTE ] SID: Full fetch complete (60823 records). [2025-10-13T21:29:34.056339] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-13T21:29:34.464415] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-13T21:29:34.464525] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-13T21:29:34.465730] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-13T21:29:34.465813] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-13T21:29:34.467257] [DEBUG] [LOCAL ] SID: Trimmed 60823 records to 42599 (keeping 200 days of data) [2025-10-13T21:29:34.566926] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T21:29:34.733193] [DEBUG] [LOCAL ] SID: Primary data saved (42599 records). [2025-10-13T21:29:34.733334] [INFO ] [MAIN ] SID: Full history saved. [2025-10-13T21:29:34.733417] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SID took 43.2s. Estimated remaining: 1h 3m 50s. Rate: 7.1 symbols/min [2025-10-13T21:29:34.817919] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-13T21:29:35.191484] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T21:29:35.618048] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-13T21:29:36.138751] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T21:29:36.418017] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-13T21:29:36.706213] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T21:29:36.709359] [INFO ] [REMOTE ] SILA: Full fetch complete (44498 records). [2025-10-13T21:29:36.709446] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-13T21:29:37.085092] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-13T21:29:37.085212] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-13T21:29:37.086385] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-13T21:29:37.086454] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-13T21:29:37.087879] [DEBUG] [LOCAL ] SILA: Trimmed 44498 records to 30545 (keeping 200 days of data) [2025-10-13T21:29:37.218771] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-13T21:29:37.289258] [DEBUG] [LOCAL ] SILA: Primary data saved (30545 records). [2025-10-13T21:29:37.289477] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-13T21:29:37.289587] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 24.9s. Estimated remaining: 1h 3m 40s. Rate: 7.1 symbols/min [2025-10-13T21:29:37.838891] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T21:29:38.017978] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-13T21:29:38.714545] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T21:29:38.817901] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-13T21:29:39.552520] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:29:39.617905] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-13T21:29:40.400906] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T21:29:40.417893] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-13T21:29:41.190774] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T21:29:41.217901] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-13T21:29:41.588632] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T21:29:42.018008] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-13T21:29:42.850212] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T21:29:42.857492] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-13T21:29:43.496840] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T21:29:43.617917] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-13T21:29:43.746350] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T21:29:44.417984] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-13T21:29:45.224983] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T21:29:45.234193] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-13T21:29:45.396478] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T21:29:46.018005] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-13T21:29:46.768828] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T21:29:46.817884] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-13T21:29:47.009462] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T21:29:47.618013] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-13T21:29:48.306462] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:29:48.417962] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-13T21:29:48.801427] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T21:29:49.217927] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-13T21:29:50.070877] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T21:29:50.080875] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-13T21:29:50.451847] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T21:29:50.456101] [INFO ] [REMOTE ] SITE: Full fetch complete (50108 records). [2025-10-13T21:29:50.456198] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-13T21:29:50.836270] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-13T21:29:50.836346] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-13T21:29:50.837239] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-13T21:29:50.837300] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-13T21:29:50.838395] [DEBUG] [LOCAL ] SITE: Trimmed 50108 records to 35421 (keeping 200 days of data) [2025-10-13T21:29:51.055871] [DEBUG] [LOCAL ] SITE: Primary data saved (35421 records). [2025-10-13T21:29:51.056011] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-13T21:29:51.056103] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITE took 19.5s. Estimated remaining: 1h 3m 33s. Rate: 7.1 symbols/min [2025-10-13T21:29:51.413353] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T21:29:51.418015] [INFO ] [REMOTE ] SITC: Full fetch complete (60501 records). [2025-10-13T21:29:51.418147] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-13T21:29:51.808606] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-13T21:29:51.808727] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-13T21:29:51.809813] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-13T21:29:51.809880] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-13T21:29:51.811210] [DEBUG] [LOCAL ] SITC: Trimmed 60501 records to 41665 (keeping 200 days of data) [2025-10-13T21:29:52.064074] [DEBUG] [LOCAL ] SITC: Primary data saved (41665 records). [2025-10-13T21:29:52.064205] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-13T21:29:52.064283] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 26.3s. Estimated remaining: 1h 3m 23s. Rate: 7.1 symbols/min [2025-10-13T21:29:52.665070] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:52.727755] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:52.777442] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:52.802473] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:29:52.813553] [DEBUG] [LOCAL ] SKIL: Loaded 6671 existing records from primary storage. [2025-10-13T21:29:52.814083] [INFO ] [MAIN ] SKIL: Loaded 6671 existing records. [2025-10-13T21:29:52.984919] [DEBUG] [LOCAL ] SJT: Loaded 22810 existing records from primary storage. [2025-10-13T21:29:53.045420] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:53.056872] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-13T21:29:53.056253] [INFO ] [MAIN ] SJT: Loaded 22810 existing records. [2025-10-13T21:29:53.062519] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-13T21:29:53.107749] [DEBUG] [LOCAL ] SKE: Loaded 37016 existing records from primary storage. [2025-10-13T21:29:53.136428] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-13T21:29:53.141959] [INFO ] [MAIN ] SKE: Loaded 37016 existing records. [2025-10-13T21:29:53.153176] [DEBUG] [LOCAL ] SJM: Loaded 50766 existing records from primary storage. [2025-10-13T21:29:53.164448] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-13T21:29:53.191061] [INFO ] [MAIN ] SJM: Loaded 50766 existing records. [2025-10-13T21:29:53.733804] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:53.781979] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:53.770022] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:29:53.798796] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-13T21:29:53.814397] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-13T21:29:53.818303] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-13T21:29:53.838382] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-13T21:29:53.838509] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-13T21:29:53.841859] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-13T21:29:53.849682] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-13T21:29:53.900208] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-13T21:29:53.881455] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-13T21:29:53.900364] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-13T21:29:53.881345] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-13T21:29:53.900455] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-13T21:29:54.504504] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:54.520155] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-13T21:29:55.141060] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:55.175365] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:55.202711] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-13T21:29:55.203836] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-13T21:29:55.202350] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:29:55.205260] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-13T21:29:55.404372] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T21:29:55.406579] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-13T21:29:56.256096] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T21:29:56.259042] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-13T21:29:56.425320] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T21:29:56.431353] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-13T21:29:56.568377] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T21:29:56.575912] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-13T21:29:56.709310] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T21:29:57.032440] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:29:57.217956] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-13T21:29:57.500569] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T21:29:57.959571] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T21:29:58.017965] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-13T21:29:58.817901] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-13T21:29:59.226438] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-13T21:29:59.617901] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-13T21:29:59.985225] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T21:30:00.327458] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T21:30:00.417969] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-13T21:30:01.217973] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-13T21:30:01.512870] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T21:30:01.685507] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T21:30:01.949564] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T21:30:02.017972] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-13T21:30:02.704621] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T21:30:02.818053] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-13T21:30:03.618030] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-13T21:30:04.063498] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T21:30:04.112586] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T21:30:04.418019] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-13T21:30:05.217959] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-13T21:30:06.017946] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-13T21:30:06.399367] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T21:30:06.671628] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T21:30:06.820146] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-13T21:30:06.824143] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T21:30:07.617972] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-13T21:30:08.315316] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T21:30:08.422138] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-13T21:30:08.425316] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T21:30:09.217978] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-13T21:30:10.017971] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-13T21:30:10.134566] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T21:30:10.229058] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T21:30:10.452951] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T21:30:10.817914] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-13T21:30:11.617961] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-13T21:30:12.256605] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T21:30:12.417993] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-13T21:30:12.642166] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T21:30:13.217982] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-13T21:30:14.017970] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-13T21:30:14.572990] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T21:30:14.818018] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-13T21:30:15.336151] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:30:15.617949] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-13T21:30:15.873842] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T21:30:16.417920] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-13T21:30:16.656081] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T21:30:17.010523] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T21:30:17.217918] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-13T21:30:18.017983] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-13T21:30:18.652979] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T21:30:18.817952] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-13T21:30:19.119451] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T21:30:19.122247] [INFO ] [REMOTE ] SJT: Full fetch complete (31850 records). [2025-10-13T21:30:19.122345] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-13T21:30:19.496019] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-13T21:30:19.496104] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-13T21:30:19.496848] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-13T21:30:19.496908] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-13T21:30:19.497850] [DEBUG] [LOCAL ] SJT: Trimmed 31850 records to 22350 (keeping 200 days of data) [2025-10-13T21:30:19.619116] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-13T21:30:19.627030] [DEBUG] [LOCAL ] SJT: Primary data saved (22350 records). [2025-10-13T21:30:19.627241] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-13T21:30:19.627337] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 27.6s. Estimated remaining: 1h 3m 19s. Rate: 7.1 symbols/min [2025-10-13T21:30:19.797171] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:19.808966] [DEBUG] [LOCAL ] SKLZ: Loaded 11724 existing records from primary storage. [2025-10-13T21:30:19.809190] [INFO ] [MAIN ] SKLZ: Loaded 11724 existing records. [2025-10-13T21:30:19.989440] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:30:19.989675] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-13T21:30:19.989735] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-13T21:30:19.989945] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-13T21:30:19.990004] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-13T21:30:20.360134] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T21:30:20.402487] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:20.417877] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-13T21:30:20.700350] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T21:30:20.767514] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (8.35 seconds). [2025-10-13T21:30:21.218026] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-13T21:30:21.892992] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T21:30:21.894901] [INFO ] [REMOTE ] SKIL: Full fetch complete (10210 records). [2025-10-13T21:30:21.895096] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-13T21:30:22.023735] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-13T21:30:22.013349] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T21:30:22.119479] [INFO ] [REMOTE ] SKE: Full fetch complete (51430 records). [2025-10-13T21:30:22.137752] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-13T21:30:22.533371] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-13T21:30:22.576623] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-13T21:30:22.599606] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-13T21:30:22.602194] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-13T21:30:22.629022] [DEBUG] [LOCAL ] SKIL: Trimmed 10210 records to 6538 (keeping 200 days of data) [2025-10-13T21:30:22.721916] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-13T21:30:22.722238] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-13T21:30:22.723723] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-13T21:30:22.724036] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-13T21:30:22.731291] [DEBUG] [LOCAL ] SKE: Trimmed 51430 records to 36639 (keeping 200 days of data) [2025-10-13T21:30:22.735603] [DEBUG] [LOCAL ] SKIL: Primary data saved (6538 records). [2025-10-13T21:30:22.735719] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-13T21:30:22.735809] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKIL took 30.7s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-13T21:30:22.823243] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-13T21:30:23.022991] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:23.147455] [DEBUG] [LOCAL ] SKE: Primary data saved (36639 records). [2025-10-13T21:30:23.147622] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-13T21:30:23.147786] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKE took 31.1s. Estimated remaining: 1h 2m 59s. Rate: 7.1 symbols/min [2025-10-13T21:30:23.148372] [DEBUG] [LOCAL ] SKM: Loaded 35508 existing records from primary storage. [2025-10-13T21:30:23.179796] [INFO ] [MAIN ] SKM: Loaded 35508 existing records. [2025-10-13T21:30:23.460029] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:23.474861] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T21:30:23.519323] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:30:23.520052] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-13T21:30:23.520099] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-13T21:30:23.520686] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-13T21:30:23.520745] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-13T21:30:23.620179] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-13T21:30:23.830593] [DEBUG] [LOCAL ] SKT: Loaded 43020 existing records from primary storage. [2025-10-13T21:30:23.831135] [INFO ] [MAIN ] SKT: Loaded 43020 existing records. [2025-10-13T21:30:24.047473] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:24.084914] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:30:24.085082] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-13T21:30:24.085126] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-13T21:30:24.085521] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-13T21:30:24.085559] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-13T21:30:24.428105] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-13T21:30:24.434242] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:24.818107] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T21:30:24.817730] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T21:30:25.217894] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-13T21:30:25.758509] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T21:30:26.018015] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-13T21:30:26.817962] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-13T21:30:26.882960] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T21:30:27.617922] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-13T21:30:28.417995] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-13T21:30:28.475366] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:30:28.510554] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-13T21:30:28.895374] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T21:30:29.217997] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-13T21:30:30.017895] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-13T21:30:30.214569] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T21:30:30.435999] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T21:30:30.817992] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-13T21:30:30.857761] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T21:30:31.617904] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-13T21:30:32.106816] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:30:32.418028] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-13T21:30:32.461750] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T21:30:33.217955] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-13T21:30:34.016176] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T21:30:34.025584] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-13T21:30:34.141545] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T21:30:34.770557] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T21:30:34.817914] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-13T21:30:35.618002] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-13T21:30:36.418008] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-13T21:30:37.217925] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-13T21:30:38.042895] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T21:30:38.046241] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-13T21:30:38.075304] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T21:30:38.817989] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-13T21:30:38.842136] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T21:30:39.617923] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-13T21:30:40.304025] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T21:30:40.417986] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-13T21:30:41.270750] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:30:41.275585] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-13T21:30:41.757074] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (6.94 seconds). [2025-10-13T21:30:41.764383] [INFO ] [REMOTE ] SJM: Full fetch complete (72007 records). [2025-10-13T21:30:41.764557] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-13T21:30:42.057448] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T21:30:42.107416] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-13T21:30:42.205977] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-13T21:30:42.206067] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-13T21:30:42.207336] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-13T21:30:42.207407] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-13T21:30:42.209081] [DEBUG] [LOCAL ] SJM: Trimmed 72007 records to 50108 (keeping 200 days of data) [2025-10-13T21:30:42.467164] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (6.85 seconds). [2025-10-13T21:30:42.570790] [DEBUG] [LOCAL ] SJM: Primary data saved (50108 records). [2025-10-13T21:30:42.570936] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-13T21:30:42.571020] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 50.5s. Estimated remaining: 1h 2m 53s. Rate: 7.1 symbols/min [2025-10-13T21:30:42.742895] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:42.780373] [DEBUG] [LOCAL ] SKY: Loaded 38636 existing records from primary storage. [2025-10-13T21:30:42.780718] [INFO ] [MAIN ] SKY: Loaded 38636 existing records. [2025-10-13T21:30:42.823735] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-13T21:30:42.962369] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:30:42.962582] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-13T21:30:42.962630] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-13T21:30:42.963114] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-13T21:30:42.963190] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-13T21:30:43.325660] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:43.591571] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T21:30:43.617916] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-13T21:30:44.417953] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-13T21:30:44.525928] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-10-13T21:30:44.725478] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T21:30:44.917553] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T21:30:45.217973] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-13T21:30:45.692000] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T21:30:46.017917] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-13T21:30:46.175628] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T21:30:46.817914] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-13T21:30:47.621515] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-13T21:30:47.631791] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T21:30:47.634066] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T21:30:47.646585] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18398 records). [2025-10-13T21:30:47.647170] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-13T21:30:48.035690] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-13T21:30:48.035784] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-13T21:30:48.036339] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-13T21:30:48.036379] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-13T21:30:48.036956] [DEBUG] [LOCAL ] SKLZ: Trimmed 18398 records to 11564 (keeping 200 days of data) [2025-10-13T21:30:48.103381] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11564 records). [2025-10-13T21:30:48.103532] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-13T21:30:48.103616] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKLZ took 28.5s. Estimated remaining: 1h 2m 44s. Rate: 7.1 symbols/min [2025-10-13T21:30:48.269966] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:48.287468] [DEBUG] [LOCAL ] SKYH: Loaded 16809 existing records from primary storage. [2025-10-13T21:30:48.287721] [INFO ] [MAIN ] SKYH: Loaded 16809 existing records. [2025-10-13T21:30:48.423109] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-13T21:30:48.462594] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:30:48.462970] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-13T21:30:48.463018] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-13T21:30:48.463299] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-13T21:30:48.463354] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-13T21:30:48.818008] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:49.060550] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T21:30:49.217924] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-13T21:30:49.937346] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T21:30:50.017898] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-13T21:30:50.568132] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T21:30:50.817914] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-13T21:30:51.181526] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T21:30:51.185215] [INFO ] [REMOTE ] SKM: Full fetch complete (48547 records). [2025-10-13T21:30:51.185303] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-13T21:30:51.558562] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-13T21:30:51.558637] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-13T21:30:51.559525] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-13T21:30:51.559567] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-13T21:30:51.560665] [DEBUG] [LOCAL ] SKM: Trimmed 48547 records to 35143 (keeping 200 days of data) [2025-10-13T21:30:51.626015] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-13T21:30:51.781347] [DEBUG] [LOCAL ] SKM: Primary data saved (35143 records). [2025-10-13T21:30:51.781494] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-13T21:30:51.781708] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKM took 29.0s. Estimated remaining: 1h 2m 34s. Rate: 7.1 symbols/min [2025-10-13T21:30:51.951227] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:30:51.951488] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-13T21:30:51.951548] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-13T21:30:51.951726] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-13T21:30:51.951792] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-13T21:30:51.951884] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-13T21:30:51.951948] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-13T21:30:52.305286] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:30:52.350214] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T21:30:52.417881] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-13T21:30:53.217991] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-13T21:30:53.987411] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T21:30:54.017915] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-13T21:30:54.818017] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-13T21:30:55.335262] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T21:30:55.573961] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T21:30:55.617979] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-13T21:30:55.855471] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T21:30:55.897514] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (4.27 seconds). [2025-10-13T21:30:56.417967] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-13T21:30:57.217971] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-13T21:30:57.696675] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T21:30:58.018021] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-13T21:30:58.464364] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T21:30:58.822478] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-13T21:30:58.825588] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T21:30:59.617962] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-13T21:31:00.163013] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T21:31:00.168962] [INFO ] [REMOTE ] SKT: Full fetch complete (60287 records). [2025-10-13T21:31:00.169122] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-13T21:31:00.269387] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T21:31:00.423183] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-13T21:31:00.576682] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-13T21:31:00.576772] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-13T21:31:00.577826] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-13T21:31:00.577887] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-13T21:31:00.579250] [DEBUG] [LOCAL ] SKT: Trimmed 60287 records to 42491 (keeping 200 days of data) [2025-10-13T21:31:00.838748] [DEBUG] [LOCAL ] SKT: Primary data saved (42491 records). [2025-10-13T21:31:00.838880] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-13T21:31:00.838959] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKT took 37.7s. Estimated remaining: 1h 2m 26s. Rate: 7.1 symbols/min [2025-10-13T21:31:00.980209] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (4.56 seconds). [2025-10-13T21:31:01.047663] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:01.082635] [DEBUG] [LOCAL ] SLF: Loaded 39332 existing records from primary storage. [2025-10-13T21:31:01.082947] [INFO ] [MAIN ] SLF: Loaded 39332 existing records. [2025-10-13T21:31:01.223237] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-13T21:31:01.263231] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:31:01.264974] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-13T21:31:01.265031] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-13T21:31:01.266103] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-13T21:31:01.266166] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-13T21:31:01.656663] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:01.672720] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T21:31:02.017975] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-13T21:31:02.492292] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T21:31:02.735116] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T21:31:02.817953] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-13T21:31:03.617965] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-13T21:31:04.228825] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T21:31:04.417885] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-13T21:31:05.173900] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:31:05.217885] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-13T21:31:05.521064] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T21:31:06.017984] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-13T21:31:06.817955] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-13T21:31:07.272227] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T21:31:07.618012] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-13T21:31:07.749193] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T21:31:08.417909] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-13T21:31:08.900529] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T21:31:08.947491] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (2.93 seconds). [2025-10-13T21:31:09.217977] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-13T21:31:10.017998] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-13T21:31:10.310729] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T21:31:10.527954] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T21:31:10.818019] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-13T21:31:11.203400] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T21:31:11.617963] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-13T21:31:12.315828] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T21:31:12.417914] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-13T21:31:12.808911] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:31:13.217991] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-13T21:31:13.376042] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T21:31:14.017957] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-13T21:31:14.740520] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T21:31:14.817943] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-13T21:31:15.618007] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-13T21:31:16.423129] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-13T21:31:16.443489] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T21:31:16.472974] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T21:31:17.218049] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-13T21:31:17.647365] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-10-13T21:31:18.017960] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-13T21:31:18.618519] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:31:18.623529] [INFO ] [REMOTE ] SKY: Full fetch complete (54109 records). [2025-10-13T21:31:18.623680] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-13T21:31:18.834111] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-13T21:31:18.995256] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-13T21:31:19.100487] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-13T21:31:19.100594] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-13T21:31:19.101741] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-13T21:31:19.101805] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-13T21:31:19.103352] [DEBUG] [LOCAL ] SKY: Trimmed 54109 records to 38298 (keeping 200 days of data) [2025-10-13T21:31:19.352679] [DEBUG] [LOCAL ] SKY: Primary data saved (38298 records). [2025-10-13T21:31:19.353042] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-13T21:31:19.353256] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKY took 36.8s. Estimated remaining: 1h 2m 20s. Rate: 7.1 symbols/min [2025-10-13T21:31:19.577445] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:19.575522] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T21:31:19.617918] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-13T21:31:19.636041] [DEBUG] [LOCAL ] SLG: Loaded 45846 existing records from primary storage. [2025-10-13T21:31:19.636310] [INFO ] [MAIN ] SLG: Loaded 45846 existing records. [2025-10-13T21:31:19.816932] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:31:19.817383] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-13T21:31:19.817675] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-13T21:31:19.818262] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-13T21:31:19.818326] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-13T21:31:19.928337] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T21:31:20.184118] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:20.417993] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-13T21:31:20.780302] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:31:21.218010] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-13T21:31:22.017976] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-13T21:31:22.073159] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T21:31:22.715185] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T21:31:22.817943] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-13T21:31:23.617950] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-13T21:31:24.246845] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T21:31:24.417966] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-13T21:31:25.217899] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-13T21:31:25.246327] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:31:25.846332] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:31:26.018001] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-13T21:31:26.134399] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T21:31:26.136630] [INFO ] [REMOTE ] SKYH: Full fetch complete (22390 records). [2025-10-13T21:31:26.136891] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-13T21:31:26.515887] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-13T21:31:26.516040] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-13T21:31:26.516752] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-13T21:31:26.516814] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-13T21:31:26.517447] [DEBUG] [LOCAL ] SKYH: Trimmed 22390 records to 16380 (keeping 200 days of data) [2025-10-13T21:31:26.618800] [DEBUG] [LOCAL ] SKYH: Primary data saved (16380 records). [2025-10-13T21:31:26.618950] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-13T21:31:26.619043] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKYH took 38.5s. Estimated remaining: 1h 2m 11s. Rate: 7.1 symbols/min [2025-10-13T21:31:26.789208] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:26.828070] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-13T21:31:26.831637] [DEBUG] [LOCAL ] SLGN: Loaded 41331 existing records from primary storage. [2025-10-13T21:31:26.832064] [INFO ] [MAIN ] SLGN: Loaded 41331 existing records. [2025-10-13T21:31:27.013542] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:31:27.014022] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-13T21:31:27.014075] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-13T21:31:27.015320] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-13T21:31:27.015380] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-13T21:31:27.164003] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T21:31:27.163031] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (5.15 seconds). [2025-10-13T21:31:27.200762] [INFO ] [REMOTE ] SLF: Full fetch complete (56218 records). [2025-10-13T21:31:27.255780] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-13T21:31:27.622312] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-13T21:31:27.699639] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:27.892020] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-13T21:31:27.892101] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-13T21:31:27.892989] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-13T21:31:27.893052] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-13T21:31:27.894451] [DEBUG] [LOCAL ] SLF: Trimmed 56218 records to 38799 (keeping 200 days of data) [2025-10-13T21:31:28.149107] [DEBUG] [LOCAL ] SLF: Primary data saved (38799 records). [2025-10-13T21:31:28.149333] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-13T21:31:28.149554] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SLF took 27.3s. Estimated remaining: 1h 2m 1s. Rate: 7.1 symbols/min [2025-10-13T21:31:28.329051] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:28.329444] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-13T21:31:28.329558] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-13T21:31:28.329740] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-13T21:31:28.329813] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-13T21:31:28.330023] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-13T21:31:28.330102] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-13T21:31:28.425866] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-13T21:31:28.536825] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T21:31:28.759589] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:29.217913] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-13T21:31:29.549130] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-13T21:31:29.804873] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T21:31:29.986963] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T21:31:30.017881] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-13T21:31:30.818000] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-13T21:31:31.149849] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T21:31:31.443693] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T21:31:31.617947] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-13T21:31:31.957618] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T21:31:32.417977] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-13T21:31:33.218022] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-13T21:31:34.018036] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-13T21:31:34.360243] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-13T21:31:34.455185] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T21:31:34.817967] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-13T21:31:34.872848] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T21:31:35.150492] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T21:31:35.617977] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-13T21:31:36.418021] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-13T21:31:36.752593] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-13T21:31:37.217954] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-13T21:31:37.423415] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T21:31:37.428933] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-13T21:31:37.429060] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-13T21:31:37.532761] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T21:31:37.822559] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-13T21:31:37.822688] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-13T21:31:37.823908] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-13T21:31:37.823972] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-13T21:31:37.825447] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-10-13T21:31:38.040162] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-13T21:31:38.166927] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-13T21:31:38.167061] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-13T21:31:38.167141] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 46.4s. Estimated remaining: 1h 1m 53s. Rate: 7.1 symbols/min [2025-10-13T21:31:38.347150] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:38.382784] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T21:31:38.402875] [DEBUG] [LOCAL ] SLQT: Loaded 44094 existing records from primary storage. [2025-10-13T21:31:38.403383] [INFO ] [MAIN ] SLQT: Loaded 44094 existing records. [2025-10-13T21:31:38.620807] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:31:38.621134] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-13T21:31:38.621208] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-13T21:31:38.622118] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-13T21:31:38.622201] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-13T21:31:38.823102] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-13T21:31:39.058294] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:39.618019] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-13T21:31:40.423160] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-13T21:31:40.429754] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T21:31:40.754508] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T21:31:41.041675] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T21:31:41.217978] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-13T21:31:42.017967] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-13T21:31:42.318668] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-13T21:31:42.665034] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T21:31:42.817954] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-13T21:31:43.617954] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-13T21:31:44.409773] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:31:44.418177] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-13T21:31:45.147557] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:31:45.217883] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-13T21:31:45.989757] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:31:46.017878] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-13T21:31:46.803688] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T21:31:46.817869] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-13T21:31:47.605061] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T21:31:47.617877] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-13T21:31:48.217809] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T21:31:48.417970] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-13T21:31:49.218057] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-13T21:31:49.368865] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:31:49.482444] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-13T21:31:49.483316] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1039 records). [2025-10-13T21:31:49.483391] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-13T21:31:49.669243] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-13T21:31:49.669563] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:31:49.669636] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:31:49.669789] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-13T21:31:49.669865] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-13T21:31:49.669902] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-13T21:31:49.669955] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-13T21:31:49.670033] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLNZ took 21.5s. Estimated remaining: 1h 1m 45s. Rate: 7.1 symbols/min [2025-10-13T21:31:49.839754] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:31:49.862929] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T21:31:49.897830] [DEBUG] [LOCAL ] SLVM: Loaded 28268 existing records from primary storage. [2025-10-13T21:31:49.898167] [INFO ] [MAIN ] SLVM: Loaded 28268 existing records. [2025-10-13T21:31:50.023157] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-13T21:31:50.076153] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:31:50.076359] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-13T21:31:50.076405] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-13T21:31:50.077253] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-13T21:31:50.077311] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-13T21:31:50.421973] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:31:50.817944] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-13T21:31:51.618043] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-13T21:31:51.681418] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:31:52.039965] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T21:31:52.417982] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-13T21:31:52.898557] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T21:31:53.217895] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-13T21:31:53.723435] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T21:31:54.017924] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-13T21:31:54.817894] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-13T21:31:54.881616] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:31:55.145204] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T21:31:55.617923] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-13T21:31:56.154222] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T21:31:56.417918] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-13T21:31:57.096165] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T21:31:57.217988] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-13T21:31:57.954427] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T21:31:58.017910] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-13T21:31:58.098279] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T21:31:58.817964] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-13T21:31:59.410088] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T21:31:59.415720] [INFO ] [REMOTE ] SLG: Full fetch complete (64896 records). [2025-10-13T21:31:59.416040] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-13T21:31:59.627173] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-13T21:31:59.806235] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-13T21:31:59.806324] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-13T21:31:59.807403] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-13T21:31:59.807465] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-13T21:31:59.809007] [DEBUG] [LOCAL ] SLG: Trimmed 64896 records to 45377 (keeping 200 days of data) [2025-10-13T21:32:00.094922] [DEBUG] [LOCAL ] SLG: Primary data saved (45377 records). [2025-10-13T21:32:00.095150] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-13T21:32:00.095249] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 40.7s. Estimated remaining: 1h 1m 37s. Rate: 7.1 symbols/min [2025-10-13T21:32:00.296408] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T21:32:00.294386] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:00.353293] [DEBUG] [LOCAL ] SM: Loaded 53093 existing records from primary storage. [2025-10-13T21:32:00.353622] [INFO ] [MAIN ] SM: Loaded 53093 existing records. [2025-10-13T21:32:00.425802] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-13T21:32:00.537269] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:00.537499] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-13T21:32:00.537547] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-13T21:32:00.538549] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-13T21:32:00.538609] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-13T21:32:00.925942] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:01.218048] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-13T21:32:01.352780] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T21:32:01.910803] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T21:32:01.916497] [INFO ] [REMOTE ] SLGN: Full fetch complete (58927 records). [2025-10-13T21:32:01.916719] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-13T21:32:02.023245] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-13T21:32:02.336273] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-13T21:32:02.336378] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-13T21:32:02.337381] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-13T21:32:02.337464] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-13T21:32:02.338987] [DEBUG] [LOCAL ] SLGN: Trimmed 58927 records to 40749 (keeping 200 days of data) [2025-10-13T21:32:02.357910] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T21:32:02.612193] [DEBUG] [LOCAL ] SLGN: Primary data saved (40749 records). [2025-10-13T21:32:02.612355] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-13T21:32:02.612447] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 36.0s. Estimated remaining: 1h 1m 27s. Rate: 7.1 symbols/min [2025-10-13T21:32:02.778418] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:02.778617] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-13T21:32:02.778683] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-13T21:32:02.778823] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-13T21:32:02.778864] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-13T21:32:02.778903] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-13T21:32:02.778934] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-13T21:32:02.823089] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-13T21:32:03.130344] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:03.617961] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-13T21:32:03.832556] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T21:32:03.842935] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:32:03.843248] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-13T21:32:03.843339] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:32:03.843401] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-13T21:32:03.843505] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:32:03.843585] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-13T21:32:03.843714] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-13T21:32:03.843779] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-13T21:32:03.843855] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-13T21:32:03.843944] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SMA took 1.2s. Estimated remaining: 1h 1m 17s. Rate: 7.1 symbols/min [2025-10-13T21:32:04.012635] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:04.021694] [DEBUG] [LOCAL ] SMBK: Loaded 8292 existing records from primary storage. [2025-10-13T21:32:04.021890] [INFO ] [MAIN ] SMBK: Loaded 8292 existing records. [2025-10-13T21:32:04.202256] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:04.202477] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-13T21:32:04.202546] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-13T21:32:04.202869] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-13T21:32:04.202962] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-13T21:32:04.423162] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-13T21:32:04.576536] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:04.705290] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T21:32:05.217922] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-13T21:32:05.406769] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T21:32:05.998611] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T21:32:06.017916] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-13T21:32:06.793609] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T21:32:06.817879] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-13T21:32:07.434611] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T21:32:07.617923] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-13T21:32:08.417915] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-13T21:32:09.218034] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-13T21:32:09.272101] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:32:09.652846] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T21:32:10.017961] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-13T21:32:10.817904] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-13T21:32:10.859355] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T21:32:11.402056] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T21:32:11.617908] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-13T21:32:11.944417] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T21:32:12.418021] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-13T21:32:13.218035] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-13T21:32:13.344409] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T21:32:13.910788] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T21:32:13.979148] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T21:32:14.017900] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-13T21:32:14.817917] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-13T21:32:14.840851] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T21:32:15.617955] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-13T21:32:16.417999] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-13T21:32:16.648706] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T21:32:16.929611] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T21:32:16.934487] [INFO ] [REMOTE ] SLQT: Full fetch complete (63782 records). [2025-10-13T21:32:16.934688] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-13T21:32:17.226128] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-13T21:32:17.359785] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-13T21:32:17.359870] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-13T21:32:17.360954] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-13T21:32:17.361018] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-13T21:32:17.362427] [DEBUG] [LOCAL ] SLQT: Trimmed 63782 records to 43529 (keeping 200 days of data) [2025-10-13T21:32:17.621393] [DEBUG] [LOCAL ] SLQT: Primary data saved (43529 records). [2025-10-13T21:32:17.621559] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-13T21:32:17.621688] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLQT took 39.5s. Estimated remaining: 1h 1m 10s. Rate: 7.1 symbols/min [2025-10-13T21:32:17.743792] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T21:32:17.824409] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:17.838103] [DEBUG] [LOCAL ] SMC: Loaded 11462 existing records from primary storage. [2025-10-13T21:32:17.838349] [INFO ] [MAIN ] SMC: Loaded 11462 existing records. [2025-10-13T21:32:18.010027] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:18.010292] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-13T21:32:18.010342] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-13T21:32:18.010567] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-13T21:32:18.010689] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-13T21:32:18.023313] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-13T21:32:18.358734] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:18.818022] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-13T21:32:19.088514] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:32:19.515919] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:32:19.532582] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T21:32:19.617976] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-13T21:32:20.417978] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-13T21:32:20.567172] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T21:32:21.217921] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-13T21:32:21.968944] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T21:32:22.001988] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T21:32:22.017878] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-13T21:32:22.817980] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-13T21:32:22.838306] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T21:32:23.618004] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-13T21:32:24.417980] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-13T21:32:24.510985] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:32:24.819478] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T21:32:24.916375] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-13T21:32:25.217987] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-13T21:32:26.008750] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T21:32:26.017868] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-13T21:32:26.817894] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-13T21:32:26.915462] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T21:32:27.617966] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-13T21:32:27.986534] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T21:32:27.990108] [INFO ] [REMOTE ] SLVM: Full fetch complete (40036 records). [2025-10-13T21:32:27.990187] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-13T21:32:28.370360] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-13T21:32:28.370443] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-13T21:32:28.371245] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-13T21:32:28.371306] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-13T21:32:28.372250] [DEBUG] [LOCAL ] SLVM: Trimmed 40036 records to 27815 (keeping 200 days of data) [2025-10-13T21:32:28.425509] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-13T21:32:28.568206] [DEBUG] [LOCAL ] SLVM: Primary data saved (27815 records). [2025-10-13T21:32:28.568484] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-13T21:32:28.568750] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLVM took 38.9s. Estimated remaining: 1h 1m 2s. Rate: 7.1 symbols/min [2025-10-13T21:32:28.625925] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T21:32:28.757816] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:28.801778] [DEBUG] [LOCAL ] SMFG: Loaded 48900 existing records from primary storage. [2025-10-13T21:32:28.802109] [INFO ] [MAIN ] SMFG: Loaded 48900 existing records. [2025-10-13T21:32:28.978231] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:28.978459] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-13T21:32:28.978505] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-13T21:32:28.979301] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-13T21:32:28.979360] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-13T21:32:29.223046] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-13T21:32:29.334488] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:29.825949] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T21:32:30.017966] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-13T21:32:30.441997] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T21:32:30.817976] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-13T21:32:31.627384] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-13T21:32:31.632888] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:32:32.418019] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-13T21:32:32.465989] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T21:32:32.542722] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T21:32:33.217954] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-13T21:32:33.992836] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T21:32:34.017883] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-13T21:32:34.086867] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:32:34.817997] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-13T21:32:34.903920] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T21:32:35.541929] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T21:32:35.617986] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-13T21:32:36.339567] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T21:32:36.417913] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-13T21:32:37.056294] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T21:32:37.058420] [INFO ] [REMOTE ] SMBK: Full fetch complete (11763 records). [2025-10-13T21:32:37.058554] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-13T21:32:37.223116] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-13T21:32:37.473582] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-13T21:32:37.473719] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-13T21:32:37.474231] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-13T21:32:37.474296] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-13T21:32:37.474894] [DEBUG] [LOCAL ] SMBK: Trimmed 11763 records to 8199 (keeping 200 days of data) [2025-10-13T21:32:37.529570] [DEBUG] [LOCAL ] SMBK: Primary data saved (8199 records). [2025-10-13T21:32:37.529783] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-13T21:32:37.529903] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 33.7s. Estimated remaining: 1h 0m 54s. Rate: 7.1 symbols/min [2025-10-13T21:32:37.707698] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:37.750140] [DEBUG] [LOCAL ] SMG: Loaded 44210 existing records from primary storage. [2025-10-13T21:32:37.750548] [INFO ] [MAIN ] SMG: Loaded 44210 existing records. [2025-10-13T21:32:37.938100] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:37.938431] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-13T21:32:37.938487] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-13T21:32:37.939414] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-13T21:32:37.939472] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-13T21:32:38.023215] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-13T21:32:38.300606] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:38.818002] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-13T21:32:38.968847] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T21:32:39.585184] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T21:32:39.625334] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-13T21:32:39.628321] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T21:32:40.417973] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-13T21:32:41.081401] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T21:32:41.087164] [INFO ] [REMOTE ] SM: Full fetch complete (75583 records). [2025-10-13T21:32:41.087311] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-13T21:32:41.185711] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T21:32:41.222771] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-13T21:32:41.217554] [INFO ] [REMOTE ] SMC: Full fetch complete (16554 records). [2025-10-13T21:32:41.239774] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-13T21:32:41.844856] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-13T21:32:41.845208] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-13T21:32:41.846490] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-13T21:32:41.852001] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-13T21:32:41.904049] [DEBUG] [LOCAL ] SM: Trimmed 75583 records to 52353 (keeping 200 days of data) [2025-10-13T21:32:41.928719] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-13T21:32:41.928797] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-13T21:32:41.929248] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-13T21:32:41.929321] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-13T21:32:41.930061] [DEBUG] [LOCAL ] SMC: Trimmed 16554 records to 11265 (keeping 200 days of data) [2025-10-13T21:32:42.022807] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-13T21:32:42.106506] [DEBUG] [LOCAL ] SMC: Primary data saved (11265 records). [2025-10-13T21:32:42.107206] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-13T21:32:42.107598] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 24.5s. Estimated remaining: 1h 0m 45s. Rate: 7.1 symbols/min [2025-10-13T21:32:42.294844] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:42.319891] [DEBUG] [LOCAL ] SMHI: Loaded 13253 existing records from primary storage. [2025-10-13T21:32:42.321269] [INFO ] [MAIN ] SMHI: Loaded 13253 existing records. [2025-10-13T21:32:42.627869] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:42.633006] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-13T21:32:42.644999] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-13T21:32:42.646213] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-13T21:32:42.646527] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-13T21:32:43.120857] [DEBUG] [LOCAL ] SM: Primary data saved (52353 records). [2025-10-13T21:32:43.150274] [INFO ] [MAIN ] SM: Full history saved. [2025-10-13T21:32:43.150954] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SM took 43.1s. Estimated remaining: 1h 0m 35s. Rate: 7.1 symbols/min [2025-10-13T21:32:43.149870] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:43.153889] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T21:32:43.168694] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-13T21:32:43.350860] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:32:43.371613] [DEBUG] [LOCAL ] SMP: Loaded 19271 existing records from primary storage. [2025-10-13T21:32:43.372132] [INFO ] [MAIN ] SMP: Loaded 19271 existing records. [2025-10-13T21:32:43.588563] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:32:43.590985] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T21:32:43.599394] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-13T21:32:43.599559] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-13T21:32:43.600950] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-13T21:32:43.601016] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-13T21:32:43.623051] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-13T21:32:43.971861] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:32:44.417891] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-13T21:32:44.509386] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T21:32:44.819125] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T21:32:45.217962] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-13T21:32:45.871126] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T21:32:45.926013] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T21:32:46.017982] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-13T21:32:46.817949] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-13T21:32:47.067874] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T21:32:47.617905] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-13T21:32:48.425988] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-13T21:32:48.451722] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:32:48.497490] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T21:32:49.218160] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-13T21:32:50.017967] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-13T21:32:50.213241] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T21:32:50.273123] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T21:32:50.817987] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-13T21:32:51.438343] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T21:32:51.617922] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-13T21:32:51.671794] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T21:32:52.417994] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-13T21:32:53.217989] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-13T21:32:53.244544] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T21:32:53.408235] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:32:54.017961] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-13T21:32:54.212465] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T21:32:54.713872] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T21:32:54.818043] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-13T21:32:55.617986] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-13T21:32:55.917951] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T21:32:56.417971] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-13T21:32:56.459263] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T21:32:57.218072] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-13T21:32:57.461942] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T21:32:58.018053] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-13T21:32:58.823096] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-13T21:32:58.848736] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T21:32:59.069801] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T21:32:59.617920] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-13T21:33:00.418032] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-13T21:33:00.530928] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T21:33:01.217914] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-13T21:33:01.401259] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T21:33:01.508006] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T21:33:02.018048] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-13T21:33:02.589456] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T21:33:02.817982] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-13T21:33:02.872197] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T21:33:03.617918] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-13T21:33:04.051811] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T21:33:04.418013] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-13T21:33:05.217921] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-13T21:33:05.346362] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T21:33:05.501699] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T21:33:06.017968] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-13T21:33:06.817955] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-13T21:33:06.964904] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:33:07.616749] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T21:33:07.619081] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-13T21:33:07.651218] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T21:33:08.417968] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-13T21:33:08.726855] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T21:33:09.217905] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-13T21:33:09.234352] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T21:33:09.235882] [INFO ] [REMOTE ] SMHI: Full fetch complete (22035 records). [2025-10-13T21:33:09.235981] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-13T21:33:09.595129] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-13T21:33:09.595205] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-13T21:33:09.595738] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-13T21:33:09.595798] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-13T21:33:09.596392] [DEBUG] [LOCAL ] SMHI: Trimmed 22035 records to 13126 (keeping 200 days of data) [2025-10-13T21:33:09.670883] [DEBUG] [LOCAL ] SMHI: Primary data saved (13126 records). [2025-10-13T21:33:09.671016] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-13T21:33:09.671149] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMHI took 27.6s. Estimated remaining: 1h 0m 30s. Rate: 7.1 symbols/min [2025-10-13T21:33:09.835130] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:09.895435] [DEBUG] [LOCAL ] SMR: Loaded 54578 existing records from primary storage. [2025-10-13T21:33:09.895795] [INFO ] [MAIN ] SMR: Loaded 54578 existing records. [2025-10-13T21:33:10.023121] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-13T21:33:10.078142] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:10.078523] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-13T21:33:10.078570] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-13T21:33:10.079224] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-13T21:33:10.079294] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-13T21:33:10.364222] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T21:33:10.442953] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:10.817951] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-13T21:33:11.596617] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T21:33:11.601900] [INFO ] [REMOTE ] SMFG: Full fetch complete (69109 records). [2025-10-13T21:33:11.602009] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-13T21:33:11.623501] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-13T21:33:11.724529] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T21:33:11.757340] [INFO ] [REMOTE ] SMP: Full fetch complete (26231 records). [2025-10-13T21:33:11.770838] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-13T21:33:12.310393] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-13T21:33:12.312872] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-13T21:33:12.313924] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-13T21:33:12.314252] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-13T21:33:12.387777] [DEBUG] [LOCAL ] SMFG: Trimmed 69109 records to 48271 (keeping 200 days of data) [2025-10-13T21:33:12.401176] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-13T21:33:12.401521] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-13T21:33:12.401896] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-13T21:33:12.401993] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-13T21:33:12.403277] [DEBUG] [LOCAL ] SMP: Trimmed 26231 records to 18967 (keeping 200 days of data) [2025-10-13T21:33:12.453074] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-13T21:33:12.699574] [DEBUG] [LOCAL ] SMP: Primary data saved (18967 records). [2025-10-13T21:33:12.699798] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-13T21:33:12.724971] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMP took 29.6s. Estimated remaining: 1h 0m 20s. Rate: 7.1 symbols/min [2025-10-13T21:33:12.909789] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:13.008598] [DEBUG] [LOCAL ] SMFG: Primary data saved (48271 records). [2025-10-13T21:33:13.009614] [DEBUG] [LOCAL ] SMRT: Loaded 44671 existing records from primary storage. [2025-10-13T21:33:13.009737] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-13T21:33:13.009977] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMFG took 44.4s. Estimated remaining: 1h 0m 10s. Rate: 7.1 symbols/min [2025-10-13T21:33:13.010428] [INFO ] [MAIN ] SMRT: Loaded 44671 existing records. [2025-10-13T21:33:13.347707] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:13.371382] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:13.369081] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-13T21:33:13.371842] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-13T21:33:13.372515] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-13T21:33:13.372599] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-13T21:33:13.530588] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T21:33:13.619830] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-13T21:33:13.711533] [DEBUG] [LOCAL ] SMWB: Loaded 32747 existing records from primary storage. [2025-10-13T21:33:13.711873] [INFO ] [MAIN ] SMWB: Loaded 32747 existing records. [2025-10-13T21:33:13.908976] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:13.970748] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:13.970975] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-13T21:33:13.971021] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-13T21:33:13.971404] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-13T21:33:13.971450] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-13T21:33:14.033176] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-13T21:33:14.321270] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:14.817919] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-13T21:33:14.874140] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-13T21:33:15.166048] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T21:33:15.297554] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T21:33:15.617942] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-13T21:33:15.754301] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T21:33:16.418033] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-13T21:33:16.933254] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T21:33:17.217941] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-13T21:33:17.896155] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T21:33:18.017944] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-13T21:33:18.697057] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:33:18.817955] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-13T21:33:19.617963] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-13T21:33:19.832818] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T21:33:19.837284] [INFO ] [REMOTE ] SMG: Full fetch complete (62761 records). [2025-10-13T21:33:19.837389] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-13T21:33:20.232145] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-13T21:33:20.232278] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-13T21:33:20.233784] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-13T21:33:20.233966] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-13T21:33:20.236160] [DEBUG] [LOCAL ] SMG: Trimmed 62761 records to 43439 (keeping 200 days of data) [2025-10-13T21:33:20.370214] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-13T21:33:20.463704] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-13T21:33:20.560169] [DEBUG] [LOCAL ] SMG: Primary data saved (43439 records). [2025-10-13T21:33:20.560351] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-13T21:33:20.560468] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMG took 43.0s. Estimated remaining: 1h 0m 2s. Rate: 7.1 symbols/min [2025-10-13T21:33:20.737006] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:20.794859] [DEBUG] [LOCAL ] SN: Loaded 50672 existing records from primary storage. [2025-10-13T21:33:20.795319] [INFO ] [MAIN ] SN: Loaded 50672 existing records. [2025-10-13T21:33:21.000233] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:21.000575] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-13T21:33:21.000633] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-13T21:33:21.001243] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-13T21:33:21.001302] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-13T21:33:21.249494] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-13T21:33:21.372250] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:21.398038] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T21:33:22.018001] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-13T21:33:22.817907] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-13T21:33:22.946937] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T21:33:23.070369] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-13T21:33:23.617972] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-13T21:33:24.240752] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T21:33:24.417966] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-13T21:33:25.217992] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-13T21:33:25.400064] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-10-13T21:33:25.924664] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T21:33:26.017881] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-13T21:33:26.257745] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-13T21:33:26.708625] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T21:33:26.817903] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-13T21:33:27.392608] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T21:33:27.617962] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-13T21:33:28.417979] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-13T21:33:28.504026] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:33:29.059627] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T21:33:29.217945] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-13T21:33:30.017905] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-13T21:33:30.567383] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T21:33:30.817972] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-13T21:33:31.054893] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-13T21:33:31.617899] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-13T21:33:31.784500] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T21:33:32.417914] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-13T21:33:32.471478] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T21:33:32.998677] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T21:33:33.217935] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-13T21:33:34.017957] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-13T21:33:34.817988] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-13T21:33:34.962984] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T21:33:35.115305] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-13T21:33:35.155116] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T21:33:35.617951] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-13T21:33:36.022549] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T21:33:36.417959] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-13T21:33:36.945675] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T21:33:37.217987] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-13T21:33:38.018016] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-13T21:33:38.666813] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T21:33:38.817910] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-13T21:33:39.052848] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-13T21:33:39.105054] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T21:33:39.617920] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-13T21:33:40.223089] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T21:33:40.417963] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-13T21:33:41.217921] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-13T21:33:41.740413] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T21:33:41.745004] [INFO ] [REMOTE ] SMRT: Full fetch complete (62032 records). [2025-10-13T21:33:41.745119] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-13T21:33:42.020863] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-13T21:33:42.202129] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-13T21:33:42.202400] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-13T21:33:42.203830] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-13T21:33:42.203914] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-13T21:33:42.205317] [DEBUG] [LOCAL ] SMRT: Trimmed 62032 records to 43964 (keeping 200 days of data) [2025-10-13T21:33:42.345263] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T21:33:42.351502] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-13T21:33:42.360907] [INFO ] [REMOTE ] SMWB: Full fetch complete (49041 records). [2025-10-13T21:33:42.373232] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-13T21:33:42.809589] [DEBUG] [LOCAL ] SMRT: Primary data saved (43964 records). [2025-10-13T21:33:42.815398] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-13T21:33:42.820730] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-13T21:33:42.836308] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMRT took 30.1s. Estimated remaining: 59m 56s. Rate: 7.1 symbols/min [2025-10-13T21:33:42.948813] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-13T21:33:42.964587] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-13T21:33:42.965717] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-13T21:33:42.965798] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-13T21:33:43.008707] [DEBUG] [LOCAL ] SMWB: Trimmed 49041 records to 32262 (keeping 200 days of data) [2025-10-13T21:33:43.153703] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:43.191460] [DEBUG] [LOCAL ] SNA: Loaded 25978 existing records from primary storage. [2025-10-13T21:33:43.192552] [INFO ] [MAIN ] SNA: Loaded 25978 existing records. [2025-10-13T21:33:43.383755] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:43.387018] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-13T21:33:43.387220] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-13T21:33:43.420669] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-13T21:33:43.421038] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-13T21:33:43.574943] [DEBUG] [LOCAL ] SMWB: Primary data saved (32262 records). [2025-10-13T21:33:43.596103] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-13T21:33:43.622118] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMWB took 30.6s. Estimated remaining: 59m 46s. Rate: 7.1 symbols/min [2025-10-13T21:33:44.042412] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:44.048782] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:44.049962] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-13T21:33:44.085144] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T21:33:44.143890] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-13T21:33:44.144347] [INFO ] [MAIN ] SNAP: Loaded 54576 existing records. [2025-10-13T21:33:44.322504] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:44.322798] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-13T21:33:44.322851] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-13T21:33:44.323378] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-13T21:33:44.323434] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-13T21:33:44.428015] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-13T21:33:44.683317] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:45.217907] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-13T21:33:45.386715] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T21:33:45.749999] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-13T21:33:46.017955] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-13T21:33:46.134864] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:33:46.817969] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-13T21:33:47.617919] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-13T21:33:47.725033] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-13T21:33:48.417987] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-13T21:33:48.531671] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-13T21:33:48.656890] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T21:33:48.725926] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T21:33:49.218044] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-13T21:33:50.018010] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-13T21:33:50.774677] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-13T21:33:50.817948] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-13T21:33:51.417323] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T21:33:51.623070] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-13T21:33:51.639259] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-13T21:33:51.648091] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-13T21:33:51.648314] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-13T21:33:52.122847] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-13T21:33:52.122946] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-13T21:33:52.124157] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-13T21:33:52.124223] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-13T21:33:52.125721] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53799 (keeping 200 days of data) [2025-10-13T21:33:52.425278] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-13T21:33:52.453586] [DEBUG] [LOCAL ] SMR: Primary data saved (53799 records). [2025-10-13T21:33:52.453764] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-13T21:33:52.453863] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 42.8s. Estimated remaining: 59m 38s. Rate: 7.1 symbols/min [2025-10-13T21:33:52.619419] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:52.626403] [DEBUG] [LOCAL ] SNDA: Loaded 4512 existing records from primary storage. [2025-10-13T21:33:52.626675] [INFO ] [MAIN ] SNDA: Loaded 4512 existing records. [2025-10-13T21:33:52.803216] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:52.803491] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-13T21:33:52.803558] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-13T21:33:52.803829] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-13T21:33:52.804123] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-13T21:33:53.194934] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:53.215033] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-13T21:33:53.225447] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-13T21:33:53.226838] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T21:33:54.026837] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-13T21:33:54.060706] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:33:54.118796] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T21:33:54.817980] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-13T21:33:55.618002] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-13T21:33:56.343285] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:33:56.374293] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T21:33:56.374484] [INFO ] [REMOTE ] SN: Full fetch complete (71261 records). [2025-10-13T21:33:56.385770] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-13T21:33:56.423013] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-13T21:33:56.804145] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-13T21:33:56.804253] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-13T21:33:56.805481] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-13T21:33:56.805546] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-13T21:33:56.807453] [DEBUG] [LOCAL ] SN: Trimmed 71261 records to 50003 (keeping 200 days of data) [2025-10-13T21:33:57.124847] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T21:33:57.173299] [DEBUG] [LOCAL ] SN: Primary data saved (50003 records). [2025-10-13T21:33:57.173493] [INFO ] [MAIN ] SN: Full history saved. [2025-10-13T21:33:57.173590] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SN took 36.6s. Estimated remaining: 59m 29s. Rate: 7.1 symbols/min [2025-10-13T21:33:57.223272] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-13T21:33:57.355335] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:33:57.399505] [DEBUG] [LOCAL ] SNDR: Loaded 41828 existing records from primary storage. [2025-10-13T21:33:57.399969] [INFO ] [MAIN ] SNDR: Loaded 41828 existing records. [2025-10-13T21:33:57.587252] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:33:57.587502] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-13T21:33:57.587552] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-13T21:33:57.588038] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-13T21:33:57.588094] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-13T21:33:57.940954] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:33:58.018094] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-13T21:33:58.385814] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T21:33:58.818005] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-13T21:33:58.892519] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-13T21:33:59.518659] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T21:33:59.617991] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-13T21:34:00.293400] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T21:34:00.318552] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T21:34:00.417949] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-13T21:34:01.217949] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-13T21:34:02.018012] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-13T21:34:02.693428] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T21:34:02.817978] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-13T21:34:02.868994] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T21:34:03.223662] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-13T21:34:03.617971] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-13T21:34:03.998245] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T21:34:04.417988] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-13T21:34:05.076792] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T21:34:05.076500] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:34:05.217975] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-13T21:34:06.018016] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-13T21:34:06.685391] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T21:34:06.818015] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-13T21:34:07.617972] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-13T21:34:08.104748] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T21:34:08.253583] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T21:34:08.343112] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-13T21:34:08.417952] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-13T21:34:09.217916] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-13T21:34:10.017969] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-13T21:34:10.817957] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-13T21:34:10.897776] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-13T21:34:10.945803] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T21:34:10.989582] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:34:11.459427] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T21:34:11.617982] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-13T21:34:12.417986] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-13T21:34:12.854439] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T21:34:13.217987] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-13T21:34:13.796272] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T21:34:14.017973] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-13T21:34:14.625201] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T21:34:14.818005] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-13T21:34:15.073855] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-13T21:34:15.617969] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-13T21:34:16.242673] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T21:34:16.417964] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-13T21:34:17.217976] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-13T21:34:17.419062] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T21:34:17.422253] [INFO ] [REMOTE ] SNA: Full fetch complete (38665 records). [2025-10-13T21:34:17.422349] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-13T21:34:17.813534] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-13T21:34:17.813633] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-13T21:34:17.814622] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-13T21:34:17.814704] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-13T21:34:17.815782] [DEBUG] [LOCAL ] SNA: Trimmed 38665 records to 25749 (keeping 200 days of data) [2025-10-13T21:34:17.987890] [DEBUG] [LOCAL ] SNA: Primary data saved (25749 records). [2025-10-13T21:34:17.988091] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-13T21:34:17.988194] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 35.1s. Estimated remaining: 59m 23s. Rate: 7.1 symbols/min [2025-10-13T21:34:18.032707] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-13T21:34:18.175473] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:18.223779] [DEBUG] [LOCAL ] SNN: Loaded 44855 existing records from primary storage. [2025-10-13T21:34:18.224174] [INFO ] [MAIN ] SNN: Loaded 44855 existing records. [2025-10-13T21:34:18.421173] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:18.421537] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-13T21:34:18.421700] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-13T21:34:18.422322] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-13T21:34:18.422391] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-13T21:34:18.811041] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T21:34:18.849150] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:18.854100] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-13T21:34:18.856226] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T21:34:19.424193] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:34:19.425332] [INFO ] [REMOTE ] SNDA: Full fetch complete (7660 records). [2025-10-13T21:34:19.425403] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-13T21:34:19.635337] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-13T21:34:19.853415] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-13T21:34:19.853736] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-13T21:34:19.854047] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-13T21:34:19.854121] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-13T21:34:19.887002] [DEBUG] [LOCAL ] SNDA: Trimmed 7660 records to 4448 (keeping 200 days of data) [2025-10-13T21:34:19.902325] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (5.08 seconds). [2025-10-13T21:34:19.932612] [DEBUG] [LOCAL ] SNDA: Primary data saved (4448 records). [2025-10-13T21:34:19.932822] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-13T21:34:19.932933] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNDA took 27.5s. Estimated remaining: 59m 13s. Rate: 7.1 symbols/min [2025-10-13T21:34:20.114102] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:20.178195] [DEBUG] [LOCAL ] SNOW: Loaded 54373 existing records from primary storage. [2025-10-13T21:34:20.178852] [INFO ] [MAIN ] SNOW: Loaded 54373 existing records. [2025-10-13T21:34:20.372071] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:20.372441] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-13T21:34:20.372529] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-13T21:34:20.373271] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-13T21:34:20.373331] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-13T21:34:20.423338] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-13T21:34:20.761143] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:21.218003] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-13T21:34:21.284969] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:34:22.017920] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-13T21:34:22.065246] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T21:34:22.817962] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-13T21:34:23.401885] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T21:34:23.505739] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:34:23.617983] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-13T21:34:24.388700] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T21:34:24.417978] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-13T21:34:25.217966] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-13T21:34:25.685616] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T21:34:25.691585] [INFO ] [REMOTE ] SNAP: Full fetch complete (77935 records). [2025-10-13T21:34:25.691798] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-13T21:34:26.020741] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-13T21:34:26.111316] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-13T21:34:26.111548] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-13T21:34:26.112846] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-13T21:34:26.113118] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-13T21:34:26.141035] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T21:34:26.150560] [DEBUG] [LOCAL ] SNAP: Trimmed 77935 records to 53796 (keeping 200 days of data) [2025-10-13T21:34:26.475809] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-13T21:34:26.475961] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-13T21:34:26.476047] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNAP took 42.8s. Estimated remaining: 59m 4s. Rate: 7.1 symbols/min [2025-10-13T21:34:26.647441] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:26.676947] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T21:34:26.727613] [DEBUG] [LOCAL ] SNV: Loaded 49619 existing records from primary storage. [2025-10-13T21:34:26.728095] [INFO ] [MAIN ] SNV: Loaded 49619 existing records. [2025-10-13T21:34:26.823583] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-13T21:34:26.933436] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:26.933765] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-13T21:34:26.933819] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-13T21:34:26.934293] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-13T21:34:26.934354] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-13T21:34:27.297908] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:27.617987] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-13T21:34:28.417983] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-13T21:34:28.481341] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T21:34:28.507480] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-13T21:34:29.052940] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T21:34:29.061314] [INFO ] [REMOTE ] SNDR: Full fetch complete (59726 records). [2025-10-13T21:34:29.061453] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-13T21:34:29.227068] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-13T21:34:29.479936] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-13T21:34:29.480033] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-13T21:34:29.481474] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-13T21:34:29.481541] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-13T21:34:29.482981] [DEBUG] [LOCAL ] SNDR: Trimmed 59726 records to 41435 (keeping 200 days of data) [2025-10-13T21:34:29.744135] [DEBUG] [LOCAL ] SNDR: Primary data saved (41435 records). [2025-10-13T21:34:29.744288] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-13T21:34:29.744564] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 32.6s. Estimated remaining: 58m 55s. Rate: 7.1 symbols/min [2025-10-13T21:34:29.918145] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:29.950575] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T21:34:29.997835] [DEBUG] [LOCAL ] SNX: Loaded 40527 existing records from primary storage. [2025-10-13T21:34:29.998196] [INFO ] [MAIN ] SNX: Loaded 40527 existing records. [2025-10-13T21:34:30.028540] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-13T21:34:30.201743] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:30.201978] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-13T21:34:30.202024] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-13T21:34:30.202877] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-13T21:34:30.202933] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-13T21:34:30.554505] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:30.817965] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-13T21:34:30.998707] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:34:31.617914] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-13T21:34:31.702978] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:34:32.014372] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T21:34:32.417955] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-13T21:34:33.217964] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-13T21:34:33.847622] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T21:34:34.026333] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-13T21:34:34.032123] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T21:34:34.823045] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-13T21:34:34.844208] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T21:34:35.618002] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-13T21:34:36.423085] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-13T21:34:36.441463] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:34:36.485239] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-13T21:34:36.850188] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T21:34:37.217946] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-13T21:34:38.017978] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-13T21:34:38.080303] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T21:34:38.770431] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T21:34:38.817963] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-13T21:34:39.617908] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-13T21:34:40.311738] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-13T21:34:40.417953] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-13T21:34:40.568526] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T21:34:41.087880] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T21:34:41.217915] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-13T21:34:41.958790] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T21:34:42.017907] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-13T21:34:42.817973] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-13T21:34:43.570218] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T21:34:43.617956] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-13T21:34:43.697552] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T21:34:44.417995] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-13T21:34:44.518101] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T21:34:45.218006] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-13T21:34:46.016431] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T21:34:46.027462] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-13T21:34:46.059182] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:34:46.675990] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T21:34:46.817957] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-13T21:34:47.617902] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-13T21:34:47.686606] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:34:48.417914] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-13T21:34:49.053764] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-13T21:34:49.146518] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T21:34:49.217953] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-13T21:34:49.726950] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T21:34:49.732886] [INFO ] [REMOTE ] SNN: Full fetch complete (63001 records). [2025-10-13T21:34:49.733135] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-13T21:34:50.027686] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-13T21:34:50.122815] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-13T21:34:50.122910] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-13T21:34:50.124030] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-13T21:34:50.124094] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-13T21:34:50.125570] [DEBUG] [LOCAL ] SNN: Trimmed 63001 records to 44305 (keeping 200 days of data) [2025-10-13T21:34:50.403852] [DEBUG] [LOCAL ] SNN: Primary data saved (44305 records). [2025-10-13T21:34:50.404000] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-13T21:34:50.404084] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNN took 32.4s. Estimated remaining: 58m 49s. Rate: 7.1 symbols/min [2025-10-13T21:34:50.571402] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:50.619794] [DEBUG] [LOCAL ] SO: Loaded 54389 existing records from primary storage. [2025-10-13T21:34:50.620150] [INFO ] [MAIN ] SO: Loaded 54389 existing records. [2025-10-13T21:34:50.798824] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:50.799184] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-13T21:34:50.799362] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-13T21:34:50.800380] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-13T21:34:50.800446] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-13T21:34:50.823180] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-13T21:34:50.943958] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T21:34:51.209517] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:51.552023] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T21:34:51.618018] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-13T21:34:52.417980] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-13T21:34:53.217902] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-13T21:34:53.392444] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-13T21:34:53.462930] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T21:34:53.866956] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T21:34:54.017986] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-13T21:34:54.817971] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-13T21:34:55.043893] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T21:34:55.617920] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-13T21:34:56.004447] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T21:34:56.258520] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-13T21:34:56.417999] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-13T21:34:57.218027] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-13T21:34:57.381215] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T21:34:58.017935] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-13T21:34:58.452782] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T21:34:58.541863] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T21:34:58.546099] [INFO ] [REMOTE ] SNX: Full fetch complete (57076 records). [2025-10-13T21:34:58.546203] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-13T21:34:58.823211] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-13T21:34:58.941713] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-13T21:34:58.941821] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-13T21:34:58.942991] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-13T21:34:58.943053] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-13T21:34:58.944325] [DEBUG] [LOCAL ] SNX: Trimmed 57076 records to 39704 (keeping 200 days of data) [2025-10-13T21:34:59.193043] [DEBUG] [LOCAL ] SNX: Primary data saved (39704 records). [2025-10-13T21:34:59.193207] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-13T21:34:59.193294] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNX took 29.4s. Estimated remaining: 58m 40s. Rate: 7.1 symbols/min [2025-10-13T21:34:59.360565] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:34:59.398959] [DEBUG] [LOCAL ] SOBO: Loaded 39909 existing records from primary storage. [2025-10-13T21:34:59.399248] [INFO ] [MAIN ] SOBO: Loaded 39909 existing records. [2025-10-13T21:34:59.583323] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:34:59.583863] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-13T21:34:59.583939] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-13T21:34:59.584604] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-13T21:34:59.584696] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-13T21:34:59.626501] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-13T21:34:59.945947] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:34:59.979319] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T21:35:00.417916] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-13T21:35:00.833935] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-13T21:35:00.839473] [INFO ] [REMOTE ] SNOW: Full fetch complete (77650 records). [2025-10-13T21:35:00.839619] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-13T21:35:01.218764] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-13T21:35:01.274724] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-13T21:35:01.275016] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-13T21:35:01.276833] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-13T21:35:01.276951] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-13T21:35:01.280001] [DEBUG] [LOCAL ] SNOW: Trimmed 77650 records to 53594 (keeping 200 days of data) [2025-10-13T21:35:01.425964] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T21:35:01.730140] [DEBUG] [LOCAL ] SNOW: Primary data saved (53594 records). [2025-10-13T21:35:01.730329] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-13T21:35:01.730520] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 41.8s. Estimated remaining: 58m 31s. Rate: 7.1 symbols/min [2025-10-13T21:35:01.913202] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:01.966032] [DEBUG] [LOCAL ] SOC: Loaded 51406 existing records from primary storage. [2025-10-13T21:35:01.966374] [INFO ] [MAIN ] SOC: Loaded 51406 existing records. [2025-10-13T21:35:02.030416] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-13T21:35:02.154594] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T21:35:02.203583] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:02.203845] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-13T21:35:02.203895] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-13T21:35:02.204469] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-13T21:35:02.204539] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-13T21:35:02.573624] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:02.821858] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-13T21:35:02.829933] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T21:35:03.617907] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-13T21:35:03.672337] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T21:35:03.677836] [INFO ] [REMOTE ] SNV: Full fetch complete (71308 records). [2025-10-13T21:35:03.677995] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-13T21:35:04.065430] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-13T21:35:04.065603] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-13T21:35:04.066823] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-13T21:35:04.066885] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-13T21:35:04.068354] [DEBUG] [LOCAL ] SNV: Trimmed 71308 records to 48968 (keeping 200 days of data) [2025-10-13T21:35:04.370862] [DEBUG] [LOCAL ] SNV: Primary data saved (48968 records). [2025-10-13T21:35:04.371091] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-13T21:35:04.371309] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNV took 37.9s. Estimated remaining: 58m 21s. Rate: 7.1 symbols/min [2025-10-13T21:35:04.434328] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-13T21:35:04.507618] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:35:04.581567] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:04.592619] [DEBUG] [LOCAL ] SOJC: Loaded 5037 existing records from primary storage. [2025-10-13T21:35:04.592853] [INFO ] [MAIN ] SOJC: Loaded 5037 existing records. [2025-10-13T21:35:04.768144] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:04.768387] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-13T21:35:04.768436] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-13T21:35:04.768932] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-13T21:35:04.769036] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-13T21:35:05.135077] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:05.217900] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-13T21:35:05.466485] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T21:35:06.017906] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-13T21:35:06.066289] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:35:06.665580] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T21:35:06.798504] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T21:35:06.817891] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-13T21:35:07.448191] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T21:35:07.617970] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-13T21:35:08.417945] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-13T21:35:09.217920] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-13T21:35:09.499812] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T21:35:10.017899] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-13T21:35:10.111104] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:35:10.600927] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T21:35:10.614200] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T21:35:10.817970] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-13T21:35:11.530335] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T21:35:11.617904] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-13T21:35:12.418071] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-13T21:35:12.884954] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T21:35:13.217961] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-13T21:35:13.944564] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T21:35:14.018021] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-13T21:35:14.375209] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T21:35:14.586848] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T21:35:14.817943] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-13T21:35:15.617905] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-13T21:35:16.423184] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-13T21:35:16.428102] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T21:35:17.217957] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-13T21:35:17.257134] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:35:17.889600] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T21:35:18.017983] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-13T21:35:18.241957] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T21:35:18.602122] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T21:35:18.817945] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-13T21:35:19.617916] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-13T21:35:20.418052] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-13T21:35:20.625556] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T21:35:20.820142] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T21:35:21.217912] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-13T21:35:21.591170] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T21:35:21.802925] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T21:35:22.017959] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-13T21:35:22.817962] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-13T21:35:23.311981] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:35:23.313221] [INFO ] [REMOTE ] SOJC: Full fetch complete (7515 records). [2025-10-13T21:35:23.313313] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-13T21:35:23.623097] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-13T21:35:23.737139] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-13T21:35:23.737309] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-13T21:35:23.737702] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-13T21:35:23.737778] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-13T21:35:23.738603] [DEBUG] [LOCAL ] SOJC: Trimmed 7515 records to 4926 (keeping 200 days of data) [2025-10-13T21:35:23.770679] [DEBUG] [LOCAL ] SOJC: Primary data saved (4926 records). [2025-10-13T21:35:23.770848] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-13T21:35:23.771002] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOJC took 19.4s. Estimated remaining: 58m 15s. Rate: 7.1 symbols/min [2025-10-13T21:35:23.799342] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:35:24.417952] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-13T21:35:25.113612] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T21:35:25.217985] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-13T21:35:25.988352] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:35:26.018001] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-13T21:35:26.600833] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T21:35:26.818035] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-13T21:35:27.617948] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-13T21:35:27.926326] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T21:35:28.228295] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T21:35:28.417947] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-13T21:35:29.217904] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-13T21:35:29.454736] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T21:35:29.680780] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T21:35:30.018013] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-13T21:35:30.817921] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-13T21:35:30.956290] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T21:35:31.617893] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-13T21:35:31.807248] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T21:35:32.054533] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T21:35:32.058825] [INFO ] [REMOTE ] SOBO: Full fetch complete (58161 records). [2025-10-13T21:35:32.058929] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-13T21:35:32.420688] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-13T21:35:32.439469] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-13T21:35:32.439546] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-13T21:35:32.440801] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-13T21:35:32.440998] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-13T21:35:32.442390] [DEBUG] [LOCAL ] SOBO: Trimmed 58161 records to 39413 (keeping 200 days of data) [2025-10-13T21:35:32.686552] [DEBUG] [LOCAL ] SOBO: Primary data saved (39413 records). [2025-10-13T21:35:32.686725] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-13T21:35:32.686832] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SOBO took 33.5s. Estimated remaining: 58m 6s. Rate: 7.1 symbols/min [2025-10-13T21:35:33.188724] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T21:35:33.194493] [INFO ] [REMOTE ] SO: Full fetch complete (77599 records). [2025-10-13T21:35:33.194624] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-13T21:35:33.597379] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-13T21:35:33.597461] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-13T21:35:33.598796] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-13T21:35:33.598859] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-13T21:35:33.600409] [DEBUG] [LOCAL ] SO: Trimmed 77599 records to 53614 (keeping 200 days of data) [2025-10-13T21:35:33.944416] [DEBUG] [LOCAL ] SO: Primary data saved (53614 records). [2025-10-13T21:35:33.944548] [INFO ] [MAIN ] SO: Full history saved. [2025-10-13T21:35:33.944639] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SO took 43.5s. Estimated remaining: 57m 57s. Rate: 7.1 symbols/min [2025-10-13T21:35:34.144316] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T21:35:34.154766] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-13T21:35:36.189728] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T21:35:36.201271] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-13T21:35:37.799986] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T21:35:37.805269] [INFO ] [REMOTE ] SOC: Full fetch complete (71773 records). [2025-10-13T21:35:37.805375] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-13T21:35:38.194961] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-13T21:35:38.195037] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-13T21:35:38.196121] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-13T21:35:38.196182] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-13T21:35:38.197959] [DEBUG] [LOCAL ] SOC: Trimmed 71773 records to 50790 (keeping 200 days of data) [2025-10-13T21:35:38.499811] [DEBUG] [LOCAL ] SOC: Primary data saved (50790 records). [2025-10-13T21:35:38.499948] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-13T21:35:38.500031] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 36.8s. Estimated remaining: 57m 47s. Rate: 7.1 symbols/min [2025-10-13T21:35:39.243149] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:39.254763] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:39.257843] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:39.261412] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:39.261931] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-13T21:35:39.262410] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-13T21:35:39.262629] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-13T21:35:39.262706] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-13T21:35:39.262758] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-13T21:35:39.262794] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-13T21:35:39.371918] [DEBUG] [LOCAL ] SOJD: Loaded 13182 existing records from primary storage. [2025-10-13T21:35:39.391328] [DEBUG] [LOCAL ] SOL: Loaded 13271 existing records from primary storage. [2025-10-13T21:35:39.382706] [DEBUG] [LOCAL ] SOJE: Loaded 9165 existing records from primary storage. [2025-10-13T21:35:39.391672] [INFO ] [MAIN ] SOL: Loaded 13271 existing records. [2025-10-13T21:35:39.397393] [INFO ] [MAIN ] SOJE: Loaded 9165 existing records. [2025-10-13T21:35:39.391046] [INFO ] [MAIN ] SOJD: Loaded 13182 existing records. [2025-10-13T21:35:40.105475] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:40.182526] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-13T21:35:40.240179] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-13T21:35:40.236981] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:40.240077] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:40.245172] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-13T21:35:40.244512] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:40.246244] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-13T21:35:40.246336] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-13T21:35:40.246522] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-13T21:35:40.244824] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-13T21:35:40.246457] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-13T21:35:40.251956] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-13T21:35:40.246701] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-13T21:35:40.270186] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-13T21:35:40.281034] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-13T21:35:40.286514] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-13T21:35:40.554945] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:35:40.558866] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-13T21:35:40.559046] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:35:40.580669] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-13T21:35:40.611841] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:35:40.661912] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-13T21:35:40.712588] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-13T21:35:40.727068] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-13T21:35:40.831314] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-13T21:35:40.856907] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 2.4s. Estimated remaining: 57m 38s. Rate: 7.1 symbols/min [2025-10-13T21:35:41.494199] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:41.538792] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-13T21:35:41.538467] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:41.506504] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:41.563411] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:35:41.564211] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-13T21:35:41.564586] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-13T21:35:41.609253] [DEBUG] [LOCAL ] SOLV: Loaded 44502 existing records from primary storage. [2025-10-13T21:35:41.609572] [INFO ] [MAIN ] SOLV: Loaded 44502 existing records. [2025-10-13T21:35:41.785087] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:35:41.785307] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-13T21:35:41.785355] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-13T21:35:41.785867] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-13T21:35:41.785925] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-13T21:35:42.149456] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:35:42.149807] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-13T21:35:42.580556] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T21:35:42.585307] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-13T21:35:42.655789] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T21:35:42.659464] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-13T21:35:42.786009] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T21:35:42.790717] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-13T21:35:43.134262] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T21:35:43.137782] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-13T21:35:43.428868] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T21:35:43.431475] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-13T21:35:43.585822] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T21:35:43.594573] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-13T21:35:43.801720] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T21:35:43.804874] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-13T21:35:43.911692] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T21:35:44.417982] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-13T21:35:44.527732] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T21:35:44.877562] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T21:35:45.114559] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T21:35:45.159376] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T21:35:45.217904] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-13T21:35:45.983520] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T21:35:46.017970] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-13T21:35:46.817904] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-13T21:35:47.052917] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T21:35:47.538835] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T21:35:47.617918] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-13T21:35:48.404080] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:35:48.417875] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-13T21:35:49.217949] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-13T21:35:49.239343] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T21:35:49.969684] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T21:35:50.017957] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-13T21:35:50.817953] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-13T21:35:51.455729] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T21:35:51.617974] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-13T21:35:51.635429] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T21:35:52.417982] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-13T21:35:53.189759] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T21:35:53.217898] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-13T21:35:53.285794] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T21:35:54.017982] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-13T21:35:54.817915] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-13T21:35:54.943485] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T21:35:55.152546] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T21:35:55.617904] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-13T21:35:55.756965] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T21:35:56.417965] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-13T21:35:57.228146] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-13T21:35:57.235112] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T21:35:57.264551] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T21:35:58.017967] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-13T21:35:58.181213] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T21:35:58.817946] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-13T21:35:59.329295] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T21:35:59.621348] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-13T21:35:59.625163] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T21:36:00.417954] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-13T21:36:00.473321] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T21:36:01.217946] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-13T21:36:01.940285] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T21:36:02.009278] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T21:36:02.017878] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-13T21:36:02.818881] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-13T21:36:02.823174] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T21:36:03.617975] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-13T21:36:03.691101] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T21:36:04.324166] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T21:36:04.326914] [INFO ] [REMOTE ] SOJD: Full fetch complete (19353 records). [2025-10-13T21:36:04.327017] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-13T21:36:04.423245] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-13T21:36:04.727794] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-13T21:36:04.727888] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-13T21:36:04.728486] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-13T21:36:04.728537] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-13T21:36:04.729161] [DEBUG] [LOCAL ] SOJD: Trimmed 19353 records to 12992 (keeping 200 days of data) [2025-10-13T21:36:04.809193] [DEBUG] [LOCAL ] SOJD: Primary data saved (12992 records). [2025-10-13T21:36:04.809342] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-13T21:36:04.809428] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJD took 26.3s. Estimated remaining: 57m 32s. Rate: 7.1 symbols/min [2025-10-13T21:36:04.985229] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:05.027871] [DEBUG] [LOCAL ] SON: Loaded 43771 existing records from primary storage. [2025-10-13T21:36:05.028210] [INFO ] [MAIN ] SON: Loaded 43771 existing records. [2025-10-13T21:36:05.204070] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:05.204313] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-13T21:36:05.204359] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-13T21:36:05.204829] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-13T21:36:05.204887] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-13T21:36:05.226339] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-13T21:36:05.325459] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T21:36:05.349151] [INFO ] [REMOTE ] SOL: Full fetch complete (21345 records). [2025-10-13T21:36:05.368747] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-13T21:36:05.914730] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:06.005445] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-13T21:36:06.005534] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-13T21:36:06.006276] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-13T21:36:06.006340] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-13T21:36:06.006967] [DEBUG] [LOCAL ] SOL: Trimmed 21345 records to 13166 (keeping 200 days of data) [2025-10-13T21:36:06.036394] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-13T21:36:06.087740] [DEBUG] [LOCAL ] SOL: Primary data saved (13166 records). [2025-10-13T21:36:06.087905] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-13T21:36:06.088025] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOL took 27.5s. Estimated remaining: 57m 22s. Rate: 7.1 symbols/min [2025-10-13T21:36:06.252091] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:06.303802] [DEBUG] [LOCAL ] SONY: Loaded 54146 existing records from primary storage. [2025-10-13T21:36:06.304179] [INFO ] [MAIN ] SONY: Loaded 54146 existing records. [2025-10-13T21:36:06.484863] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:06.485088] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-13T21:36:06.485136] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-13T21:36:06.485685] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-13T21:36:06.485759] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-13T21:36:06.830602] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-13T21:36:06.852356] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:06.880463] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T21:36:07.611412] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T21:36:07.617874] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-13T21:36:07.650617] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:36:08.265087] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T21:36:08.417918] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-13T21:36:09.217970] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-13T21:36:09.953763] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T21:36:10.017970] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-13T21:36:10.100875] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T21:36:10.522720] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T21:36:10.524454] [INFO ] [REMOTE ] SOJE: Full fetch complete (13750 records). [2025-10-13T21:36:10.524553] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-13T21:36:10.823054] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-13T21:36:10.898241] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-13T21:36:10.898350] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-13T21:36:10.899217] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-13T21:36:10.899442] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-13T21:36:10.900011] [DEBUG] [LOCAL ] SOJE: Trimmed 13750 records to 8970 (keeping 200 days of data) [2025-10-13T21:36:10.956429] [DEBUG] [LOCAL ] SOJE: Primary data saved (8970 records). [2025-10-13T21:36:10.956597] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-13T21:36:10.956708] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJE took 32.5s. Estimated remaining: 57m 13s. Rate: 7.1 symbols/min [2025-10-13T21:36:11.121600] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:11.127396] [DEBUG] [LOCAL ] SOR: Loaded 2933 existing records from primary storage. [2025-10-13T21:36:11.127567] [INFO ] [MAIN ] SOR: Loaded 2933 existing records. [2025-10-13T21:36:11.304313] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:11.304525] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-13T21:36:11.304569] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-13T21:36:11.304770] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-13T21:36:11.304826] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-13T21:36:11.623134] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-13T21:36:11.650984] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:12.418668] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-13T21:36:12.423234] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T21:36:12.523386] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T21:36:12.972926] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T21:36:13.217956] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-13T21:36:14.017968] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-13T21:36:14.817946] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-13T21:36:15.161142] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T21:36:15.333295] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T21:36:15.337724] [INFO ] [REMOTE ] SOLV: Full fetch complete (63361 records). [2025-10-13T21:36:15.337821] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-13T21:36:15.443259] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T21:36:15.623126] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-13T21:36:15.729056] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-13T21:36:15.729138] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-13T21:36:15.730121] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-13T21:36:15.730185] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-13T21:36:15.731933] [DEBUG] [LOCAL ] SOLV: Trimmed 63361 records to 43863 (keeping 200 days of data) [2025-10-13T21:36:15.987474] [DEBUG] [LOCAL ] SOLV: Primary data saved (43863 records). [2025-10-13T21:36:15.987607] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-13T21:36:15.987709] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOLV took 35.0s. Estimated remaining: 57m 4s. Rate: 7.1 symbols/min [2025-10-13T21:36:16.151303] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:16.162548] [DEBUG] [LOCAL ] SOS: Loaded 9331 existing records from primary storage. [2025-10-13T21:36:16.162735] [INFO ] [MAIN ] SOS: Loaded 9331 existing records. [2025-10-13T21:36:16.333959] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:16.334144] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-13T21:36:16.334188] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-13T21:36:16.334357] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-13T21:36:16.334394] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-13T21:36:16.423062] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-13T21:36:16.681980] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:16.937561] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T21:36:17.217974] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-13T21:36:17.606368] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T21:36:17.794708] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T21:36:18.017920] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-13T21:36:18.818000] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-13T21:36:19.468277] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T21:36:19.617908] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-13T21:36:20.235393] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-13T21:36:20.417889] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-13T21:36:20.654061] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:36:20.977892] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T21:36:21.217969] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-13T21:36:21.792010] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T21:36:22.017921] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-13T21:36:22.817939] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-13T21:36:23.617901] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-13T21:36:23.794388] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T21:36:24.425074] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-13T21:36:24.441867] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T21:36:24.745180] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T21:36:24.936386] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T21:36:25.217920] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-13T21:36:26.017965] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-13T21:36:26.683903] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T21:36:26.817981] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-13T21:36:27.139628] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T21:36:27.395781] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T21:36:27.617950] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-13T21:36:28.139246] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T21:36:28.417952] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-13T21:36:28.889628] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T21:36:29.217950] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-13T21:36:29.743503] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T21:36:30.017977] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-13T21:36:30.483285] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T21:36:30.484284] [INFO ] [REMOTE ] SOR: Full fetch complete (4416 records). [2025-10-13T21:36:30.484354] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-13T21:36:30.831172] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-13T21:36:30.824293] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-13T21:36:30.832030] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-13T21:36:30.832194] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-13T21:36:30.832248] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-13T21:36:30.832611] [DEBUG] [LOCAL ] SOR: Trimmed 4416 records to 2898 (keeping 200 days of data) [2025-10-13T21:36:30.850970] [DEBUG] [LOCAL ] SOR: Primary data saved (2898 records). [2025-10-13T21:36:30.851062] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-13T21:36:30.851140] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOR took 19.9s. Estimated remaining: 56m 57s. Rate: 7.1 symbols/min [2025-10-13T21:36:31.015751] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:31.052348] [DEBUG] [LOCAL ] SPB: Loaded 34631 existing records from primary storage. [2025-10-13T21:36:31.052622] [INFO ] [MAIN ] SPB: Loaded 34631 existing records. [2025-10-13T21:36:31.231439] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:31.231589] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-13T21:36:31.231637] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-13T21:36:31.232068] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-13T21:36:31.232125] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-13T21:36:31.585981] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:31.617879] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-13T21:36:32.417961] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-13T21:36:32.793811] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-13T21:36:32.794186] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T21:36:32.824348] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T21:36:33.217946] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-13T21:36:34.017954] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-13T21:36:34.639376] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T21:36:34.817967] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-13T21:36:35.241412] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T21:36:35.433863] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T21:36:35.617898] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-13T21:36:36.417969] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-13T21:36:36.691795] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T21:36:37.217917] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-13T21:36:37.938721] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T21:36:38.017895] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-13T21:36:38.817900] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-13T21:36:39.303754] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T21:36:39.372876] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T21:36:39.407162] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T21:36:39.617897] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-13T21:36:40.417903] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-13T21:36:40.688086] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T21:36:41.217917] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-13T21:36:42.017989] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-13T21:36:42.109856] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T21:36:42.219865] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T21:36:42.817919] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-13T21:36:43.617903] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-13T21:36:44.019177] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T21:36:44.367392] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:36:44.417881] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-13T21:36:44.580437] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T21:36:45.217922] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-13T21:36:46.010774] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T21:36:46.019806] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-13T21:36:46.817980] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-13T21:36:47.108504] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T21:36:47.286628] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T21:36:47.617982] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-13T21:36:48.248518] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T21:36:48.417951] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-13T21:36:49.054735] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T21:36:49.059439] [INFO ] [REMOTE ] SON: Full fetch complete (62488 records). [2025-10-13T21:36:49.059548] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-13T21:36:49.220574] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-13T21:36:49.452044] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-13T21:36:49.452129] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-13T21:36:49.453474] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-13T21:36:49.453538] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-13T21:36:49.454902] [DEBUG] [LOCAL ] SON: Trimmed 62488 records to 43217 (keeping 200 days of data) [2025-10-13T21:36:49.724618] [DEBUG] [LOCAL ] SON: Primary data saved (43217 records). [2025-10-13T21:36:49.724792] [INFO ] [MAIN ] SON: Full history saved. [2025-10-13T21:36:49.724877] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 44.9s. Estimated remaining: 56m 51s. Rate: 7.1 symbols/min [2025-10-13T21:36:49.894086] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:49.941923] [DEBUG] [LOCAL ] SPCE: Loaded 50706 existing records from primary storage. [2025-10-13T21:36:49.942314] [INFO ] [MAIN ] SPCE: Loaded 50706 existing records. [2025-10-13T21:36:50.020701] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-13T21:36:50.124723] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:50.125062] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-13T21:36:50.125225] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-13T21:36:50.126173] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-13T21:36:50.126232] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-13T21:36:50.289874] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T21:36:50.400452] [INFO ] [REMOTE ] SONY: Full fetch complete (77242 records). [2025-10-13T21:36:50.439766] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-13T21:36:50.584454] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:50.823160] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-13T21:36:50.906413] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T21:36:50.986022] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T21:36:51.018701] [INFO ] [REMOTE ] SOS: Full fetch complete (11230 records). [2025-10-13T21:36:51.037472] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-13T21:36:51.037636] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-13T21:36:51.038031] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-13T21:36:51.109936] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-13T21:36:51.121061] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-13T21:36:51.219503] [DEBUG] [LOCAL ] SONY: Trimmed 77242 records to 53374 (keeping 200 days of data) [2025-10-13T21:36:51.530041] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-13T21:36:51.539523] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-13T21:36:51.540144] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-13T21:36:51.540208] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-13T21:36:51.540788] [DEBUG] [LOCAL ] SOS: Trimmed 11230 records to 9365 (keeping 200 days of data) [2025-10-13T21:36:51.619198] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-13T21:36:51.741105] [DEBUG] [LOCAL ] SOS: Primary data saved (9365 records). [2025-10-13T21:36:51.744953] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-13T21:36:51.745080] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOS took 35.8s. Estimated remaining: 56m 41s. Rate: 7.1 symbols/min [2025-10-13T21:36:52.000231] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:52.017049] [DEBUG] [LOCAL ] SONY: Primary data saved (53374 records). [2025-10-13T21:36:52.017330] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-13T21:36:52.017437] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 45.9s. Estimated remaining: 56m 31s. Rate: 7.1 symbols/min [2025-10-13T21:36:52.098399] [DEBUG] [LOCAL ] SPE: Loaded 6369 existing records from primary storage. [2025-10-13T21:36:52.114441] [INFO ] [MAIN ] SPE: Loaded 6369 existing records. [2025-10-13T21:36:52.308237] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:36:52.396860] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:52.397226] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-13T21:36:52.397382] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-13T21:36:52.397710] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-13T21:36:52.397784] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-13T21:36:52.740498] [DEBUG] [LOCAL ] SPG: Loaded 50962 existing records from primary storage. [2025-10-13T21:36:52.754278] [INFO ] [MAIN ] SPG: Loaded 50962 existing records. [2025-10-13T21:36:52.945090] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:52.961515] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-13T21:36:53.065051] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:36:53.065528] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-13T21:36:53.065728] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-13T21:36:53.066501] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-13T21:36:53.066893] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-13T21:36:53.215733] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T21:36:53.346174] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-13T21:36:53.395305] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-13T21:36:53.512835] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:36:53.520676] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T21:36:54.017997] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-13T21:36:54.817985] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-13T21:36:54.905132] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T21:36:55.427810] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T21:36:55.577514] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T21:36:55.617962] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-13T21:36:56.405144] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T21:36:56.417887] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-13T21:36:57.159701] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T21:36:57.217978] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-13T21:36:58.017998] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-13T21:36:58.817911] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-13T21:36:59.268399] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T21:36:59.398537] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T21:36:59.617947] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-13T21:36:59.732106] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T21:37:00.230527] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T21:37:00.417910] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-13T21:37:01.154131] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T21:37:01.217887] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-13T21:37:01.964703] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T21:37:02.017886] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-13T21:37:02.633231] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T21:37:02.817982] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-13T21:37:03.617937] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-13T21:37:04.339010] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T21:37:04.417948] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-13T21:37:04.476515] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:37:05.218016] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-13T21:37:05.932539] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T21:37:06.017978] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-13T21:37:06.557602] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T21:37:06.558956] [INFO ] [REMOTE ] SPE: Full fetch complete (9880 records). [2025-10-13T21:37:06.559031] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-13T21:37:06.823241] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-13T21:37:06.959764] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-13T21:37:06.959924] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-13T21:37:06.960285] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-13T21:37:06.960435] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-13T21:37:06.961257] [DEBUG] [LOCAL ] SPE: Trimmed 9880 records to 6299 (keeping 200 days of data) [2025-10-13T21:37:07.003500] [DEBUG] [LOCAL ] SPE: Primary data saved (6299 records). [2025-10-13T21:37:07.003824] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-13T21:37:07.004072] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SPE took 15.3s. Estimated remaining: 56m 24s. Rate: 7.1 symbols/min [2025-10-13T21:37:07.184947] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T21:37:07.233378] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:07.282519] [DEBUG] [LOCAL ] SPGI: Loaded 46517 existing records from primary storage. [2025-10-13T21:37:07.283016] [INFO ] [MAIN ] SPGI: Loaded 46517 existing records. [2025-10-13T21:37:07.463415] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:07.463726] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-13T21:37:07.463788] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-13T21:37:07.464312] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-13T21:37:07.464370] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-13T21:37:07.620307] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-13T21:37:07.835401] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:08.202053] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T21:37:08.417908] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-13T21:37:09.217903] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-13T21:37:09.508272] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T21:37:09.511729] [INFO ] [REMOTE ] SPB: Full fetch complete (47629 records). [2025-10-13T21:37:09.511815] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-13T21:37:09.827982] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-13T21:37:09.926160] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-13T21:37:09.926243] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-13T21:37:09.927108] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-13T21:37:09.927180] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-13T21:37:09.928255] [DEBUG] [LOCAL ] SPB: Trimmed 47629 records to 34211 (keeping 200 days of data) [2025-10-13T21:37:10.019604] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-13T21:37:10.141955] [DEBUG] [LOCAL ] SPB: Primary data saved (34211 records). [2025-10-13T21:37:10.142097] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-13T21:37:10.142180] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 39.3s. Estimated remaining: 56m 14s. Rate: 7.1 symbols/min [2025-10-13T21:37:10.311851] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:10.334541] [DEBUG] [LOCAL ] SPH: Loaded 17100 existing records from primary storage. [2025-10-13T21:37:10.334812] [INFO ] [MAIN ] SPH: Loaded 17100 existing records. [2025-10-13T21:37:10.533722] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:10.533909] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-13T21:37:10.533955] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-13T21:37:10.534310] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-13T21:37:10.534369] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-13T21:37:10.820518] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-13T21:37:10.897037] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:10.928562] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T21:37:11.617904] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-13T21:37:11.663387] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T21:37:12.417973] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-13T21:37:12.889033] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T21:37:13.074785] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-13T21:37:13.217920] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-13T21:37:14.019410] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-13T21:37:14.025132] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T21:37:14.626379] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T21:37:14.817920] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-13T21:37:15.617900] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-13T21:37:16.108443] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T21:37:16.406176] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T21:37:16.417877] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-13T21:37:16.797318] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T21:37:17.217938] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-13T21:37:18.017910] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-13T21:37:18.296916] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T21:37:18.385045] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T21:37:18.817986] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-13T21:37:19.618232] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-13T21:37:19.768544] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T21:37:20.417981] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-13T21:37:20.561776] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T21:37:21.217942] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-13T21:37:21.471757] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T21:37:22.017936] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-13T21:37:22.359596] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T21:37:22.817900] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-13T21:37:22.937771] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T21:37:23.617972] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-13T21:37:23.933668] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T21:37:23.959684] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T21:37:24.417922] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-13T21:37:25.217945] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-13T21:37:25.356551] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:37:26.017952] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-13T21:37:26.231919] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T21:37:26.383751] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T21:37:26.817961] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-13T21:37:27.593973] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T21:37:27.617883] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-13T21:37:27.817510] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T21:37:28.417967] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-13T21:37:29.217907] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-13T21:37:29.437872] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T21:37:29.481273] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T21:37:30.018003] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-13T21:37:30.817993] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-13T21:37:30.997905] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T21:37:31.617951] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-13T21:37:31.779113] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T21:37:32.417948] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-13T21:37:32.589485] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:37:32.689890] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T21:37:32.695254] [INFO ] [REMOTE ] SPCE: Full fetch complete (72435 records). [2025-10-13T21:37:32.695412] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-13T21:37:33.078008] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-13T21:37:33.078115] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-13T21:37:33.079300] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-13T21:37:33.079364] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-13T21:37:33.080783] [DEBUG] [LOCAL ] SPCE: Trimmed 72435 records to 49958 (keeping 200 days of data) [2025-10-13T21:37:33.243698] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-13T21:37:33.375618] [DEBUG] [LOCAL ] SPCE: Primary data saved (49958 records). [2025-10-13T21:37:33.375796] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-13T21:37:33.375923] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 43.7s. Estimated remaining: 56m 9s. Rate: 7.1 symbols/min [2025-10-13T21:37:33.542267] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:33.582431] [DEBUG] [LOCAL ] SPHR: Loaded 41016 existing records from primary storage. [2025-10-13T21:37:33.582761] [INFO ] [MAIN ] SPHR: Loaded 41016 existing records. [2025-10-13T21:37:33.764840] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:33.765945] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-13T21:37:33.766006] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-13T21:37:33.767524] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-13T21:37:33.767598] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-13T21:37:34.018877] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-13T21:37:34.129417] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:34.159207] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:37:34.358915] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T21:37:34.818010] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-13T21:37:35.258586] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T21:37:35.265032] [INFO ] [REMOTE ] SPG: Full fetch complete (71920 records). [2025-10-13T21:37:35.265145] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-13T21:37:35.625414] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-13T21:37:35.648318] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-13T21:37:35.648394] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-13T21:37:35.649586] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-13T21:37:35.649690] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-13T21:37:35.652562] [DEBUG] [LOCAL ] SPG: Trimmed 71920 records to 50214 (keeping 200 days of data) [2025-10-13T21:37:35.975764] [DEBUG] [LOCAL ] SPG: Primary data saved (50214 records). [2025-10-13T21:37:35.975933] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-13T21:37:35.976034] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPG took 44.0s. Estimated remaining: 55m 59s. Rate: 7.1 symbols/min [2025-10-13T21:37:36.153925] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:36.199689] [DEBUG] [LOCAL ] SPIR: Loaded 37959 existing records from primary storage. [2025-10-13T21:37:36.200106] [INFO ] [MAIN ] SPIR: Loaded 37959 existing records. [2025-10-13T21:37:36.383537] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:36.384465] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-13T21:37:36.384888] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-13T21:37:36.385434] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-13T21:37:36.385494] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-13T21:37:36.418175] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-13T21:37:36.490156] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T21:37:36.574579] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:37:36.830619] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:37.218030] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-13T21:37:38.018051] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-13T21:37:38.172690] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:37:38.225941] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T21:37:38.759590] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T21:37:38.761626] [INFO ] [REMOTE ] SPH: Full fetch complete (27974 records). [2025-10-13T21:37:38.761743] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-13T21:37:38.825183] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-13T21:37:39.149346] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-13T21:37:39.149425] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-13T21:37:39.150161] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-13T21:37:39.150222] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-13T21:37:39.150950] [DEBUG] [LOCAL ] SPH: Trimmed 27974 records to 16823 (keeping 200 days of data) [2025-10-13T21:37:39.254392] [DEBUG] [LOCAL ] SPH: Primary data saved (16823 records). [2025-10-13T21:37:39.254534] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-13T21:37:39.254673] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPH took 29.1s. Estimated remaining: 55m 50s. Rate: 7.1 symbols/min [2025-10-13T21:37:39.424628] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:39.434422] [DEBUG] [LOCAL ] SPMC: Loaded 5393 existing records from primary storage. [2025-10-13T21:37:39.434629] [INFO ] [MAIN ] SPMC: Loaded 5393 existing records. [2025-10-13T21:37:39.618488] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-13T21:37:39.622711] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:39.624262] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-13T21:37:39.624326] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-13T21:37:39.624516] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-13T21:37:39.624573] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-13T21:37:40.067506] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:40.319900] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:37:40.418029] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-13T21:37:41.217982] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-13T21:37:41.632132] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T21:37:42.017983] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-13T21:37:42.217750] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T21:37:42.590987] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:37:42.597904] [INFO ] [REMOTE ] SPGI: Full fetch complete (67248 records). [2025-10-13T21:37:42.598181] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-13T21:37:42.823826] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-13T21:37:42.999011] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-13T21:37:42.999091] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-13T21:37:43.000118] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-13T21:37:43.000181] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-13T21:37:43.001516] [DEBUG] [LOCAL ] SPGI: Trimmed 67248 records to 45858 (keeping 200 days of data) [2025-10-13T21:37:43.295144] [DEBUG] [LOCAL ] SPGI: Primary data saved (45858 records). [2025-10-13T21:37:43.295277] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-13T21:37:43.295375] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 36.3s. Estimated remaining: 55m 40s. Rate: 7.1 symbols/min [2025-10-13T21:37:43.463024] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:43.463189] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-13T21:37:43.463227] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-13T21:37:43.463359] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-13T21:37:43.463402] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-13T21:37:43.463444] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-13T21:37:43.463476] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-13T21:37:43.618699] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-13T21:37:43.814823] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:44.328544] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T21:37:44.418028] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-13T21:37:44.418956] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T21:37:44.612297] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:37:44.612586] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-13T21:37:44.612698] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:37:44.612749] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-13T21:37:44.612809] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:37:44.612869] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-13T21:37:44.612947] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-13T21:37:44.612995] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-13T21:37:44.613056] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-13T21:37:44.613130] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPME took 1.3s. Estimated remaining: 55m 31s. Rate: 7.1 symbols/min [2025-10-13T21:37:44.807228] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:37:44.843855] [DEBUG] [LOCAL ] SPNT: Loaded 35122 existing records from primary storage. [2025-10-13T21:37:44.844119] [INFO ] [MAIN ] SPNT: Loaded 35122 existing records. [2025-10-13T21:37:45.015593] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:37:45.015828] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-13T21:37:45.015900] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-13T21:37:45.016296] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-13T21:37:45.016365] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-13T21:37:45.223211] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-13T21:37:45.370057] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:37:46.017912] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-13T21:37:46.780330] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T21:37:46.817882] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-13T21:37:47.412632] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T21:37:47.618043] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-13T21:37:48.196486] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T21:37:48.417998] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-13T21:37:49.217989] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-13T21:37:49.553507] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T21:37:49.663471] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T21:37:50.018002] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-13T21:37:50.777881] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T21:37:50.817876] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-13T21:37:51.504452] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (4.69 seconds). [2025-10-13T21:37:51.524445] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T21:37:51.617881] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-13T21:37:52.417953] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-13T21:37:53.123911] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:37:53.217896] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-13T21:37:53.502720] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T21:37:54.017921] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-13T21:37:54.685112] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T21:37:54.817890] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-13T21:37:55.031022] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T21:37:55.617895] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-13T21:37:56.239945] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T21:37:56.417892] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-13T21:37:57.056976] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:37:57.217920] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-13T21:37:58.013743] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T21:37:58.021072] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-13T21:37:58.184580] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:37:58.344870] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (17.93 seconds). [2025-10-13T21:37:58.643941] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T21:37:58.817946] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-13T21:37:59.617961] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-13T21:38:00.418026] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-13T21:38:00.555198] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T21:38:00.777827] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T21:38:01.218017] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-13T21:38:01.502524] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T21:38:02.017984] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-13T21:38:02.672143] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T21:38:02.677050] [INFO ] [REMOTE ] SPIR: Full fetch complete (53575 records). [2025-10-13T21:38:02.677203] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-13T21:38:02.823227] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-13T21:38:03.082378] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-13T21:38:03.082489] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-13T21:38:03.083889] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-13T21:38:03.083957] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-13T21:38:03.085459] [DEBUG] [LOCAL ] SPIR: Trimmed 53575 records to 37521 (keeping 200 days of data) [2025-10-13T21:38:03.331862] [DEBUG] [LOCAL ] SPIR: Primary data saved (37521 records). [2025-10-13T21:38:03.332076] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-13T21:38:03.332202] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPIR took 27.4s. Estimated remaining: 55m 24s. Rate: 7.1 symbols/min [2025-10-13T21:38:03.507600] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:03.567151] [DEBUG] [LOCAL ] SPOT: Loaded 51195 existing records from primary storage. [2025-10-13T21:38:03.567670] [INFO ] [MAIN ] SPOT: Loaded 51195 existing records. [2025-10-13T21:38:03.623184] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-13T21:38:03.754866] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:03.755141] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-13T21:38:03.755200] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-13T21:38:03.755862] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-13T21:38:03.755928] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-13T21:38:04.054555] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T21:38:04.140467] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:04.402980] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-13T21:38:04.417972] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-13T21:38:05.217916] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-13T21:38:05.261966] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:38:05.828235] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T21:38:06.017996] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-13T21:38:06.348101] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T21:38:06.818036] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-13T21:38:07.459151] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T21:38:07.527227] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T21:38:07.617960] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-13T21:38:08.042504] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-13T21:38:08.417990] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-13T21:38:09.218007] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-13T21:38:09.709764] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:38:09.711033] [INFO ] [REMOTE ] SPMC: Full fetch complete (8098 records). [2025-10-13T21:38:09.711104] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-13T21:38:10.023503] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-13T21:38:10.105078] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-13T21:38:10.105237] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-13T21:38:10.105618] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-13T21:38:10.105766] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-13T21:38:10.106448] [DEBUG] [LOCAL ] SPMC: Trimmed 8098 records to 5287 (keeping 200 days of data) [2025-10-13T21:38:10.162115] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T21:38:10.181212] [DEBUG] [LOCAL ] SPMC: Primary data saved (5287 records). [2025-10-13T21:38:10.181354] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-13T21:38:10.181449] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 30.9s. Estimated remaining: 55m 15s. Rate: 7.1 symbols/min [2025-10-13T21:38:10.356597] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:10.402307] [DEBUG] [LOCAL ] SPR: Loaded 41702 existing records from primary storage. [2025-10-13T21:38:10.402704] [INFO ] [MAIN ] SPR: Loaded 41702 existing records. [2025-10-13T21:38:10.604188] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:10.604538] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-13T21:38:10.604589] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-13T21:38:10.604886] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-13T21:38:10.604946] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-13T21:38:10.824631] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-13T21:38:11.013623] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:11.580729] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T21:38:11.617981] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-13T21:38:12.418009] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-13T21:38:12.952409] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-13T21:38:12.982053] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T21:38:13.217945] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-13T21:38:13.586510] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T21:38:13.590204] [INFO ] [REMOTE ] SPNT: Full fetch complete (48700 records). [2025-10-13T21:38:13.590353] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-13T21:38:13.969678] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-13T21:38:13.969761] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-13T21:38:13.970678] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-13T21:38:13.970743] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-13T21:38:13.971907] [DEBUG] [LOCAL ] SPNT: Trimmed 48700 records to 34731 (keeping 200 days of data) [2025-10-13T21:38:14.018405] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-13T21:38:14.175807] [DEBUG] [LOCAL ] SPNT: Primary data saved (34731 records). [2025-10-13T21:38:14.175955] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-13T21:38:14.176044] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPNT took 29.6s. Estimated remaining: 55m 6s. Rate: 7.1 symbols/min [2025-10-13T21:38:14.341455] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:14.352448] [DEBUG] [LOCAL ] SPRU: Loaded 9717 existing records from primary storage. [2025-10-13T21:38:14.352628] [INFO ] [MAIN ] SPRU: Loaded 9717 existing records. [2025-10-13T21:38:14.527677] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:14.528010] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-13T21:38:14.528100] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-13T21:38:14.528381] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-13T21:38:14.528438] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-13T21:38:14.826110] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-13T21:38:14.829325] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T21:38:14.915146] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:15.622035] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-13T21:38:15.624517] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T21:38:16.417942] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-13T21:38:17.217957] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-13T21:38:17.637424] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-10-13T21:38:17.904900] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-13T21:38:17.958181] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T21:38:18.017910] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-13T21:38:18.583676] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T21:38:18.817949] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-13T21:38:19.605924] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T21:38:19.617896] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-13T21:38:20.417922] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-13T21:38:21.169875] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T21:38:21.206854] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T21:38:21.217883] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-13T21:38:21.844077] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:38:22.017920] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-13T21:38:22.817898] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-13T21:38:23.486767] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T21:38:23.617904] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-13T21:38:23.650046] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-13T21:38:23.698783] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:38:24.417948] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-13T21:38:25.145287] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:38:25.150091] [INFO ] [REMOTE ] SPHR: Full fetch complete (58188 records). [2025-10-13T21:38:25.150181] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-13T21:38:25.223095] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-13T21:38:25.531199] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-13T21:38:25.531284] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-13T21:38:25.532275] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-13T21:38:25.532339] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-13T21:38:25.533699] [DEBUG] [LOCAL ] SPHR: Trimmed 58188 records to 40430 (keeping 200 days of data) [2025-10-13T21:38:25.770929] [DEBUG] [LOCAL ] SPHR: Primary data saved (40430 records). [2025-10-13T21:38:25.771094] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-13T21:38:25.771262] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPHR took 52.4s. Estimated remaining: 54m 58s. Rate: 7.1 symbols/min [2025-10-13T21:38:25.872762] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T21:38:25.954522] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:25.954812] [DEBUG] [LOCAL ] SPXC: No existing data file found in primary storage. [2025-10-13T21:38:25.954858] [WARN ] [MAIN ] SPXC: No existing data found, performing full refresh instead. [2025-10-13T21:38:25.954983] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-13T21:38:25.955024] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-13T21:38:25.955065] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-13T21:38:25.955097] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-13T21:38:26.027887] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-13T21:38:26.327559] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:26.674426] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T21:38:26.683018] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T21:38:26.817967] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-13T21:38:27.618017] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-13T21:38:28.417918] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-13T21:38:28.714275] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T21:38:28.952554] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T21:38:29.154815] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T21:38:29.217900] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-13T21:38:30.017902] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-13T21:38:30.174870] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T21:38:30.817964] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-13T21:38:31.232969] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T21:38:31.617950] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-13T21:38:32.199736] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T21:38:32.417948] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-13T21:38:33.029070] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T21:38:33.181887] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-13T21:38:33.217983] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-13T21:38:34.017971] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-13T21:38:34.817919] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-13T21:38:35.260930] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T21:38:35.428616] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-13T21:38:35.617980] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-13T21:38:36.421091] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-13T21:38:36.427236] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T21:38:37.217897] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-13T21:38:37.523119] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T21:38:37.572171] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T21:38:38.018008] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-13T21:38:38.406187] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T21:38:38.818015] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-13T21:38:39.617902] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-13T21:38:39.719573] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T21:38:39.881955] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T21:38:39.887833] [INFO ] [REMOTE ] SPOT: Full fetch complete (73629 records). [2025-10-13T21:38:39.888123] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-13T21:38:40.291008] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-13T21:38:40.291115] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-13T21:38:40.292497] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-13T21:38:40.292562] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-13T21:38:40.294075] [DEBUG] [LOCAL ] SPOT: Trimmed 73629 records to 50402 (keeping 200 days of data) [2025-10-13T21:38:40.418013] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-13T21:38:40.619995] [DEBUG] [LOCAL ] SPOT: Primary data saved (50402 records). [2025-10-13T21:38:40.620137] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-13T21:38:40.620218] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPOT took 37.3s. Estimated remaining: 54m 51s. Rate: 7.1 symbols/min [2025-10-13T21:38:40.795897] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:40.808427] [DEBUG] [LOCAL ] SPXX: Loaded 9640 existing records from primary storage. [2025-10-13T21:38:40.808716] [INFO ] [MAIN ] SPXX: Loaded 9640 existing records. [2025-10-13T21:38:40.999629] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:41.016487] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T21:38:41.015964] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-13T21:38:41.022129] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-13T21:38:41.022969] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-13T21:38:41.023029] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-13T21:38:41.222218] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-13T21:38:41.387114] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T21:38:41.399676] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:41.401766] [INFO ] [REMOTE ] SPRU: Full fetch complete (12040 records). [2025-10-13T21:38:41.402068] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-13T21:38:41.761977] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-13T21:38:41.762059] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-13T21:38:41.762393] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-13T21:38:41.762433] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-13T21:38:41.762975] [DEBUG] [LOCAL ] SPRU: Trimmed 12040 records to 9703 (keeping 200 days of data) [2025-10-13T21:38:41.821886] [DEBUG] [LOCAL ] SPRU: Primary data saved (9703 records). [2025-10-13T21:38:41.822035] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-13T21:38:41.822123] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 27.6s. Estimated remaining: 54m 41s. Rate: 7.1 symbols/min [2025-10-13T21:38:41.993217] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:42.018000] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-13T21:38:42.038886] [DEBUG] [LOCAL ] SQM: Loaded 49402 existing records from primary storage. [2025-10-13T21:38:42.039195] [INFO ] [MAIN ] SQM: Loaded 49402 existing records. [2025-10-13T21:38:42.220331] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:42.220797] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-13T21:38:42.220989] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-13T21:38:42.226877] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-13T21:38:42.230149] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-13T21:38:42.280874] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T21:38:42.598086] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:42.817995] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-13T21:38:43.445246] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T21:38:43.617953] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-13T21:38:44.417898] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-13T21:38:44.509382] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:38:44.709839] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T21:38:45.112402] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T21:38:45.217988] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-13T21:38:46.017986] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-13T21:38:46.757992] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T21:38:46.817947] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-13T21:38:47.524608] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T21:38:47.617898] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-13T21:38:48.340413] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T21:38:48.417958] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-13T21:38:49.084343] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T21:38:49.110691] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:38:49.217899] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-13T21:38:50.017923] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-13T21:38:50.804049] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T21:38:50.817879] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-13T21:38:50.861421] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T21:38:51.617965] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-13T21:38:52.182925] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T21:38:52.188327] [INFO ] [REMOTE ] SPR: Full fetch complete (60043 records). [2025-10-13T21:38:52.188558] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-13T21:38:52.423704] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-13T21:38:52.579509] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-13T21:38:52.579605] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-13T21:38:52.580727] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-13T21:38:52.580791] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-13T21:38:52.582068] [DEBUG] [LOCAL ] SPR: Trimmed 60043 records to 41105 (keeping 200 days of data) [2025-10-13T21:38:52.826999] [DEBUG] [LOCAL ] SPR: Primary data saved (41105 records). [2025-10-13T21:38:52.827130] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-13T21:38:52.827208] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPR took 42.6s. Estimated remaining: 54m 33s. Rate: 7.1 symbols/min [2025-10-13T21:38:53.001276] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:53.027885] [DEBUG] [LOCAL ] SQNS: Loaded 27421 existing records from primary storage. [2025-10-13T21:38:53.028509] [INFO ] [MAIN ] SQNS: Loaded 27421 existing records. [2025-10-13T21:38:53.212669] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:53.213049] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-13T21:38:53.213105] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-13T21:38:53.213301] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-13T21:38:53.213341] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-13T21:38:53.224700] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-13T21:38:53.617604] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:53.623628] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T21:38:53.664913] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T21:38:53.745773] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T21:38:54.017921] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-13T21:38:54.817920] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-13T21:38:55.617912] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-13T21:38:55.644502] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T21:38:55.789872] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:38:56.417905] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-13T21:38:56.497997] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T21:38:57.217963] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-13T21:38:57.811398] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T21:38:58.017985] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-13T21:38:58.221984] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T21:38:58.224812] [INFO ] [REMOTE ] SPXC: Full fetch complete (33959 records). [2025-10-13T21:38:58.224888] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-13T21:38:58.624251] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-13T21:38:58.624333] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-13T21:38:58.625155] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-13T21:38:58.625216] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-13T21:38:58.626123] [DEBUG] [LOCAL ] SPXC: Trimmed 33959 records to 23394 (keeping 200 days of data) [2025-10-13T21:38:58.775168] [DEBUG] [LOCAL ] SPXC: Primary data saved (23394 records). [2025-10-13T21:38:58.775314] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-13T21:38:58.775405] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPXC took 33.0s. Estimated remaining: 54m 24s. Rate: 7.1 symbols/min [2025-10-13T21:38:58.818707] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-13T21:38:58.908832] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T21:38:58.972595] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:38:59.011451] [DEBUG] [LOCAL ] SR: Loaded 33009 existing records from primary storage. [2025-10-13T21:38:59.011902] [INFO ] [MAIN ] SR: Loaded 33009 existing records. [2025-10-13T21:38:59.198875] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:38:59.199199] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-13T21:38:59.199251] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-13T21:38:59.199717] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-13T21:38:59.199777] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-13T21:38:59.592284] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:38:59.602810] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T21:38:59.617909] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-13T21:39:00.418002] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-13T21:39:00.916818] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T21:39:01.217903] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-13T21:39:01.277978] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T21:39:02.017960] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-13T21:39:02.275012] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T21:39:02.817977] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-13T21:39:03.617899] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-13T21:39:03.729080] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T21:39:03.756817] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T21:39:04.417996] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-13T21:39:04.558186] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T21:39:05.217972] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-13T21:39:05.965044] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T21:39:06.017910] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-13T21:39:06.162013] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T21:39:06.665134] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T21:39:06.817984] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-13T21:39:07.617997] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-13T21:39:08.244090] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T21:39:08.417910] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-13T21:39:08.561509] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:39:08.863238] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T21:39:09.217969] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-13T21:39:09.865818] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T21:39:10.017914] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-13T21:39:10.817906] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-13T21:39:10.828819] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T21:39:11.563213] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T21:39:11.617996] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-13T21:39:12.418006] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-13T21:39:12.510070] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T21:39:12.512289] [INFO ] [REMOTE ] SPXX: Full fetch complete (13397 records). [2025-10-13T21:39:12.512374] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-13T21:39:12.864541] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-13T21:39:12.864622] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-13T21:39:12.865016] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-13T21:39:12.865070] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-13T21:39:12.865566] [DEBUG] [LOCAL ] SPXX: Trimmed 13397 records to 9471 (keeping 200 days of data) [2025-10-13T21:39:12.928346] [DEBUG] [LOCAL ] SPXX: Primary data saved (9471 records). [2025-10-13T21:39:12.928635] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-13T21:39:12.928757] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 32.3s. Estimated remaining: 54m 17s. Rate: 7.1 symbols/min [2025-10-13T21:39:13.066255] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T21:39:13.115862] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:13.168945] [DEBUG] [LOCAL ] SRE: Loaded 54194 existing records from primary storage. [2025-10-13T21:39:13.169304] [INFO ] [MAIN ] SRE: Loaded 54194 existing records. [2025-10-13T21:39:13.223407] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-13T21:39:13.348790] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:39:13.349048] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-13T21:39:13.349108] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-13T21:39:13.349808] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-13T21:39:13.349865] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-13T21:39:13.697247] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:14.017966] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-13T21:39:14.541963] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T21:39:14.817921] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-13T21:39:15.617951] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-13T21:39:15.801216] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:39:16.205893] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T21:39:16.418034] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-13T21:39:17.217887] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-13T21:39:17.330985] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:39:18.016731] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T21:39:18.026978] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-13T21:39:18.185689] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T21:39:18.817964] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-13T21:39:19.558777] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:39:19.566956] [INFO ] [REMOTE ] SQM: Full fetch complete (69260 records). [2025-10-13T21:39:19.567270] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-13T21:39:19.626601] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-13T21:39:19.999348] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-13T21:39:19.999462] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-13T21:39:20.001138] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-13T21:39:20.001211] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-13T21:39:20.003141] [DEBUG] [LOCAL ] SQM: Trimmed 69260 records to 48733 (keeping 200 days of data) [2025-10-13T21:39:20.307770] [DEBUG] [LOCAL ] SQM: Primary data saved (48733 records). [2025-10-13T21:39:20.308098] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-13T21:39:20.308370] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SQM took 38.5s. Estimated remaining: 54m 8s. Rate: 7.1 symbols/min [2025-10-13T21:39:20.423195] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-13T21:39:20.491494] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:20.504874] [DEBUG] [LOCAL ] SREA: Loaded 10327 existing records from primary storage. [2025-10-13T21:39:20.505752] [INFO ] [MAIN ] SREA: Loaded 10327 existing records. [2025-10-13T21:39:20.696019] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:39:20.696325] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-13T21:39:20.696481] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-13T21:39:20.696858] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-13T21:39:20.696975] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-13T21:39:20.888914] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T21:39:21.118733] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:21.217959] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-13T21:39:21.850093] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T21:39:21.966967] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T21:39:21.969668] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-13T21:39:22.017907] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-13T21:39:22.817960] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-13T21:39:23.618023] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-13T21:39:23.911006] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T21:39:23.975099] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:39:24.418012] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-13T21:39:24.496980] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T21:39:25.218020] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-13T21:39:25.996697] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T21:39:26.017969] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-13T21:39:26.259552] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:39:26.817954] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-13T21:39:27.589814] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:39:27.617962] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-13T21:39:28.388257] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T21:39:28.417879] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-13T21:39:28.520103] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T21:39:29.217972] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-13T21:39:30.017917] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-13T21:39:30.285304] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T21:39:30.317985] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T21:39:30.321243] [INFO ] [REMOTE ] SQNS: Full fetch complete (32896 records). [2025-10-13T21:39:30.321385] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-13T21:39:30.708290] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-13T21:39:30.708784] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-13T21:39:30.709783] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-13T21:39:30.709845] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-13T21:39:30.711065] [DEBUG] [LOCAL ] SQNS: Trimmed 32896 records to 27343 (keeping 200 days of data) [2025-10-13T21:39:30.818005] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-13T21:39:30.886483] [DEBUG] [LOCAL ] SQNS: Primary data saved (27343 records). [2025-10-13T21:39:30.886697] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-13T21:39:30.886832] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 38.1s. Estimated remaining: 54m 0s. Rate: 7.1 symbols/min [2025-10-13T21:39:31.070700] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:31.111246] [DEBUG] [LOCAL ] SRFM: Loaded 38604 existing records from primary storage. [2025-10-13T21:39:31.111694] [INFO ] [MAIN ] SRFM: Loaded 38604 existing records. [2025-10-13T21:39:31.309767] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:39:31.310099] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-13T21:39:31.310280] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-13T21:39:31.319766] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-13T21:39:31.333280] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-13T21:39:31.368009] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T21:39:31.624319] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-13T21:39:31.719579] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:31.734213] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T21:39:32.417974] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-13T21:39:33.040006] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T21:39:33.218007] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-13T21:39:33.253247] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T21:39:34.017967] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-13T21:39:34.817993] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-13T21:39:34.928507] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T21:39:35.455379] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T21:39:35.545036] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T21:39:35.617969] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-13T21:39:36.418017] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-13T21:39:37.067590] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T21:39:37.217974] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-13T21:39:37.498234] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T21:39:38.017983] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-13T21:39:38.051562] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T21:39:38.817968] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-13T21:39:39.617983] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-13T21:39:39.750974] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T21:39:39.754494] [INFO ] [REMOTE ] SR: Full fetch complete (46027 records). [2025-10-13T21:39:39.754623] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-13T21:39:40.197125] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-13T21:39:40.197282] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-13T21:39:40.198868] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-13T21:39:40.199005] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-13T21:39:40.205560] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-13T21:39:40.205769] [DEBUG] [LOCAL ] SR: Trimmed 46027 records to 32486 (keeping 200 days of data) [2025-10-13T21:39:40.418813] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-13T21:39:40.447441] [DEBUG] [LOCAL ] SR: Primary data saved (32486 records). [2025-10-13T21:39:40.447672] [INFO ] [MAIN ] SR: Full history saved. [2025-10-13T21:39:40.447814] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SR took 41.7s. Estimated remaining: 53m 52s. Rate: 7.1 symbols/min [2025-10-13T21:39:40.654172] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:40.671415] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T21:39:40.690865] [DEBUG] [LOCAL ] SRG: Loaded 15543 existing records from primary storage. [2025-10-13T21:39:40.691175] [INFO ] [MAIN ] SRG: Loaded 15543 existing records. [2025-10-13T21:39:40.886019] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:39:40.886313] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-13T21:39:40.886365] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-13T21:39:40.886704] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-13T21:39:40.886765] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-13T21:39:41.223079] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-13T21:39:41.267718] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:42.017980] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-13T21:39:42.234296] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T21:39:42.492131] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T21:39:42.817968] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-13T21:39:43.157556] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T21:39:43.622137] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-13T21:39:43.626381] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T21:39:44.418042] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-13T21:39:44.581810] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T21:39:44.921482] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T21:39:45.218018] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-13T21:39:46.017988] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-13T21:39:46.162598] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T21:39:46.622617] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T21:39:46.624309] [INFO ] [REMOTE ] SREA: Full fetch complete (15274 records). [2025-10-13T21:39:46.624383] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-13T21:39:46.823051] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-13T21:39:47.003898] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-13T21:39:47.004114] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-13T21:39:47.004547] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-13T21:39:47.004591] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-13T21:39:47.005448] [DEBUG] [LOCAL ] SREA: Trimmed 15274 records to 10147 (keeping 200 days of data) [2025-10-13T21:39:47.079522] [DEBUG] [LOCAL ] SREA: Primary data saved (10147 records). [2025-10-13T21:39:47.079732] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-13T21:39:47.079844] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SREA took 26.8s. Estimated remaining: 53m 43s. Rate: 7.1 symbols/min [2025-10-13T21:39:47.254107] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:47.282039] [DEBUG] [LOCAL ] SRI: Loaded 26976 existing records from primary storage. [2025-10-13T21:39:47.282355] [INFO ] [MAIN ] SRI: Loaded 26976 existing records. [2025-10-13T21:39:47.469863] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:39:47.470165] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-13T21:39:47.470219] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-13T21:39:47.470589] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-13T21:39:47.470679] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-13T21:39:47.626529] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-13T21:39:47.845518] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:48.003859] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T21:39:48.417987] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-13T21:39:49.217988] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-13T21:39:49.559338] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T21:39:49.824499] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T21:39:49.921435] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T21:39:50.017965] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-13T21:39:50.817951] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-13T21:39:50.967021] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T21:39:51.617910] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-13T21:39:51.982294] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T21:39:52.417982] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-13T21:39:52.725691] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T21:39:53.144119] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T21:39:53.217967] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-13T21:39:53.909464] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T21:39:54.017994] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-13T21:39:54.818050] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-13T21:39:55.307752] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T21:39:55.617978] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-13T21:39:56.417964] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-13T21:39:56.440190] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T21:39:56.649445] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T21:39:57.217969] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-13T21:39:57.813911] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:39:57.819622] [INFO ] [REMOTE ] SRE: Full fetch complete (77302 records). [2025-10-13T21:39:57.819837] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-13T21:39:58.023071] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-13T21:39:58.232981] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-13T21:39:58.233200] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-13T21:39:58.234922] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-13T21:39:58.235040] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-13T21:39:58.237158] [DEBUG] [LOCAL ] SRE: Trimmed 77302 records to 53415 (keeping 200 days of data) [2025-10-13T21:39:58.375380] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T21:39:58.627384] [DEBUG] [LOCAL ] SRE: Primary data saved (53415 records). [2025-10-13T21:39:58.627572] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-13T21:39:58.627728] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRE took 45.7s. Estimated remaining: 53m 36s. Rate: 7.1 symbols/min [2025-10-13T21:39:58.799063] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:39:58.799264] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-13T21:39:58.799303] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-13T21:39:58.799446] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-13T21:39:58.799487] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-13T21:39:58.799527] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-13T21:39:58.799559] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-13T21:39:58.829598] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-13T21:39:59.133621] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T21:39:59.192464] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:39:59.617974] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-13T21:40:00.218010] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-13T21:40:00.418004] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-13T21:40:01.217906] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-13T21:40:01.475267] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-13T21:40:01.601954] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T21:40:01.614941] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T21:40:02.018002] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-13T21:40:02.475622] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T21:40:02.817960] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-13T21:40:03.617990] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-13T21:40:03.981159] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-13T21:40:04.036557] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T21:40:04.417964] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-13T21:40:04.800360] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T21:40:05.217968] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-13T21:40:06.017917] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-13T21:40:06.453517] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T21:40:06.817986] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-13T21:40:07.296607] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T21:40:07.617974] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-13T21:40:08.199884] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T21:40:08.418035] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-13T21:40:08.979310] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T21:40:09.217982] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-13T21:40:09.383381] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T21:40:10.018043] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-13T21:40:10.713126] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:40:10.715975] [INFO ] [REMOTE ] SRG: Full fetch complete (23516 records). [2025-10-13T21:40:10.716947] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-13T21:40:10.821482] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-13T21:40:11.147159] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-13T21:40:11.150526] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T21:40:11.150426] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-13T21:40:11.151481] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-13T21:40:11.152996] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-13T21:40:11.154161] [DEBUG] [LOCAL ] SRG: Trimmed 23516 records to 15360 (keeping 200 days of data) [2025-10-13T21:40:11.256759] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T21:40:11.295056] [DEBUG] [LOCAL ] SRG: Primary data saved (15360 records). [2025-10-13T21:40:11.295765] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-13T21:40:11.295884] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRG took 30.8s. Estimated remaining: 53m 28s. Rate: 7.1 symbols/min [2025-10-13T21:40:11.470927] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:11.482277] [DEBUG] [LOCAL ] SRV: Loaded 7459 existing records from primary storage. [2025-10-13T21:40:11.482557] [INFO ] [MAIN ] SRV: Loaded 7459 existing records. [2025-10-13T21:40:11.624013] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-13T21:40:11.667880] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:11.668489] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-13T21:40:11.668543] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-13T21:40:11.668814] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-13T21:40:11.668875] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-13T21:40:12.043437] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:12.193702] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T21:40:12.418058] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-13T21:40:13.019300] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-13T21:40:13.217992] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-13T21:40:13.589447] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T21:40:14.017985] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-13T21:40:14.817997] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-13T21:40:14.881797] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T21:40:15.618034] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-13T21:40:16.073082] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T21:40:16.358077] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T21:40:16.417999] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-13T21:40:16.789857] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T21:40:17.217963] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-13T21:40:18.017917] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-13T21:40:18.090527] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T21:40:18.818000] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-13T21:40:19.617945] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-13T21:40:19.790210] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T21:40:19.795921] [INFO ] [REMOTE ] SRFM: Full fetch complete (50527 records). [2025-10-13T21:40:19.796066] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-13T21:40:20.048117] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T21:40:20.222009] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-13T21:40:20.222120] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-13T21:40:20.223323] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-13T21:40:20.223388] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-13T21:40:20.224919] [DEBUG] [LOCAL ] SRFM: Trimmed 50527 records to 38550 (keeping 200 days of data) [2025-10-13T21:40:20.431725] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-13T21:40:20.451204] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T21:40:20.479505] [DEBUG] [LOCAL ] SRFM: Primary data saved (38550 records). [2025-10-13T21:40:20.479704] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-13T21:40:20.479830] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 49.6s. Estimated remaining: 53m 20s. Rate: 7.1 symbols/min [2025-10-13T21:40:20.648894] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:20.692471] [DEBUG] [LOCAL ] SSB: Loaded 43219 existing records from primary storage. [2025-10-13T21:40:20.692797] [INFO ] [MAIN ] SSB: Loaded 43219 existing records. [2025-10-13T21:40:20.871465] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:20.871707] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-13T21:40:20.871763] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-13T21:40:20.872224] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-13T21:40:20.872290] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-13T21:40:21.218337] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-13T21:40:21.246828] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:21.426032] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T21:40:21.428775] [INFO ] [REMOTE ] SRI: Full fetch complete (40370 records). [2025-10-13T21:40:21.428855] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-13T21:40:21.553812] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T21:40:21.587767] [INFO ] [REMOTE ] SRL: Full fetch complete (1960 records). [2025-10-13T21:40:21.616079] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-13T21:40:22.021159] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-13T21:40:22.044812] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-13T21:40:22.032903] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T21:40:22.045105] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:40:22.045195] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-13T21:40:22.046766] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:40:22.046479] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-13T21:40:22.046981] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-13T21:40:22.047334] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-13T21:40:22.047505] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-13T21:40:22.047998] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-13T21:40:22.048072] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-13T21:40:22.048152] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRL took 23.4s. Estimated remaining: 53m 10s. Rate: 7.1 symbols/min [2025-10-13T21:40:22.147125] [DEBUG] [LOCAL ] SRI: Trimmed 40370 records to 26555 (keeping 200 days of data) [2025-10-13T21:40:22.330490] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:22.407857] [DEBUG] [LOCAL ] SRI: Primary data saved (26555 records). [2025-10-13T21:40:22.408237] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-13T21:40:22.408336] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 35.3s. Estimated remaining: 52m 60s. Rate: 7.1 symbols/min [2025-10-13T21:40:22.519586] [DEBUG] [LOCAL ] SSD: Loaded 22766 existing records from primary storage. [2025-10-13T21:40:22.526719] [INFO ] [MAIN ] SSD: Loaded 22766 existing records. [2025-10-13T21:40:22.699999] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:22.844075] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:22.826610] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-13T21:40:22.844731] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-13T21:40:22.844827] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-13T21:40:22.846098] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-13T21:40:22.846178] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-13T21:40:22.984471] [DEBUG] [LOCAL ] SSL: Loaded 41966 existing records from primary storage. [2025-10-13T21:40:23.014987] [INFO ] [MAIN ] SSL: Loaded 41966 existing records. [2025-10-13T21:40:23.431795] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:23.442886] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-13T21:40:23.461536] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-13T21:40:23.467727] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-13T21:40:23.467629] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:23.468133] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-13T21:40:23.636511] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-13T21:40:23.682428] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T21:40:23.916135] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:23.928535] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T21:40:24.417972] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-13T21:40:24.817608] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T21:40:25.217991] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-13T21:40:25.385195] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T21:40:26.017902] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-13T21:40:26.346501] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T21:40:26.780762] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T21:40:26.817897] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-13T21:40:27.617915] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-13T21:40:27.948220] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T21:40:28.418009] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-13T21:40:29.223040] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-13T21:40:29.240104] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:40:30.017979] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-13T21:40:30.103154] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:40:30.208059] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T21:40:30.498128] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T21:40:30.818064] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-13T21:40:31.617913] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-13T21:40:32.417994] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-13T21:40:32.483709] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:40:32.689385] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T21:40:33.150518] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T21:40:33.217996] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-13T21:40:34.017988] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-13T21:40:34.623841] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:40:34.818028] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-13T21:40:35.168947] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T21:40:35.617997] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-13T21:40:36.020573] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T21:40:36.246738] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:40:36.248344] [INFO ] [REMOTE ] SRV: Full fetch complete (11370 records). [2025-10-13T21:40:36.248455] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-13T21:40:36.417979] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-13T21:40:36.630791] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-13T21:40:36.630905] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-13T21:40:36.631303] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-13T21:40:36.631350] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-13T21:40:36.631909] [DEBUG] [LOCAL ] SRV: Trimmed 11370 records to 7381 (keeping 200 days of data) [2025-10-13T21:40:36.679808] [DEBUG] [LOCAL ] SRV: Primary data saved (7381 records). [2025-10-13T21:40:36.679996] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-13T21:40:36.680103] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 25.4s. Estimated remaining: 52m 53s. Rate: 7.1 symbols/min [2025-10-13T21:40:36.856347] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:36.870547] [DEBUG] [LOCAL ] SST: Loaded 11805 existing records from primary storage. [2025-10-13T21:40:36.870853] [INFO ] [MAIN ] SST: Loaded 11805 existing records. [2025-10-13T21:40:37.049860] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:37.050233] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-13T21:40:37.050293] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-13T21:40:37.050610] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-13T21:40:37.050712] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-13T21:40:37.221539] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-13T21:40:37.417002] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:38.017979] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-13T21:40:38.153008] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T21:40:38.809740] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T21:40:38.818177] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-13T21:40:38.839700] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T21:40:39.617969] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-13T21:40:40.418012] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-13T21:40:40.473266] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T21:40:41.217966] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-13T21:40:41.313119] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T21:40:41.514315] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T21:40:42.018001] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-13T21:40:42.701236] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T21:40:42.817898] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-13T21:40:43.155032] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T21:40:43.618007] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-13T21:40:44.411576] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T21:40:44.421081] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-13T21:40:44.684274] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T21:40:45.217956] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-13T21:40:46.001014] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T21:40:46.017879] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-13T21:40:46.817907] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-13T21:40:46.892986] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T21:40:47.087548] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T21:40:47.568851] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T21:40:47.617947] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-13T21:40:48.417941] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-13T21:40:49.214582] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T21:40:49.223152] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-13T21:40:49.253814] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T21:40:50.017982] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-13T21:40:50.566831] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T21:40:50.817967] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-13T21:40:50.995533] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T21:40:51.617909] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-13T21:40:51.658750] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T21:40:51.661266] [INFO ] [REMOTE ] SSD: Full fetch complete (32233 records). [2025-10-13T21:40:51.661338] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-13T21:40:52.025537] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-13T21:40:52.025619] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-13T21:40:52.026390] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-13T21:40:52.026448] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-13T21:40:52.027223] [DEBUG] [LOCAL ] SSD: Trimmed 32233 records to 22581 (keeping 200 days of data) [2025-10-13T21:40:52.170662] [DEBUG] [LOCAL ] SSD: Primary data saved (22581 records). [2025-10-13T21:40:52.170814] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-13T21:40:52.170896] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 30.1s. Estimated remaining: 52m 45s. Rate: 7.1 symbols/min [2025-10-13T21:40:52.335589] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:40:52.364534] [DEBUG] [LOCAL ] SSTK: Loaded 25879 existing records from primary storage. [2025-10-13T21:40:52.364818] [INFO ] [MAIN ] SSTK: Loaded 25879 existing records. [2025-10-13T21:40:52.427490] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-13T21:40:52.545025] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:40:52.545418] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-13T21:40:52.545472] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-13T21:40:52.546055] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-13T21:40:52.546113] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-13T21:40:52.901179] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:40:53.146704] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T21:40:53.217897] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-13T21:40:53.380882] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T21:40:54.017937] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-13T21:40:54.817909] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-13T21:40:54.855115] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T21:40:55.285375] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T21:40:55.617918] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-13T21:40:56.390679] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T21:40:56.417892] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-13T21:40:57.038630] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:40:57.043380] [INFO ] [REMOTE ] SSL: Full fetch complete (59965 records). [2025-10-13T21:40:57.043534] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-13T21:40:57.219926] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-13T21:40:57.428993] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-13T21:40:57.429074] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-13T21:40:57.430118] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-13T21:40:57.430181] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-13T21:40:57.431371] [DEBUG] [LOCAL ] SSL: Trimmed 59965 records to 41409 (keeping 200 days of data) [2025-10-13T21:40:57.678353] [DEBUG] [LOCAL ] SSL: Primary data saved (41409 records). [2025-10-13T21:40:57.678484] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-13T21:40:57.678566] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSL took 35.3s. Estimated remaining: 52m 36s. Rate: 7.1 symbols/min [2025-10-13T21:40:57.797141] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T21:40:58.017968] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-13T21:40:58.817988] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-13T21:40:58.890223] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T21:40:58.931092] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T21:40:59.617951] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-13T21:41:00.102827] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T21:41:00.107131] [INFO ] [REMOTE ] SSB: Full fetch complete (61381 records). [2025-10-13T21:41:00.107244] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-13T21:41:00.431702] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-13T21:41:00.484827] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-13T21:41:00.484905] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-13T21:41:00.485915] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-13T21:41:00.485976] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-13T21:41:00.487207] [DEBUG] [LOCAL ] SSB: Trimmed 61381 records to 42741 (keeping 200 days of data) [2025-10-13T21:41:00.769142] [DEBUG] [LOCAL ] SSB: Primary data saved (42741 records). [2025-10-13T21:41:00.769276] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-13T21:41:00.769360] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSB took 40.3s. Estimated remaining: 52m 27s. Rate: 7.1 symbols/min [2025-10-13T21:41:01.126040] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T21:41:01.217911] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-13T21:41:01.656613] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T21:41:02.017961] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-13T21:41:02.684672] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T21:41:02.701432] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T21:41:02.817984] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-13T21:41:03.619266] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-13T21:41:03.620273] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T21:41:04.418004] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-13T21:41:05.033097] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T21:41:05.121215] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T21:41:05.217912] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-13T21:41:05.767894] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T21:41:05.769376] [INFO ] [REMOTE ] SST: Full fetch complete (18477 records). [2025-10-13T21:41:05.769455] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-13T21:41:06.031294] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-13T21:41:06.153781] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-13T21:41:06.153847] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-13T21:41:06.154326] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-13T21:41:06.154365] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-13T21:41:06.155027] [DEBUG] [LOCAL ] SST: Trimmed 18477 records to 11615 (keeping 200 days of data) [2025-10-13T21:41:06.223672] [DEBUG] [LOCAL ] SST: Primary data saved (11615 records). [2025-10-13T21:41:06.223802] [INFO ] [MAIN ] SST: Full history saved. [2025-10-13T21:41:06.223884] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 29.5s. Estimated remaining: 52m 18s. Rate: 7.1 symbols/min [2025-10-13T21:41:07.307374] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T21:41:07.312900] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-13T21:41:08.476536] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T21:41:08.481976] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-13T21:41:09.680396] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T21:41:09.686541] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-13T21:41:10.931804] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T21:41:10.937694] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-13T21:41:12.096061] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T21:41:12.101378] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-13T21:41:13.026219] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T21:41:13.029089] [INFO ] [REMOTE ] SSTK: Full fetch complete (41447 records). [2025-10-13T21:41:13.029166] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-13T21:41:13.399752] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-13T21:41:13.399829] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-13T21:41:13.400667] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-13T21:41:13.400728] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-13T21:41:13.401540] [DEBUG] [LOCAL ] SSTK: Trimmed 41447 records to 25366 (keeping 200 days of data) [2025-10-13T21:41:13.556911] [DEBUG] [LOCAL ] SSTK: Primary data saved (25366 records). [2025-10-13T21:41:13.557052] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-13T21:41:13.557133] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSTK took 21.4s. Estimated remaining: 52m 9s. Rate: 7.1 symbols/min [2025-10-13T21:41:14.064208] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:14.196052] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:14.234635] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:14.267373] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:14.284738] [DEBUG] [LOCAL ] STC: Loaded 17551 existing records from primary storage. [2025-10-13T21:41:14.285180] [INFO ] [MAIN ] STC: Loaded 17551 existing records. [2025-10-13T21:41:14.451104] [DEBUG] [LOCAL ] ST: Loaded 50558 existing records from primary storage. [2025-10-13T21:41:14.498947] [INFO ] [MAIN ] ST: Loaded 50558 existing records. [2025-10-13T21:41:14.493579] [DEBUG] [LOCAL ] STE: Loaded 35898 existing records from primary storage. [2025-10-13T21:41:14.512006] [INFO ] [MAIN ] STE: Loaded 35898 existing records. [2025-10-13T21:41:14.571710] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:14.612160] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-13T21:41:14.736365] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-13T21:41:14.742784] [DEBUG] [LOCAL ] STAG: Loaded 50819 existing records from primary storage. [2025-10-13T21:41:14.746701] [INFO ] [MAIN ] STAG: Loaded 50819 existing records. [2025-10-13T21:41:14.762619] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-13T21:41:14.773200] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-13T21:41:15.023062] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:15.064134] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-13T21:41:15.103534] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-13T21:41:15.178007] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:15.189475] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-13T21:41:15.212961] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-13T21:41:15.216616] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:15.216746] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-13T21:41:15.217035] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-13T21:41:15.216858] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-13T21:41:15.227859] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-13T21:41:15.248228] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-13T21:41:15.272466] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-13T21:41:15.267251] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-13T21:41:15.313768] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-13T21:41:16.216272] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:16.318462] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-13T21:41:16.541573] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:16.567698] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-13T21:41:16.596461] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:16.600769] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-13T21:41:16.628858] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:16.629793] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-13T21:41:17.465733] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T21:41:17.469939] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-13T21:41:17.644238] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T21:41:17.651378] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-13T21:41:18.256619] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:41:18.266440] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-13T21:41:18.278849] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T21:41:18.283533] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-13T21:41:18.326212] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:41:18.336060] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-13T21:41:19.055673] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:41:19.059588] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-13T21:41:19.096816] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T21:41:19.103967] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-13T21:41:19.953713] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:41:19.964023] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-13T21:41:19.993134] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T21:41:20.094615] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T21:41:20.417891] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-13T21:41:20.580371] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:41:21.217950] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-13T21:41:21.644433] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T21:41:22.024372] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-13T21:41:22.054750] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:41:22.810288] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T21:41:22.818134] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-13T21:41:23.617947] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-13T21:41:24.369987] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T21:41:24.417882] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-13T21:41:24.487316] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T21:41:25.210364] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T21:41:25.220294] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-13T21:41:26.017975] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-13T21:41:26.065813] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T21:41:26.585790] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T21:41:26.817953] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-13T21:41:27.105514] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T21:41:27.617916] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-13T21:41:28.417984] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-13T21:41:28.477166] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T21:41:29.217906] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-13T21:41:29.290889] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T21:41:30.017909] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-13T21:41:30.189842] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T21:41:30.436796] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T21:41:30.817887] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-13T21:41:30.970964] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T21:41:31.617939] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-13T21:41:32.418008] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-13T21:41:32.537637] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T21:41:33.158459] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T21:41:33.217966] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-13T21:41:33.625945] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T21:41:34.018016] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-13T21:41:34.817952] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-13T21:41:35.074566] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T21:41:35.617961] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-13T21:41:36.417961] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-13T21:41:36.693572] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T21:41:36.751254] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T21:41:37.092293] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-10-13T21:41:37.218003] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-13T21:41:38.017981] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-13T21:41:38.133402] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T21:41:38.817912] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-13T21:41:38.965792] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T21:41:39.023902] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T21:41:39.618016] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-13T21:41:40.417970] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-13T21:41:40.531511] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:41:41.217900] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-13T21:41:41.315314] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T21:41:41.420679] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T21:41:42.017982] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-13T21:41:42.497409] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T21:41:42.502607] [INFO ] [REMOTE ] STAG: Full fetch complete (72211 records). [2025-10-13T21:41:42.502760] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-13T21:41:42.823163] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-13T21:41:42.907028] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-13T21:41:42.907113] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-13T21:41:42.908323] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-13T21:41:42.908386] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-13T21:41:42.909845] [DEBUG] [LOCAL ] STAG: Trimmed 72211 records to 50096 (keeping 200 days of data) [2025-10-13T21:41:43.015841] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T21:41:43.234098] [DEBUG] [LOCAL ] STAG: Primary data saved (50096 records). [2025-10-13T21:41:43.234242] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-13T21:41:43.234325] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STAG took 29.7s. Estimated remaining: 52m 5s. Rate: 7.1 symbols/min [2025-10-13T21:41:43.399480] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:43.426671] [DEBUG] [LOCAL ] STEL: Loaded 23115 existing records from primary storage. [2025-10-13T21:41:43.426949] [INFO ] [MAIN ] STEL: Loaded 23115 existing records. [2025-10-13T21:41:43.612197] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:43.612497] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-13T21:41:43.612543] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-13T21:41:43.612902] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-13T21:41:43.612958] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-13T21:41:43.624009] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-13T21:41:43.993731] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:44.311261] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T21:41:44.317220] [INFO ] [REMOTE ] ST: Full fetch complete (71971 records). [2025-10-13T21:41:44.317354] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-13T21:41:44.424607] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-13T21:41:44.536860] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T21:41:44.599755] [INFO ] [REMOTE ] STC: Full fetch complete (25579 records). [2025-10-13T21:41:44.626072] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-13T21:41:45.054832] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-13T21:41:45.066919] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-13T21:41:45.084626] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-13T21:41:45.096680] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-13T21:41:45.185806] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-13T21:41:45.178498] [DEBUG] [LOCAL ] ST: Trimmed 71971 records to 49924 (keeping 200 days of data) [2025-10-13T21:41:45.186490] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-13T21:41:45.186886] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-13T21:41:45.187232] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-13T21:41:45.249560] [DEBUG] [LOCAL ] STC: Trimmed 25579 records to 17355 (keeping 200 days of data) [2025-10-13T21:41:45.250214] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-13T21:41:45.392359] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T21:41:45.640050] [DEBUG] [LOCAL ] STC: Primary data saved (17355 records). [2025-10-13T21:41:45.641051] [INFO ] [MAIN ] STC: Full history saved. [2025-10-13T21:41:45.641510] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STC took 32.1s. Estimated remaining: 51m 55s. Rate: 7.1 symbols/min [2025-10-13T21:41:45.822729] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:45.831439] [DEBUG] [LOCAL ] ST: Primary data saved (49924 records). [2025-10-13T21:41:45.831679] [INFO ] [MAIN ] ST: Full history saved. [2025-10-13T21:41:45.831804] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. ST took 32.3s. Estimated remaining: 51m 45s. Rate: 7.1 symbols/min [2025-10-13T21:41:46.018860] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:46.029156] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-13T21:41:46.032486] [DEBUG] [LOCAL ] STEM: Loaded 39568 existing records from primary storage. [2025-10-13T21:41:46.033011] [INFO ] [MAIN ] STEM: Loaded 39568 existing records. [2025-10-13T21:41:46.164862] [DEBUG] [LOCAL ] STEW: Loaded 16339 existing records from primary storage. [2025-10-13T21:41:46.175416] [INFO ] [MAIN ] STEW: Loaded 16339 existing records. [2025-10-13T21:41:46.313293] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:46.335527] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-13T21:41:46.335594] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-13T21:41:46.341471] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-13T21:41:46.341611] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-13T21:41:46.502797] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:41:46.508716] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-13T21:41:46.515020] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-13T21:41:46.539854] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-13T21:41:46.540741] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-13T21:41:46.540537] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T21:41:46.837918] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-13T21:41:47.063660] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:47.176782] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:47.534557] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T21:41:47.539170] [INFO ] [REMOTE ] STE: Full fetch complete (50633 records). [2025-10-13T21:41:47.539268] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-13T21:41:47.623946] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-13T21:41:47.934156] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-13T21:41:47.934305] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-13T21:41:47.935607] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-13T21:41:47.935736] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-13T21:41:47.937376] [DEBUG] [LOCAL ] STE: Trimmed 50633 records to 35419 (keeping 200 days of data) [2025-10-13T21:41:48.021871] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T21:41:48.190049] [DEBUG] [LOCAL ] STE: Primary data saved (35419 records). [2025-10-13T21:41:48.190198] [INFO ] [MAIN ] STE: Full history saved. [2025-10-13T21:41:48.190297] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. STE took 34.6s. Estimated remaining: 51m 36s. Rate: 7.1 symbols/min [2025-10-13T21:41:48.359810] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:41:48.360012] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-13T21:41:48.360079] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-13T21:41:48.360237] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-13T21:41:48.360280] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-13T21:41:48.360322] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-13T21:41:48.360381] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-13T21:41:48.423434] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-13T21:41:48.720484] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:41:49.217955] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-13T21:41:49.454010] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T21:41:49.502605] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-13T21:41:49.542136] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T21:41:50.018016] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-13T21:41:50.817904] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-13T21:41:51.012607] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T21:41:51.617965] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-13T21:41:52.418004] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-13T21:41:52.432406] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T21:41:52.864608] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T21:41:53.159732] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T21:41:53.217977] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-13T21:41:54.017997] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-13T21:41:54.817996] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-13T21:41:55.128035] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:41:55.147165] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T21:41:55.617999] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-13T21:41:55.928288] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:41:56.417968] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-13T21:41:56.816055] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:41:57.196188] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T21:41:57.217985] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-13T21:41:58.017953] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-13T21:41:58.448462] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T21:41:58.700454] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T21:41:58.818021] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-13T21:41:59.617952] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-13T21:41:59.938454] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T21:42:00.417955] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-13T21:42:00.614007] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T21:42:00.827406] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T21:42:01.217954] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-13T21:42:02.017950] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-13T21:42:02.156699] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T21:42:02.817970] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-13T21:42:03.065804] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T21:42:03.470423] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T21:42:03.617995] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-13T21:42:04.417965] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-13T21:42:04.858061] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T21:42:04.926146] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T21:42:05.217991] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-13T21:42:06.017982] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-13T21:42:06.276618] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T21:42:06.807517] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T21:42:06.817874] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-13T21:42:07.507846] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T21:42:07.509595] [INFO ] [REMOTE ] STEW: Full fetch complete (21693 records). [2025-10-13T21:42:07.509714] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-13T21:42:07.623056] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-13T21:42:07.888176] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-13T21:42:07.888258] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-13T21:42:07.888877] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-13T21:42:07.888939] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-13T21:42:07.889542] [DEBUG] [LOCAL ] STEW: Trimmed 21693 records to 15943 (keeping 200 days of data) [2025-10-13T21:42:07.997025] [DEBUG] [LOCAL ] STEW: Primary data saved (15943 records). [2025-10-13T21:42:07.997170] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-13T21:42:07.997266] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEW took 22.2s. Estimated remaining: 51m 29s. Rate: 7.1 symbols/min [2025-10-13T21:42:08.168492] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:42:08.181176] [DEBUG] [LOCAL ] STK: Loaded 9737 existing records from primary storage. [2025-10-13T21:42:08.181423] [INFO ] [MAIN ] STK: Loaded 9737 existing records. [2025-10-13T21:42:08.361279] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:42:08.361535] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-13T21:42:08.361581] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-13T21:42:08.361869] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-13T21:42:08.361928] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-13T21:42:08.424015] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-13T21:42:08.739247] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:42:09.217911] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-13T21:42:09.464820] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:42:09.503767] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T21:42:09.742236] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-13T21:42:10.018011] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-13T21:42:10.776557] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T21:42:10.817967] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-13T21:42:11.617959] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-13T21:42:11.759469] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T21:42:11.761878] [INFO ] [REMOTE ] STEL: Full fetch complete (31918 records). [2025-10-13T21:42:11.761960] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-13T21:42:12.166318] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-13T21:42:12.166397] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-13T21:42:12.167218] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-13T21:42:12.167278] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-13T21:42:12.168378] [DEBUG] [LOCAL ] STEL: Trimmed 31918 records to 22778 (keeping 200 days of data) [2025-10-13T21:42:12.309756] [DEBUG] [LOCAL ] STEL: Primary data saved (22778 records). [2025-10-13T21:42:12.309892] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-13T21:42:12.309975] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 29.1s. Estimated remaining: 51m 20s. Rate: 7.1 symbols/min [2025-10-13T21:42:12.423010] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-13T21:42:12.483050] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:42:12.497039] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T21:42:12.553573] [DEBUG] [LOCAL ] STLA: Loaded 54331 existing records from primary storage. [2025-10-13T21:42:12.553920] [INFO ] [MAIN ] STLA: Loaded 54331 existing records. [2025-10-13T21:42:12.732169] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:42:12.732425] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-13T21:42:12.732485] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-13T21:42:12.733113] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-13T21:42:12.733169] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-13T21:42:13.077052] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:42:13.217912] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-13T21:42:13.971829] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T21:42:14.017873] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-13T21:42:14.080040] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T21:42:14.358914] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-13T21:42:14.818013] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-13T21:42:15.617972] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-13T21:42:15.846804] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T21:42:16.417989] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-13T21:42:17.217960] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-13T21:42:17.516629] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T21:42:18.018028] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-13T21:42:18.367678] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T21:42:18.818034] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-13T21:42:19.246681] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-13T21:42:19.361124] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-13T21:42:19.617995] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-13T21:42:19.962122] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T21:42:20.338412] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T21:42:20.418021] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-13T21:42:21.217946] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-13T21:42:21.941326] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T21:42:22.007532] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:42:22.017883] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-13T21:42:22.466748] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T21:42:22.817949] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-13T21:42:23.617916] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-13T21:42:24.197592] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T21:42:24.367526] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T21:42:24.417885] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-13T21:42:25.217912] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-13T21:42:26.017913] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-13T21:42:26.562927] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-13T21:42:26.596951] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T21:42:26.634302] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T21:42:26.817958] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-13T21:42:27.575621] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T21:42:27.617908] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-13T21:42:28.417988] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-13T21:42:28.872882] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T21:42:29.217915] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-13T21:42:29.629914] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-13T21:42:30.017970] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-13T21:42:30.019252] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T21:42:30.818037] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-13T21:42:31.506974] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T21:42:31.509022] [INFO ] [REMOTE ] STK: Full fetch complete (14177 records). [2025-10-13T21:42:31.509101] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-13T21:42:31.623215] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-13T21:42:31.941615] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-13T21:42:31.941779] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-13T21:42:31.942369] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-13T21:42:31.942574] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-13T21:42:31.943830] [DEBUG] [LOCAL ] STK: Trimmed 14177 records to 9696 (keeping 200 days of data) [2025-10-13T21:42:32.044436] [DEBUG] [LOCAL ] STK: Primary data saved (9696 records). [2025-10-13T21:42:32.045352] [INFO ] [MAIN ] STK: Full history saved. [2025-10-13T21:42:32.046827] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T21:42:32.047031] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STK took 24.0s. Estimated remaining: 51m 14s. Rate: 7.1 symbols/min [2025-10-13T21:42:32.248863] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:42:32.313716] [DEBUG] [LOCAL ] STM: Loaded 54350 existing records from primary storage. [2025-10-13T21:42:32.314241] [INFO ] [MAIN ] STM: Loaded 54350 existing records. [2025-10-13T21:42:32.423261] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-13T21:42:32.514742] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:42:32.515017] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-13T21:42:32.515071] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-13T21:42:32.515801] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-13T21:42:32.515860] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-13T21:42:32.900858] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:42:33.022492] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:42:33.027908] [INFO ] [REMOTE ] STEM: Full fetch complete (61404 records). [2025-10-13T21:42:33.028144] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-13T21:42:33.225610] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-13T21:42:33.429691] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-13T21:42:33.429839] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-13T21:42:33.431033] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-13T21:42:33.431099] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-13T21:42:33.432894] [DEBUG] [LOCAL ] STEM: Trimmed 61404 records to 38838 (keeping 200 days of data) [2025-10-13T21:42:33.673144] [DEBUG] [LOCAL ] STEM: Primary data saved (38838 records). [2025-10-13T21:42:33.673335] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-13T21:42:33.673448] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 48.0s. Estimated remaining: 51m 4s. Rate: 7.1 symbols/min [2025-10-13T21:42:33.857506] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:42:33.884562] [DEBUG] [LOCAL ] STN: Loaded 23156 existing records from primary storage. [2025-10-13T21:42:33.884952] [INFO ] [MAIN ] STN: Loaded 23156 existing records. [2025-10-13T21:42:34.030524] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-13T21:42:34.072597] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:42:34.072873] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-13T21:42:34.072934] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-13T21:42:34.073181] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-13T21:42:34.073221] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-13T21:42:34.433595] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:42:34.453258] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T21:42:34.454228] [INFO ] [REMOTE ] STG: Full fetch complete (2515 records). [2025-10-13T21:42:34.454298] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-13T21:42:34.649105] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-13T21:42:34.649372] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:42:34.649449] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:42:34.649528] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-13T21:42:34.650054] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-13T21:42:34.650161] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-13T21:42:34.650227] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-13T21:42:34.650300] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STG took 46.5s. Estimated remaining: 50m 54s. Rate: 7.1 symbols/min [2025-10-13T21:42:34.827539] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-13T21:42:34.833199] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:42:34.875008] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T21:42:34.929868] [DEBUG] [LOCAL ] STNG: Loaded 44349 existing records from primary storage. [2025-10-13T21:42:34.930202] [INFO ] [MAIN ] STNG: Loaded 44349 existing records. [2025-10-13T21:42:35.114019] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:42:35.114442] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-13T21:42:35.114625] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-13T21:42:35.115291] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-13T21:42:35.115395] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-13T21:42:35.447238] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-13T21:42:35.547862] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:42:35.618011] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-13T21:42:35.945249] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T21:42:36.418023] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-13T21:42:37.229113] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-13T21:42:37.234314] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:42:38.018010] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-13T21:42:38.513590] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T21:42:38.817960] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-13T21:42:39.375684] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T21:42:39.439758] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T21:42:39.617994] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-13T21:42:40.417983] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-13T21:42:41.199941] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T21:42:41.217972] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-13T21:42:42.017907] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-13T21:42:42.050187] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (3.23 seconds). [2025-10-13T21:42:42.226974] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T21:42:42.817992] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-13T21:42:43.344702] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T21:42:43.626291] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-13T21:42:43.632830] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T21:42:43.961288] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:42:44.418048] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-13T21:42:45.218049] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-13T21:42:45.557481] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T21:42:45.738092] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T21:42:46.017998] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-13T21:42:46.817940] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-13T21:42:46.895756] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:42:47.230175] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T21:42:47.617945] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-13T21:42:48.418047] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-13T21:42:48.708394] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T21:42:48.751056] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:42:49.217949] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-13T21:42:50.017936] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-13T21:42:50.817903] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-13T21:42:50.854125] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-13T21:42:51.284521] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T21:42:51.308880] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T21:42:51.617949] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-13T21:42:52.404810] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T21:42:52.417890] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-13T21:42:53.217954] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-13T21:42:53.510191] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T21:42:53.688594] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T21:42:54.017948] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-13T21:42:54.797243] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:42:54.817971] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-13T21:42:55.618035] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-13T21:42:56.284060] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T21:42:56.417965] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-13T21:42:57.112027] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-13T21:42:57.217944] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-13T21:42:57.752864] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T21:42:57.905856] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T21:42:58.018025] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-13T21:42:58.818000] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-13T21:42:59.236873] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-13T21:42:59.242936] [INFO ] [REMOTE ] STLA: Full fetch complete (77543 records). [2025-10-13T21:42:59.243106] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-13T21:42:59.619925] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-13T21:42:59.662307] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-13T21:42:59.662496] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-13T21:42:59.664192] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-13T21:42:59.664567] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-13T21:42:59.667228] [DEBUG] [LOCAL ] STLA: Trimmed 77543 records to 53555 (keeping 200 days of data) [2025-10-13T21:42:59.802496] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T21:42:59.860792] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T21:43:00.098087] [DEBUG] [LOCAL ] STLA: Primary data saved (53555 records). [2025-10-13T21:43:00.098277] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-13T21:43:00.098374] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STLA took 47.8s. Estimated remaining: 50m 49s. Rate: 7.1 symbols/min [2025-10-13T21:43:00.277287] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:00.291805] [DEBUG] [LOCAL ] STRV: Loaded 11460 existing records from primary storage. [2025-10-13T21:43:00.292082] [INFO ] [MAIN ] STRV: Loaded 11460 existing records. [2025-10-13T21:43:00.423103] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-13T21:43:00.484397] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:00.484683] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-13T21:43:00.484745] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-13T21:43:00.485038] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-13T21:43:00.485096] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-13T21:43:00.849577] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:01.217902] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-13T21:43:01.307004] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T21:43:01.711390] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T21:43:01.714258] [INFO ] [REMOTE ] STN: Full fetch complete (32235 records). [2025-10-13T21:43:01.714391] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-13T21:43:02.023054] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-13T21:43:02.131367] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-13T21:43:02.131473] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-13T21:43:02.132343] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-13T21:43:02.132409] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-13T21:43:02.133599] [DEBUG] [LOCAL ] STN: Trimmed 32235 records to 22817 (keeping 200 days of data) [2025-10-13T21:43:02.258228] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T21:43:02.318297] [DEBUG] [LOCAL ] STN: Primary data saved (22817 records). [2025-10-13T21:43:02.318480] [INFO ] [MAIN ] STN: Full history saved. [2025-10-13T21:43:02.318578] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STN took 28.6s. Estimated remaining: 50m 39s. Rate: 7.1 symbols/min [2025-10-13T21:43:02.513474] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:02.569334] [DEBUG] [LOCAL ] STT: Loaded 51696 existing records from primary storage. [2025-10-13T21:43:02.569847] [INFO ] [MAIN ] STT: Loaded 51696 existing records. [2025-10-13T21:43:02.758879] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:02.759214] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-13T21:43:02.759266] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-13T21:43:02.760409] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-13T21:43:02.760489] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-13T21:43:02.824794] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-13T21:43:03.116459] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:03.617978] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-13T21:43:03.938020] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T21:43:04.143217] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-13T21:43:04.417905] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-13T21:43:05.215853] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T21:43:05.224691] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-13T21:43:05.993872] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:43:06.021788] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-13T21:43:06.024195] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T21:43:06.817916] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-13T21:43:07.344044] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T21:43:07.348375] [INFO ] [REMOTE ] STNG: Full fetch complete (64343 records). [2025-10-13T21:43:07.348465] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-13T21:43:07.623055] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-13T21:43:07.753906] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-13T21:43:07.753982] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-13T21:43:07.755012] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-13T21:43:07.755073] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-13T21:43:07.756294] [DEBUG] [LOCAL ] STNG: Trimmed 64343 records to 43721 (keeping 200 days of data) [2025-10-13T21:43:08.022126] [DEBUG] [LOCAL ] STNG: Primary data saved (43721 records). [2025-10-13T21:43:08.022255] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-13T21:43:08.022334] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STNG took 33.4s. Estimated remaining: 50m 31s. Rate: 7.1 symbols/min [2025-10-13T21:43:08.187176] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:08.187364] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-13T21:43:08.187407] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-13T21:43:08.187547] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-13T21:43:08.187606] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-13T21:43:08.187681] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-13T21:43:08.187741] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-13T21:43:08.423843] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-13T21:43:08.556773] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:08.649355] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T21:43:08.797209] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T21:43:09.217970] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-13T21:43:10.017974] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-13T21:43:10.131578] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T21:43:10.294772] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T21:43:10.817997] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-13T21:43:11.617954] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-13T21:43:11.731442] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T21:43:11.798431] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T21:43:11.804033] [INFO ] [REMOTE ] STM: Full fetch complete (77522 records). [2025-10-13T21:43:11.804161] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-13T21:43:11.836940] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:43:11.874905] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-13T21:43:11.907255] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:43:11.907637] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-13T21:43:11.923332] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:43:11.923432] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-13T21:43:11.928693] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-13T21:43:11.933892] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-13T21:43:11.946942] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-13T21:43:11.957331] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STUB took 3.9s. Estimated remaining: 50m 21s. Rate: 7.1 symbols/min [2025-10-13T21:43:12.383459] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:12.403237] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-13T21:43:12.403306] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-13T21:43:12.404378] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-13T21:43:12.404441] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-13T21:43:12.406304] [DEBUG] [LOCAL ] STM: Trimmed 77522 records to 53574 (keeping 200 days of data) [2025-10-13T21:43:12.461103] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-13T21:43:12.540084] [DEBUG] [LOCAL ] STVN: Loaded 26967 existing records from primary storage. [2025-10-13T21:43:12.544920] [INFO ] [MAIN ] STVN: Loaded 26967 existing records. [2025-10-13T21:43:12.743225] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:12.743486] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-13T21:43:12.743532] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-13T21:43:12.743830] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-13T21:43:12.743889] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-13T21:43:13.221667] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-13T21:43:13.292116] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:13.459366] [DEBUG] [LOCAL ] STM: Primary data saved (53574 records). [2025-10-13T21:43:13.459517] [INFO ] [MAIN ] STM: Full history saved. [2025-10-13T21:43:13.459634] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STM took 41.4s. Estimated remaining: 50m 12s. Rate: 7.1 symbols/min [2025-10-13T21:43:13.676001] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:13.752294] [DEBUG] [LOCAL ] STWD: Loaded 52712 existing records from primary storage. [2025-10-13T21:43:13.752864] [INFO ] [MAIN ] STWD: Loaded 52712 existing records. [2025-10-13T21:43:13.979168] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:13.979533] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-13T21:43:13.979595] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-13T21:43:13.980578] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-13T21:43:13.980673] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-13T21:43:14.023361] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-13T21:43:14.249908] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T21:43:14.411820] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:14.439022] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T21:43:14.817947] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-13T21:43:15.308870] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T21:43:15.618010] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-13T21:43:16.246462] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:43:16.417933] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-13T21:43:17.005506] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T21:43:17.217958] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-13T21:43:18.019934] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-13T21:43:18.025360] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T21:43:18.358045] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:43:18.795867] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T21:43:18.817895] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-13T21:43:19.558620] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T21:43:19.617901] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-13T21:43:20.417944] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-13T21:43:21.217942] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-13T21:43:21.438106] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:43:21.735509] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T21:43:22.017896] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-13T21:43:22.120508] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T21:43:22.817938] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-13T21:43:23.506486] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T21:43:23.508074] [INFO ] [REMOTE ] STRV: Full fetch complete (17723 records). [2025-10-13T21:43:23.508145] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-13T21:43:23.623041] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-13T21:43:23.869635] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-13T21:43:23.869746] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-13T21:43:23.870176] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-13T21:43:23.870215] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-13T21:43:23.870754] [DEBUG] [LOCAL ] STRV: Trimmed 17723 records to 11250 (keeping 200 days of data) [2025-10-13T21:43:23.940986] [DEBUG] [LOCAL ] STRV: Primary data saved (11250 records). [2025-10-13T21:43:23.941155] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-13T21:43:23.941258] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 23.8s. Estimated remaining: 50m 4s. Rate: 7.1 symbols/min [2025-10-13T21:43:24.107361] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:24.110122] [DEBUG] [LOCAL ] STXD: Loaded 1250 existing records from primary storage. [2025-10-13T21:43:24.110249] [INFO ] [MAIN ] STXD: Loaded 1250 existing records. [2025-10-13T21:43:24.291297] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:24.291673] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-13T21:43:24.291747] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-13T21:43:24.292003] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-13T21:43:24.292119] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-13T21:43:24.419773] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-13T21:43:24.657515] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-13T21:43:24.694957] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:25.217897] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-13T21:43:25.439509] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:43:25.634508] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T21:43:25.657239] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T21:43:26.017915] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-13T21:43:26.449896] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T21:43:26.817964] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-13T21:43:27.183128] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T21:43:27.617930] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-13T21:43:28.066829] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T21:43:28.417979] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-13T21:43:29.217953] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-13T21:43:30.017947] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-13T21:43:30.086597] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T21:43:30.817944] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-13T21:43:31.144444] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:43:31.297133] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T21:43:31.617901] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-13T21:43:32.289382] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T21:43:32.381529] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T21:43:32.417880] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-13T21:43:33.217996] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-13T21:43:33.641614] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T21:43:34.017984] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-13T21:43:34.825517] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-13T21:43:34.845215] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T21:43:35.138104] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T21:43:35.617941] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-13T21:43:36.130784] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-13T21:43:36.417987] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-13T21:43:36.752420] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T21:43:36.849788] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:43:37.218004] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-13T21:43:38.017989] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-13T21:43:38.817904] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-13T21:43:38.949600] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T21:43:38.990475] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T21:43:39.281276] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T21:43:39.617945] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-13T21:43:39.978629] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T21:43:40.421457] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-13T21:43:41.217959] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-13T21:43:42.018019] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-13T21:43:42.175575] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T21:43:42.558213] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T21:43:42.817993] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-13T21:43:43.157712] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-13T21:43:43.586243] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:43:43.617888] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-13T21:43:44.418017] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-13T21:43:44.769527] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T21:43:45.098139] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T21:43:45.103909] [INFO ] [REMOTE ] STT: Full fetch complete (74241 records). [2025-10-13T21:43:45.104204] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-13T21:43:45.223153] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-13T21:43:45.507219] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-13T21:43:45.507557] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-13T21:43:45.508833] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-13T21:43:45.508901] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-13T21:43:45.510513] [DEBUG] [LOCAL ] STT: Trimmed 74241 records to 51043 (keeping 200 days of data) [2025-10-13T21:43:45.831227] [DEBUG] [LOCAL ] STT: Primary data saved (51043 records). [2025-10-13T21:43:45.831360] [INFO ] [MAIN ] STT: Full history saved. [2025-10-13T21:43:45.831478] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STT took 43.5s. Estimated remaining: 49m 57s. Rate: 7.1 symbols/min [2025-10-13T21:43:46.004973] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:46.008777] [DEBUG] [LOCAL ] STXE: Loaded 2120 existing records from primary storage. [2025-10-13T21:43:46.008924] [INFO ] [MAIN ] STXE: Loaded 2120 existing records. [2025-10-13T21:43:46.023107] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-13T21:43:46.193449] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:46.193908] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-13T21:43:46.194044] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-13T21:43:46.194476] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-13T21:43:46.194561] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-13T21:43:46.388716] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-13T21:43:46.417001] [INFO ] [REMOTE ] STXD: Full fetch complete (2010 records). [2025-10-13T21:43:46.407034] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T21:43:46.427297] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-13T21:43:46.567985] [INFO ] [REMOTE ] STVN: Full fetch complete (39196 records). [2025-10-13T21:43:46.596026] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-13T21:43:46.813467] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:46.828051] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-13T21:43:47.266502] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-13T21:43:47.277896] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-13T21:43:47.289114] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-13T21:43:47.297346] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-13T21:43:47.300779] [DEBUG] [LOCAL ] STXD: Trimmed 2010 records to 1210 (keeping 200 days of data) [2025-10-13T21:43:47.381679] [DEBUG] [LOCAL ] STXD: Primary data saved (1210 records). [2025-10-13T21:43:47.393695] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-13T21:43:47.401621] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STXD took 23.5s. Estimated remaining: 49m 48s. Rate: 7.1 symbols/min [2025-10-13T21:43:47.435715] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-13T21:43:47.478981] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-13T21:43:47.507066] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-13T21:43:47.507702] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-13T21:43:47.578310] [DEBUG] [LOCAL ] STVN: Trimmed 39196 records to 26679 (keeping 200 days of data) [2025-10-13T21:43:47.582100] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:47.636916] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-13T21:43:47.685220] [DEBUG] [LOCAL ] STXG: Loaded 2487 existing records from primary storage. [2025-10-13T21:43:47.686145] [INFO ] [MAIN ] STXG: Loaded 2487 existing records. [2025-10-13T21:43:47.902633] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:47.904485] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-13T21:43:47.904966] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-13T21:43:47.905775] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-13T21:43:47.906127] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-13T21:43:48.360815] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:48.366868] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T21:43:48.376071] [DEBUG] [LOCAL ] STVN: Primary data saved (26679 records). [2025-10-13T21:43:48.376174] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-13T21:43:48.376266] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STVN took 36.4s. Estimated remaining: 49m 38s. Rate: 7.1 symbols/min [2025-10-13T21:43:48.420761] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-13T21:43:48.556349] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:43:48.560389] [DEBUG] [LOCAL ] STXK: Loaded 1545 existing records from primary storage. [2025-10-13T21:43:48.560548] [INFO ] [MAIN ] STXK: Loaded 1545 existing records. [2025-10-13T21:43:48.746498] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:43:48.746918] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-13T21:43:48.747087] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-13T21:43:48.747444] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-13T21:43:48.747514] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-13T21:43:48.974222] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T21:43:49.033263] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T21:43:49.176027] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:43:49.217895] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-13T21:43:49.591299] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-13T21:43:50.018017] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-13T21:43:50.345865] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T21:43:50.817998] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-13T21:43:51.285700] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T21:43:51.617962] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-13T21:43:52.181859] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T21:43:52.417979] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-13T21:43:52.989137] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T21:43:53.217997] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-13T21:43:54.018042] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-13T21:43:54.466743] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T21:43:54.817967] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-13T21:43:54.983486] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:43:55.249066] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T21:43:55.617979] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-13T21:43:56.181918] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T21:43:56.417947] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-13T21:43:56.860733] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T21:43:57.217949] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-13T21:43:57.779039] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T21:43:58.017950] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-13T21:43:58.501845] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T21:43:58.817941] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-13T21:43:59.248007] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:43:59.617954] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-13T21:44:00.296136] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T21:44:00.417911] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-13T21:44:00.927134] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T21:44:01.217954] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-13T21:44:01.733316] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T21:44:02.017989] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-13T21:44:02.458737] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T21:44:02.821950] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-13T21:44:03.278803] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T21:44:03.617943] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-13T21:44:04.068886] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T21:44:04.417988] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-13T21:44:04.890104] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T21:44:05.217988] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-13T21:44:05.676441] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T21:44:06.018014] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-13T21:44:06.817963] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-13T21:44:07.175854] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T21:44:07.176757] [INFO ] [REMOTE ] STXG: Full fetch complete (4075 records). [2025-10-13T21:44:07.176826] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-13T21:44:07.552437] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-13T21:44:07.552546] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-13T21:44:07.552811] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-13T21:44:07.552877] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-13T21:44:07.553282] [DEBUG] [LOCAL ] STXG: Trimmed 4075 records to 2438 (keeping 200 days of data) [2025-10-13T21:44:07.573027] [DEBUG] [LOCAL ] STXG: Primary data saved (2438 records). [2025-10-13T21:44:07.573247] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-13T21:44:07.573364] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXG took 20.2s. Estimated remaining: 49m 32s. Rate: 7.1 symbols/min [2025-10-13T21:44:07.623227] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-13T21:44:07.797573] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:07.797994] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-13T21:44:07.798096] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-13T21:44:07.798582] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-13T21:44:07.798772] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-13T21:44:07.798961] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-13T21:44:07.799159] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-13T21:44:07.941668] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T21:44:08.139187] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T21:44:08.217330] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:08.417945] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-13T21:44:08.853556] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T21:44:09.218008] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-13T21:44:09.642158] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-13T21:44:10.017979] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-13T21:44:10.462013] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T21:44:10.817950] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-13T21:44:11.618006] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-13T21:44:12.073847] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T21:44:12.396594] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T21:44:12.402113] [INFO ] [REMOTE ] STWD: Full fetch complete (75198 records). [2025-10-13T21:44:12.402231] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-13T21:44:12.424220] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-13T21:44:12.817344] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-13T21:44:12.817435] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-13T21:44:12.818605] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-13T21:44:12.818695] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-13T21:44:12.821071] [DEBUG] [LOCAL ] STWD: Trimmed 75198 records to 51981 (keeping 200 days of data) [2025-10-13T21:44:12.887815] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T21:44:13.153731] [DEBUG] [LOCAL ] STWD: Primary data saved (51981 records). [2025-10-13T21:44:13.153869] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-13T21:44:13.153947] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STWD took 59.7s. Estimated remaining: 49m 23s. Rate: 7.1 symbols/min [2025-10-13T21:44:13.223161] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-13T21:44:13.324694] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:13.329411] [DEBUG] [LOCAL ] STXT: Loaded 2534 existing records from primary storage. [2025-10-13T21:44:13.329554] [INFO ] [MAIN ] STXT: Loaded 2534 existing records. [2025-10-13T21:44:13.503761] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:13.504017] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-13T21:44:13.504073] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-13T21:44:13.504251] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-13T21:44:13.504319] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-13T21:44:13.769299] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T21:44:13.882632] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:14.017974] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-13T21:44:14.421112] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-13T21:44:14.817981] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-13T21:44:15.257267] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T21:44:15.617949] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-13T21:44:16.063934] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T21:44:16.417947] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-13T21:44:16.766296] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T21:44:17.217938] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-13T21:44:17.863786] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T21:44:18.017945] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-13T21:44:18.587215] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T21:44:18.817951] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-13T21:44:19.263125] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T21:44:19.618005] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-13T21:44:20.251426] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T21:44:20.417951] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-13T21:44:20.787207] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-13T21:44:20.788244] [INFO ] [REMOTE ] STXE: Full fetch complete (3495 records). [2025-10-13T21:44:20.788314] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-13T21:44:21.161022] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-13T21:44:21.161133] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-13T21:44:21.161272] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-13T21:44:21.161313] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-13T21:44:21.161704] [DEBUG] [LOCAL ] STXE: Trimmed 3495 records to 2080 (keeping 200 days of data) [2025-10-13T21:44:21.175879] [DEBUG] [LOCAL ] STXE: Primary data saved (2080 records). [2025-10-13T21:44:21.175951] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-13T21:44:21.176045] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXE took 35.3s. Estimated remaining: 49m 14s. Rate: 7.1 symbols/min [2025-10-13T21:44:21.223084] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-13T21:44:21.363318] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:21.366952] [DEBUG] [LOCAL ] STXV: Loaded 1561 existing records from primary storage. [2025-10-13T21:44:21.367115] [INFO ] [MAIN ] STXV: Loaded 1561 existing records. [2025-10-13T21:44:21.555941] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:21.556265] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-13T21:44:21.556325] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-13T21:44:21.556616] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-13T21:44:21.556732] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-13T21:44:21.895377] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T21:44:21.957302] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:22.017966] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-13T21:44:22.448926] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-13T21:44:22.817985] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-13T21:44:23.274074] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T21:44:23.617951] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-13T21:44:24.074703] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-13T21:44:24.417954] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-13T21:44:24.788322] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T21:44:25.217907] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-13T21:44:26.017899] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-13T21:44:26.200930] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T21:44:26.468454] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T21:44:26.817946] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-13T21:44:27.421978] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T21:44:27.617934] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-13T21:44:28.132365] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T21:44:28.418016] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-13T21:44:28.966670] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T21:44:29.217996] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-13T21:44:29.567241] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T21:44:29.568217] [INFO ] [REMOTE ] STXK: Full fetch complete (2424 records). [2025-10-13T21:44:29.568287] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-13T21:44:29.919189] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-13T21:44:29.919271] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-13T21:44:29.919373] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-13T21:44:29.919408] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-13T21:44:29.919760] [DEBUG] [LOCAL ] STXK: Trimmed 2424 records to 1524 (keeping 200 days of data) [2025-10-13T21:44:29.929363] [DEBUG] [LOCAL ] STXK: Primary data saved (1524 records). [2025-10-13T21:44:29.929420] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-13T21:44:29.929483] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 41.6s. Estimated remaining: 49m 6s. Rate: 7.1 symbols/min [2025-10-13T21:44:30.023221] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-13T21:44:30.101383] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:30.160813] [DEBUG] [LOCAL ] STZ: Loaded 53107 existing records from primary storage. [2025-10-13T21:44:30.161138] [INFO ] [MAIN ] STZ: Loaded 53107 existing records. [2025-10-13T21:44:30.339473] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:30.339743] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-13T21:44:30.339805] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-13T21:44:30.340382] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-13T21:44:30.340439] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-13T21:44:30.450878] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:44:30.702515] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:30.817969] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-13T21:44:31.617959] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-13T21:44:31.974949] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T21:44:32.417968] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-13T21:44:32.666097] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T21:44:32.773396] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T21:44:33.218002] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-13T21:44:33.679066] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T21:44:34.017984] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-13T21:44:34.375791] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-13T21:44:34.818012] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-13T21:44:35.265890] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T21:44:35.617963] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-13T21:44:36.072131] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T21:44:36.417990] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-13T21:44:36.919318] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T21:44:37.217973] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-13T21:44:37.589429] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T21:44:38.017956] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-13T21:44:38.359461] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-13T21:44:38.817967] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-13T21:44:39.150200] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-13T21:44:39.150960] [INFO ] [REMOTE ] STXM: Full fetch complete (1402 records). [2025-10-13T21:44:39.151028] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-13T21:44:39.355122] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-13T21:44:39.355339] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:44:39.355411] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:44:39.355485] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-13T21:44:39.355550] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-13T21:44:39.355603] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-13T21:44:39.355704] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-13T21:44:39.355775] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXM took 31.8s. Estimated remaining: 48m 57s. Rate: 7.1 symbols/min [2025-10-13T21:44:39.519104] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:39.575192] [DEBUG] [LOCAL ] SU: Loaded 54213 existing records from primary storage. [2025-10-13T21:44:39.575499] [INFO ] [MAIN ] SU: Loaded 54213 existing records. [2025-10-13T21:44:39.627037] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-13T21:44:39.755271] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:39.755505] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-13T21:44:39.755553] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-13T21:44:39.756889] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-13T21:44:39.756947] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-13T21:44:40.099457] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:40.418013] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-13T21:44:41.217943] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-13T21:44:41.712441] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T21:44:41.744392] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-13T21:44:42.017901] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-13T21:44:42.116120] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T21:44:42.379446] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T21:44:42.380248] [INFO ] [REMOTE ] STXT: Full fetch complete (3884 records). [2025-10-13T21:44:42.380315] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-13T21:44:42.726174] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-13T21:44:42.726249] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-13T21:44:42.726375] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-13T21:44:42.726411] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-13T21:44:42.726776] [DEBUG] [LOCAL ] STXT: Trimmed 3884 records to 2489 (keeping 200 days of data) [2025-10-13T21:44:42.743630] [DEBUG] [LOCAL ] STXT: Primary data saved (2489 records). [2025-10-13T21:44:42.743812] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-13T21:44:42.743911] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXT took 29.6s. Estimated remaining: 48m 48s. Rate: 7.1 symbols/min [2025-10-13T21:44:42.823208] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-13T21:44:42.936815] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:42.980825] [DEBUG] [LOCAL ] SUI: Loaded 42380 existing records from primary storage. [2025-10-13T21:44:42.981258] [INFO ] [MAIN ] SUI: Loaded 42380 existing records. [2025-10-13T21:44:43.167149] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:43.167445] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-13T21:44:43.167496] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-13T21:44:43.169506] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-13T21:44:43.169568] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-13T21:44:43.544902] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:43.617995] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-13T21:44:44.417902] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-13T21:44:44.675689] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T21:44:45.217971] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-13T21:44:45.691132] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T21:44:45.930129] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T21:44:46.017965] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-13T21:44:46.304748] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-13T21:44:46.817943] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-13T21:44:46.946204] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T21:44:47.617988] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-13T21:44:48.384048] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T21:44:48.417892] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-13T21:44:49.217950] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-13T21:44:49.665126] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T21:44:49.672711] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T21:44:49.930507] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T21:44:50.017902] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-13T21:44:50.818016] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-13T21:44:51.156284] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T21:44:51.157109] [INFO ] [REMOTE ] STXV: Full fetch complete (2536 records). [2025-10-13T21:44:51.157179] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-13T21:44:51.510405] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-13T21:44:51.510559] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-13T21:44:51.510736] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-13T21:44:51.510814] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-13T21:44:51.511287] [DEBUG] [LOCAL ] STXV: Trimmed 2536 records to 1532 (keeping 200 days of data) [2025-10-13T21:44:51.521879] [DEBUG] [LOCAL ] STXV: Primary data saved (1532 records). [2025-10-13T21:44:51.521956] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-13T21:44:51.522030] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXV took 30.3s. Estimated remaining: 48m 40s. Rate: 7.1 symbols/min [2025-10-13T21:44:51.621346] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-13T21:44:51.724570] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:44:51.749900] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:44:51.794557] [DEBUG] [LOCAL ] SUN: Loaded 38533 existing records from primary storage. [2025-10-13T21:44:51.794880] [INFO ] [MAIN ] SUN: Loaded 38533 existing records. [2025-10-13T21:44:52.004698] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:44:52.004948] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-13T21:44:52.005012] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-13T21:44:52.006137] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-13T21:44:52.006217] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-13T21:44:52.403186] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:44:52.417888] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-13T21:44:53.217913] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-13T21:44:53.543604] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:44:53.893043] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T21:44:54.017983] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-13T21:44:54.826260] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-13T21:44:54.830945] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T21:44:55.516143] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T21:44:55.617997] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-13T21:44:56.417906] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-13T21:44:56.648857] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T21:44:57.217899] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-13T21:44:57.624610] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T21:44:57.906388] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T21:44:58.017910] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-13T21:44:58.817987] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-13T21:44:58.963352] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T21:44:59.586739] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T21:44:59.617898] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-13T21:45:00.211912] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T21:45:00.418007] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-13T21:45:01.217992] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-13T21:45:01.431621] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T21:45:02.017999] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-13T21:45:02.262414] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T21:45:02.737463] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T21:45:02.817970] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-13T21:45:03.617990] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-13T21:45:04.181185] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T21:45:04.303085] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T21:45:04.418044] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-13T21:45:05.218011] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-13T21:45:05.275021] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:45:06.017954] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-13T21:45:06.403050] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T21:45:06.817960] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-13T21:45:07.282178] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-13T21:45:07.625178] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-13T21:45:07.651105] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T21:45:08.323874] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:45:08.417939] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-13T21:45:09.217957] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-13T21:45:09.556897] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T21:45:09.960699] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T21:45:10.017938] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-13T21:45:10.817974] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-13T21:45:11.312942] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T21:45:11.617900] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-13T21:45:11.869184] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T21:45:12.419560] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-13T21:45:13.100605] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-13T21:45:13.217887] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-13T21:45:14.008811] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T21:45:14.014617] [INFO ] [REMOTE ] SU: Full fetch complete (77376 records). [2025-10-13T21:45:14.014778] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-13T21:45:14.022667] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-13T21:45:14.232227] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-13T21:45:14.507885] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-13T21:45:14.508045] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-13T21:45:14.509262] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-13T21:45:14.509325] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-13T21:45:14.510809] [DEBUG] [LOCAL ] SU: Trimmed 77376 records to 53428 (keeping 200 days of data) [2025-10-13T21:45:14.824847] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-13T21:45:14.902790] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T21:45:14.946639] [DEBUG] [LOCAL ] SU: Primary data saved (53428 records). [2025-10-13T21:45:14.946864] [INFO ] [MAIN ] SU: Full history saved. [2025-10-13T21:45:14.946985] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SU took 35.6s. Estimated remaining: 48m 34s. Rate: 7.1 symbols/min [2025-10-13T21:45:15.182425] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:15.230052] [DEBUG] [LOCAL ] SUPV: Loaded 48230 existing records from primary storage. [2025-10-13T21:45:15.230524] [INFO ] [MAIN ] SUPV: Loaded 48230 existing records. [2025-10-13T21:45:15.523293] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T21:45:15.552694] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:15.553786] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-13T21:45:15.553071] [INFO ] [REMOTE ] SUI: Full fetch complete (60861 records). [2025-10-13T21:45:15.554106] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-13T21:45:15.554421] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-13T21:45:15.561470] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-13T21:45:15.591287] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-13T21:45:15.628012] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-13T21:45:15.874082] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T21:45:16.420098] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-13T21:45:16.456929] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-13T21:45:16.460145] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:16.460392] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-13T21:45:16.461584] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-13T21:45:16.461636] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-13T21:45:16.462856] [DEBUG] [LOCAL ] SUI: Trimmed 60861 records to 41951 (keeping 200 days of data) [2025-10-13T21:45:16.729496] [DEBUG] [LOCAL ] SUI: Primary data saved (41951 records). [2025-10-13T21:45:16.729627] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-13T21:45:16.729743] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUI took 34.0s. Estimated remaining: 48m 24s. Rate: 7.1 symbols/min [2025-10-13T21:45:16.899666] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:16.940052] [DEBUG] [LOCAL ] SUZ: Loaded 46265 existing records from primary storage. [2025-10-13T21:45:16.940370] [INFO ] [MAIN ] SUZ: Loaded 46265 existing records. [2025-10-13T21:45:17.117521] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:17.117747] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-13T21:45:17.117830] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-13T21:45:17.119197] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-13T21:45:17.119274] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-13T21:45:17.221708] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-13T21:45:17.511459] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:17.513349] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T21:45:18.017926] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-13T21:45:18.447333] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-13T21:45:18.453039] [INFO ] [REMOTE ] STZ: Full fetch complete (75938 records). [2025-10-13T21:45:18.453193] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-13T21:45:18.825815] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-13T21:45:18.849856] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-13T21:45:18.849938] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-13T21:45:18.851045] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-13T21:45:18.851286] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-13T21:45:18.852865] [DEBUG] [LOCAL ] STZ: Trimmed 75938 records to 52386 (keeping 200 days of data) [2025-10-13T21:45:18.996383] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T21:45:19.112323] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T21:45:19.145102] [INFO ] [REMOTE ] SUN: Full fetch complete (55124 records). [2025-10-13T21:45:19.146883] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-13T21:45:19.571421] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-13T21:45:19.572834] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-13T21:45:19.573882] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-13T21:45:19.573972] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-13T21:45:19.580932] [DEBUG] [LOCAL ] SUN: Trimmed 55124 records to 38142 (keeping 200 days of data) [2025-10-13T21:45:19.642213] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-13T21:45:19.793208] [DEBUG] [LOCAL ] STZ: Primary data saved (52386 records). [2025-10-13T21:45:19.794003] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-13T21:45:19.794158] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. STZ took 49.9s. Estimated remaining: 48m 15s. Rate: 7.1 symbols/min [2025-10-13T21:45:20.055775] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:20.121054] [DEBUG] [LOCAL ] SVV: Loaded 40570 existing records from primary storage. [2025-10-13T21:45:20.120256] [DEBUG] [LOCAL ] SUN: Primary data saved (38142 records). [2025-10-13T21:45:20.121512] [INFO ] [MAIN ] SVV: Loaded 40570 existing records. [2025-10-13T21:45:20.121363] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-13T21:45:20.121707] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 28.6s. Estimated remaining: 48m 5s. Rate: 7.1 symbols/min [2025-10-13T21:45:20.483637] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:20.489279] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:20.490025] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-13T21:45:20.490233] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-13T21:45:20.491185] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-13T21:45:20.491267] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-13T21:45:20.601495] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:45:20.640708] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-13T21:45:20.910701] [DEBUG] [LOCAL ] SW: Loaded 53963 existing records from primary storage. [2025-10-13T21:45:20.941769] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:20.942067] [INFO ] [MAIN ] SW: Loaded 53963 existing records. [2025-10-13T21:45:21.124097] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:21.124340] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-13T21:45:21.124387] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-13T21:45:21.124973] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-13T21:45:21.125029] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-13T21:45:21.218057] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-13T21:45:21.489955] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:21.520397] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T21:45:22.017904] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-13T21:45:22.252207] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T21:45:22.320053] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T21:45:22.817973] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-13T21:45:23.411072] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T21:45:23.617971] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-13T21:45:24.417892] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-13T21:45:24.595048] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:45:24.666002] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T21:45:25.218009] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-13T21:45:25.825487] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:45:26.017978] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-13T21:45:26.812142] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T21:45:26.818485] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-13T21:45:27.617954] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-13T21:45:27.689919] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T21:45:28.420756] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-13T21:45:28.426517] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T21:45:29.217994] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-13T21:45:29.362238] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T21:45:30.017947] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-13T21:45:30.239813] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T21:45:30.751444] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:45:30.817946] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-13T21:45:31.437597] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T21:45:31.617956] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-13T21:45:32.417903] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-13T21:45:32.505440] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T21:45:33.190596] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T21:45:33.217896] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-13T21:45:34.017940] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-13T21:45:34.300412] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T21:45:34.811203] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T21:45:34.820124] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-13T21:45:35.238184] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-13T21:45:35.617900] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-13T21:45:36.133020] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T21:45:36.417956] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-13T21:45:37.217976] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-13T21:45:37.281309] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T21:45:38.018019] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-13T21:45:38.206949] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T21:45:38.817982] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-13T21:45:38.906244] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:45:39.490705] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T21:45:39.617885] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-13T21:45:40.423045] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-13T21:45:40.441854] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T21:45:40.561043] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T21:45:41.217951] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-13T21:45:42.017936] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-13T21:45:42.064713] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T21:45:42.794231] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:45:42.817895] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-13T21:45:43.228999] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T21:45:43.618002] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-13T21:45:44.245941] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T21:45:44.417946] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-13T21:45:45.217899] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-13T21:45:45.375782] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T21:45:46.009115] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T21:45:46.018136] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-13T21:45:46.811159] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:45:46.821769] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-13T21:45:47.474900] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T21:45:47.617904] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-13T21:45:48.418008] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-13T21:45:48.442897] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T21:45:48.448014] [INFO ] [REMOTE ] SUPV: Full fetch complete (68540 records). [2025-10-13T21:45:48.448138] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-13T21:45:48.832326] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-13T21:45:48.832412] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-13T21:45:48.833452] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-13T21:45:48.833517] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-13T21:45:48.834881] [DEBUG] [LOCAL ] SUPV: Trimmed 68540 records to 47691 (keeping 200 days of data) [2025-10-13T21:45:49.118729] [DEBUG] [LOCAL ] SUPV: Primary data saved (47691 records). [2025-10-13T21:45:49.118878] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-13T21:45:49.118981] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 34.2s. Estimated remaining: 48m 0s. Rate: 7.1 symbols/min [2025-10-13T21:45:49.218824] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-13T21:45:49.292221] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:49.326353] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T21:45:49.379501] [DEBUG] [LOCAL ] SWK: Loaded 53204 existing records from primary storage. [2025-10-13T21:45:49.379883] [INFO ] [MAIN ] SWK: Loaded 53204 existing records. [2025-10-13T21:45:49.555602] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:49.555826] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-13T21:45:49.555872] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-13T21:45:49.556747] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-13T21:45:49.556803] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-13T21:45:49.942992] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:49.951109] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T21:45:50.017946] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-13T21:45:50.817951] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-13T21:45:51.147568] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T21:45:51.378602] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T21:45:51.383620] [INFO ] [REMOTE ] SUZ: Full fetch complete (66640 records). [2025-10-13T21:45:51.383770] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-13T21:45:51.617987] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-13T21:45:51.783292] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-13T21:45:51.783400] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-13T21:45:51.784860] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-13T21:45:51.784928] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-13T21:45:51.786840] [DEBUG] [LOCAL ] SUZ: Trimmed 66640 records to 45687 (keeping 200 days of data) [2025-10-13T21:45:52.103186] [DEBUG] [LOCAL ] SUZ: Primary data saved (45687 records). [2025-10-13T21:45:52.103392] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-13T21:45:52.103505] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 35.4s. Estimated remaining: 47m 51s. Rate: 7.1 symbols/min [2025-10-13T21:45:52.333734] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:52.344198] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:45:52.350493] [INFO ] [REMOTE ] SVV: Full fetch complete (56837 records). [2025-10-13T21:45:52.350688] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-13T21:45:52.418231] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-13T21:45:52.665149] [DEBUG] [LOCAL ] SWX: Loaded 31622 existing records from primary storage. [2025-10-13T21:45:52.675832] [INFO ] [MAIN ] SWX: Loaded 31622 existing records. [2025-10-13T21:45:52.931795] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-13T21:45:52.948447] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-13T21:45:52.950590] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T21:45:52.961903] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-13T21:45:52.976200] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-13T21:45:53.033555] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:53.034702] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-13T21:45:53.034893] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-13T21:45:53.035814] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-13T21:45:53.035914] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-13T21:45:53.035736] [DEBUG] [LOCAL ] SVV: Trimmed 56837 records to 40109 (keeping 200 days of data) [2025-10-13T21:45:53.240037] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-13T21:45:53.504912] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:53.656500] [DEBUG] [LOCAL ] SVV: Primary data saved (40109 records). [2025-10-13T21:45:53.656751] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-13T21:45:53.656968] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SVV took 33.9s. Estimated remaining: 47m 41s. Rate: 7.1 symbols/min [2025-10-13T21:45:53.826890] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:53.834503] [DEBUG] [LOCAL ] SWZ: Loaded 6168 existing records from primary storage. [2025-10-13T21:45:53.834774] [INFO ] [MAIN ] SWZ: Loaded 6168 existing records. [2025-10-13T21:45:54.013634] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:54.013882] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-13T21:45:54.013931] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-13T21:45:54.014213] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-13T21:45:54.014280] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-13T21:45:54.029529] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-13T21:45:54.387747] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:54.421544] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T21:45:54.817966] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-13T21:45:54.934822] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T21:45:54.940492] [INFO ] [REMOTE ] SW: Full fetch complete (76823 records). [2025-10-13T21:45:54.940661] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-13T21:45:55.400613] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-13T21:45:55.402677] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-13T21:45:55.405175] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-13T21:45:55.405815] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-13T21:45:55.405977] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T21:45:55.408549] [DEBUG] [LOCAL ] SW: Trimmed 76823 records to 53184 (keeping 200 days of data) [2025-10-13T21:45:55.624851] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-13T21:45:55.676395] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T21:45:55.769772] [DEBUG] [LOCAL ] SW: Primary data saved (53184 records). [2025-10-13T21:45:55.770203] [INFO ] [MAIN ] SW: Full history saved. [2025-10-13T21:45:55.770316] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 35.6s. Estimated remaining: 47m 32s. Rate: 7.1 symbols/min [2025-10-13T21:45:55.939284] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:45:55.975378] [DEBUG] [LOCAL ] SXC: Loaded 42061 existing records from primary storage. [2025-10-13T21:45:55.975683] [INFO ] [MAIN ] SXC: Loaded 42061 existing records. [2025-10-13T21:45:56.148433] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:45:56.148719] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-13T21:45:56.148773] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-13T21:45:56.150192] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-13T21:45:56.150254] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-13T21:45:56.424175] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-13T21:45:56.501959] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:45:57.218078] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-13T21:45:57.453779] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T21:45:57.684376] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T21:45:57.702734] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T21:45:58.017957] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-13T21:45:58.597237] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T21:45:58.817942] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-13T21:45:59.617899] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-13T21:46:00.035328] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T21:46:00.140178] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T21:46:00.417944] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-13T21:46:01.217957] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-13T21:46:01.934230] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T21:46:02.017895] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-13T21:46:02.099259] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T21:46:02.626316] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T21:46:02.817905] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-13T21:46:03.617949] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-13T21:46:04.195750] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T21:46:04.226014] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:46:04.417908] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-13T21:46:05.218066] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-13T21:46:05.733087] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T21:46:06.017927] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-13T21:46:06.217883] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:46:06.817971] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-13T21:46:07.437718] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T21:46:07.617963] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-13T21:46:08.418062] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-13T21:46:08.467488] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T21:46:09.214174] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T21:46:09.217881] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-13T21:46:09.454950] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:46:09.977087] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T21:46:10.017933] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-13T21:46:10.607573] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T21:46:10.608728] [INFO ] [REMOTE ] SWZ: Full fetch complete (8180 records). [2025-10-13T21:46:10.608796] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-13T21:46:10.823021] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-13T21:46:10.969581] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-13T21:46:10.969682] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-13T21:46:10.969915] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-13T21:46:10.969954] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-13T21:46:10.970352] [DEBUG] [LOCAL ] SWZ: Trimmed 8180 records to 6072 (keeping 200 days of data) [2025-10-13T21:46:11.005326] [DEBUG] [LOCAL ] SWZ: Primary data saved (6072 records). [2025-10-13T21:46:11.005451] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-13T21:46:11.005536] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWZ took 17.3s. Estimated remaining: 47m 24s. Rate: 7.1 symbols/min [2025-10-13T21:46:11.173252] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:46:11.187696] [DEBUG] [LOCAL ] SXI: Loaded 11909 existing records from primary storage. [2025-10-13T21:46:11.187954] [INFO ] [MAIN ] SXI: Loaded 11909 existing records. [2025-10-13T21:46:11.361908] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:46:11.362133] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-13T21:46:11.362180] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-13T21:46:11.362569] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-13T21:46:11.362628] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-13T21:46:11.625370] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-13T21:46:11.719120] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:46:12.398176] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T21:46:12.417876] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-13T21:46:13.217988] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-13T21:46:13.728830] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-13T21:46:13.902755] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T21:46:14.017908] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-13T21:46:14.227304] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T21:46:14.817943] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-13T21:46:15.617954] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-13T21:46:15.659430] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:46:16.105191] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T21:46:16.417980] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-13T21:46:17.217938] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-13T21:46:17.610110] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:46:17.862283] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T21:46:17.898947] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T21:46:18.017972] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-13T21:46:18.817965] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-13T21:46:19.617908] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-13T21:46:19.869705] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T21:46:20.206946] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T21:46:20.409395] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T21:46:20.417872] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-13T21:46:21.102913] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T21:46:21.217947] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-13T21:46:22.017933] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-13T21:46:22.032444] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T21:46:22.817969] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-13T21:46:23.316561] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T21:46:23.617945] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-13T21:46:24.351314] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T21:46:24.417940] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-13T21:46:24.981834] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T21:46:25.217939] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-13T21:46:25.702302] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T21:46:25.859025] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T21:46:26.017988] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-13T21:46:26.817905] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-13T21:46:27.116361] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T21:46:27.119613] [INFO ] [REMOTE ] SWX: Full fetch complete (43907 records). [2025-10-13T21:46:27.119911] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-13T21:46:27.513632] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-13T21:46:27.513782] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-13T21:46:27.515041] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-13T21:46:27.515222] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-13T21:46:27.517475] [DEBUG] [LOCAL ] SWX: Trimmed 43907 records to 31094 (keeping 200 days of data) [2025-10-13T21:46:27.624678] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-13T21:46:27.637608] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T21:46:27.768626] [DEBUG] [LOCAL ] SWX: Primary data saved (31094 records). [2025-10-13T21:46:27.768861] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-13T21:46:27.768968] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWX took 35.7s. Estimated remaining: 47m 17s. Rate: 7.1 symbols/min [2025-10-13T21:46:27.950928] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:46:27.993178] [DEBUG] [LOCAL ] SXT: Loaded 30290 existing records from primary storage. [2025-10-13T21:46:27.993563] [INFO ] [MAIN ] SXT: Loaded 30290 existing records. [2025-10-13T21:46:28.188287] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:46:28.188620] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-13T21:46:28.188707] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-13T21:46:28.189133] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-13T21:46:28.189191] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-13T21:46:28.423441] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-13T21:46:28.573551] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:46:29.217903] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-13T21:46:29.248362] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T21:46:29.383059] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T21:46:30.017983] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-13T21:46:30.817907] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-13T21:46:30.983786] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:46:31.215685] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T21:46:31.617947] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-13T21:46:31.704888] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T21:46:32.417964] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-13T21:46:32.654374] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T21:46:33.217939] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-13T21:46:33.414623] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T21:46:34.017980] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-13T21:46:34.648741] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T21:46:34.817961] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-13T21:46:35.617908] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-13T21:46:35.864608] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T21:46:35.906865] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T21:46:36.329526] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T21:46:36.417895] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-13T21:46:37.217901] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-13T21:46:37.226478] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T21:46:37.228425] [INFO ] [REMOTE ] SXI: Full fetch complete (15318 records). [2025-10-13T21:46:37.228495] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-13T21:46:37.598683] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-13T21:46:37.598788] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-13T21:46:37.599226] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-13T21:46:37.599284] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-13T21:46:37.599848] [DEBUG] [LOCAL ] SXI: Trimmed 15318 records to 11865 (keeping 200 days of data) [2025-10-13T21:46:37.675861] [DEBUG] [LOCAL ] SXI: Primary data saved (11865 records). [2025-10-13T21:46:37.675996] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-13T21:46:37.676085] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SXI took 26.7s. Estimated remaining: 47m 9s. Rate: 7.1 symbols/min [2025-10-13T21:46:37.841724] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:46:37.897242] [DEBUG] [LOCAL ] SYF: Loaded 54226 existing records from primary storage. [2025-10-13T21:46:37.897552] [INFO ] [MAIN ] SYF: Loaded 54226 existing records. [2025-10-13T21:46:38.020110] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-13T21:46:38.077217] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:46:38.077389] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-13T21:46:38.077437] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-13T21:46:38.079477] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-13T21:46:38.079684] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-13T21:46:38.442319] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:46:38.459371] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T21:46:38.829351] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-13T21:46:38.835152] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T21:46:39.617962] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-13T21:46:40.417902] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-13T21:46:40.773944] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T21:46:41.209232] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T21:46:41.217871] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-13T21:46:41.946495] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T21:46:41.951766] [INFO ] [REMOTE ] SWK: Full fetch complete (75321 records). [2025-10-13T21:46:41.951880] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-13T21:46:42.024839] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-13T21:46:42.338958] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-13T21:46:42.339044] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-13T21:46:42.340098] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-13T21:46:42.340160] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-13T21:46:42.341544] [DEBUG] [LOCAL ] SWK: Trimmed 75321 records to 52484 (keeping 200 days of data) [2025-10-13T21:46:42.486581] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T21:46:42.699385] [DEBUG] [LOCAL ] SWK: Primary data saved (52484 records). [2025-10-13T21:46:42.699546] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-13T21:46:42.699673] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SWK took 53.6s. Estimated remaining: 47m 0s. Rate: 7.1 symbols/min [2025-10-13T21:46:42.817997] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-13T21:46:43.352622] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T21:46:43.357810] [INFO ] [REMOTE ] SXC: Full fetch complete (60862 records). [2025-10-13T21:46:43.357986] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-13T21:46:43.623172] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-13T21:46:43.740294] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-13T21:46:43.740393] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-13T21:46:43.741521] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-13T21:46:43.741589] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-13T21:46:43.743079] [DEBUG] [LOCAL ] SXC: Trimmed 60862 records to 41622 (keeping 200 days of data) [2025-10-13T21:46:43.992971] [DEBUG] [LOCAL ] SXC: Primary data saved (41622 records). [2025-10-13T21:46:43.993146] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-13T21:46:43.993294] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 48.2s. Estimated remaining: 46m 50s. Rate: 7.1 symbols/min [2025-10-13T21:46:44.594790] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T21:46:44.606637] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-13T21:46:44.859346] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T21:46:45.217959] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-13T21:46:46.268266] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:46:46.278508] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-13T21:46:46.626978] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T21:46:46.817994] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-13T21:46:48.121912] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:46:48.122981] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T21:46:48.140381] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-13T21:46:48.418004] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-13T21:46:49.732715] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T21:46:49.739741] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-13T21:46:50.017341] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T21:46:50.028602] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-13T21:46:50.917873] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T21:46:50.921530] [INFO ] [REMOTE ] SXT: Full fetch complete (39264 records). [2025-10-13T21:46:50.921618] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-13T21:46:51.311283] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-13T21:46:51.311395] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-13T21:46:51.312858] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-13T21:46:51.312927] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-13T21:46:51.314221] [DEBUG] [LOCAL ] SXT: Trimmed 39264 records to 29919 (keeping 200 days of data) [2025-10-13T21:46:51.521147] [DEBUG] [LOCAL ] SXT: Primary data saved (29919 records). [2025-10-13T21:46:51.521338] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-13T21:46:51.521437] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 23.8s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-13T21:46:51.837972] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T21:46:51.849140] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-13T21:46:53.525724] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T21:46:53.537154] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-13T21:46:55.452523] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T21:46:55.464616] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-13T21:46:57.270328] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T21:46:57.281525] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-13T21:46:59.227899] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T21:46:59.239291] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-13T21:47:00.737024] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T21:47:00.745926] [INFO ] [REMOTE ] SYF: Full fetch complete (77338 records). [2025-10-13T21:47:00.746127] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-13T21:47:01.370327] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-13T21:47:01.370459] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-13T21:47:01.372594] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-13T21:47:01.372729] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-13T21:47:01.375111] [DEBUG] [LOCAL ] SYF: Trimmed 77338 records to 53453 (keeping 200 days of data) [2025-10-13T21:47:01.829320] [DEBUG] [LOCAL ] SYF: Primary data saved (53453 records). [2025-10-13T21:47:01.829490] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-13T21:47:01.829602] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SYF took 24.2s. Estimated remaining: 46m 34s. Rate: 7.1 symbols/min [2025-10-13T21:47:02.386159] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:02.434823] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:02.563225] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:02.569809] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:02.630735] [DEBUG] [LOCAL ] SYK: Loaded 47599 existing records from primary storage. [2025-10-13T21:47:02.631290] [INFO ] [MAIN ] SYK: Loaded 47599 existing records. [2025-10-13T21:47:02.763004] [DEBUG] [LOCAL ] TAC: Loaded 43404 existing records from primary storage. [2025-10-13T21:47:02.778120] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-10-13T21:47:02.779043] [INFO ] [MAIN ] TAC: Loaded 43404 existing records. [2025-10-13T21:47:02.784327] [INFO ] [MAIN ] SYY: Loaded 54009 existing records. [2025-10-13T21:47:03.059947] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:03.110536] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-13T21:47:03.100069] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-13T21:47:03.150554] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-13T21:47:03.210716] [INFO ] [MAIN ] T: Loaded 54578 existing records. [2025-10-13T21:47:03.222910] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-13T21:47:03.252678] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:03.282918] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-13T21:47:03.298574] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-13T21:47:03.298746] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-13T21:47:03.273883] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:03.347756] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-13T21:47:03.361814] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-13T21:47:03.378346] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-13T21:47:03.392337] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-13T21:47:03.402870] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-13T21:47:03.463756] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-13T21:47:03.587262] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:03.642365] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-13T21:47:03.651071] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-13T21:47:03.696834] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-13T21:47:03.731108] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-13T21:47:04.570863] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:04.636373] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-13T21:47:04.841468] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:04.864078] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-13T21:47:04.867254] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:04.868329] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-13T21:47:04.950961] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:04.951254] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-13T21:47:06.471638] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T21:47:06.481102] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-13T21:47:06.529732] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T21:47:06.539086] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-13T21:47:06.688998] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T21:47:06.700443] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-13T21:47:07.542993] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-13T21:47:07.553795] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-13T21:47:08.090172] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T21:47:08.100731] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-13T21:47:08.159458] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:47:08.169778] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-13T21:47:08.237496] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T21:47:08.247845] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-13T21:47:09.765713] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T21:47:09.775807] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-13T21:47:09.860438] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T21:47:09.870611] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-13T21:47:09.963173] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T21:47:09.973430] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-13T21:47:10.024750] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-13T21:47:10.035399] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-13T21:47:11.359377] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T21:47:11.369102] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-13T21:47:11.685410] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T21:47:11.695894] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-13T21:47:11.844628] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T21:47:11.856004] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-13T21:47:11.944447] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:47:11.954810] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-13T21:47:12.604524] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T21:47:12.615173] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-13T21:47:13.432109] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T21:47:13.443345] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-13T21:47:13.851005] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T21:47:13.862557] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-13T21:47:14.137755] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T21:47:14.146883] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-13T21:47:14.345856] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-13T21:47:14.357272] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-13T21:47:15.072582] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T21:47:15.083159] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-13T21:47:15.435849] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:47:15.447175] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-13T21:47:15.729357] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T21:47:15.738949] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-13T21:47:16.566162] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-13T21:47:16.577378] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-13T21:47:16.832394] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T21:47:17.217890] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-13T21:47:17.351728] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T21:47:17.390427] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T21:47:18.017986] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-13T21:47:18.817944] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-13T21:47:18.921084] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-13T21:47:18.964990] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T21:47:19.617955] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-13T21:47:19.965943] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T21:47:20.203303] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T21:47:20.417972] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-13T21:47:21.217938] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-13T21:47:21.731134] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T21:47:21.921355] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-13T21:47:22.017893] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-13T21:47:22.817943] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-13T21:47:23.008923] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T21:47:23.617963] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-13T21:47:24.417986] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-13T21:47:24.497232] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T21:47:24.723480] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T21:47:24.729127] [INFO ] [REMOTE ] TAC: Full fetch complete (64010 records). [2025-10-13T21:47:24.729303] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-13T21:47:25.077741] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-13T21:47:25.161830] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-13T21:47:25.161908] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-13T21:47:25.162898] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-13T21:47:25.162959] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-13T21:47:25.164158] [DEBUG] [LOCAL ] TAC: Trimmed 64010 records to 42894 (keeping 200 days of data) [2025-10-13T21:47:25.227260] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-13T21:47:25.442820] [DEBUG] [LOCAL ] TAC: Primary data saved (42894 records). [2025-10-13T21:47:25.443042] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-13T21:47:25.443164] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. TAC took 23.6s. Estimated remaining: 46m 28s. Rate: 7.1 symbols/min [2025-10-13T21:47:25.622715] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:25.679567] [DEBUG] [LOCAL ] TAK: Loaded 50719 existing records from primary storage. [2025-10-13T21:47:25.680006] [INFO ] [MAIN ] TAK: Loaded 50719 existing records. [2025-10-13T21:47:25.866745] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:25.867332] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-13T21:47:25.867422] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-13T21:47:25.868213] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-13T21:47:25.868431] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-13T21:47:26.018997] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-13T21:47:26.215599] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T21:47:26.309055] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:26.817970] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-13T21:47:27.593987] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-13T21:47:27.617891] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-13T21:47:27.912413] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T21:47:28.417898] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-13T21:47:28.599349] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T21:47:28.990234] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:47:28.996008] [INFO ] [REMOTE ] SYY: Full fetch complete (76997 records). [2025-10-13T21:47:28.996318] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-13T21:47:29.223030] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-13T21:47:29.380128] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-13T21:47:29.380210] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-13T21:47:29.381344] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-13T21:47:29.381406] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-13T21:47:29.382922] [DEBUG] [LOCAL ] SYY: Trimmed 76997 records to 53240 (keeping 200 days of data) [2025-10-13T21:47:29.715247] [DEBUG] [LOCAL ] SYY: Primary data saved (53240 records). [2025-10-13T21:47:29.715380] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-13T21:47:29.716330] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 27.9s. Estimated remaining: 46m 19s. Rate: 7.1 symbols/min [2025-10-13T21:47:29.885601] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:29.950672] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T21:47:29.979492] [DEBUG] [LOCAL ] TAL: Loaded 52579 existing records from primary storage. [2025-10-13T21:47:29.979879] [INFO ] [MAIN ] TAL: Loaded 52579 existing records. [2025-10-13T21:47:30.023192] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-13T21:47:30.157296] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:30.157516] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-13T21:47:30.157564] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-13T21:47:30.158007] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-13T21:47:30.158096] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-13T21:47:30.509738] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:30.527580] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T21:47:30.534129] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-13T21:47:30.534369] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-13T21:47:30.818895] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-13T21:47:30.959044] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-13T21:47:30.959225] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-13T21:47:30.960867] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-13T21:47:30.960948] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-13T21:47:30.992590] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-10-13T21:47:30.994114] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T21:47:31.247179] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-13T21:47:31.254286] [INFO ] [REMOTE ] SYK: Full fetch complete (68930 records). [2025-10-13T21:47:31.256708] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-13T21:47:31.628560] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-13T21:47:31.757519] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-13T21:47:31.758555] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-13T21:47:31.759679] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-13T21:47:31.759994] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-13T21:47:31.765292] [DEBUG] [LOCAL ] SYK: Trimmed 68930 records to 46939 (keeping 200 days of data) [2025-10-13T21:47:31.767903] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-13T21:47:31.768323] [INFO ] [MAIN ] T: Full history saved. [2025-10-13T21:47:31.768426] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 29.9s. Estimated remaining: 46m 9s. Rate: 7.1 symbols/min [2025-10-13T21:47:32.059613] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:32.251175] [DEBUG] [LOCAL ] SYK: Primary data saved (46939 records). [2025-10-13T21:47:32.251495] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-13T21:47:32.264219] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYK took 30.4s. Estimated remaining: 45m 59s. Rate: 7.1 symbols/min [2025-10-13T21:47:32.340021] [DEBUG] [LOCAL ] TALO: Loaded 51598 existing records from primary storage. [2025-10-13T21:47:32.365696] [INFO ] [MAIN ] TALO: Loaded 51598 existing records. [2025-10-13T21:47:32.419299] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-13T21:47:32.541186] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:47:32.638209] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:32.638493] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-13T21:47:32.638565] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-13T21:47:32.639179] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-13T21:47:32.639240] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-13T21:47:32.923440] [DEBUG] [LOCAL ] TAP: Loaded 53692 existing records from primary storage. [2025-10-13T21:47:32.956392] [INFO ] [MAIN ] TAP: Loaded 53692 existing records. [2025-10-13T21:47:33.188530] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:33.227667] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-13T21:47:33.249116] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:47:33.249553] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-13T21:47:33.249674] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-13T21:47:33.250354] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-13T21:47:33.250416] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-13T21:47:33.653839] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:47:33.657223] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T21:47:34.018089] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-13T21:47:34.159381] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T21:47:34.817946] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-13T21:47:35.039973] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T21:47:35.618014] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-13T21:47:35.799129] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T21:47:36.247346] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:47:36.417896] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-13T21:47:37.223025] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-13T21:47:37.239287] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:47:38.017955] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-13T21:47:38.170723] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T21:47:38.623071] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T21:47:38.817943] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-13T21:47:39.617985] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-13T21:47:39.794118] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T21:47:40.417999] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-13T21:47:40.631240] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T21:47:41.210104] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T21:47:41.219142] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-13T21:47:41.830913] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:47:42.017980] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-13T21:47:42.817961] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-13T21:47:43.024009] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:47:43.617945] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-13T21:47:43.654289] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T21:47:44.287551] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T21:47:44.417983] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-13T21:47:45.217955] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-13T21:47:45.698018] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T21:47:45.734548] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:47:46.017941] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-13T21:47:46.678035] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T21:47:46.817950] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-13T21:47:47.617905] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-13T21:47:47.900983] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T21:47:48.268367] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T21:47:48.417978] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-13T21:47:49.217931] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-13T21:47:49.256116] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:47:50.017936] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-13T21:47:50.333220] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T21:47:50.818036] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-13T21:47:51.075770] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T21:47:51.617886] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-13T21:47:51.839219] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T21:47:52.417962] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-13T21:47:52.506250] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:47:53.130441] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T21:47:53.217959] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-13T21:47:54.017956] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-13T21:47:54.158096] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T21:47:54.817927] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-13T21:47:54.956838] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T21:47:55.617961] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-13T21:47:55.669774] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:47:56.424819] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-13T21:47:56.431089] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T21:47:57.224712] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-13T21:47:57.250080] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T21:47:58.020950] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-13T21:47:58.027943] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T21:47:58.638673] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T21:47:58.817948] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-13T21:47:59.617926] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-13T21:47:59.685483] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T21:47:59.727378] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T21:48:00.417954] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-13T21:48:01.217958] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-13T21:48:01.442371] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T21:48:01.896152] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T21:48:01.901306] [INFO ] [REMOTE ] TAK: Full fetch complete (71741 records). [2025-10-13T21:48:01.901411] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-13T21:48:02.023185] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-13T21:48:02.303484] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-13T21:48:02.303614] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-13T21:48:02.304952] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-13T21:48:02.305037] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-13T21:48:02.307221] [DEBUG] [LOCAL ] TAK: Trimmed 71741 records to 50073 (keeping 200 days of data) [2025-10-13T21:48:02.640273] [DEBUG] [LOCAL ] TAK: Primary data saved (50073 records). [2025-10-13T21:48:02.640488] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-13T21:48:02.640618] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAK took 37.2s. Estimated remaining: 45m 55s. Rate: 7.1 symbols/min [2025-10-13T21:48:02.819599] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-13T21:48:02.821449] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:02.839876] [DEBUG] [LOCAL ] TBB: Loaded 11799 existing records from primary storage. [2025-10-13T21:48:02.840193] [INFO ] [MAIN ] TBB: Loaded 11799 existing records. [2025-10-13T21:48:03.043159] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T21:48:03.049413] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:03.056050] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-13T21:48:03.056152] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-13T21:48:03.056323] [INFO ] [REMOTE ] TAP: Full fetch complete (76244 records). [2025-10-13T21:48:03.056472] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-13T21:48:03.056435] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-13T21:48:03.056573] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-13T21:48:03.752308] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T21:48:03.852209] [INFO ] [REMOTE ] TAL: Full fetch complete (75521 records). [2025-10-13T21:48:03.851975] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:03.872417] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-13T21:48:03.891430] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-13T21:48:03.891909] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-13T21:48:03.892050] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-13T21:48:03.907392] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-13T21:48:03.907593] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-13T21:48:03.995885] [DEBUG] [LOCAL ] TAP: Trimmed 76244 records to 52947 (keeping 200 days of data) [2025-10-13T21:48:04.550119] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-13T21:48:04.557714] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-13T21:48:04.562565] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-13T21:48:04.567019] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-13T21:48:04.600876] [DEBUG] [LOCAL ] TAL: Trimmed 75521 records to 51801 (keeping 200 days of data) [2025-10-13T21:48:04.602951] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T21:48:04.617988] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-13T21:48:04.959356] [DEBUG] [LOCAL ] TAP: Primary data saved (52947 records). [2025-10-13T21:48:04.967589] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-13T21:48:04.968684] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAP took 32.7s. Estimated remaining: 45m 45s. Rate: 7.1 symbols/min [2025-10-13T21:48:04.983719] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T21:48:05.213680] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:05.222895] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-13T21:48:05.233325] [DEBUG] [LOCAL ] TAL: Primary data saved (51801 records). [2025-10-13T21:48:05.233588] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-13T21:48:05.233730] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 35.5s. Estimated remaining: 45m 35s. Rate: 7.1 symbols/min [2025-10-13T21:48:05.428960] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:05.430140] [DEBUG] [LOCAL ] TBBB: Loaded 36241 existing records from primary storage. [2025-10-13T21:48:05.430472] [INFO ] [MAIN ] TBBB: Loaded 36241 existing records. [2025-10-13T21:48:05.621246] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:05.622585] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-13T21:48:05.622701] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-13T21:48:05.623188] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-13T21:48:05.623287] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-13T21:48:05.623122] [DEBUG] [LOCAL ] TBI: Loaded 22719 existing records from primary storage. [2025-10-13T21:48:05.685295] [INFO ] [MAIN ] TBI: Loaded 22719 existing records. [2025-10-13T21:48:06.015477] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:06.056577] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-13T21:48:06.056840] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-13T21:48:06.077133] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-13T21:48:06.077335] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-13T21:48:06.318497] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:06.331561] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-13T21:48:06.332638] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T21:48:06.596735] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:06.632713] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T21:48:06.817955] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-13T21:48:07.621481] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-13T21:48:07.826954] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T21:48:08.218357] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T21:48:08.226236] [INFO ] [REMOTE ] TALO: Full fetch complete (73263 records). [2025-10-13T21:48:08.226420] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-13T21:48:08.405086] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T21:48:08.421104] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-13T21:48:08.658363] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-13T21:48:08.658444] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-13T21:48:08.659541] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-13T21:48:08.659606] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-13T21:48:08.661558] [DEBUG] [LOCAL ] TALO: Trimmed 73263 records to 50947 (keeping 200 days of data) [2025-10-13T21:48:08.951420] [DEBUG] [LOCAL ] TALO: Primary data saved (50947 records). [2025-10-13T21:48:08.951552] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-13T21:48:08.951635] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 37.2s. Estimated remaining: 45m 26s. Rate: 7.1 symbols/min [2025-10-13T21:48:09.119755] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:09.119921] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-13T21:48:09.119957] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-13T21:48:09.120107] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-13T21:48:09.120161] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-13T21:48:09.120204] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-13T21:48:09.120236] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-13T21:48:09.218374] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-13T21:48:09.386545] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T21:48:09.493616] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:10.017979] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-13T21:48:10.476430] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T21:48:10.817972] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-13T21:48:10.930962] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T21:48:11.157385] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T21:48:11.617968] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-13T21:48:12.008191] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-13T21:48:12.417965] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-13T21:48:13.217898] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-13T21:48:13.534568] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T21:48:13.546542] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T21:48:14.017942] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-13T21:48:14.817968] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-13T21:48:15.603176] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T21:48:15.617872] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-13T21:48:15.723634] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T21:48:16.417943] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-13T21:48:16.764522] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T21:48:17.217941] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-13T21:48:17.302398] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T21:48:18.017982] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-13T21:48:18.292613] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T21:48:18.350882] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T21:48:18.817904] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-13T21:48:19.207099] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T21:48:19.617978] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-13T21:48:19.960340] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T21:48:20.417974] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-13T21:48:21.217957] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-13T21:48:21.855253] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:48:22.017954] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-13T21:48:22.302091] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T21:48:22.817954] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-13T21:48:23.398323] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T21:48:23.413193] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T21:48:23.617935] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-13T21:48:23.896675] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-13T21:48:24.417955] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-13T21:48:25.217955] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-13T21:48:25.625201] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T21:48:25.632719] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-13T21:48:26.017958] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-13T21:48:26.817951] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-13T21:48:27.222863] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T21:48:27.486103] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-13T21:48:27.617898] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-13T21:48:28.417978] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-13T21:48:28.933247] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:48:29.029463] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T21:48:29.217969] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-13T21:48:29.557734] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T21:48:29.558456] [INFO ] [REMOTE ] TBLU: Full fetch complete (1199 records). [2025-10-13T21:48:29.558522] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-13T21:48:29.738505] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T21:48:29.738745] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T21:48:29.738796] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T21:48:29.738864] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-13T21:48:29.738935] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-13T21:48:29.738971] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-13T21:48:29.739013] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-13T21:48:29.739078] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBLU took 20.8s. Estimated remaining: 45m 20s. Rate: 7.1 symbols/min [2025-10-13T21:48:29.909127] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:29.915873] [DEBUG] [LOCAL ] TBN: Loaded 3943 existing records from primary storage. [2025-10-13T21:48:29.916053] [INFO ] [MAIN ] TBN: Loaded 3943 existing records. [2025-10-13T21:48:30.023076] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-13T21:48:30.097246] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:30.097576] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-13T21:48:30.097625] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-13T21:48:30.097859] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-13T21:48:30.097936] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-13T21:48:30.456022] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:30.817893] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-13T21:48:30.856588] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T21:48:31.617895] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-13T21:48:31.790875] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:48:32.417128] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T21:48:32.418779] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-13T21:48:33.217974] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-13T21:48:33.467755] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T21:48:34.018017] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-13T21:48:34.482474] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-13T21:48:34.780338] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T21:48:34.817894] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-13T21:48:35.617980] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-13T21:48:36.221485] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T21:48:36.417965] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-13T21:48:36.639530] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T21:48:37.080209] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T21:48:37.081879] [INFO ] [REMOTE ] TBB: Full fetch complete (16863 records). [2025-10-13T21:48:37.081953] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-13T21:48:37.229865] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-13T21:48:37.471138] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-13T21:48:37.471257] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-13T21:48:37.471950] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-13T21:48:37.472025] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-13T21:48:37.473071] [DEBUG] [LOCAL ] TBB: Trimmed 16863 records to 11602 (keeping 200 days of data) [2025-10-13T21:48:37.553477] [DEBUG] [LOCAL ] TBB: Primary data saved (11602 records). [2025-10-13T21:48:37.553726] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-13T21:48:37.553900] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBB took 34.9s. Estimated remaining: 45m 11s. Rate: 7.1 symbols/min [2025-10-13T21:48:37.733480] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:37.733741] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-13T21:48:37.733792] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-13T21:48:37.733918] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-13T21:48:37.733961] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-13T21:48:37.734003] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-13T21:48:37.734037] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-13T21:48:38.023074] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-13T21:48:38.110306] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:38.376192] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T21:48:38.426975] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T21:48:38.817971] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-13T21:48:39.426596] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T21:48:39.617933] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-13T21:48:40.180600] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T21:48:40.417944] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-13T21:48:41.217994] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-13T21:48:41.758055] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T21:48:41.777198] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T21:48:42.017965] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-13T21:48:42.817904] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-13T21:48:43.004589] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T21:48:43.248794] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:48:43.617960] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-13T21:48:44.088132] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-13T21:48:44.417936] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-13T21:48:44.976604] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T21:48:45.217948] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-13T21:48:46.017890] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-13T21:48:46.208540] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T21:48:46.211161] [INFO ] [REMOTE ] TBI: Full fetch complete (31664 records). [2025-10-13T21:48:46.211233] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-13T21:48:46.581760] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-13T21:48:46.581837] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-13T21:48:46.582477] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-13T21:48:46.582536] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-13T21:48:46.583397] [DEBUG] [LOCAL ] TBI: Trimmed 31664 records to 22509 (keeping 200 days of data) [2025-10-13T21:48:46.707588] [DEBUG] [LOCAL ] TBI: Primary data saved (22509 records). [2025-10-13T21:48:46.707739] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-13T21:48:46.707824] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 41.5s. Estimated remaining: 45m 3s. Rate: 7.1 symbols/min [2025-10-13T21:48:46.823122] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-13T21:48:46.877520] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:46.889787] [DEBUG] [LOCAL ] TCBX: Loaded 10298 existing records from primary storage. [2025-10-13T21:48:46.890012] [INFO ] [MAIN ] TCBX: Loaded 10298 existing records. [2025-10-13T21:48:47.037600] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T21:48:47.076900] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:48:47.081523] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:47.082157] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-13T21:48:47.082412] [INFO ] [REMOTE ] TBBB: Full fetch complete (51627 records). [2025-10-13T21:48:47.082229] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-13T21:48:47.082691] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:48:47.082597] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-13T21:48:47.082846] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-13T21:48:47.082931] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-13T21:48:47.083204] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:48:47.083472] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-13T21:48:47.083368] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-13T21:48:47.095032] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-13T21:48:47.104672] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-13T21:48:47.167585] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-13T21:48:47.190823] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-13T21:48:47.201284] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TCAI took 9.6s. Estimated remaining: 44m 53s. Rate: 7.1 symbols/min [2025-10-13T21:48:47.638292] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-13T21:48:47.839957] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:47.988966] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-13T21:48:47.999873] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-13T21:48:48.000794] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-13T21:48:48.017414] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-13T21:48:48.023633] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:48.025295] [DEBUG] [LOCAL ] TBBB: Trimmed 51627 records to 35826 (keeping 200 days of data) [2025-10-13T21:48:48.130760] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T21:48:48.153176] [DEBUG] [LOCAL ] TD: Loaded 53114 existing records from primary storage. [2025-10-13T21:48:48.154272] [INFO ] [MAIN ] TD: Loaded 53114 existing records. [2025-10-13T21:48:48.424290] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-13T21:48:48.423959] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:48.427314] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-13T21:48:48.427714] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-13T21:48:48.429330] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-13T21:48:48.429783] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-13T21:48:48.811119] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:48.818980] [DEBUG] [LOCAL ] TBBB: Primary data saved (35826 records). [2025-10-13T21:48:48.819064] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-13T21:48:48.819136] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBBB took 43.8s. Estimated remaining: 44m 44s. Rate: 7.1 symbols/min [2025-10-13T21:48:48.990239] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:49.035032] [DEBUG] [LOCAL ] TDC: Loaded 47272 existing records from primary storage. [2025-10-13T21:48:49.035329] [INFO ] [MAIN ] TDC: Loaded 47272 existing records. [2025-10-13T21:48:49.219260] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-13T21:48:49.214817] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T21:48:49.219128] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:49.222750] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-13T21:48:49.223098] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-13T21:48:49.223537] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-13T21:48:49.223592] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-13T21:48:49.574783] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:50.017952] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-13T21:48:50.191311] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T21:48:50.817971] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-13T21:48:51.179841] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T21:48:51.617948] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-13T21:48:51.715095] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T21:48:52.336570] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T21:48:52.338286] [INFO ] [REMOTE ] TBN: Full fetch complete (5788 records). [2025-10-13T21:48:52.338353] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-13T21:48:52.423171] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-13T21:48:52.694586] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-13T21:48:52.694686] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-13T21:48:52.694914] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-13T21:48:52.694970] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-13T21:48:52.695329] [DEBUG] [LOCAL ] TBN: Trimmed 5788 records to 3906 (keeping 200 days of data) [2025-10-13T21:48:52.718392] [DEBUG] [LOCAL ] TBN: Primary data saved (3906 records). [2025-10-13T21:48:52.718461] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-13T21:48:52.718530] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBN took 23.0s. Estimated remaining: 44m 34s. Rate: 7.1 symbols/min [2025-10-13T21:48:52.886196] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:48:52.895958] [DEBUG] [LOCAL ] TDF: Loaded 6355 existing records from primary storage. [2025-10-13T21:48:52.896162] [INFO ] [MAIN ] TDF: Loaded 6355 existing records. [2025-10-13T21:48:53.080405] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:48:53.080725] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-13T21:48:53.080783] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-13T21:48:53.080969] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-13T21:48:53.081024] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-13T21:48:53.223132] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-13T21:48:53.378169] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T21:48:53.458685] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:48:54.017933] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-13T21:48:54.817951] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-13T21:48:54.873185] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T21:48:55.213503] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T21:48:55.605050] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T21:48:55.617903] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-13T21:48:56.089694] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T21:48:56.417969] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-13T21:48:57.184045] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:48:57.217873] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-13T21:48:58.007975] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T21:48:58.017893] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-13T21:48:58.817988] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-13T21:48:59.486899] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T21:48:59.543553] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T21:48:59.618014] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-13T21:49:00.418008] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-13T21:49:00.525346] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T21:49:01.218044] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-13T21:49:01.956758] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T21:49:02.023007] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-13T21:49:02.039408] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T21:49:02.674357] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T21:49:02.818000] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-13T21:49:03.617969] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-13T21:49:04.417954] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-13T21:49:04.580209] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T21:49:05.104538] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:49:05.189618] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T21:49:05.217885] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-13T21:49:05.947805] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T21:49:06.017895] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-13T21:49:06.778589] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T21:49:06.817883] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-13T21:49:07.335809] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T21:49:07.617946] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-13T21:49:08.256843] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T21:49:08.417891] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-13T21:49:08.952921] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T21:49:08.954557] [INFO ] [REMOTE ] TCBX: Full fetch complete (15845 records). [2025-10-13T21:49:08.954625] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-13T21:49:09.223064] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-13T21:49:09.320221] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-13T21:49:09.320326] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-13T21:49:09.320914] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-13T21:49:09.320978] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-13T21:49:09.321557] [DEBUG] [LOCAL ] TCBX: Trimmed 15845 records to 10156 (keeping 200 days of data) [2025-10-13T21:49:09.387454] [DEBUG] [LOCAL ] TCBX: Primary data saved (10156 records). [2025-10-13T21:49:09.387677] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-13T21:49:09.387796] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TCBX took 22.7s. Estimated remaining: 44m 27s. Rate: 7.1 symbols/min [2025-10-13T21:49:09.572846] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:09.601959] [DEBUG] [LOCAL ] TDG: Loaded 22311 existing records from primary storage. [2025-10-13T21:49:09.602253] [INFO ] [MAIN ] TDG: Loaded 22311 existing records. [2025-10-13T21:49:09.778567] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:49:09.778838] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-13T21:49:09.778887] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-13T21:49:09.779224] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-13T21:49:09.779279] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-13T21:49:10.023099] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-13T21:49:10.156502] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:49:10.817905] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-13T21:49:11.020919] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T21:49:11.250935] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-13T21:49:11.617961] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-13T21:49:11.666779] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T21:49:12.417987] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-13T21:49:12.897145] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T21:49:13.217941] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-13T21:49:14.017900] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-13T21:49:14.349238] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T21:49:14.377795] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T21:49:14.653590] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T21:49:14.817948] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-13T21:49:15.617947] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-13T21:49:15.993908] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T21:49:16.417940] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-13T21:49:17.029403] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T21:49:17.193583] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T21:49:17.217878] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-13T21:49:17.918783] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T21:49:17.920093] [INFO ] [REMOTE ] TDF: Full fetch complete (10437 records). [2025-10-13T21:49:17.920162] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-13T21:49:18.018292] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-13T21:49:18.273082] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-13T21:49:18.273166] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-13T21:49:18.273435] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-13T21:49:18.273472] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-13T21:49:18.273908] [DEBUG] [LOCAL ] TDF: Trimmed 10437 records to 6364 (keeping 200 days of data) [2025-10-13T21:49:18.313994] [DEBUG] [LOCAL ] TDF: Primary data saved (6364 records). [2025-10-13T21:49:18.314107] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-13T21:49:18.314188] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 25.6s. Estimated remaining: 44m 19s. Rate: 7.1 symbols/min [2025-10-13T21:49:18.484387] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:18.553141] [DEBUG] [LOCAL ] TDOC: Loaded 54129 existing records from primary storage. [2025-10-13T21:49:18.553608] [INFO ] [MAIN ] TDOC: Loaded 54129 existing records. [2025-10-13T21:49:18.739366] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:49:18.739692] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-13T21:49:18.739753] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-13T21:49:18.740527] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-13T21:49:18.740587] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-13T21:49:18.823100] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-13T21:49:19.168867] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:49:19.620352] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-13T21:49:19.625428] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T21:49:19.920286] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T21:49:20.417962] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-13T21:49:21.217886] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-13T21:49:21.418373] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T21:49:22.018038] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-13T21:49:22.342162] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T21:49:22.640983] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-13T21:49:22.817954] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-13T21:49:23.595574] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T21:49:23.617880] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-13T21:49:24.417904] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-13T21:49:24.781810] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T21:49:25.217958] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-13T21:49:25.544917] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T21:49:25.669050] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T21:49:26.017975] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-13T21:49:26.646708] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T21:49:26.817940] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-13T21:49:27.088113] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T21:49:27.617974] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-13T21:49:28.417946] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-13T21:49:28.972299] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-13T21:49:29.217938] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-13T21:49:29.494484] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T21:49:29.514128] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T21:49:30.018000] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-13T21:49:30.817905] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-13T21:49:31.110857] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T21:49:31.361945] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T21:49:31.617957] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-13T21:49:32.152996] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T21:49:32.417992] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-13T21:49:33.217979] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-13T21:49:33.341470] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T21:49:34.017960] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-13T21:49:34.156313] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T21:49:34.817944] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-13T21:49:35.541307] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T21:49:35.546236] [INFO ] [REMOTE ] TDC: Full fetch complete (67327 records). [2025-10-13T21:49:35.546344] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-13T21:49:35.622988] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-13T21:49:35.859165] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-13T21:49:35.986003] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-13T21:49:35.986212] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-13T21:49:35.987235] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-13T21:49:35.987422] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-13T21:49:35.989060] [DEBUG] [LOCAL ] TDC: Trimmed 67327 records to 46559 (keeping 200 days of data) [2025-10-13T21:49:36.013150] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T21:49:36.291599] [DEBUG] [LOCAL ] TDC: Primary data saved (46559 records). [2025-10-13T21:49:36.291771] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-13T21:49:36.291866] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDC took 47.5s. Estimated remaining: 44m 12s. Rate: 7.1 symbols/min [2025-10-13T21:49:36.427305] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-13T21:49:36.459186] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:36.499566] [DEBUG] [LOCAL ] TDS: Loaded 43218 existing records from primary storage. [2025-10-13T21:49:36.499936] [INFO ] [MAIN ] TDS: Loaded 43218 existing records. [2025-10-13T21:49:36.675327] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:49:36.675581] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-13T21:49:36.675684] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-13T21:49:36.675993] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-13T21:49:36.676064] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-13T21:49:36.971798] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T21:49:37.039528] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:49:37.042207] [INFO ] [REMOTE ] TDG: Full fetch complete (31756 records). [2025-10-13T21:49:37.042445] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-13T21:49:37.242165] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-13T21:49:37.450766] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T21:49:37.468910] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-13T21:49:37.469002] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-13T21:49:37.469880] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-13T21:49:37.469971] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-13T21:49:37.471214] [DEBUG] [LOCAL ] TDG: Trimmed 31756 records to 22020 (keeping 200 days of data) [2025-10-13T21:49:37.617319] [DEBUG] [LOCAL ] TDG: Primary data saved (22020 records). [2025-10-13T21:49:37.617455] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-13T21:49:37.617539] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 28.2s. Estimated remaining: 44m 2s. Rate: 7.1 symbols/min [2025-10-13T21:49:37.786261] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:37.829192] [DEBUG] [LOCAL ] TDW: Loaded 45772 existing records from primary storage. [2025-10-13T21:49:37.829504] [INFO ] [MAIN ] TDW: Loaded 45772 existing records. [2025-10-13T21:49:38.005004] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:49:38.005227] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-13T21:49:38.005273] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-13T21:49:38.005668] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-13T21:49:38.005727] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-13T21:49:38.025604] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-13T21:49:38.356894] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:49:38.817982] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-13T21:49:38.888264] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T21:49:39.617963] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-13T21:49:39.647889] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T21:49:39.654513] [INFO ] [REMOTE ] TD: Full fetch complete (75746 records). [2025-10-13T21:49:39.654699] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-13T21:49:40.049586] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-13T21:49:40.049689] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-13T21:49:40.050748] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-13T21:49:40.050807] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-13T21:49:40.052366] [DEBUG] [LOCAL ] TD: Trimmed 75746 records to 52324 (keeping 200 days of data) [2025-10-13T21:49:40.342222] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T21:49:40.422395] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-13T21:49:40.448190] [DEBUG] [LOCAL ] TD: Primary data saved (52324 records). [2025-10-13T21:49:40.448345] [INFO ] [MAIN ] TD: Full history saved. [2025-10-13T21:49:40.448435] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TD took 53.2s. Estimated remaining: 43m 53s. Rate: 7.1 symbols/min [2025-10-13T21:49:40.616564] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:40.639493] [DEBUG] [LOCAL ] TDY: Loaded 22699 existing records from primary storage. [2025-10-13T21:49:40.639784] [INFO ] [MAIN ] TDY: Loaded 22699 existing records. [2025-10-13T21:49:40.820816] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:49:40.821004] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-13T21:49:40.821049] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-13T21:49:40.821255] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-13T21:49:40.821310] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-13T21:49:41.199219] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:49:41.219535] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-13T21:49:41.221815] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T21:49:42.017940] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-13T21:49:42.167951] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T21:49:42.444899] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T21:49:42.817986] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-13T21:49:43.617960] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-13T21:49:43.957318] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T21:49:44.016540] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T21:49:44.417955] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-13T21:49:44.939473] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T21:49:45.217999] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-13T21:49:46.018058] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-13T21:49:46.413174] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T21:49:46.412631] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T21:49:46.817941] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-13T21:49:47.617970] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-13T21:49:47.681586] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T21:49:47.839165] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T21:49:48.417959] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-13T21:49:49.218037] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-13T21:49:49.943960] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T21:49:49.986346] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-13T21:49:50.017927] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-13T21:49:50.564895] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T21:49:50.817985] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-13T21:49:51.502984] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T21:49:51.617895] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-13T21:49:52.417922] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-13T21:49:52.782291] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T21:49:53.217904] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-13T21:49:53.335369] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T21:49:53.389953] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:49:54.017952] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-13T21:49:54.817891] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-13T21:49:54.919554] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T21:49:55.617950] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-13T21:49:55.672103] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T21:49:56.418008] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-13T21:49:56.721062] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T21:49:56.786433] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T21:49:57.217975] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-13T21:49:57.749904] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T21:49:58.018002] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-13T21:49:58.817894] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-13T21:49:58.833411] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T21:49:58.839085] [INFO ] [REMOTE ] TDOC: Full fetch complete (77310 records). [2025-10-13T21:49:58.839204] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-13T21:49:59.241884] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-13T21:49:59.242084] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-13T21:49:59.243375] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-13T21:49:59.243459] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-13T21:49:59.245216] [DEBUG] [LOCAL ] TDOC: Trimmed 77310 records to 53359 (keeping 200 days of data) [2025-10-13T21:49:59.361433] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T21:49:59.586802] [DEBUG] [LOCAL ] TDOC: Primary data saved (53359 records). [2025-10-13T21:49:59.586981] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-13T21:49:59.587070] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDOC took 41.3s. Estimated remaining: 43m 46s. Rate: 7.1 symbols/min [2025-10-13T21:49:59.623199] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-13T21:49:59.761664] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:49:59.761819] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-13T21:49:59.761856] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-13T21:49:59.761965] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-13T21:49:59.762005] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-13T21:49:59.762057] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-13T21:49:59.762119] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-13T21:50:00.142620] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:00.170736] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T21:50:00.417939] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-13T21:50:01.217994] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-13T21:50:01.416321] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T21:50:01.804710] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T21:50:02.018063] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-13T21:50:02.233264] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:50:02.233590] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-13T21:50:02.233716] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:50:02.233768] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-13T21:50:02.233828] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:50:02.233900] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-13T21:50:02.233962] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-13T21:50:02.233998] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-13T21:50:02.234038] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-13T21:50:02.234085] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 2.6s. Estimated remaining: 43m 37s. Rate: 7.1 symbols/min [2025-10-13T21:50:02.359453] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T21:50:02.415634] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:02.426235] [DEBUG] [LOCAL ] TEAF: Loaded 7606 existing records from primary storage. [2025-10-13T21:50:02.426419] [INFO ] [MAIN ] TEAF: Loaded 7606 existing records. [2025-10-13T21:50:02.612674] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:02.612871] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-13T21:50:02.612919] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-13T21:50:02.613191] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-13T21:50:02.613264] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-13T21:50:02.823012] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-13T21:50:02.997438] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:03.618003] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-13T21:50:04.412629] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:50:04.422971] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-13T21:50:04.500559] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T21:50:05.217937] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-13T21:50:05.530606] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T21:50:06.017948] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-13T21:50:06.467571] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T21:50:06.469903] [INFO ] [REMOTE ] TDY: Full fetch complete (31897 records). [2025-10-13T21:50:06.470006] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-13T21:50:06.826007] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-13T21:50:06.859984] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-13T21:50:06.860184] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-13T21:50:06.861070] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-13T21:50:06.861257] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-13T21:50:06.862534] [DEBUG] [LOCAL ] TDY: Trimmed 31897 records to 22351 (keeping 200 days of data) [2025-10-13T21:50:06.984519] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T21:50:07.038494] [DEBUG] [LOCAL ] TDY: Primary data saved (22351 records). [2025-10-13T21:50:07.038675] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-13T21:50:07.038788] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 26.6s. Estimated remaining: 43m 28s. Rate: 7.1 symbols/min [2025-10-13T21:50:07.209362] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:07.260928] [DEBUG] [LOCAL ] TECK: Loaded 54219 existing records from primary storage. [2025-10-13T21:50:07.261296] [INFO ] [MAIN ] TECK: Loaded 54219 existing records. [2025-10-13T21:50:07.442598] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:07.442843] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-13T21:50:07.442895] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-13T21:50:07.443347] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-13T21:50:07.443386] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-13T21:50:07.628388] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-13T21:50:07.796745] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:08.417959] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-13T21:50:08.487337] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:50:09.217959] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-13T21:50:09.358452] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T21:50:10.017979] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-13T21:50:10.173451] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T21:50:10.496050] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T21:50:10.619787] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T21:50:10.817903] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-13T21:50:11.395705] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T21:50:11.617950] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-13T21:50:12.417935] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-13T21:50:13.001870] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T21:50:13.002595] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T21:50:13.009251] [INFO ] [REMOTE ] TDW: Full fetch complete (66838 records). [2025-10-13T21:50:13.009346] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-13T21:50:13.223109] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-13T21:50:13.418752] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-13T21:50:13.418834] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-13T21:50:13.419800] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-13T21:50:13.419861] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-13T21:50:13.421226] [DEBUG] [LOCAL ] TDW: Trimmed 66838 records to 45054 (keeping 200 days of data) [2025-10-13T21:50:13.697126] [DEBUG] [LOCAL ] TDW: Primary data saved (45054 records). [2025-10-13T21:50:13.697262] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-13T21:50:13.697347] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDW took 36.1s. Estimated remaining: 43m 19s. Rate: 7.1 symbols/min [2025-10-13T21:50:13.868662] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:13.904876] [DEBUG] [LOCAL ] TEF: Loaded 37625 existing records from primary storage. [2025-10-13T21:50:13.905159] [INFO ] [MAIN ] TEF: Loaded 37625 existing records. [2025-10-13T21:50:14.023093] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-13T21:50:14.091592] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:14.091814] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-13T21:50:14.091859] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-13T21:50:14.092140] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-13T21:50:14.092197] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-13T21:50:14.451745] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:14.817952] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-13T21:50:14.853169] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T21:50:14.959831] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T21:50:15.617945] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-13T21:50:16.289380] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T21:50:16.417992] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-13T21:50:16.820235] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T21:50:16.824743] [INFO ] [REMOTE ] TDS: Full fetch complete (61470 records). [2025-10-13T21:50:16.824889] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-13T21:50:17.212403] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-13T21:50:17.212495] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-13T21:50:17.213432] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-13T21:50:17.213535] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-13T21:50:17.214723] [DEBUG] [LOCAL ] TDS: Trimmed 61470 records to 42515 (keeping 200 days of data) [2025-10-13T21:50:17.267669] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-13T21:50:17.485058] [DEBUG] [LOCAL ] TDS: Primary data saved (42515 records). [2025-10-13T21:50:17.485180] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-13T21:50:17.485257] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDS took 41.2s. Estimated remaining: 43m 10s. Rate: 7.1 symbols/min [2025-10-13T21:50:17.661130] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:17.682680] [DEBUG] [LOCAL ] TEI: Loaded 21784 existing records from primary storage. [2025-10-13T21:50:17.682947] [INFO ] [MAIN ] TEI: Loaded 21784 existing records. [2025-10-13T21:50:17.860621] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:17.860918] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-13T21:50:17.860992] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-13T21:50:17.861245] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-13T21:50:17.861303] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-13T21:50:18.021804] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-13T21:50:18.061864] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T21:50:18.252054] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:18.675619] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T21:50:18.817887] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-13T21:50:19.026152] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T21:50:19.587859] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T21:50:19.617930] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-13T21:50:20.417969] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-13T21:50:20.660710] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T21:50:20.908073] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T21:50:21.217944] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-13T21:50:22.017996] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-13T21:50:22.282533] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T21:50:22.817924] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-13T21:50:23.617933] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-13T21:50:23.738953] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T21:50:23.921736] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T21:50:24.414090] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T21:50:24.417882] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-13T21:50:25.217939] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-13T21:50:25.834883] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T21:50:26.017895] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-13T21:50:26.823681] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-13T21:50:26.842450] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T21:50:27.617959] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-13T21:50:27.657349] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T21:50:27.714662] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T21:50:28.262146] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T21:50:28.417944] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-13T21:50:29.144469] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T21:50:29.218014] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-13T21:50:29.774373] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T21:50:29.775538] [INFO ] [REMOTE ] TEAF: Full fetch complete (9965 records). [2025-10-13T21:50:29.775629] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-13T21:50:30.023281] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-13T21:50:30.128855] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-13T21:50:30.128927] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-13T21:50:30.129157] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-13T21:50:30.129217] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-13T21:50:30.129619] [DEBUG] [LOCAL ] TEAF: Trimmed 9965 records to 7378 (keeping 200 days of data) [2025-10-13T21:50:30.179514] [DEBUG] [LOCAL ] TEAF: Primary data saved (7378 records). [2025-10-13T21:50:30.179613] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-13T21:50:30.179755] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 27.9s. Estimated remaining: 43m 2s. Rate: 7.1 symbols/min [2025-10-13T21:50:30.347341] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:30.404294] [DEBUG] [LOCAL ] TEL: Loaded 51770 existing records from primary storage. [2025-10-13T21:50:30.404633] [INFO ] [MAIN ] TEL: Loaded 51770 existing records. [2025-10-13T21:50:30.581104] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:30.581326] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-13T21:50:30.581371] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-13T21:50:30.582004] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-13T21:50:30.582073] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-13T21:50:30.822991] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-13T21:50:30.930913] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:31.112995] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T21:50:31.617950] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-13T21:50:32.417944] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-13T21:50:32.575550] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T21:50:32.622586] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T21:50:33.217982] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-13T21:50:33.865004] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T21:50:34.017938] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-13T21:50:34.817971] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-13T21:50:34.984872] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T21:50:35.302995] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:50:35.617991] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-13T21:50:35.932005] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T21:50:36.417983] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-13T21:50:37.218017] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-13T21:50:37.480096] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T21:50:37.545229] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T21:50:38.018051] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-13T21:50:38.653424] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T21:50:38.817958] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-13T21:50:39.629134] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-13T21:50:39.646928] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:50:40.354124] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T21:50:40.417883] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-13T21:50:40.800594] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T21:50:41.217952] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-13T21:50:41.519939] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T21:50:42.017956] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-13T21:50:42.817956] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-13T21:50:43.001335] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T21:50:43.430339] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T21:50:43.617957] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-13T21:50:44.417894] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-13T21:50:44.689410] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T21:50:45.009069] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T21:50:45.217893] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-13T21:50:45.406064] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T21:50:45.409105] [INFO ] [REMOTE ] TEI: Full fetch complete (30808 records). [2025-10-13T21:50:45.409179] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-13T21:50:45.767471] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-13T21:50:45.767542] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-13T21:50:45.768134] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-13T21:50:45.768194] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-13T21:50:45.768944] [DEBUG] [LOCAL ] TEI: Trimmed 30808 records to 21428 (keeping 200 days of data) [2025-10-13T21:50:45.890791] [DEBUG] [LOCAL ] TEI: Primary data saved (21428 records). [2025-10-13T21:50:45.890915] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-13T21:50:45.890994] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEI took 28.4s. Estimated remaining: 42m 55s. Rate: 7.1 symbols/min [2025-10-13T21:50:46.030790] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-13T21:50:46.061948] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:46.094932] [DEBUG] [LOCAL ] TEN: Loaded 30810 existing records from primary storage. [2025-10-13T21:50:46.095188] [INFO ] [MAIN ] TEN: Loaded 30810 existing records. [2025-10-13T21:50:46.277544] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:46.277848] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-13T21:50:46.277895] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-13T21:50:46.278284] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-13T21:50:46.278341] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-13T21:50:46.626723] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:46.776756] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T21:50:46.817954] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-13T21:50:47.617982] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-13T21:50:47.990984] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T21:50:48.291797] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T21:50:48.417975] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-13T21:50:49.218033] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-13T21:50:49.478219] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T21:50:49.509850] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T21:50:49.514481] [INFO ] [REMOTE ] TEF: Full fetch complete (54756 records). [2025-10-13T21:50:49.514694] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-13T21:50:49.936082] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-13T21:50:49.936186] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-13T21:50:49.937135] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-13T21:50:49.937200] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-13T21:50:49.938631] [DEBUG] [LOCAL ] TEF: Trimmed 54756 records to 37026 (keeping 200 days of data) [2025-10-13T21:50:50.021948] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-13T21:50:50.157942] [DEBUG] [LOCAL ] TEF: Primary data saved (37026 records). [2025-10-13T21:50:50.158095] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-13T21:50:50.158197] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEF took 36.5s. Estimated remaining: 42m 46s. Rate: 7.1 symbols/min [2025-10-13T21:50:50.345931] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:50.364535] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T21:50:50.390771] [DEBUG] [LOCAL ] TEO: Loaded 22786 existing records from primary storage. [2025-10-13T21:50:50.391047] [INFO ] [MAIN ] TEO: Loaded 22786 existing records. [2025-10-13T21:50:50.567937] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:50.568191] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-13T21:50:50.568237] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-13T21:50:50.568571] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-13T21:50:50.568627] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-13T21:50:50.823193] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-13T21:50:50.924705] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:51.617929] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-13T21:50:51.641210] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T21:50:51.648330] [INFO ] [REMOTE ] TECK: Full fetch complete (77321 records). [2025-10-13T21:50:51.648539] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-13T21:50:52.054522] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-13T21:50:52.054709] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-13T21:50:52.055830] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-13T21:50:52.055975] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-13T21:50:52.057544] [DEBUG] [LOCAL ] TECK: Trimmed 77321 records to 53437 (keeping 200 days of data) [2025-10-13T21:50:52.138116] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T21:50:52.422717] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-13T21:50:52.432914] [DEBUG] [LOCAL ] TECK: Primary data saved (53437 records). [2025-10-13T21:50:52.433132] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-13T21:50:52.433244] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TECK took 45.4s. Estimated remaining: 42m 37s. Rate: 7.1 symbols/min [2025-10-13T21:50:52.606465] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:50:52.661405] [DEBUG] [LOCAL ] TEVA: Loaded 54410 existing records from primary storage. [2025-10-13T21:50:52.661767] [INFO ] [MAIN ] TEVA: Loaded 54410 existing records. [2025-10-13T21:50:52.838397] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:50:52.838614] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-13T21:50:52.838694] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-13T21:50:52.838982] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-13T21:50:52.839040] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-13T21:50:53.194777] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:50:53.217938] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-13T21:50:53.455448] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T21:50:53.515409] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T21:50:54.017961] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-13T21:50:54.821251] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-13T21:50:55.165815] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T21:50:55.338453] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T21:50:55.617935] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-13T21:50:56.417990] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-13T21:50:56.643269] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T21:50:57.077585] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T21:50:57.217945] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-13T21:50:58.017969] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-13T21:50:58.203199] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T21:50:58.254307] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T21:50:58.817926] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-13T21:50:59.221047] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T21:50:59.617981] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-13T21:51:00.417973] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-13T21:51:00.827553] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-13T21:51:01.172063] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:51:01.217953] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-13T21:51:01.572308] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T21:51:02.017940] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-13T21:51:02.817939] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-13T21:51:03.099829] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T21:51:03.283168] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T21:51:03.617980] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-13T21:51:04.176128] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T21:51:04.417947] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-13T21:51:05.217958] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-13T21:51:05.491176] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T21:51:05.530477] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T21:51:06.017976] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-13T21:51:06.817896] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-13T21:51:07.124380] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T21:51:07.617896] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-13T21:51:07.815804] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T21:51:08.067878] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T21:51:08.417900] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-13T21:51:08.718810] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T21:51:09.217964] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-13T21:51:10.017944] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-13T21:51:10.074793] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T21:51:10.818022] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-13T21:51:11.395807] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T21:51:11.569222] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-13T21:51:11.612235] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T21:51:11.617870] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-13T21:51:12.417993] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-13T21:51:12.700568] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T21:51:13.217947] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-13T21:51:14.017931] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-13T21:51:14.357153] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T21:51:14.360723] [INFO ] [REMOTE ] TEN: Full fetch complete (43982 records). [2025-10-13T21:51:14.360859] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-13T21:51:14.723149] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-13T21:51:14.825009] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-13T21:51:14.837677] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T21:51:14.844508] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-13T21:51:14.844856] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-13T21:51:14.846308] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-13T21:51:14.846537] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-13T21:51:14.846449] [INFO ] [REMOTE ] TEL: Full fetch complete (73403 records). [2025-10-13T21:51:14.846838] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-13T21:51:14.917212] [DEBUG] [LOCAL ] TEN: Trimmed 43982 records to 30551 (keeping 200 days of data) [2025-10-13T21:51:15.431161] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-13T21:51:15.433162] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-13T21:51:15.434934] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-13T21:51:15.435037] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-13T21:51:15.442035] [DEBUG] [LOCAL ] TEL: Trimmed 73403 records to 51074 (keeping 200 days of data) [2025-10-13T21:51:15.518209] [DEBUG] [LOCAL ] TEN: Primary data saved (30551 records). [2025-10-13T21:51:15.544730] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-13T21:51:15.547610] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEN took 29.7s. Estimated remaining: 42m 30s. Rate: 7.1 symbols/min [2025-10-13T21:51:15.621363] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-13T21:51:15.736504] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:15.900160] [DEBUG] [LOCAL ] TEX: Loaded 44641 existing records from primary storage. [2025-10-13T21:51:15.902572] [INFO ] [MAIN ] TEX: Loaded 44641 existing records. [2025-10-13T21:51:16.027010] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T21:51:16.118728] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:16.119891] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-13T21:51:16.121218] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-13T21:51:16.123566] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-13T21:51:16.123887] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-13T21:51:16.425032] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-13T21:51:16.583861] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:16.591691] [DEBUG] [LOCAL ] TEL: Primary data saved (51074 records). [2025-10-13T21:51:16.591864] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-13T21:51:16.591958] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEL took 46.4s. Estimated remaining: 42m 21s. Rate: 7.1 symbols/min [2025-10-13T21:51:16.757420] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:16.819144] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-13T21:51:16.819633] [INFO ] [MAIN ] TFC: Loaded 54447 existing records. [2025-10-13T21:51:17.030370] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:17.030582] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-13T21:51:17.030638] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-13T21:51:17.030972] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-13T21:51:17.031047] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-13T21:51:17.224237] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-13T21:51:17.398911] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:17.561958] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T21:51:17.744598] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T21:51:18.017925] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-13T21:51:18.610755] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T21:51:18.817928] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-13T21:51:19.092680] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T21:51:19.095521] [INFO ] [REMOTE ] TEO: Full fetch complete (32580 records). [2025-10-13T21:51:19.095615] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-13T21:51:19.468507] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-13T21:51:19.468618] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-13T21:51:19.469299] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-13T21:51:19.469349] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-13T21:51:19.470393] [DEBUG] [LOCAL ] TEO: Trimmed 32580 records to 22429 (keeping 200 days of data) [2025-10-13T21:51:19.597815] [DEBUG] [LOCAL ] TEO: Primary data saved (22429 records). [2025-10-13T21:51:19.597963] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-13T21:51:19.598056] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEO took 29.4s. Estimated remaining: 42m 12s. Rate: 7.1 symbols/min [2025-10-13T21:51:19.626999] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-13T21:51:19.768296] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:19.802200] [DEBUG] [LOCAL ] TFII: Loaded 33845 existing records from primary storage. [2025-10-13T21:51:19.802471] [INFO ] [MAIN ] TFII: Loaded 33845 existing records. [2025-10-13T21:51:19.974769] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:19.974963] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-13T21:51:19.975008] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-13T21:51:19.975376] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-13T21:51:19.975432] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-13T21:51:20.324384] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:20.420335] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-13T21:51:20.424949] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T21:51:21.217948] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-13T21:51:21.345077] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T21:51:21.486328] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T21:51:22.017962] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-13T21:51:22.631221] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:51:22.817986] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-13T21:51:23.617956] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-13T21:51:24.136592] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-13T21:51:24.229532] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:51:24.417946] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-13T21:51:24.799231] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T21:51:25.217939] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-13T21:51:26.017957] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-13T21:51:26.096569] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:51:26.817963] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-13T21:51:27.042881] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T21:51:27.617901] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-13T21:51:28.031921] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T21:51:28.383396] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:51:28.417881] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-13T21:51:28.956231] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T21:51:29.217894] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-13T21:51:29.768591] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T21:51:30.018004] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-13T21:51:30.628854] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T21:51:30.817948] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-13T21:51:31.618013] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-13T21:51:31.662251] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T21:51:31.667721] [INFO ] [REMOTE ] TEVA: Full fetch complete (77702 records). [2025-10-13T21:51:31.667846] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-13T21:51:32.051472] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-13T21:51:32.051549] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-13T21:51:32.052586] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-13T21:51:32.052673] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-13T21:51:32.054128] [DEBUG] [LOCAL ] TEVA: Trimmed 77702 records to 53628 (keeping 200 days of data) [2025-10-13T21:51:32.380165] [DEBUG] [LOCAL ] TEVA: Primary data saved (53628 records). [2025-10-13T21:51:32.380327] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-13T21:51:32.380432] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEVA took 39.9s. Estimated remaining: 42m 4s. Rate: 7.1 symbols/min [2025-10-13T21:51:32.423010] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-13T21:51:32.551471] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:32.575038] [DEBUG] [LOCAL ] TFIN: Loaded 23854 existing records from primary storage. [2025-10-13T21:51:32.575294] [INFO ] [MAIN ] TFIN: Loaded 23854 existing records. [2025-10-13T21:51:32.753066] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:32.753344] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-13T21:51:32.753472] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-13T21:51:32.753788] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-13T21:51:32.753876] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-13T21:51:32.909544] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T21:51:33.166373] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:33.217951] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-13T21:51:33.270383] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T21:51:33.745556] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T21:51:34.017951] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-13T21:51:34.818018] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-13T21:51:35.135506] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T21:51:35.617919] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-13T21:51:35.691567] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T21:51:35.731115] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T21:51:36.417949] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-13T21:51:37.217886] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-13T21:51:37.252448] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T21:51:37.357487] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T21:51:38.017951] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-13T21:51:38.425885] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T21:51:38.817971] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-13T21:51:39.545347] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T21:51:39.617952] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-13T21:51:40.417978] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-13T21:51:40.594065] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T21:51:40.891319] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T21:51:40.895939] [INFO ] [REMOTE ] TEX: Full fetch complete (64461 records). [2025-10-13T21:51:40.896052] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-13T21:51:41.223099] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-13T21:51:41.277369] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-13T21:51:41.277454] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-13T21:51:41.278820] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-13T21:51:41.279068] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-13T21:51:41.280828] [DEBUG] [LOCAL ] TEX: Trimmed 64461 records to 43940 (keeping 200 days of data) [2025-10-13T21:51:41.557988] [DEBUG] [LOCAL ] TEX: Primary data saved (43940 records). [2025-10-13T21:51:41.558115] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-13T21:51:41.558195] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEX took 26.0s. Estimated remaining: 41m 55s. Rate: 7.1 symbols/min [2025-10-13T21:51:41.740701] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:41.744046] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T21:51:41.785591] [DEBUG] [LOCAL ] TFPM: Loaded 39256 existing records from primary storage. [2025-10-13T21:51:41.785902] [INFO ] [MAIN ] TFPM: Loaded 39256 existing records. [2025-10-13T21:51:41.961124] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:41.961426] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-13T21:51:41.961490] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-13T21:51:41.967125] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-13T21:51:41.971608] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-13T21:51:41.997008] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T21:51:42.027543] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-13T21:51:42.347990] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:42.817946] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-13T21:51:43.557285] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T21:51:43.617879] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-13T21:51:43.883734] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T21:51:44.417937] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-13T21:51:44.933492] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:51:45.217998] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-13T21:51:46.018007] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-13T21:51:46.270030] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T21:51:46.513556] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T21:51:46.817893] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-13T21:51:47.277339] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T21:51:47.617947] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-13T21:51:48.119687] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T21:51:48.417897] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-13T21:51:48.665137] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T21:51:49.217945] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-13T21:51:50.017990] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-13T21:51:50.304919] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T21:51:50.308619] [INFO ] [REMOTE ] TFII: Full fetch complete (47896 records). [2025-10-13T21:51:50.308757] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-13T21:51:50.456837] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T21:51:50.741896] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-13T21:51:50.741977] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-13T21:51:50.742839] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-13T21:51:50.742902] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-13T21:51:50.743974] [DEBUG] [LOCAL ] TFII: Trimmed 47896 records to 33185 (keeping 200 days of data) [2025-10-13T21:51:50.834442] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-13T21:51:50.857054] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T21:51:50.977686] [DEBUG] [LOCAL ] TFII: Primary data saved (33185 records). [2025-10-13T21:51:50.977838] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-13T21:51:50.977948] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 31.4s. Estimated remaining: 41m 47s. Rate: 7.1 symbols/min [2025-10-13T21:51:51.145756] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:51.183106] [DEBUG] [LOCAL ] TFX: Loaded 37279 existing records from primary storage. [2025-10-13T21:51:51.183406] [INFO ] [MAIN ] TFX: Loaded 37279 existing records. [2025-10-13T21:51:51.356188] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:51.356422] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-13T21:51:51.356466] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-13T21:51:51.356907] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-13T21:51:51.356964] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-13T21:51:51.624702] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-13T21:51:51.706369] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:52.417969] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-13T21:51:52.702811] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T21:51:52.887862] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T21:51:53.217955] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-13T21:51:53.409379] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T21:51:54.018018] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-13T21:51:54.817935] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-13T21:51:55.074433] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T21:51:55.370792] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T21:51:55.617896] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-13T21:51:55.858584] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T21:51:56.215265] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T21:51:56.221350] [INFO ] [REMOTE ] TFC: Full fetch complete (77671 records). [2025-10-13T21:51:56.221505] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-13T21:51:56.423013] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-13T21:51:56.619946] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-13T21:51:56.620043] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-13T21:51:56.621147] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-13T21:51:56.621217] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-13T21:51:56.622880] [DEBUG] [LOCAL ] TFC: Trimmed 77671 records to 53667 (keeping 200 days of data) [2025-10-13T21:51:56.963116] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-13T21:51:56.963249] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-13T21:51:56.963327] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFC took 40.4s. Estimated remaining: 41m 38s. Rate: 7.1 symbols/min [2025-10-13T21:51:57.128958] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:51:57.140828] [DEBUG] [LOCAL ] TG: Loaded 10536 existing records from primary storage. [2025-10-13T21:51:57.141027] [INFO ] [MAIN ] TG: Loaded 10536 existing records. [2025-10-13T21:51:57.223173] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-13T21:51:57.324135] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:51:57.324380] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-13T21:51:57.324426] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-13T21:51:57.324686] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-13T21:51:57.324744] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-13T21:51:57.688744] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:51:57.977326] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:51:58.017965] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-13T21:51:58.083926] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T21:51:58.792441] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T21:51:58.817939] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-13T21:51:59.617928] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-13T21:51:59.743403] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T21:51:59.746061] [INFO ] [REMOTE ] TFIN: Full fetch complete (31784 records). [2025-10-13T21:51:59.746128] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-13T21:52:00.109810] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-13T21:52:00.109883] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-13T21:52:00.110686] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-13T21:52:00.110751] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-13T21:52:00.111534] [DEBUG] [LOCAL ] TFIN: Trimmed 31784 records to 23484 (keeping 200 days of data) [2025-10-13T21:52:00.248628] [DEBUG] [LOCAL ] TFIN: Primary data saved (23484 records). [2025-10-13T21:52:00.248786] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-13T21:52:00.248868] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 27.9s. Estimated remaining: 41m 29s. Rate: 7.1 symbols/min [2025-10-13T21:52:00.415034] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:00.415183] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-13T21:52:00.415219] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-13T21:52:00.415324] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-13T21:52:00.415366] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-13T21:52:00.415406] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-13T21:52:00.415437] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-13T21:52:00.426691] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-13T21:52:00.765905] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:01.123588] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T21:52:01.217891] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-13T21:52:01.446321] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T21:52:02.017960] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-13T21:52:02.673174] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T21:52:02.696955] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:52:02.817893] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-13T21:52:03.617940] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-13T21:52:04.350448] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T21:52:04.417935] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-13T21:52:04.529490] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T21:52:05.217957] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-13T21:52:05.245694] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T21:52:06.017957] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-13T21:52:06.730336] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T21:52:06.817949] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-13T21:52:07.378835] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T21:52:07.617951] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-13T21:52:08.026511] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T21:52:08.417975] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-13T21:52:08.443916] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T21:52:08.633128] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:52:08.633483] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-13T21:52:08.633580] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:52:08.633635] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-13T21:52:08.633723] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:52:08.633767] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-13T21:52:08.633825] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-13T21:52:08.633860] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-13T21:52:08.633898] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-13T21:52:08.633965] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TGE took 8.4s. Estimated remaining: 41m 21s. Rate: 7.1 symbols/min [2025-10-13T21:52:09.221145] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-13T21:52:09.984467] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T21:52:10.017899] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-13T21:52:10.817944] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-13T21:52:10.847509] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T21:52:11.617955] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-13T21:52:12.294676] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T21:52:12.417952] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-13T21:52:12.445201] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T21:52:13.217953] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-13T21:52:13.993618] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T21:52:14.017928] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-13T21:52:14.030702] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T21:52:14.818001] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-13T21:52:15.624459] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-13T21:52:15.627803] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T21:52:15.702745] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T21:52:16.418028] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-13T21:52:17.064965] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:52:17.066725] [INFO ] [REMOTE ] TG: Full fetch complete (14970 records). [2025-10-13T21:52:17.066806] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-13T21:52:17.224131] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-13T21:52:17.387099] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T21:52:17.466906] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-13T21:52:17.466985] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-13T21:52:17.467333] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-13T21:52:17.467371] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-13T21:52:17.467881] [DEBUG] [LOCAL ] TG: Trimmed 14970 records to 10393 (keeping 200 days of data) [2025-10-13T21:52:17.529827] [DEBUG] [LOCAL ] TG: Primary data saved (10393 records). [2025-10-13T21:52:17.529931] [INFO ] [MAIN ] TG: Full history saved. [2025-10-13T21:52:17.530018] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TG took 20.6s. Estimated remaining: 41m 12s. Rate: 7.1 symbols/min [2025-10-13T21:52:18.018006] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-13T21:52:18.889757] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T21:52:18.900112] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-13T21:52:19.415712] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T21:52:19.617969] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-13T21:52:20.295068] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T21:52:20.300473] [INFO ] [REMOTE ] TFPM: Full fetch complete (52011 records). [2025-10-13T21:52:20.300620] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-13T21:52:20.743260] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-13T21:52:20.743465] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-13T21:52:20.744420] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-13T21:52:20.744492] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-13T21:52:20.745800] [DEBUG] [LOCAL ] TFPM: Trimmed 52011 records to 39066 (keeping 200 days of data) [2025-10-13T21:52:20.885030] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T21:52:20.895357] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-13T21:52:21.027231] [DEBUG] [LOCAL ] TFPM: Primary data saved (39066 records). [2025-10-13T21:52:21.027397] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-13T21:52:21.027484] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFPM took 39.5s. Estimated remaining: 41m 3s. Rate: 7.1 symbols/min [2025-10-13T21:52:22.458251] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T21:52:22.465930] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-13T21:52:23.983342] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T21:52:23.992194] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-13T21:52:25.147713] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T21:52:25.151697] [INFO ] [REMOTE ] TFX: Full fetch complete (54573 records). [2025-10-13T21:52:25.151795] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-13T21:52:25.542938] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-13T21:52:25.543260] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-13T21:52:25.544223] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-13T21:52:25.544286] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-13T21:52:25.545541] [DEBUG] [LOCAL ] TFX: Trimmed 54573 records to 36470 (keeping 200 days of data) [2025-10-13T21:52:25.786882] [DEBUG] [LOCAL ] TFX: Primary data saved (36470 records). [2025-10-13T21:52:25.787024] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-13T21:52:25.787104] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 34.8s. Estimated remaining: 40m 54s. Rate: 7.1 symbols/min [2025-10-13T21:52:26.368341] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:26.424024] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:26.467113] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:26.493078] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:26.534582] [DEBUG] [LOCAL ] TGLS: Loaded 27913 existing records from primary storage. [2025-10-13T21:52:26.556156] [INFO ] [MAIN ] TGLS: Loaded 27913 existing records. [2025-10-13T21:52:26.586347] [DEBUG] [LOCAL ] TGS: Loaded 33559 existing records from primary storage. [2025-10-13T21:52:26.591994] [INFO ] [MAIN ] TGS: Loaded 33559 existing records. [2025-10-13T21:52:26.743359] [DEBUG] [LOCAL ] TGNA: Loaded 49361 existing records from primary storage. [2025-10-13T21:52:26.765092] [INFO ] [MAIN ] TGNA: Loaded 49361 existing records. [2025-10-13T21:52:27.064419] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-10-13T21:52:27.101221] [INFO ] [MAIN ] TGT: Loaded 54558 existing records. [2025-10-13T21:52:27.078414] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:27.156337] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-13T21:52:27.169175] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-13T21:52:27.169064] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:27.225728] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-13T21:52:27.196607] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:27.220490] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-13T21:52:27.248242] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-13T21:52:27.239569] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-13T21:52:27.253794] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-13T21:52:27.259161] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-13T21:52:27.269461] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-13T21:52:27.285342] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-13T21:52:27.296229] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-13T21:52:27.308180] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-13T21:52:27.633112] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:27.749230] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-13T21:52:27.801001] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-13T21:52:27.934698] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-13T21:52:27.980831] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-13T21:52:28.493906] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:28.546866] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-13T21:52:28.702307] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:28.797924] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-13T21:52:28.813521] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:28.831034] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-13T21:52:28.931939] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:28.932260] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-13T21:52:29.669285] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T21:52:29.679068] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-13T21:52:30.093968] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T21:52:30.099200] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-13T21:52:30.258411] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:52:30.268394] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-13T21:52:31.117405] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T21:52:31.124955] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-13T21:52:31.202984] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-13T21:52:31.214059] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-13T21:52:31.264009] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T21:52:31.270435] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-13T21:52:31.503489] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T21:52:31.512487] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-13T21:52:32.048095] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T21:52:32.053882] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-13T21:52:32.376126] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T21:52:32.417893] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-13T21:52:32.940534] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T21:52:32.979055] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T21:52:33.093199] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T21:52:33.217965] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-13T21:52:33.353049] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T21:52:34.017984] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-13T21:52:34.817977] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-13T21:52:34.956394] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T21:52:35.617924] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-13T21:52:35.655337] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T21:52:36.132090] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T21:52:36.417961] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-13T21:52:37.217960] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-13T21:52:38.017968] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-13T21:52:38.073426] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-13T21:52:38.142566] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T21:52:38.211015] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T21:52:38.817951] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-13T21:52:39.305729] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T21:52:39.617985] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-13T21:52:40.170514] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T21:52:40.417974] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-13T21:52:41.218541] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T21:52:41.218620] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-13T21:52:41.284760] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T21:52:42.017935] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-13T21:52:42.557573] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T21:52:42.817941] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-13T21:52:43.617939] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-13T21:52:44.237569] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T21:52:44.356989] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-13T21:52:44.417955] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-13T21:52:45.171336] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:52:45.217969] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-13T21:52:45.733818] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:52:46.017957] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-13T21:52:46.692000] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:52:46.817886] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-13T21:52:47.489415] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T21:52:47.617950] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-13T21:52:48.417986] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-13T21:52:48.588861] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:52:48.627887] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T21:52:49.217932] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-13T21:52:49.754917] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T21:52:49.762958] [INFO ] [REMOTE ] TGS: Full fetch complete (48144 records). [2025-10-13T21:52:49.763151] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-13T21:52:50.023111] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-13T21:52:50.145415] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-13T21:52:50.145487] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-13T21:52:50.146348] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-13T21:52:50.146410] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-13T21:52:50.147352] [DEBUG] [LOCAL ] TGS: Trimmed 48144 records to 33260 (keeping 200 days of data) [2025-10-13T21:52:50.372826] [DEBUG] [LOCAL ] TGS: Primary data saved (33260 records). [2025-10-13T21:52:50.372973] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-13T21:52:50.373059] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 24.6s. Estimated remaining: 40m 48s. Rate: 7.1 symbols/min [2025-10-13T21:52:50.554014] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:50.620350] [DEBUG] [LOCAL ] THC: Loaded 47996 existing records from primary storage. [2025-10-13T21:52:50.620863] [INFO ] [MAIN ] THC: Loaded 47996 existing records. [2025-10-13T21:52:50.823387] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-13T21:52:50.875243] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:50.876037] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-13T21:52:50.876104] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-13T21:52:50.876637] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-13T21:52:50.876752] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-13T21:52:51.349785] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:51.395962] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T21:52:51.578455] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-13T21:52:51.617932] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-13T21:52:52.161881] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T21:52:52.418009] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-13T21:52:53.217956] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-13T21:52:53.835390] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T21:52:53.834611] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T21:52:53.853195] [INFO ] [REMOTE ] TGNA: Full fetch complete (69854 records). [2025-10-13T21:52:53.854033] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-13T21:52:54.025763] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-13T21:52:54.239682] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-13T21:52:54.239776] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-13T21:52:54.240785] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-13T21:52:54.240846] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-13T21:52:54.242284] [DEBUG] [LOCAL ] TGNA: Trimmed 69854 records to 48635 (keeping 200 days of data) [2025-10-13T21:52:54.539680] [DEBUG] [LOCAL ] TGNA: Primary data saved (48635 records). [2025-10-13T21:52:54.539816] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-13T21:52:54.539896] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGNA took 28.7s. Estimated remaining: 40m 39s. Rate: 7.1 symbols/min [2025-10-13T21:52:54.707466] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:54.729584] [DEBUG] [LOCAL ] THG: Loaded 21827 existing records from primary storage. [2025-10-13T21:52:54.729878] [INFO ] [MAIN ] THG: Loaded 21827 existing records. [2025-10-13T21:52:54.822099] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-13T21:52:54.913322] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:54.913697] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-13T21:52:54.913773] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-13T21:52:54.914497] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-13T21:52:54.914560] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-13T21:52:55.101609] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T21:52:55.316781] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:55.617881] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-13T21:52:55.721123] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T21:52:55.983105] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T21:52:56.417958] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-13T21:52:57.149355] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T21:52:57.217885] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-13T21:52:57.435379] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T21:52:57.441494] [INFO ] [REMOTE ] TGLS: Full fetch complete (40540 records). [2025-10-13T21:52:57.441708] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-13T21:52:57.805712] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-13T21:52:57.805791] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-13T21:52:57.806536] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-13T21:52:57.806575] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-13T21:52:57.807390] [DEBUG] [LOCAL ] TGLS: Trimmed 40540 records to 27631 (keeping 200 days of data) [2025-10-13T21:52:57.978039] [DEBUG] [LOCAL ] TGLS: Primary data saved (27631 records). [2025-10-13T21:52:57.978182] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-13T21:52:57.978265] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGLS took 32.2s. Estimated remaining: 40m 30s. Rate: 7.1 symbols/min [2025-10-13T21:52:58.023188] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-13T21:52:58.150602] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:52:58.154613] [DEBUG] [LOCAL ] THIR: Loaded 2341 existing records from primary storage. [2025-10-13T21:52:58.154857] [INFO ] [MAIN ] THIR: Loaded 2341 existing records. [2025-10-13T21:52:58.336623] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:52:58.336834] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-13T21:52:58.336879] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-13T21:52:58.337053] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-13T21:52:58.337109] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-13T21:52:58.469874] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T21:52:58.707240] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:52:58.817974] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-13T21:52:59.161250] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T21:52:59.617951] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-13T21:53:00.228047] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-13T21:53:00.417896] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-13T21:53:00.778594] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T21:53:00.834605] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T21:53:01.217932] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-13T21:53:01.563400] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-13T21:53:02.017944] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-13T21:53:02.392837] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T21:53:02.817895] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-13T21:53:03.617936] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-13T21:53:04.117532] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T21:53:04.417934] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-13T21:53:05.217972] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-13T21:53:05.276216] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-13T21:53:05.649028] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T21:53:06.021380] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-13T21:53:06.055180] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T21:53:06.817955] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-13T21:53:07.121088] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T21:53:07.390126] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:53:07.395907] [INFO ] [REMOTE ] TGT: Full fetch complete (77861 records). [2025-10-13T21:53:07.396057] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-13T21:53:07.623107] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-13T21:53:07.787227] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-13T21:53:07.787312] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-13T21:53:07.788383] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-13T21:53:07.788445] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-13T21:53:07.789933] [DEBUG] [LOCAL ] TGT: Trimmed 77861 records to 53778 (keeping 200 days of data) [2025-10-13T21:53:08.111485] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T21:53:08.130506] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-13T21:53:08.130600] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-13T21:53:08.130703] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 42.3s. Estimated remaining: 40m 22s. Rate: 7.1 symbols/min [2025-10-13T21:53:08.304799] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:08.308090] [DEBUG] [LOCAL ] THLV: Loaded 1560 existing records from primary storage. [2025-10-13T21:53:08.308233] [INFO ] [MAIN ] THLV: Loaded 1560 existing records. [2025-10-13T21:53:08.436533] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-13T21:53:08.513132] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:08.513325] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-13T21:53:08.513373] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-13T21:53:08.513542] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-13T21:53:08.513599] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-13T21:53:08.859133] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:09.217994] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-13T21:53:09.672825] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T21:53:09.722141] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-13T21:53:10.017947] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-13T21:53:10.620108] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T21:53:10.817998] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-13T21:53:11.617964] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-13T21:53:12.053020] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T21:53:12.417933] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-13T21:53:12.545940] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:53:12.827671] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T21:53:13.217938] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-13T21:53:13.597375] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T21:53:14.017948] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-13T21:53:14.817965] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-13T21:53:15.349396] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T21:53:15.617957] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-13T21:53:15.787778] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T21:53:16.091411] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T21:53:16.092297] [INFO ] [REMOTE ] THIR: Full fetch complete (2839 records). [2025-10-13T21:53:16.092364] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-13T21:53:16.419687] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-13T21:53:16.444853] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-13T21:53:16.444960] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-13T21:53:16.445095] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-13T21:53:16.445167] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-13T21:53:16.445522] [DEBUG] [LOCAL ] THIR: Trimmed 2839 records to 2351 (keeping 200 days of data) [2025-10-13T21:53:16.459827] [DEBUG] [LOCAL ] THIR: Primary data saved (2351 records). [2025-10-13T21:53:16.459891] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-13T21:53:16.459962] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 18.5s. Estimated remaining: 40m 13s. Rate: 7.1 symbols/min [2025-10-13T21:53:16.628103] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:16.672199] [DEBUG] [LOCAL ] THO: Loaded 42217 existing records from primary storage. [2025-10-13T21:53:16.672502] [INFO ] [MAIN ] THO: Loaded 42217 existing records. [2025-10-13T21:53:16.847725] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:16.847940] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-13T21:53:16.848001] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-13T21:53:16.848489] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-13T21:53:16.848545] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-13T21:53:17.035932] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T21:53:17.212211] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:17.217884] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-13T21:53:18.017927] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-13T21:53:18.480499] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T21:53:18.817946] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-13T21:53:18.860309] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T21:53:19.323972] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T21:53:19.617937] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-13T21:53:20.417964] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-13T21:53:20.754527] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T21:53:20.940830] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T21:53:21.217982] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-13T21:53:22.017945] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-13T21:53:22.533693] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T21:53:22.817946] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-13T21:53:23.550813] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T21:53:23.617948] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-13T21:53:24.417945] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-13T21:53:24.448945] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T21:53:25.097706] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T21:53:25.217937] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-13T21:53:26.017960] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-13T21:53:26.164182] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T21:53:26.818015] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-13T21:53:26.898319] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T21:53:27.081156] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-13T21:53:27.206332] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T21:53:27.617944] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-13T21:53:28.417898] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-13T21:53:28.653506] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T21:53:29.217980] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-13T21:53:29.648968] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T21:53:30.017924] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-13T21:53:30.111352] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T21:53:30.817998] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-13T21:53:31.096609] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-13T21:53:31.110029] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T21:53:31.618020] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-13T21:53:31.978686] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-13T21:53:31.979446] [INFO ] [REMOTE ] THLV: Full fetch complete (2557 records). [2025-10-13T21:53:31.979513] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-13T21:53:32.340733] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-13T21:53:32.340817] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-13T21:53:32.340930] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-13T21:53:32.340979] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-13T21:53:32.341410] [DEBUG] [LOCAL ] THLV: Trimmed 2557 records to 1518 (keeping 200 days of data) [2025-10-13T21:53:32.350846] [DEBUG] [LOCAL ] THLV: Primary data saved (1518 records). [2025-10-13T21:53:32.350975] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-13T21:53:32.351058] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THLV took 24.2s. Estimated remaining: 40m 6s. Rate: 7.1 symbols/min [2025-10-13T21:53:32.423163] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-13T21:53:32.525414] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:32.555631] [DEBUG] [LOCAL ] THQ: Loaded 25525 existing records from primary storage. [2025-10-13T21:53:32.555951] [INFO ] [MAIN ] THQ: Loaded 25525 existing records. [2025-10-13T21:53:32.738217] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:32.738438] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-13T21:53:32.738527] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-13T21:53:32.738789] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-13T21:53:32.738848] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-13T21:53:33.088784] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:33.217934] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-13T21:53:33.387595] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T21:53:33.389939] [INFO ] [REMOTE ] THG: Full fetch complete (30964 records). [2025-10-13T21:53:33.390009] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-13T21:53:33.754962] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-13T21:53:33.755040] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-13T21:53:33.755702] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-13T21:53:33.755762] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-13T21:53:33.756499] [DEBUG] [LOCAL ] THG: Trimmed 30964 records to 21621 (keeping 200 days of data) [2025-10-13T21:53:33.891752] [DEBUG] [LOCAL ] THG: Primary data saved (21621 records). [2025-10-13T21:53:33.891887] [INFO ] [MAIN ] THG: Full history saved. [2025-10-13T21:53:33.891974] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 39.4s. Estimated remaining: 39m 56s. Rate: 7.1 symbols/min [2025-10-13T21:53:34.030629] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-13T21:53:34.064484] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:34.084174] [DEBUG] [LOCAL ] THR: Loaded 20063 existing records from primary storage. [2025-10-13T21:53:34.084411] [INFO ] [MAIN ] THR: Loaded 20063 existing records. [2025-10-13T21:53:34.259568] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:34.259843] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-13T21:53:34.259919] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-13T21:53:34.260215] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-13T21:53:34.260272] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-13T21:53:34.417216] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T21:53:34.631043] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:34.817896] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-13T21:53:35.384751] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T21:53:35.617889] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-13T21:53:35.867466] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T21:53:36.417953] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-13T21:53:36.910434] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:53:37.217984] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-13T21:53:38.017924] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-13T21:53:38.197115] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T21:53:38.817975] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-13T21:53:38.994490] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T21:53:39.617924] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-13T21:53:40.417924] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-13T21:53:40.711020] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T21:53:40.733609] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T21:53:41.027376] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (4.61 seconds). [2025-10-13T21:53:41.217956] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-13T21:53:41.574816] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T21:53:42.017982] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-13T21:53:42.803418] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T21:53:42.817960] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-13T21:53:43.090951] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T21:53:43.617983] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-13T21:53:44.337459] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T21:53:44.417971] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-13T21:53:45.217931] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-13T21:53:45.294200] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T21:53:45.377051] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T21:53:46.017976] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-13T21:53:46.527158] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T21:53:46.784407] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T21:53:46.817895] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-13T21:53:47.617956] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-13T21:53:47.953270] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T21:53:48.417964] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-13T21:53:49.010856] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T21:53:49.014735] [INFO ] [REMOTE ] THO: Full fetch complete (60169 records). [2025-10-13T21:53:49.014847] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-13T21:53:49.225088] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-13T21:53:49.403142] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-13T21:53:49.403284] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-13T21:53:49.404386] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-13T21:53:49.404451] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-13T21:53:49.405738] [DEBUG] [LOCAL ] THO: Trimmed 60169 records to 41659 (keeping 200 days of data) [2025-10-13T21:53:49.638197] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T21:53:49.689026] [DEBUG] [LOCAL ] THO: Primary data saved (41659 records). [2025-10-13T21:53:49.689155] [INFO ] [MAIN ] THO: Full history saved. [2025-10-13T21:53:49.689235] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THO took 33.2s. Estimated remaining: 39m 49s. Rate: 7.1 symbols/min [2025-10-13T21:53:49.858533] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:49.897112] [DEBUG] [LOCAL ] THS: Loaded 38977 existing records from primary storage. [2025-10-13T21:53:49.897400] [INFO ] [MAIN ] THS: Loaded 38977 existing records. [2025-10-13T21:53:50.023065] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-13T21:53:50.079277] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:50.079505] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-13T21:53:50.079589] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-13T21:53:50.080006] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-13T21:53:50.080063] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-13T21:53:50.432606] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:50.638831] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T21:53:50.817940] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-13T21:53:51.157552] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T21:53:51.617983] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-13T21:53:52.378240] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T21:53:52.417897] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-13T21:53:52.763243] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T21:53:53.217964] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-13T21:53:53.370691] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T21:53:54.017948] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-13T21:53:54.529304] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T21:53:54.533552] [INFO ] [REMOTE ] THC: Full fetch complete (68771 records). [2025-10-13T21:53:54.533680] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-13T21:53:54.826563] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-13T21:53:54.962155] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-13T21:53:54.962250] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-13T21:53:54.963270] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-13T21:53:54.963333] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-13T21:53:54.964691] [DEBUG] [LOCAL ] THC: Trimmed 68771 records to 47182 (keeping 200 days of data) [2025-10-13T21:53:55.253411] [DEBUG] [LOCAL ] THC: Primary data saved (47182 records). [2025-10-13T21:53:55.253545] [INFO ] [MAIN ] THC: Full history saved. [2025-10-13T21:53:55.253625] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THC took 1m 5s. Estimated remaining: 39m 40s. Rate: 7.1 symbols/min [2025-10-13T21:53:55.447085] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:53:55.449291] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T21:53:55.475170] [DEBUG] [LOCAL ] THW: Loaded 19931 existing records from primary storage. [2025-10-13T21:53:55.475401] [INFO ] [MAIN ] THW: Loaded 19931 existing records. [2025-10-13T21:53:55.622124] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-13T21:53:55.660425] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:53:55.660788] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-13T21:53:55.660842] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-13T21:53:55.661241] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-13T21:53:55.661348] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-13T21:53:55.812241] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T21:53:56.029742] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:53:56.418004] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-13T21:53:57.149858] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T21:53:57.218032] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-13T21:53:58.017985] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-13T21:53:58.075211] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T21:53:58.752251] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:53:58.817982] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-13T21:53:59.414162] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T21:53:59.617897] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-13T21:53:59.959956] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T21:54:00.417981] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-13T21:54:00.596738] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T21:54:01.217980] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-13T21:54:01.753384] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T21:54:02.018093] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-13T21:54:02.266586] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T21:54:02.817924] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-13T21:54:03.108343] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T21:54:03.617999] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-13T21:54:04.330562] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T21:54:04.417971] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-13T21:54:04.939952] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:54:05.217984] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-13T21:54:05.799128] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T21:54:06.017935] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-13T21:54:06.354356] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T21:54:06.817894] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-13T21:54:06.914292] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T21:54:06.916687] [INFO ] [REMOTE ] THR: Full fetch complete (28627 records). [2025-10-13T21:54:06.916757] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-13T21:54:07.280387] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-13T21:54:07.280494] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-13T21:54:07.281099] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-13T21:54:07.281161] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-13T21:54:07.281929] [DEBUG] [LOCAL ] THR: Trimmed 28627 records to 19704 (keeping 200 days of data) [2025-10-13T21:54:07.401682] [DEBUG] [LOCAL ] THR: Primary data saved (19704 records). [2025-10-13T21:54:07.401834] [INFO ] [MAIN ] THR: Full history saved. [2025-10-13T21:54:07.401916] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THR took 33.5s. Estimated remaining: 39m 32s. Rate: 7.1 symbols/min [2025-10-13T21:54:07.577252] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:07.577432] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-13T21:54:07.577473] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-13T21:54:07.577585] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-13T21:54:07.577695] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-13T21:54:07.577761] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-13T21:54:07.577797] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-13T21:54:07.625110] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-13T21:54:07.956710] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:08.290018] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:54:08.402965] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T21:54:08.405829] [INFO ] [REMOTE ] THQ: Full fetch complete (34911 records). [2025-10-13T21:54:08.405921] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-13T21:54:08.426344] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-13T21:54:08.714841] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:54:08.749745] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-13T21:54:08.776112] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:54:08.788451] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-13T21:54:08.788531] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-13T21:54:08.788619] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-13T21:54:08.789370] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-13T21:54:08.789448] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-13T21:54:08.789528] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:54:08.789700] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-13T21:54:08.789797] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-13T21:54:08.790170] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-13T21:54:08.790317] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-13T21:54:08.790465] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. TIC took 1.4s. Estimated remaining: 39m 23s. Rate: 7.1 symbols/min [2025-10-13T21:54:08.790795] [DEBUG] [LOCAL ] THQ: Trimmed 34911 records to 25308 (keeping 200 days of data) [2025-10-13T21:54:09.088443] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:09.135965] [DEBUG] [LOCAL ] TIMB: Loaded 36068 existing records from primary storage. [2025-10-13T21:54:09.137002] [INFO ] [MAIN ] TIMB: Loaded 36068 existing records. [2025-10-13T21:54:09.220130] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-13T21:54:09.380281] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:09.383870] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-13T21:54:09.383954] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-13T21:54:09.384022] [DEBUG] [LOCAL ] THQ: Primary data saved (25308 records). [2025-10-13T21:54:09.384254] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-13T21:54:09.384349] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THQ took 37.0s. Estimated remaining: 39m 13s. Rate: 7.1 symbols/min [2025-10-13T21:54:09.384502] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-13T21:54:09.384676] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-13T21:54:09.707595] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:09.825901] [DEBUG] [LOCAL ] TISI: Loaded 3496 existing records from primary storage. [2025-10-13T21:54:09.851488] [INFO ] [MAIN ] TISI: Loaded 3496 existing records. [2025-10-13T21:54:10.041988] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:10.031684] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-13T21:54:10.109637] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:10.109883] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-13T21:54:10.109930] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-13T21:54:10.110140] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-13T21:54:10.110195] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-13T21:54:10.467992] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:10.766449] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:54:10.817949] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-13T21:54:11.200045] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T21:54:11.400756] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-13T21:54:11.617957] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-13T21:54:12.092166] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T21:54:12.417956] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-13T21:54:13.217935] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-13T21:54:13.640128] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T21:54:13.749794] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T21:54:14.018086] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-13T21:54:14.818034] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-13T21:54:15.542004] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T21:54:15.617933] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-13T21:54:16.394269] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T21:54:16.417960] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-13T21:54:16.968510] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T21:54:17.217946] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-13T21:54:17.701296] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T21:54:17.711066] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T21:54:17.713336] [INFO ] [REMOTE ] THS: Full fetch complete (54372 records). [2025-10-13T21:54:17.714162] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-13T21:54:18.023182] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-13T21:54:18.100185] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-13T21:54:18.100326] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-13T21:54:18.101421] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-13T21:54:18.101486] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-13T21:54:18.102734] [DEBUG] [LOCAL ] THS: Trimmed 54372 records to 38578 (keeping 200 days of data) [2025-10-13T21:54:18.332034] [DEBUG] [LOCAL ] THS: Primary data saved (38578 records). [2025-10-13T21:54:18.332166] [INFO ] [MAIN ] THS: Full history saved. [2025-10-13T21:54:18.332332] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 28.6s. Estimated remaining: 39m 5s. Rate: 7.1 symbols/min [2025-10-13T21:54:18.499122] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:18.529915] [DEBUG] [LOCAL ] TIXT: Loaded 32473 existing records from primary storage. [2025-10-13T21:54:18.530182] [INFO ] [MAIN ] TIXT: Loaded 32473 existing records. [2025-10-13T21:54:18.711220] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:18.711400] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-13T21:54:18.711446] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-13T21:54:18.711718] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-13T21:54:18.711784] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-13T21:54:18.823049] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-13T21:54:19.082830] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:19.103124] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T21:54:19.617924] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-13T21:54:19.773487] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T21:54:20.417960] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-13T21:54:21.007115] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T21:54:21.101913] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T21:54:21.217963] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-13T21:54:22.017968] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-13T21:54:22.707418] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T21:54:22.817923] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-13T21:54:23.287222] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T21:54:23.617945] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-13T21:54:23.944216] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T21:54:24.417970] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-13T21:54:24.803163] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T21:54:25.025300] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T21:54:25.217985] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-13T21:54:25.521153] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-13T21:54:26.018054] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-13T21:54:26.526271] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T21:54:26.817994] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-13T21:54:27.262676] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T21:54:27.617932] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-13T21:54:28.078342] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T21:54:28.079496] [INFO ] [REMOTE ] TISI: Full fetch complete (4922 records). [2025-10-13T21:54:28.079575] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-13T21:54:28.427472] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-13T21:54:28.459929] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-13T21:54:28.460012] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-13T21:54:28.460198] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-13T21:54:28.460238] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-13T21:54:28.460595] [DEBUG] [LOCAL ] TISI: Trimmed 4922 records to 3349 (keeping 200 days of data) [2025-10-13T21:54:28.481040] [DEBUG] [LOCAL ] TISI: Primary data saved (3349 records). [2025-10-13T21:54:28.481127] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-13T21:54:28.481221] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 19.1s. Estimated remaining: 38m 57s. Rate: 7.1 symbols/min [2025-10-13T21:54:28.652326] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:28.705541] [DEBUG] [LOCAL ] TJX: Loaded 54447 existing records from primary storage. [2025-10-13T21:54:28.705901] [INFO ] [MAIN ] TJX: Loaded 54447 existing records. [2025-10-13T21:54:28.877538] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:28.877767] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-13T21:54:28.877874] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-13T21:54:28.878315] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-13T21:54:28.878374] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-13T21:54:29.235577] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-13T21:54:29.240967] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:29.858318] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T21:54:30.017968] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-13T21:54:30.248091] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T21:54:30.817934] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-13T21:54:31.559210] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T21:54:31.617892] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-13T21:54:32.042322] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T21:54:32.417937] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-13T21:54:33.217896] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-13T21:54:33.310916] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T21:54:33.453231] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T21:54:34.018009] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-13T21:54:34.571831] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T21:54:34.817970] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-13T21:54:35.381366] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T21:54:35.511698] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T21:54:35.617967] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-13T21:54:36.418016] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-13T21:54:36.757001] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:54:37.217963] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-13T21:54:37.662061] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T21:54:38.017961] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-13T21:54:38.817948] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-13T21:54:39.011604] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T21:54:39.015197] [INFO ] [REMOTE ] TIMB: Full fetch complete (53464 records). [2025-10-13T21:54:39.015295] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-13T21:54:39.416363] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-13T21:54:39.426088] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-13T21:54:39.427048] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-13T21:54:39.427136] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-13T21:54:39.429466] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-13T21:54:39.441256] [DEBUG] [LOCAL ] TIMB: Trimmed 53464 records to 35399 (keeping 200 days of data) [2025-10-13T21:54:39.620960] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-13T21:54:39.673727] [DEBUG] [LOCAL ] TIMB: Primary data saved (35399 records). [2025-10-13T21:54:39.673898] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-13T21:54:39.673988] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIMB took 30.9s. Estimated remaining: 38m 49s. Rate: 7.1 symbols/min [2025-10-13T21:54:39.790227] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T21:54:39.819080] [INFO ] [REMOTE ] THW: Full fetch complete (29080 records). [2025-10-13T21:54:39.838313] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-13T21:54:39.898138] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:40.250995] [DEBUG] [LOCAL ] TK: Loaded 39728 existing records from primary storage. [2025-10-13T21:54:40.270683] [INFO ] [MAIN ] TK: Loaded 39728 existing records. [2025-10-13T21:54:40.310358] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-13T21:54:40.321841] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-13T21:54:40.355764] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-13T21:54:40.355863] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-13T21:54:40.384177] [DEBUG] [LOCAL ] THW: Trimmed 29080 records to 19722 (keeping 200 days of data) [2025-10-13T21:54:40.427287] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-13T21:54:40.555383] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:40.563617] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-13T21:54:40.565339] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-13T21:54:40.567066] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-13T21:54:40.567708] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-13T21:54:40.868193] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T21:54:40.967373] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:40.972778] [DEBUG] [LOCAL ] THW: Primary data saved (19722 records). [2025-10-13T21:54:40.972908] [INFO ] [MAIN ] THW: Full history saved. [2025-10-13T21:54:40.973033] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. THW took 45.7s. Estimated remaining: 38m 39s. Rate: 7.1 symbols/min [2025-10-13T21:54:41.158468] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:54:41.199943] [DEBUG] [LOCAL ] TKC: Loaded 39807 existing records from primary storage. [2025-10-13T21:54:41.200266] [INFO ] [MAIN ] TKC: Loaded 39807 existing records. [2025-10-13T21:54:41.223074] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-13T21:54:41.381755] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:54:41.381944] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-13T21:54:41.381989] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-13T21:54:41.382291] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-13T21:54:41.382336] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-13T21:54:41.752482] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:54:42.018005] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-13T21:54:42.410727] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T21:54:42.804392] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T21:54:42.817894] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-13T21:54:43.264639] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T21:54:43.617970] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-13T21:54:44.231840] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T21:54:44.418048] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-13T21:54:44.866450] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T21:54:45.218061] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-13T21:54:45.771801] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T21:54:46.017972] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-13T21:54:46.817947] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-13T21:54:47.141718] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T21:54:47.167628] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T21:54:47.617951] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-13T21:54:48.034383] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T21:54:48.417955] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-13T21:54:48.910221] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T21:54:49.218003] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-13T21:54:50.018028] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-13T21:54:50.048472] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:54:50.817954] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-13T21:54:51.254903] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T21:54:51.444416] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T21:54:51.617948] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-13T21:54:52.296552] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T21:54:52.417979] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-13T21:54:53.050151] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T21:54:53.217938] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-13T21:54:53.912597] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T21:54:54.017997] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-13T21:54:54.745321] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T21:54:54.817936] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-13T21:54:55.049922] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T21:54:55.617935] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-13T21:54:56.410061] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T21:54:56.419574] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-13T21:54:56.934297] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:54:57.217977] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-13T21:54:57.742797] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:54:58.017948] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-13T21:54:58.770702] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T21:54:58.817895] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-13T21:54:59.617936] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-13T21:55:00.057246] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T21:55:00.288584] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:55:00.417946] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-13T21:55:01.155624] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T21:55:01.217961] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-13T21:55:02.017929] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-13T21:55:02.509953] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T21:55:02.830212] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-13T21:55:02.846955] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T21:55:02.873970] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T21:55:02.878775] [INFO ] [REMOTE ] TIXT: Full fetch complete (46236 records). [2025-10-13T21:55:02.878954] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-13T21:55:03.265555] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-13T21:55:03.265707] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-13T21:55:03.266961] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-13T21:55:03.267028] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-13T21:55:03.268480] [DEBUG] [LOCAL ] TIXT: Trimmed 46236 records to 32346 (keeping 200 days of data) [2025-10-13T21:55:03.472612] [DEBUG] [LOCAL ] TIXT: Primary data saved (32346 records). [2025-10-13T21:55:03.472894] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-13T21:55:03.472998] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIXT took 45.1s. Estimated remaining: 38m 33s. Rate: 7.1 symbols/min [2025-10-13T21:55:03.623060] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-13T21:55:03.657364] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:03.711208] [DEBUG] [LOCAL ] TKO: Loaded 44571 existing records from primary storage. [2025-10-13T21:55:03.711638] [INFO ] [MAIN ] TKO: Loaded 44571 existing records. [2025-10-13T21:55:03.901985] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:03.902363] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-13T21:55:03.902423] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-13T21:55:03.902891] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-13T21:55:03.902949] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-13T21:55:04.265262] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:04.417966] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-13T21:55:04.966598] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T21:55:04.973990] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T21:55:05.217926] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-13T21:55:06.028302] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-13T21:55:06.033954] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T21:55:06.817926] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-13T21:55:07.180978] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T21:55:07.218518] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T21:55:07.617934] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-13T21:55:08.417972] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-13T21:55:08.510637] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:55:08.915855] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T21:55:09.217946] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-13T21:55:10.017918] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-13T21:55:10.372972] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T21:55:10.507808] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T21:55:10.511793] [INFO ] [REMOTE ] TK: Full fetch complete (56240 records). [2025-10-13T21:55:10.511899] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-13T21:55:10.823120] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-13T21:55:10.889043] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-13T21:55:10.889121] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-13T21:55:10.890050] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-13T21:55:10.890112] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-13T21:55:10.891337] [DEBUG] [LOCAL ] TK: Trimmed 56240 records to 39201 (keeping 200 days of data) [2025-10-13T21:55:11.123433] [DEBUG] [LOCAL ] TK: Primary data saved (39201 records). [2025-10-13T21:55:11.123578] [INFO ] [MAIN ] TK: Full history saved. [2025-10-13T21:55:11.123687] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 31.4s. Estimated remaining: 38m 24s. Rate: 7.1 symbols/min [2025-10-13T21:55:11.294634] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:11.311010] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T21:55:11.316804] [INFO ] [REMOTE ] TJX: Full fetch complete (77681 records). [2025-10-13T21:55:11.316953] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-13T21:55:11.622552] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-13T21:55:11.624600] [DEBUG] [LOCAL ] TKR: Loaded 40474 existing records from primary storage. [2025-10-13T21:55:11.636071] [INFO ] [MAIN ] TKR: Loaded 40474 existing records. [2025-10-13T21:55:11.920211] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-13T21:55:11.933390] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-13T21:55:11.942029] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-13T21:55:11.959431] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-13T21:55:11.962360] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:11.963260] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-13T21:55:11.963353] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-13T21:55:11.963813] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-13T21:55:11.963971] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-13T21:55:12.018895] [DEBUG] [LOCAL ] TJX: Trimmed 77681 records to 53668 (keeping 200 days of data) [2025-10-13T21:55:12.354493] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-13T21:55:12.424264] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-13T21:55:12.484988] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:12.705380] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-13T21:55:12.705514] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-13T21:55:12.705592] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 44.2s. Estimated remaining: 38m 15s. Rate: 7.1 symbols/min [2025-10-13T21:55:12.872246] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:12.912856] [DEBUG] [LOCAL ] TLK: Loaded 39321 existing records from primary storage. [2025-10-13T21:55:12.913192] [INFO ] [MAIN ] TLK: Loaded 39321 existing records. [2025-10-13T21:55:13.093597] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:13.093928] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-13T21:55:13.094058] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-13T21:55:13.103022] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-13T21:55:13.115611] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-13T21:55:13.189406] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:55:13.219696] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-13T21:55:13.500974] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:14.017915] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-13T21:55:14.361440] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T21:55:14.769162] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:55:14.817890] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-13T21:55:15.474769] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T21:55:15.617937] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-13T21:55:16.376116] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T21:55:16.417884] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-13T21:55:17.217927] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-13T21:55:17.247281] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:55:17.989578] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T21:55:18.017895] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-13T21:55:18.817983] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-13T21:55:19.060305] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T21:55:19.452461] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T21:55:19.621051] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-13T21:55:20.026536] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T21:55:20.031431] [INFO ] [REMOTE ] TKC: Full fetch complete (53272 records). [2025-10-13T21:55:20.031556] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-13T21:55:20.401072] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-13T21:55:20.401155] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-13T21:55:20.402049] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-13T21:55:20.402148] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-13T21:55:20.403312] [DEBUG] [LOCAL ] TKC: Trimmed 53272 records to 39245 (keeping 200 days of data) [2025-10-13T21:55:20.452163] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-13T21:55:20.629937] [DEBUG] [LOCAL ] TKC: Primary data saved (39245 records). [2025-10-13T21:55:20.630076] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-13T21:55:20.630154] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 39.7s. Estimated remaining: 38m 6s. Rate: 7.1 symbols/min [2025-10-13T21:55:20.797949] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:20.815822] [DEBUG] [LOCAL ] TLYS: Loaded 16650 existing records from primary storage. [2025-10-13T21:55:20.816052] [INFO ] [MAIN ] TLYS: Loaded 16650 existing records. [2025-10-13T21:55:20.988963] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:20.989193] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-13T21:55:20.989251] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-13T21:55:20.989488] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-13T21:55:20.989544] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-13T21:55:21.230038] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-13T21:55:21.352002] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:21.385925] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T21:55:22.017892] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-13T21:55:22.101381] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T21:55:22.641289] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:55:22.817918] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-13T21:55:22.967140] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T21:55:23.618013] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-13T21:55:24.417932] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-13T21:55:24.462693] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T21:55:24.548398] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T21:55:25.217935] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-13T21:55:26.026418] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-13T21:55:26.035899] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T21:55:26.036187] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T21:55:26.817970] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-13T21:55:27.588851] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:55:27.617946] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-13T21:55:27.683310] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T21:55:28.417972] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-13T21:55:29.217496] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T21:55:29.222888] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-13T21:55:29.240448] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T21:55:30.017950] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-13T21:55:30.784539] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T21:55:30.817891] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-13T21:55:31.199988] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T21:55:31.617960] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-13T21:55:32.309909] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T21:55:32.417895] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-13T21:55:33.217941] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-13T21:55:33.291555] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T21:55:33.874850] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T21:55:34.017915] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-13T21:55:34.654165] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T21:55:34.817971] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-13T21:55:35.069477] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T21:55:35.617937] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-13T21:55:36.074886] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T21:55:36.417949] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-13T21:55:37.070314] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T21:55:37.127433] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T21:55:37.217922] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-13T21:55:38.017948] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-13T21:55:38.055999] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T21:55:38.817938] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-13T21:55:39.512873] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:55:39.618008] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-13T21:55:39.759234] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T21:55:40.417937] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-13T21:55:41.151440] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T21:55:41.217985] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-13T21:55:41.561453] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T21:55:42.017977] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-13T21:55:42.717753] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T21:55:42.817922] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-13T21:55:43.322033] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T21:55:43.326184] [INFO ] [REMOTE ] TLK: Full fetch complete (57243 records). [2025-10-13T21:55:43.326290] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-13T21:55:43.623031] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-13T21:55:43.766084] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-13T21:55:43.766222] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-13T21:55:43.767304] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-13T21:55:43.767400] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-13T21:55:43.768958] [DEBUG] [LOCAL ] TLK: Trimmed 57243 records to 38623 (keeping 200 days of data) [2025-10-13T21:55:44.009721] [DEBUG] [LOCAL ] TLK: Primary data saved (38623 records). [2025-10-13T21:55:44.009861] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-13T21:55:44.009942] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TLK took 31.3s. Estimated remaining: 37m 60s. Rate: 7.1 symbols/min [2025-10-13T21:55:44.179036] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:44.216638] [DEBUG] [LOCAL ] TM: Loaded 36916 existing records from primary storage. [2025-10-13T21:55:44.226634] [INFO ] [MAIN ] TM: Loaded 36916 existing records. [2025-10-13T21:55:44.226516] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T21:55:44.293173] [INFO ] [REMOTE ] TKR: Full fetch complete (57801 records). [2025-10-13T21:55:44.308829] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-13T21:55:44.382929] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T21:55:44.462751] [INFO ] [REMOTE ] TLYS: Full fetch complete (21692 records). [2025-10-13T21:55:44.433307] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-13T21:55:44.518032] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-13T21:55:44.523609] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:44.540080] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-13T21:55:44.540263] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-13T21:55:44.621601] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-13T21:55:44.682573] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-13T21:55:45.271820] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-13T21:55:45.349467] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-13T21:55:45.381945] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-13T21:55:45.454986] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-13T21:55:45.538997] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-13T21:55:45.566753] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-13T21:55:45.566545] [DEBUG] [LOCAL ] TKR: Trimmed 57801 records to 39889 (keeping 200 days of data) [2025-10-13T21:55:45.596069] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-13T21:55:45.600978] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-13T21:55:45.733005] [DEBUG] [LOCAL ] TLYS: Trimmed 21692 records to 16571 (keeping 200 days of data) [2025-10-13T21:55:45.723783] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:45.740634] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-13T21:55:46.006589] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T21:55:46.005699] [DEBUG] [LOCAL ] TKR: Primary data saved (39889 records). [2025-10-13T21:55:46.024137] [DEBUG] [LOCAL ] TLYS: Primary data saved (16571 records). [2025-10-13T21:55:46.024858] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-13T21:55:46.024336] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-13T21:55:46.025563] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TLYS took 25.4s. Estimated remaining: 37m 51s. Rate: 7.1 symbols/min [2025-10-13T21:55:46.025272] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-13T21:55:46.037213] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TKR took 34.9s. Estimated remaining: 37m 41s. Rate: 7.1 symbols/min [2025-10-13T21:55:46.389460] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:46.419607] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:46.488041] [DEBUG] [LOCAL ] TMHC: Loaded 45999 existing records from primary storage. [2025-10-13T21:55:46.488373] [INFO ] [MAIN ] TMHC: Loaded 45999 existing records. [2025-10-13T21:55:46.630992] [DEBUG] [LOCAL ] TME: Loaded 53957 existing records from primary storage. [2025-10-13T21:55:46.639497] [INFO ] [MAIN ] TME: Loaded 53957 existing records. [2025-10-13T21:55:46.834232] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:46.869104] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-13T21:55:46.899432] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-13T21:55:46.942945] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T21:55:46.943332] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-13T21:55:46.973682] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-13T21:55:47.042203] [INFO ] [REMOTE ] TKO: Full fetch complete (64993 records). [2025-10-13T21:55:47.060797] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-13T21:55:47.117550] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:47.154602] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-13T21:55:47.248668] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-13T21:55:47.341127] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-13T21:55:47.352205] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-13T21:55:48.182205] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:48.226893] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-13T21:55:48.227196] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-13T21:55:48.249693] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-13T21:55:48.253528] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-13T21:55:48.281253] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:48.276081] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-13T21:55:48.281857] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-13T21:55:48.306087] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-13T21:55:48.315578] [DEBUG] [LOCAL ] TKO: Trimmed 64993 records to 43845 (keeping 200 days of data) [2025-10-13T21:55:48.418777] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-13T21:55:48.604769] [DEBUG] [LOCAL ] TKO: Primary data saved (43845 records). [2025-10-13T21:55:48.604921] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-13T21:55:48.605010] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TKO took 45.1s. Estimated remaining: 37m 32s. Rate: 7.1 symbols/min [2025-10-13T21:55:48.779099] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:55:48.830122] [DEBUG] [LOCAL ] TMO: Loaded 53169 existing records from primary storage. [2025-10-13T21:55:48.830450] [INFO ] [MAIN ] TMO: Loaded 53169 existing records. [2025-10-13T21:55:49.011665] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:55:49.011879] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-13T21:55:49.011949] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-13T21:55:49.012240] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-13T21:55:49.012279] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-13T21:55:49.370667] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:55:49.371940] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-13T21:55:49.861945] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T21:55:50.017881] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-13T21:55:50.109617] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T21:55:50.224509] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T21:55:50.817942] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-13T21:55:51.169940] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T21:55:51.598700] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T21:55:51.617890] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-13T21:55:52.152596] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T21:55:52.417919] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-13T21:55:53.142326] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T21:55:53.217950] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-13T21:55:53.892479] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T21:55:54.017970] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-13T21:55:54.817928] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-13T21:55:55.018522] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T21:55:55.617964] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-13T21:55:55.875457] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:55:56.407260] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T21:55:56.417889] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-13T21:55:57.121241] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T21:55:57.217887] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-13T21:55:57.647485] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T21:55:58.017934] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-13T21:55:58.817941] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-13T21:55:59.170273] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T21:55:59.202964] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T21:55:59.617944] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-13T21:56:00.410633] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:56:00.420731] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-13T21:56:01.217946] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-13T21:56:01.668175] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T21:56:02.017958] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-13T21:56:02.057951] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T21:56:02.817992] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-13T21:56:02.882225] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T21:56:03.617952] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-13T21:56:03.845679] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T21:56:04.417944] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-13T21:56:04.724186] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T21:56:05.224165] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-13T21:56:05.240417] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T21:56:06.017960] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-13T21:56:06.229545] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T21:56:06.818013] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-13T21:56:07.107806] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T21:56:07.274955] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T21:56:07.617934] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-13T21:56:08.417995] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-13T21:56:08.620834] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T21:56:09.208987] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T21:56:09.217925] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-13T21:56:10.017932] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-13T21:56:10.102879] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T21:56:10.817924] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-13T21:56:10.850726] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:56:11.617945] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-13T21:56:11.773558] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T21:56:12.334867] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T21:56:12.417921] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-13T21:56:13.217932] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-13T21:56:13.763307] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T21:56:13.765088] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T21:56:13.779126] [INFO ] [REMOTE ] TM: Full fetch complete (52618 records). [2025-10-13T21:56:13.779516] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-13T21:56:14.028748] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-13T21:56:14.155232] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-13T21:56:14.155317] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-13T21:56:14.156207] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-13T21:56:14.156270] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-13T21:56:14.157517] [DEBUG] [LOCAL ] TM: Trimmed 52618 records to 36628 (keeping 200 days of data) [2025-10-13T21:56:14.379302] [DEBUG] [LOCAL ] TM: Primary data saved (36628 records). [2025-10-13T21:56:14.379448] [INFO ] [MAIN ] TM: Full history saved. [2025-10-13T21:56:14.379547] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 30.4s. Estimated remaining: 37m 26s. Rate: 7.1 symbols/min [2025-10-13T21:56:14.546138] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:14.562117] [DEBUG] [LOCAL ] TNC: Loaded 14744 existing records from primary storage. [2025-10-13T21:56:14.562338] [INFO ] [MAIN ] TNC: Loaded 14744 existing records. [2025-10-13T21:56:14.740122] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:14.740363] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-13T21:56:14.740436] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-13T21:56:14.740851] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-13T21:56:14.740910] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-13T21:56:14.837441] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-13T21:56:15.031196] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T21:56:15.154728] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:15.617891] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-13T21:56:16.105415] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T21:56:16.417939] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-13T21:56:16.727699] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T21:56:16.732472] [INFO ] [REMOTE ] TMHC: Full fetch complete (65993 records). [2025-10-13T21:56:16.732577] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-13T21:56:17.141176] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-13T21:56:17.167505] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-13T21:56:17.167771] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-13T21:56:17.169011] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-13T21:56:17.169466] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-13T21:56:17.176311] [DEBUG] [LOCAL ] TMHC: Trimmed 65993 records to 45406 (keeping 200 days of data) [2025-10-13T21:56:17.182313] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T21:56:17.233106] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-13T21:56:17.461409] [DEBUG] [LOCAL ] TMHC: Primary data saved (45406 records). [2025-10-13T21:56:17.461565] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-13T21:56:17.461698] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMHC took 31.4s. Estimated remaining: 37m 17s. Rate: 7.1 symbols/min [2025-10-13T21:56:17.631049] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:17.661164] [DEBUG] [LOCAL ] TNET: Loaded 28679 existing records from primary storage. [2025-10-13T21:56:17.661433] [INFO ] [MAIN ] TNET: Loaded 28679 existing records. [2025-10-13T21:56:17.839728] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:17.839961] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-13T21:56:17.840009] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-13T21:56:17.840321] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-13T21:56:17.840379] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-13T21:56:18.025385] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-13T21:56:18.206949] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:18.817941] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-13T21:56:19.043463] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T21:56:19.099616] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T21:56:19.617922] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-13T21:56:20.417961] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-13T21:56:20.621861] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T21:56:21.055082] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-13T21:56:21.217889] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-13T21:56:21.598888] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T21:56:22.017918] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-13T21:56:22.232737] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T21:56:22.817921] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-13T21:56:23.177985] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T21:56:23.617893] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-13T21:56:23.938787] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T21:56:24.417951] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-13T21:56:25.217930] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-13T21:56:25.355087] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T21:56:25.368706] [INFO ] [REMOTE ] TME: Full fetch complete (76916 records). [2025-10-13T21:56:25.369709] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T21:56:25.369300] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-13T21:56:25.772845] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-13T21:56:25.772918] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-13T21:56:25.773976] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-13T21:56:25.774043] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-13T21:56:25.775365] [DEBUG] [LOCAL ] TME: Trimmed 76916 records to 53188 (keeping 200 days of data) [2025-10-13T21:56:26.045237] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-13T21:56:26.096029] [DEBUG] [LOCAL ] TME: Primary data saved (53188 records). [2025-10-13T21:56:26.096129] [INFO ] [MAIN ] TME: Full history saved. [2025-10-13T21:56:26.096205] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TME took 40.1s. Estimated remaining: 37m 8s. Rate: 7.1 symbols/min [2025-10-13T21:56:26.260749] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:26.260899] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-13T21:56:26.260935] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-13T21:56:26.261064] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-13T21:56:26.261124] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-13T21:56:26.261172] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-13T21:56:26.261259] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-13T21:56:26.607509] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:26.817884] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-13T21:56:27.021452] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T21:56:27.021812] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-13T21:56:27.021955] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T21:56:27.022043] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-13T21:56:27.022152] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T21:56:27.022243] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-13T21:56:27.022321] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-13T21:56:27.022358] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-13T21:56:27.022397] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-13T21:56:27.022443] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNGY took 0.9s. Estimated remaining: 36m 59s. Rate: 7.1 symbols/min [2025-10-13T21:56:27.076783] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T21:56:27.212556] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:27.260204] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-13T21:56:27.299022] [DEBUG] [LOCAL ] TNK: Loaded 35697 existing records from primary storage. [2025-10-13T21:56:27.299357] [INFO ] [MAIN ] TNK: Loaded 35697 existing records. [2025-10-13T21:56:27.470380] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:27.470567] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-13T21:56:27.470611] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-13T21:56:27.470962] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-13T21:56:27.471018] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-13T21:56:27.621546] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-13T21:56:27.824727] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:28.417950] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-13T21:56:29.221666] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-13T21:56:29.495800] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T21:56:29.869085] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T21:56:30.017884] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-13T21:56:30.648283] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:56:30.817949] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-13T21:56:31.420074] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T21:56:31.617936] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-13T21:56:31.851971] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T21:56:32.183689] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T21:56:32.189106] [INFO ] [REMOTE ] TMO: Full fetch complete (75462 records). [2025-10-13T21:56:32.189243] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-13T21:56:32.423020] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-13T21:56:32.585876] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-13T21:56:32.586229] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-13T21:56:32.588340] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-13T21:56:32.588404] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-13T21:56:32.592557] [DEBUG] [LOCAL ] TMO: Trimmed 75462 records to 52450 (keeping 200 days of data) [2025-10-13T21:56:32.936949] [DEBUG] [LOCAL ] TMO: Primary data saved (52450 records). [2025-10-13T21:56:32.937084] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-13T21:56:32.937216] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TMO took 44.3s. Estimated remaining: 36m 50s. Rate: 7.1 symbols/min [2025-10-13T21:56:33.106898] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:33.150212] [DEBUG] [LOCAL ] TNL: Loaded 42370 existing records from primary storage. [2025-10-13T21:56:33.150528] [INFO ] [MAIN ] TNL: Loaded 42370 existing records. [2025-10-13T21:56:33.223513] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-13T21:56:33.332008] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:33.332280] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-13T21:56:33.332328] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-13T21:56:33.332856] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-13T21:56:33.332928] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-13T21:56:33.678818] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:34.016510] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:56:34.024532] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-13T21:56:34.126472] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T21:56:34.817931] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-13T21:56:35.340261] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T21:56:35.617942] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-13T21:56:36.187405] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T21:56:36.417956] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-13T21:56:36.822718] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T21:56:37.217922] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-13T21:56:37.254162] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T21:56:38.017943] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-13T21:56:38.734489] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T21:56:38.818206] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-13T21:56:39.448598] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T21:56:39.617973] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-13T21:56:39.794600] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T21:56:40.417972] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-13T21:56:41.081256] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T21:56:41.218016] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-13T21:56:41.730367] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T21:56:41.966762] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T21:56:41.968505] [INFO ] [REMOTE ] TNC: Full fetch complete (22400 records). [2025-10-13T21:56:41.968573] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-13T21:56:42.018085] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-13T21:56:42.341578] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-13T21:56:42.341714] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-13T21:56:42.342545] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-13T21:56:42.342592] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-13T21:56:42.343637] [DEBUG] [LOCAL ] TNC: Trimmed 22400 records to 14489 (keeping 200 days of data) [2025-10-13T21:56:42.447276] [DEBUG] [LOCAL ] TNC: Primary data saved (14489 records). [2025-10-13T21:56:42.447486] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-13T21:56:42.447612] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNC took 28.1s. Estimated remaining: 36m 42s. Rate: 7.1 symbols/min [2025-10-13T21:56:42.624294] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:42.682432] [DEBUG] [LOCAL ] TOL: Loaded 51509 existing records from primary storage. [2025-10-13T21:56:42.682951] [INFO ] [MAIN ] TOL: Loaded 51509 existing records. [2025-10-13T21:56:42.823138] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-13T21:56:42.884756] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:42.885041] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-13T21:56:42.885091] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-13T21:56:42.885367] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-13T21:56:42.885412] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-13T21:56:43.348097] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:43.368504] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T21:56:43.617969] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-13T21:56:44.413154] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T21:56:44.420995] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-13T21:56:44.627034] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T21:56:45.217946] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-13T21:56:45.433447] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T21:56:46.017978] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-13T21:56:46.662095] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T21:56:46.817925] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-13T21:56:47.082160] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T21:56:47.617943] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-13T21:56:47.846278] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T21:56:48.417951] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-13T21:56:48.952726] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T21:56:49.217989] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-13T21:56:49.705349] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T21:56:50.017967] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-13T21:56:50.817919] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-13T21:56:51.108767] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T21:56:51.361366] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T21:56:51.617989] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-13T21:56:51.814329] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T21:56:51.817624] [INFO ] [REMOTE ] TNET: Full fetch complete (41609 records). [2025-10-13T21:56:51.817747] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-13T21:56:52.250194] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-13T21:56:52.250362] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-13T21:56:52.251812] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-13T21:56:52.251883] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-13T21:56:52.253615] [DEBUG] [LOCAL ] TNET: Trimmed 41609 records to 28317 (keeping 200 days of data) [2025-10-13T21:56:52.422618] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-13T21:56:52.461350] [DEBUG] [LOCAL ] TNET: Primary data saved (28317 records). [2025-10-13T21:56:52.461555] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-13T21:56:52.461721] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 35.0s. Estimated remaining: 36m 33s. Rate: 7.1 symbols/min [2025-10-13T21:56:52.644262] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:52.694688] [DEBUG] [LOCAL ] TOST: Loaded 54463 existing records from primary storage. [2025-10-13T21:56:52.695030] [INFO ] [MAIN ] TOST: Loaded 54463 existing records. [2025-10-13T21:56:52.872802] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:52.873035] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-13T21:56:52.873084] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-13T21:56:52.873529] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-13T21:56:52.873585] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-13T21:56:53.219142] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-13T21:56:53.257975] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:53.315470] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T21:56:53.353125] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T21:56:53.357073] [INFO ] [REMOTE ] TNK: Full fetch complete (51838 records). [2025-10-13T21:56:53.357172] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-13T21:56:53.738988] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-13T21:56:53.739117] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-13T21:56:53.740667] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-13T21:56:53.740740] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-13T21:56:53.742439] [DEBUG] [LOCAL ] TNK: Trimmed 51838 records to 35356 (keeping 200 days of data) [2025-10-13T21:56:53.994773] [DEBUG] [LOCAL ] TNK: Primary data saved (35356 records). [2025-10-13T21:56:53.994972] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-13T21:56:53.995074] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNK took 27.0s. Estimated remaining: 36m 24s. Rate: 7.1 symbols/min [2025-10-13T21:56:54.025128] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-13T21:56:54.179566] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:56:54.212335] [DEBUG] [LOCAL ] TPB: Loaded 26064 existing records from primary storage. [2025-10-13T21:56:54.212712] [INFO ] [MAIN ] TPB: Loaded 26064 existing records. [2025-10-13T21:56:54.390258] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:56:54.390526] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-13T21:56:54.390575] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-13T21:56:54.390946] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-13T21:56:54.391003] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-13T21:56:54.793116] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:56:54.817966] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-13T21:56:54.851707] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T21:56:55.617991] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-13T21:56:55.942772] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T21:56:56.383063] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T21:56:56.417916] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-13T21:56:57.217982] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-13T21:56:57.395726] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T21:56:57.870023] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T21:56:58.017958] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-13T21:56:58.360405] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T21:56:58.817977] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-13T21:56:59.569439] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T21:56:59.617935] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-13T21:57:00.417948] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-13T21:57:00.507034] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T21:57:01.217981] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-13T21:57:01.555381] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T21:57:01.735348] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T21:57:02.017952] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-13T21:57:02.307682] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T21:57:02.817988] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-13T21:57:03.571151] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T21:57:03.617923] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-13T21:57:04.417954] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-13T21:57:04.625306] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T21:57:04.707575] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T21:57:05.217941] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-13T21:57:05.530496] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T21:57:06.017977] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-13T21:57:06.711149] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T21:57:06.817920] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-13T21:57:07.220439] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T21:57:07.617976] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-13T21:57:08.132499] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T21:57:08.137430] [INFO ] [REMOTE ] TNL: Full fetch complete (59204 records). [2025-10-13T21:57:08.137581] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-13T21:57:08.423582] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-13T21:57:08.543180] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-13T21:57:08.543320] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-13T21:57:08.546772] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-13T21:57:08.546870] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-13T21:57:08.549157] [DEBUG] [LOCAL ] TNL: Trimmed 59204 records to 41758 (keeping 200 days of data) [2025-10-13T21:57:08.858789] [DEBUG] [LOCAL ] TNL: Primary data saved (41758 records). [2025-10-13T21:57:08.858970] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-13T21:57:08.859072] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNL took 35.9s. Estimated remaining: 36m 17s. Rate: 7.1 symbols/min [2025-10-13T21:57:09.052759] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:57:09.098087] [DEBUG] [LOCAL ] TPC: Loaded 39503 existing records from primary storage. [2025-10-13T21:57:09.098486] [INFO ] [MAIN ] TPC: Loaded 39503 existing records. [2025-10-13T21:57:09.223064] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-13T21:57:09.297620] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:57:09.298313] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-13T21:57:09.298398] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-13T21:57:09.298872] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-13T21:57:09.298937] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-13T21:57:09.660064] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T21:57:09.707465] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:57:09.751240] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T21:57:10.017976] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-13T21:57:10.817985] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-13T21:57:11.193461] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T21:57:11.340367] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T21:57:11.617982] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-13T21:57:12.417962] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-13T21:57:12.501247] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T21:57:13.072297] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T21:57:13.217932] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-13T21:57:13.305102] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T21:57:14.017933] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-13T21:57:14.753699] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T21:57:14.817941] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-13T21:57:15.617949] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-13T21:57:16.088707] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T21:57:16.261198] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T21:57:16.417957] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-13T21:57:16.840272] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T21:57:17.217975] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-13T21:57:17.754122] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T21:57:18.017965] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-13T21:57:18.817998] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-13T21:57:19.192126] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T21:57:19.617996] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-13T21:57:19.943699] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T21:57:20.090433] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T21:57:20.417978] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-13T21:57:21.217971] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-13T21:57:21.595440] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T21:57:21.961953] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T21:57:22.017961] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-13T21:57:22.638806] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T21:57:22.818043] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-13T21:57:23.266226] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T21:57:23.617986] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-13T21:57:24.332687] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T21:57:24.417951] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-13T21:57:24.651464] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T21:57:24.655625] [INFO ] [REMOTE ] TPB: Full fetch complete (35676 records). [2025-10-13T21:57:24.655766] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-13T21:57:25.081414] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-13T21:57:25.081582] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-13T21:57:25.083055] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-13T21:57:25.083124] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-13T21:57:25.084674] [DEBUG] [LOCAL ] TPB: Trimmed 35676 records to 25891 (keeping 200 days of data) [2025-10-13T21:57:25.219761] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-13T21:57:25.261849] [DEBUG] [LOCAL ] TPB: Primary data saved (25891 records). [2025-10-13T21:57:25.262061] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-13T21:57:25.262170] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TPB took 31.3s. Estimated remaining: 36m 9s. Rate: 7.1 symbols/min [2025-10-13T21:57:25.440829] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:57:25.495863] [DEBUG] [LOCAL ] TPH: Loaded 45574 existing records from primary storage. [2025-10-13T21:57:25.496336] [INFO ] [MAIN ] TPH: Loaded 45574 existing records. [2025-10-13T21:57:25.677770] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:57:25.678081] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-13T21:57:25.678134] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-13T21:57:25.678519] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-13T21:57:25.678575] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-13T21:57:26.026279] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-13T21:57:26.050855] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:57:26.312970] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T21:57:26.818039] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-13T21:57:27.423688] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T21:57:27.476553] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-13T21:57:27.617987] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-13T21:57:28.372869] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T21:57:28.417983] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-13T21:57:29.218022] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-13T21:57:29.624446] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T21:57:29.786221] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T21:57:29.792088] [INFO ] [REMOTE ] TOL: Full fetch complete (73618 records). [2025-10-13T21:57:29.792253] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-13T21:57:30.026116] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-13T21:57:30.227889] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-13T21:57:30.228037] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-13T21:57:30.229467] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-13T21:57:30.229537] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-13T21:57:30.231450] [DEBUG] [LOCAL ] TOL: Trimmed 73618 records to 50684 (keeping 200 days of data) [2025-10-13T21:57:30.592574] [DEBUG] [LOCAL ] TOL: Primary data saved (50684 records). [2025-10-13T21:57:30.592910] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-13T21:57:30.593058] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOL took 48.1s. Estimated remaining: 36m 0s. Rate: 7.1 symbols/min [2025-10-13T21:57:30.777750] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:57:30.805830] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T21:57:30.819078] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-13T21:57:30.826932] [DEBUG] [LOCAL ] TPL: Loaded 12460 existing records from primary storage. [2025-10-13T21:57:30.827180] [INFO ] [MAIN ] TPL: Loaded 12460 existing records. [2025-10-13T21:57:31.017773] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:57:31.018115] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-13T21:57:31.018167] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-13T21:57:31.018484] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-13T21:57:31.018542] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-13T21:57:31.405038] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:57:31.618015] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-13T21:57:31.683739] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T21:57:32.417961] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-13T21:57:32.620074] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T21:57:32.727331] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T21:57:33.217935] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-13T21:57:33.877983] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T21:57:34.017928] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-13T21:57:34.794269] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T21:57:34.799848] [INFO ] [REMOTE ] TOST: Full fetch complete (77703 records). [2025-10-13T21:57:34.799951] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-13T21:57:34.823188] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-13T21:57:35.204001] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-13T21:57:35.204184] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-13T21:57:35.205343] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-13T21:57:35.205429] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-13T21:57:35.218323] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T21:57:35.222634] [DEBUG] [LOCAL ] TOST: Trimmed 77703 records to 53685 (keeping 200 days of data) [2025-10-13T21:57:35.223858] [INFO ] [REMOTE ] TPC: Full fetch complete (55220 records). [2025-10-13T21:57:35.224315] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-13T21:57:35.624296] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-13T21:57:35.942244] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-13T21:57:35.943523] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-13T21:57:35.945321] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-13T21:57:35.945832] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-13T21:57:35.951070] [DEBUG] [LOCAL ] TPC: Trimmed 55220 records to 39010 (keeping 200 days of data) [2025-10-13T21:57:36.057606] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T21:57:36.316110] [DEBUG] [LOCAL ] TOST: Primary data saved (53685 records). [2025-10-13T21:57:36.318272] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-13T21:57:36.318429] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 43.9s. Estimated remaining: 35m 51s. Rate: 7.1 symbols/min [2025-10-13T21:57:36.423794] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-13T21:57:36.491378] [DEBUG] [LOCAL ] TPC: Primary data saved (39010 records). [2025-10-13T21:57:36.503043] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-13T21:57:36.504030] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 27.6s. Estimated remaining: 35m 42s. Rate: 7.1 symbols/min [2025-10-13T21:57:36.523516] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:57:36.588962] [DEBUG] [LOCAL ] TPR: Loaded 54214 existing records from primary storage. [2025-10-13T21:57:36.589555] [INFO ] [MAIN ] TPR: Loaded 54214 existing records. [2025-10-13T21:57:36.781242] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:57:36.781604] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-13T21:57:36.781682] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-13T21:57:36.782203] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-13T21:57:36.782261] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-13T21:57:37.158295] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:57:37.188149] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T21:57:37.217909] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-13T21:57:37.407695] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T21:57:38.018000] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-13T21:57:38.742705] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T21:57:38.818001] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-13T21:57:39.617987] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-13T21:57:40.003764] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T21:57:40.286857] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T21:57:40.374588] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T21:57:40.417924] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-13T21:57:41.218024] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-13T21:57:42.025759] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-13T21:57:42.042608] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T21:57:42.817954] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-13T21:57:42.929732] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T21:57:42.992430] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T21:57:43.617942] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-13T21:57:44.417936] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-13T21:57:44.486891] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T21:57:44.584008] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T21:57:45.217953] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-13T21:57:46.017995] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-13T21:57:46.324126] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T21:57:46.796717] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T21:57:46.817961] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-13T21:57:47.002307] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T21:57:47.617948] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-13T21:57:48.183460] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T21:57:48.417924] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-13T21:57:49.217924] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-13T21:57:49.453434] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:57:49.534831] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T21:57:50.018008] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-13T21:57:50.445489] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T21:57:50.451862] [INFO ] [REMOTE ] TPH: Full fetch complete (64822 records). [2025-10-13T21:57:50.451984] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-13T21:57:50.821010] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-13T21:57:50.838313] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-13T21:57:50.838407] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-13T21:57:50.839453] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-13T21:57:50.839542] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-13T21:57:50.840944] [DEBUG] [LOCAL ] TPH: Trimmed 64822 records to 44898 (keeping 200 days of data) [2025-10-13T21:57:51.104594] [DEBUG] [LOCAL ] TPH: Primary data saved (44898 records). [2025-10-13T21:57:51.104785] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-13T21:57:51.104871] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 25.8s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-13T21:57:51.892723] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T21:57:51.897557] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-13T21:57:51.945055] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T21:57:52.417965] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-13T21:57:52.584178] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T21:57:53.217981] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-13T21:57:53.674557] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T21:57:54.017994] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-13T21:57:54.366700] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T21:57:54.394348] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T21:57:54.396332] [INFO ] [REMOTE ] TPL: Full fetch complete (17625 records). [2025-10-13T21:57:54.396506] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-13T21:57:54.763761] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-13T21:57:54.763848] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-13T21:57:54.764761] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-13T21:57:54.764829] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-13T21:57:54.765543] [DEBUG] [LOCAL ] TPL: Trimmed 17625 records to 12304 (keeping 200 days of data) [2025-10-13T21:57:54.826670] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-13T21:57:54.855466] [DEBUG] [LOCAL ] TPL: Primary data saved (12304 records). [2025-10-13T21:57:54.855624] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-13T21:57:54.855753] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 24.3s. Estimated remaining: 35m 25s. Rate: 7.1 symbols/min [2025-10-13T21:57:56.517110] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T21:57:56.529139] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-13T21:57:58.516938] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T21:57:58.529326] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-13T21:58:00.547421] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T21:58:00.560745] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-13T21:58:02.494448] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T21:58:02.507297] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-13T21:58:03.084915] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T21:58:03.091276] [INFO ] [REMOTE ] TPR: Full fetch complete (77393 records). [2025-10-13T21:58:03.091492] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-13T21:58:03.505668] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-13T21:58:03.505790] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-13T21:58:03.507265] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-13T21:58:03.507331] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-13T21:58:03.509333] [DEBUG] [LOCAL ] TPR: Trimmed 77393 records to 53446 (keeping 200 days of data) [2025-10-13T21:58:03.879869] [DEBUG] [LOCAL ] TPR: Primary data saved (53446 records). [2025-10-13T21:58:03.880090] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-13T21:58:03.880233] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 27.6s. Estimated remaining: 35m 17s. Rate: 7.1 symbols/min [2025-10-13T21:58:04.444517] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:04.545047] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:04.630409] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:04.625924] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:04.639108] [DEBUG] [LOCAL ] TPYP: Loaded 8020 existing records from primary storage. [2025-10-13T21:58:04.640148] [INFO ] [MAIN ] TPYP: Loaded 8020 existing records. [2025-10-13T21:58:04.701148] [DEBUG] [LOCAL ] TPZ: Loaded 4896 existing records from primary storage. [2025-10-13T21:58:04.746086] [INFO ] [MAIN ] TPZ: Loaded 4896 existing records. [2025-10-13T21:58:04.872000] [DEBUG] [LOCAL ] TR: Loaded 19014 existing records from primary storage. [2025-10-13T21:58:04.914238] [DEBUG] [LOCAL ] TPVG: Loaded 27522 existing records from primary storage. [2025-10-13T21:58:04.934270] [INFO ] [MAIN ] TR: Loaded 19014 existing records. [2025-10-13T21:58:04.970248] [INFO ] [MAIN ] TPVG: Loaded 27522 existing records. [2025-10-13T21:58:04.997844] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:05.060467] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-13T21:58:05.096178] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-13T21:58:05.178025] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-13T21:58:05.289110] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:05.292801] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-13T21:58:05.352853] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-13T21:58:05.419156] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:05.424486] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-13T21:58:05.470254] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-13T21:58:05.519156] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-13T21:58:05.557130] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-13T21:58:05.567682] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-13T21:58:05.567826] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-13T21:58:05.591606] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-13T21:58:05.572962] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:05.710560] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-13T21:58:05.822847] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-13T21:58:05.868233] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-13T21:58:05.940893] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-13T21:58:06.616565] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:06.694051] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-13T21:58:07.015961] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:07.022962] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-13T21:58:07.022423] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:07.041359] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-13T21:58:07.116629] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:07.117062] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-13T21:58:07.557010] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T21:58:07.559592] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-13T21:58:07.843284] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T21:58:07.845832] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-13T21:58:08.106621] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T21:58:08.110335] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-13T21:58:08.322247] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T21:58:08.325996] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-13T21:58:08.378742] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T21:58:08.387862] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-13T21:58:08.406503] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T21:58:08.409810] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-13T21:58:08.775311] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T21:58:08.778335] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-13T21:58:08.835552] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T21:58:08.838144] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-13T21:58:09.252781] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T21:58:09.256345] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-13T21:58:09.552680] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:58:09.555217] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-13T21:58:09.577024] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T21:58:09.592590] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T21:58:09.830866] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T21:58:10.017965] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-13T21:58:10.382163] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T21:58:10.817991] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-13T21:58:10.893626] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T21:58:11.617922] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-13T21:58:11.954433] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T21:58:12.340473] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T21:58:12.417917] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-13T21:58:13.066595] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T21:58:13.217890] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-13T21:58:14.017976] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-13T21:58:14.074734] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T21:58:14.817928] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-13T21:58:15.428814] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T21:58:15.558707] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T21:58:15.617883] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-13T21:58:16.417959] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-13T21:58:16.864689] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T21:58:17.167270] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T21:58:17.217929] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-13T21:58:17.910833] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T21:58:18.017983] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-13T21:58:18.616382] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T21:58:18.817963] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-13T21:58:19.504536] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T21:58:19.617947] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-13T21:58:20.182475] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T21:58:20.417970] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-13T21:58:21.217978] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-13T21:58:21.454100] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T21:58:21.960023] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T21:58:22.017954] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-13T21:58:22.817994] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-13T21:58:23.222086] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T21:58:23.370810] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T21:58:23.617948] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-13T21:58:24.418038] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-13T21:58:24.631227] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T21:58:25.178356] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T21:58:25.217962] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-13T21:58:25.850614] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T21:58:25.851919] [INFO ] [REMOTE ] TPYP: Full fetch complete (12465 records). [2025-10-13T21:58:25.852023] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-13T21:58:26.021692] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-13T21:58:26.207119] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-13T21:58:26.207199] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-13T21:58:26.207517] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-13T21:58:26.207580] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-13T21:58:26.208154] [DEBUG] [LOCAL ] TPYP: Trimmed 12465 records to 7942 (keeping 200 days of data) [2025-10-13T21:58:26.257251] [DEBUG] [LOCAL ] TPYP: Primary data saved (7942 records). [2025-10-13T21:58:26.257393] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-13T21:58:26.257528] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 22.4s. Estimated remaining: 35m 10s. Rate: 7.1 symbols/min [2025-10-13T21:58:26.429262] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:26.444468] [DEBUG] [LOCAL ] TRAK: Loaded 9733 existing records from primary storage. [2025-10-13T21:58:26.444708] [INFO ] [MAIN ] TRAK: Loaded 9733 existing records. [2025-10-13T21:58:26.623102] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:26.623308] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-13T21:58:26.623354] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-13T21:58:26.623636] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-13T21:58:26.623773] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-13T21:58:26.825577] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-13T21:58:26.999510] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:27.364466] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T21:58:27.617971] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-13T21:58:27.823298] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T21:58:28.418003] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-13T21:58:28.472794] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T21:58:29.217953] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-13T21:58:29.318552] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T21:58:29.321978] [INFO ] [REMOTE ] TR: Full fetch complete (25350 records). [2025-10-13T21:58:29.322096] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-13T21:58:29.693166] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-13T21:58:29.693271] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-13T21:58:29.693821] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-13T21:58:29.693881] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-13T21:58:29.694754] [DEBUG] [LOCAL ] TR: Trimmed 25350 records to 18914 (keeping 200 days of data) [2025-10-13T21:58:29.814584] [DEBUG] [LOCAL ] TR: Primary data saved (18914 records). [2025-10-13T21:58:29.814757] [INFO ] [MAIN ] TR: Full history saved. [2025-10-13T21:58:29.814845] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TR took 25.9s. Estimated remaining: 35m 1s. Rate: 7.1 symbols/min [2025-10-13T21:58:29.980679] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:30.000228] [DEBUG] [LOCAL ] TRC: Loaded 15818 existing records from primary storage. [2025-10-13T21:58:30.000477] [INFO ] [MAIN ] TRC: Loaded 15818 existing records. [2025-10-13T21:58:30.030189] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-13T21:58:30.178449] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:30.178702] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-13T21:58:30.178761] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-13T21:58:30.178986] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-13T21:58:30.179040] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-13T21:58:30.526497] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T21:58:30.555468] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:30.651264] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T21:58:30.652342] [INFO ] [REMOTE ] TPZ: Full fetch complete (9084 records). [2025-10-13T21:58:30.652410] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-13T21:58:30.823174] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-13T21:58:31.014257] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-13T21:58:31.014396] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-13T21:58:31.014892] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-13T21:58:31.014962] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-13T21:58:31.016095] [DEBUG] [LOCAL ] TPZ: Trimmed 9084 records to 4764 (keeping 200 days of data) [2025-10-13T21:58:31.048495] [DEBUG] [LOCAL ] TPZ: Primary data saved (4764 records). [2025-10-13T21:58:31.048699] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-13T21:58:31.048833] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TPZ took 27.1s. Estimated remaining: 34m 52s. Rate: 7.1 symbols/min [2025-10-13T21:58:31.231166] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:31.284982] [DEBUG] [LOCAL ] TREX: Loaded 50610 existing records from primary storage. [2025-10-13T21:58:31.285430] [INFO ] [MAIN ] TREX: Loaded 50610 existing records. [2025-10-13T21:58:31.470949] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:31.471290] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-13T21:58:31.471353] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-13T21:58:31.471962] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-13T21:58:31.472022] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-13T21:58:31.623218] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-13T21:58:31.859518] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:32.106841] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T21:58:32.351627] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T21:58:32.418022] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-13T21:58:33.217915] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-13T21:58:33.554699] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T21:58:34.024024] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-13T21:58:34.026084] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T21:58:34.817983] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-13T21:58:35.318789] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T21:58:35.617958] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-13T21:58:35.643821] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T21:58:36.417990] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-13T21:58:36.477513] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T21:58:37.217965] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-13T21:58:38.017928] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-13T21:58:38.091347] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T21:58:38.630345] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T21:58:38.725302] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T21:58:38.817943] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-13T21:58:39.617944] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-13T21:58:39.804789] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T21:58:40.389266] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T21:58:40.417885] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-13T21:58:41.207414] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T21:58:41.217883] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-13T21:58:41.947869] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T21:58:42.017912] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-13T21:58:42.817928] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-13T21:58:43.257967] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T21:58:43.261921] [INFO ] [REMOTE ] TPVG: Full fetch complete (39653 records). [2025-10-13T21:58:43.262018] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-13T21:58:43.541905] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T21:58:43.625487] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-13T21:58:43.659284] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-13T21:58:43.659383] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-13T21:58:43.660323] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-13T21:58:43.660387] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-13T21:58:43.661439] [DEBUG] [LOCAL ] TPVG: Trimmed 39653 records to 27290 (keeping 200 days of data) [2025-10-13T21:58:43.824970] [DEBUG] [LOCAL ] TPVG: Primary data saved (27290 records). [2025-10-13T21:58:43.825127] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-13T21:58:43.825218] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 39.9s. Estimated remaining: 34m 44s. Rate: 7.1 symbols/min [2025-10-13T21:58:43.994929] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:44.055016] [DEBUG] [LOCAL ] TRGP: Loaded 51543 existing records from primary storage. [2025-10-13T21:58:44.055335] [INFO ] [MAIN ] TRGP: Loaded 51543 existing records. [2025-10-13T21:58:44.229083] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:44.229317] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-13T21:58:44.229362] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-13T21:58:44.229875] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-13T21:58:44.229931] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-13T21:58:44.423223] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-13T21:58:44.589622] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:44.602421] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T21:58:45.217992] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-13T21:58:46.017928] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-13T21:58:46.042466] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T21:58:46.818009] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-13T21:58:47.060061] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T21:58:47.077399] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T21:58:47.617969] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-13T21:58:47.789624] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T21:58:48.417916] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-13T21:58:48.498910] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T21:58:49.218006] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-13T21:58:49.992804] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T21:58:50.017917] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-13T21:58:50.135438] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T21:58:50.701074] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T21:58:50.702861] [INFO ] [REMOTE ] TRAK: Full fetch complete (13606 records). [2025-10-13T21:58:50.702940] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-13T21:58:50.823158] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-13T21:58:51.093703] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-13T21:58:51.093825] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-13T21:58:51.094329] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-13T21:58:51.094373] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-13T21:58:51.095015] [DEBUG] [LOCAL ] TRAK: Trimmed 13606 records to 9616 (keeping 200 days of data) [2025-10-13T21:58:51.161401] [DEBUG] [LOCAL ] TRAK: Primary data saved (9616 records). [2025-10-13T21:58:51.161597] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-13T21:58:51.161725] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 24.9s. Estimated remaining: 34m 35s. Rate: 7.1 symbols/min [2025-10-13T21:58:51.335001] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:58:51.383670] [DEBUG] [LOCAL ] TRN: Loaded 37274 existing records from primary storage. [2025-10-13T21:58:51.384084] [INFO ] [MAIN ] TRN: Loaded 37274 existing records. [2025-10-13T21:58:51.572494] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:58:51.572799] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-13T21:58:51.572854] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-13T21:58:51.573188] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-13T21:58:51.573247] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-13T21:58:51.627810] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-13T21:58:51.935624] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:58:52.417957] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-13T21:58:52.576783] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T21:58:52.653478] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T21:58:53.217923] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-13T21:58:54.001806] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T21:58:54.017883] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-13T21:58:54.575535] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T21:58:54.817986] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-13T21:58:55.617941] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-13T21:58:55.749599] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:58:56.163488] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T21:58:56.418021] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-13T21:58:56.592422] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T21:58:57.217978] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-13T21:58:58.017928] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-13T21:58:58.050730] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T21:58:58.776819] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T21:58:58.817890] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-13T21:58:58.956499] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T21:58:59.618006] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-13T21:59:00.349153] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T21:59:00.417951] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-13T21:59:00.584003] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T21:59:01.217940] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-13T21:59:01.992751] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T21:59:02.017982] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-13T21:59:02.523748] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T21:59:02.817960] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-13T21:59:03.617951] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-13T21:59:03.909435] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T21:59:04.263591] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T21:59:04.265541] [INFO ] [REMOTE ] TRC: Full fetch complete (21803 records). [2025-10-13T21:59:04.265700] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-13T21:59:04.420616] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-13T21:59:04.428114] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T21:59:04.722075] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-13T21:59:04.722204] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-13T21:59:04.723333] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-13T21:59:04.723402] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-13T21:59:04.724260] [DEBUG] [LOCAL ] TRC: Trimmed 21803 records to 15628 (keeping 200 days of data) [2025-10-13T21:59:04.826153] [DEBUG] [LOCAL ] TRC: Primary data saved (15628 records). [2025-10-13T21:59:04.826393] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-13T21:59:04.826514] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 35.0s. Estimated remaining: 34m 28s. Rate: 7.1 symbols/min [2025-10-13T21:59:05.000085] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:05.051332] [DEBUG] [LOCAL ] TRNO: Loaded 44485 existing records from primary storage. [2025-10-13T21:59:05.051767] [INFO ] [MAIN ] TRNO: Loaded 44485 existing records. [2025-10-13T21:59:05.219809] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-13T21:59:05.234766] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:05.235202] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-13T21:59:05.235275] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-13T21:59:05.235559] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-13T21:59:05.235639] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-13T21:59:05.594477] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:06.017940] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-13T21:59:06.195303] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T21:59:06.817918] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-13T21:59:07.153211] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T21:59:07.617912] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-13T21:59:07.963730] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T21:59:08.417934] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-13T21:59:08.451969] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T21:59:09.217943] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-13T21:59:09.354545] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T21:59:09.867950] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T21:59:10.017950] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-13T21:59:10.537328] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T21:59:10.817970] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-13T21:59:11.329358] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T21:59:11.617952] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-13T21:59:12.417932] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-13T21:59:12.675320] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T21:59:13.121378] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T21:59:13.217882] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-13T21:59:13.886174] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T21:59:14.017920] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-13T21:59:14.817939] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-13T21:59:14.846491] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:59:15.512413] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T21:59:15.617925] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-13T21:59:16.367331] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T21:59:16.417879] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-13T21:59:17.217941] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-13T21:59:17.395152] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T21:59:17.899919] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T21:59:18.017927] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-13T21:59:18.817936] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-13T21:59:18.884915] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T21:59:19.527860] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T21:59:19.532957] [INFO ] [REMOTE ] TREX: Full fetch complete (71186 records). [2025-10-13T21:59:19.533078] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-13T21:59:19.623739] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-13T21:59:19.931937] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-13T21:59:19.932034] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-13T21:59:19.933275] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-13T21:59:19.933354] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-13T21:59:19.953265] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T21:59:19.960430] [DEBUG] [LOCAL ] TREX: Trimmed 71186 records to 49851 (keeping 200 days of data) [2025-10-13T21:59:20.272085] [DEBUG] [LOCAL ] TREX: Primary data saved (49851 records). [2025-10-13T21:59:20.272275] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-13T21:59:20.272385] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 49.2s. Estimated remaining: 34m 20s. Rate: 7.1 symbols/min [2025-10-13T21:59:20.423257] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-13T21:59:20.451142] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:20.510356] [DEBUG] [LOCAL ] TROX: Loaded 52739 existing records from primary storage. [2025-10-13T21:59:20.510866] [INFO ] [MAIN ] TROX: Loaded 52739 existing records. [2025-10-13T21:59:20.694103] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:20.694397] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-13T21:59:20.694456] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-13T21:59:20.694793] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-13T21:59:20.694851] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-13T21:59:21.085563] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:21.098057] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T21:59:21.104053] [INFO ] [REMOTE ] TRGP: Full fetch complete (73514 records). [2025-10-13T21:59:21.104247] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-13T21:59:21.222730] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-13T21:59:21.524040] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T21:59:21.574203] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-13T21:59:21.574467] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-13T21:59:21.576178] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-13T21:59:21.576288] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-13T21:59:21.578522] [DEBUG] [LOCAL ] TRGP: Trimmed 73514 records to 50843 (keeping 200 days of data) [2025-10-13T21:59:21.909825] [DEBUG] [LOCAL ] TRGP: Primary data saved (50843 records). [2025-10-13T21:59:21.909958] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-13T21:59:21.910037] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 38.1s. Estimated remaining: 34m 11s. Rate: 7.1 symbols/min [2025-10-13T21:59:22.020938] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-13T21:59:22.083199] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:22.140385] [DEBUG] [LOCAL ] TRP: Loaded 52912 existing records from primary storage. [2025-10-13T21:59:22.140838] [INFO ] [MAIN ] TRP: Loaded 52912 existing records. [2025-10-13T21:59:22.340000] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:22.340717] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-13T21:59:22.340855] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-13T21:59:22.341280] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-13T21:59:22.341343] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-13T21:59:22.458294] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T21:59:22.489091] [INFO ] [REMOTE ] TRN: Full fetch complete (52556 records). [2025-10-13T21:59:22.509389] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-13T21:59:22.824877] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-13T21:59:23.075603] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:23.167861] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-13T21:59:23.168009] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-13T21:59:23.169098] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-13T21:59:23.169161] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-13T21:59:23.170273] [DEBUG] [LOCAL ] TRN: Trimmed 52556 records to 36838 (keeping 200 days of data) [2025-10-13T21:59:23.401832] [DEBUG] [LOCAL ] TRN: Primary data saved (36838 records). [2025-10-13T21:59:23.401981] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-13T21:59:23.402068] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 32.2s. Estimated remaining: 34m 1s. Rate: 7.1 symbols/min [2025-10-13T21:59:23.576957] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:23.613761] [DEBUG] [LOCAL ] TRTX: Loaded 37988 existing records from primary storage. [2025-10-13T21:59:23.614069] [INFO ] [MAIN ] TRTX: Loaded 37988 existing records. [2025-10-13T21:59:23.645828] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-13T21:59:23.813432] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:23.813800] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-13T21:59:23.813883] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-13T21:59:23.814195] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-13T21:59:23.814290] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-13T21:59:24.008843] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T21:59:24.233614] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:24.417955] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-13T21:59:24.471388] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T21:59:25.218067] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-13T21:59:25.533569] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T21:59:25.957374] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T21:59:26.017928] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-13T21:59:26.737812] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T21:59:26.817995] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-13T21:59:27.617888] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-13T21:59:27.726305] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T21:59:28.305349] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T21:59:28.418000] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-13T21:59:29.217952] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-13T21:59:29.263420] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T21:59:30.018009] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-13T21:59:30.047759] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T21:59:30.769625] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T21:59:30.817982] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-13T21:59:31.617936] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-13T21:59:31.745538] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T21:59:32.226605] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T21:59:32.417975] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-13T21:59:33.036365] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T21:59:33.217950] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-13T21:59:34.017970] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-13T21:59:34.239307] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T21:59:34.506946] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T21:59:34.817993] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-13T21:59:35.339241] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T21:59:35.345016] [INFO ] [REMOTE ] TRNO: Full fetch complete (63033 records). [2025-10-13T21:59:35.345116] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-13T21:59:35.623102] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-13T21:59:35.736123] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-13T21:59:35.736202] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-13T21:59:35.737188] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-13T21:59:35.737250] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-13T21:59:35.738528] [DEBUG] [LOCAL ] TRNO: Trimmed 63033 records to 43857 (keeping 200 days of data) [2025-10-13T21:59:36.014888] [DEBUG] [LOCAL ] TRNO: Primary data saved (43857 records). [2025-10-13T21:59:36.015058] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-13T21:59:36.015163] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 31.2s. Estimated remaining: 33m 54s. Rate: 7.1 symbols/min [2025-10-13T21:59:36.184323] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:36.234050] [DEBUG] [LOCAL ] TRU: Loaded 52113 existing records from primary storage. [2025-10-13T21:59:36.234369] [INFO ] [MAIN ] TRU: Loaded 52113 existing records. [2025-10-13T21:59:36.411402] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:36.411589] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-13T21:59:36.411635] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-13T21:59:36.411952] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-13T21:59:36.412008] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-13T21:59:36.442728] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-13T21:59:36.801603] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:36.836209] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T21:59:37.217918] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-13T21:59:37.449232] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T21:59:37.770158] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T21:59:38.018011] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-13T21:59:38.817989] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-13T21:59:39.030781] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T21:59:39.617935] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-13T21:59:39.761962] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T21:59:40.417983] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-13T21:59:40.624314] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T21:59:41.217966] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-13T21:59:41.462700] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T21:59:42.017930] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-13T21:59:42.276811] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T21:59:42.451922] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T21:59:42.817961] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-13T21:59:43.518867] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T21:59:43.617886] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-13T21:59:44.417953] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-13T21:59:44.589168] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T21:59:44.876180] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T21:59:45.217930] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-13T21:59:46.017957] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-13T21:59:46.126879] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T21:59:46.823137] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-13T21:59:46.835905] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T21:59:47.319099] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T21:59:47.617952] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-13T21:59:48.423073] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-13T21:59:48.438372] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T21:59:49.217971] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-13T21:59:49.478635] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T21:59:49.546005] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T21:59:50.017945] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-13T21:59:50.817964] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-13T21:59:51.054858] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T21:59:51.617951] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-13T21:59:51.765691] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T21:59:51.803323] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T21:59:52.417960] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-13T21:59:53.217919] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-13T21:59:53.475000] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T21:59:53.934721] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T21:59:53.939956] [INFO ] [REMOTE ] TRP: Full fetch complete (75507 records). [2025-10-13T21:59:53.940096] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-13T21:59:54.023216] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-13T21:59:54.335567] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-13T21:59:54.335707] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-13T21:59:54.336961] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-13T21:59:54.337068] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-13T21:59:54.359070] [DEBUG] [LOCAL ] TRP: Trimmed 75507 records to 52141 (keeping 200 days of data) [2025-10-13T21:59:54.361023] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T21:59:54.696758] [DEBUG] [LOCAL ] TRP: Primary data saved (52141 records). [2025-10-13T21:59:54.696892] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-13T21:59:54.696974] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TRP took 32.8s. Estimated remaining: 33m 46s. Rate: 7.1 symbols/min [2025-10-13T21:59:54.823188] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-13T21:59:54.868135] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:54.914733] [DEBUG] [LOCAL ] TRV: Loaded 48195 existing records from primary storage. [2025-10-13T21:59:54.915091] [INFO ] [MAIN ] TRV: Loaded 48195 existing records. [2025-10-13T21:59:55.085857] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:55.086078] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-13T21:59:55.086125] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-13T21:59:55.086506] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-13T21:59:55.086564] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-13T21:59:55.438415] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:55.617932] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-13T21:59:55.877252] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T21:59:56.395986] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T21:59:56.402507] [INFO ] [REMOTE ] TROX: Full fetch complete (73487 records). [2025-10-13T21:59:56.402769] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-13T21:59:56.426287] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-13T21:59:56.829156] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-13T21:59:56.829300] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-13T21:59:56.830984] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-13T21:59:56.831085] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-13T21:59:56.833105] [DEBUG] [LOCAL ] TROX: Trimmed 73487 records to 52089 (keeping 200 days of data) [2025-10-13T21:59:57.081783] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T21:59:57.207714] [DEBUG] [LOCAL ] TROX: Primary data saved (52089 records). [2025-10-13T21:59:57.208026] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-13T21:59:57.208155] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TROX took 36.9s. Estimated remaining: 33m 37s. Rate: 7.1 symbols/min [2025-10-13T21:59:57.223152] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-13T21:59:57.385379] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T21:59:57.441728] [DEBUG] [LOCAL ] TS: Loaded 52435 existing records from primary storage. [2025-10-13T21:59:57.442138] [INFO ] [MAIN ] TS: Loaded 52435 existing records. [2025-10-13T21:59:57.626490] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T21:59:57.626803] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-13T21:59:57.626857] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-13T21:59:57.627330] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-13T21:59:57.627394] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-13T21:59:58.009243] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T21:59:58.017877] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-13T21:59:58.296191] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T21:59:58.750845] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T21:59:58.817953] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-13T21:59:59.617931] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-13T21:59:59.729400] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T22:00:00.145326] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T22:00:00.149151] [INFO ] [REMOTE ] TRTX: Full fetch complete (53067 records). [2025-10-13T22:00:00.149263] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-13T22:00:00.423093] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-13T22:00:00.563182] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-13T22:00:00.563310] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-13T22:00:00.564732] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-13T22:00:00.564797] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-13T22:00:00.566405] [DEBUG] [LOCAL ] TRTX: Trimmed 53067 records to 37391 (keeping 200 days of data) [2025-10-13T22:00:00.814567] [DEBUG] [LOCAL ] TRTX: Primary data saved (37391 records). [2025-10-13T22:00:00.814850] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-13T22:00:00.815748] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRTX took 37.4s. Estimated remaining: 33m 28s. Rate: 7.1 symbols/min [2025-10-13T22:00:01.014445] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:01.047548] [DEBUG] [LOCAL ] TSE: Loaded 28282 existing records from primary storage. [2025-10-13T22:00:01.047971] [INFO ] [MAIN ] TSE: Loaded 28282 existing records. [2025-10-13T22:00:01.222123] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-13T22:00:01.249106] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:01.249637] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-13T22:00:01.249735] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-13T22:00:01.250110] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-13T22:00:01.250262] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-13T22:00:01.721684] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:01.771637] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T22:00:02.018031] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-13T22:00:02.267301] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T22:00:02.817973] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-13T22:00:03.290993] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T22:00:03.617914] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-13T22:00:03.767331] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T22:00:04.312578] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T22:00:04.417982] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-13T22:00:05.218041] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-13T22:00:05.664130] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T22:00:06.017932] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-13T22:00:06.097064] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T22:00:06.817942] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-13T22:00:07.149595] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T22:00:07.487715] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T22:00:07.617953] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-13T22:00:08.417917] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-13T22:00:08.513463] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T22:00:08.795970] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T22:00:09.217954] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-13T22:00:10.017955] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-13T22:00:10.208556] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T22:00:10.817930] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-13T22:00:11.336132] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T22:00:11.617944] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-13T22:00:11.653385] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T22:00:11.658806] [INFO ] [REMOTE ] TRU: Full fetch complete (73713 records). [2025-10-13T22:00:11.658925] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-13T22:00:12.060040] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-13T22:00:12.060180] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-13T22:00:12.061345] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-13T22:00:12.061616] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-13T22:00:12.063309] [DEBUG] [LOCAL ] TRU: Trimmed 73713 records to 51424 (keeping 200 days of data) [2025-10-13T22:00:12.177331] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T22:00:12.419243] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-13T22:00:12.445467] [DEBUG] [LOCAL ] TRU: Primary data saved (51424 records). [2025-10-13T22:00:12.445691] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-13T22:00:12.445810] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 36.4s. Estimated remaining: 33m 20s. Rate: 7.1 symbols/min [2025-10-13T22:00:12.627213] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:12.627479] [DEBUG] [LOCAL ] TSI: No existing data file found in primary storage. [2025-10-13T22:00:12.627519] [WARN ] [MAIN ] TSI: No existing data found, performing full refresh instead. [2025-10-13T22:00:12.627664] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-13T22:00:12.627724] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-13T22:00:12.627770] [DEBUG] [LOCAL ] TSI: No primary data file found to delete. [2025-10-13T22:00:12.627805] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-13T22:00:13.019230] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:13.217944] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-13T22:00:13.726020] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T22:00:13.741843] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-13T22:00:14.017917] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-13T22:00:14.403476] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T22:00:14.420036] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T22:00:14.817964] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-13T22:00:15.617925] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-13T22:00:15.860187] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T22:00:16.417930] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-13T22:00:16.890263] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T22:00:17.217966] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-13T22:00:17.387761] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T22:00:18.018057] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-13T22:00:18.611033] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T22:00:18.817959] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-13T22:00:19.617987] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-13T22:00:19.807686] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T22:00:20.400137] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T22:00:20.417914] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-13T22:00:20.648101] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T22:00:20.784927] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T22:00:21.217926] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-13T22:00:21.980757] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T22:00:22.017941] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-13T22:00:22.817953] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-13T22:00:22.828308] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T22:00:23.617952] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-13T22:00:24.417968] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-13T22:00:24.545969] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T22:00:24.913970] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T22:00:25.217953] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-13T22:00:25.826408] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T22:00:26.017942] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-13T22:00:26.823198] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-13T22:00:26.855356] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T22:00:27.617946] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-13T22:00:27.655937] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T22:00:27.931884] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T22:00:28.417963] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-13T22:00:29.217955] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-13T22:00:29.482824] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T22:00:30.017964] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-13T22:00:30.027586] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T22:00:30.211878] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T22:00:30.817943] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-13T22:00:31.477580] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:00:31.617923] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-13T22:00:32.406718] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T22:00:32.417887] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-13T22:00:32.680803] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-13T22:00:32.685568] [INFO ] [REMOTE ] TRV: Full fetch complete (69534 records). [2025-10-13T22:00:32.685741] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-13T22:00:33.103060] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-13T22:00:33.103295] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-13T22:00:33.104778] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-13T22:00:33.105615] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T22:00:33.105792] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-13T22:00:33.113800] [DEBUG] [LOCAL ] TRV: Trimmed 69534 records to 47472 (keeping 200 days of data) [2025-10-13T22:00:33.218087] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-13T22:00:33.424674] [DEBUG] [LOCAL ] TRV: Primary data saved (47472 records). [2025-10-13T22:00:33.424817] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-13T22:00:33.424960] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 38.7s. Estimated remaining: 33m 13s. Rate: 7.1 symbols/min [2025-10-13T22:00:33.597491] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:33.633907] [DEBUG] [LOCAL ] TSLX: Loaded 36037 existing records from primary storage. [2025-10-13T22:00:33.634207] [INFO ] [MAIN ] TSLX: Loaded 36037 existing records. [2025-10-13T22:00:33.812439] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:33.812695] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-13T22:00:33.812752] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-13T22:00:33.813103] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-13T22:00:33.813172] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-13T22:00:33.935501] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T22:00:33.970276] [INFO ] [REMOTE ] TSI: Full fetch complete (13716 records). [2025-10-13T22:00:33.979127] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-13T22:00:34.025278] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-13T22:00:34.379694] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:34.560987] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-13T22:00:34.561059] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-13T22:00:34.561346] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-13T22:00:34.561383] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-13T22:00:34.561871] [DEBUG] [LOCAL ] TSI: Trimmed 13716 records to 7889 (keeping 200 days of data) [2025-10-13T22:00:34.610934] [DEBUG] [LOCAL ] TSI: Primary data saved (7889 records). [2025-10-13T22:00:34.611094] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-13T22:00:34.611176] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSI took 22.2s. Estimated remaining: 33m 4s. Rate: 7.1 symbols/min [2025-10-13T22:00:34.782068] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:34.817975] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-13T22:00:34.842358] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-13T22:00:34.842765] [INFO ] [MAIN ] TSM: Loaded 54599 existing records. [2025-10-13T22:00:35.018123] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:35.018367] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-13T22:00:35.018424] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-13T22:00:35.018954] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-13T22:00:35.019011] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-13T22:00:35.395615] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:35.617937] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-13T22:00:35.664480] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T22:00:35.670056] [INFO ] [REMOTE ] TS: Full fetch complete (74527 records). [2025-10-13T22:00:35.670181] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-13T22:00:36.067028] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-13T22:00:36.067166] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-13T22:00:36.068348] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-13T22:00:36.068428] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-13T22:00:36.086989] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T22:00:36.093965] [DEBUG] [LOCAL ] TS: Trimmed 74527 records to 51672 (keeping 200 days of data) [2025-10-13T22:00:36.403287] [DEBUG] [LOCAL ] TS: Primary data saved (51672 records). [2025-10-13T22:00:36.403417] [INFO ] [MAIN ] TS: Full history saved. [2025-10-13T22:00:36.403512] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TS took 39.2s. Estimated remaining: 32m 55s. Rate: 7.1 symbols/min [2025-10-13T22:00:36.424170] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-13T22:00:36.573119] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:36.624852] [DEBUG] [LOCAL ] TSN: Loaded 53734 existing records from primary storage. [2025-10-13T22:00:36.625153] [INFO ] [MAIN ] TSN: Loaded 53734 existing records. [2025-10-13T22:00:36.800848] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:36.801082] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-13T22:00:36.801133] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-13T22:00:36.801606] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-13T22:00:36.801702] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-13T22:00:37.154912] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:37.217911] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-13T22:00:37.558300] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T22:00:38.017969] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-13T22:00:38.675301] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-10-13T22:00:38.818026] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-13T22:00:39.021114] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T22:00:39.313973] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T22:00:39.617980] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-13T22:00:40.418025] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-13T22:00:40.839332] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T22:00:41.217914] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-13T22:00:41.447328] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-13T22:00:42.017924] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-13T22:00:42.229685] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T22:00:42.501753] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T22:00:42.817920] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-13T22:00:43.617962] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-13T22:00:44.417934] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-13T22:00:44.654276] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T22:00:44.692968] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-13T22:00:45.159355] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T22:00:45.217882] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-13T22:00:45.342867] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T22:00:45.345638] [INFO ] [REMOTE ] TSE: Full fetch complete (40663 records). [2025-10-13T22:00:45.345756] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-13T22:00:45.720345] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-13T22:00:45.720419] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-13T22:00:45.721309] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-13T22:00:45.721369] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-13T22:00:45.722592] [DEBUG] [LOCAL ] TSE: Trimmed 40663 records to 27793 (keeping 200 days of data) [2025-10-13T22:00:45.879566] [DEBUG] [LOCAL ] TSE: Primary data saved (27793 records). [2025-10-13T22:00:45.879721] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-13T22:00:45.879810] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSE took 45.1s. Estimated remaining: 32m 46s. Rate: 7.1 symbols/min [2025-10-13T22:00:46.023084] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-13T22:00:46.052554] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:46.066757] [DEBUG] [LOCAL ] TSQ: Loaded 11863 existing records from primary storage. [2025-10-13T22:00:46.066960] [INFO ] [MAIN ] TSQ: Loaded 11863 existing records. [2025-10-13T22:00:46.240419] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:46.240635] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-13T22:00:46.240715] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-13T22:00:46.240973] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-13T22:00:46.241029] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-13T22:00:46.604943] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:00:46.767938] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T22:00:46.817880] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-13T22:00:47.617984] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-13T22:00:48.215586] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:00:48.417986] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-13T22:00:48.640566] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-13T22:00:49.217941] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-13T22:00:49.512979] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T22:00:49.811741] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T22:00:50.017973] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-13T22:00:50.817972] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-13T22:00:51.441926] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T22:00:51.617947] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-13T22:00:52.076196] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-13T22:00:52.135609] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-13T22:00:52.417934] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-13T22:00:52.664613] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T22:00:53.217931] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-13T22:00:53.250224] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T22:00:54.017955] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-13T22:00:54.565626] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T22:00:54.783837] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T22:00:54.817927] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-13T22:00:55.617953] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-13T22:00:56.418005] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-13T22:00:56.959904] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T22:00:57.217940] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-13T22:00:57.301100] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-13T22:00:57.302310] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T22:00:58.017949] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-13T22:00:58.487452] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T22:00:58.491916] [INFO ] [REMOTE ] TSLX: Full fetch complete (49911 records). [2025-10-13T22:00:58.492020] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-13T22:00:58.831155] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-13T22:00:58.886108] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-13T22:00:58.886205] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-13T22:00:58.887134] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-13T22:00:58.887200] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-13T22:00:58.888410] [DEBUG] [LOCAL ] TSLX: Trimmed 49911 records to 35780 (keeping 200 days of data) [2025-10-13T22:00:59.110407] [DEBUG] [LOCAL ] TSLX: Primary data saved (35780 records). [2025-10-13T22:00:59.110551] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-13T22:00:59.110635] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 25.7s. Estimated remaining: 32m 38s. Rate: 7.1 symbols/min [2025-10-13T22:00:59.281011] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:00:59.327492] [DEBUG] [LOCAL ] TT: Loaded 48155 existing records from primary storage. [2025-10-13T22:00:59.327816] [INFO ] [MAIN ] TT: Loaded 48155 existing records. [2025-10-13T22:00:59.513933] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:00:59.514277] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-13T22:00:59.514395] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-13T22:00:59.514835] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-13T22:00:59.514902] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-13T22:00:59.623065] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-13T22:00:59.884996] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:00.417934] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-13T22:01:00.484789] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-13T22:01:00.504927] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T22:01:00.750337] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T22:01:01.217974] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-13T22:01:01.875836] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T22:01:02.017993] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-13T22:01:02.817987] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-13T22:01:03.617942] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-13T22:01:03.745769] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T22:01:03.955778] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T22:01:04.135945] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-13T22:01:04.417999] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-13T22:01:05.217930] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-13T22:01:05.484027] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T22:01:06.017939] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-13T22:01:06.488614] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T22:01:06.817937] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-13T22:01:07.617990] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-13T22:01:07.807768] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T22:01:07.819163] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T22:01:07.913679] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-13T22:01:08.417983] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-13T22:01:09.125888] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T22:01:09.218038] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-13T22:01:09.878816] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T22:01:10.017972] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-13T22:01:10.341520] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-13T22:01:10.347494] [INFO ] [REMOTE ] TSN: Full fetch complete (76406 records). [2025-10-13T22:01:10.347636] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-13T22:01:10.744329] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-13T22:01:10.744591] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-13T22:01:10.745860] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-13T22:01:10.745946] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-13T22:01:10.747595] [DEBUG] [LOCAL ] TSN: Trimmed 76406 records to 53006 (keeping 200 days of data) [2025-10-13T22:01:10.836926] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-13T22:01:11.129177] [DEBUG] [LOCAL ] TSN: Primary data saved (53006 records). [2025-10-13T22:01:11.129595] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-13T22:01:11.129852] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSN took 34.7s. Estimated remaining: 32m 30s. Rate: 7.1 symbols/min [2025-10-13T22:01:11.317205] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:11.317521] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-13T22:01:11.317590] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-13T22:01:11.317943] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-13T22:01:11.318000] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-13T22:01:11.318044] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-13T22:01:11.318077] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-13T22:01:11.461980] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-10-13T22:01:11.625326] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-13T22:01:11.740844] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:12.417970] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-13T22:01:12.555243] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T22:01:12.623872] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:01:12.624277] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-13T22:01:12.624374] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:01:12.624422] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-13T22:01:12.624478] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:01:12.624551] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-13T22:01:12.624615] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-13T22:01:12.624681] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-13T22:01:12.624742] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-13T22:01:12.624793] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 1.5s. Estimated remaining: 32m 21s. Rate: 7.1 symbols/min [2025-10-13T22:01:12.823198] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:12.867333] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T22:01:12.915823] [DEBUG] [LOCAL ] TTC: Loaded 42672 existing records from primary storage. [2025-10-13T22:01:12.916202] [INFO ] [MAIN ] TTC: Loaded 42672 existing records. [2025-10-13T22:01:13.100826] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:13.101071] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-13T22:01:13.101117] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-13T22:01:13.101447] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-13T22:01:13.101503] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-13T22:01:13.223150] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-13T22:01:13.451830] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:14.018037] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-13T22:01:14.117029] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T22:01:14.609513] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T22:01:14.615389] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-13T22:01:14.615504] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-13T22:01:14.823144] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-13T22:01:15.035611] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-13T22:01:15.035747] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-13T22:01:15.037912] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-13T22:01:15.037985] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-13T22:01:15.040075] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-10-13T22:01:15.421905] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-13T22:01:15.422142] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-13T22:01:15.422243] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSM took 40.8s. Estimated remaining: 32m 12s. Rate: 7.1 symbols/min [2025-10-13T22:01:15.612092] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:15.618006] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-13T22:01:15.653754] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T22:01:15.678285] [DEBUG] [LOCAL ] TTE: Loaded 52365 existing records from primary storage. [2025-10-13T22:01:15.678788] [INFO ] [MAIN ] TTE: Loaded 52365 existing records. [2025-10-13T22:01:15.875886] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:15.876201] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-13T22:01:15.876254] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-13T22:01:15.876850] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-13T22:01:15.876943] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-13T22:01:16.234923] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:16.417933] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-13T22:01:17.147713] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T22:01:17.217995] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-13T22:01:17.928350] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T22:01:17.930093] [INFO ] [REMOTE ] TSQ: Full fetch complete (16396 records). [2025-10-13T22:01:17.930187] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-13T22:01:18.019693] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-13T22:01:18.335923] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-13T22:01:18.336179] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-13T22:01:18.336676] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-13T22:01:18.336823] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-13T22:01:18.337516] [DEBUG] [LOCAL ] TSQ: Trimmed 16396 records to 11703 (keeping 200 days of data) [2025-10-13T22:01:18.424560] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T22:01:18.452230] [DEBUG] [LOCAL ] TSQ: Primary data saved (11703 records). [2025-10-13T22:01:18.452390] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-13T22:01:18.452476] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSQ took 32.6s. Estimated remaining: 32m 3s. Rate: 7.1 symbols/min [2025-10-13T22:01:18.621725] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:18.666353] [DEBUG] [LOCAL ] TTI: Loaded 46673 existing records from primary storage. [2025-10-13T22:01:18.666705] [INFO ] [MAIN ] TTI: Loaded 46673 existing records. [2025-10-13T22:01:18.819732] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-13T22:01:18.842306] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:18.843821] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-13T22:01:18.843883] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-13T22:01:18.844313] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-13T22:01:18.844374] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-13T22:01:19.220824] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:19.470165] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T22:01:19.617970] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-13T22:01:20.418056] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-13T22:01:20.743540] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T22:01:21.105060] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T22:01:21.217905] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-13T22:01:21.847743] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T22:01:22.017945] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-13T22:01:22.817926] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-13T22:01:22.863695] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T22:01:23.618021] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-13T22:01:23.715456] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T22:01:24.417947] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-13T22:01:24.467340] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T22:01:25.156406] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:01:25.217981] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-13T22:01:26.018038] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-13T22:01:26.238683] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T22:01:26.817943] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-13T22:01:26.849458] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T22:01:27.352229] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T22:01:27.617942] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-13T22:01:28.417993] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-13T22:01:28.549049] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T22:01:29.219709] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T22:01:29.218436] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-13T22:01:29.829193] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T22:01:30.017948] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-13T22:01:30.817995] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-13T22:01:30.963961] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T22:01:31.617999] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-13T22:01:31.660543] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T22:01:32.370013] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T22:01:32.417880] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-13T22:01:32.992279] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T22:01:33.218002] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-13T22:01:34.025595] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-13T22:01:34.031230] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:01:34.817980] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-13T22:01:34.887548] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:01:35.318448] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T22:01:35.617945] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-13T22:01:36.283030] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T22:01:36.417933] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-13T22:01:36.878881] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T22:01:36.883624] [INFO ] [REMOTE ] TT: Full fetch complete (69771 records). [2025-10-13T22:01:36.883841] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-13T22:01:37.218255] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-13T22:01:37.293956] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-13T22:01:37.294061] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-13T22:01:37.295203] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-13T22:01:37.295285] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-13T22:01:37.296921] [DEBUG] [LOCAL ] TT: Trimmed 69771 records to 47416 (keeping 200 days of data) [2025-10-13T22:01:37.420098] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T22:01:37.640136] [DEBUG] [LOCAL ] TT: Primary data saved (47416 records). [2025-10-13T22:01:37.640283] [INFO ] [MAIN ] TT: Full history saved. [2025-10-13T22:01:37.640371] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TT took 38.5s. Estimated remaining: 31m 56s. Rate: 7.1 symbols/min [2025-10-13T22:01:37.814867] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:37.864821] [DEBUG] [LOCAL ] TU: Loaded 50567 existing records from primary storage. [2025-10-13T22:01:37.865162] [INFO ] [MAIN ] TU: Loaded 50567 existing records. [2025-10-13T22:01:38.023205] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-13T22:01:38.052796] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:38.053193] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-13T22:01:38.053245] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-13T22:01:38.053545] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-13T22:01:38.053604] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-13T22:01:38.422994] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:38.766269] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T22:01:38.817979] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-13T22:01:39.617995] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-13T22:01:39.908096] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T22:01:40.417944] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-13T22:01:40.561556] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T22:01:41.217916] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-13T22:01:41.393966] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T22:01:42.017960] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-13T22:01:42.333494] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T22:01:42.706607] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T22:01:42.817950] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-13T22:01:43.617943] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-13T22:01:43.852188] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T22:01:44.132584] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T22:01:44.417947] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-13T22:01:45.192534] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T22:01:45.217907] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-13T22:01:46.017961] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-13T22:01:46.054146] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T22:01:46.817925] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-13T22:01:47.065077] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T22:01:47.466459] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T22:01:47.471565] [INFO ] [REMOTE ] TTI: Full fetch complete (65711 records). [2025-10-13T22:01:47.471740] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-13T22:01:47.628364] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-13T22:01:47.868449] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-13T22:01:47.868523] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-13T22:01:47.869512] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-13T22:01:47.869573] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-13T22:01:47.870786] [DEBUG] [LOCAL ] TTI: Trimmed 65711 records to 46249 (keeping 200 days of data) [2025-10-13T22:01:48.140586] [DEBUG] [LOCAL ] TTI: Primary data saved (46249 records). [2025-10-13T22:01:48.155015] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T22:01:48.154232] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-13T22:01:48.155178] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTI took 29.7s. Estimated remaining: 31m 48s. Rate: 7.1 symbols/min [2025-10-13T22:01:48.328485] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:48.370056] [DEBUG] [LOCAL ] TUYA: Loaded 46611 existing records from primary storage. [2025-10-13T22:01:48.370362] [INFO ] [MAIN ] TUYA: Loaded 46611 existing records. [2025-10-13T22:01:48.423513] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-13T22:01:48.545012] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:48.545192] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-13T22:01:48.545236] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-13T22:01:48.545523] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-13T22:01:48.545579] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-13T22:01:48.914544] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:49.217926] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-13T22:01:49.421047] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T22:01:50.017907] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-13T22:01:50.086841] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T22:01:50.429539] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T22:01:50.817952] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-13T22:01:51.446007] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T22:01:51.617936] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-13T22:01:52.339111] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:01:52.417883] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-13T22:01:53.042385] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T22:01:53.217910] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-13T22:01:53.710989] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T22:01:53.715370] [INFO ] [REMOTE ] TTC: Full fetch complete (62034 records). [2025-10-13T22:01:53.715459] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-13T22:01:54.023130] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-13T22:01:54.093137] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-13T22:01:54.093209] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-13T22:01:54.094181] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-13T22:01:54.094246] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-13T22:01:54.095430] [DEBUG] [LOCAL ] TTC: Trimmed 62034 records to 42016 (keeping 200 days of data) [2025-10-13T22:01:54.353462] [DEBUG] [LOCAL ] TTC: Primary data saved (42016 records). [2025-10-13T22:01:54.353584] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-13T22:01:54.353687] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTC took 41.7s. Estimated remaining: 31m 39s. Rate: 7.1 symbols/min [2025-10-13T22:01:54.520803] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:54.559565] [DEBUG] [LOCAL ] TV: Loaded 42533 existing records from primary storage. [2025-10-13T22:01:54.559870] [INFO ] [MAIN ] TV: Loaded 42533 existing records. [2025-10-13T22:01:54.737429] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:54.737781] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-13T22:01:54.737840] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-13T22:01:54.738263] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-13T22:01:54.738320] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-13T22:01:54.825902] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-13T22:01:55.054285] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T22:01:55.143445] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:55.417079] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T22:01:55.422499] [INFO ] [REMOTE ] TTE: Full fetch complete (74953 records). [2025-10-13T22:01:55.422621] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-13T22:01:55.624005] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-13T22:01:55.806980] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-13T22:01:55.807055] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-13T22:01:55.808137] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-13T22:01:55.808199] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-13T22:01:55.809620] [DEBUG] [LOCAL ] TTE: Trimmed 74953 records to 51576 (keeping 200 days of data) [2025-10-13T22:01:56.125375] [DEBUG] [LOCAL ] TTE: Primary data saved (51576 records). [2025-10-13T22:01:56.125699] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-13T22:01:56.125930] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTE took 40.7s. Estimated remaining: 31m 30s. Rate: 7.1 symbols/min [2025-10-13T22:01:56.263532] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T22:01:56.325027] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:01:56.330274] [DEBUG] [LOCAL ] TVC: Loaded 3358 existing records from primary storage. [2025-10-13T22:01:56.330416] [INFO ] [MAIN ] TVC: Loaded 3358 existing records. [2025-10-13T22:01:56.425008] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-13T22:01:56.504272] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:01:56.504433] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-13T22:01:56.504478] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-13T22:01:56.504621] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-13T22:01:56.504691] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-13T22:01:56.849456] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:01:57.073428] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T22:01:57.217923] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-13T22:01:57.757870] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T22:01:58.017932] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-13T22:01:58.817919] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-13T22:01:58.864930] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T22:01:59.467987] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T22:01:59.617924] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-13T22:02:00.417952] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-13T22:02:00.795898] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T22:02:00.963729] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T22:02:01.199753] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T22:02:01.217929] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-13T22:02:02.017996] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-13T22:02:02.525532] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T22:02:02.817962] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-13T22:02:02.983206] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T22:02:03.420237] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T22:02:03.617984] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-13T22:02:04.171428] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T22:02:04.417996] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-13T22:02:05.010066] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T22:02:05.217971] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-13T22:02:06.017957] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-13T22:02:06.819517] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T22:02:06.819357] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-13T22:02:06.857343] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T22:02:07.617935] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-13T22:02:08.216334] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T22:02:08.337210] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T22:02:08.343011] [INFO ] [REMOTE ] TU: Full fetch complete (72749 records). [2025-10-13T22:02:08.343196] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-13T22:02:08.423058] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-13T22:02:08.775558] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-13T22:02:08.775671] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-13T22:02:08.776762] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-13T22:02:08.776824] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-13T22:02:08.778197] [DEBUG] [LOCAL ] TU: Trimmed 72749 records to 49821 (keeping 200 days of data) [2025-10-13T22:02:09.077613] [DEBUG] [LOCAL ] TU: Primary data saved (49821 records). [2025-10-13T22:02:09.077775] [INFO ] [MAIN ] TU: Full history saved. [2025-10-13T22:02:09.077862] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 31.4s. Estimated remaining: 31m 22s. Rate: 7.1 symbols/min [2025-10-13T22:02:09.242125] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-13T22:02:09.244728] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:09.250820] [DEBUG] [LOCAL ] TVE: Loaded 2793 existing records from primary storage. [2025-10-13T22:02:09.250986] [INFO ] [MAIN ] TVE: Loaded 2793 existing records. [2025-10-13T22:02:09.428106] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:09.428334] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-13T22:02:09.428760] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-13T22:02:09.429040] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-13T22:02:09.429104] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-13T22:02:09.811858] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T22:02:09.833841] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:10.017994] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-13T22:02:10.636822] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T22:02:10.743117] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-13T22:02:10.817959] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-13T22:02:11.617961] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-13T22:02:12.079439] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T22:02:12.417972] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-13T22:02:13.217941] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-13T22:02:13.305620] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T22:02:13.708904] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T22:02:13.839381] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T22:02:14.017979] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-13T22:02:14.598349] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T22:02:14.818011] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-13T22:02:15.352836] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T22:02:15.617945] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-13T22:02:16.072029] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T22:02:16.417928] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-13T22:02:16.894153] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T22:02:16.895007] [INFO ] [REMOTE ] TVC: Full fetch complete (5327 records). [2025-10-13T22:02:16.895073] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-13T22:02:17.228027] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-13T22:02:17.262683] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-13T22:02:17.262770] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-13T22:02:17.262933] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-13T22:02:17.262974] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-13T22:02:17.263320] [DEBUG] [LOCAL ] TVC: Trimmed 5327 records to 3252 (keeping 200 days of data) [2025-10-13T22:02:17.284611] [DEBUG] [LOCAL ] TVC: Primary data saved (3252 records). [2025-10-13T22:02:17.284717] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-13T22:02:17.284796] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TVC took 21.2s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-13T22:02:17.449396] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:17.483135] [DEBUG] [LOCAL ] TWI: Loaded 34575 existing records from primary storage. [2025-10-13T22:02:17.483412] [INFO ] [MAIN ] TWI: Loaded 34575 existing records. [2025-10-13T22:02:17.654754] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:17.654973] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-13T22:02:17.655020] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-13T22:02:17.655309] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-13T22:02:17.655366] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-13T22:02:18.000253] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:18.017938] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-13T22:02:18.669403] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T22:02:18.817958] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-13T22:02:19.399449] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T22:02:19.617964] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-13T22:02:20.089122] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T22:02:20.418018] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-13T22:02:21.225098] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-13T22:02:21.228157] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T22:02:22.017982] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-13T22:02:22.110103] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T22:02:22.401571] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T22:02:22.818041] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-13T22:02:23.454978] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T22:02:23.455851] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T22:02:23.617954] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-13T22:02:24.417984] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-13T22:02:25.110058] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T22:02:25.203672] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T22:02:25.217915] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-13T22:02:26.017952] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-13T22:02:26.793533] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T22:02:26.817928] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-13T22:02:27.600903] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T22:02:27.617933] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-13T22:02:27.984248] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T22:02:28.122517] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T22:02:28.417928] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-13T22:02:29.217946] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-13T22:02:29.645372] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T22:02:29.818969] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:02:30.017951] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-13T22:02:30.818002] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-13T22:02:31.617935] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-13T22:02:31.666561] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T22:02:31.994137] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T22:02:32.417952] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-13T22:02:33.160173] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T22:02:33.217924] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-13T22:02:33.631971] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T22:02:34.017963] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-13T22:02:34.419900] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T22:02:34.423565] [INFO ] [REMOTE ] TV: Full fetch complete (61411 records). [2025-10-13T22:02:34.423680] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-13T22:02:34.528409] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T22:02:34.812315] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-13T22:02:34.812447] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-13T22:02:34.813583] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-13T22:02:34.813664] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-13T22:02:34.814896] [DEBUG] [LOCAL ] TV: Trimmed 61411 records to 41852 (keeping 200 days of data) [2025-10-13T22:02:34.860828] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-13T22:02:35.052692] [DEBUG] [LOCAL ] TV: Primary data saved (41852 records). [2025-10-13T22:02:35.052830] [INFO ] [MAIN ] TV: Full history saved. [2025-10-13T22:02:35.052947] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 40.7s. Estimated remaining: 31m 6s. Rate: 7.1 symbols/min [2025-10-13T22:02:35.216275] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:35.266315] [DEBUG] [LOCAL ] TWLO: Loaded 53536 existing records from primary storage. [2025-10-13T22:02:35.266626] [INFO ] [MAIN ] TWLO: Loaded 53536 existing records. [2025-10-13T22:02:35.438928] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:35.439116] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-13T22:02:35.439162] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-13T22:02:35.439511] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-13T22:02:35.439576] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-13T22:02:35.624705] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-13T22:02:35.788951] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:36.125441] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T22:02:36.417884] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-13T22:02:36.550239] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T22:02:37.217965] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-13T22:02:37.786803] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T22:02:38.017916] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-13T22:02:38.170712] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T22:02:38.817963] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-13T22:02:39.220285] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T22:02:39.221356] [INFO ] [REMOTE ] TVE: Full fetch complete (4318 records). [2025-10-13T22:02:39.221438] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-13T22:02:39.543702] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T22:02:39.604223] [INFO ] [REMOTE ] TUYA: Full fetch complete (66066 records). [2025-10-13T22:02:39.609710] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-13T22:02:39.609920] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-13T22:02:39.610297] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-13T22:02:39.610548] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-13T22:02:39.610742] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-13T22:02:39.611204] [DEBUG] [LOCAL ] TVE: Trimmed 4318 records to 2700 (keeping 200 days of data) [2025-10-13T22:02:39.623695] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-13T22:02:39.740705] [DEBUG] [LOCAL ] TVE: Primary data saved (2700 records). [2025-10-13T22:02:39.746639] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-13T22:02:39.751962] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVE took 30.7s. Estimated remaining: 30m 57s. Rate: 7.1 symbols/min [2025-10-13T22:02:40.126214] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:40.218934] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-13T22:02:40.218734] [DEBUG] [LOCAL ] TWN: Loaded 3242 existing records from primary storage. [2025-10-13T22:02:40.219082] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-13T22:02:40.219290] [INFO ] [MAIN ] TWN: Loaded 3242 existing records. [2025-10-13T22:02:40.220459] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-13T22:02:40.262386] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-13T22:02:40.326741] [DEBUG] [LOCAL ] TUYA: Trimmed 66066 records to 45957 (keeping 200 days of data) [2025-10-13T22:02:40.444604] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:40.441578] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-13T22:02:40.456285] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-13T22:02:40.456719] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-13T22:02:40.482661] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-13T22:02:40.485032] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-13T22:02:40.964852] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:41.019840] [DEBUG] [LOCAL ] TUYA: Primary data saved (45957 records). [2025-10-13T22:02:41.019966] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-13T22:02:41.020041] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TUYA took 52.9s. Estimated remaining: 30m 48s. Rate: 7.1 symbols/min [2025-10-13T22:02:41.187290] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:41.222995] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-13T22:02:41.246790] [DEBUG] [LOCAL ] TWO: Loaded 49240 existing records from primary storage. [2025-10-13T22:02:41.247095] [INFO ] [MAIN ] TWO: Loaded 49240 existing records. [2025-10-13T22:02:41.433146] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:41.433697] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-13T22:02:41.433785] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-13T22:02:41.434373] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-13T22:02:41.434432] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-13T22:02:41.804428] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:41.859391] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-13T22:02:41.860150] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T22:02:41.883248] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-13T22:02:42.017898] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-13T22:02:42.817985] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-13T22:02:43.467169] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T22:02:43.617917] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-13T22:02:44.418033] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-13T22:02:44.606911] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T22:02:44.817201] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T22:02:44.821630] [INFO ] [REMOTE ] TWI: Full fetch complete (52205 records). [2025-10-13T22:02:44.821782] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-13T22:02:45.220716] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-13T22:02:45.239105] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-13T22:02:45.239215] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-13T22:02:45.241079] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-13T22:02:45.241267] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-13T22:02:45.242734] [DEBUG] [LOCAL ] TWI: Trimmed 52205 records to 33932 (keeping 200 days of data) [2025-10-13T22:02:45.456239] [DEBUG] [LOCAL ] TWI: Primary data saved (33932 records). [2025-10-13T22:02:45.456436] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-13T22:02:45.456563] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWI took 28.2s. Estimated remaining: 30m 39s. Rate: 7.1 symbols/min [2025-10-13T22:02:45.636816] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:45.637152] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-13T22:02:45.637229] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-13T22:02:45.637498] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-13T22:02:45.637603] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-13T22:02:45.637778] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-13T22:02:45.637876] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-13T22:02:45.907602] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T22:02:46.027068] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-13T22:02:46.071527] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:46.667372] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T22:02:46.817920] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-13T22:02:47.172153] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T22:02:47.390740] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T22:02:47.617967] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-13T22:02:48.292587] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T22:02:48.417940] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-13T22:02:49.217939] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-13T22:02:49.793989] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T22:02:50.017913] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-13T22:02:50.113858] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T22:02:50.231768] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:02:50.232066] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-13T22:02:50.232155] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:02:50.232200] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-13T22:02:50.232233] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:02:50.232269] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-13T22:02:50.232322] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-13T22:02:50.232357] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-13T22:02:50.232403] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-13T22:02:50.232448] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 4.8s. Estimated remaining: 30m 30s. Rate: 7.1 symbols/min [2025-10-13T22:02:50.402043] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:50.425330] [DEBUG] [LOCAL ] TX: Loaded 23640 existing records from primary storage. [2025-10-13T22:02:50.425601] [INFO ] [MAIN ] TX: Loaded 23640 existing records. [2025-10-13T22:02:50.598266] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:50.598474] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-13T22:02:50.598525] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-13T22:02:50.598769] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-13T22:02:50.598830] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-13T22:02:50.824033] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-13T22:02:50.949340] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:51.617947] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-13T22:02:52.214512] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T22:02:52.320443] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T22:02:52.417881] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-13T22:02:53.218009] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-13T22:02:53.322709] [DEBUG] [REMOTE ] TWLO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-13T22:02:53.323019] [WARN ] [REMOTE ] TWLO: No data returned for month 2025-05 [2025-10-13T22:02:53.323110] [FATAL] [REMOTE ] TWLO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:02:53.323231] [FATAL] [MAIN ] TWLO: Failed to fetch primary data. [2025-10-13T22:02:53.323310] [WARN ] [MAIN ] TWLO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:02:53.323394] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-13T22:02:53.323472] [DEBUG] [LOCAL ] TWLO: No primary data file found to delete. [2025-10-13T22:02:53.323527] [INFO ] [LOCAL ] TWLO: Starting deletion of derivative data. [2025-10-13T22:02:53.323957] [DEBUG] [LOCAL ] TWLO: Deleted derivative data file. [2025-10-13T22:02:53.324048] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 18.3s. Estimated remaining: 30m 21s. Rate: 7.1 symbols/min [2025-10-13T22:02:53.497952] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:53.540133] [DEBUG] [LOCAL ] TXNM: Loaded 44121 existing records from primary storage. [2025-10-13T22:02:53.540431] [INFO ] [MAIN ] TXNM: Loaded 44121 existing records. [2025-10-13T22:02:53.716613] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:02:53.716859] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-13T22:02:53.716928] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-13T22:02:53.717226] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-13T22:02:53.717286] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-13T22:02:54.023569] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-13T22:02:54.109120] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:02:54.132100] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T22:02:54.508696] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T22:02:54.817976] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-13T22:02:55.617938] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-13T22:02:56.074566] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T22:02:56.417907] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-13T22:02:56.614985] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T22:02:57.217960] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-13T22:02:57.654768] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T22:02:57.670456] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T22:02:58.021498] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-13T22:02:58.599438] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T22:02:58.817965] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-13T22:02:59.376157] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T22:02:59.377310] [INFO ] [REMOTE ] TWN: Full fetch complete (5314 records). [2025-10-13T22:02:59.377399] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-13T22:02:59.623097] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-13T22:02:59.788047] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-13T22:02:59.788128] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-13T22:02:59.788281] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-13T22:02:59.788319] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-13T22:02:59.788691] [DEBUG] [LOCAL ] TWN: Trimmed 5314 records to 3230 (keeping 200 days of data) [2025-10-13T22:02:59.807659] [DEBUG] [LOCAL ] TWN: Primary data saved (3230 records). [2025-10-13T22:02:59.807733] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-13T22:02:59.807802] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWN took 20.1s. Estimated remaining: 30m 13s. Rate: 7.1 symbols/min [2025-10-13T22:02:59.973474] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:02:59.999071] [DEBUG] [LOCAL ] TXO: Loaded 19726 existing records from primary storage. [2025-10-13T22:02:59.999310] [INFO ] [MAIN ] TXO: Loaded 19726 existing records. [2025-10-13T22:03:00.200911] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:03:00.201085] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-13T22:03:00.201131] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-13T22:03:00.201389] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-13T22:03:00.201444] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-13T22:03:00.429462] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-13T22:03:00.553760] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:01.217953] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-13T22:03:01.600212] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T22:03:01.981948] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T22:03:02.017881] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-13T22:03:02.216741] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T22:03:02.817943] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-13T22:03:03.208309] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T22:03:03.433201] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T22:03:03.617939] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-13T22:03:04.419162] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-13T22:03:04.422063] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T22:03:05.217944] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-13T22:03:05.646212] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T22:03:06.017976] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-13T22:03:06.792050] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T22:03:06.817879] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-13T22:03:06.937501] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T22:03:07.617918] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-13T22:03:08.263141] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T22:03:08.417983] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-13T22:03:08.904902] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T22:03:09.218003] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-13T22:03:10.017937] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-13T22:03:10.130714] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T22:03:10.545593] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T22:03:10.817929] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-13T22:03:11.617960] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-13T22:03:11.691518] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T22:03:12.104710] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T22:03:12.417986] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-13T22:03:13.015377] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T22:03:13.217961] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-13T22:03:13.559211] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T22:03:14.018036] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-13T22:03:14.698765] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T22:03:14.700085] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T22:03:14.818021] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-13T22:03:15.618003] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-13T22:03:16.367807] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T22:03:16.417925] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-13T22:03:16.498476] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T22:03:17.217960] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-13T22:03:17.938407] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:03:18.017941] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-13T22:03:18.072158] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T22:03:18.817945] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-13T22:03:19.138147] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T22:03:19.617933] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-13T22:03:19.690994] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T22:03:20.417993] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-13T22:03:20.547870] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T22:03:21.217998] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-13T22:03:21.439227] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T22:03:21.447219] [INFO ] [REMOTE ] TXNM: Full fetch complete (62843 records). [2025-10-13T22:03:21.447482] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-13T22:03:22.004612] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-13T22:03:22.004767] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-13T22:03:22.006579] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-13T22:03:22.006669] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-13T22:03:22.008697] [DEBUG] [LOCAL ] TXNM: Trimmed 62843 records to 43470 (keeping 200 days of data) [2025-10-13T22:03:22.065807] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-13T22:03:22.316123] [DEBUG] [LOCAL ] TXNM: Primary data saved (43470 records). [2025-10-13T22:03:22.316317] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-13T22:03:22.316418] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TXNM took 29.0s. Estimated remaining: 30m 6s. Rate: 7.1 symbols/min [2025-10-13T22:03:22.817943] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-13T22:03:22.945496] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T22:03:23.001883] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T22:03:23.617940] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-13T22:03:23.985226] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T22:03:24.417960] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-13T22:03:24.625351] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T22:03:25.218074] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-13T22:03:26.004112] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T22:03:26.017913] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-13T22:03:26.047541] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T22:03:26.817974] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-13T22:03:27.446790] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T22:03:27.617955] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-13T22:03:27.913010] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T22:03:28.417974] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-13T22:03:29.142282] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T22:03:29.145301] [INFO ] [REMOTE ] TXO: Full fetch complete (26756 records). [2025-10-13T22:03:29.145411] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-13T22:03:29.226226] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-13T22:03:29.535694] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T22:03:29.589198] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-13T22:03:29.589303] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-13T22:03:29.590326] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-13T22:03:29.590392] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-13T22:03:29.591299] [DEBUG] [LOCAL ] TXO: Trimmed 26756 records to 19640 (keeping 200 days of data) [2025-10-13T22:03:29.725682] [DEBUG] [LOCAL ] TXO: Primary data saved (19640 records). [2025-10-13T22:03:29.725892] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-13T22:03:29.725998] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXO took 29.9s. Estimated remaining: 29m 57s. Rate: 7.1 symbols/min [2025-10-13T22:03:30.017985] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-13T22:03:30.213086] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T22:03:30.216229] [INFO ] [REMOTE ] TX: Full fetch complete (35703 records). [2025-10-13T22:03:30.216322] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-13T22:03:30.605821] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-13T22:03:30.605926] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-13T22:03:30.607102] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-13T22:03:30.607167] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-13T22:03:30.608353] [DEBUG] [LOCAL ] TX: Trimmed 35703 records to 23267 (keeping 200 days of data) [2025-10-13T22:03:30.761759] [DEBUG] [LOCAL ] TX: Primary data saved (23267 records). [2025-10-13T22:03:30.761937] [INFO ] [MAIN ] TX: Full history saved. [2025-10-13T22:03:30.762035] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TX took 40.5s. Estimated remaining: 29m 48s. Rate: 7.1 symbols/min [2025-10-13T22:03:31.586749] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T22:03:31.592556] [INFO ] [REMOTE ] TWO: Full fetch complete (69091 records). [2025-10-13T22:03:31.592774] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-13T22:03:32.006369] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-13T22:03:32.006466] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-13T22:03:32.008531] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-13T22:03:32.008613] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-13T22:03:32.010748] [DEBUG] [LOCAL ] TWO: Trimmed 69091 records to 48593 (keeping 200 days of data) [2025-10-13T22:03:32.336947] [DEBUG] [LOCAL ] TWO: Primary data saved (48593 records). [2025-10-13T22:03:32.337152] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-13T22:03:32.337272] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TWO took 51.3s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-13T22:03:33.065873] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:03:33.127852] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:03:33.151917] [DEBUG] [LOCAL ] TY: No existing data file found in primary storage. [2025-10-13T22:03:33.153243] [WARN ] [MAIN ] TY: No existing data found, performing full refresh instead. [2025-10-13T22:03:33.153074] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:03:33.154134] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-13T22:03:33.132097] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:03:33.155298] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-13T22:03:33.155381] [DEBUG] [LOCAL ] TY: No primary data file found to delete. [2025-10-13T22:03:33.155420] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-13T22:03:33.326353] [DEBUG] [LOCAL ] TYL: Loaded 22651 existing records from primary storage. [2025-10-13T22:03:33.352854] [INFO ] [MAIN ] TYL: Loaded 22651 existing records. [2025-10-13T22:03:33.386186] [DEBUG] [LOCAL ] TYG: Loaded 14076 existing records from primary storage. [2025-10-13T22:03:33.489154] [INFO ] [MAIN ] TYG: Loaded 14076 existing records. [2025-10-13T22:03:33.616845] [DEBUG] [LOCAL ] TXT: Loaded 50440 existing records from primary storage. [2025-10-13T22:03:33.663973] [INFO ] [MAIN ] TXT: Loaded 50440 existing records. [2025-10-13T22:03:33.904534] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:03:33.949695] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-13T22:03:33.971679] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-13T22:03:33.997924] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-13T22:03:34.055219] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-13T22:03:34.137374] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:03:34.171791] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:34.201601] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-13T22:03:34.261205] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-13T22:03:34.227087] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-13T22:03:34.339749] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-13T22:03:34.345865] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-13T22:03:34.344434] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:03:34.346164] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-13T22:03:34.346272] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-13T22:03:34.365143] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-13T22:03:34.406771] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-13T22:03:35.199323] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:35.223921] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-13T22:03:35.383932] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:35.390622] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-13T22:03:35.393553] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T22:03:35.418769] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-13T22:03:35.489321] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:35.490225] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-13T22:03:36.236702] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T22:03:36.239558] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-13T22:03:36.374825] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T22:03:36.380428] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-13T22:03:36.602991] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T22:03:36.606301] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-13T22:03:36.800799] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T22:03:37.060848] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T22:03:37.217935] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-13T22:03:37.356774] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T22:03:37.411201] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T22:03:37.698602] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T22:03:38.017928] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-13T22:03:38.817927] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-13T22:03:39.122089] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T22:03:39.618008] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-13T22:03:39.880928] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T22:03:40.157212] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T22:03:40.417954] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-13T22:03:41.218002] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-13T22:03:41.412515] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T22:03:42.017978] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-13T22:03:42.817932] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-13T22:03:42.981925] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:03:43.417982] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T22:03:43.617942] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-13T22:03:43.632428] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T22:03:44.417946] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-13T22:03:45.202733] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T22:03:45.217909] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-13T22:03:45.253967] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T22:03:45.907408] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T22:03:46.017940] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-13T22:03:46.735106] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-13T22:03:46.817965] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-13T22:03:47.617967] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-13T22:03:47.811878] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T22:03:48.417962] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-13T22:03:49.199436] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T22:03:49.204417] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T22:03:49.217926] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-13T22:03:49.960114] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T22:03:50.017995] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-13T22:03:50.817990] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-13T22:03:51.612309] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T22:03:51.622796] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-13T22:03:51.977485] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T22:03:52.150532] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T22:03:52.417961] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-13T22:03:53.217922] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-13T22:03:53.288334] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T22:03:54.017956] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-13T22:03:54.214887] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T22:03:54.817923] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-13T22:03:55.108502] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T22:03:55.617946] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-13T22:03:56.197210] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T22:03:56.350952] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T22:03:56.417949] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-13T22:03:57.217915] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-13T22:03:57.312731] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T22:03:57.854100] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T22:03:57.855680] [INFO ] [REMOTE ] TY: Full fetch complete (11514 records). [2025-10-13T22:03:57.855763] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-13T22:03:58.028883] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-13T22:03:58.224507] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-13T22:03:58.224588] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-13T22:03:58.224891] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-13T22:03:58.224950] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-13T22:03:58.225379] [DEBUG] [LOCAL ] TY: Trimmed 11514 records to 7576 (keeping 200 days of data) [2025-10-13T22:03:58.270408] [DEBUG] [LOCAL ] TY: Primary data saved (7576 records). [2025-10-13T22:03:58.270518] [INFO ] [MAIN ] TY: Full history saved. [2025-10-13T22:03:58.270589] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 25.9s. Estimated remaining: 29m 32s. Rate: 7.1 symbols/min [2025-10-13T22:03:58.435551] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:03:58.489999] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-13T22:03:58.490348] [INFO ] [MAIN ] U: Loaded 54579 existing records. [2025-10-13T22:03:58.665464] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:03:58.665707] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-13T22:03:58.665764] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-13T22:03:58.666004] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-13T22:03:58.666060] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-13T22:03:58.821509] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-13T22:03:59.026338] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:03:59.037579] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T22:03:59.617971] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-13T22:04:00.318179] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T22:04:00.417996] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-13T22:04:01.217931] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-13T22:04:01.814437] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T22:04:02.017984] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-13T22:04:02.221831] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-13T22:04:02.272099] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T22:04:02.393881] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T22:04:02.817946] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-13T22:04:03.089467] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-13T22:04:03.092299] [INFO ] [REMOTE ] TYL: Full fetch complete (31454 records). [2025-10-13T22:04:03.092376] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-13T22:04:03.466567] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-13T22:04:03.466746] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-13T22:04:03.467581] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-13T22:04:03.467667] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-13T22:04:03.468856] [DEBUG] [LOCAL ] TYL: Trimmed 31454 records to 22457 (keeping 200 days of data) [2025-10-13T22:04:03.620540] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-13T22:04:03.626681] [DEBUG] [LOCAL ] TYL: Primary data saved (22457 records). [2025-10-13T22:04:03.626873] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-13T22:04:03.626977] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 31.3s. Estimated remaining: 29m 23s. Rate: 7.1 symbols/min [2025-10-13T22:04:03.807789] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:03.859959] [DEBUG] [LOCAL ] UA: Loaded 51194 existing records from primary storage. [2025-10-13T22:04:03.860868] [INFO ] [MAIN ] UA: Loaded 51194 existing records. [2025-10-13T22:04:04.095389] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:04.095759] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-13T22:04:04.095819] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-13T22:04:04.096259] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-13T22:04:04.096320] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-13T22:04:04.425792] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-13T22:04:04.473250] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:05.217911] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-13T22:04:05.228436] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T22:04:05.230391] [INFO ] [REMOTE ] TYG: Full fetch complete (22365 records). [2025-10-13T22:04:05.230467] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-13T22:04:05.379401] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T22:04:05.649146] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-13T22:04:05.649267] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-13T22:04:05.649974] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-13T22:04:05.650039] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-13T22:04:05.651140] [DEBUG] [LOCAL ] TYG: Trimmed 22365 records to 13870 (keeping 200 days of data) [2025-10-13T22:04:05.750298] [DEBUG] [LOCAL ] TYG: Primary data saved (13870 records). [2025-10-13T22:04:05.750521] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-13T22:04:05.750633] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYG took 33.4s. Estimated remaining: 29m 14s. Rate: 7.1 symbols/min [2025-10-13T22:04:05.927386] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:05.988514] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-10-13T22:04:05.989049] [INFO ] [MAIN ] UAA: Loaded 54287 existing records. [2025-10-13T22:04:06.023201] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-13T22:04:06.175050] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:06.175331] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-13T22:04:06.175442] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-13T22:04:06.175871] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-13T22:04:06.175929] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-13T22:04:06.544619] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:06.818346] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-13T22:04:06.825390] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T22:04:07.617952] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-13T22:04:08.054154] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T22:04:08.136907] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T22:04:08.369997] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T22:04:08.417938] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-13T22:04:09.218006] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-13T22:04:10.017983] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-13T22:04:10.216950] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T22:04:10.818013] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-13T22:04:11.258430] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-13T22:04:11.585553] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T22:04:11.617908] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-13T22:04:12.420962] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-13T22:04:12.463083] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T22:04:13.032454] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T22:04:13.038139] [INFO ] [REMOTE ] TXT: Full fetch complete (72236 records). [2025-10-13T22:04:13.038273] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-13T22:04:13.220362] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-13T22:04:13.399198] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T22:04:13.483420] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-13T22:04:13.483503] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-13T22:04:13.484668] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-13T22:04:13.484751] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-13T22:04:13.486553] [DEBUG] [LOCAL ] TXT: Trimmed 72236 records to 49685 (keeping 200 days of data) [2025-10-13T22:04:13.811990] [DEBUG] [LOCAL ] TXT: Primary data saved (49685 records). [2025-10-13T22:04:13.812148] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-13T22:04:13.812235] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 41.5s. Estimated remaining: 29m 6s. Rate: 7.1 symbols/min [2025-10-13T22:04:14.022797] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-13T22:04:14.024576] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:14.034858] [DEBUG] [LOCAL ] UAN: Loaded 5484 existing records from primary storage. [2025-10-13T22:04:14.035095] [INFO ] [MAIN ] UAN: Loaded 5484 existing records. [2025-10-13T22:04:14.289577] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:14.289999] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-13T22:04:14.290088] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-13T22:04:14.290418] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-13T22:04:14.290503] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-13T22:04:14.823366] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-13T22:04:14.856926] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:15.201006] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T22:04:15.617952] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-13T22:04:16.028883] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T22:04:16.417930] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-13T22:04:16.471577] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:04:17.217917] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-13T22:04:17.267271] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T22:04:18.017955] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-13T22:04:18.574355] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T22:04:18.698314] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T22:04:18.817928] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-13T22:04:18.886610] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:04:19.562314] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T22:04:19.617969] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-13T22:04:20.237588] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T22:04:20.417932] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-13T22:04:21.094146] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T22:04:21.217927] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-13T22:04:22.017962] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-13T22:04:22.604380] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T22:04:22.818018] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-13T22:04:23.321294] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T22:04:23.617932] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-13T22:04:24.405437] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T22:04:24.417928] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-13T22:04:25.217987] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-13T22:04:25.957094] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-13T22:04:26.017919] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-13T22:04:26.263334] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T22:04:26.734435] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T22:04:26.817934] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-13T22:04:27.376112] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T22:04:27.617945] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-13T22:04:28.177056] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T22:04:28.417949] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-13T22:04:29.026714] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T22:04:29.217931] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-13T22:04:29.433322] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T22:04:30.017961] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-13T22:04:30.817958] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-13T22:04:31.578113] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T22:04:31.594748] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T22:04:31.598480] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-13T22:04:31.617881] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-13T22:04:32.115821] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T22:04:32.417945] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-13T22:04:33.217940] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-13T22:04:33.687735] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T22:04:34.017984] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-13T22:04:34.815999] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-13T22:04:34.820113] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-13T22:04:35.316209] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T22:04:35.317426] [INFO ] [REMOTE ] UAN: Full fetch complete (8021 records). [2025-10-13T22:04:35.317497] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-13T22:04:35.623323] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-13T22:04:35.694221] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-13T22:04:35.694352] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-13T22:04:35.694726] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-13T22:04:35.694793] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-13T22:04:35.695613] [DEBUG] [LOCAL ] UAN: Trimmed 8021 records to 5433 (keeping 200 days of data) [2025-10-13T22:04:35.734912] [DEBUG] [LOCAL ] UAN: Primary data saved (5433 records). [2025-10-13T22:04:35.735106] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-13T22:04:35.735270] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 21.9s. Estimated remaining: 28m 59s. Rate: 7.1 symbols/min [2025-10-13T22:04:35.910752] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:35.971120] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-13T22:04:35.971732] [INFO ] [MAIN ] UBER: Loaded 54586 existing records. [2025-10-13T22:04:36.158639] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:36.159111] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-13T22:04:36.159164] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-13T22:04:36.175954] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-13T22:04:36.193417] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-13T22:04:36.231679] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-13T22:04:36.425871] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-13T22:04:36.578510] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:36.997362] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T22:04:37.217934] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-13T22:04:38.017968] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-13T22:04:38.775638] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T22:04:38.781174] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-13T22:04:38.781289] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-13T22:04:38.828705] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-13T22:04:39.209168] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-13T22:04:39.209301] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-13T22:04:39.210689] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-13T22:04:39.210864] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-13T22:04:39.248589] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T22:04:39.245911] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-10-13T22:04:39.532199] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T22:04:39.621330] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-13T22:04:39.668850] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-13T22:04:39.669049] [INFO ] [MAIN ] U: Full history saved. [2025-10-13T22:04:39.669171] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. U took 41.4s. Estimated remaining: 28m 50s. Rate: 7.1 symbols/min [2025-10-13T22:04:39.844495] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:39.905286] [DEBUG] [LOCAL ] UBS: Loaded 53101 existing records from primary storage. [2025-10-13T22:04:39.905722] [INFO ] [MAIN ] UBS: Loaded 53101 existing records. [2025-10-13T22:04:40.084000] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:40.084308] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-13T22:04:40.084360] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-13T22:04:40.085017] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-13T22:04:40.085081] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-13T22:04:40.424529] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-13T22:04:40.446937] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:41.217950] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-13T22:04:41.260371] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-13T22:04:41.400704] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T22:04:41.406490] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-13T22:04:41.406614] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-13T22:04:41.798511] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-13T22:04:41.798622] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-13T22:04:41.800901] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-13T22:04:41.801044] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-13T22:04:41.803943] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53507 (keeping 200 days of data) [2025-10-13T22:04:42.018707] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-13T22:04:42.154440] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:04:42.190613] [DEBUG] [LOCAL ] UAA: Primary data saved (53507 records). [2025-10-13T22:04:42.190802] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-13T22:04:42.190909] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAA took 36.4s. Estimated remaining: 28m 41s. Rate: 7.1 symbols/min [2025-10-13T22:04:42.357241] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:42.395436] [DEBUG] [LOCAL ] UCB: Loaded 38322 existing records from primary storage. [2025-10-13T22:04:42.395768] [INFO ] [MAIN ] UCB: Loaded 38322 existing records. [2025-10-13T22:04:42.571377] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:42.571594] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-13T22:04:42.571662] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-13T22:04:42.572001] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-13T22:04:42.572057] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-13T22:04:42.818134] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-13T22:04:42.938724] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:43.031621] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T22:04:43.617997] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-13T22:04:44.417956] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-13T22:04:44.452367] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T22:04:44.458953] [INFO ] [REMOTE ] UA: Full fetch complete (72974 records). [2025-10-13T22:04:44.459229] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-13T22:04:44.787880] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-13T22:04:44.916665] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-13T22:04:44.916866] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-13T22:04:44.918162] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-13T22:04:44.918255] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-13T22:04:44.920135] [DEBUG] [LOCAL ] UA: Trimmed 72974 records to 50465 (keeping 200 days of data) [2025-10-13T22:04:45.059251] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T22:04:45.219453] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-13T22:04:45.257198] [DEBUG] [LOCAL ] UA: Primary data saved (50465 records). [2025-10-13T22:04:45.257357] [INFO ] [MAIN ] UA: Full history saved. [2025-10-13T22:04:45.257456] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UA took 41.6s. Estimated remaining: 28m 32s. Rate: 7.1 symbols/min [2025-10-13T22:04:45.428494] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:04:45.481931] [DEBUG] [LOCAL ] UDR: Loaded 52669 existing records from primary storage. [2025-10-13T22:04:45.482274] [INFO ] [MAIN ] UDR: Loaded 52669 existing records. [2025-10-13T22:04:45.666464] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:04:45.666942] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-13T22:04:45.667096] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-13T22:04:45.667714] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-13T22:04:45.667810] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-13T22:04:45.846744] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T22:04:46.025374] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-13T22:04:46.058940] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:04:46.650776] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T22:04:46.817977] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-13T22:04:47.617951] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-13T22:04:48.376500] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-13T22:04:48.417929] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-13T22:04:48.524799] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T22:04:49.217928] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-13T22:04:49.256061] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T22:04:50.017947] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-13T22:04:50.612696] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T22:04:50.669324] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-13T22:04:50.818008] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-13T22:04:51.617981] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-13T22:04:51.697114] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T22:04:52.417968] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-13T22:04:52.810490] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T22:04:52.893588] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-13T22:04:53.217950] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-13T22:04:53.598777] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T22:04:54.017942] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-13T22:04:54.817953] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-13T22:04:55.617924] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-13T22:04:55.673205] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T22:04:55.777367] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T22:04:55.823797] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-13T22:04:56.417920] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-13T22:04:57.217942] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-13T22:04:57.287975] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T22:04:57.951154] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T22:04:58.017915] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-13T22:04:58.817912] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-13T22:04:58.919536] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T22:04:59.344555] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T22:04:59.618017] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-13T22:05:00.417943] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-13T22:05:01.006982] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-13T22:05:01.217941] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-13T22:05:01.250364] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T22:05:01.952488] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T22:05:02.018000] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-13T22:05:02.817960] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-13T22:05:03.617942] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-13T22:05:03.754127] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T22:05:03.951935] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-13T22:05:04.427168] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-13T22:05:04.449175] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T22:05:04.837038] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T22:05:05.217932] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-13T22:05:06.018011] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-13T22:05:06.271570] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T22:05:06.817951] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-13T22:05:07.617984] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-13T22:05:07.732876] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T22:05:07.758435] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-13T22:05:08.330619] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T22:05:08.418054] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-13T22:05:09.217917] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-13T22:05:09.419333] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T22:05:10.018013] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-13T22:05:10.448070] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T22:05:10.595661] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T22:05:10.817968] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-13T22:05:11.401748] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T22:05:11.407255] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-13T22:05:11.407381] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-13T22:05:11.623116] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-13T22:05:11.807388] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-13T22:05:11.807685] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-13T22:05:11.808899] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-13T22:05:11.808989] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-13T22:05:11.810706] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-10-13T22:05:11.938948] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T22:05:12.174707] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-13T22:05:12.174872] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-13T22:05:12.174961] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 36.4s. Estimated remaining: 28m 25s. Rate: 7.1 symbols/min [2025-10-13T22:05:12.344068] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:12.395148] [DEBUG] [LOCAL ] UE: Loaded 43173 existing records from primary storage. [2025-10-13T22:05:12.395484] [INFO ] [MAIN ] UE: Loaded 43173 existing records. [2025-10-13T22:05:12.425948] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-13T22:05:12.584008] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:12.584751] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-13T22:05:12.584858] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-13T22:05:12.585305] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-13T22:05:12.585407] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-13T22:05:12.937433] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:13.049171] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T22:05:13.080735] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:05:13.217929] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-13T22:05:14.018000] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-13T22:05:14.144809] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T22:05:14.148974] [INFO ] [REMOTE ] UCB: Full fetch complete (54694 records). [2025-10-13T22:05:14.149072] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-13T22:05:14.527825] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-13T22:05:14.527928] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-13T22:05:14.528912] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-13T22:05:14.528974] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-13T22:05:14.530146] [DEBUG] [LOCAL ] UCB: Trimmed 54694 records to 37769 (keeping 200 days of data) [2025-10-13T22:05:14.769403] [DEBUG] [LOCAL ] UCB: Primary data saved (37769 records). [2025-10-13T22:05:14.769523] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-13T22:05:14.769628] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 32.6s. Estimated remaining: 28m 16s. Rate: 7.1 symbols/min [2025-10-13T22:05:14.828968] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-13T22:05:14.942589] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:14.942753] [DEBUG] [LOCAL ] UFI: No existing data file found in primary storage. [2025-10-13T22:05:14.942795] [WARN ] [MAIN ] UFI: No existing data found, performing full refresh instead. [2025-10-13T22:05:14.942903] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-13T22:05:14.942943] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-13T22:05:14.942983] [DEBUG] [LOCAL ] UFI: No primary data file found to delete. [2025-10-13T22:05:14.943014] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-13T22:05:15.332389] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:15.356609] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T22:05:15.458479] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T22:05:15.463908] [INFO ] [REMOTE ] UDR: Full fetch complete (74758 records). [2025-10-13T22:05:15.464020] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-13T22:05:15.620206] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-13T22:05:15.852034] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-13T22:05:15.852120] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-13T22:05:15.853186] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-13T22:05:15.853246] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-13T22:05:15.854698] [DEBUG] [LOCAL ] UDR: Trimmed 74758 records to 52006 (keeping 200 days of data) [2025-10-13T22:05:16.179318] [DEBUG] [LOCAL ] UDR: Primary data saved (52006 records). [2025-10-13T22:05:16.179456] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-13T22:05:16.179546] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 30.9s. Estimated remaining: 28m 7s. Rate: 7.1 symbols/min [2025-10-13T22:05:16.347684] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:16.404865] [DEBUG] [LOCAL ] UGI: Loaded 51300 existing records from primary storage. [2025-10-13T22:05:16.405803] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T22:05:16.408668] [INFO ] [MAIN ] UGI: Loaded 51300 existing records. [2025-10-13T22:05:16.428145] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-13T22:05:16.582602] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:16.582825] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-13T22:05:16.582871] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-13T22:05:16.583289] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-13T22:05:16.583343] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-13T22:05:16.934034] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:17.217990] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-13T22:05:18.020171] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-13T22:05:18.024677] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T22:05:18.699148] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T22:05:18.817921] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-13T22:05:19.453983] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T22:05:19.617902] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-13T22:05:20.418029] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-13T22:05:20.577103] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:05:20.906324] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T22:05:20.912517] [INFO ] [REMOTE ] UBS: Full fetch complete (75734 records). [2025-10-13T22:05:20.912622] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-13T22:05:21.223128] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-13T22:05:21.307403] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-13T22:05:21.307546] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-13T22:05:21.308853] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-13T22:05:21.308934] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-13T22:05:21.310519] [DEBUG] [LOCAL ] UBS: Trimmed 75734 records to 52320 (keeping 200 days of data) [2025-10-13T22:05:21.634360] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T22:05:21.659594] [DEBUG] [LOCAL ] UBS: Primary data saved (52320 records). [2025-10-13T22:05:21.659770] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-13T22:05:21.659860] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBS took 42.0s. Estimated remaining: 27m 58s. Rate: 7.1 symbols/min [2025-10-13T22:05:21.838786] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:21.879470] [DEBUG] [LOCAL ] UGP: Loaded 43561 existing records from primary storage. [2025-10-13T22:05:21.879816] [INFO ] [MAIN ] UGP: Loaded 43561 existing records. [2025-10-13T22:05:21.958020] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T22:05:22.023026] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-13T22:05:22.077566] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:22.077800] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-13T22:05:22.077916] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-13T22:05:22.078203] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-13T22:05:22.078287] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-13T22:05:22.435270] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:22.817943] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-13T22:05:23.500480] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T22:05:23.617952] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-13T22:05:24.417963] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-13T22:05:24.462940] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T22:05:25.216988] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T22:05:25.225874] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-13T22:05:25.241155] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T22:05:26.017952] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-13T22:05:26.725625] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T22:05:26.817960] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-13T22:05:27.284933] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T22:05:27.293161] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T22:05:27.617983] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-13T22:05:28.417974] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-13T22:05:28.463352] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T22:05:29.217936] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-13T22:05:29.840567] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T22:05:30.017957] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-13T22:05:30.179730] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T22:05:30.817948] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-13T22:05:31.326615] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T22:05:31.617953] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-13T22:05:31.807209] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T22:05:32.033184] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T22:05:32.417946] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-13T22:05:32.954174] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T22:05:33.217938] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-13T22:05:34.018012] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-13T22:05:34.823043] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-13T22:05:34.849561] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T22:05:35.309137] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T22:05:35.617919] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-13T22:05:36.417990] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-13T22:05:36.550476] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T22:05:36.845564] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T22:05:37.217933] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-13T22:05:37.709839] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T22:05:38.018027] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-13T22:05:38.718465] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T22:05:38.817938] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-13T22:05:39.617981] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-13T22:05:39.737632] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T22:05:40.096811] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T22:05:40.417958] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-13T22:05:41.003944] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T22:05:41.217923] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-13T22:05:41.325052] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T22:05:42.017932] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-13T22:05:42.789387] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T22:05:42.817908] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-13T22:05:42.845889] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T22:05:43.617950] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-13T22:05:43.850814] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T22:05:43.854895] [INFO ] [REMOTE ] UE: Full fetch complete (61045 records). [2025-10-13T22:05:43.854984] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-13T22:05:44.238547] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-13T22:05:44.238629] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-13T22:05:44.239714] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-13T22:05:44.239779] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-13T22:05:44.241065] [DEBUG] [LOCAL ] UE: Trimmed 61045 records to 42613 (keeping 200 days of data) [2025-10-13T22:05:44.427022] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-13T22:05:44.506752] [DEBUG] [LOCAL ] UE: Primary data saved (42613 records). [2025-10-13T22:05:44.506887] [INFO ] [MAIN ] UE: Full history saved. [2025-10-13T22:05:44.506970] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UE took 32.3s. Estimated remaining: 27m 51s. Rate: 7.1 symbols/min [2025-10-13T22:05:44.679582] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:44.698535] [DEBUG] [LOCAL ] UHAL: Loaded 17006 existing records from primary storage. [2025-10-13T22:05:44.698780] [INFO ] [MAIN ] UHAL: Loaded 17006 existing records. [2025-10-13T22:05:44.877092] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:44.877400] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-13T22:05:44.877544] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-13T22:05:44.877801] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-13T22:05:44.877858] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-13T22:05:44.990209] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T22:05:45.026788] [INFO ] [REMOTE ] UFI: Full fetch complete (12370 records). [2025-10-13T22:05:45.050556] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-13T22:05:45.230149] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-13T22:05:45.259369] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T22:05:45.502723] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:45.703403] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-13T22:05:45.703480] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-13T22:05:45.703793] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-13T22:05:45.703854] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-13T22:05:45.704285] [DEBUG] [LOCAL ] UFI: Trimmed 12370 records to 8136 (keeping 200 days of data) [2025-10-13T22:05:45.749053] [DEBUG] [LOCAL ] UFI: Primary data saved (8136 records). [2025-10-13T22:05:45.749172] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-13T22:05:45.749246] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UFI took 31.0s. Estimated remaining: 27m 42s. Rate: 7.1 symbols/min [2025-10-13T22:05:45.914952] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:45.955983] [DEBUG] [LOCAL ] UHS: Loaded 41138 existing records from primary storage. [2025-10-13T22:05:45.956272] [INFO ] [MAIN ] UHS: Loaded 41138 existing records. [2025-10-13T22:05:46.023274] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-13T22:05:46.134677] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:46.134880] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-13T22:05:46.134926] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-13T22:05:46.135249] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-13T22:05:46.135306] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-13T22:05:46.479820] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:46.817937] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-13T22:05:47.049910] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T22:05:47.052747] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T22:05:47.618021] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-13T22:05:47.949680] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T22:05:48.417937] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-13T22:05:48.844385] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T22:05:49.217934] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-13T22:05:49.975158] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T22:05:50.017909] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-13T22:05:50.105223] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T22:05:50.817994] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-13T22:05:51.617928] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-13T22:05:51.767924] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T22:05:52.059673] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T22:05:52.417972] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-13T22:05:52.988017] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T22:05:53.217979] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-13T22:05:53.912496] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T22:05:53.917779] [INFO ] [REMOTE ] UGI: Full fetch complete (73262 records). [2025-10-13T22:05:53.917974] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-13T22:05:54.022601] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-13T22:05:54.053040] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T22:05:54.325445] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-13T22:05:54.325528] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-13T22:05:54.326607] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-13T22:05:54.326691] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-13T22:05:54.328200] [DEBUG] [LOCAL ] UGI: Trimmed 73262 records to 50599 (keeping 200 days of data) [2025-10-13T22:05:54.641411] [DEBUG] [LOCAL ] UGI: Primary data saved (50599 records). [2025-10-13T22:05:54.641543] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-13T22:05:54.641620] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 38.5s. Estimated remaining: 27m 34s. Rate: 7.1 symbols/min [2025-10-13T22:05:54.804717] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:05:54.816535] [DEBUG] [LOCAL ] UHT: Loaded 10186 existing records from primary storage. [2025-10-13T22:05:54.816786] [INFO ] [MAIN ] UHT: Loaded 10186 existing records. [2025-10-13T22:05:54.823280] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-13T22:05:54.994994] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:05:54.995195] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-13T22:05:54.995241] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-13T22:05:54.995420] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-13T22:05:54.995457] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-13T22:05:55.340997] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:05:55.532699] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T22:05:55.617940] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-13T22:05:55.663020] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T22:05:56.417974] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-13T22:05:56.820389] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T22:05:57.217953] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-13T22:05:57.842147] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T22:05:57.993131] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T22:05:58.017918] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-13T22:05:58.818020] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-13T22:05:59.381247] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T22:05:59.415367] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T22:05:59.617970] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-13T22:06:00.418013] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-13T22:06:00.824287] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T22:06:00.829320] [INFO ] [REMOTE ] UGP: Full fetch complete (62182 records). [2025-10-13T22:06:00.829485] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-13T22:06:01.215589] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-13T22:06:01.215726] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-13T22:06:01.216879] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-13T22:06:01.216963] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-13T22:06:01.217935] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-13T22:06:01.219144] [DEBUG] [LOCAL ] UGP: Trimmed 62182 records to 42912 (keeping 200 days of data) [2025-10-13T22:06:01.481380] [DEBUG] [LOCAL ] UGP: Primary data saved (42912 records). [2025-10-13T22:06:01.481536] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-13T22:06:01.481625] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 39.8s. Estimated remaining: 27m 25s. Rate: 7.1 symbols/min [2025-10-13T22:06:01.666978] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:01.667837] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T22:06:01.687824] [DEBUG] [LOCAL ] UI: Loaded 13680 existing records from primary storage. [2025-10-13T22:06:01.688095] [INFO ] [MAIN ] UI: Loaded 13680 existing records. [2025-10-13T22:06:01.866945] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:01.867162] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-13T22:06:01.867209] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-13T22:06:01.867460] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-13T22:06:01.867518] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-13T22:06:02.026459] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-13T22:06:02.111627] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T22:06:02.238189] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:02.817915] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-13T22:06:03.088506] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T22:06:03.617971] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-13T22:06:03.651107] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T22:06:04.418036] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-13T22:06:05.217952] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-13T22:06:05.231054] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T22:06:05.314040] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T22:06:05.946755] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T22:06:06.017982] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-13T22:06:06.663878] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T22:06:06.817983] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-13T22:06:07.617917] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-13T22:06:07.936471] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T22:06:08.417934] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-13T22:06:08.981348] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T22:06:09.098618] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T22:06:09.217916] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-13T22:06:10.017938] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-13T22:06:10.142583] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T22:06:10.144825] [INFO ] [REMOTE ] UHAL: Full fetch complete (23178 records). [2025-10-13T22:06:10.144896] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-13T22:06:10.503834] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-13T22:06:10.503910] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-13T22:06:10.504415] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-13T22:06:10.504453] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-13T22:06:10.505078] [DEBUG] [LOCAL ] UHAL: Trimmed 23178 records to 16852 (keeping 200 days of data) [2025-10-13T22:06:10.602710] [DEBUG] [LOCAL ] UHAL: Primary data saved (16852 records). [2025-10-13T22:06:10.602853] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-13T22:06:10.602930] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 26.1s. Estimated remaining: 27m 17s. Rate: 7.1 symbols/min [2025-10-13T22:06:10.771479] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:10.806717] [DEBUG] [LOCAL ] UIS: Loaded 37519 existing records from primary storage. [2025-10-13T22:06:10.807000] [INFO ] [MAIN ] UIS: Loaded 37519 existing records. [2025-10-13T22:06:10.827281] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-13T22:06:10.984053] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:10.984287] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-13T22:06:10.984333] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-13T22:06:10.984616] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-13T22:06:10.984702] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-13T22:06:11.343606] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:11.389468] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T22:06:11.617980] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-13T22:06:11.734842] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T22:06:12.417949] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-13T22:06:12.809374] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T22:06:13.125232] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T22:06:13.217989] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-13T22:06:14.017938] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-13T22:06:14.148563] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T22:06:14.817939] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-13T22:06:15.352609] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T22:06:15.617915] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-13T22:06:15.781075] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T22:06:16.417919] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-13T22:06:16.460417] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T22:06:17.217984] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-13T22:06:17.813954] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T22:06:17.835325] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T22:06:18.017953] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-13T22:06:18.817913] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-13T22:06:18.826271] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T22:06:19.617947] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-13T22:06:19.738432] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T22:06:20.083392] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T22:06:20.085215] [INFO ] [REMOTE ] UHT: Full fetch complete (15001 records). [2025-10-13T22:06:20.085305] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-13T22:06:20.425359] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-13T22:06:20.449680] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-13T22:06:20.449763] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-13T22:06:20.450075] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-13T22:06:20.450114] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-13T22:06:20.450605] [DEBUG] [LOCAL ] UHT: Trimmed 15001 records to 10071 (keeping 200 days of data) [2025-10-13T22:06:20.512349] [DEBUG] [LOCAL ] UHT: Primary data saved (10071 records). [2025-10-13T22:06:20.512456] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-13T22:06:20.512532] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHT took 25.9s. Estimated remaining: 27m 8s. Rate: 7.1 symbols/min [2025-10-13T22:06:20.675213] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:20.723763] [DEBUG] [LOCAL ] UL: Loaded 53848 existing records from primary storage. [2025-10-13T22:06:20.724085] [INFO ] [MAIN ] UL: Loaded 53848 existing records. [2025-10-13T22:06:20.899698] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:20.899901] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-13T22:06:20.899953] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-13T22:06:20.900187] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-13T22:06:20.900226] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-13T22:06:21.219251] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-13T22:06:21.244540] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:22.017961] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-13T22:06:22.078823] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T22:06:22.315304] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T22:06:22.817992] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-13T22:06:23.255152] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T22:06:23.617992] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-13T22:06:23.838376] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T22:06:24.418019] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-13T22:06:24.533606] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T22:06:25.218013] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-13T22:06:25.433234] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T22:06:25.771372] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T22:06:25.775849] [INFO ] [REMOTE ] UHS: Full fetch complete (58175 records). [2025-10-13T22:06:25.775971] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-13T22:06:26.023207] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-13T22:06:26.164880] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-13T22:06:26.164971] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-13T22:06:26.166256] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-13T22:06:26.166324] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-13T22:06:26.167724] [DEBUG] [LOCAL ] UHS: Trimmed 58175 records to 40384 (keeping 200 days of data) [2025-10-13T22:06:26.428963] [DEBUG] [LOCAL ] UHS: Primary data saved (40384 records). [2025-10-13T22:06:26.429091] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-13T22:06:26.429166] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHS took 40.7s. Estimated remaining: 26m 60s. Rate: 7.1 symbols/min [2025-10-13T22:06:26.593619] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:26.634935] [DEBUG] [LOCAL ] ULS: Loaded 39884 existing records from primary storage. [2025-10-13T22:06:26.635249] [INFO ] [MAIN ] ULS: Loaded 39884 existing records. [2025-10-13T22:06:26.830499] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-13T22:06:26.837781] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:26.839589] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-13T22:06:26.839694] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-13T22:06:26.840066] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-13T22:06:26.840138] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-13T22:06:27.019859] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T22:06:27.301536] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:27.618010] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-13T22:06:28.417926] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-13T22:06:28.854637] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-13T22:06:29.107768] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T22:06:29.225180] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-13T22:06:29.227726] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T22:06:30.017951] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-13T22:06:30.419993] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T22:06:30.817956] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-13T22:06:31.553335] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:06:31.617957] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-13T22:06:32.099669] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T22:06:32.417975] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-13T22:06:33.217929] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-13T22:06:33.298540] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T22:06:33.423242] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T22:06:33.934091] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T22:06:34.017993] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-13T22:06:34.817945] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-13T22:06:35.084739] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T22:06:35.617978] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-13T22:06:36.077677] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T22:06:36.369769] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T22:06:36.372146] [INFO ] [REMOTE ] UI: Full fetch complete (19035 records). [2025-10-13T22:06:36.372246] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-13T22:06:36.425593] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-13T22:06:36.738678] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-13T22:06:36.738766] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-13T22:06:36.739287] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-13T22:06:36.739350] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-13T22:06:36.740018] [DEBUG] [LOCAL ] UI: Trimmed 19035 records to 13686 (keeping 200 days of data) [2025-10-13T22:06:36.833478] [DEBUG] [LOCAL ] UI: Primary data saved (13686 records). [2025-10-13T22:06:36.833986] [INFO ] [MAIN ] UI: Full history saved. [2025-10-13T22:06:36.834168] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 35.4s. Estimated remaining: 26m 52s. Rate: 7.1 symbols/min [2025-10-13T22:06:37.013329] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:37.072226] [DEBUG] [LOCAL ] UMC: Loaded 53453 existing records from primary storage. [2025-10-13T22:06:37.072540] [INFO ] [MAIN ] UMC: Loaded 53453 existing records. [2025-10-13T22:06:37.225487] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-13T22:06:37.256834] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:37.257767] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-13T22:06:37.257821] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-13T22:06:37.258576] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-13T22:06:37.258676] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-13T22:06:37.622857] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:38.017942] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-13T22:06:38.456942] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T22:06:38.529459] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T22:06:38.817969] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-13T22:06:39.617923] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-13T22:06:39.948194] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T22:06:40.423178] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-13T22:06:40.449459] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T22:06:40.759634] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T22:06:41.217944] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-13T22:06:42.017954] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-13T22:06:42.403383] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-13T22:06:42.437554] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-13T22:06:42.817954] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-13T22:06:43.180626] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T22:06:43.617961] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-13T22:06:44.417957] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-13T22:06:44.601581] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T22:06:45.027766] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T22:06:45.217949] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-13T22:06:46.017922] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-13T22:06:46.279628] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T22:06:46.817939] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-13T22:06:46.905561] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T22:06:47.287444] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T22:06:47.291812] [INFO ] [REMOTE ] UIS: Full fetch complete (51888 records). [2025-10-13T22:06:47.291923] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-13T22:06:47.631099] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-13T22:06:47.690909] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-13T22:06:47.691072] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-13T22:06:47.692338] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-13T22:06:47.692405] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-13T22:06:47.694280] [DEBUG] [LOCAL ] UIS: Trimmed 51888 records to 36900 (keeping 200 days of data) [2025-10-13T22:06:47.917687] [DEBUG] [LOCAL ] UIS: Primary data saved (36900 records). [2025-10-13T22:06:47.917925] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-13T22:06:47.918048] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 37.3s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-13T22:06:48.100108] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:06:48.139399] [DEBUG] [LOCAL ] UMH: Loaded 34385 existing records from primary storage. [2025-10-13T22:06:48.139779] [INFO ] [MAIN ] UMH: Loaded 34385 existing records. [2025-10-13T22:06:48.331933] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:06:48.332563] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-13T22:06:48.332699] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-13T22:06:48.332951] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-13T22:06:48.332995] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-13T22:06:48.424396] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-13T22:06:48.724177] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:06:48.761945] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T22:06:49.217981] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-13T22:06:49.572751] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T22:06:49.748489] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T22:06:50.017954] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-13T22:06:50.817955] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-13T22:06:51.057984] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T22:06:51.608740] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T22:06:51.619600] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-13T22:06:52.094497] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T22:06:52.418052] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-13T22:06:53.212978] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T22:06:53.223771] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-13T22:06:54.017978] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-13T22:06:54.252282] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T22:06:54.403103] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T22:06:54.818001] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-13T22:06:55.562803] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T22:06:55.617949] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-13T22:06:56.030617] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T22:06:56.417949] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-13T22:06:57.095702] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T22:06:57.217955] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-13T22:06:57.902985] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T22:06:58.017929] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-13T22:06:58.452339] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T22:06:58.817952] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-13T22:06:59.249903] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T22:06:59.617952] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-13T22:06:59.783508] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T22:07:00.418018] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-13T22:07:00.704955] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T22:07:01.217980] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-13T22:07:01.873972] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T22:07:01.879375] [INFO ] [REMOTE ] UL: Full fetch complete (76894 records). [2025-10-13T22:07:01.879484] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-13T22:07:02.023124] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-13T22:07:02.281335] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-13T22:07:02.281413] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-13T22:07:02.282598] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-13T22:07:02.282821] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-13T22:07:02.284474] [DEBUG] [LOCAL ] UL: Trimmed 76894 records to 53079 (keeping 200 days of data) [2025-10-13T22:07:02.415586] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T22:07:02.422499] [INFO ] [REMOTE ] ULS: Full fetch complete (53987 records). [2025-10-13T22:07:02.423319] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-13T22:07:02.843469] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-13T22:07:02.956113] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-13T22:07:02.956472] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-13T22:07:02.957726] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-13T22:07:02.958057] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-13T22:07:02.961851] [DEBUG] [LOCAL ] ULS: Trimmed 53987 records to 39048 (keeping 200 days of data) [2025-10-13T22:07:03.291413] [DEBUG] [LOCAL ] UL: Primary data saved (53079 records). [2025-10-13T22:07:03.293172] [INFO ] [MAIN ] UL: Full history saved. [2025-10-13T22:07:03.293815] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 42.8s. Estimated remaining: 26m 35s. Rate: 7.1 symbols/min [2025-10-13T22:07:03.340423] [DEBUG] [LOCAL ] ULS: Primary data saved (39048 records). [2025-10-13T22:07:03.366627] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-13T22:07:03.377715] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 36.9s. Estimated remaining: 26m 26s. Rate: 7.1 symbols/min [2025-10-13T22:07:03.606472] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:03.652866] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:03.669281] [DEBUG] [LOCAL ] UNF: Loaded 12272 existing records from primary storage. [2025-10-13T22:07:03.669693] [INFO ] [MAIN ] UNF: Loaded 12272 existing records. [2025-10-13T22:07:03.860100] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T22:07:03.928253] [DEBUG] [LOCAL ] UNFI: Loaded 42999 existing records from primary storage. [2025-10-13T22:07:03.932357] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-13T22:07:03.931947] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:03.932877] [INFO ] [MAIN ] UNFI: Loaded 42999 existing records. [2025-10-13T22:07:03.934077] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-13T22:07:03.934363] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-13T22:07:03.956506] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-13T22:07:03.972427] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-13T22:07:04.248364] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:04.289295] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-13T22:07:04.311766] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-13T22:07:04.359850] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-13T22:07:04.362929] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T22:07:04.363017] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-13T22:07:04.419724] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-13T22:07:04.814813] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:04.922667] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:05.217943] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-13T22:07:05.795838] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T22:07:05.933582] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-13T22:07:06.017917] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-13T22:07:06.767684] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T22:07:06.817945] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-13T22:07:07.443904] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T22:07:07.449277] [INFO ] [REMOTE ] UMC: Full fetch complete (76528 records). [2025-10-13T22:07:07.449402] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-13T22:07:07.639834] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-13T22:07:07.853825] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-13T22:07:07.853970] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-13T22:07:07.855282] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-13T22:07:07.855409] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-13T22:07:07.857548] [DEBUG] [LOCAL ] UMC: Trimmed 76528 records to 52680 (keeping 200 days of data) [2025-10-13T22:07:07.878438] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T22:07:08.190705] [DEBUG] [LOCAL ] UMC: Primary data saved (52680 records). [2025-10-13T22:07:08.190827] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-13T22:07:08.190936] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 31.4s. Estimated remaining: 26m 18s. Rate: 7.1 symbols/min [2025-10-13T22:07:08.357988] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:08.412598] [DEBUG] [LOCAL ] UNH: Loaded 54583 existing records from primary storage. [2025-10-13T22:07:08.412926] [INFO ] [MAIN ] UNH: Loaded 54583 existing records. [2025-10-13T22:07:08.424045] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-13T22:07:08.594408] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:08.594628] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-13T22:07:08.594721] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-13T22:07:08.595032] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-13T22:07:08.595106] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-13T22:07:08.812896] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T22:07:08.981793] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:09.218038] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-13T22:07:09.934038] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T22:07:10.017995] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-13T22:07:10.817991] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-13T22:07:11.182203] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T22:07:11.303071] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T22:07:11.617960] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-13T22:07:12.142913] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T22:07:12.417931] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-13T22:07:12.723559] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T22:07:13.217931] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-13T22:07:13.556546] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T22:07:13.971852] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T22:07:14.018003] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-13T22:07:14.813765] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T22:07:14.817872] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-13T22:07:15.617912] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-13T22:07:15.694617] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T22:07:16.417998] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-13T22:07:16.795486] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T22:07:17.217964] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-13T22:07:18.017956] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-13T22:07:18.385995] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T22:07:18.472680] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T22:07:18.785589] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T22:07:18.817919] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-13T22:07:19.618001] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-13T22:07:20.095387] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T22:07:20.417984] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-13T22:07:20.987153] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T22:07:21.217999] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-13T22:07:21.741995] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-13T22:07:22.018028] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-13T22:07:22.590445] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T22:07:22.817938] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-13T22:07:23.617997] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-13T22:07:23.981336] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T22:07:24.418058] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-13T22:07:24.457249] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T22:07:24.494379] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T22:07:25.217945] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-13T22:07:25.821423] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T22:07:26.017939] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-13T22:07:26.817944] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-13T22:07:27.300265] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T22:07:27.304357] [INFO ] [REMOTE ] UMH: Full fetch complete (46769 records). [2025-10-13T22:07:27.304511] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-13T22:07:27.618357] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-13T22:07:27.719155] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-13T22:07:27.719296] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-13T22:07:27.720381] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-13T22:07:27.720767] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-13T22:07:27.722394] [DEBUG] [LOCAL ] UMH: Trimmed 46769 records to 33956 (keeping 200 days of data) [2025-10-13T22:07:27.847443] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T22:07:27.866866] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-13T22:07:27.996696] [DEBUG] [LOCAL ] UMH: Primary data saved (33956 records). [2025-10-13T22:07:27.996841] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-13T22:07:27.996921] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 40.1s. Estimated remaining: 26m 10s. Rate: 7.1 symbols/min [2025-10-13T22:07:28.166980] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:28.214130] [DEBUG] [LOCAL ] UNM: Loaded 48932 existing records from primary storage. [2025-10-13T22:07:28.214428] [INFO ] [MAIN ] UNM: Loaded 48932 existing records. [2025-10-13T22:07:28.398830] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:28.399119] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-13T22:07:28.399170] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-13T22:07:28.399793] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-13T22:07:28.399872] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-13T22:07:28.423096] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-13T22:07:28.814556] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:29.034797] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T22:07:29.217909] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-13T22:07:29.317508] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T22:07:30.017991] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-13T22:07:30.439310] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T22:07:30.817917] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-13T22:07:30.827599] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T22:07:31.618008] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-13T22:07:32.078099] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T22:07:32.082924] [INFO ] [REMOTE ] UNFI: Full fetch complete (59449 records). [2025-10-13T22:07:32.083015] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-13T22:07:32.423137] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-13T22:07:32.475283] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-13T22:07:32.475358] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-13T22:07:32.476342] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-13T22:07:32.476403] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-13T22:07:32.477830] [DEBUG] [LOCAL ] UNFI: Trimmed 59449 records to 42529 (keeping 200 days of data) [2025-10-13T22:07:32.731145] [DEBUG] [LOCAL ] UNFI: Primary data saved (42529 records). [2025-10-13T22:07:32.731273] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-13T22:07:32.731351] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNFI took 29.3s. Estimated remaining: 26m 1s. Rate: 7.1 symbols/min [2025-10-13T22:07:32.927486] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:32.938189] [DEBUG] [LOCAL ] UNMA: Loaded 3599 existing records from primary storage. [2025-10-13T22:07:32.938439] [INFO ] [MAIN ] UNMA: Loaded 3599 existing records. [2025-10-13T22:07:33.169449] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:33.169930] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-13T22:07:33.170064] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-13T22:07:33.170362] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-13T22:07:33.170421] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-13T22:07:33.221669] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-13T22:07:33.581525] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:33.613457] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T22:07:34.017941] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-13T22:07:34.054996] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T22:07:34.057036] [INFO ] [REMOTE ] UNF: Full fetch complete (17327 records). [2025-10-13T22:07:34.057177] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-13T22:07:34.439477] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-13T22:07:34.439581] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-13T22:07:34.440260] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-13T22:07:34.440323] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-13T22:07:34.440986] [DEBUG] [LOCAL ] UNF: Trimmed 17327 records to 11761 (keeping 200 days of data) [2025-10-13T22:07:34.507800] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-13T22:07:34.535514] [DEBUG] [LOCAL ] UNF: Primary data saved (11761 records). [2025-10-13T22:07:34.535746] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-13T22:07:34.535863] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNF took 31.2s. Estimated remaining: 25m 52s. Rate: 7.1 symbols/min [2025-10-13T22:07:34.714021] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:34.775661] [DEBUG] [LOCAL ] UNP: Loaded 54080 existing records from primary storage. [2025-10-13T22:07:34.776099] [INFO ] [MAIN ] UNP: Loaded 54080 existing records. [2025-10-13T22:07:34.830759] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-13T22:07:34.968032] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:34.968317] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-13T22:07:34.968533] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-13T22:07:34.969337] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-13T22:07:34.969462] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-13T22:07:35.356973] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:07:35.387073] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-13T22:07:35.617941] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-13T22:07:36.289303] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T22:07:36.417930] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-13T22:07:37.218033] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-13T22:07:37.863327] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T22:07:38.017924] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-13T22:07:38.317470] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-13T22:07:38.817920] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-13T22:07:38.910617] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T22:07:39.407037] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T22:07:39.617924] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-13T22:07:40.417954] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-13T22:07:41.217943] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-13T22:07:41.462119] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T22:07:41.576714] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-13T22:07:41.777991] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T22:07:41.779959] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T22:07:42.017919] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-13T22:07:42.817939] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-13T22:07:43.226053] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-13T22:07:43.570349] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:07:43.617921] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-13T22:07:44.417955] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-13T22:07:45.217923] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-13T22:07:45.340923] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T22:07:45.976891] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T22:07:46.017898] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-13T22:07:46.817950] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-13T22:07:47.457286] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T22:07:47.599842] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T22:07:47.617893] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-13T22:07:47.823895] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-13T22:07:48.417951] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-13T22:07:49.136239] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T22:07:49.217972] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-13T22:07:49.632915] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-13T22:07:50.017931] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-13T22:07:50.094605] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T22:07:50.555885] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T22:07:50.817967] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-13T22:07:51.617966] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-13T22:07:52.417914] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-13T22:07:52.502244] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T22:07:52.913895] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T22:07:53.217989] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-13T22:07:53.709586] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T22:07:53.999623] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-13T22:07:54.017910] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-13T22:07:54.484809] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T22:07:54.817993] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-13T22:07:55.617946] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-13T22:07:56.417929] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-13T22:07:56.676809] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T22:07:56.956610] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T22:07:57.217985] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-13T22:07:57.251238] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T22:07:58.017933] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-13T22:07:58.416270] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T22:07:58.421806] [INFO ] [REMOTE ] UNH: Full fetch complete (77868 records). [2025-10-13T22:07:58.421931] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-13T22:07:58.820688] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-13T22:07:58.826142] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-13T22:07:58.826461] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-13T22:07:58.827834] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-13T22:07:58.828101] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-13T22:07:58.830104] [DEBUG] [LOCAL ] UNH: Trimmed 77868 records to 53806 (keeping 200 days of data) [2025-10-13T22:07:59.120551] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T22:07:59.276274] [DEBUG] [LOCAL ] UNH: Primary data saved (53806 records). [2025-10-13T22:07:59.276483] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-13T22:07:59.276587] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNH took 51.1s. Estimated remaining: 25m 45s. Rate: 7.1 symbols/min [2025-10-13T22:07:59.448026] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:07:59.496298] [DEBUG] [LOCAL ] UP: Loaded 44474 existing records from primary storage. [2025-10-13T22:07:59.496724] [INFO ] [MAIN ] UP: Loaded 44474 existing records. [2025-10-13T22:07:59.623158] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-13T22:07:59.685300] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:07:59.685858] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-13T22:07:59.685912] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-13T22:07:59.686425] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-13T22:07:59.686486] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-13T22:08:00.065060] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:00.065364] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T22:08:00.067214] [INFO ] [REMOTE ] UNMA: Full fetch complete (5670 records). [2025-10-13T22:08:00.067294] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-13T22:08:00.420009] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-13T22:08:00.445006] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-13T22:08:00.446346] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-13T22:08:00.446620] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-13T22:08:00.446741] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-13T22:08:00.447322] [DEBUG] [LOCAL ] UNMA: Trimmed 5670 records to 3545 (keeping 200 days of data) [2025-10-13T22:08:00.471099] [DEBUG] [LOCAL ] UNMA: Primary data saved (3545 records). [2025-10-13T22:08:00.471353] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-13T22:08:00.471510] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNMA took 27.7s. Estimated remaining: 25m 36s. Rate: 7.1 symbols/min [2025-10-13T22:08:00.640056] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T22:08:00.721698] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:00.721866] [DEBUG] [LOCAL ] UPS: No existing data file found in primary storage. [2025-10-13T22:08:00.721906] [WARN ] [MAIN ] UPS: No existing data found, performing full refresh instead. [2025-10-13T22:08:00.722021] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-13T22:08:00.722063] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-13T22:08:00.722104] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-10-13T22:08:00.722137] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-13T22:08:01.077456] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:01.217955] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-13T22:08:02.018037] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-13T22:08:02.321043] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T22:08:02.817962] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-13T22:08:03.202668] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T22:08:03.208034] [INFO ] [REMOTE ] UNM: Full fetch complete (69786 records). [2025-10-13T22:08:03.208210] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-13T22:08:03.606175] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-13T22:08:03.606263] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-13T22:08:03.608076] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-13T22:08:03.608161] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-13T22:08:03.618577] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-13T22:08:03.640625] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-13T22:08:03.652423] [DEBUG] [LOCAL ] UNM: Trimmed 69786 records to 48201 (keeping 200 days of data) [2025-10-13T22:08:03.951880] [DEBUG] [LOCAL ] UNM: Primary data saved (48201 records). [2025-10-13T22:08:03.952013] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-13T22:08:03.952090] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 36.0s. Estimated remaining: 25m 27s. Rate: 7.1 symbols/min [2025-10-13T22:08:04.122343] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:04.157660] [DEBUG] [LOCAL ] URI: Loaded 35626 existing records from primary storage. [2025-10-13T22:08:04.157961] [INFO ] [MAIN ] URI: Loaded 35626 existing records. [2025-10-13T22:08:04.336244] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:04.336477] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-13T22:08:04.336524] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-13T22:08:04.336916] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-13T22:08:04.336972] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-13T22:08:04.426284] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-13T22:08:04.704485] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:04.832285] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T22:08:04.964667] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T22:08:05.218011] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-13T22:08:06.017964] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-13T22:08:06.478437] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T22:08:06.663119] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-13T22:08:06.817976] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-13T22:08:07.327030] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T22:08:07.332869] [INFO ] [REMOTE ] UNP: Full fetch complete (76906 records). [2025-10-13T22:08:07.332978] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-13T22:08:07.618052] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-13T22:08:07.751569] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T22:08:07.770685] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-13T22:08:07.770766] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-13T22:08:07.780080] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-13T22:08:07.780328] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-13T22:08:07.782547] [DEBUG] [LOCAL ] UNP: Trimmed 76906 records to 53333 (keeping 200 days of data) [2025-10-13T22:08:08.149954] [DEBUG] [LOCAL ] UNP: Primary data saved (53333 records). [2025-10-13T22:08:08.150116] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-13T22:08:08.150203] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 33.6s. Estimated remaining: 25m 19s. Rate: 7.1 symbols/min [2025-10-13T22:08:08.317755] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:08.353014] [DEBUG] [LOCAL ] USA: Loaded 36662 existing records from primary storage. [2025-10-13T22:08:08.353285] [INFO ] [MAIN ] USA: Loaded 36662 existing records. [2025-10-13T22:08:08.423126] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-13T22:08:08.539668] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:08.539872] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-13T22:08:08.539920] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-13T22:08:08.540298] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-13T22:08:08.540354] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-13T22:08:08.907954] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:09.217973] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-13T22:08:09.562139] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T22:08:09.603468] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T22:08:10.018053] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-13T22:08:10.416754] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T22:08:10.817965] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-13T22:08:11.618048] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-13T22:08:12.207064] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T22:08:12.294950] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T22:08:12.417953] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-13T22:08:13.178790] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T22:08:13.217922] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-13T22:08:14.018042] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-13T22:08:14.500607] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T22:08:14.694226] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T22:08:14.817906] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-13T22:08:15.191510] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T22:08:15.617957] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-13T22:08:16.417989] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-13T22:08:16.860295] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T22:08:17.217983] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-13T22:08:17.531297] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T22:08:17.667845] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T22:08:18.017964] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-13T22:08:18.427076] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T22:08:18.817926] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-13T22:08:19.284516] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T22:08:19.618028] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-13T22:08:20.418057] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-13T22:08:20.571841] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T22:08:21.218016] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-13T22:08:21.837519] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T22:08:21.922482] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T22:08:22.017905] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-13T22:08:22.508050] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T22:08:22.817925] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-13T22:08:23.472343] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T22:08:23.617940] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-13T22:08:24.038669] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-13T22:08:24.417953] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-13T22:08:25.217932] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-13T22:08:25.750850] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T22:08:25.752903] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-13T22:08:26.017980] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-13T22:08:26.617326] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:08:26.817940] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-13T22:08:27.202785] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T22:08:27.618003] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-13T22:08:28.208098] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T22:08:28.417995] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-13T22:08:29.115639] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T22:08:29.217989] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-13T22:08:30.017964] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-13T22:08:30.106708] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T22:08:30.818007] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-13T22:08:31.339592] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T22:08:31.626339] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-13T22:08:31.648101] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-13T22:08:31.911283] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T22:08:32.418002] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-13T22:08:33.107446] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T22:08:33.217931] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-13T22:08:34.018011] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-13T22:08:34.310769] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T22:08:34.818015] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-13T22:08:35.285993] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T22:08:35.376304] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T22:08:35.617978] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-13T22:08:36.299242] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T22:08:36.417956] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-13T22:08:36.567612] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T22:08:36.573963] [INFO ] [REMOTE ] USA: Full fetch complete (52109 records). [2025-10-13T22:08:36.574425] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-13T22:08:36.866098] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T22:08:36.903214] [INFO ] [REMOTE ] URI: Full fetch complete (52797 records). [2025-10-13T22:08:36.908500] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-13T22:08:37.087502] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-13T22:08:37.096529] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-13T22:08:37.100899] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-13T22:08:37.100994] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-13T22:08:37.148007] [DEBUG] [LOCAL ] USA: Trimmed 52109 records to 36209 (keeping 200 days of data) [2025-10-13T22:08:37.264714] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-13T22:08:37.515332] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-13T22:08:37.516276] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-13T22:08:37.518715] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-13T22:08:37.518802] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-13T22:08:37.525239] [DEBUG] [LOCAL ] URI: Trimmed 52797 records to 34885 (keeping 200 days of data) [2025-10-13T22:08:37.868251] [DEBUG] [LOCAL ] USA: Primary data saved (36209 records). [2025-10-13T22:08:37.870547] [DEBUG] [LOCAL ] URI: Primary data saved (34885 records). [2025-10-13T22:08:37.870673] [INFO ] [MAIN ] URI: Full history saved. [2025-10-13T22:08:37.870809] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. URI took 33.9s. Estimated remaining: 25m 12s. Rate: 7.1 symbols/min [2025-10-13T22:08:37.870459] [INFO ] [MAIN ] USA: Full history saved. [2025-10-13T22:08:37.876532] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. USA took 29.7s. Estimated remaining: 25m 3s. Rate: 7.1 symbols/min [2025-10-13T22:08:38.018059] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-13T22:08:38.157996] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:38.232319] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:38.251811] [DEBUG] [LOCAL ] USAC: Loaded 21905 existing records from primary storage. [2025-10-13T22:08:38.252171] [INFO ] [MAIN ] USAC: Loaded 21905 existing records. [2025-10-13T22:08:38.445772] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:38.461525] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-13T22:08:38.461991] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-13T22:08:38.467561] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-13T22:08:38.467844] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-13T22:08:38.502203] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T22:08:38.555885] [INFO ] [REMOTE ] UPS: Full fetch complete (77758 records). [2025-10-13T22:08:38.601405] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-13T22:08:38.615283] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-13T22:08:38.638015] [INFO ] [MAIN ] USB: Loaded 54468 existing records. [2025-10-13T22:08:39.180165] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:39.246899] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-13T22:08:39.282473] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-13T22:08:39.325716] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-13T22:08:39.345088] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-13T22:08:39.611458] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:39.613479] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T22:08:39.673019] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-13T22:08:39.694116] [INFO ] [REMOTE ] UP: Full fetch complete (62753 records). [2025-10-13T22:08:39.791731] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-13T22:08:39.816773] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-13T22:08:39.817117] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-13T22:08:39.854878] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-13T22:08:39.892741] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-13T22:08:40.047233] [DEBUG] [LOCAL ] UPS: Trimmed 77758 records to 53718 (keeping 200 days of data) [2025-10-13T22:08:40.200543] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:40.258374] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-13T22:08:40.506279] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-13T22:08:40.506975] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-13T22:08:40.508310] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-13T22:08:40.510206] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-13T22:08:40.515230] [DEBUG] [LOCAL ] UP: Trimmed 62753 records to 43941 (keeping 200 days of data) [2025-10-13T22:08:41.000072] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T22:08:41.007249] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-13T22:08:41.025229] [DEBUG] [LOCAL ] UP: Primary data saved (43941 records). [2025-10-13T22:08:41.027202] [INFO ] [MAIN ] UP: Full history saved. [2025-10-13T22:08:41.027761] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UP took 41.8s. Estimated remaining: 24m 54s. Rate: 7.1 symbols/min [2025-10-13T22:08:41.151851] [DEBUG] [LOCAL ] UPS: Primary data saved (53718 records). [2025-10-13T22:08:41.157917] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-13T22:08:41.163198] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. UPS took 40.7s. Estimated remaining: 24m 45s. Rate: 7.1 symbols/min [2025-10-13T22:08:41.332377] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:41.406984] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:08:41.441820] [DEBUG] [LOCAL ] USNA: Loaded 18076 existing records from primary storage. [2025-10-13T22:08:41.442110] [INFO ] [MAIN ] USNA: Loaded 18076 existing records. [2025-10-13T22:08:41.573881] [DEBUG] [LOCAL ] USFD: Loaded 51896 existing records from primary storage. [2025-10-13T22:08:41.586055] [INFO ] [MAIN ] USFD: Loaded 51896 existing records. [2025-10-13T22:08:41.724547] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:41.760498] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-13T22:08:41.764258] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-13T22:08:41.785428] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-13T22:08:41.839590] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-13T22:08:41.845274] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:08:41.885373] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-13T22:08:41.912899] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-13T22:08:41.943995] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-13T22:08:41.961304] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-13T22:08:42.417533] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T22:08:42.532715] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-13T22:08:42.531950] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:42.548367] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-13T22:08:42.537539] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T22:08:42.698297] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:08:42.817964] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-13T22:08:43.408365] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T22:08:43.617942] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-13T22:08:43.945606] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T22:08:44.229731] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T22:08:44.417920] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-13T22:08:44.681528] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T22:08:45.217923] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-13T22:08:45.304809] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T22:08:46.017951] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-13T22:08:46.769448] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:08:46.795962] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T22:08:46.817966] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-13T22:08:47.617989] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-13T22:08:48.418703] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-13T22:08:48.421425] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T22:08:48.975060] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T22:08:49.217980] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-13T22:08:49.267579] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T22:08:50.018046] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-13T22:08:50.817956] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-13T22:08:50.922470] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T22:08:50.949307] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T22:08:51.618019] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-13T22:08:52.417950] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-13T22:08:52.486546] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T22:08:53.217927] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-13T22:08:53.430611] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T22:08:53.541432] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T22:08:54.017954] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-13T22:08:54.655788] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T22:08:54.818043] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-13T22:08:55.617927] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-13T22:08:55.943606] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T22:08:56.418008] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-13T22:08:56.601795] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T22:08:56.650747] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T22:08:57.217919] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-13T22:08:57.402465] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T22:08:57.903228] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T22:08:58.017960] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-13T22:08:58.817975] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-13T22:08:58.969034] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T22:08:59.618059] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-13T22:08:59.817928] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T22:09:00.417976] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-13T22:09:01.217951] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-13T22:09:01.388786] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T22:09:01.448366] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T22:09:02.017942] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-13T22:09:02.817980] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-13T22:09:03.354639] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T22:09:03.617963] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-13T22:09:03.971135] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T22:09:04.006559] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T22:09:04.417945] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-13T22:09:05.217922] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-13T22:09:05.373835] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T22:09:05.411355] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T22:09:06.017966] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-13T22:09:06.769325] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T22:09:06.817918] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-13T22:09:06.878699] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T22:09:06.881099] [INFO ] [REMOTE ] USNA: Full fetch complete (26739 records). [2025-10-13T22:09:06.881175] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-13T22:09:07.264219] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-13T22:09:07.264358] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-13T22:09:07.264964] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-13T22:09:07.265027] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-13T22:09:07.265918] [DEBUG] [LOCAL ] USNA: Trimmed 26739 records to 17862 (keeping 200 days of data) [2025-10-13T22:09:07.371493] [DEBUG] [LOCAL ] USNA: Primary data saved (17862 records). [2025-10-13T22:09:07.371670] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-13T22:09:07.371777] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USNA took 26.2s. Estimated remaining: 24m 38s. Rate: 7.1 symbols/min [2025-10-13T22:09:07.542419] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:07.561086] [DEBUG] [LOCAL ] USPH: Loaded 17233 existing records from primary storage. [2025-10-13T22:09:07.561373] [INFO ] [MAIN ] USPH: Loaded 17233 existing records. [2025-10-13T22:09:07.620712] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-13T22:09:07.754874] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:07.755125] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-13T22:09:07.755174] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-13T22:09:07.755392] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-13T22:09:07.755463] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-13T22:09:08.104150] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:08.417915] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-13T22:09:08.518434] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T22:09:09.217937] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-13T22:09:09.409454] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T22:09:09.442972] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T22:09:10.018000] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-13T22:09:10.817937] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-13T22:09:10.856150] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T22:09:11.025976] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T22:09:11.563738] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T22:09:11.617928] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-13T22:09:12.300373] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T22:09:12.417911] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-13T22:09:13.217922] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-13T22:09:13.396499] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T22:09:13.398859] [INFO ] [REMOTE ] USAC: Full fetch complete (35076 records). [2025-10-13T22:09:13.398942] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-13T22:09:13.779786] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-13T22:09:13.779861] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-13T22:09:13.780577] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-13T22:09:13.780616] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-13T22:09:13.781439] [DEBUG] [LOCAL ] USAC: Trimmed 35076 records to 21651 (keeping 200 days of data) [2025-10-13T22:09:13.909033] [DEBUG] [LOCAL ] USAC: Primary data saved (21651 records). [2025-10-13T22:09:13.909157] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-13T22:09:13.909235] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USAC took 36.0s. Estimated remaining: 24m 29s. Rate: 7.1 symbols/min [2025-10-13T22:09:14.017909] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-13T22:09:14.265715] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T22:09:14.817996] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-13T22:09:15.436960] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T22:09:15.617926] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-13T22:09:15.692030] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T22:09:16.417945] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-13T22:09:17.004359] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T22:09:17.020392] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-13T22:09:17.034086] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-13T22:09:17.039566] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T22:09:17.223866] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-13T22:09:17.442037] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-13T22:09:17.442116] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-13T22:09:17.443246] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-13T22:09:17.443307] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-13T22:09:17.444831] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-10-13T22:09:17.784351] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-13T22:09:17.784491] [INFO ] [MAIN ] USB: Full history saved. [2025-10-13T22:09:17.784571] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USB took 39.8s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-13T22:09:18.017984] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-13T22:09:18.125677] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T22:09:18.818034] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-13T22:09:19.420432] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T22:09:19.427789] [INFO ] [REMOTE ] USFD: Full fetch complete (73969 records). [2025-10-13T22:09:19.427941] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-13T22:09:19.822414] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-13T22:09:19.822491] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-13T22:09:19.823626] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-13T22:09:19.823708] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-13T22:09:19.825037] [DEBUG] [LOCAL ] USFD: Trimmed 73969 records to 51157 (keeping 200 days of data) [2025-10-13T22:09:20.046190] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T22:09:20.052103] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-13T22:09:20.151726] [DEBUG] [LOCAL ] USFD: Primary data saved (51157 records). [2025-10-13T22:09:20.151877] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-13T22:09:20.152044] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USFD took 39.1s. Estimated remaining: 24m 11s. Rate: 7.1 symbols/min [2025-10-13T22:09:20.966436] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T22:09:20.971439] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-13T22:09:21.737690] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T22:09:21.741866] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-13T22:09:22.487762] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T22:09:22.491696] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-13T22:09:23.374056] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T22:09:23.376547] [INFO ] [REMOTE ] USPH: Full fetch complete (22934 records). [2025-10-13T22:09:23.376628] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-13T22:09:23.743618] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-13T22:09:23.743744] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-13T22:09:23.744233] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-13T22:09:23.744272] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-13T22:09:23.744902] [DEBUG] [LOCAL ] USPH: Trimmed 22934 records to 17123 (keeping 200 days of data) [2025-10-13T22:09:23.851029] [DEBUG] [LOCAL ] USPH: Primary data saved (17123 records). [2025-10-13T22:09:23.851181] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-13T22:09:23.851262] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 16.5s. Estimated remaining: 24m 3s. Rate: 7.1 symbols/min [2025-10-13T22:09:24.402713] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:24.442630] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:24.538901] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:24.557338] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:24.568230] [DEBUG] [LOCAL ] UTL: Loaded 11823 existing records from primary storage. [2025-10-13T22:09:24.568628] [INFO ] [MAIN ] UTL: Loaded 11823 existing records. [2025-10-13T22:09:24.786341] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:24.786760] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-13T22:09:24.786824] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-13T22:09:24.787075] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-13T22:09:24.787155] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-13T22:09:24.840191] [DEBUG] [LOCAL ] UTF: Loaded 30866 existing records from primary storage. [2025-10-13T22:09:24.855941] [INFO ] [MAIN ] UTF: Loaded 30866 existing records. [2025-10-13T22:09:24.959045] [DEBUG] [LOCAL ] UTI: Loaded 41054 existing records from primary storage. [2025-10-13T22:09:24.945444] [DEBUG] [LOCAL ] UTZ: Loaded 45169 existing records from primary storage. [2025-10-13T22:09:25.008168] [INFO ] [MAIN ] UTZ: Loaded 45169 existing records. [2025-10-13T22:09:25.007955] [INFO ] [MAIN ] UTI: Loaded 41054 existing records. [2025-10-13T22:09:25.373132] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:25.489437] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-13T22:09:25.536879] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-13T22:09:25.612631] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-13T22:09:25.641620] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-13T22:09:25.674905] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:25.713410] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:25.781217] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-13T22:09:25.789816] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-13T22:09:25.786559] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-13T22:09:25.818936] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-13T22:09:25.849268] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:25.871156] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-13T22:09:25.865086] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-13T22:09:25.874622] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-13T22:09:25.874752] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-13T22:09:25.880051] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-13T22:09:26.684890] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:26.729081] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-13T22:09:26.803060] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:26.834553] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-13T22:09:26.907565] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:26.908342] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-13T22:09:26.909208] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T22:09:26.912722] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-13T22:09:27.373431] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T22:09:27.375868] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-13T22:09:27.921924] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T22:09:27.930693] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-13T22:09:28.043358] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T22:09:28.153030] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T22:09:28.276687] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T22:09:28.417948] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-13T22:09:29.153076] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T22:09:29.217989] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-13T22:09:29.876046] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T22:09:30.017941] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-13T22:09:30.547361] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T22:09:30.817978] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-13T22:09:31.228021] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T22:09:31.617955] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-13T22:09:32.370538] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T22:09:32.417906] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-13T22:09:32.683484] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T22:09:33.217975] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-13T22:09:33.712126] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T22:09:34.017932] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-13T22:09:34.706781] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T22:09:34.817900] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-13T22:09:35.043920] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T22:09:35.617957] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-13T22:09:36.102421] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T22:09:36.399015] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T22:09:36.417871] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-13T22:09:37.199203] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T22:09:37.217870] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-13T22:09:37.980068] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T22:09:38.017898] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-13T22:09:38.620014] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T22:09:38.817955] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-13T22:09:39.617974] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-13T22:09:40.148037] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T22:09:40.417921] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-13T22:09:40.474521] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T22:09:41.218005] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-13T22:09:41.671126] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T22:09:42.017956] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-13T22:09:42.725428] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T22:09:42.740307] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T22:09:42.817920] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-13T22:09:43.617957] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-13T22:09:43.814135] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T22:09:44.417968] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-13T22:09:44.987468] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T22:09:45.217932] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-13T22:09:45.373524] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T22:09:46.017935] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-13T22:09:46.352370] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T22:09:46.817922] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-13T22:09:46.951401] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T22:09:46.953578] [INFO ] [REMOTE ] UTL: Full fetch complete (15648 records). [2025-10-13T22:09:46.953739] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-13T22:09:47.361723] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-13T22:09:47.361816] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-13T22:09:47.362214] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-13T22:09:47.362279] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-13T22:09:47.362963] [DEBUG] [LOCAL ] UTL: Trimmed 15648 records to 11753 (keeping 200 days of data) [2025-10-13T22:09:47.444273] [DEBUG] [LOCAL ] UTL: Primary data saved (11753 records). [2025-10-13T22:09:47.444455] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-13T22:09:47.444571] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 23.6s. Estimated remaining: 23m 55s. Rate: 7.1 symbols/min [2025-10-13T22:09:47.623280] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-13T22:09:47.666192] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:47.694829] [DEBUG] [LOCAL ] UVE: Loaded 22150 existing records from primary storage. [2025-10-13T22:09:47.695220] [INFO ] [MAIN ] UVE: Loaded 22150 existing records. [2025-10-13T22:09:47.916821] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:47.917126] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-13T22:09:47.917193] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-13T22:09:47.917496] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-13T22:09:47.917569] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-13T22:09:48.396761] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:48.419998] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-13T22:09:48.425432] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:09:48.977838] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T22:09:49.021031] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-13T22:09:49.217948] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-13T22:09:50.017913] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-13T22:09:50.048723] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T22:09:50.817949] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-13T22:09:51.558102] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T22:09:51.617916] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-13T22:09:52.417931] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-13T22:09:52.529837] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T22:09:52.752715] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T22:09:53.217966] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-13T22:09:53.534241] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T22:09:54.018007] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-13T22:09:54.404825] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T22:09:54.408959] [INFO ] [REMOTE ] UTI: Full fetch complete (58454 records). [2025-10-13T22:09:54.409042] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-13T22:09:54.778773] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-13T22:09:54.778888] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-13T22:09:54.779758] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-13T22:09:54.779823] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-13T22:09:54.780946] [DEBUG] [LOCAL ] UTI: Trimmed 58454 records to 40604 (keeping 200 days of data) [2025-10-13T22:09:54.832856] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-13T22:09:55.016987] [DEBUG] [LOCAL ] UTI: Primary data saved (40604 records). [2025-10-13T22:09:55.017112] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-13T22:09:55.018459] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 31.1s. Estimated remaining: 23m 47s. Rate: 7.1 symbols/min [2025-10-13T22:09:55.187141] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:09:55.209956] [DEBUG] [LOCAL ] UVV: Loaded 22996 existing records from primary storage. [2025-10-13T22:09:55.210191] [INFO ] [MAIN ] UVV: Loaded 22996 existing records. [2025-10-13T22:09:55.380333] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T22:09:55.417992] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:09:55.418569] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-13T22:09:55.418628] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-13T22:09:55.419110] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-13T22:09:55.419169] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-13T22:09:55.622479] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-13T22:09:55.769134] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:09:55.861612] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T22:09:56.417978] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-13T22:09:56.661848] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T22:09:57.217947] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-13T22:09:57.415575] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T22:09:58.017916] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-13T22:09:58.342056] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T22:09:58.817946] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-13T22:09:59.217424] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T22:09:59.617916] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-13T22:09:59.836203] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T22:10:00.417963] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-13T22:10:00.522743] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T22:10:01.217989] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-13T22:10:01.719942] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T22:10:01.730450] [INFO ] [REMOTE ] UTZ: Full fetch complete (64546 records). [2025-10-13T22:10:01.730740] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-13T22:10:02.022791] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-13T22:10:02.183922] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-13T22:10:02.184039] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-13T22:10:02.185298] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-13T22:10:02.185386] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-13T22:10:02.195249] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T22:10:02.199397] [DEBUG] [LOCAL ] UTZ: Trimmed 64546 records to 44608 (keeping 200 days of data) [2025-10-13T22:10:02.502733] [DEBUG] [LOCAL ] UTZ: Primary data saved (44608 records). [2025-10-13T22:10:02.503061] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-13T22:10:02.503180] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTZ took 38.6s. Estimated remaining: 23m 38s. Rate: 7.1 symbols/min [2025-10-13T22:10:02.680122] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:02.729489] [DEBUG] [LOCAL ] UWMC: Loaded 53633 existing records from primary storage. [2025-10-13T22:10:02.729853] [INFO ] [MAIN ] UWMC: Loaded 53633 existing records. [2025-10-13T22:10:02.823201] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-13T22:10:02.922137] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:02.922338] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-13T22:10:02.922386] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-13T22:10:02.922824] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-13T22:10:02.922882] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-13T22:10:03.283890] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:03.298152] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T22:10:03.617912] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-13T22:10:03.754745] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T22:10:04.417996] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-13T22:10:05.154731] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T22:10:05.217957] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-13T22:10:05.949475] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T22:10:06.017965] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-13T22:10:06.708846] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T22:10:06.817917] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-13T22:10:06.876733] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T22:10:07.617931] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-13T22:10:08.229275] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T22:10:08.417923] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-13T22:10:08.712013] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T22:10:09.218024] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-13T22:10:09.423049] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T22:10:10.018077] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-13T22:10:10.306235] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T22:10:10.817953] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-13T22:10:11.580329] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T22:10:11.617906] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-13T22:10:12.105830] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T22:10:12.417935] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-13T22:10:13.108285] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T22:10:13.217931] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-13T22:10:13.922681] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T22:10:13.927426] [INFO ] [REMOTE ] UTF: Full fetch complete (43013 records). [2025-10-13T22:10:13.927513] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-13T22:10:14.027099] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-13T22:10:14.311021] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-13T22:10:14.311144] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-13T22:10:14.312165] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-13T22:10:14.312226] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-13T22:10:14.313204] [DEBUG] [LOCAL ] UTF: Trimmed 43013 records to 30678 (keeping 200 days of data) [2025-10-13T22:10:14.500130] [DEBUG] [LOCAL ] UTF: Primary data saved (30678 records). [2025-10-13T22:10:14.500265] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-13T22:10:14.500348] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTF took 50.6s. Estimated remaining: 23m 30s. Rate: 7.1 symbols/min [2025-10-13T22:10:14.668268] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:14.677588] [DEBUG] [LOCAL ] UZD: Loaded 6451 existing records from primary storage. [2025-10-13T22:10:14.677814] [INFO ] [MAIN ] UZD: Loaded 6451 existing records. [2025-10-13T22:10:14.825015] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-13T22:10:14.856205] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:14.856480] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-13T22:10:14.856539] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-13T22:10:14.856781] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-13T22:10:14.856839] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-13T22:10:15.190461] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T22:10:15.213761] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T22:10:15.289256] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:15.617984] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-13T22:10:16.077404] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T22:10:16.418028] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-13T22:10:16.947513] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T22:10:17.217939] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-13T22:10:18.017925] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-13T22:10:18.146441] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T22:10:18.238270] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T22:10:18.457319] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T22:10:18.817949] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-13T22:10:19.603165] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T22:10:19.617912] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-13T22:10:20.417923] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-13T22:10:20.448856] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T22:10:20.869935] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T22:10:21.217939] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-13T22:10:22.017914] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-13T22:10:22.182927] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T22:10:22.185458] [INFO ] [REMOTE ] UVE: Full fetch complete (30019 records). [2025-10-13T22:10:22.185536] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-13T22:10:22.560248] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-13T22:10:22.560346] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-13T22:10:22.561005] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-13T22:10:22.561065] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-13T22:10:22.561761] [DEBUG] [LOCAL ] UVE: Trimmed 30019 records to 21929 (keeping 200 days of data) [2025-10-13T22:10:22.694559] [DEBUG] [LOCAL ] UVE: Primary data saved (21929 records). [2025-10-13T22:10:22.694714] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-13T22:10:22.694806] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 35.3s. Estimated remaining: 23m 22s. Rate: 7.1 symbols/min [2025-10-13T22:10:22.823045] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-13T22:10:22.868244] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:22.878750] [DEBUG] [LOCAL ] UZE: Loaded 7576 existing records from primary storage. [2025-10-13T22:10:22.878959] [INFO ] [MAIN ] UZE: Loaded 7576 existing records. [2025-10-13T22:10:23.060332] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:23.060591] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-13T22:10:23.060668] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-13T22:10:23.067788] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-13T22:10:23.067858] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-13T22:10:23.100262] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-13T22:10:23.148729] [INFO ] [REMOTE ] UVV: Full fetch complete (30054 records). [2025-10-13T22:10:23.173204] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-13T22:10:23.622220] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-13T22:10:23.769600] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:23.765596] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T22:10:23.905587] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-13T22:10:23.905693] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-13T22:10:23.906358] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-13T22:10:23.906398] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-13T22:10:23.907187] [DEBUG] [LOCAL ] UVV: Trimmed 30054 records to 22811 (keeping 200 days of data) [2025-10-13T22:10:24.051803] [DEBUG] [LOCAL ] UVV: Primary data saved (22811 records). [2025-10-13T22:10:24.051966] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-13T22:10:24.052049] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 29.0s. Estimated remaining: 23m 13s. Rate: 7.1 symbols/min [2025-10-13T22:10:24.223082] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:24.233584] [DEBUG] [LOCAL ] UZF: Loaded 6403 existing records from primary storage. [2025-10-13T22:10:24.233869] [INFO ] [MAIN ] UZF: Loaded 6403 existing records. [2025-10-13T22:10:24.419875] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:24.420341] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-13T22:10:24.419992] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-13T22:10:24.421669] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-13T22:10:24.421927] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-13T22:10:24.421983] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-13T22:10:24.772462] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:25.119795] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T22:10:25.217956] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-13T22:10:25.760875] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T22:10:25.781805] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T22:10:26.017929] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-13T22:10:26.507201] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T22:10:26.817948] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-13T22:10:27.420816] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T22:10:27.617920] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-13T22:10:28.193614] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T22:10:28.417962] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-13T22:10:29.217986] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-13T22:10:29.943385] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T22:10:30.017913] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-13T22:10:30.125905] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T22:10:30.466484] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-13T22:10:30.817990] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-13T22:10:31.225794] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T22:10:31.617959] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-13T22:10:32.156845] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T22:10:32.417948] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-13T22:10:33.217981] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-13T22:10:33.285768] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T22:10:33.802113] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T22:10:34.017942] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-13T22:10:34.751561] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T22:10:34.817900] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-13T22:10:35.617941] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-13T22:10:36.318142] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T22:10:36.417946] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-13T22:10:36.641838] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T22:10:36.971921] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T22:10:37.217961] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-13T22:10:37.674528] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T22:10:38.017941] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-13T22:10:38.724082] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T22:10:38.818005] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-13T22:10:39.617942] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-13T22:10:40.185392] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T22:10:40.261036] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T22:10:40.266528] [INFO ] [REMOTE ] UWMC: Full fetch complete (75679 records). [2025-10-13T22:10:40.266668] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-13T22:10:40.426040] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-13T22:10:40.673135] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-13T22:10:40.673229] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-13T22:10:40.674412] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-13T22:10:40.674473] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-13T22:10:40.675963] [DEBUG] [LOCAL ] UWMC: Trimmed 75679 records to 52914 (keeping 200 days of data) [2025-10-13T22:10:40.979859] [DEBUG] [LOCAL ] UWMC: Primary data saved (52914 records). [2025-10-13T22:10:40.979996] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-13T22:10:40.980080] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UWMC took 38.5s. Estimated remaining: 23m 5s. Rate: 7.1 symbols/min [2025-10-13T22:10:41.088192] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T22:10:41.158625] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:41.211730] [DEBUG] [LOCAL ] V: Loaded 54532 existing records from primary storage. [2025-10-13T22:10:41.212034] [INFO ] [MAIN ] V: Loaded 54532 existing records. [2025-10-13T22:10:41.223112] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-13T22:10:41.403052] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:41.403254] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-13T22:10:41.403299] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-13T22:10:41.403900] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-13T22:10:41.403956] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-13T22:10:41.759871] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T22:10:41.765263] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:41.766990] [INFO ] [REMOTE ] UZD: Full fetch complete (9274 records). [2025-10-13T22:10:41.767080] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-13T22:10:42.027348] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-13T22:10:42.152424] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-13T22:10:42.152500] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-13T22:10:42.152765] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-13T22:10:42.152827] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-13T22:10:42.153293] [DEBUG] [LOCAL ] UZD: Trimmed 9274 records to 6333 (keeping 200 days of data) [2025-10-13T22:10:42.191872] [DEBUG] [LOCAL ] UZD: Primary data saved (6333 records). [2025-10-13T22:10:42.192002] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-13T22:10:42.192084] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZD took 27.7s. Estimated remaining: 22m 56s. Rate: 7.1 symbols/min [2025-10-13T22:10:42.365579] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:42.400624] [DEBUG] [LOCAL ] VAC: Loaded 34670 existing records from primary storage. [2025-10-13T22:10:42.400962] [INFO ] [MAIN ] VAC: Loaded 34670 existing records. [2025-10-13T22:10:42.580258] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:42.580453] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-13T22:10:42.580518] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-13T22:10:42.580924] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-13T22:10:42.580981] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-13T22:10:42.826835] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T22:10:42.826925] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-13T22:10:42.947246] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:43.617946] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-13T22:10:44.417919] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-13T22:10:44.738164] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T22:10:44.939980] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T22:10:44.941811] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T22:10:45.217960] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-13T22:10:46.018016] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-13T22:10:46.507700] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T22:10:46.817985] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-13T22:10:47.431562] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T22:10:47.617933] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-13T22:10:47.930188] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T22:10:48.417962] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-13T22:10:48.628399] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T22:10:49.086496] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T22:10:49.217911] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-13T22:10:49.637353] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T22:10:50.018029] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-13T22:10:50.788573] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T22:10:50.817905] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-13T22:10:51.206229] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T22:10:51.617972] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-13T22:10:52.037292] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T22:10:52.038506] [INFO ] [REMOTE ] UZE: Full fetch complete (10018 records). [2025-10-13T22:10:52.038583] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-13T22:10:52.405976] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-13T22:10:52.406052] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-13T22:10:52.406296] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-13T22:10:52.406334] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-13T22:10:52.406771] [DEBUG] [LOCAL ] UZE: Trimmed 10018 records to 7446 (keeping 200 days of data) [2025-10-13T22:10:52.425344] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-13T22:10:52.457081] [DEBUG] [LOCAL ] UZE: Primary data saved (7446 records). [2025-10-13T22:10:52.457290] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-13T22:10:52.457387] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UZE took 29.8s. Estimated remaining: 22m 48s. Rate: 7.1 symbols/min [2025-10-13T22:10:52.623765] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:10:52.670970] [DEBUG] [LOCAL ] VAL: Loaded 50921 existing records from primary storage. [2025-10-13T22:10:52.671265] [INFO ] [MAIN ] VAL: Loaded 50921 existing records. [2025-10-13T22:10:52.844108] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:10:52.844366] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-13T22:10:52.844411] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-13T22:10:52.844752] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-13T22:10:52.844814] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-13T22:10:53.222025] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:10:53.222209] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-13T22:10:53.951844] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T22:10:54.015219] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T22:10:54.018099] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-13T22:10:54.817983] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-13T22:10:55.557930] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T22:10:55.617902] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-13T22:10:56.417928] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-13T22:10:56.496185] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T22:10:57.226006] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-13T22:10:57.251762] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T22:10:57.980582] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T22:10:58.017968] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-13T22:10:58.594465] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T22:10:58.817941] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-13T22:10:59.589923] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-13T22:10:59.617918] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-13T22:10:59.994030] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T22:11:00.417935] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-13T22:11:01.217966] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-13T22:11:01.671303] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T22:11:01.672803] [INFO ] [REMOTE ] UZF: Full fetch complete (8769 records). [2025-10-13T22:11:01.672977] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-13T22:11:02.022416] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-13T22:11:02.064290] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-13T22:11:02.065354] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-13T22:11:02.065764] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-13T22:11:02.065885] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-13T22:11:02.078441] [DEBUG] [LOCAL ] UZF: Trimmed 8769 records to 6210 (keeping 200 days of data) [2025-10-13T22:11:02.098565] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T22:11:02.163052] [DEBUG] [LOCAL ] UZF: Primary data saved (6210 records). [2025-10-13T22:11:02.163214] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-13T22:11:02.163695] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 38.1s. Estimated remaining: 22m 39s. Rate: 7.1 symbols/min [2025-10-13T22:11:02.328923] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T22:11:02.381009] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:02.435382] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-13T22:11:02.435720] [INFO ] [MAIN ] VALE: Loaded 54473 existing records. [2025-10-13T22:11:02.607553] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:02.607808] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-13T22:11:02.607911] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-13T22:11:02.608672] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-13T22:11:02.608751] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-13T22:11:02.823067] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-13T22:11:02.960566] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:03.207130] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T22:11:03.617951] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-13T22:11:04.417984] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-13T22:11:05.002611] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-13T22:11:05.217961] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-13T22:11:05.317391] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T22:11:05.761073] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T22:11:06.017949] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-13T22:11:06.817991] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-13T22:11:07.097693] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T22:11:07.617956] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-13T22:11:07.814924] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T22:11:08.417931] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-13T22:11:08.571328] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T22:11:08.706404] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T22:11:09.217970] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-13T22:11:10.023092] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-13T22:11:10.030245] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T22:11:10.818016] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-13T22:11:11.070591] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T22:11:11.617973] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-13T22:11:12.156801] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T22:11:12.417963] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-13T22:11:12.600694] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-13T22:11:13.217920] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-13T22:11:13.399822] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T22:11:13.423476] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T22:11:14.017960] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-13T22:11:14.817934] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-13T22:11:14.956782] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T22:11:15.370734] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T22:11:15.617951] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-13T22:11:16.417935] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-13T22:11:16.786189] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T22:11:17.185031] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T22:11:17.217942] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-13T22:11:18.018011] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-13T22:11:18.239539] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T22:11:18.818002] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-13T22:11:18.931275] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T22:11:18.934820] [INFO ] [REMOTE ] VAC: Full fetch complete (48582 records). [2025-10-13T22:11:18.934934] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-13T22:11:19.324977] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-13T22:11:19.325068] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-13T22:11:19.326045] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-13T22:11:19.326108] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-13T22:11:19.327344] [DEBUG] [LOCAL ] VAC: Trimmed 48582 records to 34246 (keeping 200 days of data) [2025-10-13T22:11:19.542065] [DEBUG] [LOCAL ] VAC: Primary data saved (34246 records). [2025-10-13T22:11:19.542269] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-13T22:11:19.542581] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 37.4s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-13T22:11:19.620734] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-13T22:11:19.758708] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:19.760999] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-13T22:11:19.778114] [DEBUG] [LOCAL ] VATE: Loaded 5369 existing records from primary storage. [2025-10-13T22:11:19.778327] [INFO ] [MAIN ] VATE: Loaded 5369 existing records. [2025-10-13T22:11:19.957141] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:19.957367] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-13T22:11:19.957419] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-13T22:11:19.957606] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-13T22:11:19.957698] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-13T22:11:20.323330] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:20.417919] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-13T22:11:20.887512] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T22:11:20.889052] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T22:11:21.038676] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T22:11:21.217964] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-13T22:11:22.018008] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-13T22:11:22.494411] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T22:11:22.499624] [INFO ] [REMOTE ] VAL: Full fetch complete (73065 records). [2025-10-13T22:11:22.499809] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-13T22:11:22.821187] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-13T22:11:22.895392] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-13T22:11:22.895536] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-13T22:11:22.896720] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-13T22:11:22.896781] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-13T22:11:22.898244] [DEBUG] [LOCAL ] VAL: Trimmed 73065 records to 50170 (keeping 200 days of data) [2025-10-13T22:11:23.152201] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T22:11:23.216039] [DEBUG] [LOCAL ] VAL: Primary data saved (50170 records). [2025-10-13T22:11:23.216182] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-13T22:11:23.216282] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAL took 30.8s. Estimated remaining: 22m 23s. Rate: 7.1 symbols/min [2025-10-13T22:11:23.388083] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:23.400098] [DEBUG] [LOCAL ] VBF: Loaded 7204 existing records from primary storage. [2025-10-13T22:11:23.400382] [INFO ] [MAIN ] VBF: Loaded 7204 existing records. [2025-10-13T22:11:23.575401] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T22:11:23.631787] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-13T22:11:23.631528] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:23.633106] [INFO ] [REMOTE ] V: Full fetch complete (77819 records). [2025-10-13T22:11:23.632067] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-13T22:11:23.633223] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-13T22:11:23.633354] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-13T22:11:23.633585] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-13T22:11:23.633682] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-13T22:11:24.419616] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-13T22:11:24.443848] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-13T22:11:24.449860] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-13T22:11:24.451414] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-13T22:11:24.451530] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-13T22:11:24.449709] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:24.461989] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T22:11:24.465877] [DEBUG] [LOCAL ] V: Trimmed 77819 records to 53753 (keeping 200 days of data) [2025-10-13T22:11:24.798031] [DEBUG] [LOCAL ] V: Primary data saved (53753 records). [2025-10-13T22:11:24.798172] [INFO ] [MAIN ] V: Full history saved. [2025-10-13T22:11:24.798271] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. V took 43.8s. Estimated remaining: 22m 14s. Rate: 7.1 symbols/min [2025-10-13T22:11:24.964381] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:24.979924] [DEBUG] [LOCAL ] VCV: Loaded 13672 existing records from primary storage. [2025-10-13T22:11:24.980141] [INFO ] [MAIN ] VCV: Loaded 13672 existing records. [2025-10-13T22:11:25.159456] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:25.159749] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-13T22:11:25.159837] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-13T22:11:25.160104] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-13T22:11:25.160171] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-13T22:11:25.225332] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-13T22:11:25.512139] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:25.984592] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T22:11:26.017961] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-13T22:11:26.339161] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T22:11:26.735005] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T22:11:26.818010] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-13T22:11:27.476928] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T22:11:27.617983] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-13T22:11:28.246437] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T22:11:28.417966] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-13T22:11:29.052885] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T22:11:29.217997] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-13T22:11:30.017981] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-13T22:11:30.103819] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T22:11:30.817952] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-13T22:11:31.570789] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T22:11:31.617948] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-13T22:11:31.787912] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T22:11:32.417982] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-13T22:11:32.493865] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T22:11:33.048783] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T22:11:33.217955] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-13T22:11:34.017995] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-13T22:11:34.334580] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T22:11:34.503118] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T22:11:34.817918] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-13T22:11:35.511771] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T22:11:35.617923] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-13T22:11:36.273594] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T22:11:36.417958] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-13T22:11:36.977896] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T22:11:37.217971] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-13T22:11:38.017967] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-13T22:11:38.050227] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T22:11:38.817942] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-13T22:11:39.316051] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-13T22:11:39.617969] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-13T22:11:39.784323] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T22:11:40.408860] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T22:11:40.417890] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-13T22:11:41.217999] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-13T22:11:41.269972] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T22:11:42.017974] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-13T22:11:42.817971] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-13T22:11:43.002778] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T22:11:43.322100] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T22:11:43.324611] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T22:11:43.617968] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-13T22:11:44.417923] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-13T22:11:45.100852] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T22:11:45.102251] [INFO ] [REMOTE ] VCV: Full fetch complete (18495 records). [2025-10-13T22:11:45.102343] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-13T22:11:45.218048] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-13T22:11:45.446609] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T22:11:45.493179] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-13T22:11:45.511142] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-13T22:11:45.519994] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-13T22:11:45.520118] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-13T22:11:45.520604] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-13T22:11:45.565374] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-13T22:11:45.629740] [DEBUG] [LOCAL ] VCV: Trimmed 18495 records to 13590 (keeping 200 days of data) [2025-10-13T22:11:45.940183] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T22:11:46.020332] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-13T22:11:46.021947] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-13T22:11:46.023218] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-13T22:11:46.026226] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-13T22:11:46.027596] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-13T22:11:46.037192] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 53693 (keeping 200 days of data) [2025-10-13T22:11:46.093554] [DEBUG] [LOCAL ] VCV: Primary data saved (13590 records). [2025-10-13T22:11:46.103565] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-13T22:11:46.103739] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VCV took 21.3s. Estimated remaining: 22m 6s. Rate: 7.1 symbols/min [2025-10-13T22:11:46.321281] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:46.467429] [DEBUG] [LOCAL ] VEEV: Loaded 47874 existing records from primary storage. [2025-10-13T22:11:46.469627] [INFO ] [MAIN ] VEEV: Loaded 47874 existing records. [2025-10-13T22:11:46.664505] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:46.666138] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-13T22:11:46.666567] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-13T22:11:46.673316] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-13T22:11:46.674055] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-13T22:11:46.679920] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T22:11:46.819363] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-13T22:11:47.077208] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:47.174754] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-13T22:11:47.174912] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-13T22:11:47.174998] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VALE took 45.0s. Estimated remaining: 21m 57s. Rate: 7.1 symbols/min [2025-10-13T22:11:47.352803] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:47.368771] [DEBUG] [LOCAL ] VEL: Loaded 12608 existing records from primary storage. [2025-10-13T22:11:47.369024] [INFO ] [MAIN ] VEL: Loaded 12608 existing records. [2025-10-13T22:11:47.477933] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T22:11:47.505884] [INFO ] [REMOTE ] VATE: Full fetch complete (10534 records). [2025-10-13T22:11:47.531168] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-13T22:11:47.627688] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-13T22:11:47.645994] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:47.664743] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-13T22:11:47.678599] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-13T22:11:47.689635] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-13T22:11:47.690259] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-13T22:11:48.300354] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-13T22:11:48.300857] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-13T22:11:48.312279] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-13T22:11:48.328119] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-13T22:11:48.394925] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T22:11:48.395242] [DEBUG] [LOCAL ] VATE: Trimmed 10534 records to 5225 (keeping 200 days of data) [2025-10-13T22:11:48.393208] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:48.420386] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-13T22:11:48.429760] [DEBUG] [LOCAL ] VATE: Primary data saved (5225 records). [2025-10-13T22:11:48.429926] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-13T22:11:48.430026] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VATE took 28.9s. Estimated remaining: 21m 48s. Rate: 7.1 symbols/min [2025-10-13T22:11:48.608138] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:11:48.650368] [DEBUG] [LOCAL ] VET: Loaded 44718 existing records from primary storage. [2025-10-13T22:11:48.650746] [INFO ] [MAIN ] VET: Loaded 44718 existing records. [2025-10-13T22:11:48.852975] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:11:48.853217] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-13T22:11:48.853264] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-13T22:11:48.853596] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-13T22:11:48.853685] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-13T22:11:49.221464] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-13T22:11:49.221367] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:11:49.235558] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T22:11:49.837152] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T22:11:50.017962] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-13T22:11:50.601466] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T22:11:50.817956] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-13T22:11:51.617974] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-13T22:11:52.431072] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-13T22:11:52.434521] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T22:11:53.032798] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T22:11:53.217935] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-13T22:11:53.356851] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T22:11:53.998823] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T22:11:54.017914] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-13T22:11:54.817948] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-13T22:11:55.308421] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T22:11:55.557547] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T22:11:55.617899] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-13T22:11:56.274489] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T22:11:56.417934] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-13T22:11:57.212290] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T22:11:57.217908] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-13T22:11:58.017960] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-13T22:11:58.614120] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T22:11:58.818019] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-13T22:11:59.374265] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T22:11:59.474028] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T22:11:59.475823] [INFO ] [REMOTE ] VBF: Full fetch complete (10817 records). [2025-10-13T22:11:59.475889] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-13T22:11:59.623023] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-13T22:11:59.842224] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-13T22:11:59.842325] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-13T22:11:59.842625] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-13T22:11:59.842700] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-13T22:11:59.843265] [DEBUG] [LOCAL ] VBF: Trimmed 10817 records to 7121 (keeping 200 days of data) [2025-10-13T22:11:59.887727] [DEBUG] [LOCAL ] VBF: Primary data saved (7121 records). [2025-10-13T22:11:59.888049] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-13T22:11:59.888187] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VBF took 36.7s. Estimated remaining: 21m 40s. Rate: 7.1 symbols/min [2025-10-13T22:12:00.055848] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:00.110807] [DEBUG] [LOCAL ] VFC: Loaded 54387 existing records from primary storage. [2025-10-13T22:12:00.111125] [INFO ] [MAIN ] VFC: Loaded 54387 existing records. [2025-10-13T22:12:00.288811] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:00.288992] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-13T22:12:00.289038] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-13T22:12:00.289399] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-13T22:12:00.289437] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-13T22:12:00.431786] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-13T22:12:00.647288] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:01.217958] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-13T22:12:01.385344] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T22:12:01.552045] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T22:12:02.017962] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-13T22:12:02.817948] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-13T22:12:02.910131] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T22:12:03.372470] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T22:12:03.617978] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-13T22:12:03.771875] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T22:12:04.239933] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T22:12:04.417991] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-13T22:12:05.217925] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-13T22:12:05.993070] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T22:12:06.017893] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-13T22:12:06.817907] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-13T22:12:06.875440] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T22:12:07.615258] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T22:12:07.618118] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-13T22:12:07.720358] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T22:12:08.417935] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-13T22:12:09.217916] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-13T22:12:09.360390] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T22:12:09.985896] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T22:12:10.017899] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-13T22:12:10.817961] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-13T22:12:10.900557] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T22:12:11.355498] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T22:12:11.389462] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T22:12:11.617931] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-13T22:12:12.275001] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T22:12:12.417935] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-13T22:12:13.140890] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T22:12:13.142548] [INFO ] [REMOTE ] VEL: Full fetch complete (17092 records). [2025-10-13T22:12:13.142615] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-13T22:12:13.223116] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-13T22:12:13.506095] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-13T22:12:13.506185] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-13T22:12:13.506628] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-13T22:12:13.506714] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-13T22:12:13.507474] [DEBUG] [LOCAL ] VEL: Trimmed 17092 records to 12240 (keeping 200 days of data) [2025-10-13T22:12:13.582282] [DEBUG] [LOCAL ] VEL: Primary data saved (12240 records). [2025-10-13T22:12:13.582427] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-13T22:12:13.582507] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 26.4s. Estimated remaining: 21m 32s. Rate: 7.1 symbols/min [2025-10-13T22:12:13.748895] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:13.749105] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-13T22:12:13.749159] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-13T22:12:13.749266] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-13T22:12:13.749306] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-13T22:12:13.749346] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-13T22:12:13.749377] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-13T22:12:14.023109] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-13T22:12:14.092324] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:14.564169] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T22:12:14.817917] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-13T22:12:15.546148] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T22:12:15.617937] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-13T22:12:16.350702] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T22:12:16.417954] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-13T22:12:17.082455] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T22:12:17.218054] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-13T22:12:17.448591] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:12:17.449287] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-13T22:12:17.449384] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:12:17.449436] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-13T22:12:17.450414] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:12:17.450513] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-13T22:12:17.450740] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-13T22:12:17.450905] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-13T22:12:17.450964] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-13T22:12:17.451022] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 3.9s. Estimated remaining: 21m 23s. Rate: 7.1 symbols/min [2025-10-13T22:12:17.629158] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:17.637879] [DEBUG] [LOCAL ] VGI: Loaded 5267 existing records from primary storage. [2025-10-13T22:12:17.638128] [INFO ] [MAIN ] VGI: Loaded 5267 existing records. [2025-10-13T22:12:17.831811] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:17.832112] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-13T22:12:17.832161] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-13T22:12:17.832425] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-13T22:12:17.832482] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-13T22:12:18.027333] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-13T22:12:18.143003] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:12:18.257629] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:18.817942] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-13T22:12:19.366066] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T22:12:19.617932] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-13T22:12:19.898571] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T22:12:20.306802] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T22:12:20.417952] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-13T22:12:21.217990] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-13T22:12:21.803357] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T22:12:22.018010] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-13T22:12:22.125202] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T22:12:22.818004] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-13T22:12:23.196783] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T22:12:23.201537] [INFO ] [REMOTE ] VET: Full fetch complete (64565 records). [2025-10-13T22:12:23.201687] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-13T22:12:23.581334] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-13T22:12:23.581420] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-13T22:12:23.582549] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-13T22:12:23.582629] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-13T22:12:23.584056] [DEBUG] [LOCAL ] VET: Trimmed 64565 records to 44077 (keeping 200 days of data) [2025-10-13T22:12:23.632483] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-13T22:12:23.852206] [DEBUG] [LOCAL ] VET: Primary data saved (44077 records). [2025-10-13T22:12:23.852933] [INFO ] [MAIN ] VET: Full history saved. [2025-10-13T22:12:23.853028] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 35.4s. Estimated remaining: 21m 15s. Rate: 7.1 symbols/min [2025-10-13T22:12:24.019313] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:24.041787] [DEBUG] [LOCAL ] VGM: Loaded 18737 existing records from primary storage. [2025-10-13T22:12:24.042061] [INFO ] [MAIN ] VGM: Loaded 18737 existing records. [2025-10-13T22:12:24.227098] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:24.227300] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-13T22:12:24.227365] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-13T22:12:24.227616] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-13T22:12:24.227709] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-13T22:12:24.333637] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T22:12:24.423608] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-13T22:12:24.604426] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:24.698529] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T22:12:25.217954] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-13T22:12:26.017917] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-13T22:12:26.088249] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T22:12:26.502342] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T22:12:26.541712] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T22:12:26.817932] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-13T22:12:27.201778] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T22:12:27.617943] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-13T22:12:28.417932] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-13T22:12:29.194552] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T22:12:29.217908] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-13T22:12:30.017929] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-13T22:12:30.171511] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T22:12:30.370015] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T22:12:30.817935] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-13T22:12:31.320206] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T22:12:31.617943] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-13T22:12:32.338423] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:12:32.357344] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T22:12:32.417900] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-13T22:12:33.217948] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-13T22:12:33.498796] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T22:12:33.633403] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T22:12:34.017941] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-13T22:12:34.725098] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T22:12:34.817910] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-13T22:12:35.618625] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T22:12:35.617916] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-13T22:12:36.417931] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-13T22:12:36.929298] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T22:12:36.930332] [INFO ] [REMOTE ] VGI: Full fetch complete (7660 records). [2025-10-13T22:12:36.930403] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-13T22:12:37.223045] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-13T22:12:37.280746] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-13T22:12:37.280842] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-13T22:12:37.281042] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-13T22:12:37.281079] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-13T22:12:37.281460] [DEBUG] [LOCAL ] VGI: Trimmed 7660 records to 5217 (keeping 200 days of data) [2025-10-13T22:12:37.312992] [DEBUG] [LOCAL ] VGI: Primary data saved (5217 records). [2025-10-13T22:12:37.313105] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-13T22:12:37.313186] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VGI took 19.9s. Estimated remaining: 21m 7s. Rate: 7.1 symbols/min [2025-10-13T22:12:37.480081] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:37.485473] [DEBUG] [LOCAL ] VHI: Loaded 2774 existing records from primary storage. [2025-10-13T22:12:37.485665] [INFO ] [MAIN ] VHI: Loaded 2774 existing records. [2025-10-13T22:12:37.666322] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:37.666666] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-13T22:12:37.666735] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-13T22:12:37.666982] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-13T22:12:37.667048] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-13T22:12:37.923373] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-13T22:12:38.023002] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-13T22:12:38.064598] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T22:12:38.084050] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:38.817990] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-13T22:12:39.617912] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-13T22:12:39.756917] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:12:39.823156] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T22:12:40.264109] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T22:12:40.417954] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-13T22:12:41.038809] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T22:12:41.217914] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-13T22:12:41.786228] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T22:12:42.017917] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-13T22:12:42.818052] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-13T22:12:42.872230] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T22:12:43.617973] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-13T22:12:44.301214] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T22:12:44.301845] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T22:12:44.308161] [INFO ] [REMOTE ] VEEV: Full fetch complete (68243 records). [2025-10-13T22:12:44.308254] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-13T22:12:44.423093] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-13T22:12:44.692149] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-13T22:12:44.692226] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-13T22:12:44.693290] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-13T22:12:44.693351] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-13T22:12:44.694696] [DEBUG] [LOCAL ] VEEV: Trimmed 68243 records to 47238 (keeping 200 days of data) [2025-10-13T22:12:45.006294] [DEBUG] [LOCAL ] VEEV: Primary data saved (47238 records). [2025-10-13T22:12:45.006436] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-13T22:12:45.006521] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VEEV took 58.9s. Estimated remaining: 20m 58s. Rate: 7.1 symbols/min [2025-10-13T22:12:45.172060] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:45.172264] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-13T22:12:45.172302] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-13T22:12:45.172416] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-13T22:12:45.172456] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-13T22:12:45.172499] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-13T22:12:45.172531] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-13T22:12:45.225577] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-13T22:12:45.522964] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:45.895862] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T22:12:45.975878] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T22:12:45.981497] [INFO ] [REMOTE ] VFC: Full fetch complete (77589 records). [2025-10-13T22:12:45.981626] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-13T22:12:46.023178] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-13T22:12:46.318706] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:12:46.352486] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-13T22:12:46.352612] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:12:46.376499] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-13T22:12:46.372578] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-13T22:12:46.376841] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-13T22:12:46.376746] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:12:46.378162] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-13T22:12:46.378269] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-13T22:12:46.378342] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-13T22:12:46.378739] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-13T22:12:46.378795] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-13T22:12:46.378838] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-13T22:12:46.378890] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 1.4s. Estimated remaining: 20m 49s. Rate: 7.1 symbols/min [2025-10-13T22:12:46.480319] [DEBUG] [LOCAL ] VFC: Trimmed 77589 records to 53606 (keeping 200 days of data) [2025-10-13T22:12:46.637493] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:46.800373] [DEBUG] [LOCAL ] VICI: Loaded 54430 existing records from primary storage. [2025-10-13T22:12:46.802824] [INFO ] [MAIN ] VICI: Loaded 54430 existing records. [2025-10-13T22:12:46.823117] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-13T22:12:46.996136] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:46.997994] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-13T22:12:46.998617] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-13T22:12:47.000238] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-13T22:12:47.000317] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-13T22:12:47.290972] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T22:12:47.382336] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:47.475571] [DEBUG] [LOCAL ] VFC: Primary data saved (53606 records). [2025-10-13T22:12:47.475840] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-13T22:12:47.475972] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VFC took 47.6s. Estimated remaining: 20m 40s. Rate: 7.1 symbols/min [2025-10-13T22:12:47.632032] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-13T22:12:47.670963] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:47.731261] [DEBUG] [LOCAL ] VIK: Loaded 53216 existing records from primary storage. [2025-10-13T22:12:47.731805] [INFO ] [MAIN ] VIK: Loaded 53216 existing records. [2025-10-13T22:12:47.922423] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:47.922788] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-13T22:12:47.922849] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-13T22:12:47.923384] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-13T22:12:47.923424] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-13T22:12:48.292971] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:48.417925] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-13T22:12:48.520305] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T22:12:49.217950] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-13T22:12:49.768537] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-13T22:12:50.017961] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-13T22:12:50.093508] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T22:12:50.817998] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-13T22:12:51.397159] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T22:12:51.617933] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-13T22:12:51.795049] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T22:12:52.022331] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T22:12:52.417920] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-13T22:12:52.950240] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T22:12:53.217913] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-13T22:12:53.689229] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T22:12:53.690170] [INFO ] [REMOTE ] VHI: Full fetch complete (4372 records). [2025-10-13T22:12:53.690236] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-13T22:12:54.029885] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-13T22:12:54.043681] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-13T22:12:54.044464] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-13T22:12:54.044679] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-13T22:12:54.044740] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-13T22:12:54.045122] [DEBUG] [LOCAL ] VHI: Trimmed 4372 records to 2756 (keeping 200 days of data) [2025-10-13T22:12:54.062018] [DEBUG] [LOCAL ] VHI: Primary data saved (2756 records). [2025-10-13T22:12:54.062095] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-13T22:12:54.062167] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VHI took 16.7s. Estimated remaining: 20m 32s. Rate: 7.1 symbols/min [2025-10-13T22:12:54.231428] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:12:54.285060] [DEBUG] [LOCAL ] VIPS: Loaded 52000 existing records from primary storage. [2025-10-13T22:12:54.285414] [INFO ] [MAIN ] VIPS: Loaded 52000 existing records. [2025-10-13T22:12:54.472181] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:12:54.472420] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-13T22:12:54.472467] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-13T22:12:54.472729] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-13T22:12:54.472786] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-13T22:12:54.825127] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-13T22:12:54.847516] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:12:54.926968] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T22:12:55.617930] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-13T22:12:56.417982] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-13T22:12:56.681544] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T22:12:57.217927] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-13T22:12:57.482108] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T22:12:57.819599] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T22:12:58.017936] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-13T22:12:58.775505] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T22:12:58.817905] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-13T22:12:58.924316] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T22:12:59.617967] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-13T22:13:00.232792] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T22:13:00.417900] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-13T22:13:00.624810] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T22:13:01.217956] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-13T22:13:01.844842] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T22:13:02.017932] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-13T22:13:02.817963] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-13T22:13:03.057878] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T22:13:03.440516] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T22:13:03.617935] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-13T22:13:04.284003] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T22:13:04.417945] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-13T22:13:05.217932] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-13T22:13:05.387778] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T22:13:05.950448] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T22:13:06.017902] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-13T22:13:06.817968] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-13T22:13:07.008895] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T22:13:07.447535] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T22:13:07.617920] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-13T22:13:07.710600] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T22:13:07.713844] [INFO ] [REMOTE ] VGM: Full fetch complete (25985 records). [2025-10-13T22:13:07.713943] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-13T22:13:08.121153] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-13T22:13:08.121228] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-13T22:13:08.121804] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-13T22:13:08.121864] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-13T22:13:08.122529] [DEBUG] [LOCAL ] VGM: Trimmed 25985 records to 18509 (keeping 200 days of data) [2025-10-13T22:13:08.228273] [DEBUG] [LOCAL ] VGM: Primary data saved (18509 records). [2025-10-13T22:13:08.228404] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-13T22:13:08.228481] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VGM took 44.4s. Estimated remaining: 20m 24s. Rate: 7.1 symbols/min [2025-10-13T22:13:08.391779] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:08.420912] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-13T22:13:08.441024] [DEBUG] [LOCAL ] VIRT: Loaded 47459 existing records from primary storage. [2025-10-13T22:13:08.441353] [INFO ] [MAIN ] VIRT: Loaded 47459 existing records. [2025-10-13T22:13:08.613929] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:08.614181] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-13T22:13:08.614252] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-13T22:13:08.614695] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-13T22:13:08.614775] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-13T22:13:08.965043] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:09.097868] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T22:13:09.217936] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-13T22:13:09.818455] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:13:10.017903] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-13T22:13:10.817934] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-13T22:13:11.207275] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T22:13:11.627684] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-13T22:13:11.652104] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T22:13:11.999311] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T22:13:12.417929] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-13T22:13:13.153844] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T22:13:13.217903] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-13T22:13:14.017925] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-13T22:13:14.200392] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T22:13:14.817945] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-13T22:13:14.947791] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T22:13:15.617914] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-13T22:13:15.686985] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T22:13:16.428931] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-13T22:13:16.434286] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T22:13:17.218059] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-13T22:13:17.421368] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T22:13:18.017904] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-13T22:13:18.338060] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T22:13:18.588457] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T22:13:18.817929] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-13T22:13:19.474734] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:13:19.617930] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-13T22:13:20.417912] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-13T22:13:20.883528] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T22:13:21.078051] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T22:13:21.085224] [INFO ] [REMOTE ] VIK: Full fetch complete (75874 records). [2025-10-13T22:13:21.085364] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-13T22:13:21.226602] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-13T22:13:21.477083] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-13T22:13:21.477164] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-13T22:13:21.478342] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-13T22:13:21.478406] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-13T22:13:21.480265] [DEBUG] [LOCAL ] VIK: Trimmed 75874 records to 52445 (keeping 200 days of data) [2025-10-13T22:13:21.618354] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T22:13:21.627128] [INFO ] [REMOTE ] VIPS: Full fetch complete (74607 records). [2025-10-13T22:13:21.673604] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-13T22:13:22.021671] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-13T22:13:22.224217] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-13T22:13:22.225533] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-13T22:13:22.228055] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-13T22:13:22.228139] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-13T22:13:22.232313] [DEBUG] [LOCAL ] VIPS: Trimmed 74607 records to 51246 (keeping 200 days of data) [2025-10-13T22:13:22.295797] [DEBUG] [LOCAL ] VIK: Primary data saved (52445 records). [2025-10-13T22:13:22.321114] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-13T22:13:22.321588] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 34.8s. Estimated remaining: 20m 16s. Rate: 7.1 symbols/min [2025-10-13T22:13:22.505086] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:22.650737] [DEBUG] [LOCAL ] VIST: Loaded 46928 existing records from primary storage. [2025-10-13T22:13:22.652459] [INFO ] [MAIN ] VIST: Loaded 46928 existing records. [2025-10-13T22:13:22.828812] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T22:13:22.884110] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-13T22:13:22.881064] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:22.889454] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-13T22:13:22.893690] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-13T22:13:22.896213] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-13T22:13:22.900130] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-13T22:13:23.130678] [DEBUG] [LOCAL ] VIPS: Primary data saved (51246 records). [2025-10-13T22:13:23.149116] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-13T22:13:23.157441] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIPS took 29.1s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-13T22:13:23.490263] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:23.506326] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:23.553111] [DEBUG] [LOCAL ] VIV: Loaded 45510 existing records from primary storage. [2025-10-13T22:13:23.553405] [INFO ] [MAIN ] VIV: Loaded 45510 existing records. [2025-10-13T22:13:23.626364] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-13T22:13:23.734333] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:23.734634] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-13T22:13:23.734722] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-13T22:13:23.735139] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-13T22:13:23.735196] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-13T22:13:24.115125] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:24.144810] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-13T22:13:24.417895] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-13T22:13:24.534034] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:13:25.217947] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-13T22:13:25.355121] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T22:13:25.568864] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T22:13:26.017926] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-13T22:13:26.751354] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T22:13:26.817900] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-13T22:13:27.617935] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-13T22:13:27.906199] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T22:13:28.421932] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-13T22:13:28.427188] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T22:13:29.217955] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-13T22:13:29.384009] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T22:13:29.564522] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T22:13:29.570126] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-13T22:13:29.570236] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-13T22:13:30.002735] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-13T22:13:30.002496] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T22:13:30.003015] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-13T22:13:30.013356] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-13T22:13:30.013483] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-13T22:13:30.014983] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 53653 (keeping 200 days of data) [2025-10-13T22:13:30.068848] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-13T22:13:30.352184] [DEBUG] [LOCAL ] VICI: Primary data saved (53653 records). [2025-10-13T22:13:30.352325] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-13T22:13:30.352403] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VICI took 44.0s. Estimated remaining: 19m 58s. Rate: 7.1 symbols/min [2025-10-13T22:13:30.516385] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:30.535003] [DEBUG] [LOCAL ] VKQ: Loaded 17616 existing records from primary storage. [2025-10-13T22:13:30.535230] [INFO ] [MAIN ] VKQ: Loaded 17616 existing records. [2025-10-13T22:13:30.715212] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:30.715405] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-13T22:13:30.715450] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-13T22:13:30.715779] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-13T22:13:30.715836] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-13T22:13:30.823037] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-13T22:13:31.065917] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:31.600215] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T22:13:31.617893] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-13T22:13:32.159856] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T22:13:32.417924] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-13T22:13:32.759089] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T22:13:33.184772] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T22:13:33.217922] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-13T22:13:34.017956] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-13T22:13:34.121681] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T22:13:34.818159] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-13T22:13:35.630245] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-13T22:13:35.639346] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T22:13:36.181474] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T22:13:36.309400] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T22:13:36.417903] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-13T22:13:37.217917] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-13T22:13:38.017974] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-13T22:13:38.066908] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:13:38.110386] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T22:13:38.817937] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-13T22:13:39.626675] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-13T22:13:39.652094] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T22:13:39.849723] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T22:13:40.417968] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-13T22:13:41.134626] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T22:13:41.217941] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-13T22:13:41.562027] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T22:13:42.017925] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-13T22:13:42.818168] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-13T22:13:42.818096] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T22:13:43.610113] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T22:13:43.619394] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-13T22:13:44.123781] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T22:13:44.417906] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-13T22:13:44.556390] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T22:13:45.217946] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-13T22:13:45.821805] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T22:13:45.846282] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T22:13:46.017935] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-13T22:13:46.817964] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-13T22:13:47.164079] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T22:13:47.168873] [INFO ] [REMOTE ] VIRT: Full fetch complete (67355 records). [2025-10-13T22:13:47.168968] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-13T22:13:47.562302] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-13T22:13:47.562386] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-13T22:13:47.563507] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-13T22:13:47.563574] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-13T22:13:47.565111] [DEBUG] [LOCAL ] VIRT: Trimmed 67355 records to 46744 (keeping 200 days of data) [2025-10-13T22:13:47.618149] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-13T22:13:47.864825] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T22:13:47.881900] [DEBUG] [LOCAL ] VIRT: Primary data saved (46744 records). [2025-10-13T22:13:47.882079] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-13T22:13:47.882174] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 39.7s. Estimated remaining: 19m 50s. Rate: 7.1 symbols/min [2025-10-13T22:13:48.051315] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:48.081894] [DEBUG] [LOCAL ] VLN: Loaded 30383 existing records from primary storage. [2025-10-13T22:13:48.082188] [INFO ] [MAIN ] VLN: Loaded 30383 existing records. [2025-10-13T22:13:48.257245] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:48.257486] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-13T22:13:48.257538] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-13T22:13:48.257813] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-13T22:13:48.257897] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-13T22:13:48.426478] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-13T22:13:48.605903] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:49.217719] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T22:13:49.225756] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-13T22:13:49.394000] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T22:13:50.017918] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-13T22:13:50.558441] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T22:13:50.817986] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-13T22:13:51.617937] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-13T22:13:51.835228] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T22:13:51.886997] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T22:13:52.409975] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T22:13:52.417891] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-13T22:13:53.217934] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-13T22:13:53.849191] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T22:13:54.000860] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T22:13:54.017954] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-13T22:13:54.817907] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-13T22:13:54.832763] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T22:13:55.617914] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-13T22:13:55.689225] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T22:13:55.691361] [INFO ] [REMOTE ] VKQ: Full fetch complete (24400 records). [2025-10-13T22:13:55.691427] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-13T22:13:56.048602] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-13T22:13:56.048752] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-13T22:13:56.049272] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-13T22:13:56.049313] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-13T22:13:56.049928] [DEBUG] [LOCAL ] VKQ: Trimmed 24400 records to 17504 (keeping 200 days of data) [2025-10-13T22:13:56.151060] [DEBUG] [LOCAL ] VKQ: Primary data saved (17504 records). [2025-10-13T22:13:56.151188] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-13T22:13:56.151263] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VKQ took 25.8s. Estimated remaining: 19m 42s. Rate: 7.1 symbols/min [2025-10-13T22:13:56.314374] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:56.368781] [DEBUG] [LOCAL ] VLO: Loaded 53837 existing records from primary storage. [2025-10-13T22:13:56.369088] [INFO ] [MAIN ] VLO: Loaded 53837 existing records. [2025-10-13T22:13:56.429697] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-13T22:13:56.545615] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:56.545917] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-13T22:13:56.545998] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-13T22:13:56.546515] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-13T22:13:56.546569] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-13T22:13:56.884514] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:13:57.120184] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T22:13:57.217906] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-13T22:13:58.017997] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-13T22:13:58.082097] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T22:13:58.680474] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T22:13:58.685335] [INFO ] [REMOTE ] VIST: Full fetch complete (66830 records). [2025-10-13T22:13:58.685436] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-13T22:13:58.831947] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-13T22:13:59.085085] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-13T22:13:59.085167] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-13T22:13:59.086221] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-13T22:13:59.086283] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-13T22:13:59.087539] [DEBUG] [LOCAL ] VIST: Trimmed 66830 records to 46429 (keeping 200 days of data) [2025-10-13T22:13:59.356402] [DEBUG] [LOCAL ] VIST: Primary data saved (46429 records). [2025-10-13T22:13:59.356535] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-13T22:13:59.356615] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 37.0s. Estimated remaining: 19m 33s. Rate: 7.1 symbols/min [2025-10-13T22:13:59.541347] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:13:59.580849] [DEBUG] [LOCAL ] VLRS: Loaded 40669 existing records from primary storage. [2025-10-13T22:13:59.581156] [INFO ] [MAIN ] VLRS: Loaded 40669 existing records. [2025-10-13T22:13:59.624296] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-13T22:13:59.764995] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:13:59.765285] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-13T22:13:59.765336] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-13T22:13:59.765775] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-13T22:13:59.765833] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-13T22:14:00.196332] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:14:00.226322] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T22:14:00.417943] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-13T22:14:00.564314] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T22:14:01.013197] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T22:14:01.217940] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-13T22:14:02.017926] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-13T22:14:02.140495] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T22:14:02.758309] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T22:14:02.817966] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-13T22:14:03.367512] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T22:14:03.617908] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-13T22:14:04.418342] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-13T22:14:04.421072] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T22:14:04.451983] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T22:14:05.217928] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-13T22:14:05.558935] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T22:14:06.017944] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-13T22:14:06.122354] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T22:14:06.817931] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-13T22:14:07.382550] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T22:14:07.387848] [INFO ] [REMOTE ] VIV: Full fetch complete (64385 records). [2025-10-13T22:14:07.388042] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-13T22:14:07.623073] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-13T22:14:07.817800] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-13T22:14:07.817919] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-13T22:14:07.819134] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-13T22:14:07.819197] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-13T22:14:07.820490] [DEBUG] [LOCAL ] VIV: Trimmed 64385 records to 44909 (keeping 200 days of data) [2025-10-13T22:14:08.071697] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T22:14:08.126945] [DEBUG] [LOCAL ] VIV: Primary data saved (44909 records). [2025-10-13T22:14:08.127089] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-13T22:14:08.127170] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VIV took 44.9s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-13T22:14:08.295864] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:14:08.302922] [DEBUG] [LOCAL ] VLT: Loaded 4574 existing records from primary storage. [2025-10-13T22:14:08.303089] [INFO ] [MAIN ] VLT: Loaded 4574 existing records. [2025-10-13T22:14:08.423122] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-13T22:14:08.484162] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:14:08.484382] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-13T22:14:08.484427] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-13T22:14:08.484673] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-13T22:14:08.484730] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-13T22:14:08.837221] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:14:08.918081] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T22:14:09.217949] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-13T22:14:10.017951] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-13T22:14:10.258104] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T22:14:10.452798] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T22:14:10.817945] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-13T22:14:11.617985] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-13T22:14:11.826777] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T22:14:12.007503] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T22:14:12.417931] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-13T22:14:13.217941] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-13T22:14:13.578623] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T22:14:13.700763] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-13T22:14:14.017979] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-13T22:14:14.054924] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T22:14:14.638250] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T22:14:14.817958] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-13T22:14:15.456843] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T22:14:15.617923] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-13T22:14:16.096905] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T22:14:16.417916] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-13T22:14:17.157621] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T22:14:17.217964] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-13T22:14:17.730861] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T22:14:18.017941] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-13T22:14:18.817922] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-13T22:14:19.371559] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T22:14:19.377529] [INFO ] [REMOTE ] VLN: Full fetch complete (43514 records). [2025-10-13T22:14:19.377686] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-13T22:14:19.481799] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T22:14:19.624738] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-13T22:14:19.782163] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-13T22:14:19.782238] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-13T22:14:19.783131] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-13T22:14:19.783191] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-13T22:14:19.784116] [DEBUG] [LOCAL ] VLN: Trimmed 43514 records to 30394 (keeping 200 days of data) [2025-10-13T22:14:19.950774] [DEBUG] [LOCAL ] VLN: Primary data saved (30394 records). [2025-10-13T22:14:19.950903] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-13T22:14:19.950992] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 32.1s. Estimated remaining: 19m 16s. Rate: 7.1 symbols/min [2025-10-13T22:14:20.117779] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:14:20.167297] [DEBUG] [LOCAL ] VLTO: Loaded 46814 existing records from primary storage. [2025-10-13T22:14:20.167612] [INFO ] [MAIN ] VLTO: Loaded 46814 existing records. [2025-10-13T22:14:20.365229] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:14:20.365437] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-13T22:14:20.365482] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-13T22:14:20.365988] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-13T22:14:20.366044] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-13T22:14:20.423142] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-13T22:14:20.742904] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:14:21.026534] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:14:21.217993] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-13T22:14:21.963594] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T22:14:22.017905] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-13T22:14:22.556081] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T22:14:22.622485] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T22:14:22.817999] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-13T22:14:23.617937] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-13T22:14:24.417969] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-13T22:14:24.641095] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T22:14:25.012885] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T22:14:25.144036] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T22:14:25.217976] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-13T22:14:25.680898] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T22:14:26.017962] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-13T22:14:26.817952] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-13T22:14:27.352292] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T22:14:27.617928] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-13T22:14:28.134016] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T22:14:28.134982] [INFO ] [REMOTE ] VLT: Full fetch complete (7495 records). [2025-10-13T22:14:28.135048] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-13T22:14:28.424180] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-13T22:14:28.510085] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-13T22:14:28.510352] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-13T22:14:28.510724] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-13T22:14:28.510831] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-13T22:14:28.511536] [DEBUG] [LOCAL ] VLT: Trimmed 7495 records to 4440 (keeping 200 days of data) [2025-10-13T22:14:28.569343] [DEBUG] [LOCAL ] VLT: Primary data saved (4440 records). [2025-10-13T22:14:28.569892] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-13T22:14:28.571037] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T22:14:28.571211] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLT took 20.4s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-13T22:14:28.750624] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:14:28.793804] [DEBUG] [LOCAL ] VMC: Loaded 43347 existing records from primary storage. [2025-10-13T22:14:28.794165] [INFO ] [MAIN ] VMC: Loaded 43347 existing records. [2025-10-13T22:14:28.965597] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:14:28.965865] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-13T22:14:28.965911] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-13T22:14:28.966315] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-13T22:14:28.966386] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-13T22:14:29.225501] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-13T22:14:29.315365] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:14:29.804558] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T22:14:30.017938] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-13T22:14:30.817915] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-13T22:14:31.009500] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T22:14:31.494264] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T22:14:31.617923] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-13T22:14:32.102433] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T22:14:32.417908] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-13T22:14:33.217913] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-13T22:14:33.313393] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T22:14:33.648808] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T22:14:34.017952] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-13T22:14:34.760508] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T22:14:34.817942] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-13T22:14:35.620004] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-13T22:14:35.625493] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T22:14:36.417906] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-13T22:14:36.510364] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T22:14:37.020962] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T22:14:37.217933] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-13T22:14:37.695843] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T22:14:37.701104] [INFO ] [REMOTE ] VLO: Full fetch complete (76846 records). [2025-10-13T22:14:37.701215] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-13T22:14:37.869777] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T22:14:38.022522] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-13T22:14:38.116859] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-13T22:14:38.116941] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-13T22:14:38.120448] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-13T22:14:38.120536] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-13T22:14:38.122106] [DEBUG] [LOCAL ] VLO: Trimmed 76846 records to 53046 (keeping 200 days of data) [2025-10-13T22:14:38.459700] [DEBUG] [LOCAL ] VLO: Primary data saved (53046 records). [2025-10-13T22:14:38.459927] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-13T22:14:38.460039] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 42.3s. Estimated remaining: 18m 60s. Rate: 7.1 symbols/min [2025-10-13T22:14:38.634114] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:14:38.653688] [DEBUG] [LOCAL ] VMI: Loaded 15456 existing records from primary storage. [2025-10-13T22:14:38.654020] [INFO ] [MAIN ] VMI: Loaded 15456 existing records. [2025-10-13T22:14:38.821614] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-13T22:14:38.852458] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:14:38.852988] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-13T22:14:38.853046] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-13T22:14:38.853326] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-13T22:14:38.853384] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-13T22:14:39.213030] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:14:39.378724] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T22:14:39.617909] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-13T22:14:40.212886] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T22:14:40.417916] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-13T22:14:40.635550] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T22:14:40.639414] [INFO ] [REMOTE ] VLRS: Full fetch complete (58317 records). [2025-10-13T22:14:40.639500] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-13T22:14:41.031761] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-13T22:14:41.031843] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-13T22:14:41.032998] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-13T22:14:41.033063] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-13T22:14:41.034241] [DEBUG] [LOCAL ] VLRS: Trimmed 58317 records to 39975 (keeping 200 days of data) [2025-10-13T22:14:41.226856] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-13T22:14:41.264295] [DEBUG] [LOCAL ] VLRS: Primary data saved (39975 records). [2025-10-13T22:14:41.273000] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-13T22:14:41.272917] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T22:14:41.273137] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLRS took 41.9s. Estimated remaining: 18m 51s. Rate: 7.1 symbols/min [2025-10-13T22:14:42.017969] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-13T22:14:42.817905] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-13T22:14:42.940038] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T22:14:42.981632] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T22:14:43.617993] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-13T22:14:44.365447] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T22:14:44.411254] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T22:14:44.417877] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-13T22:14:45.217971] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-13T22:14:45.477962] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T22:14:46.017945] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-13T22:14:46.820612] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-13T22:14:46.823409] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T22:14:47.617738] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T22:14:47.617890] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-13T22:14:47.864684] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T22:14:48.417981] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-13T22:14:49.059023] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T22:14:49.085108] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T22:14:49.217956] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-13T22:14:50.017993] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-13T22:14:50.554847] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T22:14:50.817897] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-13T22:14:51.117898] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T22:14:51.617940] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-13T22:14:52.424387] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-13T22:14:52.441208] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T22:14:52.572313] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T22:14:53.217963] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-13T22:14:54.017936] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-13T22:14:54.169298] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T22:14:54.357349] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T22:14:54.817893] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-13T22:14:54.887260] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T22:14:55.617916] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-13T22:14:56.362484] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T22:14:56.417919] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-13T22:14:56.657220] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T22:14:56.788499] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-13T22:14:56.792430] [INFO ] [REMOTE ] VMC: Full fetch complete (62100 records). [2025-10-13T22:14:56.792545] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-13T22:14:57.178201] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-13T22:14:57.178292] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-13T22:14:57.179381] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-13T22:14:57.179442] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-13T22:14:57.180595] [DEBUG] [LOCAL ] VMC: Trimmed 62100 records to 42665 (keeping 200 days of data) [2025-10-13T22:14:57.235761] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-13T22:14:57.462623] [DEBUG] [LOCAL ] VMC: Primary data saved (42665 records). [2025-10-13T22:14:57.462781] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-13T22:14:57.462866] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VMC took 28.9s. Estimated remaining: 18m 43s. Rate: 7.1 symbols/min [2025-10-13T22:14:57.614165] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T22:14:57.619033] [INFO ] [REMOTE ] VLTO: Full fetch complete (67006 records). [2025-10-13T22:14:57.619132] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-13T22:14:58.009900] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-13T22:14:58.010023] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-13T22:14:58.011561] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-13T22:14:58.011660] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-13T22:14:58.013574] [DEBUG] [LOCAL ] VLTO: Trimmed 67006 records to 46167 (keeping 200 days of data) [2025-10-13T22:14:58.069190] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-13T22:14:58.336859] [DEBUG] [LOCAL ] VLTO: Primary data saved (46167 records). [2025-10-13T22:14:58.337099] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-13T22:14:58.337221] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VLTO took 38.4s. Estimated remaining: 18m 34s. Rate: 7.1 symbols/min [2025-10-13T22:14:58.878477] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T22:14:58.880448] [INFO ] [REMOTE ] VMI: Full fetch complete (21048 records). [2025-10-13T22:14:58.880526] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-13T22:14:59.265272] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-13T22:14:59.265347] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-13T22:14:59.265819] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-13T22:14:59.265879] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-13T22:14:59.266414] [DEBUG] [LOCAL ] VMI: Trimmed 21048 records to 15102 (keeping 200 days of data) [2025-10-13T22:14:59.363261] [DEBUG] [LOCAL ] VMI: Primary data saved (15102 records). [2025-10-13T22:14:59.363393] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-13T22:14:59.363471] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMI took 20.9s. Estimated remaining: 18m 25s. Rate: 7.1 symbols/min [2025-10-13T22:15:00.010934] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:00.033575] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:00.059566] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:00.085253] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:00.096913] [DEBUG] [LOCAL ] VNCE: Loaded 8751 existing records from primary storage. [2025-10-13T22:15:00.097179] [INFO ] [MAIN ] VNCE: Loaded 8751 existing records. [2025-10-13T22:15:00.249886] [DEBUG] [LOCAL ] VMO: Loaded 21176 existing records from primary storage. [2025-10-13T22:15:00.269863] [INFO ] [MAIN ] VMO: Loaded 21176 existing records. [2025-10-13T22:15:00.400405] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:00.413811] [DEBUG] [LOCAL ] VNT: Loaded 44351 existing records from primary storage. [2025-10-13T22:15:00.458869] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-13T22:15:00.475294] [INFO ] [MAIN ] VNT: Loaded 44351 existing records. [2025-10-13T22:15:00.494831] [DEBUG] [LOCAL ] VNO: Loaded 49551 existing records from primary storage. [2025-10-13T22:15:00.510690] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-13T22:15:00.522217] [INFO ] [MAIN ] VNO: Loaded 49551 existing records. [2025-10-13T22:15:00.585858] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-13T22:15:00.643526] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-13T22:15:00.775037] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:00.810287] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-13T22:15:00.843114] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-13T22:15:00.915739] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-13T22:15:00.916015] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-13T22:15:01.133319] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:01.194591] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-13T22:15:01.212051] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-13T22:15:01.211868] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:01.228397] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-13T22:15:01.233766] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-13T22:15:01.291907] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-13T22:15:01.331399] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-13T22:15:01.509216] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-13T22:15:01.555613] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-13T22:15:02.180693] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:02.234519] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-13T22:15:02.539053] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:02.586921] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-13T22:15:02.680186] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:02.697999] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-13T22:15:02.779219] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:02.779578] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-13T22:15:03.450997] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T22:15:03.455206] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-13T22:15:03.696777] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T22:15:03.702088] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-13T22:15:04.125675] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T22:15:04.141344] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-13T22:15:04.326911] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T22:15:04.417886] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-13T22:15:04.528950] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T22:15:04.654899] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T22:15:05.217937] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-13T22:15:05.590411] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T22:15:05.947178] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T22:15:06.017917] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-13T22:15:06.208595] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T22:15:06.817926] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-13T22:15:07.270242] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T22:15:07.617966] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-13T22:15:07.766811] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T22:15:08.417918] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-13T22:15:08.474309] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T22:15:09.218016] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-13T22:15:09.832600] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T22:15:09.968293] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:15:10.017924] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-13T22:15:10.817928] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-13T22:15:11.617915] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-13T22:15:11.708308] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T22:15:11.762444] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T22:15:12.417919] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-13T22:15:13.166489] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T22:15:13.217891] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-13T22:15:13.477396] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T22:15:14.018019] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-13T22:15:14.817920] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-13T22:15:14.996929] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T22:15:15.400246] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T22:15:15.617998] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-13T22:15:16.151065] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T22:15:16.418023] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-13T22:15:17.179900] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T22:15:17.222999] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-13T22:15:17.234454] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T22:15:17.758582] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T22:15:18.017966] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-13T22:15:18.817933] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-13T22:15:19.218484] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T22:15:19.617941] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-13T22:15:19.899709] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T22:15:20.417930] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-13T22:15:21.113605] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T22:15:21.217958] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-13T22:15:21.866276] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T22:15:22.009530] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T22:15:22.019105] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-13T22:15:22.618779] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T22:15:22.817949] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-13T22:15:23.617930] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-13T22:15:24.389774] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T22:15:24.417926] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-13T22:15:24.513909] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T22:15:25.217904] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-13T22:15:25.793409] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T22:15:26.017925] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-13T22:15:26.817919] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-13T22:15:26.883149] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T22:15:27.366332] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T22:15:27.406681] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T22:15:27.409155] [INFO ] [REMOTE ] VMO: Full fetch complete (31105 records). [2025-10-13T22:15:27.409239] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-13T22:15:27.625239] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-13T22:15:27.783511] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-13T22:15:27.783584] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-13T22:15:27.784304] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-13T22:15:27.784369] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-13T22:15:27.785138] [DEBUG] [LOCAL ] VMO: Trimmed 31105 records to 20797 (keeping 200 days of data) [2025-10-13T22:15:27.911190] [DEBUG] [LOCAL ] VMO: Primary data saved (20797 records). [2025-10-13T22:15:27.911323] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-13T22:15:27.911427] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VMO took 28.5s. Estimated remaining: 18m 18s. Rate: 7.1 symbols/min [2025-10-13T22:15:28.096701] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:28.110000] [DEBUG] [LOCAL ] VOC: Loaded 9114 existing records from primary storage. [2025-10-13T22:15:28.110312] [INFO ] [MAIN ] VOC: Loaded 9114 existing records. [2025-10-13T22:15:28.315623] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:28.315954] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-13T22:15:28.316008] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-13T22:15:28.316320] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-13T22:15:28.316382] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-13T22:15:28.423213] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-13T22:15:28.681359] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:29.133931] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T22:15:29.217942] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-13T22:15:29.350893] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:15:29.785256] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T22:15:30.017938] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-13T22:15:30.817929] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-13T22:15:31.394259] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T22:15:31.617931] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-13T22:15:32.371378] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:15:32.417919] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-13T22:15:32.623940] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T22:15:32.626316] [INFO ] [REMOTE ] VNCE: Full fetch complete (15710 records). [2025-10-13T22:15:32.626388] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-13T22:15:32.990399] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-13T22:15:32.990479] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-13T22:15:32.990893] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-13T22:15:32.990975] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-13T22:15:32.991544] [DEBUG] [LOCAL ] VNCE: Trimmed 15710 records to 8785 (keeping 200 days of data) [2025-10-13T22:15:33.042120] [DEBUG] [LOCAL ] VNCE: Primary data saved (8785 records). [2025-10-13T22:15:33.042268] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-13T22:15:33.042354] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNCE took 33.7s. Estimated remaining: 18m 9s. Rate: 7.1 symbols/min [2025-10-13T22:15:33.211773] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:33.217939] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-13T22:15:33.261975] [DEBUG] [LOCAL ] VOYA: Loaded 42862 existing records from primary storage. [2025-10-13T22:15:33.262296] [INFO ] [MAIN ] VOYA: Loaded 42862 existing records. [2025-10-13T22:15:33.438872] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:33.439083] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-13T22:15:33.439130] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-13T22:15:33.439567] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-13T22:15:33.439626] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-13T22:15:33.737601] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T22:15:33.764451] [INFO ] [REMOTE ] VNT: Full fetch complete (63583 records). [2025-10-13T22:15:33.793032] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-13T22:15:33.823370] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:33.928888] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T22:15:34.018587] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-13T22:15:34.278861] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-13T22:15:34.278941] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-13T22:15:34.280195] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-13T22:15:34.280276] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-13T22:15:34.281852] [DEBUG] [LOCAL ] VNT: Trimmed 63583 records to 43883 (keeping 200 days of data) [2025-10-13T22:15:34.577102] [DEBUG] [LOCAL ] VNT: Primary data saved (43883 records). [2025-10-13T22:15:34.577233] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-13T22:15:34.577318] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 35.2s. Estimated remaining: 18m 0s. Rate: 7.1 symbols/min [2025-10-13T22:15:34.775720] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:34.776011] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-13T22:15:34.776073] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-13T22:15:34.776222] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-13T22:15:34.776267] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-13T22:15:34.776310] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-13T22:15:34.776344] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-13T22:15:34.823190] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-13T22:15:34.870766] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T22:15:35.196543] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:35.617924] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-13T22:15:36.070003] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T22:15:36.075282] [INFO ] [REMOTE ] VNO: Full fetch complete (70317 records). [2025-10-13T22:15:36.075419] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-13T22:15:36.423034] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-13T22:15:36.514552] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-13T22:15:36.514675] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-13T22:15:36.515889] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-13T22:15:36.515951] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-13T22:15:36.517352] [DEBUG] [LOCAL ] VNO: Trimmed 70317 records to 48943 (keeping 200 days of data) [2025-10-13T22:15:36.801407] [DEBUG] [LOCAL ] VNO: Primary data saved (48943 records). [2025-10-13T22:15:36.801554] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-13T22:15:36.801639] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNO took 37.4s. Estimated remaining: 17m 52s. Rate: 7.1 symbols/min [2025-10-13T22:15:36.968219] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:36.987144] [DEBUG] [LOCAL ] VPG: Loaded 17234 existing records from primary storage. [2025-10-13T22:15:36.987366] [INFO ] [MAIN ] VPG: Loaded 17234 existing records. [2025-10-13T22:15:37.168151] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:37.168462] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-13T22:15:37.168620] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-13T22:15:37.169018] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-13T22:15:37.169078] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-13T22:15:37.222319] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-13T22:15:37.382729] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T22:15:37.462372] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T22:15:37.576017] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:15:37.580736] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:37.581118] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-13T22:15:37.581461] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:15:37.581540] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-13T22:15:37.581606] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:15:37.581704] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-13T22:15:37.581777] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-13T22:15:37.581814] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-13T22:15:37.581869] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-13T22:15:37.581939] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOYG took 3.0s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-13T22:15:37.746857] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:15:37.754705] [DEBUG] [LOCAL ] VPV: Loaded 5516 existing records from primary storage. [2025-10-13T22:15:37.754883] [INFO ] [MAIN ] VPV: Loaded 5516 existing records. [2025-10-13T22:15:37.926950] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:15:37.927145] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-13T22:15:37.927193] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-13T22:15:37.927364] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-13T22:15:37.927418] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-13T22:15:38.026030] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-13T22:15:38.304819] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:15:38.817937] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-13T22:15:39.033399] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T22:15:39.617948] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-13T22:15:40.182613] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T22:15:40.377394] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T22:15:40.417883] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-13T22:15:41.217970] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-13T22:15:41.924265] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T22:15:41.956347] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:15:42.017952] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-13T22:15:42.817938] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-13T22:15:43.600390] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T22:15:43.617875] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-13T22:15:43.734102] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T22:15:44.134424] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T22:15:44.417946] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-13T22:15:45.223092] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-13T22:15:45.226032] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T22:15:45.862556] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T22:15:46.017959] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-13T22:15:46.753858] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T22:15:46.817942] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-13T22:15:47.617943] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-13T22:15:48.238468] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T22:15:48.310547] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T22:15:48.417902] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-13T22:15:49.208976] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T22:15:49.217871] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-13T22:15:50.017910] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-13T22:15:50.405173] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T22:15:50.817944] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-13T22:15:50.854127] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T22:15:51.407135] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T22:15:51.617920] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-13T22:15:52.089693] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T22:15:52.417935] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-13T22:15:53.217949] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-13T22:15:53.376109] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T22:15:54.017928] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-13T22:15:54.764976] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T22:15:54.817952] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-13T22:15:55.105895] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T22:15:55.617940] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-13T22:15:56.114319] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T22:15:56.228286] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T22:15:56.417908] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-13T22:15:57.217909] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-13T22:15:57.425726] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T22:15:57.789038] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T22:15:58.017938] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-13T22:15:58.690035] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T22:15:58.817955] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-13T22:15:59.617927] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-13T22:15:59.648542] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T22:16:00.417912] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-13T22:16:01.217913] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-13T22:16:01.380059] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T22:16:01.462333] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T22:16:01.751374] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T22:16:02.017978] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-13T22:16:02.665102] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T22:16:02.817938] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-13T22:16:03.408451] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T22:16:03.617979] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-13T22:16:04.417921] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-13T22:16:05.164223] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T22:16:05.217930] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-13T22:16:05.320188] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T22:16:05.609486] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T22:16:05.610690] [INFO ] [REMOTE ] VPV: Full fetch complete (9077 records). [2025-10-13T22:16:05.610757] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-13T22:16:05.966780] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-13T22:16:05.966862] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-13T22:16:05.967084] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-13T22:16:05.967122] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-13T22:16:05.967555] [DEBUG] [LOCAL ] VPV: Trimmed 9077 records to 5439 (keeping 200 days of data) [2025-10-13T22:16:05.999983] [DEBUG] [LOCAL ] VPV: Primary data saved (5439 records). [2025-10-13T22:16:06.000080] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-13T22:16:06.000155] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VPV took 28.4s. Estimated remaining: 17m 35s. Rate: 7.1 symbols/min [2025-10-13T22:16:06.023048] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-13T22:16:06.173059] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:06.211119] [DEBUG] [LOCAL ] VRE: Loaded 35549 existing records from primary storage. [2025-10-13T22:16:06.211391] [INFO ] [MAIN ] VRE: Loaded 35549 existing records. [2025-10-13T22:16:06.399056] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:06.399265] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-13T22:16:06.399312] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-13T22:16:06.399752] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-13T22:16:06.399809] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-13T22:16:06.753450] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:06.780900] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T22:16:06.782311] [INFO ] [REMOTE ] VOC: Full fetch complete (13181 records). [2025-10-13T22:16:06.782396] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-13T22:16:06.823166] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-13T22:16:07.144367] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-13T22:16:07.144444] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-13T22:16:07.144778] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-13T22:16:07.144837] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-13T22:16:07.145298] [DEBUG] [LOCAL ] VOC: Trimmed 13181 records to 9019 (keeping 200 days of data) [2025-10-13T22:16:07.202383] [DEBUG] [LOCAL ] VOC: Primary data saved (9019 records). [2025-10-13T22:16:07.202564] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-13T22:16:07.202676] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOC took 39.3s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-13T22:16:07.373990] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:07.431071] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-13T22:16:07.431409] [INFO ] [MAIN ] VRT: Loaded 54533 existing records. [2025-10-13T22:16:07.610230] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:07.610687] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-13T22:16:07.610848] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-13T22:16:07.611448] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-13T22:16:07.611508] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-13T22:16:07.623107] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-13T22:16:07.805395] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T22:16:07.992143] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:08.417930] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-13T22:16:08.974753] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T22:16:09.217909] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-13T22:16:09.692838] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T22:16:10.017971] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-13T22:16:10.795582] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T22:16:10.797471] [INFO ] [REMOTE ] VPG: Full fetch complete (22691 records). [2025-10-13T22:16:10.797564] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-13T22:16:10.830229] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-13T22:16:11.209173] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-13T22:16:11.209346] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-13T22:16:11.210156] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-13T22:16:11.210222] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-13T22:16:11.211377] [DEBUG] [LOCAL ] VPG: Trimmed 22691 records to 17099 (keeping 200 days of data) [2025-10-13T22:16:11.316407] [DEBUG] [LOCAL ] VPG: Primary data saved (17099 records). [2025-10-13T22:16:11.316615] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-13T22:16:11.316797] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPG took 34.5s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-13T22:16:11.488241] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:11.520744] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-13T22:16:11.539260] [DEBUG] [LOCAL ] VRTS: Loaded 9421 existing records from primary storage. [2025-10-13T22:16:11.539504] [INFO ] [MAIN ] VRTS: Loaded 9421 existing records. [2025-10-13T22:16:11.623081] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-13T22:16:11.722215] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:11.722439] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-13T22:16:11.722487] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-13T22:16:11.722773] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-13T22:16:11.722831] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-13T22:16:12.104398] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:12.276562] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T22:16:12.280852] [INFO ] [REMOTE ] VOYA: Full fetch complete (61629 records). [2025-10-13T22:16:12.280947] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-13T22:16:12.423138] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-13T22:16:12.681207] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-13T22:16:12.681345] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-13T22:16:12.682419] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-13T22:16:12.682498] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-13T22:16:12.689978] [DEBUG] [LOCAL ] VOYA: Trimmed 61629 records to 42227 (keeping 200 days of data) [2025-10-13T22:16:12.701735] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T22:16:12.932316] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T22:16:12.979825] [DEBUG] [LOCAL ] VOYA: Primary data saved (42227 records). [2025-10-13T22:16:12.979966] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-13T22:16:12.980047] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VOYA took 39.9s. Estimated remaining: 17m 9s. Rate: 7.1 symbols/min [2025-10-13T22:16:13.150096] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:13.203048] [DEBUG] [LOCAL ] VSCO: Loaded 53514 existing records from primary storage. [2025-10-13T22:16:13.203375] [INFO ] [MAIN ] VSCO: Loaded 53514 existing records. [2025-10-13T22:16:13.223744] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-13T22:16:13.394845] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:13.395087] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-13T22:16:13.395136] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-13T22:16:13.395564] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-13T22:16:13.395619] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-13T22:16:13.762442] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:13.950153] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T22:16:14.017953] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-13T22:16:14.817893] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-13T22:16:15.214089] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T22:16:15.367550] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T22:16:15.617933] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-13T22:16:16.131098] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-13T22:16:16.417918] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-13T22:16:17.217924] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-13T22:16:18.017936] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-13T22:16:18.817985] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-13T22:16:18.914259] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-13T22:16:19.005052] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T22:16:19.353568] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T22:16:19.412342] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T22:16:19.617947] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-13T22:16:20.417953] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-13T22:16:21.217948] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-13T22:16:22.017951] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-13T22:16:22.130234] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T22:16:22.174303] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-13T22:16:22.468457] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T22:16:22.506206] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T22:16:22.817943] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-13T22:16:23.617921] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-13T22:16:24.417919] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-13T22:16:24.803890] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T22:16:24.903268] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T22:16:25.217900] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-13T22:16:25.376798] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T22:16:26.017948] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-13T22:16:26.817950] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-13T22:16:27.371175] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T22:16:27.424439] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-13T22:16:27.617937] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-13T22:16:27.712839] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T22:16:28.417908] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-13T22:16:29.217911] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-13T22:16:29.341408] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T22:16:30.017947] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-13T22:16:30.061459] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-13T22:16:30.369798] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T22:16:30.502403] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T22:16:30.817978] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-13T22:16:31.468725] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T22:16:31.473542] [INFO ] [REMOTE ] VRTS: Full fetch complete (11519 records). [2025-10-13T22:16:31.473820] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-13T22:16:31.623727] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-13T22:16:32.000836] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-13T22:16:32.000919] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-13T22:16:32.001219] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-13T22:16:32.001262] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-13T22:16:32.001813] [DEBUG] [LOCAL ] VRTS: Trimmed 11519 records to 9348 (keeping 200 days of data) [2025-10-13T22:16:32.065476] [DEBUG] [LOCAL ] VRTS: Primary data saved (9348 records). [2025-10-13T22:16:32.065667] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-13T22:16:32.065788] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 20.7s. Estimated remaining: 17m 1s. Rate: 7.1 symbols/min [2025-10-13T22:16:32.245132] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:32.296720] [DEBUG] [LOCAL ] VSH: Loaded 48908 existing records from primary storage. [2025-10-13T22:16:32.297040] [INFO ] [MAIN ] VSH: Loaded 48908 existing records. [2025-10-13T22:16:32.423116] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-13T22:16:32.491101] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:32.491336] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-13T22:16:32.491383] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-13T22:16:32.491867] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-13T22:16:32.491924] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-13T22:16:32.856256] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:33.217938] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-13T22:16:33.689112] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T22:16:34.026373] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-13T22:16:34.031430] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-13T22:16:34.817949] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-13T22:16:34.974279] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T22:16:35.044371] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T22:16:35.617959] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-13T22:16:36.417933] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-13T22:16:37.217912] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-13T22:16:37.242382] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T22:16:37.374695] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T22:16:38.017902] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-13T22:16:38.118508] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T22:16:38.817944] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-13T22:16:38.857408] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T22:16:39.617934] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-13T22:16:40.417981] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-13T22:16:40.504229] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-13T22:16:40.645921] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T22:16:40.915289] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T22:16:40.919179] [INFO ] [REMOTE ] VRE: Full fetch complete (48269 records). [2025-10-13T22:16:40.919289] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-13T22:16:41.223095] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-13T22:16:41.294685] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-13T22:16:41.294767] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-13T22:16:41.295722] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-13T22:16:41.295785] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-13T22:16:41.296826] [DEBUG] [LOCAL ] VRE: Trimmed 48269 records to 35162 (keeping 200 days of data) [2025-10-13T22:16:41.511397] [DEBUG] [LOCAL ] VRE: Primary data saved (35162 records). [2025-10-13T22:16:41.511548] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-13T22:16:41.511631] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRE took 35.5s. Estimated remaining: 16m 53s. Rate: 7.1 symbols/min [2025-10-13T22:16:41.681860] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:41.682067] [DEBUG] [LOCAL ] VST: No existing data file found in primary storage. [2025-10-13T22:16:41.682226] [WARN ] [MAIN ] VST: No existing data found, performing full refresh instead. [2025-10-13T22:16:41.682339] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-13T22:16:41.682380] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-13T22:16:41.682423] [DEBUG] [LOCAL ] VST: No primary data file found to delete. [2025-10-13T22:16:41.682456] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-13T22:16:42.018747] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-13T22:16:42.039455] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:42.068330] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T22:16:42.817978] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-13T22:16:43.597202] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-13T22:16:43.617887] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-13T22:16:44.060086] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T22:16:44.335970] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T22:16:44.417923] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-13T22:16:45.217981] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-13T22:16:45.903969] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-13T22:16:45.909511] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-13T22:16:45.909709] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-13T22:16:46.023093] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-13T22:16:46.315979] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-13T22:16:46.316060] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-13T22:16:46.317248] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-13T22:16:46.317313] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-13T22:16:46.318836] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-10-13T22:16:46.687340] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-13T22:16:46.716760] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-13T22:16:46.716870] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-13T22:16:46.716953] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 39.5s. Estimated remaining: 16m 44s. Rate: 7.1 symbols/min [2025-10-13T22:16:46.821088] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-13T22:16:46.898065] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:16:46.945851] [DEBUG] [LOCAL ] VSTS: Loaded 49658 existing records from primary storage. [2025-10-13T22:16:46.946195] [INFO ] [MAIN ] VSTS: Loaded 49658 existing records. [2025-10-13T22:16:47.165397] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:16:47.181042] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-13T22:16:47.181181] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-13T22:16:47.181608] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-13T22:16:47.181746] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-13T22:16:47.191747] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T22:16:47.563710] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:16:47.625323] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-13T22:16:47.631288] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:16:48.417977] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-13T22:16:48.993519] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T22:16:49.217907] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-13T22:16:49.275600] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-13T22:16:50.017952] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-13T22:16:50.146107] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T22:16:50.817897] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-13T22:16:51.063309] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T22:16:51.619972] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-13T22:16:51.622695] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T22:16:52.228898] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T22:16:52.417920] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-13T22:16:53.217992] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-13T22:16:53.939267] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-13T22:16:54.014066] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T22:16:54.023664] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-13T22:16:54.817931] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-13T22:16:55.008100] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T22:16:55.617927] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-13T22:16:56.298837] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T22:16:56.374258] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T22:16:56.417892] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-13T22:16:57.089534] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T22:16:57.217919] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-13T22:16:58.017957] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-13T22:16:58.589739] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T22:16:58.727260] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T22:16:58.817894] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-13T22:16:59.617924] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-13T22:16:59.770401] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T22:16:59.946147] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T22:16:59.951111] [INFO ] [REMOTE ] VSH: Full fetch complete (70730 records). [2025-10-13T22:16:59.951226] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-13T22:17:00.339524] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-13T22:17:00.339601] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-13T22:17:00.340695] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-13T22:17:00.340757] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-13T22:17:00.342068] [DEBUG] [LOCAL ] VSH: Trimmed 70730 records to 48189 (keeping 200 days of data) [2025-10-13T22:17:00.437089] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-13T22:17:00.675480] [DEBUG] [LOCAL ] VSH: Primary data saved (48189 records). [2025-10-13T22:17:00.675633] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-13T22:17:00.675766] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSH took 28.6s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-13T22:17:00.842851] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:00.883695] [DEBUG] [LOCAL ] VTEX: Loaded 43617 existing records from primary storage. [2025-10-13T22:17:00.884000] [INFO ] [MAIN ] VTEX: Loaded 43617 existing records. [2025-10-13T22:17:01.065371] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:01.065767] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-13T22:17:01.065879] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-13T22:17:01.066283] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-13T22:17:01.066415] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-13T22:17:01.224596] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-13T22:17:01.381098] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T22:17:01.498506] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:02.018016] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-13T22:17:02.817950] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-13T22:17:02.923076] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-13T22:17:02.934740] [DEBUG] [REMOTE ] VSTS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-13T22:17:02.935764] [WARN ] [REMOTE ] VSTS: No data returned for month 2025-04 [2025-10-13T22:17:02.936249] [FATAL] [REMOTE ] VSTS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:17:02.936388] [FATAL] [MAIN ] VSTS: Failed to fetch primary data. [2025-10-13T22:17:02.936458] [WARN ] [MAIN ] VSTS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:17:02.936532] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-13T22:17:02.936607] [DEBUG] [LOCAL ] VSTS: No primary data file found to delete. [2025-10-13T22:17:02.936674] [INFO ] [LOCAL ] VSTS: Starting deletion of derivative data. [2025-10-13T22:17:02.936985] [DEBUG] [LOCAL ] VSTS: Deleted derivative data file. [2025-10-13T22:17:02.937088] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSTS took 16.2s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-13T22:17:03.124947] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:03.142664] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T22:17:03.149584] [INFO ] [REMOTE ] VSCO: Full fetch complete (76230 records). [2025-10-13T22:17:03.149827] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-13T22:17:03.475836] [DEBUG] [LOCAL ] VTLE: Loaded 48858 existing records from primary storage. [2025-10-13T22:17:03.545428] [INFO ] [MAIN ] VTLE: Loaded 48858 existing records. [2025-10-13T22:17:03.641240] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T22:17:03.670692] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-13T22:17:03.665343] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-13T22:17:03.686100] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-13T22:17:03.698414] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-13T22:17:03.739696] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-13T22:17:03.791897] [DEBUG] [LOCAL ] VSCO: Trimmed 76230 records to 52734 (keeping 200 days of data) [2025-10-13T22:17:03.901033] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:03.910799] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-13T22:17:03.938238] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-13T22:17:03.957715] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-13T22:17:03.960909] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-13T22:17:04.421757] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-13T22:17:04.444490] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:04.544788] [DEBUG] [LOCAL ] VSCO: Primary data saved (52734 records). [2025-10-13T22:17:04.544957] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-13T22:17:04.545063] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSCO took 51.6s. Estimated remaining: 16m 18s. Rate: 7.1 symbols/min [2025-10-13T22:17:04.711773] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:04.730456] [DEBUG] [LOCAL ] VTMX: Loaded 17778 existing records from primary storage. [2025-10-13T22:17:04.730726] [INFO ] [MAIN ] VTMX: Loaded 17778 existing records. [2025-10-13T22:17:04.908109] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:04.908351] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-13T22:17:04.908400] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-13T22:17:04.908640] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-13T22:17:04.908736] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-13T22:17:05.223041] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-13T22:17:05.276939] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:05.590739] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T22:17:06.017909] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-13T22:17:06.180605] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-13T22:17:06.817960] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-13T22:17:06.915998] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T22:17:07.286019] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T22:17:07.617940] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-13T22:17:08.417969] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-13T22:17:09.162583] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T22:17:09.218380] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T22:17:09.218450] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-13T22:17:09.402208] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-13T22:17:10.017927] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-13T22:17:10.811048] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T22:17:10.819901] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-13T22:17:10.979616] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T22:17:11.617930] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-13T22:17:12.170537] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T22:17:12.417954] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-13T22:17:12.987854] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T22:17:13.217958] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-13T22:17:13.235990] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T22:17:14.017943] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-13T22:17:14.783631] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T22:17:14.817877] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-13T22:17:15.410144] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-13T22:17:15.617928] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-13T22:17:15.897081] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T22:17:16.417968] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-13T22:17:17.169135] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T22:17:17.217934] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-13T22:17:18.017932] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-13T22:17:18.131001] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T22:17:18.345547] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T22:17:18.817993] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-13T22:17:19.614829] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T22:17:19.624498] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-13T22:17:20.411887] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T22:17:20.419997] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-13T22:17:20.630235] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T22:17:21.217939] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-13T22:17:22.017923] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-13T22:17:22.143494] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T22:17:22.772062] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T22:17:22.810509] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T22:17:22.817881] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-13T22:17:23.617967] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-13T22:17:23.820165] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T22:17:24.417999] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-13T22:17:25.217939] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-13T22:17:25.888628] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T22:17:25.927473] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-13T22:17:26.017911] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-13T22:17:26.112135] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T22:17:26.817937] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-13T22:17:27.344912] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T22:17:27.617941] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-13T22:17:28.417982] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-13T22:17:28.574169] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T22:17:29.086810] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T22:17:29.093391] [INFO ] [REMOTE ] VST: Full fetch complete (77802 records). [2025-10-13T22:17:29.093582] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-13T22:17:29.219462] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-13T22:17:29.517412] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T22:17:29.551236] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-13T22:17:29.551332] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-13T22:17:29.553121] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-13T22:17:29.553190] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-13T22:17:29.554843] [DEBUG] [LOCAL ] VST: Trimmed 77802 records to 53712 (keeping 200 days of data) [2025-10-13T22:17:29.906377] [DEBUG] [LOCAL ] VST: Primary data saved (53712 records). [2025-10-13T22:17:29.906533] [INFO ] [MAIN ] VST: Full history saved. [2025-10-13T22:17:29.906669] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 48.4s. Estimated remaining: 16m 11s. Rate: 7.1 symbols/min [2025-10-13T22:17:30.023065] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-13T22:17:30.077429] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T22:17:30.090932] [INFO ] [REMOTE ] VTMX: Full fetch complete (25565 records). [2025-10-13T22:17:30.096318] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-13T22:17:30.099587] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:30.208810] [DEBUG] [LOCAL ] VTN: Loaded 7080 existing records from primary storage. [2025-10-13T22:17:30.221708] [INFO ] [MAIN ] VTN: Loaded 7080 existing records. [2025-10-13T22:17:30.629053] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:30.650471] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-13T22:17:30.655754] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-13T22:17:30.689805] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-13T22:17:30.705712] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-13T22:17:30.751150] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-13T22:17:30.790326] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-13T22:17:30.802484] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-13T22:17:30.802590] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-13T22:17:30.822723] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-13T22:17:30.827292] [DEBUG] [LOCAL ] VTMX: Trimmed 25565 records to 17610 (keeping 200 days of data) [2025-10-13T22:17:31.238912] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:31.259147] [DEBUG] [LOCAL ] VTMX: Primary data saved (17610 records). [2025-10-13T22:17:31.259312] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-13T22:17:31.259409] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTMX took 26.7s. Estimated remaining: 16m 2s. Rate: 7.1 symbols/min [2025-10-13T22:17:31.428375] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:31.450587] [DEBUG] [LOCAL ] VTOL: Loaded 19730 existing records from primary storage. [2025-10-13T22:17:31.450905] [INFO ] [MAIN ] VTOL: Loaded 19730 existing records. [2025-10-13T22:17:31.645465] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:31.645721] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-13T22:17:31.647334] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-13T22:17:31.647456] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-13T22:17:31.647861] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-13T22:17:31.647998] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-13T22:17:31.997858] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T22:17:32.095012] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:32.200775] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T22:17:32.205524] [INFO ] [REMOTE ] VTEX: Full fetch complete (60490 records). [2025-10-13T22:17:32.205712] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-13T22:17:32.365617] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T22:17:32.425117] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-13T22:17:32.625309] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-13T22:17:32.625389] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-13T22:17:32.626515] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-13T22:17:32.626578] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-13T22:17:32.627855] [DEBUG] [LOCAL ] VTEX: Trimmed 60490 records to 43014 (keeping 200 days of data) [2025-10-13T22:17:32.891497] [DEBUG] [LOCAL ] VTEX: Primary data saved (43014 records). [2025-10-13T22:17:32.891689] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-13T22:17:32.891800] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTEX took 32.2s. Estimated remaining: 15m 53s. Rate: 7.1 symbols/min [2025-10-13T22:17:33.069495] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:33.129095] [DEBUG] [LOCAL ] VTR: Loaded 53530 existing records from primary storage. [2025-10-13T22:17:33.129857] [INFO ] [MAIN ] VTR: Loaded 53530 existing records. [2025-10-13T22:17:33.223212] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-13T22:17:33.320981] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:33.328527] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-13T22:17:33.328974] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-13T22:17:33.328865] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T22:17:33.332503] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-13T22:17:33.332590] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-13T22:17:33.708852] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:34.017948] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-13T22:17:34.293234] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T22:17:34.809121] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T22:17:34.817888] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-13T22:17:35.564701] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T22:17:35.617934] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-13T22:17:36.322018] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T22:17:36.417928] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-13T22:17:37.217970] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-13T22:17:37.758218] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T22:17:38.017911] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-13T22:17:38.117827] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T22:17:38.817985] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-13T22:17:39.617990] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-13T22:17:39.746240] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:17:40.133393] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T22:17:40.417941] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-13T22:17:40.478398] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T22:17:41.217945] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-13T22:17:41.337637] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T22:17:42.017990] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-13T22:17:42.817913] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-13T22:17:42.841922] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T22:17:42.980379] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T22:17:43.617936] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-13T22:17:43.957392] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T22:17:43.961997] [INFO ] [REMOTE ] VTLE: Full fetch complete (68731 records). [2025-10-13T22:17:43.962103] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-13T22:17:44.349718] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-13T22:17:44.349805] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-13T22:17:44.351010] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-13T22:17:44.351073] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-13T22:17:44.352470] [DEBUG] [LOCAL ] VTLE: Trimmed 68731 records to 48154 (keeping 200 days of data) [2025-10-13T22:17:44.437694] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-13T22:17:44.637096] [DEBUG] [LOCAL ] VTLE: Primary data saved (48154 records). [2025-10-13T22:17:44.637231] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-13T22:17:44.637317] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTLE took 41.7s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-13T22:17:44.808944] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:44.823522] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T22:17:44.861030] [DEBUG] [LOCAL ] VTS: Loaded 30552 existing records from primary storage. [2025-10-13T22:17:44.861299] [INFO ] [MAIN ] VTS: Loaded 30552 existing records. [2025-10-13T22:17:45.039471] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:45.039701] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-13T22:17:45.039759] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-13T22:17:45.040031] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-13T22:17:45.040086] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-13T22:17:45.225907] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-13T22:17:45.393506] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:46.017958] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-13T22:17:46.218129] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T22:17:46.319033] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T22:17:46.817906] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-13T22:17:47.154805] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T22:17:47.617980] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-13T22:17:48.316496] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T22:17:48.372971] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T22:17:48.417922] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-13T22:17:49.153237] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T22:17:49.217902] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-13T22:17:50.017907] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-13T22:17:50.380727] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T22:17:50.817963] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-13T22:17:51.539310] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T22:17:51.584398] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T22:17:51.617910] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-13T22:17:52.417974] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-13T22:17:53.009081] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T22:17:53.017573] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T22:17:53.217926] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-13T22:17:54.017974] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-13T22:17:54.677386] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T22:17:54.807411] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T22:17:54.817923] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-13T22:17:55.402817] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T22:17:55.404010] [INFO ] [REMOTE ] VTN: Full fetch complete (10910 records). [2025-10-13T22:17:55.404079] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-13T22:17:55.623121] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-13T22:17:55.760249] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-13T22:17:55.760324] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-13T22:17:55.760611] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-13T22:17:55.760676] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-13T22:17:55.761100] [DEBUG] [LOCAL ] VTN: Trimmed 10910 records to 6997 (keeping 200 days of data) [2025-10-13T22:17:55.801776] [DEBUG] [LOCAL ] VTN: Primary data saved (6997 records). [2025-10-13T22:17:55.801888] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-13T22:17:55.801970] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTN took 25.9s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-13T22:17:55.968888] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:17:55.998698] [DEBUG] [LOCAL ] VVR: Loaded 32015 existing records from primary storage. [2025-10-13T22:17:55.998968] [INFO ] [MAIN ] VVR: Loaded 32015 existing records. [2025-10-13T22:17:56.178024] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:17:56.178289] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-13T22:17:56.178338] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-13T22:17:56.178727] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-13T22:17:56.178784] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-13T22:17:56.423032] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-13T22:17:56.532107] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:17:57.193157] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T22:17:57.217891] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-13T22:17:58.025623] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-13T22:17:58.028926] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:17:58.773368] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T22:17:58.817888] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-13T22:17:58.964556] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T22:17:59.617967] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-13T22:18:00.116132] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T22:18:00.417926] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-13T22:18:00.931792] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T22:18:01.217967] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-13T22:18:01.505796] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T22:18:02.017979] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-13T22:18:02.729918] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T22:18:02.817941] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-13T22:18:03.617953] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-13T22:18:03.828129] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T22:18:03.851541] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T22:18:04.417916] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-13T22:18:04.855335] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T22:18:05.217957] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-13T22:18:05.950702] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T22:18:06.017900] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-13T22:18:06.490225] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T22:18:06.817974] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-13T22:18:07.516746] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T22:18:07.617891] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-13T22:18:08.236714] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T22:18:08.256938] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T22:18:08.262245] [INFO ] [REMOTE ] VTR: Full fetch complete (76327 records). [2025-10-13T22:18:08.262360] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-13T22:18:08.419698] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-13T22:18:08.668506] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-13T22:18:08.668600] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-13T22:18:08.669938] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-13T22:18:08.670003] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-13T22:18:08.671629] [DEBUG] [LOCAL ] VTR: Trimmed 76327 records to 52772 (keeping 200 days of data) [2025-10-13T22:18:08.995397] [DEBUG] [LOCAL ] VTR: Primary data saved (52772 records). [2025-10-13T22:18:08.995534] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-13T22:18:08.995618] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTR took 36.1s. Estimated remaining: 15m 29s. Rate: 7.1 symbols/min [2025-10-13T22:18:09.160459] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:09.208588] [DEBUG] [LOCAL ] VVV: Loaded 51012 existing records from primary storage. [2025-10-13T22:18:09.208949] [INFO ] [MAIN ] VVV: Loaded 51012 existing records. [2025-10-13T22:18:09.223160] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-13T22:18:09.388385] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:09.388593] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-13T22:18:09.388659] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-13T22:18:09.388996] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-13T22:18:09.389064] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-13T22:18:09.671094] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T22:18:09.763871] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:10.017921] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-13T22:18:10.520253] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T22:18:10.817969] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-13T22:18:11.339532] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T22:18:11.617941] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-13T22:18:11.660602] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T22:18:11.663969] [INFO ] [REMOTE ] VTOL: Full fetch complete (26003 records). [2025-10-13T22:18:11.664122] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-13T22:18:12.084965] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-13T22:18:12.085062] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-13T22:18:12.085873] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-13T22:18:12.085937] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-13T22:18:12.087433] [DEBUG] [LOCAL ] VTOL: Trimmed 26003 records to 19518 (keeping 200 days of data) [2025-10-13T22:18:12.205067] [DEBUG] [LOCAL ] VTOL: Primary data saved (19518 records). [2025-10-13T22:18:12.205245] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-13T22:18:12.205337] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTOL took 40.9s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-13T22:18:12.372325] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:12.397019] [DEBUG] [LOCAL ] VVX: Loaded 23187 existing records from primary storage. [2025-10-13T22:18:12.397364] [INFO ] [MAIN ] VVX: Loaded 23187 existing records. [2025-10-13T22:18:12.427606] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-13T22:18:12.581372] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:12.581698] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-13T22:18:12.581756] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-13T22:18:12.582058] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-13T22:18:12.582117] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-13T22:18:12.934053] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T22:18:13.025189] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:13.217950] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-13T22:18:14.017950] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-13T22:18:14.069158] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T22:18:14.572511] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T22:18:14.817932] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-13T22:18:15.233949] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T22:18:15.617931] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-13T22:18:16.417919] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-13T22:18:16.505718] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T22:18:16.528346] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T22:18:17.217907] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-13T22:18:17.408787] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T22:18:18.017931] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-13T22:18:18.817980] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-13T22:18:18.875116] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T22:18:19.133841] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T22:18:19.136986] [INFO ] [REMOTE ] VTS: Full fetch complete (41370 records). [2025-10-13T22:18:19.137075] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-13T22:18:19.501421] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-13T22:18:19.501503] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-13T22:18:19.502509] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-13T22:18:19.502574] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-13T22:18:19.503619] [DEBUG] [LOCAL ] VTS: Trimmed 41370 records to 30006 (keeping 200 days of data) [2025-10-13T22:18:19.620879] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-13T22:18:19.703404] [DEBUG] [LOCAL ] VTS: Primary data saved (30006 records). [2025-10-13T22:18:19.703570] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-13T22:18:19.703685] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 35.1s. Estimated remaining: 15m 11s. Rate: 7.1 symbols/min [2025-10-13T22:18:19.874012] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:19.924504] [DEBUG] [LOCAL ] VYX: Loaded 49261 existing records from primary storage. [2025-10-13T22:18:19.924867] [INFO ] [MAIN ] VYX: Loaded 49261 existing records. [2025-10-13T22:18:20.106565] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:20.106907] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-13T22:18:20.106967] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-13T22:18:20.107237] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-13T22:18:20.107300] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-13T22:18:20.282532] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T22:18:20.422690] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-13T22:18:20.503336] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:20.508962] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T22:18:21.217974] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-13T22:18:21.567274] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T22:18:22.017898] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-13T22:18:22.119852] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T22:18:22.817932] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-13T22:18:23.442884] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T22:18:23.617916] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-13T22:18:24.417911] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-13T22:18:24.521244] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T22:18:24.692811] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T22:18:25.217952] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-13T22:18:26.017928] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-13T22:18:26.255216] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T22:18:26.318336] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T22:18:26.817926] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-13T22:18:27.086404] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T22:18:27.090356] [INFO ] [REMOTE ] VVR: Full fetch complete (46668 records). [2025-10-13T22:18:27.090439] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-13T22:18:27.466954] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-13T22:18:27.467040] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-13T22:18:27.468256] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-13T22:18:27.468320] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-13T22:18:27.469376] [DEBUG] [LOCAL ] VVR: Trimmed 46668 records to 31230 (keeping 200 days of data) [2025-10-13T22:18:27.639307] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-13T22:18:27.695102] [DEBUG] [LOCAL ] VVR: Primary data saved (31230 records). [2025-10-13T22:18:27.695283] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-13T22:18:27.695383] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 31.9s. Estimated remaining: 15m 3s. Rate: 7.1 symbols/min [2025-10-13T22:18:27.866549] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:27.918870] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-13T22:18:27.919221] [INFO ] [MAIN ] VZ: Loaded 54571 existing records. [2025-10-13T22:18:28.102470] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:28.117014] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-13T22:18:28.117152] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-13T22:18:28.118568] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-13T22:18:28.118488] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T22:18:28.118806] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-13T22:18:28.421583] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-13T22:18:28.502960] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:29.225394] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-13T22:18:29.230756] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T22:18:30.017963] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-13T22:18:30.116481] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T22:18:30.817947] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-13T22:18:31.085257] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T22:18:31.295760] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T22:18:31.617936] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-13T22:18:32.170349] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T22:18:32.417916] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-13T22:18:32.993138] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T22:18:33.217945] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-13T22:18:34.018018] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-13T22:18:34.086391] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T22:18:34.381983] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T22:18:34.818005] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-13T22:18:35.568820] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:18:35.617917] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-13T22:18:36.417950] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-13T22:18:36.598747] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T22:18:36.601385] [INFO ] [REMOTE ] VVX: Full fetch complete (33089 records). [2025-10-13T22:18:36.601470] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-13T22:18:36.986664] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-13T22:18:36.986780] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-13T22:18:36.987792] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-13T22:18:36.987873] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-13T22:18:36.989335] [DEBUG] [LOCAL ] VVX: Trimmed 33089 records to 22933 (keeping 200 days of data) [2025-10-13T22:18:37.127018] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-13T22:18:37.170247] [DEBUG] [LOCAL ] VVX: Primary data saved (22933 records). [2025-10-13T22:18:37.170390] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-13T22:18:37.170476] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVX took 25.0s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-13T22:18:37.226075] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-13T22:18:37.358595] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:37.416105] [DEBUG] [LOCAL ] W: Loaded 54218 existing records from primary storage. [2025-10-13T22:18:37.416534] [INFO ] [MAIN ] W: Loaded 54218 existing records. [2025-10-13T22:18:37.625670] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:37.626694] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-13T22:18:37.626752] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-13T22:18:37.627094] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-13T22:18:37.627150] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-13T22:18:37.982026] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:38.012585] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T22:18:38.023139] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-13T22:18:38.817950] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-13T22:18:38.950266] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T22:18:39.617943] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-13T22:18:39.948363] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T22:18:40.274964] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:18:40.417923] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-13T22:18:41.217967] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-13T22:18:41.701464] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-13T22:18:42.017942] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-13T22:18:42.184121] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T22:18:42.817963] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-13T22:18:42.961570] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T22:18:43.133623] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T22:18:43.138758] [INFO ] [REMOTE ] VVV: Full fetch complete (72436 records). [2025-10-13T22:18:43.138883] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-13T22:18:43.516997] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-13T22:18:43.517084] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-13T22:18:43.518844] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-13T22:18:43.518918] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-13T22:18:43.520371] [DEBUG] [LOCAL ] VVV: Trimmed 72436 records to 50305 (keeping 200 days of data) [2025-10-13T22:18:43.617978] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-13T22:18:43.818819] [DEBUG] [LOCAL ] VVV: Primary data saved (50305 records). [2025-10-13T22:18:43.818964] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-13T22:18:43.819057] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVV took 34.8s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-13T22:18:43.996183] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:18:44.039600] [DEBUG] [LOCAL ] WAB: Loaded 44672 existing records from primary storage. [2025-10-13T22:18:44.039954] [INFO ] [MAIN ] WAB: Loaded 44672 existing records. [2025-10-13T22:18:44.220227] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:18:44.220483] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-13T22:18:44.220537] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-13T22:18:44.220813] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-13T22:18:44.220870] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-13T22:18:44.431957] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-13T22:18:44.584092] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:18:45.063620] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T22:18:45.157068] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-13T22:18:45.217886] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-13T22:18:45.903498] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T22:18:46.017964] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-13T22:18:46.817964] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-13T22:18:47.535422] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T22:18:47.617952] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-13T22:18:47.664044] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T22:18:48.417909] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-13T22:18:48.571075] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T22:18:49.217912] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-13T22:18:49.363110] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T22:18:50.012947] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T22:18:50.023251] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-13T22:18:50.817937] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-13T22:18:51.347234] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T22:18:51.617901] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-13T22:18:51.648864] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-13T22:18:52.417945] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-13T22:18:52.582781] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T22:18:53.038993] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T22:18:53.217994] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-13T22:18:54.017947] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-13T22:18:54.259075] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T22:18:54.817958] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-13T22:18:54.987350] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T22:18:55.617939] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-13T22:18:55.672078] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T22:18:56.293942] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T22:18:56.417922] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-13T22:18:57.217907] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-13T22:18:57.533602] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T22:18:57.801528] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T22:18:58.017936] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-13T22:18:58.817994] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-13T22:18:59.617908] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-13T22:18:59.750770] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-13T22:18:59.991029] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T22:19:00.224209] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T22:19:00.417913] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-13T22:19:01.016390] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T22:19:01.021436] [INFO ] [REMOTE ] VYX: Full fetch complete (70079 records). [2025-10-13T22:19:01.021567] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-13T22:19:01.224376] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-13T22:19:01.411731] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-13T22:19:01.411821] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-13T22:19:01.413095] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-13T22:19:01.413158] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-13T22:19:01.414537] [DEBUG] [LOCAL ] VYX: Trimmed 70079 records to 48548 (keeping 200 days of data) [2025-10-13T22:19:01.700767] [DEBUG] [LOCAL ] VYX: Primary data saved (48548 records). [2025-10-13T22:19:01.700909] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-13T22:19:01.700994] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 42.0s. Estimated remaining: 14m 38s. Rate: 7.1 symbols/min [2025-10-13T22:19:01.884071] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:01.928750] [DEBUG] [LOCAL ] WAL: Loaded 45940 existing records from primary storage. [2025-10-13T22:19:01.929089] [INFO ] [MAIN ] WAL: Loaded 45940 existing records. [2025-10-13T22:19:02.023987] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-13T22:19:02.131089] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:02.131986] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-13T22:19:02.132057] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-13T22:19:02.132898] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-13T22:19:02.132959] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-13T22:19:02.509487] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:02.566468] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-13T22:19:02.817886] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-13T22:19:03.115951] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T22:19:03.617921] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-13T22:19:03.719937] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T22:19:04.418008] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-13T22:19:04.510406] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T22:19:05.165814] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:19:05.217898] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-13T22:19:05.921064] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T22:19:06.017923] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-13T22:19:06.589099] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T22:19:06.594927] [INFO ] [REMOTE ] W: Full fetch complete (77389 records). [2025-10-13T22:19:06.595080] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-13T22:19:06.823172] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-13T22:19:06.999869] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-13T22:19:06.999981] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-13T22:19:07.002571] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-13T22:19:07.002701] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-13T22:19:07.006034] [DEBUG] [LOCAL ] W: Trimmed 77389 records to 53438 (keeping 200 days of data) [2025-10-13T22:19:07.352669] [DEBUG] [LOCAL ] W: Primary data saved (53438 records). [2025-10-13T22:19:07.352884] [INFO ] [MAIN ] W: Full history saved. [2025-10-13T22:19:07.353037] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. W took 30.2s. Estimated remaining: 14m 29s. Rate: 7.1 symbols/min [2025-10-13T22:19:07.549431] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:07.618385] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-13T22:19:07.623343] [DEBUG] [LOCAL ] WAT: Loaded 36046 existing records from primary storage. [2025-10-13T22:19:07.621437] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T22:19:07.633370] [INFO ] [MAIN ] WAT: Loaded 36046 existing records. [2025-10-13T22:19:07.861254] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:07.861748] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-13T22:19:07.861811] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-13T22:19:07.862782] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-13T22:19:07.862844] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-13T22:19:08.226733] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:08.417961] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-13T22:19:08.653578] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T22:19:09.217982] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-13T22:19:09.590587] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T22:19:09.725580] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T22:19:10.017984] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-13T22:19:10.617291] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T22:19:10.624857] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-13T22:19:10.624987] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-13T22:19:10.824162] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-13T22:19:10.969596] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T22:19:11.061030] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-13T22:19:11.061111] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-13T22:19:11.062344] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-13T22:19:11.062409] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-13T22:19:11.063862] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-10-13T22:19:11.399585] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-13T22:19:11.399751] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-13T22:19:11.399842] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. VZ took 43.7s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-13T22:19:11.566089] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:11.566251] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-13T22:19:11.566289] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-13T22:19:11.566403] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-13T22:19:11.566445] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-13T22:19:11.566486] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-13T22:19:11.566519] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-13T22:19:11.627707] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-13T22:19:11.918134] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:12.044181] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T22:19:12.417962] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-13T22:19:13.217909] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-13T22:19:13.456137] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T22:19:14.017901] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-13T22:19:14.102797] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T22:19:14.710836] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T22:19:14.817925] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-13T22:19:15.617910] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-13T22:19:15.935150] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T22:19:16.401897] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T22:19:16.417884] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-13T22:19:16.667072] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T22:19:16.984495] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T22:19:16.989707] [INFO ] [REMOTE ] WAB: Full fetch complete (64111 records). [2025-10-13T22:19:16.989905] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-13T22:19:17.223205] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-13T22:19:17.444767] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-13T22:19:17.444863] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-13T22:19:17.446501] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-13T22:19:17.446571] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-13T22:19:17.448110] [DEBUG] [LOCAL ] WAB: Trimmed 64111 records to 44045 (keeping 200 days of data) [2025-10-13T22:19:17.756089] [DEBUG] [LOCAL ] WAB: Primary data saved (44045 records). [2025-10-13T22:19:17.756249] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-13T22:19:17.756362] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 33.9s. Estimated remaining: 14m 12s. Rate: 7.1 symbols/min [2025-10-13T22:19:17.953017] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:18.002528] [DEBUG] [LOCAL ] WBS: Loaded 49376 existing records from primary storage. [2025-10-13T22:19:18.002993] [INFO ] [MAIN ] WBS: Loaded 49376 existing records. [2025-10-13T22:19:18.023220] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-13T22:19:18.213779] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:18.214062] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-13T22:19:18.214113] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-13T22:19:18.214616] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-13T22:19:18.214698] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-13T22:19:18.316898] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:19:18.323143] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-13T22:19:18.342679] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:19:18.363216] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-13T22:19:18.374146] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:19:18.401817] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-13T22:19:18.418045] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-13T22:19:18.418132] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-13T22:19:18.449808] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-13T22:19:18.473509] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WBI took 7.1s. Estimated remaining: 14m 3s. Rate: 7.1 symbols/min [2025-10-13T22:19:18.744205] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:18.790860] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:18.791089] [DEBUG] [LOCAL ] WBX: No existing data file found in primary storage. [2025-10-13T22:19:18.791135] [WARN ] [MAIN ] WBX: No existing data found, performing full refresh instead. [2025-10-13T22:19:18.791252] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-13T22:19:18.791338] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-13T22:19:18.791389] [DEBUG] [LOCAL ] WBX: No primary data file found to delete. [2025-10-13T22:19:18.791423] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-13T22:19:18.823232] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-13T22:19:19.194730] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:19.198140] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T22:19:19.617921] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-13T22:19:20.417948] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-13T22:19:20.441283] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T22:19:21.186403] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T22:19:21.217910] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-13T22:19:21.688254] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T22:19:22.017944] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-13T22:19:22.683498] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T22:19:22.817974] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-13T22:19:23.201532] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T22:19:23.617999] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-13T22:19:24.309829] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T22:19:24.417932] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-13T22:19:25.217924] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-13T22:19:25.253988] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T22:19:25.704069] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T22:19:26.018015] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-13T22:19:26.343778] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T22:19:26.818107] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-13T22:19:27.617899] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-13T22:19:27.722994] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T22:19:27.928327] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T22:19:28.417951] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-13T22:19:29.152488] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T22:19:29.217899] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-13T22:19:29.456367] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T22:19:30.017922] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-13T22:19:30.817952] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-13T22:19:30.879129] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T22:19:31.617914] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-13T22:19:31.741333] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T22:19:32.039840] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T22:19:32.417925] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-13T22:19:32.691848] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T22:19:32.697233] [INFO ] [REMOTE ] WAL: Full fetch complete (66749 records). [2025-10-13T22:19:32.697342] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-13T22:19:33.111594] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-13T22:19:33.111696] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-13T22:19:33.112980] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-13T22:19:33.113045] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-13T22:19:33.114386] [DEBUG] [LOCAL ] WAL: Trimmed 66749 records to 45391 (keeping 200 days of data) [2025-10-13T22:19:33.217972] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-13T22:19:33.435079] [DEBUG] [LOCAL ] WAL: Primary data saved (45391 records). [2025-10-13T22:19:33.435220] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-13T22:19:33.435310] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 31.7s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-13T22:19:33.623358] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:33.672827] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T22:19:33.696301] [DEBUG] [LOCAL ] WCC: Loaded 39666 existing records from primary storage. [2025-10-13T22:19:33.696816] [INFO ] [MAIN ] WCC: Loaded 39666 existing records. [2025-10-13T22:19:33.881061] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:33.881293] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-13T22:19:33.881340] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-13T22:19:33.881787] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-13T22:19:33.881843] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-13T22:19:34.023044] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-13T22:19:34.270039] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T22:19:34.282107] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:34.817960] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-13T22:19:35.617910] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-13T22:19:35.828252] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T22:19:35.961754] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T22:19:36.331313] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T22:19:36.417933] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-13T22:19:37.217968] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-13T22:19:37.298369] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T22:19:37.783340] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T22:19:37.787906] [INFO ] [REMOTE ] WAT: Full fetch complete (50249 records). [2025-10-13T22:19:37.788045] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-13T22:19:38.027376] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-13T22:19:38.198577] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-13T22:19:38.198691] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-13T22:19:38.199864] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-13T22:19:38.199929] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-13T22:19:38.201111] [DEBUG] [LOCAL ] WAT: Trimmed 50249 records to 35698 (keeping 200 days of data) [2025-10-13T22:19:38.412736] [DEBUG] [LOCAL ] WAT: Primary data saved (35698 records). [2025-10-13T22:19:38.412885] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-13T22:19:38.412977] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 31.1s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-13T22:19:38.577481] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:38.625582] [DEBUG] [LOCAL ] WCN: Loaded 48658 existing records from primary storage. [2025-10-13T22:19:38.625941] [INFO ] [MAIN ] WCN: Loaded 48658 existing records. [2025-10-13T22:19:38.812281] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:38.812509] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-13T22:19:38.812556] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-13T22:19:38.813155] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-13T22:19:38.813213] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-13T22:19:38.824332] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-13T22:19:39.165768] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:39.617941] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-13T22:19:39.707142] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T22:19:39.904787] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T22:19:40.417918] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-13T22:19:41.217914] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-13T22:19:41.337832] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T22:19:41.562544] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T22:19:41.738517] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T22:19:42.017954] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-13T22:19:42.466934] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T22:19:42.817955] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-13T22:19:43.617950] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-13T22:19:44.175681] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T22:19:44.417931] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-13T22:19:44.540059] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T22:19:45.217943] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-13T22:19:46.017944] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-13T22:19:46.055137] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T22:19:46.719973] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T22:19:46.722070] [INFO ] [REMOTE ] WBX: Full fetch complete (23521 records). [2025-10-13T22:19:46.722176] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-13T22:19:46.820968] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-13T22:19:47.157200] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T22:19:47.193669] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-13T22:19:47.194211] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-13T22:19:47.195172] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-13T22:19:47.195235] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-13T22:19:47.195830] [DEBUG] [LOCAL ] WBX: Trimmed 23521 records to 10656 (keeping 200 days of data) [2025-10-13T22:19:47.254336] [DEBUG] [LOCAL ] WBX: Primary data saved (10656 records). [2025-10-13T22:19:47.254478] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-13T22:19:47.254554] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBX took 28.8s. Estimated remaining: 13m 38s. Rate: 7.1 symbols/min [2025-10-13T22:19:47.422760] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:47.454928] [DEBUG] [LOCAL ] WD: Loaded 23365 existing records from primary storage. [2025-10-13T22:19:47.455210] [INFO ] [MAIN ] WD: Loaded 23365 existing records. [2025-10-13T22:19:47.624130] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-13T22:19:47.628843] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:47.629875] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-13T22:19:47.629932] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-13T22:19:47.630286] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-13T22:19:47.630343] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-13T22:19:47.997298] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:48.417910] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-13T22:19:48.514800] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T22:19:49.217937] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-13T22:19:49.363878] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T22:19:49.681095] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T22:19:50.017939] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-13T22:19:50.771033] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T22:19:50.817904] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-13T22:19:50.857094] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T22:19:51.617923] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-13T22:19:52.143096] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T22:19:52.312777] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T22:19:52.417914] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-13T22:19:53.217922] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-13T22:19:53.572129] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T22:19:54.017929] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-13T22:19:54.703859] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T22:19:54.709158] [INFO ] [REMOTE ] WBS: Full fetch complete (69828 records). [2025-10-13T22:19:54.709274] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-13T22:19:54.825729] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-13T22:19:55.176185] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-13T22:19:55.176504] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-13T22:19:55.178208] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-13T22:19:55.178401] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-13T22:19:55.180364] [DEBUG] [LOCAL ] WBS: Trimmed 69828 records to 48737 (keeping 200 days of data) [2025-10-13T22:19:55.314905] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T22:19:55.507854] [DEBUG] [LOCAL ] WBS: Primary data saved (48737 records). [2025-10-13T22:19:55.507997] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-13T22:19:55.508087] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBS took 37.8s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-13T22:19:55.623102] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-13T22:19:55.676070] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:19:55.694461] [DEBUG] [LOCAL ] WDH: Loaded 18268 existing records from primary storage. [2025-10-13T22:19:55.694719] [INFO ] [MAIN ] WDH: Loaded 18268 existing records. [2025-10-13T22:19:55.873146] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:19:55.873376] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-13T22:19:55.873433] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-13T22:19:55.873746] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-13T22:19:55.873803] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-13T22:19:56.218282] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:19:56.417882] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-13T22:19:56.611866] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T22:19:56.750922] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T22:19:57.217889] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-13T22:19:57.240614] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T22:19:58.017974] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-13T22:19:58.250768] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T22:19:58.817921] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-13T22:19:59.617894] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-13T22:19:59.875896] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T22:20:00.093938] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T22:20:00.417939] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-13T22:20:01.217915] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-13T22:20:01.279352] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T22:20:01.496934] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T22:20:02.017966] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-13T22:20:02.201171] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T22:20:02.817938] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-13T22:20:03.617950] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-13T22:20:03.761750] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T22:20:03.847569] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T22:20:04.417923] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-13T22:20:05.217944] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-13T22:20:05.319519] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T22:20:05.552333] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T22:20:06.017915] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-13T22:20:06.113450] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T22:20:06.817916] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-13T22:20:07.004009] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T22:20:07.006296] [INFO ] [REMOTE ] WD: Full fetch complete (33190 records). [2025-10-13T22:20:07.006393] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-13T22:20:07.383850] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-13T22:20:07.383931] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-13T22:20:07.384715] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-13T22:20:07.384778] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-13T22:20:07.385577] [DEBUG] [LOCAL ] WD: Trimmed 33190 records to 23185 (keeping 200 days of data) [2025-10-13T22:20:07.532228] [DEBUG] [LOCAL ] WD: Primary data saved (23185 records). [2025-10-13T22:20:07.532370] [INFO ] [MAIN ] WD: Full history saved. [2025-10-13T22:20:07.532457] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WD took 20.3s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-13T22:20:07.625050] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-13T22:20:07.698182] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T22:20:07.734015] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:07.757015] [DEBUG] [LOCAL ] WDI: Loaded 21388 existing records from primary storage. [2025-10-13T22:20:07.757270] [INFO ] [MAIN ] WDI: Loaded 21388 existing records. [2025-10-13T22:20:07.931625] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:07.931864] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-13T22:20:07.931915] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-13T22:20:07.932159] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-13T22:20:07.932197] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-13T22:20:08.283458] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:08.417930] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-13T22:20:09.217913] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-13T22:20:09.251480] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T22:20:09.747895] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T22:20:09.772803] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T22:20:10.017921] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-13T22:20:10.722470] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-13T22:20:10.817982] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-13T22:20:11.617922] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-13T22:20:12.049830] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T22:20:12.417927] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-13T22:20:12.979365] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T22:20:13.217996] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-13T22:20:14.018007] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-13T22:20:14.163546] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T22:20:14.794370] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T22:20:14.817897] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-13T22:20:14.862915] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T22:20:15.617894] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-13T22:20:15.945824] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T22:20:16.417986] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-13T22:20:17.180241] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T22:20:17.217896] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-13T22:20:17.329494] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T22:20:18.017938] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-13T22:20:18.160733] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T22:20:18.164416] [INFO ] [REMOTE ] WCC: Full fetch complete (57325 records). [2025-10-13T22:20:18.164516] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-13T22:20:18.548600] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-13T22:20:18.548714] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-13T22:20:18.549956] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-13T22:20:18.550030] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-13T22:20:18.551280] [DEBUG] [LOCAL ] WCC: Trimmed 57325 records to 39131 (keeping 200 days of data) [2025-10-13T22:20:18.804861] [DEBUG] [LOCAL ] WCC: Primary data saved (39131 records). [2025-10-13T22:20:18.805053] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-13T22:20:18.805174] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCC took 45.4s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-13T22:20:18.817898] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-13T22:20:19.061751] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T22:20:19.617953] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-13T22:20:20.194556] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T22:20:20.417985] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-13T22:20:20.459027] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T22:20:21.142070] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T22:20:21.217946] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-13T22:20:22.017946] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-13T22:20:22.513020] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T22:20:22.817937] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-13T22:20:23.390612] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T22:20:23.617902] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-13T22:20:23.925947] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T22:20:24.417923] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-13T22:20:24.617222] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T22:20:24.620178] [INFO ] [REMOTE ] WDH: Full fetch complete (23754 records). [2025-10-13T22:20:24.620253] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-13T22:20:24.989456] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-13T22:20:24.989547] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-13T22:20:24.990164] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-13T22:20:24.990281] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-13T22:20:24.991078] [DEBUG] [LOCAL ] WDH: Trimmed 23754 records to 18004 (keeping 200 days of data) [2025-10-13T22:20:25.102002] [DEBUG] [LOCAL ] WDH: Primary data saved (18004 records). [2025-10-13T22:20:25.102319] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-13T22:20:25.102429] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WDH took 29.6s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-13T22:20:25.217970] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-13T22:20:25.800041] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T22:20:25.985335] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T22:20:26.017887] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-13T22:20:26.817902] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-13T22:20:27.040196] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T22:20:27.617932] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-13T22:20:28.285350] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T22:20:28.290400] [INFO ] [REMOTE ] WCN: Full fetch complete (69242 records). [2025-10-13T22:20:28.290508] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-13T22:20:28.696781] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T22:20:28.696339] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-13T22:20:28.701397] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-13T22:20:28.701707] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-13T22:20:28.702951] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-13T22:20:28.703033] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-13T22:20:28.705224] [DEBUG] [LOCAL ] WCN: Trimmed 69242 records to 47938 (keeping 200 days of data) [2025-10-13T22:20:28.995543] [DEBUG] [LOCAL ] WCN: Primary data saved (47938 records). [2025-10-13T22:20:28.995711] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-13T22:20:28.995811] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WCN took 50.6s. Estimated remaining: 12m 56s. Rate: 7.1 symbols/min [2025-10-13T22:20:29.800384] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T22:20:29.804898] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-13T22:20:30.935047] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T22:20:30.937447] [INFO ] [REMOTE ] WDI: Full fetch complete (30440 records). [2025-10-13T22:20:30.937565] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-13T22:20:31.318255] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-13T22:20:31.318423] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-13T22:20:31.319341] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-13T22:20:31.319407] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-13T22:20:31.320569] [DEBUG] [LOCAL ] WDI: Trimmed 30440 records to 21111 (keeping 200 days of data) [2025-10-13T22:20:31.446615] [DEBUG] [LOCAL ] WDI: Primary data saved (21111 records). [2025-10-13T22:20:31.446774] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-13T22:20:31.446860] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 23.9s. Estimated remaining: 12m 47s. Rate: 7.1 symbols/min [2025-10-13T22:20:32.073564] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:32.181431] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:32.178763] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:32.182563] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:32.196349] [DEBUG] [LOCAL ] WEA: Loaded 7639 existing records from primary storage. [2025-10-13T22:20:32.210874] [INFO ] [MAIN ] WEA: Loaded 7639 existing records. [2025-10-13T22:20:32.428236] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:32.425091] [DEBUG] [LOCAL ] WDS: Loaded 43729 existing records from primary storage. [2025-10-13T22:20:32.440058] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-13T22:20:32.455021] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-13T22:20:32.455545] [INFO ] [MAIN ] WDS: Loaded 43729 existing records. [2025-10-13T22:20:32.467863] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-13T22:20:32.461785] [DEBUG] [LOCAL ] WEAV: Loaded 42583 existing records from primary storage. [2025-10-13T22:20:32.477632] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-13T22:20:32.509367] [INFO ] [MAIN ] WEAV: Loaded 42583 existing records. [2025-10-13T22:20:32.727548] [DEBUG] [LOCAL ] WEC: Loaded 52920 existing records from primary storage. [2025-10-13T22:20:32.812531] [INFO ] [MAIN ] WEC: Loaded 52920 existing records. [2025-10-13T22:20:32.892508] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:32.989502] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-13T22:20:33.058388] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-13T22:20:33.157345] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-13T22:20:33.171870] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:33.157508] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-13T22:20:33.175417] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-13T22:20:33.242812] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-13T22:20:33.286264] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-13T22:20:33.388404] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-13T22:20:33.539597] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:33.547849] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:33.577430] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-13T22:20:33.577484] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-13T22:20:33.639525] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-13T22:20:33.666692] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-13T22:20:33.696480] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-13T22:20:34.270240] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:34.296025] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-13T22:20:34.343611] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T22:20:34.383163] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-13T22:20:34.447443] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:34.447867] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-13T22:20:34.526773] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:34.527317] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-13T22:20:35.082625] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T22:20:35.084526] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-13T22:20:35.704193] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T22:20:35.705809] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-13T22:20:35.804308] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T22:20:35.813400] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-13T22:20:36.033980] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T22:20:36.312941] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T22:20:36.381474] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T22:20:36.417903] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-13T22:20:37.153687] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T22:20:37.217899] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-13T22:20:37.282998] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T22:20:37.789493] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T22:20:38.017934] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-13T22:20:38.732947] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T22:20:38.817987] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-13T22:20:39.617960] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-13T22:20:40.267547] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T22:20:40.417893] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-13T22:20:40.430412] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T22:20:41.217952] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-13T22:20:41.861614] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T22:20:42.003375] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T22:20:42.017883] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-13T22:20:42.817930] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-13T22:20:43.563276] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:20:43.617948] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-13T22:20:44.056215] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T22:20:44.326168] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T22:20:44.417911] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-13T22:20:44.839267] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T22:20:44.840735] [INFO ] [REMOTE ] WEA: Full fetch complete (9944 records). [2025-10-13T22:20:44.840801] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-13T22:20:45.191225] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-13T22:20:45.191304] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-13T22:20:45.191578] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-13T22:20:45.191617] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-13T22:20:45.192066] [DEBUG] [LOCAL ] WEA: Trimmed 9944 records to 7656 (keeping 200 days of data) [2025-10-13T22:20:45.224990] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-13T22:20:45.240739] [DEBUG] [LOCAL ] WEA: Primary data saved (7656 records). [2025-10-13T22:20:45.240817] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-13T22:20:45.240903] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 13.8s. Estimated remaining: 12m 39s. Rate: 7.1 symbols/min [2025-10-13T22:20:45.407381] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:20:45.464858] [DEBUG] [LOCAL ] WELL: Loaded 53103 existing records from primary storage. [2025-10-13T22:20:45.465246] [INFO ] [MAIN ] WELL: Loaded 53103 existing records. [2025-10-13T22:20:45.640066] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:20:45.640307] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-13T22:20:45.640354] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-13T22:20:45.640896] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-13T22:20:45.640953] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-13T22:20:45.986844] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:20:46.017891] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-13T22:20:46.817930] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-13T22:20:46.922624] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T22:20:47.603520] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T22:20:47.617883] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-13T22:20:48.067471] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T22:20:48.417973] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-13T22:20:49.217959] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-13T22:20:49.525369] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T22:20:49.874313] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T22:20:50.017979] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-13T22:20:50.817942] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-13T22:20:51.044475] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T22:20:51.587679] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T22:20:51.617895] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-13T22:20:52.417944] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-13T22:20:52.445158] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T22:20:52.717289] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T22:20:53.217946] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-13T22:20:53.752430] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T22:20:54.017946] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-13T22:20:54.829763] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-13T22:20:54.832722] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:20:55.560610] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:20:55.617898] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-13T22:20:56.417921] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-13T22:20:56.808627] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T22:20:57.112969] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T22:20:57.217968] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-13T22:20:57.657891] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T22:20:58.017995] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-13T22:20:58.751209] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T22:20:58.817896] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-13T22:20:59.617913] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-13T22:20:59.742256] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T22:21:00.340781] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:21:00.417903] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-13T22:21:01.217928] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-13T22:21:01.310594] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T22:21:01.865933] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T22:21:01.870958] [INFO ] [REMOTE ] WEAV: Full fetch complete (61622 records). [2025-10-13T22:21:01.871102] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-13T22:21:02.023004] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-13T22:21:02.264069] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-13T22:21:02.264186] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-13T22:21:02.265369] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-13T22:21:02.265434] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-13T22:21:02.267149] [DEBUG] [LOCAL ] WEAV: Trimmed 61622 records to 42194 (keeping 200 days of data) [2025-10-13T22:21:02.531936] [DEBUG] [LOCAL ] WEAV: Primary data saved (42194 records). [2025-10-13T22:21:02.532087] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-13T22:21:02.532182] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 31.1s. Estimated remaining: 12m 31s. Rate: 7.1 symbols/min [2025-10-13T22:21:02.716206] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:02.762126] [DEBUG] [LOCAL ] WES: Loaded 49050 existing records from primary storage. [2025-10-13T22:21:02.762474] [INFO ] [MAIN ] WES: Loaded 49050 existing records. [2025-10-13T22:21:02.826393] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-13T22:21:02.958082] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:02.958440] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-13T22:21:02.958692] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-13T22:21:02.969553] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-13T22:21:02.988366] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-13T22:21:03.055332] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T22:21:03.349486] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:03.617924] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-13T22:21:03.785753] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T22:21:04.417953] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-13T22:21:04.877351] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T22:21:05.215581] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T22:21:05.224579] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-13T22:21:05.943384] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T22:21:06.017904] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-13T22:21:06.122757] [DEBUG] [REMOTE ] WDS: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T22:21:06.123100] [WARN ] [REMOTE ] WDS: No data returned for month 2025-10 [2025-10-13T22:21:06.123193] [FATAL] [REMOTE ] WDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:21:06.123311] [FATAL] [MAIN ] WDS: Failed to fetch primary data. [2025-10-13T22:21:06.123377] [WARN ] [MAIN ] WDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:21:06.123449] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-13T22:21:06.123512] [DEBUG] [LOCAL ] WDS: No primary data file found to delete. [2025-10-13T22:21:06.123549] [INFO ] [LOCAL ] WDS: Starting deletion of derivative data. [2025-10-13T22:21:06.123754] [DEBUG] [LOCAL ] WDS: Deleted derivative data file. [2025-10-13T22:21:06.123842] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 34.7s. Estimated remaining: 12m 22s. Rate: 7.1 symbols/min [2025-10-13T22:21:06.301989] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:06.345319] [DEBUG] [LOCAL ] WEX: Loaded 34207 existing records from primary storage. [2025-10-13T22:21:06.345636] [INFO ] [MAIN ] WEX: Loaded 34207 existing records. [2025-10-13T22:21:06.536744] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:06.536975] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-13T22:21:06.537025] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-13T22:21:06.537230] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-13T22:21:06.537270] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-13T22:21:06.819193] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-13T22:21:06.913710] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:06.946246] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T22:21:07.617930] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-13T22:21:08.417905] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-13T22:21:08.525933] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T22:21:09.204382] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T22:21:09.217899] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-13T22:21:10.017961] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-13T22:21:10.313716] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T22:21:10.656384] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T22:21:10.817946] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-13T22:21:11.247233] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T22:21:11.617938] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-13T22:21:12.417964] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-13T22:21:12.741723] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T22:21:13.218092] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-13T22:21:13.264507] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:21:14.017916] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-13T22:21:14.201874] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T22:21:14.818009] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-13T22:21:15.137922] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T22:21:15.592628] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T22:21:15.617892] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-13T22:21:16.417928] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-13T22:21:16.681508] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T22:21:17.178139] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T22:21:17.217884] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-13T22:21:17.970320] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:21:18.017912] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-13T22:21:18.817958] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-13T22:21:18.888788] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T22:21:19.155713] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T22:21:19.162980] [INFO ] [REMOTE ] WEC: Full fetch complete (75561 records). [2025-10-13T22:21:19.163249] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-13T22:21:19.587310] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-13T22:21:19.588121] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-13T22:21:19.590090] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-13T22:21:19.590181] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-13T22:21:19.592351] [DEBUG] [LOCAL ] WEC: Trimmed 75561 records to 52165 (keeping 200 days of data) [2025-10-13T22:21:19.656903] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-13T22:21:19.750722] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T22:21:20.013169] [DEBUG] [LOCAL ] WEC: Primary data saved (52165 records). [2025-10-13T22:21:20.013339] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-13T22:21:20.013475] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 48.6s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-13T22:21:20.180764] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:20.193796] [DEBUG] [LOCAL ] WF: Loaded 10888 existing records from primary storage. [2025-10-13T22:21:20.194003] [INFO ] [MAIN ] WF: Loaded 10888 existing records. [2025-10-13T22:21:20.371060] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:20.371284] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-13T22:21:20.371337] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-13T22:21:20.371726] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-13T22:21:20.371797] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-13T22:21:20.426125] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-13T22:21:20.725317] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:21.171928] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T22:21:21.217903] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-13T22:21:22.017934] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-13T22:21:22.307815] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T22:21:22.368449] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T22:21:22.817926] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-13T22:21:23.617909] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-13T22:21:23.766618] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T22:21:24.193697] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T22:21:24.201944] [INFO ] [REMOTE ] WELL: Full fetch complete (75719 records). [2025-10-13T22:21:24.202115] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-13T22:21:24.406503] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T22:21:24.440265] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-13T22:21:24.632323] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-13T22:21:24.632415] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-13T22:21:24.633727] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-13T22:21:24.633791] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-13T22:21:24.635326] [DEBUG] [LOCAL ] WELL: Trimmed 75719 records to 52331 (keeping 200 days of data) [2025-10-13T22:21:24.974959] [DEBUG] [LOCAL ] WELL: Primary data saved (52331 records). [2025-10-13T22:21:24.975123] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-13T22:21:24.975216] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 39.7s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-13T22:21:25.139533] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:25.192423] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-10-13T22:21:25.192800] [INFO ] [MAIN ] WFC: Loaded 54528 existing records. [2025-10-13T22:21:25.223146] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-13T22:21:25.401957] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:25.402345] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-13T22:21:25.402409] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-13T22:21:25.402771] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-13T22:21:25.402828] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-13T22:21:25.635798] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T22:21:25.771295] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:26.018149] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-13T22:21:26.817912] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-13T22:21:26.942762] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T22:21:27.006687] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T22:21:27.617935] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-13T22:21:28.183106] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T22:21:28.417929] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-13T22:21:28.515985] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T22:21:29.217948] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-13T22:21:29.799185] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T22:21:30.017901] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-13T22:21:30.096972] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T22:21:30.817904] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-13T22:21:31.368061] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T22:21:31.617955] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-13T22:21:32.417930] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-13T22:21:32.589448] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T22:21:33.225464] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-13T22:21:33.251022] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T22:21:33.285519] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T22:21:33.288696] [INFO ] [REMOTE ] WEX: Full fetch complete (50256 records). [2025-10-13T22:21:33.288781] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-13T22:21:33.659911] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-13T22:21:33.659999] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-13T22:21:33.661048] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-13T22:21:33.661111] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-13T22:21:33.663167] [DEBUG] [LOCAL ] WEX: Trimmed 50256 records to 33233 (keeping 200 days of data) [2025-10-13T22:21:33.868371] [DEBUG] [LOCAL ] WEX: Primary data saved (33233 records). [2025-10-13T22:21:33.868499] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-13T22:21:33.868585] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WEX took 27.7s. Estimated remaining: 11m 57s. Rate: 7.1 symbols/min [2025-10-13T22:21:34.031312] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-13T22:21:34.034899] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:34.061736] [DEBUG] [LOCAL ] WFG: Loaded 25167 existing records from primary storage. [2025-10-13T22:21:34.062178] [INFO ] [MAIN ] WFG: Loaded 25167 existing records. [2025-10-13T22:21:34.237531] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:34.237863] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-13T22:21:34.237913] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-13T22:21:34.238226] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-13T22:21:34.238281] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-13T22:21:34.584272] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:34.817926] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-13T22:21:35.012106] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T22:21:35.267848] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T22:21:35.617948] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-13T22:21:35.689368] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T22:21:36.144245] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-13T22:21:36.417942] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-13T22:21:37.217952] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-13T22:21:38.017932] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-13T22:21:38.028871] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T22:21:38.241076] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T22:21:38.817950] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-13T22:21:39.617911] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-13T22:21:39.653580] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T22:21:39.896043] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T22:21:40.417894] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-13T22:21:40.817637] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T22:21:41.173584] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T22:21:41.218015] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-13T22:21:42.008039] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T22:21:42.017884] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-13T22:21:42.671383] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T22:21:42.672931] [INFO ] [REMOTE ] WF: Full fetch complete (16137 records). [2025-10-13T22:21:42.672999] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-13T22:21:42.826031] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-13T22:21:43.037963] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-13T22:21:43.038042] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-13T22:21:43.038451] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-13T22:21:43.038490] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-13T22:21:43.039018] [DEBUG] [LOCAL ] WF: Trimmed 16137 records to 10850 (keeping 200 days of data) [2025-10-13T22:21:43.103859] [DEBUG] [LOCAL ] WF: Primary data saved (10850 records). [2025-10-13T22:21:43.104006] [INFO ] [MAIN ] WF: Full history saved. [2025-10-13T22:21:43.104093] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WF took 23.1s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-13T22:21:43.267287] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:43.308338] [DEBUG] [LOCAL ] WGO: Loaded 39034 existing records from primary storage. [2025-10-13T22:21:43.308639] [INFO ] [MAIN ] WGO: Loaded 39034 existing records. [2025-10-13T22:21:43.480109] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:43.480354] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-13T22:21:43.480415] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-13T22:21:43.480830] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-13T22:21:43.480888] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-13T22:21:43.623159] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-13T22:21:43.837207] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:44.380724] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:21:44.417897] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-13T22:21:44.835996] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T22:21:45.217959] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-13T22:21:46.017914] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-13T22:21:46.649499] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-13T22:21:46.823286] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-13T22:21:46.833553] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T22:21:47.336604] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T22:21:47.617998] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-13T22:21:48.340387] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T22:21:48.347196] [INFO ] [REMOTE ] WES: Full fetch complete (70184 records). [2025-10-13T22:21:48.347411] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-13T22:21:48.428631] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-13T22:21:48.770402] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-13T22:21:48.770497] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-13T22:21:48.771739] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-13T22:21:48.771804] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-13T22:21:48.773204] [DEBUG] [LOCAL ] WES: Trimmed 70184 records to 48437 (keeping 200 days of data) [2025-10-13T22:21:49.084804] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T22:21:49.102164] [DEBUG] [LOCAL ] WES: Primary data saved (48437 records). [2025-10-13T22:21:49.102276] [INFO ] [MAIN ] WES: Full history saved. [2025-10-13T22:21:49.102371] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WES took 46.6s. Estimated remaining: 11m 40s. Rate: 7.1 symbols/min [2025-10-13T22:21:49.223008] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-13T22:21:49.269110] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:21:49.312162] [DEBUG] [LOCAL ] WH: Loaded 45953 existing records from primary storage. [2025-10-13T22:21:49.312478] [INFO ] [MAIN ] WH: Loaded 45953 existing records. [2025-10-13T22:21:49.507268] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:21:49.507514] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-13T22:21:49.507563] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-13T22:21:49.507841] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-13T22:21:49.507898] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-13T22:21:49.856896] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:21:50.017880] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-13T22:21:50.723694] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T22:21:50.761079] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-13T22:21:50.817885] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-13T22:21:51.631601] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-13T22:21:51.635786] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T22:21:52.417913] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-13T22:21:52.881783] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T22:21:52.891836] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-13T22:21:53.217939] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-13T22:21:53.985502] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T22:21:54.017886] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-13T22:21:54.817912] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-13T22:21:54.942135] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T22:21:55.558222] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:21:55.617957] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-13T22:21:56.428518] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-13T22:21:56.432289] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T22:21:57.217936] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-13T22:21:57.564538] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T22:21:58.017917] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-13T22:21:58.253585] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T22:21:58.278839] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T22:21:58.817961] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-13T22:21:59.417607] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T22:21:59.617958] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-13T22:22:00.105876] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T22:22:00.417920] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-13T22:22:00.960297] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T22:22:01.217946] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-13T22:22:02.019558] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-13T22:22:02.028103] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T22:22:02.660043] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T22:22:02.817953] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-13T22:22:03.155266] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T22:22:03.617984] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-13T22:22:04.417941] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-13T22:22:04.932334] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T22:22:05.198568] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-13T22:22:05.217896] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-13T22:22:05.581603] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T22:22:06.017950] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-13T22:22:06.817934] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-13T22:22:07.027862] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T22:22:07.621166] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-13T22:22:07.626345] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T22:22:08.122595] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T22:22:08.417925] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-13T22:22:09.070259] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T22:22:09.217970] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-13T22:22:09.496113] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T22:22:10.017980] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-13T22:22:10.566581] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T22:22:10.817956] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-13T22:22:11.503490] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T22:22:11.617955] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-13T22:22:12.189320] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T22:22:12.195949] [INFO ] [REMOTE ] WFC: Full fetch complete (77792 records). [2025-10-13T22:22:12.196129] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-13T22:22:12.425576] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-13T22:22:12.581715] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T22:22:12.674287] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-13T22:22:12.674392] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-13T22:22:12.675864] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-13T22:22:12.675947] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-13T22:22:12.677684] [DEBUG] [LOCAL ] WFC: Trimmed 77792 records to 53748 (keeping 200 days of data) [2025-10-13T22:22:13.029109] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-13T22:22:13.029276] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-13T22:22:13.029369] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 48.1s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-13T22:22:13.206180] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:13.217983] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-13T22:22:13.247369] [DEBUG] [LOCAL ] WHD: Loaded 40649 existing records from primary storage. [2025-10-13T22:22:13.247772] [INFO ] [MAIN ] WHD: Loaded 40649 existing records. [2025-10-13T22:22:13.432362] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:13.432750] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-13T22:22:13.432842] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-13T22:22:13.433122] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-13T22:22:13.433178] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-13T22:22:13.534373] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T22:22:13.555379] [INFO ] [REMOTE ] WFG: Full fetch complete (35917 records). [2025-10-13T22:22:13.565861] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-13T22:22:14.027173] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-13T22:22:14.041746] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:14.258487] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-13T22:22:14.258589] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-13T22:22:14.259959] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-13T22:22:14.260030] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-13T22:22:14.261086] [DEBUG] [LOCAL ] WFG: Trimmed 35917 records to 24768 (keeping 200 days of data) [2025-10-13T22:22:14.433630] [DEBUG] [LOCAL ] WFG: Primary data saved (24768 records). [2025-10-13T22:22:14.433814] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-13T22:22:14.433910] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 40.6s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-13T22:22:14.601183] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:14.607294] [DEBUG] [LOCAL ] WHG: Loaded 3257 existing records from primary storage. [2025-10-13T22:22:14.607488] [INFO ] [MAIN ] WHG: Loaded 3257 existing records. [2025-10-13T22:22:14.786422] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:14.786850] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-13T22:22:14.786993] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-13T22:22:14.787278] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-13T22:22:14.787473] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-13T22:22:14.828694] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-13T22:22:14.923055] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T22:22:15.205294] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:15.464284] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T22:22:15.468810] [INFO ] [REMOTE ] WGO: Full fetch complete (57214 records). [2025-10-13T22:22:15.468965] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-13T22:22:15.623017] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-13T22:22:15.904762] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-13T22:22:15.904864] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-13T22:22:15.906234] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-13T22:22:15.906327] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-13T22:22:15.907974] [DEBUG] [LOCAL ] WGO: Trimmed 57214 records to 38304 (keeping 200 days of data) [2025-10-13T22:22:16.163379] [DEBUG] [LOCAL ] WGO: Primary data saved (38304 records). [2025-10-13T22:22:16.163546] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-13T22:22:16.163637] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 33.1s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-13T22:22:16.337871] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:16.359920] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T22:22:16.410582] [DEBUG] [LOCAL ] WHR: Loaded 49139 existing records from primary storage. [2025-10-13T22:22:16.410957] [INFO ] [MAIN ] WHR: Loaded 49139 existing records. [2025-10-13T22:22:16.423935] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-13T22:22:16.592787] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:16.593048] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-13T22:22:16.593098] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-13T22:22:16.593576] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-13T22:22:16.593617] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-13T22:22:16.954050] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:17.037972] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T22:22:17.042527] [INFO ] [REMOTE ] WH: Full fetch complete (64919 records). [2025-10-13T22:22:17.042670] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-13T22:22:17.220003] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-13T22:22:17.428313] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-13T22:22:17.428410] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-13T22:22:17.429630] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-13T22:22:17.429715] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-13T22:22:17.431107] [DEBUG] [LOCAL ] WH: Trimmed 64919 records to 45237 (keeping 200 days of data) [2025-10-13T22:22:17.714048] [DEBUG] [LOCAL ] WH: Primary data saved (45237 records). [2025-10-13T22:22:17.714196] [INFO ] [MAIN ] WH: Full history saved. [2025-10-13T22:22:17.714309] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WH took 28.6s. Estimated remaining: 11m 6s. Rate: 7.1 symbols/min [2025-10-13T22:22:17.880528] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:17.888237] [DEBUG] [LOCAL ] WIA: Loaded 5040 existing records from primary storage. [2025-10-13T22:22:17.888456] [INFO ] [MAIN ] WIA: Loaded 5040 existing records. [2025-10-13T22:22:18.021212] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-13T22:22:18.098120] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:18.100935] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-13T22:22:18.100782] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T22:22:18.109295] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-13T22:22:18.110062] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-13T22:22:18.110121] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-13T22:22:18.489283] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:18.821492] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T22:22:18.821286] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-13T22:22:18.859075] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T22:22:19.438356] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T22:22:19.617930] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-13T22:22:20.417928] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-13T22:22:20.874502] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T22:22:21.042190] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T22:22:21.217950] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-13T22:22:21.675479] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T22:22:22.017938] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-13T22:22:22.817973] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-13T22:22:23.320750] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T22:22:23.623050] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-13T22:22:23.646091] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T22:22:24.417924] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-13T22:22:25.217916] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-13T22:22:25.761340] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T22:22:25.882605] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T22:22:26.017914] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-13T22:22:26.311928] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-13T22:22:26.445501] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-13T22:22:26.817928] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-13T22:22:27.485695] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T22:22:27.617932] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-13T22:22:28.270826] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T22:22:28.417928] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-13T22:22:29.218023] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-13T22:22:29.689201] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-13T22:22:30.023509] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-13T22:22:30.034751] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T22:22:30.688605] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-13T22:22:30.817949] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-13T22:22:31.617934] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-13T22:22:32.417946] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-13T22:22:32.498066] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T22:22:32.936131] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T22:22:33.117626] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T22:22:33.217912] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-13T22:22:34.017984] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-13T22:22:34.546986] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T22:22:34.793760] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T22:22:34.817897] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-13T22:22:35.173861] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T22:22:35.617937] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-13T22:22:36.107035] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T22:22:36.417914] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-13T22:22:37.025012] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T22:22:37.217943] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-13T22:22:37.675001] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T22:22:38.017937] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-13T22:22:38.817977] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-13T22:22:39.260077] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T22:22:39.260875] [INFO ] [REMOTE ] WHG: Full fetch complete (4483 records). [2025-10-13T22:22:39.260942] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-13T22:22:39.618364] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-13T22:22:39.619709] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-13T22:22:39.619811] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-13T22:22:39.620030] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-13T22:22:39.620073] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-13T22:22:39.620435] [DEBUG] [LOCAL ] WHG: Trimmed 4483 records to 3175 (keeping 200 days of data) [2025-10-13T22:22:39.640800] [DEBUG] [LOCAL ] WHG: Primary data saved (3175 records). [2025-10-13T22:22:39.640911] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-13T22:22:39.640994] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 25.2s. Estimated remaining: 10m 58s. Rate: 7.1 symbols/min [2025-10-13T22:22:39.814773] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:39.846778] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T22:22:39.867010] [DEBUG] [LOCAL ] WINN: Loaded 11739 existing records from primary storage. [2025-10-13T22:22:39.867294] [INFO ] [MAIN ] WINN: Loaded 11739 existing records. [2025-10-13T22:22:40.042617] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:40.043010] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-13T22:22:40.043070] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-13T22:22:40.043934] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-13T22:22:40.044000] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-13T22:22:40.305107] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T22:22:40.428791] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:40.423166] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-13T22:22:41.217943] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-13T22:22:41.743442] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T22:22:42.017959] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-13T22:22:42.048226] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T22:22:42.566214] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T22:22:42.817924] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-13T22:22:43.617986] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-13T22:22:44.249449] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T22:22:44.334528] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:22:44.417901] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-13T22:22:45.217927] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-13T22:22:45.755198] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T22:22:45.756797] [INFO ] [REMOTE ] WIA: Full fetch complete (7291 records). [2025-10-13T22:22:45.766953] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-13T22:22:45.768022] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T22:22:45.843969] [INFO ] [REMOTE ] WHD: Full fetch complete (57598 records). [2025-10-13T22:22:45.855009] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-13T22:22:46.020438] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-13T22:22:46.564178] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-13T22:22:46.566242] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-13T22:22:46.581625] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-13T22:22:46.585008] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-13T22:22:46.585233] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-13T22:22:46.585308] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-13T22:22:46.585823] [DEBUG] [LOCAL ] WIA: Trimmed 7291 records to 4999 (keeping 200 days of data) [2025-10-13T22:22:46.587177] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-13T22:22:46.587255] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-13T22:22:46.610561] [DEBUG] [LOCAL ] WHD: Trimmed 57598 records to 40114 (keeping 200 days of data) [2025-10-13T22:22:46.713457] [DEBUG] [LOCAL ] WIA: Primary data saved (4999 records). [2025-10-13T22:22:46.716575] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-13T22:22:46.716936] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WIA took 29.0s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-13T22:22:46.823886] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-13T22:22:46.904259] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:47.010432] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T22:22:47.081078] [DEBUG] [LOCAL ] WIT: Loaded 53178 existing records from primary storage. [2025-10-13T22:22:47.082631] [INFO ] [MAIN ] WIT: Loaded 53178 existing records. [2025-10-13T22:22:47.274613] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:47.278687] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-13T22:22:47.279895] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-13T22:22:47.284726] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-13T22:22:47.285078] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-13T22:22:47.414539] [DEBUG] [LOCAL ] WHD: Primary data saved (40114 records). [2025-10-13T22:22:47.419874] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-13T22:22:47.425141] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WHD took 34.4s. Estimated remaining: 10m 41s. Rate: 7.1 symbols/min [2025-10-13T22:22:47.637381] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-13T22:22:47.807681] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:22:47.879887] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:47.897126] [DEBUG] [LOCAL ] WIW: Loaded 20672 existing records from primary storage. [2025-10-13T22:22:47.897451] [INFO ] [MAIN ] WIW: Loaded 20672 existing records. [2025-10-13T22:22:48.097063] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:22:48.097318] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-13T22:22:48.097376] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-13T22:22:48.097618] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-13T22:22:48.097733] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-13T22:22:48.423976] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-13T22:22:48.454123] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:22:48.544397] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T22:22:48.804576] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T22:22:49.218040] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-13T22:22:49.948740] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T22:22:50.017951] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-13T22:22:50.466398] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T22:22:50.817934] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-13T22:22:51.617905] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-13T22:22:51.786878] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T22:22:51.853259] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T22:22:52.417905] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-13T22:22:53.217923] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-13T22:22:53.388176] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T22:22:54.017931] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-13T22:22:54.817983] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-13T22:23:04.674719] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (10.66 seconds). [2025-10-13T22:23:04.678955] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-13T22:23:05.489192] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (10.67 seconds). [2025-10-13T22:23:05.493271] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-13T22:23:06.316239] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T22:23:06.319665] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-13T22:23:06.397774] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (13.18 seconds). [2025-10-13T22:23:06.407586] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-13T22:23:06.770911] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T22:23:06.775547] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-13T22:23:07.073844] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T22:23:07.076722] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-13T22:23:07.630102] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T22:23:07.633055] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-13T22:23:07.944278] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T22:23:07.949494] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-13T22:23:08.421507] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T22:23:08.424430] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-13T22:23:08.546672] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T22:23:08.557570] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-13T22:23:08.857917] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T22:23:08.862755] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-13T22:23:09.246006] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (17.63 seconds). [2025-10-13T22:23:09.257445] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-13T22:23:09.343081] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T22:23:09.346083] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-13T22:23:09.547066] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T22:23:09.551804] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-13T22:23:10.007741] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T22:23:10.009434] [INFO ] [REMOTE ] WINN: Full fetch complete (17425 records). [2025-10-13T22:23:10.009503] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-13T22:23:10.378258] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-13T22:23:10.378424] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-13T22:23:10.378972] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-13T22:23:10.379055] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-13T22:23:10.379997] [DEBUG] [LOCAL ] WINN: Trimmed 17425 records to 11583 (keeping 200 days of data) [2025-10-13T22:23:10.467105] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T22:23:10.482121] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-13T22:23:10.505437] [DEBUG] [LOCAL ] WINN: Primary data saved (11583 records). [2025-10-13T22:23:10.505568] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-13T22:23:10.505704] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 30.9s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-13T22:23:10.676265] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:10.715664] [DEBUG] [LOCAL ] WK: Loaded 37775 existing records from primary storage. [2025-10-13T22:23:10.715991] [INFO ] [MAIN ] WK: Loaded 37775 existing records. [2025-10-13T22:23:10.893270] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:10.893780] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-13T22:23:10.893861] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-13T22:23:10.894163] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-13T22:23:10.894227] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-13T22:23:11.215502] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T22:23:11.252441] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-13T22:23:11.304897] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:11.305418] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-13T22:23:12.209212] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:23:12.220541] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-13T22:23:12.442184] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T22:23:12.451034] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-13T22:23:13.103722] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T22:23:13.114429] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-13T22:23:13.470330] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T22:23:13.478020] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-13T22:23:13.495323] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (3.94 seconds). [2025-10-13T22:23:13.500188] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-13T22:23:14.335977] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T22:23:14.341345] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-13T22:23:14.547936] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T22:23:14.559261] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-13T22:23:14.579698] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T22:23:14.817970] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-13T22:23:15.458816] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T22:23:15.617989] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-13T22:23:15.735444] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-13T22:23:15.746211] [INFO ] [REMOTE ] WHR: Full fetch complete (69083 records). [2025-10-13T22:23:15.746462] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-13T22:23:16.284451] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-13T22:23:16.284591] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-13T22:23:16.287181] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-13T22:23:16.287353] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-13T22:23:16.289780] [DEBUG] [LOCAL ] WHR: Trimmed 69083 records to 48678 (keeping 200 days of data) [2025-10-13T22:23:16.455309] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T22:23:16.476068] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T22:23:16.489289] [INFO ] [REMOTE ] WIW: Full fetch complete (29438 records). [2025-10-13T22:23:16.489067] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-13T22:23:16.494788] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-13T22:23:16.962015] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T22:23:17.055333] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-13T22:23:17.055784] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-13T22:23:17.057406] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-13T22:23:17.057491] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-13T22:23:17.060458] [DEBUG] [LOCAL ] WIW: Trimmed 29438 records to 20314 (keeping 200 days of data) [2025-10-13T22:23:17.219778] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-13T22:23:17.238317] [DEBUG] [LOCAL ] WIW: Primary data saved (20314 records). [2025-10-13T22:23:17.239152] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-13T22:23:17.239619] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WIW took 29.8s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-13T22:23:17.349702] [DEBUG] [LOCAL ] WHR: Primary data saved (48678 records). [2025-10-13T22:23:17.355194] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-13T22:23:17.360440] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WHR took 1m 1s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-13T22:23:17.529811] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:17.588092] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:17.619869] [DEBUG] [LOCAL ] WKC: Loaded 35157 existing records from primary storage. [2025-10-13T22:23:17.620246] [INFO ] [MAIN ] WKC: Loaded 35157 existing records. [2025-10-13T22:23:17.822124] [DEBUG] [LOCAL ] WLK: Loaded 46251 existing records from primary storage. [2025-10-13T22:23:17.825285] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:17.825680] [INFO ] [MAIN ] WLK: Loaded 46251 existing records. [2025-10-13T22:23:17.825928] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-13T22:23:17.868533] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-13T22:23:17.924957] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-13T22:23:17.927517] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-13T22:23:18.115721] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:18.116330] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-13T22:23:18.155281] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-13T22:23:18.222693] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-13T22:23:18.222972] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-13T22:23:18.568896] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:18.572502] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T22:23:18.578289] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-13T22:23:18.814153] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:18.817885] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-13T22:23:19.039508] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T22:23:19.617908] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-13T22:23:20.102830] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T22:23:20.133701] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T22:23:20.417962] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-13T22:23:21.217911] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-13T22:23:21.268007] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T22:23:21.839287] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T22:23:22.017960] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-13T22:23:22.582336] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T22:23:22.817923] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-13T22:23:23.306712] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T22:23:23.617937] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-13T22:23:24.417929] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-13T22:23:25.125323] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T22:23:25.217901] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-13T22:23:25.609954] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T22:23:25.685665] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-13T22:23:26.017942] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-13T22:23:26.459630] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T22:23:26.817966] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-13T22:23:27.617903] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-13T22:23:27.940389] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T22:23:28.395694] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T22:23:28.417882] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-13T22:23:28.934396] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T22:23:29.217935] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-13T22:23:30.017908] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-13T22:23:30.156528] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T22:23:30.736251] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T22:23:30.741804] [INFO ] [REMOTE ] WIT: Full fetch complete (75714 records). [2025-10-13T22:23:30.741956] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-13T22:23:30.823035] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-13T22:23:31.142426] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-13T22:23:31.142550] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-13T22:23:31.143824] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-13T22:23:31.143889] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-13T22:23:31.145687] [DEBUG] [LOCAL ] WIT: Trimmed 75714 records to 52420 (keeping 200 days of data) [2025-10-13T22:23:31.473198] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T22:23:31.491020] [DEBUG] [LOCAL ] WIT: Primary data saved (52420 records). [2025-10-13T22:23:31.491167] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-13T22:23:31.491318] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 44.8s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-13T22:23:31.627919] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-13T22:23:31.662381] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:31.673157] [DEBUG] [LOCAL ] WLKP: Loaded 7020 existing records from primary storage. [2025-10-13T22:23:31.673331] [INFO ] [MAIN ] WLKP: Loaded 7020 existing records. [2025-10-13T22:23:31.851992] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:31.852237] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-13T22:23:31.852285] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-13T22:23:31.852542] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-13T22:23:31.852694] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-13T22:23:32.219044] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:32.270508] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T22:23:32.417922] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-13T22:23:33.135274] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T22:23:33.217917] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-13T22:23:33.985981] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T22:23:34.017901] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-13T22:23:34.410023] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T22:23:34.817964] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-13T22:23:35.497208] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T22:23:35.501625] [INFO ] [REMOTE ] WK: Full fetch complete (52859 records). [2025-10-13T22:23:35.501731] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-13T22:23:35.623103] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-13T22:23:35.875777] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-13T22:23:35.875861] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-13T22:23:35.876876] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-13T22:23:35.876938] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-13T22:23:35.883394] [DEBUG] [LOCAL ] WK: Trimmed 52859 records to 37386 (keeping 200 days of data) [2025-10-13T22:23:36.108833] [DEBUG] [LOCAL ] WK: Primary data saved (37386 records). [2025-10-13T22:23:36.108987] [INFO ] [MAIN ] WK: Full history saved. [2025-10-13T22:23:36.109122] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 25.6s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-13T22:23:36.277189] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:36.277366] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-13T22:23:36.277403] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-13T22:23:36.277604] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-13T22:23:36.277672] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-13T22:23:36.277779] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-13T22:23:36.277847] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-13T22:23:36.427677] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-13T22:23:36.545907] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T22:23:36.658498] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:36.686942] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T22:23:37.217942] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-13T22:23:37.745322] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T22:23:37.764595] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T22:23:38.017970] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-13T22:23:38.364709] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T22:23:38.817929] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-13T22:23:39.165744] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-13T22:23:39.617982] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-13T22:23:40.417956] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-13T22:23:41.217948] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-13T22:23:41.590206] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T22:23:42.008586] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-13T22:23:42.018213] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-13T22:23:42.713018] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T22:23:42.738865] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T22:23:42.817898] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-13T22:23:43.617926] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-13T22:23:44.418003] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-13T22:23:44.550135] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T22:23:44.788747] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T22:23:45.153021] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T22:23:45.217954] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-13T22:23:45.670078] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T22:23:46.017963] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-13T22:23:46.817916] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-13T22:23:47.407145] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T22:23:47.452116] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T22:23:47.617930] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-13T22:23:47.993917] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T22:23:48.417935] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-13T22:23:48.704043] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-13T22:23:49.217969] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-13T22:23:50.017924] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-13T22:23:50.376550] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T22:23:50.380391] [INFO ] [REMOTE ] WKC: Full fetch complete (50240 records). [2025-10-13T22:23:50.380487] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-13T22:23:50.765465] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-13T22:23:50.765568] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-13T22:23:50.767279] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-13T22:23:50.767342] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-13T22:23:50.768944] [DEBUG] [LOCAL ] WKC: Trimmed 50240 records to 34639 (keeping 200 days of data) [2025-10-13T22:23:50.822847] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-13T22:23:50.996474] [DEBUG] [LOCAL ] WKC: Primary data saved (34639 records). [2025-10-13T22:23:50.996678] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-13T22:23:50.996833] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 33.8s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-13T22:23:51.173364] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:51.206691] [DEBUG] [LOCAL ] WLY: Loaded 29980 existing records from primary storage. [2025-10-13T22:23:51.207018] [INFO ] [MAIN ] WLY: Loaded 29980 existing records. [2025-10-13T22:23:51.392556] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:51.392811] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-13T22:23:51.392861] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-13T22:23:51.393194] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-13T22:23:51.393253] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-13T22:23:51.639557] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-13T22:23:51.689133] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T22:23:51.790886] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:51.827396] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T22:23:52.036692] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T22:23:52.417961] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-13T22:23:53.081478] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T22:23:53.217958] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-13T22:23:53.519430] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T22:23:54.017985] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-13T22:23:54.817933] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-13T22:23:55.129833] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-13T22:23:55.617972] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-13T22:23:55.664184] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T22:23:56.338837] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T22:23:56.417979] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-13T22:23:56.762369] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T22:23:56.763135] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-10-13T22:23:56.763204] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-13T22:23:56.935404] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T22:23:56.935610] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T22:23:56.935686] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T22:23:56.935742] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-13T22:23:56.935799] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-13T22:23:56.935835] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-13T22:23:56.935875] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-13T22:23:56.935931] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLTG took 20.8s. Estimated remaining: 9m 42s. Rate: 7.1 symbols/min [2025-10-13T22:23:57.103186] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:57.156809] [DEBUG] [LOCAL ] WM: Loaded 51718 existing records from primary storage. [2025-10-13T22:23:57.157130] [INFO ] [MAIN ] WM: Loaded 51718 existing records. [2025-10-13T22:23:57.223120] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-13T22:23:57.345584] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:57.345840] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-13T22:23:57.345891] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-13T22:23:57.346181] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-13T22:23:57.346238] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-13T22:23:57.710114] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:23:58.017959] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-13T22:23:58.701189] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T22:23:58.706136] [INFO ] [REMOTE ] WLK: Full fetch complete (63401 records). [2025-10-13T22:23:58.706267] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-13T22:23:58.822996] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-13T22:23:59.117105] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-13T22:23:59.117299] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-13T22:23:59.118538] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-13T22:23:59.118618] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-13T22:23:59.141625] [DEBUG] [LOCAL ] WLK: Trimmed 63401 records to 45653 (keeping 200 days of data) [2025-10-13T22:23:59.143285] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T22:23:59.431677] [DEBUG] [LOCAL ] WLK: Primary data saved (45653 records). [2025-10-13T22:23:59.431819] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-13T22:23:59.431911] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 42.1s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-13T22:23:59.596629] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:23:59.626331] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-13T22:23:59.648920] [DEBUG] [LOCAL ] WMB: Loaded 54452 existing records from primary storage. [2025-10-13T22:23:59.649282] [INFO ] [MAIN ] WMB: Loaded 54452 existing records. [2025-10-13T22:23:59.827965] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:23:59.828188] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-13T22:23:59.828234] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-13T22:23:59.828518] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-13T22:23:59.828556] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-13T22:24:00.192355] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:00.417954] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-13T22:24:00.875416] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T22:24:00.916221] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T22:24:01.059579] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-13T22:24:01.217945] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-13T22:24:02.017952] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-13T22:24:02.436237] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T22:24:02.817950] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-13T22:24:03.617920] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-13T22:24:03.801111] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T22:24:04.180832] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T22:24:04.417986] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-13T22:24:05.217908] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-13T22:24:05.264992] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T22:24:05.752464] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T22:24:06.017925] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-13T22:24:06.817907] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-13T22:24:07.105230] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T22:24:07.617962] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-13T22:24:07.858442] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T22:24:07.928128] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T22:24:08.417937] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-13T22:24:09.217964] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-13T22:24:09.273882] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T22:24:09.841938] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T22:24:09.857473] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T22:24:10.017967] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-13T22:24:10.817919] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-13T22:24:11.580858] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T22:24:11.617941] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-13T22:24:11.901495] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T22:24:12.295893] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T22:24:12.297316] [INFO ] [REMOTE ] WLKP: Full fetch complete (10187 records). [2025-10-13T22:24:12.297391] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-13T22:24:12.423176] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-13T22:24:12.699174] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-13T22:24:12.699316] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-13T22:24:12.699799] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-13T22:24:12.699921] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-13T22:24:12.700793] [DEBUG] [LOCAL ] WLKP: Trimmed 10187 records to 6971 (keeping 200 days of data) [2025-10-13T22:24:12.748956] [DEBUG] [LOCAL ] WLKP: Primary data saved (6971 records). [2025-10-13T22:24:12.749185] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-13T22:24:12.749300] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLKP took 41.3s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-13T22:24:12.926748] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:12.946372] [DEBUG] [LOCAL ] WMK: Loaded 14815 existing records from primary storage. [2025-10-13T22:24:12.946735] [INFO ] [MAIN ] WMK: Loaded 14815 existing records. [2025-10-13T22:24:13.124343] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:13.124591] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-13T22:24:13.124640] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-13T22:24:13.125011] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-13T22:24:13.125068] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-13T22:24:13.222205] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-13T22:24:13.477216] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:14.017931] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-13T22:24:14.591756] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T22:24:14.784475] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T22:24:14.807161] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T22:24:14.817898] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-13T22:24:15.617933] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-13T22:24:16.417947] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-13T22:24:16.681941] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T22:24:16.866548] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T22:24:17.217974] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-13T22:24:18.017911] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-13T22:24:18.069472] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:24:18.487563] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T22:24:18.817926] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-13T22:24:19.011504] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T22:24:19.617937] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-13T22:24:20.417911] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-13T22:24:21.217950] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-13T22:24:21.575813] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-13T22:24:21.812464] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-13T22:24:21.816032] [INFO ] [REMOTE ] WLY: Full fetch complete (42732 records). [2025-10-13T22:24:21.816164] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-13T22:24:21.976822] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T22:24:22.028441] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-13T22:24:22.225514] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-13T22:24:22.225631] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-13T22:24:22.226824] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-13T22:24:22.226886] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-13T22:24:22.227798] [DEBUG] [LOCAL ] WLY: Trimmed 42732 records to 29735 (keeping 200 days of data) [2025-10-13T22:24:22.349707] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T22:24:22.447570] [DEBUG] [LOCAL ] WLY: Primary data saved (29735 records). [2025-10-13T22:24:22.447759] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-13T22:24:22.447858] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 31.5s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-13T22:24:22.615309] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:22.655868] [DEBUG] [LOCAL ] WMS: Loaded 40212 existing records from primary storage. [2025-10-13T22:24:22.656164] [INFO ] [MAIN ] WMS: Loaded 40212 existing records. [2025-10-13T22:24:22.823109] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-13T22:24:22.827535] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:22.828773] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-13T22:24:22.828841] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-13T22:24:22.829122] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-13T22:24:22.829179] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-13T22:24:23.171257] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:23.617957] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-13T22:24:23.855529] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T22:24:23.940978] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T22:24:24.417919] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-13T22:24:25.217960] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-13T22:24:25.994500] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T22:24:26.017877] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-13T22:24:26.461575] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-13T22:24:26.817907] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-13T22:24:27.139734] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T22:24:27.617898] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-13T22:24:27.646978] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T22:24:27.913724] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T22:24:28.417912] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-13T22:24:29.217895] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-13T22:24:29.540823] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T22:24:29.578763] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T22:24:30.017948] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-13T22:24:30.817914] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-13T22:24:30.931527] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T22:24:31.617912] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-13T22:24:31.777400] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T22:24:32.357068] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:24:32.417935] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-13T22:24:32.441499] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T22:24:33.217982] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-13T22:24:33.897458] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T22:24:34.017934] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-13T22:24:34.817943] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-13T22:24:35.163434] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T22:24:35.467923] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T22:24:35.617941] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-13T22:24:36.417912] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-13T22:24:36.897155] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T22:24:37.128609] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T22:24:37.217965] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-13T22:24:37.786960] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T22:24:37.792174] [INFO ] [REMOTE ] WM: Full fetch complete (73742 records). [2025-10-13T22:24:37.792328] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-13T22:24:38.024046] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-13T22:24:38.217917] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-13T22:24:38.218067] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-13T22:24:38.219474] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-13T22:24:38.219563] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-13T22:24:38.222597] [DEBUG] [LOCAL ] WM: Trimmed 73742 records to 50991 (keeping 200 days of data) [2025-10-13T22:24:38.357477] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T22:24:38.609969] [DEBUG] [LOCAL ] WM: Primary data saved (50991 records). [2025-10-13T22:24:38.610139] [INFO ] [MAIN ] WM: Full history saved. [2025-10-13T22:24:38.610227] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WM took 41.7s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-13T22:24:38.798273] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:38.827857] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-13T22:24:38.851677] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-13T22:24:38.852057] [INFO ] [MAIN ] WMT: Loaded 54580 existing records. [2025-10-13T22:24:39.023615] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:39.023876] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-13T22:24:39.023924] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-13T22:24:39.024188] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-13T22:24:39.024228] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-13T22:24:39.373218] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:39.617917] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-13T22:24:39.680233] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T22:24:39.834030] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T22:24:40.417992] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-13T22:24:41.217917] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-13T22:24:41.964945] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T22:24:42.017933] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-13T22:24:42.255177] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-13T22:24:42.275960] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T22:24:42.817930] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-13T22:24:43.385522] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T22:24:43.587499] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T22:24:43.589599] [INFO ] [REMOTE ] WMK: Full fetch complete (19884 records). [2025-10-13T22:24:43.589707] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-13T22:24:43.623113] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-13T22:24:43.951942] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-13T22:24:43.952023] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-13T22:24:43.952488] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-13T22:24:43.952527] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-13T22:24:43.953114] [DEBUG] [LOCAL ] WMK: Trimmed 19884 records to 14665 (keeping 200 days of data) [2025-10-13T22:24:44.043429] [DEBUG] [LOCAL ] WMK: Primary data saved (14665 records). [2025-10-13T22:24:44.043576] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-13T22:24:44.043681] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 31.3s. Estimated remaining: 9m 0s. Rate: 7.1 symbols/min [2025-10-13T22:24:44.217340] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:44.256793] [DEBUG] [LOCAL ] WNC: Loaded 39319 existing records from primary storage. [2025-10-13T22:24:44.257093] [INFO ] [MAIN ] WNC: Loaded 39319 existing records. [2025-10-13T22:24:44.429854] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-13T22:24:44.435464] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:44.436812] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-13T22:24:44.436877] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-13T22:24:44.437243] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-13T22:24:44.437309] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-13T22:24:44.786923] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:45.217982] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-13T22:24:45.664989] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T22:24:45.670881] [INFO ] [REMOTE ] WMB: Full fetch complete (77691 records). [2025-10-13T22:24:45.671023] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-13T22:24:46.022519] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-13T22:24:46.069159] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-13T22:24:46.069451] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-13T22:24:46.070777] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-13T22:24:46.079283] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-13T22:24:46.101635] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T22:24:46.099837] [DEBUG] [LOCAL ] WMB: Trimmed 77691 records to 53672 (keeping 200 days of data) [2025-10-13T22:24:46.255987] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-13T22:24:46.493013] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-13T22:24:46.493166] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-13T22:24:46.493252] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMB took 47.1s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-13T22:24:46.664830] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:46.704270] [DEBUG] [LOCAL ] WNS: Loaded 40459 existing records from primary storage. [2025-10-13T22:24:46.704568] [INFO ] [MAIN ] WNS: Loaded 40459 existing records. [2025-10-13T22:24:46.823091] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-13T22:24:46.881461] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:46.881771] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-13T22:24:46.881826] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-13T22:24:46.882174] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-13T22:24:46.882212] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-13T22:24:47.294127] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:47.312186] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T22:24:47.617921] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-13T22:24:48.417936] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-13T22:24:49.144877] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T22:24:49.217913] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-13T22:24:49.261883] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-13T22:24:49.756730] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T22:24:50.017987] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-13T22:24:50.429556] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T22:24:50.433997] [INFO ] [REMOTE ] WMS: Full fetch complete (57091 records). [2025-10-13T22:24:50.434121] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-13T22:24:50.816522] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-13T22:24:50.816613] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-13T22:24:50.817736] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-13T22:24:50.817803] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-13T22:24:50.818033] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-13T22:24:50.820533] [DEBUG] [LOCAL ] WMS: Trimmed 57091 records to 39678 (keeping 200 days of data) [2025-10-13T22:24:51.080036] [DEBUG] [LOCAL ] WMS: Primary data saved (39678 records). [2025-10-13T22:24:51.080242] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-13T22:24:51.080348] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 28.6s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-13T22:24:51.248511] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:24:51.299445] [DEBUG] [LOCAL ] WOLF: Loaded 53950 existing records from primary storage. [2025-10-13T22:24:51.299811] [INFO ] [MAIN ] WOLF: Loaded 53950 existing records. [2025-10-13T22:24:51.476932] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:24:51.477227] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-13T22:24:51.477286] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-13T22:24:51.477617] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-13T22:24:51.477774] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-13T22:24:51.629985] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-13T22:24:51.686700] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T22:24:51.883161] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:24:52.417964] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-13T22:24:53.146487] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T22:24:53.217950] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-13T22:24:53.270908] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-13T22:24:53.643496] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T22:24:54.017947] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-13T22:24:54.451720] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T22:24:54.817967] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-13T22:24:55.617951] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-13T22:24:56.417915] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-13T22:24:56.532759] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T22:24:56.608226] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-13T22:24:57.218021] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-13T22:24:57.623948] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T22:24:57.741865] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T22:24:58.018002] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-13T22:24:58.787248] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T22:24:58.817899] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-13T22:24:59.617965] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-13T22:25:00.314619] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-13T22:25:00.347089] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T22:25:00.417945] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-13T22:25:01.120047] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T22:25:01.217959] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-13T22:25:02.018002] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-13T22:25:02.686499] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T22:25:02.817995] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-13T22:25:03.134283] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-13T22:25:03.520078] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T22:25:03.617948] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-13T22:25:03.915851] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T22:25:04.417948] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-13T22:25:04.848933] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T22:25:05.217939] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-13T22:25:05.442887] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T22:25:06.017997] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-13T22:25:06.817979] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-13T22:25:07.262288] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T22:25:07.266324] [INFO ] [REMOTE ] WNC: Full fetch complete (57458 records). [2025-10-13T22:25:07.266440] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-13T22:25:07.628406] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-13T22:25:07.713582] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-13T22:25:07.713888] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-13T22:25:07.715274] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-13T22:25:07.715361] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-13T22:25:07.719001] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-13T22:25:07.730920] [DEBUG] [LOCAL ] WNC: Trimmed 57458 records to 38638 (keeping 200 days of data) [2025-10-13T22:25:07.961993] [DEBUG] [LOCAL ] WNC: Primary data saved (38638 records). [2025-10-13T22:25:07.962138] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-13T22:25:07.962216] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 23.9s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-13T22:25:08.127823] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:08.152918] [DEBUG] [LOCAL ] WOR: Loaded 24978 existing records from primary storage. [2025-10-13T22:25:08.153187] [INFO ] [MAIN ] WOR: Loaded 24978 existing records. [2025-10-13T22:25:08.331846] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:08.332125] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-13T22:25:08.332182] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-13T22:25:08.332423] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-13T22:25:08.332478] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-13T22:25:08.422557] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-13T22:25:08.692566] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:08.728862] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T22:25:09.217958] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-13T22:25:09.840059] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-13T22:25:10.017971] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-13T22:25:10.456905] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T22:25:10.664950] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T22:25:10.817939] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-13T22:25:11.174310] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T22:25:11.617956] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-13T22:25:12.417986] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-13T22:25:12.959206] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T22:25:13.063493] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T22:25:13.217967] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-13T22:25:14.017937] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-13T22:25:14.711174] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T22:25:14.782271] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T22:25:14.817905] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-13T22:25:15.617932] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-13T22:25:15.789761] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-13T22:25:16.417924] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-13T22:25:16.853413] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T22:25:17.217938] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-13T22:25:17.422410] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-13T22:25:18.017932] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-13T22:25:18.231471] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T22:25:18.752527] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-13T22:25:18.817891] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-13T22:25:19.617928] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-13T22:25:20.417967] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-13T22:25:20.538912] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-13T22:25:20.755464] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T22:25:21.217930] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-13T22:25:21.597489] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T22:25:21.603856] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-13T22:25:21.604013] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-13T22:25:21.724409] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T22:25:21.772022] [INFO ] [REMOTE ] WNS: Full fetch complete (55219 records). [2025-10-13T22:25:21.901569] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-13T22:25:21.945550] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-13T22:25:22.023739] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-13T22:25:22.184200] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-13T22:25:22.193068] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-13T22:25:22.197291] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-13T22:25:22.197715] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-13T22:25:22.260150] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-10-13T22:25:22.609416] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-13T22:25:22.609517] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-13T22:25:22.611225] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-13T22:25:22.611593] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-13T22:25:22.623221] [DEBUG] [LOCAL ] WNS: Trimmed 55219 records to 40018 (keeping 200 days of data) [2025-10-13T22:25:22.819443] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-13T22:25:23.004921] [DEBUG] [LOCAL ] WNS: Primary data saved (40018 records). [2025-10-13T22:25:23.007557] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-13T22:25:23.007772] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 36.5s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-13T22:25:23.269857] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:23.273737] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-13T22:25:23.273855] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-13T22:25:23.274236] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 44.7s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-13T22:25:23.490158] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:23.502561] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T22:25:23.514002] [DEBUG] [LOCAL ] WOW: Loaded 31014 existing records from primary storage. [2025-10-13T22:25:23.516278] [INFO ] [MAIN ] WOW: Loaded 31014 existing records. [2025-10-13T22:25:23.618598] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-13T22:25:23.774756] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:23.775035] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-13T22:25:23.775160] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-13T22:25:23.790044] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-13T22:25:23.789974] [DEBUG] [LOCAL ] WPC: Loaded 48975 existing records from primary storage. [2025-10-13T22:25:23.790234] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-13T22:25:23.822217] [INFO ] [MAIN ] WPC: Loaded 48975 existing records. [2025-10-13T22:25:24.235926] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:24.246959] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-13T22:25:24.252610] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-13T22:25:24.258042] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-13T22:25:24.279730] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-13T22:25:24.458622] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:24.458980] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-13T22:25:24.726073] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:24.790015] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T22:25:24.837612] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T22:25:25.217926] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-13T22:25:25.511465] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T22:25:26.017938] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-13T22:25:26.817931] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-13T22:25:26.947554] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T22:25:27.298339] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T22:25:27.617936] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-13T22:25:28.417904] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-13T22:25:28.715577] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T22:25:28.910703] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-13T22:25:29.217930] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-13T22:25:30.017917] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-13T22:25:30.314887] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T22:25:30.817934] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-13T22:25:30.895536] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T22:25:31.089505] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T22:25:31.096021] [INFO ] [REMOTE ] WOLF: Full fetch complete (77238 records). [2025-10-13T22:25:31.096194] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-13T22:25:31.505050] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-13T22:25:31.505169] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-13T22:25:31.506467] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-13T22:25:31.506530] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-13T22:25:31.508223] [DEBUG] [LOCAL ] WOLF: Trimmed 77238 records to 53171 (keeping 200 days of data) [2025-10-13T22:25:31.618565] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-13T22:25:31.820996] [DEBUG] [LOCAL ] WOLF: Primary data saved (53171 records). [2025-10-13T22:25:31.821144] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-13T22:25:31.821293] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 40.7s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-13T22:25:31.987166] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:32.043165] [DEBUG] [LOCAL ] WPM: Loaded 53518 existing records from primary storage. [2025-10-13T22:25:32.043527] [INFO ] [MAIN ] WPM: Loaded 53518 existing records. [2025-10-13T22:25:32.220213] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:32.220912] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-13T22:25:32.220983] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-13T22:25:32.221576] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-13T22:25:32.221671] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-13T22:25:32.422008] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-13T22:25:32.431581] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T22:25:32.607025] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:33.217919] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-13T22:25:33.464456] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T22:25:33.473631] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T22:25:34.017924] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-13T22:25:34.481678] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T22:25:34.817975] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-13T22:25:35.617911] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-13T22:25:35.838741] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T22:25:35.894908] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T22:25:36.417940] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-13T22:25:37.217991] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-13T22:25:37.358321] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T22:25:37.617109] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T22:25:38.017932] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-13T22:25:38.817906] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-13T22:25:38.852891] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T22:25:39.129509] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T22:25:39.133305] [INFO ] [REMOTE ] WOR: Full fetch complete (36246 records). [2025-10-13T22:25:39.133408] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-13T22:25:39.518516] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-13T22:25:39.518610] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-13T22:25:39.519406] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-13T22:25:39.519467] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-13T22:25:39.521292] [DEBUG] [LOCAL ] WOR: Trimmed 36246 records to 24262 (keeping 200 days of data) [2025-10-13T22:25:39.621129] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-13T22:25:39.686697] [DEBUG] [LOCAL ] WOR: Primary data saved (24262 records). [2025-10-13T22:25:39.686859] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-13T22:25:39.686949] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOR took 31.7s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-13T22:25:39.861621] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:39.897457] [DEBUG] [LOCAL ] WPP: Loaded 34748 existing records from primary storage. [2025-10-13T22:25:39.897788] [INFO ] [MAIN ] WPP: Loaded 34748 existing records. [2025-10-13T22:25:40.072220] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:40.072487] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-13T22:25:40.072536] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-13T22:25:40.072864] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-13T22:25:40.072921] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-13T22:25:40.422070] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-13T22:25:40.459199] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:40.502779] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T22:25:41.026965] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T22:25:41.217898] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-13T22:25:41.520047] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T22:25:42.017934] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-13T22:25:42.817894] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-13T22:25:42.857194] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T22:25:42.987356] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T22:25:43.617918] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-13T22:25:43.765602] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T22:25:44.417944] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-13T22:25:45.217906] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-13T22:25:45.401373] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T22:25:45.727533] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T22:25:46.017966] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-13T22:25:46.817899] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-13T22:25:46.854278] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T22:25:47.218782] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T22:25:47.617905] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-13T22:25:48.039231] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T22:25:48.417958] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-13T22:25:49.007436] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T22:25:49.217949] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-13T22:25:50.017962] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-13T22:25:50.055268] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T22:25:50.282756] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T22:25:50.817941] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-13T22:25:51.617905] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-13T22:25:51.728872] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T22:25:52.418000] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-13T22:25:52.859438] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T22:25:52.993627] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T22:25:53.217932] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-13T22:25:53.433393] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T22:25:54.017939] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-13T22:25:54.817941] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-13T22:25:55.104969] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T22:25:55.267806] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T22:25:55.617946] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-13T22:25:55.863240] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T22:25:56.417930] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-13T22:25:57.217971] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-13T22:25:57.448845] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T22:25:57.880236] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T22:25:57.885186] [INFO ] [REMOTE ] WPC: Full fetch complete (70515 records). [2025-10-13T22:25:57.885345] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-13T22:25:58.027030] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-13T22:25:58.276466] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-13T22:25:58.276555] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-13T22:25:58.277744] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-13T22:25:58.277810] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-13T22:25:58.279456] [DEBUG] [LOCAL ] WPC: Trimmed 70515 records to 48198 (keeping 200 days of data) [2025-10-13T22:25:58.587285] [DEBUG] [LOCAL ] WPC: Primary data saved (48198 records). [2025-10-13T22:25:58.587429] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-13T22:25:58.587516] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WPC took 35.3s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-13T22:25:58.765134] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:25:58.792334] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T22:25:58.825244] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-13T22:25:58.847276] [DEBUG] [LOCAL ] WRB: Loaded 51438 existing records from primary storage. [2025-10-13T22:25:58.847605] [INFO ] [MAIN ] WRB: Loaded 51438 existing records. [2025-10-13T22:25:59.023073] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:25:59.023346] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-13T22:25:59.023395] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-13T22:25:59.023693] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-13T22:25:59.023752] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-13T22:25:59.382521] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:25:59.394336] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T22:25:59.398419] [INFO ] [REMOTE ] WOW: Full fetch complete (42523 records). [2025-10-13T22:25:59.398539] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-13T22:25:59.623084] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-13T22:25:59.783063] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-13T22:25:59.783137] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-13T22:25:59.784125] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-13T22:25:59.784189] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-13T22:25:59.785550] [DEBUG] [LOCAL ] WOW: Trimmed 42523 records to 30751 (keeping 200 days of data) [2025-10-13T22:25:59.978755] [DEBUG] [LOCAL ] WOW: Primary data saved (30751 records). [2025-10-13T22:25:59.978945] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-13T22:25:59.979048] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WOW took 37.0s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-13T22:26:00.161089] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:00.218360] [DEBUG] [LOCAL ] WRBY: Loaded 51446 existing records from primary storage. [2025-10-13T22:26:00.218765] [INFO ] [MAIN ] WRBY: Loaded 51446 existing records. [2025-10-13T22:26:00.381450] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T22:26:00.419505] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-13T22:26:00.450245] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:00.452051] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-13T22:26:00.452714] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-13T22:26:00.453078] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-13T22:26:00.453140] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-13T22:26:00.890296] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:01.218022] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-13T22:26:01.459309] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T22:26:02.018005] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-13T22:26:02.303385] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T22:26:02.817953] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-13T22:26:03.053566] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T22:26:03.351733] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T22:26:03.617948] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-13T22:26:04.417949] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-13T22:26:04.790876] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T22:26:05.217901] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-13T22:26:05.355472] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T22:26:05.878487] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T22:26:06.017940] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-13T22:26:06.612013] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T22:26:06.616178] [INFO ] [REMOTE ] WPP: Full fetch complete (46624 records). [2025-10-13T22:26:06.616276] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-13T22:26:06.828783] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-13T22:26:06.993415] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-13T22:26:06.993515] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-13T22:26:06.994797] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-13T22:26:06.994863] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-13T22:26:06.996091] [DEBUG] [LOCAL ] WPP: Trimmed 46624 records to 34374 (keeping 200 days of data) [2025-10-13T22:26:07.221364] [DEBUG] [LOCAL ] WPP: Primary data saved (34374 records). [2025-10-13T22:26:07.221544] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-13T22:26:07.221639] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPP took 27.5s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-13T22:26:07.475271] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T22:26:07.617914] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-13T22:26:08.418003] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-13T22:26:08.833947] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T22:26:09.039309] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T22:26:09.217937] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-13T22:26:09.724865] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T22:26:10.017929] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-13T22:26:10.817988] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-13T22:26:10.964925] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T22:26:11.247942] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T22:26:11.618011] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-13T22:26:12.373525] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T22:26:12.379903] [INFO ] [REMOTE ] WPM: Full fetch complete (75998 records). [2025-10-13T22:26:12.380089] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-13T22:26:12.428469] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-13T22:26:12.795345] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-13T22:26:12.795451] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-13T22:26:12.796671] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-13T22:26:12.796735] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-13T22:26:12.798369] [DEBUG] [LOCAL ] WPM: Trimmed 75998 records to 52763 (keeping 200 days of data) [2025-10-13T22:26:13.073838] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T22:26:13.165738] [DEBUG] [LOCAL ] WPM: Primary data saved (52763 records). [2025-10-13T22:26:13.165887] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-13T22:26:13.165970] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPM took 41.3s. Estimated remaining: 7m 27s. Rate: 7.1 symbols/min [2025-10-13T22:26:13.217933] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-13T22:26:14.233422] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T22:26:14.244017] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-13T22:26:14.890222] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T22:26:14.901267] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-13T22:26:15.926551] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T22:26:15.937072] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-13T22:26:16.591399] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T22:26:16.601805] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-13T22:26:17.818941] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T22:26:17.832868] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-13T22:26:18.335573] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T22:26:18.346613] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-13T22:26:19.692815] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T22:26:19.705361] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-13T22:26:20.084298] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T22:26:20.095206] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-13T22:26:20.238543] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T22:26:20.417946] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-13T22:26:20.999020] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T22:26:21.004596] [INFO ] [REMOTE ] WRB: Full fetch complete (73408 records). [2025-10-13T22:26:21.004826] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-13T22:26:21.394316] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-13T22:26:21.394536] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-13T22:26:21.395990] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-13T22:26:21.396072] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-13T22:26:21.397544] [DEBUG] [LOCAL ] WRB: Trimmed 73408 records to 50777 (keeping 200 days of data) [2025-10-13T22:26:21.673907] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T22:26:21.688129] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-13T22:26:21.771791] [DEBUG] [LOCAL ] WRB: Primary data saved (50777 records). [2025-10-13T22:26:21.771989] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-13T22:26:21.772082] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 23.2s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-13T22:26:23.216806] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T22:26:23.222054] [INFO ] [REMOTE ] WRBY: Full fetch complete (73524 records). [2025-10-13T22:26:23.222165] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-13T22:26:23.603307] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-13T22:26:23.603388] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-13T22:26:23.604504] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-13T22:26:23.604566] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-13T22:26:23.606160] [DEBUG] [LOCAL ] WRBY: Trimmed 73524 records to 50695 (keeping 200 days of data) [2025-10-13T22:26:23.896300] [DEBUG] [LOCAL ] WRBY: Primary data saved (50695 records). [2025-10-13T22:26:23.896434] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-13T22:26:23.896515] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 23.9s. Estimated remaining: 7m 10s. Rate: 7.1 symbols/min [2025-10-13T22:26:24.426197] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:24.593993] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:24.593157] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:24.597257] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:24.643748] [DEBUG] [LOCAL ] WSR: Loaded 23191 existing records from primary storage. [2025-10-13T22:26:24.642817] [DEBUG] [LOCAL ] WS: Loaded 23878 existing records from primary storage. [2025-10-13T22:26:24.644343] [INFO ] [MAIN ] WSR: Loaded 23191 existing records. [2025-10-13T22:26:24.644723] [INFO ] [MAIN ] WS: Loaded 23878 existing records. [2025-10-13T22:26:24.768445] [DEBUG] [LOCAL ] WSO: Loaded 25618 existing records from primary storage. [2025-10-13T22:26:24.850014] [INFO ] [MAIN ] WSO: Loaded 25618 existing records. [2025-10-13T22:26:25.107078] [DEBUG] [LOCAL ] WSM: Loaded 50013 existing records from primary storage. [2025-10-13T22:26:25.102962] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:25.105824] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:25.122922] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-13T22:26:25.123020] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-13T22:26:25.128365] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-13T22:26:25.128250] [INFO ] [MAIN ] WSM: Loaded 50013 existing records. [2025-10-13T22:26:25.139044] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-13T22:26:25.133697] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-13T22:26:25.148686] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-13T22:26:25.187151] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-13T22:26:25.218180] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-13T22:26:25.652910] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:25.719127] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:25.744801] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-13T22:26:25.821473] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-13T22:26:25.821582] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-13T22:26:25.840958] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-13T22:26:25.875848] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-13T22:26:25.881134] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-13T22:26:25.875994] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-13T22:26:25.900511] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-13T22:26:26.163190] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:26.206206] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-13T22:26:26.364566] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:26.375258] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-13T22:26:26.801984] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:26.831910] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-13T22:26:26.855586] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:26.855921] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-13T22:26:27.510423] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T22:26:27.517600] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-13T22:26:27.610972] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T22:26:27.615817] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-13T22:26:27.699146] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T22:26:27.703135] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-13T22:26:28.505427] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T22:26:28.510404] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-13T22:26:28.567914] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T22:26:28.573813] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-13T22:26:28.673425] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T22:26:28.826427] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T22:26:29.217950] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-13T22:26:29.509324] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T22:26:29.702462] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T22:26:30.017911] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-13T22:26:30.254337] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T22:26:30.817889] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-13T22:26:31.138324] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T22:26:31.617944] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-13T22:26:32.112412] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T22:26:32.417969] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-13T22:26:32.985862] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T22:26:33.217970] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-13T22:26:34.017896] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-13T22:26:34.141545] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T22:26:34.207869] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T22:26:34.817940] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-13T22:26:35.169225] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T22:26:35.617900] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-13T22:26:35.932116] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T22:26:36.417891] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-13T22:26:36.834171] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T22:26:37.206866] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T22:26:37.217896] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-13T22:26:38.017936] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-13T22:26:38.805186] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T22:26:38.817893] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-13T22:26:39.009505] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T22:26:39.617965] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-13T22:26:40.417978] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-13T22:26:40.730020] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T22:26:40.755940] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T22:26:41.217943] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-13T22:26:41.545106] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T22:26:42.017919] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-13T22:26:42.827799] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-13T22:26:42.849306] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T22:26:42.878312] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T22:26:43.617912] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-13T22:26:43.842048] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T22:26:44.417961] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-13T22:26:45.218005] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-13T22:26:45.435103] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T22:26:45.618375] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T22:26:46.017944] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-13T22:26:46.263709] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T22:26:46.817973] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-13T22:26:47.617966] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-13T22:26:47.801565] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T22:26:47.934343] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T22:26:48.417954] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-13T22:26:48.624858] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T22:26:49.217949] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-13T22:26:50.017922] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-13T22:26:50.069408] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T22:26:50.357268] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T22:26:50.360856] [INFO ] [REMOTE ] WSO: Full fetch complete (35112 records). [2025-10-13T22:26:50.360954] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-13T22:26:50.759174] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-13T22:26:50.759323] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-13T22:26:50.760678] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-13T22:26:50.760743] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-13T22:26:50.761899] [DEBUG] [LOCAL ] WSO: Trimmed 35112 records to 25486 (keeping 200 days of data) [2025-10-13T22:26:50.829563] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-13T22:26:50.937447] [DEBUG] [LOCAL ] WSO: Primary data saved (25486 records). [2025-10-13T22:26:50.937681] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-13T22:26:50.937805] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSO took 27.0s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-13T22:26:51.138456] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:51.139929] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T22:26:51.190087] [DEBUG] [LOCAL ] WST: Loaded 37444 existing records from primary storage. [2025-10-13T22:26:51.190609] [INFO ] [MAIN ] WST: Loaded 37444 existing records. [2025-10-13T22:26:51.374742] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:51.375018] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-13T22:26:51.375098] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-13T22:26:51.375406] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-13T22:26:51.375465] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-13T22:26:51.623520] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-13T22:26:51.754387] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:51.770215] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T22:26:52.417963] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-13T22:26:53.217929] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-13T22:26:53.361410] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T22:26:53.684127] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T22:26:54.017963] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-13T22:26:54.137426] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T22:26:54.814632] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T22:26:54.817505] [INFO ] [REMOTE ] WSR: Full fetch complete (32654 records). [2025-10-13T22:26:54.817634] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-13T22:26:54.817997] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-13T22:26:55.210667] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-13T22:26:55.210803] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-13T22:26:55.211953] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-13T22:26:55.212017] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-13T22:26:55.213199] [DEBUG] [LOCAL ] WSR: Trimmed 32654 records to 22987 (keeping 200 days of data) [2025-10-13T22:26:55.360572] [DEBUG] [LOCAL ] WSR: Primary data saved (22987 records). [2025-10-13T22:26:55.360767] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-13T22:26:55.360874] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSR took 31.5s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-13T22:26:55.540752] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:55.594903] [DEBUG] [LOCAL ] WT: Loaded 48659 existing records from primary storage. [2025-10-13T22:26:55.595364] [INFO ] [MAIN ] WT: Loaded 48659 existing records. [2025-10-13T22:26:55.623175] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-13T22:26:55.802301] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:55.802622] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-13T22:26:55.802703] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-13T22:26:55.803058] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-13T22:26:55.803129] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-13T22:26:55.940154] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T22:26:55.996180] [INFO ] [REMOTE ] WS: Full fetch complete (36122 records). [2025-10-13T22:26:56.043388] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-13T22:26:56.334767] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:56.429215] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-13T22:26:56.631670] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-13T22:26:56.631776] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-13T22:26:56.632761] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-13T22:26:56.632825] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-13T22:26:56.633727] [DEBUG] [LOCAL ] WS: Trimmed 36122 records to 23444 (keeping 200 days of data) [2025-10-13T22:26:56.775446] [DEBUG] [LOCAL ] WS: Primary data saved (23444 records). [2025-10-13T22:26:56.775609] [INFO ] [MAIN ] WS: Full history saved. [2025-10-13T22:26:56.775729] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WS took 32.9s. Estimated remaining: 6m 45s. Rate: 7.1 symbols/min [2025-10-13T22:26:56.947309] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:26:56.991490] [DEBUG] [LOCAL ] WTI: Loaded 44879 existing records from primary storage. [2025-10-13T22:26:56.991853] [INFO ] [MAIN ] WTI: Loaded 44879 existing records. [2025-10-13T22:26:57.151334] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T22:26:57.199342] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:26:57.199587] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-13T22:26:57.199639] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-13T22:26:57.199991] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-13T22:26:57.200033] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-13T22:26:57.229582] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-13T22:26:57.545480] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:26:57.858813] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T22:26:57.979703] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T22:26:58.017912] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-13T22:26:58.817945] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-13T22:26:59.310536] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T22:26:59.617936] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-13T22:27:00.417934] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-13T22:27:00.501322] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T22:27:01.004028] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T22:27:01.009395] [INFO ] [REMOTE ] WSM: Full fetch complete (71576 records). [2025-10-13T22:27:01.009546] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-13T22:27:01.220930] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-13T22:27:01.486340] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T22:27:01.490417] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-13T22:27:01.498416] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-13T22:27:01.500287] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-13T22:27:01.500380] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-13T22:27:01.502886] [DEBUG] [LOCAL ] WSM: Trimmed 71576 records to 49208 (keeping 200 days of data) [2025-10-13T22:27:01.833023] [DEBUG] [LOCAL ] WSM: Primary data saved (49208 records). [2025-10-13T22:27:01.833217] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-13T22:27:01.833322] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 37.9s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-13T22:27:02.011320] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:02.011614] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-13T22:27:02.011725] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-13T22:27:02.011852] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-13T22:27:02.011896] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-13T22:27:02.011938] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-13T22:27:02.011971] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-13T22:27:02.023361] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-13T22:27:02.394808] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:02.817952] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-13T22:27:02.983980] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:27:03.617938] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-13T22:27:03.720776] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T22:27:04.293167] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T22:27:04.418041] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-13T22:27:04.762846] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T22:27:05.217959] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-13T22:27:05.682372] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-13T22:27:06.017949] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-13T22:27:06.259141] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T22:27:06.368387] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T22:27:06.817960] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-13T22:27:07.617952] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-13T22:27:08.212180] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T22:27:08.418046] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-13T22:27:09.101162] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T22:27:09.217962] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-13T22:27:09.901168] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T22:27:10.017970] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-13T22:27:10.817950] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-13T22:27:11.131558] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T22:27:11.302750] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T22:27:11.617930] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-13T22:27:11.706344] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T22:27:12.092864] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T22:27:12.417983] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-13T22:27:13.217952] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-13T22:27:13.983892] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T22:27:14.017906] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-13T22:27:14.817934] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-13T22:27:14.861333] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T22:27:15.603371] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T22:27:15.617898] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-13T22:27:16.400337] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T22:27:16.417902] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-13T22:27:16.914388] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T22:27:17.217920] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-13T22:27:17.452076] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T22:27:17.679571] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T22:27:18.017946] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-13T22:27:18.817950] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-13T22:27:19.617948] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-13T22:27:19.688402] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T22:27:20.397995] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T22:27:20.423464] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-13T22:27:20.432994] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T22:27:20.904458] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T22:27:21.217984] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-13T22:27:21.730097] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T22:27:22.017976] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-13T22:27:22.817962] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-13T22:27:23.594839] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T22:27:23.617912] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-13T22:27:24.243576] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T22:27:24.417918] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-13T22:27:25.217912] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-13T22:27:25.468981] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T22:27:25.714779] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T22:27:26.023226] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-13T22:27:26.028931] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T22:27:26.595105] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T22:27:26.596543] [INFO ] [REMOTE ] WTM: Full fetch complete (2668 records). [2025-10-13T22:27:26.596618] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-13T22:27:26.792176] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T22:27:26.792525] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T22:27:26.792664] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T22:27:26.792737] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-13T22:27:26.792839] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-13T22:27:26.792899] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-13T22:27:26.792997] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-13T22:27:26.793085] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WTM took 25.0s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-13T22:27:26.826238] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-13T22:27:26.977026] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:27.035639] [DEBUG] [LOCAL ] WTRG: Loaded 51727 existing records from primary storage. [2025-10-13T22:27:27.036209] [INFO ] [MAIN ] WTRG: Loaded 51727 existing records. [2025-10-13T22:27:27.237546] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:27:27.237849] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-13T22:27:27.237898] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-13T22:27:27.238373] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-13T22:27:27.238429] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-13T22:27:27.607324] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:27.617896] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-13T22:27:28.342443] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:27:28.417952] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-13T22:27:29.217919] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-13T22:27:29.249294] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T22:27:29.720833] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T22:27:29.727536] [INFO ] [REMOTE ] WTI: Full fetch complete (64046 records). [2025-10-13T22:27:29.727818] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-13T22:27:30.020870] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-13T22:27:30.138753] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T22:27:30.149582] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-13T22:27:30.149864] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-13T22:27:30.151044] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-13T22:27:30.151129] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-13T22:27:30.152948] [DEBUG] [LOCAL ] WTI: Trimmed 64046 records to 44466 (keeping 200 days of data) [2025-10-13T22:27:30.407538] [DEBUG] [LOCAL ] WTI: Primary data saved (44466 records). [2025-10-13T22:27:30.407721] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-13T22:27:30.407815] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTI took 33.6s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-13T22:27:30.571995] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:30.592053] [DEBUG] [LOCAL ] WTS: Loaded 17923 existing records from primary storage. [2025-10-13T22:27:30.592305] [INFO ] [MAIN ] WTS: Loaded 17923 existing records. [2025-10-13T22:27:30.771492] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:27:30.771842] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-13T22:27:30.771905] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-13T22:27:30.772314] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-13T22:27:30.772384] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-13T22:27:30.828298] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-13T22:27:31.147803] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:31.599264] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T22:27:31.617880] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-13T22:27:32.417930] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-13T22:27:32.548860] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T22:27:33.066272] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T22:27:33.217937] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-13T22:27:33.472991] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T22:27:33.545409] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-13T22:27:33.549248] [INFO ] [REMOTE ] WST: Full fetch complete (53921 records). [2025-10-13T22:27:33.549370] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-13T22:27:33.930556] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-13T22:27:33.930683] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-13T22:27:33.931637] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-13T22:27:33.931718] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-13T22:27:33.932861] [DEBUG] [LOCAL ] WST: Trimmed 53921 records to 36798 (keeping 200 days of data) [2025-10-13T22:27:34.023155] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-13T22:27:34.168306] [DEBUG] [LOCAL ] WST: Primary data saved (36798 records). [2025-10-13T22:27:34.168479] [INFO ] [MAIN ] WST: Full history saved. [2025-10-13T22:27:34.168634] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WST took 43.2s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-13T22:27:34.333315] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:34.375260] [DEBUG] [LOCAL ] WTTR: Loaded 45236 existing records from primary storage. [2025-10-13T22:27:34.375601] [INFO ] [MAIN ] WTTR: Loaded 45236 existing records. [2025-10-13T22:27:34.546675] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:27:34.546934] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-13T22:27:34.546982] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-13T22:27:34.547302] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-13T22:27:34.547369] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-13T22:27:34.824386] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-13T22:27:34.911314] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:35.617934] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-13T22:27:35.664396] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T22:27:36.304828] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T22:27:36.417919] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-13T22:27:37.217899] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-13T22:27:37.259035] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T22:27:37.834011] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T22:27:37.841992] [INFO ] [REMOTE ] WT: Full fetch complete (69404 records). [2025-10-13T22:27:37.842151] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-13T22:27:38.024011] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-13T22:27:38.254358] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-13T22:27:38.254442] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-13T22:27:38.255709] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-13T22:27:38.255774] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-13T22:27:38.257382] [DEBUG] [LOCAL ] WT: Trimmed 69404 records to 47986 (keeping 200 days of data) [2025-10-13T22:27:38.568504] [DEBUG] [LOCAL ] WT: Primary data saved (47986 records). [2025-10-13T22:27:38.568837] [INFO ] [MAIN ] WT: Full history saved. [2025-10-13T22:27:38.568966] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WT took 43.2s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-13T22:27:38.743582] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:38.790593] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T22:27:38.818975] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-13T22:27:38.841798] [DEBUG] [LOCAL ] WU: Loaded 54235 existing records from primary storage. [2025-10-13T22:27:38.842219] [INFO ] [MAIN ] WU: Loaded 54235 existing records. [2025-10-13T22:27:39.019246] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:27:39.019550] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-13T22:27:39.019634] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-13T22:27:39.020192] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-13T22:27:39.020253] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-13T22:27:39.131514] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T22:27:39.404270] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:39.617970] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-13T22:27:40.389604] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T22:27:40.417896] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-13T22:27:41.217933] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-13T22:27:41.406255] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T22:27:41.925118] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T22:27:42.017907] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-13T22:27:42.053301] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T22:27:42.817996] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-13T22:27:43.619408] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T22:27:43.619520] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-13T22:27:43.648343] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T22:27:44.417969] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-13T22:27:45.124437] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T22:27:45.217949] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-13T22:27:45.723349] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T22:27:46.017967] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-13T22:27:46.817906] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-13T22:27:46.922101] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T22:27:47.141388] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T22:27:47.617938] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-13T22:27:48.390848] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T22:27:48.417897] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-13T22:27:48.791673] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T22:27:49.217935] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-13T22:27:49.904962] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T22:27:50.017932] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-13T22:27:50.501759] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T22:27:50.817992] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-13T22:27:51.339794] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T22:27:51.617922] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-13T22:27:52.417979] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-13T22:27:52.568302] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T22:27:53.225489] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-13T22:27:53.247432] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T22:27:54.014297] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T22:27:54.023263] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-13T22:27:54.789758] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T22:27:54.795712] [INFO ] [REMOTE ] WTRG: Full fetch complete (73544 records). [2025-10-13T22:27:54.795867] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-13T22:27:54.828619] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-13T22:27:55.212766] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-13T22:27:55.212882] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-13T22:27:55.214277] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-13T22:27:55.214344] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-13T22:27:55.216423] [DEBUG] [LOCAL ] WTRG: Trimmed 73544 records to 51008 (keeping 200 days of data) [2025-10-13T22:27:55.550881] [DEBUG] [LOCAL ] WTRG: Primary data saved (51008 records). [2025-10-13T22:27:55.551070] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-13T22:27:55.551183] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTRG took 28.8s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-13T22:27:55.621465] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-13T22:27:55.756358] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:27:55.799434] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T22:27:55.856309] [DEBUG] [LOCAL ] WWW: Loaded 49946 existing records from primary storage. [2025-10-13T22:27:55.856772] [INFO ] [MAIN ] WWW: Loaded 49946 existing records. [2025-10-13T22:27:56.072227] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:27:56.072553] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-13T22:27:56.072604] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-13T22:27:56.073100] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-13T22:27:56.073159] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-13T22:27:56.419925] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-13T22:27:56.536598] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:27:56.571249] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T22:27:56.646588] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T22:27:57.218002] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-13T22:27:57.969097] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T22:27:58.017930] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-13T22:27:58.188526] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T22:27:58.817951] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-13T22:27:59.617956] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-13T22:27:59.838258] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T22:28:00.227864] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T22:28:00.232419] [INFO ] [REMOTE ] WTTR: Full fetch complete (65367 records). [2025-10-13T22:28:00.232541] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-13T22:28:00.423129] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-13T22:28:00.617155] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-13T22:28:00.617332] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-13T22:28:00.618686] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-13T22:28:00.618894] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-13T22:28:00.620356] [DEBUG] [LOCAL ] WTTR: Trimmed 65367 records to 44571 (keeping 200 days of data) [2025-10-13T22:28:00.733274] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T22:28:00.902755] [DEBUG] [LOCAL ] WTTR: Primary data saved (44571 records). [2025-10-13T22:28:00.902898] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-13T22:28:00.903004] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTTR took 26.7s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-13T22:28:01.067895] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:01.120230] [DEBUG] [LOCAL ] WY: Loaded 53917 existing records from primary storage. [2025-10-13T22:28:01.120552] [INFO ] [MAIN ] WY: Loaded 53917 existing records. [2025-10-13T22:28:01.219539] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-13T22:28:01.298272] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:01.298475] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-13T22:28:01.298525] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-13T22:28:01.299093] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-13T22:28:01.299150] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-13T22:28:01.687985] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:02.017894] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-13T22:28:02.145703] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T22:28:02.249166] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T22:28:02.817932] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-13T22:28:03.617935] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-13T22:28:03.851558] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T22:28:04.226695] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T22:28:04.228839] [INFO ] [REMOTE ] WTS: Full fetch complete (25663 records). [2025-10-13T22:28:04.228917] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-13T22:28:04.413558] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T22:28:04.421798] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-13T22:28:04.642303] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-13T22:28:04.642390] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-13T22:28:04.643117] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-13T22:28:04.643180] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-13T22:28:04.643967] [DEBUG] [LOCAL ] WTS: Trimmed 25663 records to 17552 (keeping 200 days of data) [2025-10-13T22:28:04.754689] [DEBUG] [LOCAL ] WTS: Primary data saved (17552 records). [2025-10-13T22:28:04.754857] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-13T22:28:04.754965] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTS took 34.3s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-13T22:28:04.926666] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:04.958604] [DEBUG] [LOCAL ] XFLT: Loaded 30248 existing records from primary storage. [2025-10-13T22:28:04.958915] [INFO ] [MAIN ] XFLT: Loaded 30248 existing records. [2025-10-13T22:28:05.133496] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:05.133768] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-13T22:28:05.133819] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-13T22:28:05.134277] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-13T22:28:05.134333] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-13T22:28:05.223122] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-13T22:28:05.488719] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:06.017952] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-13T22:28:06.278038] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T22:28:06.817922] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-13T22:28:07.132470] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T22:28:07.455318] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T22:28:07.617959] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-13T22:28:08.430332] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-13T22:28:08.436819] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T22:28:09.224363] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-13T22:28:09.228699] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T22:28:10.017954] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-13T22:28:10.188437] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T22:28:10.819167] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-13T22:28:10.826866] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T22:28:11.530379] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T22:28:11.617959] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-13T22:28:12.417918] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-13T22:28:12.559259] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T22:28:12.871048] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T22:28:13.217951] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-13T22:28:14.017955] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-13T22:28:14.339182] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T22:28:14.352164] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T22:28:14.817923] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-13T22:28:15.563087] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T22:28:15.617911] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-13T22:28:16.255475] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T22:28:16.417944] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-13T22:28:17.217932] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-13T22:28:17.371224] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T22:28:18.017937] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-13T22:28:18.321790] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T22:28:18.404023] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T22:28:18.817913] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-13T22:28:19.623052] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-13T22:28:19.640572] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T22:28:20.298918] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T22:28:20.306908] [INFO ] [REMOTE ] WU: Full fetch complete (77348 records). [2025-10-13T22:28:20.307126] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-13T22:28:20.423288] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-13T22:28:20.758175] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-13T22:28:20.758403] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-13T22:28:20.760181] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-13T22:28:20.760304] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-13T22:28:20.778747] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T22:28:20.785028] [DEBUG] [LOCAL ] WU: Trimmed 77348 records to 53470 (keeping 200 days of data) [2025-10-13T22:28:21.139939] [DEBUG] [LOCAL ] WU: Primary data saved (53470 records). [2025-10-13T22:28:21.140119] [INFO ] [MAIN ] WU: Full history saved. [2025-10-13T22:28:21.140213] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 42.6s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-13T22:28:21.223192] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-13T22:28:21.311783] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:21.353999] [DEBUG] [LOCAL ] XHR: Loaded 44269 existing records from primary storage. [2025-10-13T22:28:21.354345] [INFO ] [MAIN ] XHR: Loaded 44269 existing records. [2025-10-13T22:28:21.533762] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:21.534021] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-13T22:28:21.534069] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-13T22:28:21.534691] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-13T22:28:21.534750] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-13T22:28:21.928491] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:21.981315] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T22:28:22.017913] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-13T22:28:22.817913] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-13T22:28:23.098368] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T22:28:23.617905] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-13T22:28:23.811822] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T22:28:23.895787] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T22:28:24.417990] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-13T22:28:25.135190] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T22:28:25.217995] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-13T22:28:26.017963] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-13T22:28:26.088635] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T22:28:26.571209] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T22:28:26.817929] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-13T22:28:27.617894] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-13T22:28:27.827706] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T22:28:28.163404] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T22:28:28.417893] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-13T22:28:29.147114] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T22:28:29.217904] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-13T22:28:30.017916] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-13T22:28:30.098135] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T22:28:30.817950] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-13T22:28:31.073174] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T22:28:31.371443] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T22:28:31.617925] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-13T22:28:32.371753] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T22:28:32.423042] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-13T22:28:32.436334] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T22:28:33.217941] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-13T22:28:33.868602] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T22:28:34.017915] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-13T22:28:34.817938] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-13T22:28:34.938448] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T22:28:35.617973] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-13T22:28:35.823052] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T22:28:36.068541] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T22:28:36.075191] [INFO ] [REMOTE ] WY: Full fetch complete (76850 records). [2025-10-13T22:28:36.075324] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-13T22:28:36.362002] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T22:28:36.423019] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-13T22:28:36.499897] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-13T22:28:36.499998] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-13T22:28:36.501259] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-13T22:28:36.501354] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-13T22:28:36.502936] [DEBUG] [LOCAL ] WY: Trimmed 76850 records to 53192 (keeping 200 days of data) [2025-10-13T22:28:36.832345] [DEBUG] [LOCAL ] WY: Primary data saved (53192 records). [2025-10-13T22:28:36.832528] [INFO ] [MAIN ] WY: Full history saved. [2025-10-13T22:28:36.832617] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WY took 35.9s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-13T22:28:37.001986] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:37.002195] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-13T22:28:37.002245] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-13T22:28:37.002382] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-13T22:28:37.002437] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-13T22:28:37.002491] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-13T22:28:37.002535] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-13T22:28:37.226917] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-13T22:28:37.368993] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:37.706503] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T22:28:38.017942] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-13T22:28:38.239150] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:28:38.239488] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-13T22:28:38.239579] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:28:38.239627] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-13T22:28:38.239699] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:28:38.239772] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-13T22:28:38.239836] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-13T22:28:38.239872] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-13T22:28:38.239926] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-13T22:28:38.239999] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 1.4s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-13T22:28:38.411237] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:38.467258] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-13T22:28:38.467605] [INFO ] [MAIN ] XOM: Loaded 54573 existing records. [2025-10-13T22:28:38.654575] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:38.654897] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-13T22:28:38.654952] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-13T22:28:38.655382] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-13T22:28:38.655438] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-13T22:28:38.824474] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-13T22:28:38.817930] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T22:28:38.933056] [INFO ] [REMOTE ] WWW: Full fetch complete (70344 records). [2025-10-13T22:28:38.953887] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-13T22:28:39.142577] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:39.415869] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-13T22:28:39.415952] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-13T22:28:39.417060] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-13T22:28:39.417123] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-13T22:28:39.418633] [DEBUG] [LOCAL ] WWW: Trimmed 70344 records to 49251 (keeping 200 days of data) [2025-10-13T22:28:39.628244] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-13T22:28:39.731373] [DEBUG] [LOCAL ] WWW: Primary data saved (49251 records). [2025-10-13T22:28:39.731552] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-13T22:28:39.731693] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. WWW took 44.2s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-13T22:28:39.914590] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:39.943587] [DEBUG] [LOCAL ] XPER: Loaded 30589 existing records from primary storage. [2025-10-13T22:28:39.943885] [INFO ] [MAIN ] XPER: Loaded 30589 existing records. [2025-10-13T22:28:40.140401] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:40.140607] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-13T22:28:40.140680] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-13T22:28:40.140938] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-13T22:28:40.140995] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-13T22:28:40.425377] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-13T22:28:40.527418] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:40.564582] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T22:28:40.582632] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T22:28:40.586448] [INFO ] [REMOTE ] XFLT: Full fetch complete (43750 records). [2025-10-13T22:28:40.586542] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-13T22:28:40.960887] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-13T22:28:40.960966] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-13T22:28:40.961938] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-13T22:28:40.961999] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-13T22:28:40.962947] [DEBUG] [LOCAL ] XFLT: Trimmed 43750 records to 29895 (keeping 200 days of data) [2025-10-13T22:28:41.142313] [DEBUG] [LOCAL ] XFLT: Primary data saved (29895 records). [2025-10-13T22:28:41.142540] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-13T22:28:41.142665] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XFLT took 36.4s. Estimated remaining: 4m 55s. Rate: 7.1 symbols/min [2025-10-13T22:28:41.223045] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-13T22:28:41.322110] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:41.380923] [DEBUG] [LOCAL ] XPEV: Loaded 54414 existing records from primary storage. [2025-10-13T22:28:41.381322] [INFO ] [MAIN ] XPEV: Loaded 54414 existing records. [2025-10-13T22:28:41.562380] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:41.562602] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-13T22:28:41.562672] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-13T22:28:41.563179] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-13T22:28:41.563236] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-13T22:28:41.913740] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:42.017898] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-13T22:28:42.611128] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T22:28:42.685028] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-13T22:28:42.817906] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-13T22:28:43.617928] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-13T22:28:43.937798] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T22:28:44.289538] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-13T22:28:44.417930] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-13T22:28:45.217963] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-13T22:28:45.608174] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T22:28:46.012897] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-13T22:28:46.023174] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-13T22:28:46.817996] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-13T22:28:47.114370] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T22:28:47.346742] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-13T22:28:47.617954] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-13T22:28:48.126555] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T22:28:48.417935] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-13T22:28:48.542262] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T22:28:49.217965] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-13T22:28:49.660728] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T22:28:50.017900] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-13T22:28:50.492038] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T22:28:50.817954] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-13T22:28:51.617964] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-13T22:28:52.276133] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T22:28:52.335944] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T22:28:52.417947] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-13T22:28:53.218036] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-13T22:28:53.446137] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T22:28:53.703890] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-13T22:28:54.017950] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-13T22:28:54.680173] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T22:28:54.684879] [INFO ] [REMOTE ] XHR: Full fetch complete (61743 records). [2025-10-13T22:28:54.685013] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-13T22:28:54.823174] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-13T22:28:55.143024] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-13T22:28:55.143283] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-13T22:28:55.144544] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-13T22:28:55.144632] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-13T22:28:55.146144] [DEBUG] [LOCAL ] XHR: Trimmed 61743 records to 43633 (keeping 200 days of data) [2025-10-13T22:28:55.255682] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T22:28:55.457449] [DEBUG] [LOCAL ] XHR: Primary data saved (43633 records). [2025-10-13T22:28:55.457685] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-13T22:28:55.457806] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 34.3s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-13T22:28:55.618374] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-13T22:28:55.639237] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:28:55.693385] [DEBUG] [LOCAL ] XPO: Loaded 48522 existing records from primary storage. [2025-10-13T22:28:55.693838] [INFO ] [MAIN ] XPO: Loaded 48522 existing records. [2025-10-13T22:28:55.884593] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:28:55.884908] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-13T22:28:55.884955] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-13T22:28:55.885507] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-13T22:28:55.885564] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-13T22:28:56.248531] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:28:56.417946] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-13T22:28:56.871912] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T22:28:57.217966] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-13T22:28:57.544571] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-13T22:28:58.018053] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-13T22:28:58.803011] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-13T22:28:58.827461] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-13T22:28:58.848701] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T22:28:59.617968] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-13T22:29:00.417942] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-13T22:29:00.495618] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T22:29:01.174564] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T22:29:01.228601] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-13T22:29:01.233493] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T22:29:01.804336] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T22:29:02.017943] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-13T22:29:02.817997] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-13T22:29:03.617906] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-13T22:29:03.658435] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-13T22:29:04.388042] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T22:29:04.425030] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-13T22:29:04.430917] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-13T22:29:04.628886] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T22:29:04.633424] [INFO ] [REMOTE ] XPER: Full fetch complete (43269 records). [2025-10-13T22:29:04.633572] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-13T22:29:05.079936] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-13T22:29:05.080029] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-13T22:29:05.081189] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-13T22:29:05.081254] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-13T22:29:05.082590] [DEBUG] [LOCAL ] XPER: Trimmed 43269 records to 30245 (keeping 200 days of data) [2025-10-13T22:29:05.232066] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-13T22:29:05.271200] [DEBUG] [LOCAL ] XPER: Primary data saved (30245 records). [2025-10-13T22:29:05.271340] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-13T22:29:05.271424] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 25.5s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-13T22:29:05.436291] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:05.469997] [DEBUG] [LOCAL ] XPOF: Loaded 38159 existing records from primary storage. [2025-10-13T22:29:05.470316] [INFO ] [MAIN ] XPOF: Loaded 38159 existing records. [2025-10-13T22:29:05.646027] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:05.646240] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-13T22:29:05.646294] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-13T22:29:05.646612] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-13T22:29:05.646700] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-13T22:29:06.002554] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:06.017890] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-13T22:29:06.057609] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T22:29:06.817916] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-13T22:29:07.263863] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T22:29:07.382191] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T22:29:07.617937] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-13T22:29:08.417940] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-13T22:29:08.900173] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T22:29:09.120263] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-13T22:29:09.217911] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-13T22:29:10.017905] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-13T22:29:10.313856] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T22:29:10.487973] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T22:29:10.817929] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-13T22:29:11.617931] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-13T22:29:12.216666] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-13T22:29:12.423489] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-13T22:29:12.440250] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T22:29:13.040934] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T22:29:13.217914] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-13T22:29:14.017981] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-13T22:29:14.795258] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-13T22:29:14.817894] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-13T22:29:15.460240] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T22:29:15.617922] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-13T22:29:15.699553] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-13T22:29:16.417985] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-13T22:29:16.994937] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T22:29:17.218388] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T22:29:17.218506] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-13T22:29:18.011522] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T22:29:18.020735] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-13T22:29:18.817971] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-13T22:29:19.125698] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T22:29:19.464396] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-13T22:29:19.470046] [INFO ] [REMOTE ] XPEV: Full fetch complete (77685 records). [2025-10-13T22:29:19.470190] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-13T22:29:19.642620] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-13T22:29:19.863022] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-13T22:29:19.863120] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-13T22:29:19.864430] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-13T22:29:19.864498] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-13T22:29:19.866084] [DEBUG] [LOCAL ] XPEV: Trimmed 77685 records to 53634 (keeping 200 days of data) [2025-10-13T22:29:20.194384] [DEBUG] [LOCAL ] XPEV: Primary data saved (53634 records). [2025-10-13T22:29:20.194685] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-13T22:29:20.194811] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 39.1s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-13T22:29:20.363544] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:20.406393] [DEBUG] [LOCAL ] XPRO: Loaded 46570 existing records from primary storage. [2025-10-13T22:29:20.406735] [INFO ] [MAIN ] XPRO: Loaded 46570 existing records. [2025-10-13T22:29:20.437339] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-13T22:29:20.589823] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:20.590110] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-13T22:29:20.590178] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-13T22:29:20.590882] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-13T22:29:20.590940] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-13T22:29:20.946099] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:21.217966] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-13T22:29:21.234964] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T22:29:21.276676] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T22:29:21.927773] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T22:29:22.017913] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-13T22:29:22.817945] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-13T22:29:22.877962] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T22:29:23.324079] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T22:29:23.617936] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-13T22:29:24.312591] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T22:29:24.417907] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-13T22:29:25.217922] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-13T22:29:26.012531] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-13T22:29:26.023872] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-13T22:29:26.079806] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T22:29:26.542754] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T22:29:26.817937] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-13T22:29:27.483383] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:29:27.617928] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-13T22:29:28.057771] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T22:29:28.061677] [INFO ] [REMOTE ] XPOF: Full fetch complete (52660 records). [2025-10-13T22:29:28.061823] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-13T22:29:28.423307] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-13T22:29:28.441800] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-13T22:29:28.441873] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-13T22:29:28.443060] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-13T22:29:28.443207] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-13T22:29:28.444456] [DEBUG] [LOCAL ] XPOF: Trimmed 52660 records to 37558 (keeping 200 days of data) [2025-10-13T22:29:28.655438] [DEBUG] [LOCAL ] XPOF: Primary data saved (37558 records). [2025-10-13T22:29:28.655582] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-13T22:29:28.655725] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPOF took 23.4s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-13T22:29:28.827515] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:28.856466] [DEBUG] [LOCAL ] XYF: Loaded 28704 existing records from primary storage. [2025-10-13T22:29:28.856798] [INFO ] [MAIN ] XYF: Loaded 28704 existing records. [2025-10-13T22:29:29.037413] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:29.037697] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-13T22:29:29.037980] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-13T22:29:29.043544] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-13T22:29:29.051688] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-13T22:29:29.123442] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T22:29:29.159137] [INFO ] [REMOTE ] XPO: Full fetch complete (69710 records). [2025-10-13T22:29:29.161715] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-13T22:29:29.221024] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-13T22:29:29.665322] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:29.847097] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-13T22:29:29.855579] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-13T22:29:29.857020] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-13T22:29:29.857179] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-13T22:29:29.877074] [DEBUG] [LOCAL ] XPO: Trimmed 69710 records to 47760 (keeping 200 days of data) [2025-10-13T22:29:29.888248] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T22:29:29.889166] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T22:29:29.904783] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-13T22:29:29.904916] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-13T22:29:30.023036] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-13T22:29:30.536384] [DEBUG] [LOCAL ] XPO: Primary data saved (47760 records). [2025-10-13T22:29:30.546885] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-13T22:29:30.560307] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 35.1s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-13T22:29:30.708582] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-13T22:29:30.719067] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-13T22:29:30.720339] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-13T22:29:30.720423] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-13T22:29:30.767221] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-10-13T22:29:30.790613] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:30.845427] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-13T22:29:31.067585] [DEBUG] [LOCAL ] XYL: Loaded 48625 existing records from primary storage. [2025-10-13T22:29:31.075059] [INFO ] [MAIN ] XYL: Loaded 48625 existing records. [2025-10-13T22:29:31.266214] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:31.267679] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-13T22:29:31.268014] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-13T22:29:31.269209] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-13T22:29:31.269502] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-13T22:29:31.547396] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-13T22:29:31.570585] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-13T22:29:31.541898] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T22:29:31.586320] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XOM took 53.3s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-13T22:29:31.625795] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-13T22:29:31.849442] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:31.910315] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:31.910573] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-13T22:29:31.910912] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-13T22:29:31.911124] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-13T22:29:31.911242] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-13T22:29:31.911384] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-13T22:29:31.911430] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-13T22:29:32.117945] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T22:29:32.306905] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:32.388245] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T22:29:32.417893] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-13T22:29:32.613720] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T22:29:32.614107] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-13T22:29:32.614200] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:29:32.614247] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-13T22:29:32.614281] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:29:32.614367] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-13T22:29:32.614430] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-13T22:29:32.614474] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-13T22:29:32.614512] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-13T22:29:32.614570] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 1.0s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-13T22:29:32.777591] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:32.815502] [DEBUG] [LOCAL ] YALA: Loaded 37416 existing records from primary storage. [2025-10-13T22:29:32.815876] [INFO ] [MAIN ] YALA: Loaded 37416 existing records. [2025-10-13T22:29:32.987577] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:32.987830] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-13T22:29:32.987877] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-13T22:29:32.988125] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-13T22:29:32.988181] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-13T22:29:33.226771] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-13T22:29:33.343451] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:34.017922] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-13T22:29:34.821806] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-13T22:29:34.822755] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T22:29:35.093100] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T22:29:35.617913] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-13T22:29:36.179957] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T22:29:36.417941] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-13T22:29:36.599594] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T22:29:37.217945] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-13T22:29:38.017905] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-13T22:29:38.185953] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T22:29:38.378521] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T22:29:38.817986] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-13T22:29:39.007760] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T22:29:39.617943] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-13T22:29:40.224980] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T22:29:40.417902] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-13T22:29:40.775685] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T22:29:41.218009] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-13T22:29:42.017985] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-13T22:29:42.139754] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T22:29:42.287388] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T22:29:42.817934] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-13T22:29:43.247112] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T22:29:43.617931] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-13T22:29:44.033977] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T22:29:44.417939] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-13T22:29:45.108266] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T22:29:45.217923] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-13T22:29:45.933824] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T22:29:46.017903] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-13T22:29:46.334855] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T22:29:46.817934] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-13T22:29:47.471509] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T22:29:47.617919] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-13T22:29:48.265093] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T22:29:48.417942] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-13T22:29:48.707832] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T22:29:49.217934] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-13T22:29:50.017906] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-13T22:29:50.090389] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:29:50.145248] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T22:29:50.148823] [INFO ] [REMOTE ] XYF: Full fetch complete (32962 records). [2025-10-13T22:29:50.148919] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-13T22:29:50.575395] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-13T22:29:50.575500] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-13T22:29:50.576997] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-13T22:29:50.577063] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-13T22:29:50.578171] [DEBUG] [LOCAL ] XYF: Trimmed 32962 records to 28103 (keeping 200 days of data) [2025-10-13T22:29:50.769788] [DEBUG] [LOCAL ] XYF: Primary data saved (28103 records). [2025-10-13T22:29:50.770000] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-13T22:29:50.770220] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYF took 22.1s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-13T22:29:50.828344] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-13T22:29:50.953523] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:29:50.997471] [DEBUG] [LOCAL ] YELP: Loaded 46061 existing records from primary storage. [2025-10-13T22:29:50.997871] [INFO ] [MAIN ] YELP: Loaded 46061 existing records. [2025-10-13T22:29:51.179173] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:29:51.179402] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-13T22:29:51.179450] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-13T22:29:51.179908] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-13T22:29:51.179966] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-13T22:29:51.547856] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:29:51.573580] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T22:29:51.617886] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-13T22:29:52.417935] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-13T22:29:52.587303] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T22:29:53.108884] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T22:29:53.217941] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-13T22:29:53.896814] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T22:29:54.017899] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-13T22:29:54.274682] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T22:29:54.817955] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-13T22:29:55.264373] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T22:29:55.617923] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-13T22:29:56.298915] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T22:29:56.417917] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-13T22:29:56.855501] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T22:29:57.217927] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-13T22:29:57.679006] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T22:29:58.018017] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-13T22:29:58.447109] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T22:29:58.817942] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-13T22:29:59.011794] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T22:29:59.617937] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-13T22:30:00.116377] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T22:30:00.417940] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-13T22:30:00.793544] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T22:30:01.217980] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-13T22:30:02.017911] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-13T22:30:02.154851] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T22:30:02.608842] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T22:30:02.817907] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-13T22:30:03.187143] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T22:30:03.190345] [INFO ] [REMOTE ] YALA: Full fetch complete (46812 records). [2025-10-13T22:30:03.190425] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-13T22:30:03.573371] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-13T22:30:03.573453] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-13T22:30:03.574413] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-13T22:30:03.574479] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-13T22:30:03.575506] [DEBUG] [LOCAL ] YALA: Trimmed 46812 records to 36962 (keeping 200 days of data) [2025-10-13T22:30:03.619775] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-13T22:30:03.787422] [DEBUG] [LOCAL ] YALA: Primary data saved (36962 records). [2025-10-13T22:30:03.787568] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-13T22:30:03.787699] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. YALA took 31.2s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-13T22:30:03.957110] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:04.007560] [DEBUG] [LOCAL ] YETI: Loaded 53210 existing records from primary storage. [2025-10-13T22:30:04.007948] [INFO ] [MAIN ] YETI: Loaded 53210 existing records. [2025-10-13T22:30:04.183011] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:04.183297] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-13T22:30:04.183350] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-13T22:30:04.183886] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-13T22:30:04.183944] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-13T22:30:04.418177] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T22:30:04.438472] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-13T22:30:04.481426] [INFO ] [REMOTE ] XPRO: Full fetch complete (66348 records). [2025-10-13T22:30:04.482228] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-13T22:30:04.648732] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:04.959167] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-13T22:30:04.959280] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-13T22:30:04.960424] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-13T22:30:04.960486] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-13T22:30:04.961857] [DEBUG] [LOCAL ] XPRO: Trimmed 66348 records to 45959 (keeping 200 days of data) [2025-10-13T22:30:05.245963] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-13T22:30:05.249797] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T22:30:05.269921] [DEBUG] [LOCAL ] XPRO: Primary data saved (45959 records). [2025-10-13T22:30:05.270088] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-13T22:30:05.270183] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XPRO took 45.1s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-13T22:30:05.438422] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:05.480890] [DEBUG] [LOCAL ] YEXT: Loaded 43739 existing records from primary storage. [2025-10-13T22:30:05.481240] [INFO ] [MAIN ] YEXT: Loaded 43739 existing records. [2025-10-13T22:30:05.659094] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:05.659319] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-13T22:30:05.659426] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-13T22:30:05.659724] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-13T22:30:05.659780] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-13T22:30:06.018456] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-13T22:30:06.021730] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:06.112786] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T22:30:06.636877] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T22:30:06.817937] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-13T22:30:07.617907] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-13T22:30:07.678190] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T22:30:08.272257] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T22:30:08.417911] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-13T22:30:09.019336] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T22:30:09.217902] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-13T22:30:09.927342] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T22:30:10.017900] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-13T22:30:10.715152] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T22:30:10.817936] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-13T22:30:11.426582] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T22:30:11.617937] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-13T22:30:12.165555] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T22:30:12.417933] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-13T22:30:12.860128] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T22:30:13.019101] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T22:30:13.024197] [INFO ] [REMOTE ] XYL: Full fetch complete (69720 records). [2025-10-13T22:30:13.024320] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-13T22:30:13.223112] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-13T22:30:13.413140] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-13T22:30:13.413231] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-13T22:30:13.414513] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-13T22:30:13.414581] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-13T22:30:13.416138] [DEBUG] [LOCAL ] XYL: Trimmed 69720 records to 47852 (keeping 200 days of data) [2025-10-13T22:30:13.715531] [DEBUG] [LOCAL ] XYL: Primary data saved (47852 records). [2025-10-13T22:30:13.715698] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-13T22:30:13.715793] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. XYL took 43.1s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-13T22:30:13.887903] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:13.942163] [DEBUG] [LOCAL ] YMM: Loaded 53367 existing records from primary storage. [2025-10-13T22:30:13.942544] [INFO ] [MAIN ] YMM: Loaded 53367 existing records. [2025-10-13T22:30:14.023075] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-13T22:30:14.125639] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:14.125920] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-13T22:30:14.125973] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-13T22:30:14.126500] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-13T22:30:14.126541] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-13T22:30:14.488887] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:14.587186] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T22:30:14.817924] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-13T22:30:15.617896] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-13T22:30:15.653733] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T22:30:16.417953] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-13T22:30:16.562387] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T22:30:17.217897] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-13T22:30:17.264527] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T22:30:18.017897] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-13T22:30:18.057918] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T22:30:18.536606] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T22:30:18.817938] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-13T22:30:19.617911] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-13T22:30:19.789747] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T22:30:20.110460] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T22:30:20.417929] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-13T22:30:21.217938] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-13T22:30:21.254739] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T22:30:22.017906] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-13T22:30:22.098909] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T22:30:22.817942] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-13T22:30:22.947160] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T22:30:23.617910] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-13T22:30:23.838624] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T22:30:24.417947] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-13T22:30:24.446360] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T22:30:25.217964] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-13T22:30:25.219619] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T22:30:26.017915] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-13T22:30:26.251276] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T22:30:26.479481] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T22:30:26.817940] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-13T22:30:27.617909] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-13T22:30:27.686155] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:30:28.083352] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T22:30:28.418000] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-13T22:30:29.217913] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-13T22:30:29.418510] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T22:30:29.836079] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T22:30:30.017898] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-13T22:30:30.580898] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T22:30:30.817930] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-13T22:30:31.623015] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-13T22:30:31.634830] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T22:30:32.417909] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-13T22:30:32.609042] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T22:30:33.217901] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-13T22:30:33.402486] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T22:30:33.546877] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T22:30:33.552521] [INFO ] [REMOTE ] YELP: Full fetch complete (64633 records). [2025-10-13T22:30:33.552686] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-13T22:30:33.955374] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-13T22:30:33.955457] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-13T22:30:33.956613] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-13T22:30:33.956703] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-13T22:30:33.958302] [DEBUG] [LOCAL ] YELP: Trimmed 64633 records to 45436 (keeping 200 days of data) [2025-10-13T22:30:34.040920] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-13T22:30:34.217824] [DEBUG] [LOCAL ] YELP: Primary data saved (45436 records). [2025-10-13T22:30:34.218514] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-13T22:30:34.218607] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 43.4s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-13T22:30:34.388916] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:34.435123] [DEBUG] [LOCAL ] YOU: Loaded 50448 existing records from primary storage. [2025-10-13T22:30:34.435440] [INFO ] [MAIN ] YOU: Loaded 50448 existing records. [2025-10-13T22:30:34.617165] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:34.617533] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-13T22:30:34.617605] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-13T22:30:34.623315] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-13T22:30:34.629861] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-13T22:30:34.636182] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T22:30:34.713246] [INFO ] [REMOTE ] YEXT: Full fetch complete (63152 records). [2025-10-13T22:30:34.736681] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-13T22:30:34.818359] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-13T22:30:35.327285] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:35.425629] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-13T22:30:35.425785] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-13T22:30:35.427046] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-13T22:30:35.427114] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-13T22:30:35.428576] [DEBUG] [LOCAL ] YEXT: Trimmed 63152 records to 43108 (keeping 200 days of data) [2025-10-13T22:30:35.561352] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T22:30:35.621561] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-13T22:30:35.652624] [INFO ] [REMOTE ] YETI: Full fetch complete (75404 records). [2025-10-13T22:30:35.658166] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-13T22:30:36.081097] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-13T22:30:36.081828] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-13T22:30:36.084282] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-13T22:30:36.084361] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-13T22:30:36.090615] [DEBUG] [LOCAL ] YETI: Trimmed 75404 records to 52473 (keeping 200 days of data) [2025-10-13T22:30:36.112430] [DEBUG] [LOCAL ] YEXT: Primary data saved (43108 records). [2025-10-13T22:30:36.112519] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-13T22:30:36.112607] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YEXT took 30.8s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-13T22:30:36.380037] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:36.534580] [DEBUG] [LOCAL ] YPF: Loaded 51292 existing records from primary storage. [2025-10-13T22:30:36.536779] [INFO ] [MAIN ] YPF: Loaded 51292 existing records. [2025-10-13T22:30:36.792830] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:36.840312] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-13T22:30:36.845907] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-13T22:30:36.847026] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-13T22:30:36.848005] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-13T22:30:36.854768] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T22:30:36.977858] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-13T22:30:36.988363] [DEBUG] [LOCAL ] YETI: Primary data saved (52473 records). [2025-10-13T22:30:36.994590] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-13T22:30:37.005195] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YETI took 33.2s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-13T22:30:37.357744] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:37.446926] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:37.447494] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-13T22:30:37.478536] [DEBUG] [LOCAL ] YRD: Loaded 12135 existing records from primary storage. [2025-10-13T22:30:37.481885] [INFO ] [MAIN ] YRD: Loaded 12135 existing records. [2025-10-13T22:30:37.496738] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T22:30:37.676186] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:37.676412] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-13T22:30:37.676461] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-13T22:30:37.676714] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-13T22:30:37.676789] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-13T22:30:38.023095] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-13T22:30:38.081691] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:38.802994] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T22:30:38.817892] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-13T22:30:39.286252] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T22:30:39.617974] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-13T22:30:39.784436] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:30:40.290414] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T22:30:40.417989] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-13T22:30:41.217966] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-13T22:30:41.376076] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:30:42.017952] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-13T22:30:42.144659] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T22:30:42.197842] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T22:30:42.817935] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-13T22:30:43.617928] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-13T22:30:43.650829] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T22:30:44.417907] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-13T22:30:44.455148] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T22:30:44.474473] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T22:30:45.217974] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-13T22:30:45.911122] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T22:30:46.017918] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-13T22:30:46.817943] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-13T22:30:47.115685] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T22:30:47.617915] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-13T22:30:47.682921] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:30:47.994241] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T22:30:47.999842] [INFO ] [REMOTE ] YMM: Full fetch complete (76324 records). [2025-10-13T22:30:48.000015] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-13T22:30:48.415552] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-13T22:30:48.415708] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-13T22:30:48.417104] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-13T22:30:48.417173] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-13T22:30:48.418055] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-13T22:30:48.420101] [DEBUG] [LOCAL ] YMM: Trimmed 76324 records to 52604 (keeping 200 days of data) [2025-10-13T22:30:48.766867] [DEBUG] [LOCAL ] YMM: Primary data saved (52604 records). [2025-10-13T22:30:48.767031] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-13T22:30:48.767125] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 35.1s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-13T22:30:48.944039] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:30:48.973454] [DEBUG] [LOCAL ] YSG: Loaded 25646 existing records from primary storage. [2025-10-13T22:30:48.973936] [INFO ] [MAIN ] YSG: Loaded 25646 existing records. [2025-10-13T22:30:49.177420] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:30:49.177773] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-13T22:30:49.177990] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-13T22:30:49.178330] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-13T22:30:49.178386] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-13T22:30:49.220395] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-13T22:30:49.570978] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:30:49.571617] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T22:30:49.605768] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T22:30:50.017946] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-13T22:30:50.730387] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T22:30:50.817947] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-13T22:30:51.130417] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T22:30:51.617929] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-13T22:30:52.113125] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T22:30:52.417990] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-13T22:30:53.217911] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-13T22:30:53.449033] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T22:30:53.482962] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T22:30:54.017999] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-13T22:30:54.629238] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T22:30:54.817911] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-13T22:30:54.832106] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T22:30:55.617940] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-13T22:30:56.311458] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T22:30:56.417915] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-13T22:30:56.604367] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T22:30:57.200330] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T22:30:57.217888] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-13T22:30:58.018015] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-13T22:30:58.072052] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T22:30:58.817932] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-13T22:30:58.867082] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T22:30:59.489579] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-13T22:30:59.617959] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-13T22:31:00.406470] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T22:31:00.417916] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-13T22:31:01.217967] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-13T22:31:01.620345] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T22:31:01.730547] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T22:31:01.732334] [INFO ] [REMOTE ] YRD: Full fetch complete (19175 records). [2025-10-13T22:31:01.732403] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-13T22:31:02.023107] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-13T22:31:02.102334] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-13T22:31:02.102430] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-13T22:31:02.103016] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-13T22:31:02.103081] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-13T22:31:02.103751] [DEBUG] [LOCAL ] YRD: Trimmed 19175 records to 11833 (keeping 200 days of data) [2025-10-13T22:31:02.178132] [DEBUG] [LOCAL ] YRD: Primary data saved (11833 records). [2025-10-13T22:31:02.178322] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-13T22:31:02.178421] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YRD took 25.2s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-13T22:31:02.347345] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:31:02.411066] [DEBUG] [LOCAL ] YUM: Loaded 51941 existing records from primary storage. [2025-10-13T22:31:02.411462] [INFO ] [MAIN ] YUM: Loaded 51941 existing records. [2025-10-13T22:31:02.594919] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:31:02.595217] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-13T22:31:02.595266] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-13T22:31:02.595484] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-13T22:31:02.595524] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-13T22:31:02.823088] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-13T22:31:02.958961] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:31:03.617936] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-13T22:31:03.880384] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T22:31:04.417916] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-13T22:31:04.545398] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T22:31:05.217942] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-13T22:31:05.531462] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T22:31:06.017900] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-13T22:31:06.069255] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T22:31:06.173354] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T22:31:06.817951] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-13T22:31:07.578499] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T22:31:07.617946] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-13T22:31:07.764849] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T22:31:08.417950] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-13T22:31:08.728444] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T22:31:09.217948] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-13T22:31:10.017906] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-13T22:31:10.150902] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T22:31:10.817928] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-13T22:31:10.925880] [DEBUG] [REMOTE ] YSG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-13T22:31:10.926212] [WARN ] [REMOTE ] YSG: No data returned for month 2025-07 [2025-10-13T22:31:10.926315] [FATAL] [REMOTE ] YSG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T22:31:10.926440] [FATAL] [MAIN ] YSG: Failed to fetch primary data. [2025-10-13T22:31:10.926523] [WARN ] [MAIN ] YSG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T22:31:10.926612] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-13T22:31:10.926745] [DEBUG] [LOCAL ] YSG: No primary data file found to delete. [2025-10-13T22:31:10.926796] [INFO ] [LOCAL ] YSG: Starting deletion of derivative data. [2025-10-13T22:31:10.926987] [DEBUG] [LOCAL ] YSG: Deleted derivative data file. [2025-10-13T22:31:10.927082] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YSG took 22.2s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-13T22:31:11.104988] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:31:11.137355] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T22:31:11.193484] [DEBUG] [LOCAL ] YUMC: Loaded 53362 existing records from primary storage. [2025-10-13T22:31:11.193859] [INFO ] [MAIN ] YUMC: Loaded 53362 existing records. [2025-10-13T22:31:11.383775] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:31:11.384102] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-13T22:31:11.384155] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-13T22:31:11.384373] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-13T22:31:11.384429] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-13T22:31:11.626495] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-13T22:31:11.726906] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T22:31:11.767043] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:31:11.768172] [INFO ] [REMOTE ] YOU: Full fetch complete (72169 records). [2025-10-13T22:31:11.768360] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-13T22:31:12.171749] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-13T22:31:12.171832] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-13T22:31:12.173175] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-13T22:31:12.173278] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-13T22:31:12.174814] [DEBUG] [LOCAL ] YOU: Trimmed 72169 records to 49667 (keeping 200 days of data) [2025-10-13T22:31:12.421121] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-13T22:31:12.478565] [DEBUG] [LOCAL ] YOU: Primary data saved (49667 records). [2025-10-13T22:31:12.478718] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-13T22:31:12.478829] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YOU took 38.3s. Estimated remaining: 2m 23s. Rate: 7.1 symbols/min [2025-10-13T22:31:12.651247] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:31:12.699672] [DEBUG] [LOCAL ] ZBH: Loaded 51529 existing records from primary storage. [2025-10-13T22:31:12.700005] [INFO ] [MAIN ] ZBH: Loaded 51529 existing records. [2025-10-13T22:31:12.877547] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:31:12.877850] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-13T22:31:12.877907] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-13T22:31:12.878112] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-13T22:31:12.878169] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-13T22:31:13.218034] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-13T22:31:13.239768] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:31:13.498784] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T22:31:13.866947] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T22:31:14.017927] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-13T22:31:14.792277] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T22:31:14.817898] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-13T22:31:15.617897] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-13T22:31:15.921850] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T22:31:16.417935] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-13T22:31:16.719998] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T22:31:17.217918] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-13T22:31:17.685139] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T22:31:17.931628] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T22:31:18.017900] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-13T22:31:18.774617] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T22:31:18.817874] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-13T22:31:19.425712] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T22:31:19.617886] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-13T22:31:20.417951] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-13T22:31:20.580769] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T22:31:21.197181] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T22:31:21.217882] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-13T22:31:22.017952] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-13T22:31:22.068460] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T22:31:22.817911] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-13T22:31:22.906863] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T22:31:23.617903] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-13T22:31:23.661196] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T22:31:24.417942] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-13T22:31:24.460675] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T22:31:24.465969] [INFO ] [REMOTE ] YPF: Full fetch complete (73495 records). [2025-10-13T22:31:24.466093] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-13T22:31:24.855945] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-13T22:31:24.856027] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-13T22:31:24.857207] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-13T22:31:24.857269] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-13T22:31:24.858782] [DEBUG] [LOCAL ] YPF: Trimmed 73495 records to 50614 (keeping 200 days of data) [2025-10-13T22:31:25.190633] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T22:31:25.217527] [DEBUG] [LOCAL ] YPF: Primary data saved (50614 records). [2025-10-13T22:31:25.217749] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-13T22:31:25.217865] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YPF took 49.1s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-13T22:31:25.217935] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-13T22:31:25.387848] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:31:25.407293] [DEBUG] [LOCAL ] ZEPP: Loaded 18685 existing records from primary storage. [2025-10-13T22:31:25.407567] [INFO ] [MAIN ] ZEPP: Loaded 18685 existing records. [2025-10-13T22:31:25.587508] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:31:25.587814] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-13T22:31:25.587862] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-13T22:31:25.588209] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-13T22:31:25.588272] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-13T22:31:25.953337] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:31:26.015858] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T22:31:26.025740] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-13T22:31:26.494189] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T22:31:26.818016] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-13T22:31:27.234638] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T22:31:27.617910] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-13T22:31:28.417919] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-13T22:31:28.663486] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T22:31:29.217917] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-13T22:31:29.377517] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T22:31:29.633881] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T22:31:30.017897] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-13T22:31:30.140173] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T22:31:30.443436] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T22:31:30.817976] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-13T22:31:31.356954] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T22:31:31.617938] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-13T22:31:32.417924] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-13T22:31:32.837511] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T22:31:32.842721] [INFO ] [REMOTE ] YUM: Full fetch complete (74444 records). [2025-10-13T22:31:32.842872] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-13T22:31:33.228151] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-13T22:31:33.260899] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T22:31:33.288902] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-13T22:31:33.289739] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-13T22:31:33.291211] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-13T22:31:33.291290] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-13T22:31:33.295115] [DEBUG] [LOCAL ] YUM: Trimmed 74444 records to 51165 (keeping 200 days of data) [2025-10-13T22:31:33.615868] [DEBUG] [LOCAL ] YUM: Primary data saved (51165 records). [2025-10-13T22:31:33.616010] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-13T22:31:33.616123] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 31.4s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-13T22:31:33.789225] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:31:33.846214] [DEBUG] [LOCAL ] ZETA: Loaded 54389 existing records from primary storage. [2025-10-13T22:31:33.846787] [INFO ] [MAIN ] ZETA: Loaded 54389 existing records. [2025-10-13T22:31:34.026156] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:31:34.026220] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-13T22:31:34.027207] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-13T22:31:34.027261] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-13T22:31:34.027800] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-13T22:31:34.027868] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-13T22:31:34.386385] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:31:34.817908] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-13T22:31:35.124413] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T22:31:35.290545] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T22:31:35.608024] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T22:31:35.618533] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-13T22:31:36.250345] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T22:31:36.417906] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-13T22:31:37.217955] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-13T22:31:38.017922] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-13T22:31:38.620719] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T22:31:38.817891] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-13T22:31:38.821699] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-13T22:31:38.918090] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T22:31:39.617923] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-13T22:31:40.129431] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T22:31:40.417948] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-13T22:31:41.217966] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-13T22:31:41.516048] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T22:31:41.973556] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T22:31:42.017902] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-13T22:31:42.817900] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-13T22:31:43.110725] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-13T22:31:43.310337] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T22:31:43.617903] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-13T22:31:44.417906] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-13T22:31:44.575869] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T22:31:45.217932] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-13T22:31:45.940870] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-13T22:31:46.003762] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T22:31:46.017913] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-13T22:31:46.077382] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T22:31:46.817979] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-13T22:31:47.403603] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T22:31:47.409002] [INFO ] [REMOTE ] ZBH: Full fetch complete (73642 records). [2025-10-13T22:31:47.409191] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-13T22:31:47.558733] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T22:31:47.598446] [INFO ] [REMOTE ] YUMC: Full fetch complete (76164 records). [2025-10-13T22:31:47.629677] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-13T22:31:47.644320] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-13T22:31:48.183966] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-13T22:31:48.204314] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-13T22:31:48.221312] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-13T22:31:48.229439] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-13T22:31:48.291039] [DEBUG] [LOCAL ] ZBH: Trimmed 73642 records to 50790 (keeping 200 days of data) [2025-10-13T22:31:48.329238] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-13T22:31:48.329309] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-13T22:31:48.329988] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-13T22:31:48.330100] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-13T22:31:48.386340] [DEBUG] [LOCAL ] YUMC: Trimmed 76164 records to 52596 (keeping 200 days of data) [2025-10-13T22:31:48.423176] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-13T22:31:48.787877] [DEBUG] [LOCAL ] ZBH: Primary data saved (50790 records). [2025-10-13T22:31:48.789599] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-13T22:31:48.789784] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZBH took 36.3s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-13T22:31:48.989457] [DEBUG] [LOCAL ] YUMC: Primary data saved (52596 records). [2025-10-13T22:31:48.989596] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-13T22:31:48.989721] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. YUMC took 38.1s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-13T22:31:49.555035] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T22:31:49.566344] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-13T22:31:49.878262] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T22:31:50.017893] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-13T22:31:51.126920] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T22:31:51.129968] [INFO ] [REMOTE ] ZEPP: Full fetch complete (20392 records). [2025-10-13T22:31:51.130048] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-13T22:31:51.518902] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-13T22:31:51.518993] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-13T22:31:51.519538] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-13T22:31:51.519577] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-13T22:31:51.520214] [DEBUG] [LOCAL ] ZEPP: Trimmed 20392 records to 18824 (keeping 200 days of data) [2025-10-13T22:31:51.635359] [DEBUG] [LOCAL ] ZEPP: Primary data saved (18824 records). [2025-10-13T22:31:51.635527] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-13T22:31:51.635633] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZEPP took 26.4s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-13T22:31:51.725269] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-13T22:31:51.736638] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-13T22:31:53.786528] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T22:31:53.797902] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-13T22:31:55.913307] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-13T22:31:55.924622] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-13T22:31:58.334304] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-13T22:31:58.345992] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-13T22:32:00.571381] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T22:32:00.582715] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-13T22:32:02.975521] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-13T22:32:02.990512] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-13T22:32:05.088604] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T22:32:05.094045] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-13T22:32:05.094190] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-13T22:32:05.483290] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-13T22:32:05.483374] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-13T22:32:05.484584] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-13T22:32:05.484670] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-13T22:32:05.486201] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 53611 (keeping 200 days of data) [2025-10-13T22:32:05.818168] [DEBUG] [LOCAL ] ZETA: Primary data saved (53611 records). [2025-10-13T22:32:05.818312] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-13T22:32:05.818400] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 32.2s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-13T22:32:06.439969] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:06.507763] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:06.538045] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:06.559829] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:06.596384] [DEBUG] [LOCAL ] ZH: Loaded 26192 existing records from primary storage. [2025-10-13T22:32:06.596691] [INFO ] [MAIN ] ZH: Loaded 26192 existing records. [2025-10-13T22:32:06.713407] [DEBUG] [LOCAL ] ZGN: Loaded 41436 existing records from primary storage. [2025-10-13T22:32:06.739259] [INFO ] [MAIN ] ZGN: Loaded 41436 existing records. [2025-10-13T22:32:06.786791] [DEBUG] [LOCAL ] ZIP: Loaded 44484 existing records from primary storage. [2025-10-13T22:32:06.877027] [INFO ] [MAIN ] ZIP: Loaded 44484 existing records. [2025-10-13T22:32:07.023997] [DEBUG] [LOCAL ] ZIM: Loaded 54281 existing records from primary storage. [2025-10-13T22:32:07.032686] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:07.054141] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-13T22:32:07.054416] [INFO ] [MAIN ] ZIM: Loaded 54281 existing records. [2025-10-13T22:32:07.054556] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-13T22:32:07.080667] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-13T22:32:07.122945] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-13T22:32:07.357590] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:07.388622] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-13T22:32:07.477598] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-13T22:32:07.586050] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-13T22:32:07.634844] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-13T22:32:07.629588] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:07.625599] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:07.706315] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-13T22:32:07.740853] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-13T22:32:07.791703] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-13T22:32:07.777730] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-13T22:32:07.839353] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-13T22:32:07.869373] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-13T22:32:07.869458] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-13T22:32:07.896737] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-13T22:32:08.483859] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:08.559958] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-13T22:32:08.774364] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:08.791244] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-13T22:32:09.062430] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:09.057002] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:09.062798] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-13T22:32:09.063877] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-13T22:32:09.959561] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T22:32:09.964829] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-13T22:32:10.154234] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T22:32:10.162985] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-13T22:32:10.211000] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T22:32:10.220177] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-13T22:32:10.965468] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T22:32:10.969889] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-13T22:32:11.173868] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T22:32:11.185567] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-13T22:32:11.287815] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T22:32:11.294095] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-13T22:32:11.584795] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T22:32:11.593508] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-13T22:32:12.510664] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T22:32:12.519224] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-13T22:32:12.587448] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T22:32:12.594693] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-13T22:32:12.614211] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T22:32:12.621694] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-13T22:32:13.358872] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T22:32:13.369400] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-13T22:32:13.982383] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T22:32:13.991319] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-13T22:32:14.022242] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T22:32:14.032906] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-13T22:32:14.069894] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T22:32:14.079299] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-13T22:32:15.019312] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T22:32:15.026531] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-13T22:32:15.112550] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T22:32:15.123527] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-13T22:32:15.701866] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T22:32:15.711814] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-13T22:32:15.881029] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T22:32:15.894371] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-13T22:32:16.059386] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T22:32:16.063875] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-13T22:32:16.894290] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T22:32:16.900155] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-13T22:32:17.068211] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T22:32:17.079133] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-13T22:32:17.135731] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T22:32:17.148410] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-13T22:32:17.449952] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T22:32:17.459243] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-13T22:32:18.057804] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T22:32:18.064277] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-13T22:32:18.653159] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T22:32:18.662558] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-13T22:32:18.935698] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T22:32:18.944128] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-13T22:32:19.164008] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T22:32:19.330512] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T22:32:19.617927] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-13T22:32:20.191755] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T22:32:20.335211] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T22:32:20.417932] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-13T22:32:21.217977] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-13T22:32:21.775281] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T22:32:22.005173] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T22:32:22.017888] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-13T22:32:22.520887] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T22:32:22.817954] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-13T22:32:23.589414] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T22:32:23.617894] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-13T22:32:24.037506] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T22:32:24.040143] [INFO ] [REMOTE ] ZH: Full fetch complete (40017 records). [2025-10-13T22:32:24.040222] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-13T22:32:24.412567] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-13T22:32:24.412675] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-13T22:32:24.413563] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-13T22:32:24.413605] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-13T22:32:24.414547] [DEBUG] [LOCAL ] ZH: Trimmed 40017 records to 25584 (keeping 200 days of data) [2025-10-13T22:32:24.457606] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-13T22:32:24.558496] [DEBUG] [LOCAL ] ZH: Primary data saved (25584 records). [2025-10-13T22:32:24.558686] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-13T22:32:24.558793] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 18.7s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-13T22:32:24.732529] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:24.770311] [DEBUG] [LOCAL ] ZK: Loaded 39847 existing records from primary storage. [2025-10-13T22:32:24.770631] [INFO ] [MAIN ] ZK: Loaded 39847 existing records. [2025-10-13T22:32:24.952329] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:24.952809] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-13T22:32:24.952935] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-13T22:32:24.953351] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-13T22:32:24.953406] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-13T22:32:25.091101] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T22:32:25.144700] [INFO ] [REMOTE ] ZIP: Full fetch complete (59999 records). [2025-10-13T22:32:25.180228] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-13T22:32:25.226758] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-13T22:32:25.501633] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:25.749348] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-13T22:32:25.749468] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-13T22:32:25.750848] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-13T22:32:25.750929] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-13T22:32:25.752241] [DEBUG] [LOCAL ] ZIP: Trimmed 59999 records to 43740 (keeping 200 days of data) [2025-10-13T22:32:25.878389] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T22:32:26.018495] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-13T22:32:26.048385] [DEBUG] [LOCAL ] ZIP: Primary data saved (43740 records). [2025-10-13T22:32:26.048557] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-13T22:32:26.048673] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 20.2s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-13T22:32:26.214486] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:26.224116] [DEBUG] [LOCAL ] ZKH: Loaded 7702 existing records from primary storage. [2025-10-13T22:32:26.224348] [INFO ] [MAIN ] ZKH: Loaded 7702 existing records. [2025-10-13T22:32:26.396193] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:26.396423] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-13T22:32:26.396469] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-13T22:32:26.396687] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-13T22:32:26.396743] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-13T22:32:26.775851] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:26.817908] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-13T22:32:27.420561] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-13T22:32:27.449797] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T22:32:27.619269] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-13T22:32:27.622821] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-13T22:32:28.417970] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-13T22:32:28.855027] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T22:32:29.217964] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-13T22:32:29.467180] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T22:32:30.017931] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-13T22:32:30.678476] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T22:32:30.817903] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-13T22:32:31.617924] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-13T22:32:32.339432] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T22:32:32.417930] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-13T22:32:32.576104] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T22:32:32.580515] [INFO ] [REMOTE ] ZGN: Full fetch complete (58117 records). [2025-10-13T22:32:32.580602] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-13T22:32:32.883147] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T22:32:33.009631] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-13T22:32:33.009774] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-13T22:32:33.010935] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-13T22:32:33.010998] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-13T22:32:33.012353] [DEBUG] [LOCAL ] ZGN: Trimmed 58117 records to 40908 (keeping 200 days of data) [2025-10-13T22:32:33.217962] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-13T22:32:33.255979] [DEBUG] [LOCAL ] ZGN: Primary data saved (40908 records). [2025-10-13T22:32:33.256125] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-13T22:32:33.256214] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 27.4s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-13T22:32:33.421378] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:33.466443] [DEBUG] [LOCAL ] ZTO: Loaded 50281 existing records from primary storage. [2025-10-13T22:32:33.466801] [INFO ] [MAIN ] ZTO: Loaded 50281 existing records. [2025-10-13T22:32:33.644310] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:33.644542] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-13T22:32:33.644590] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-13T22:32:33.645168] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-13T22:32:33.645226] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-13T22:32:33.993790] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:34.017976] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-13T22:32:34.573282] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T22:32:34.674602] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T22:32:34.744744] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T22:32:34.817942] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-13T22:32:35.617956] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-13T22:32:36.405184] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T22:32:36.417875] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-13T22:32:37.217952] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-13T22:32:37.427525] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T22:32:37.851223] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T22:32:38.017969] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-13T22:32:38.806319] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T22:32:38.817881] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-13T22:32:39.412247] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T22:32:39.617937] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-13T22:32:39.653054] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T22:32:40.417926] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-13T22:32:40.786573] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T22:32:41.069907] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T22:32:41.217895] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-13T22:32:41.857415] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T22:32:42.017907] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-13T22:32:42.817919] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-13T22:32:43.473270] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T22:32:43.617948] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-13T22:32:44.201976] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T22:32:44.289736] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T22:32:44.417945] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-13T22:32:45.217998] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-13T22:32:45.419009] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T22:32:46.017969] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-13T22:32:46.817977] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-13T22:32:46.882991] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T22:32:47.544674] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T22:32:47.617953] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-13T22:32:48.028544] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-13T22:32:48.034630] [INFO ] [REMOTE ] ZIM: Full fetch complete (77495 records). [2025-10-13T22:32:48.034797] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-13T22:32:48.420287] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-13T22:32:48.419976] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-13T22:32:48.420553] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-13T22:32:48.422295] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-13T22:32:48.423325] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-13T22:32:48.425079] [DEBUG] [LOCAL ] ZIM: Trimmed 77495 records to 53499 (keeping 200 days of data) [2025-10-13T22:32:48.759069] [DEBUG] [LOCAL ] ZIM: Primary data saved (53499 records). [2025-10-13T22:32:48.759208] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-13T22:32:48.759289] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 42.9s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-13T22:32:48.927393] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:48.943946] [DEBUG] [LOCAL ] ZTR: Loaded 16994 existing records from primary storage. [2025-10-13T22:32:48.944177] [INFO ] [MAIN ] ZTR: Loaded 16994 existing records. [2025-10-13T22:32:49.120228] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:49.120557] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-13T22:32:49.120621] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-13T22:32:49.128949] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-13T22:32:49.142362] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-13T22:32:49.185749] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T22:32:49.219687] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-13T22:32:49.497603] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:49.883301] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T22:32:49.978996] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T22:32:50.017927] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-13T22:32:50.817931] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-13T22:32:51.156937] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T22:32:51.161007] [INFO ] [REMOTE ] ZK: Full fetch complete (56923 records). [2025-10-13T22:32:51.161100] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-13T22:32:51.571915] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-13T22:32:51.572130] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-13T22:32:51.574014] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-13T22:32:51.574104] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-13T22:32:51.576419] [DEBUG] [LOCAL ] ZK: Trimmed 56923 records to 39149 (keeping 200 days of data) [2025-10-13T22:32:51.626551] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-13T22:32:51.679974] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T22:32:51.843759] [DEBUG] [LOCAL ] ZK: Primary data saved (39149 records). [2025-10-13T22:32:51.843975] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-13T22:32:51.844124] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZK took 27.3s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-13T22:32:52.021687] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:52.087928] [DEBUG] [LOCAL ] ZTS: Loaded 53853 existing records from primary storage. [2025-10-13T22:32:52.088417] [INFO ] [MAIN ] ZTS: Loaded 53853 existing records. [2025-10-13T22:32:52.281255] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:52.281539] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-13T22:32:52.281586] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-13T22:32:52.282593] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-13T22:32:52.282691] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-13T22:32:52.427600] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-13T22:32:52.687425] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:53.217917] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-13T22:32:53.497498] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T22:32:53.541327] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T22:32:53.641437] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T22:32:53.642765] [INFO ] [REMOTE ] ZKH: Full fetch complete (11934 records). [2025-10-13T22:32:53.642850] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-13T22:32:54.016563] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-13T22:32:54.016662] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-13T22:32:54.017324] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-13T22:32:54.017370] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-13T22:32:54.017983] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-13T22:32:54.018595] [DEBUG] [LOCAL ] ZKH: Trimmed 11934 records to 7571 (keeping 200 days of data) [2025-10-13T22:32:54.063942] [DEBUG] [LOCAL ] ZKH: Primary data saved (7571 records). [2025-10-13T22:32:54.064112] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-13T22:32:54.064207] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZKH took 28.0s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-13T22:32:54.241280] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:32:54.282827] [DEBUG] [LOCAL ] ZVIA: Loaded 35978 existing records from primary storage. [2025-10-13T22:32:54.283380] [INFO ] [MAIN ] ZVIA: Loaded 35978 existing records. [2025-10-13T22:32:54.469838] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:32:54.470223] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-13T22:32:54.470288] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-13T22:32:54.470704] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-13T22:32:54.470765] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-13T22:32:54.827613] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-13T22:32:54.833116] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:32:55.617899] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-13T22:32:55.803935] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T22:32:55.899696] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T22:32:56.417934] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-13T22:32:57.217935] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-13T22:32:57.257157] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T22:32:57.355483] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T22:32:58.017931] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-13T22:32:58.817932] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-13T22:32:58.864516] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T22:32:59.076589] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T22:32:59.617919] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-13T22:33:00.417962] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-13T22:33:00.512616] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T22:33:01.217947] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-13T22:33:01.236749] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T22:33:01.480750] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T22:33:02.017952] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-13T22:33:02.655007] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T22:33:02.817959] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-13T22:33:03.469092] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T22:33:03.617943] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-13T22:33:04.417963] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-13T22:33:04.595027] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T22:33:05.046802] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T22:33:05.217942] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-13T22:33:06.017914] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-13T22:33:06.351299] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T22:33:06.444751] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T22:33:06.635602] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T22:33:06.817928] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-13T22:33:07.617927] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-13T22:33:08.417899] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-13T22:33:08.505675] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T22:33:09.217897] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-13T22:33:09.316012] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T22:33:09.489825] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T22:33:10.018002] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-13T22:33:10.817922] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-13T22:33:11.165583] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T22:33:11.183281] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T22:33:11.617910] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-13T22:33:11.948729] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T22:33:12.417902] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-13T22:33:12.440412] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T22:33:13.217949] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-13T22:33:14.017964] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-13T22:33:14.197393] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T22:33:14.500896] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T22:33:14.817958] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-13T22:33:15.143004] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T22:33:15.147791] [INFO ] [REMOTE ] ZTO: Full fetch complete (72742 records). [2025-10-13T22:33:15.147906] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-13T22:33:15.546434] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-13T22:33:15.546529] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-13T22:33:15.547813] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-13T22:33:15.547875] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-13T22:33:15.549386] [DEBUG] [LOCAL ] ZTO: Trimmed 72742 records to 49519 (keeping 200 days of data) [2025-10-13T22:33:15.640193] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-13T22:33:15.861638] [DEBUG] [LOCAL ] ZTO: Primary data saved (49519 records). [2025-10-13T22:33:15.861800] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-13T22:33:15.861885] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTO took 42.6s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-13T22:33:16.058264] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T22:33:16.097721] [DEBUG] [LOCAL ] ZWS: Loaded 42839 existing records from primary storage. [2025-10-13T22:33:16.098040] [INFO ] [MAIN ] ZWS: Loaded 42839 existing records. [2025-10-13T22:33:16.277565] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T22:33:16.277941] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-13T22:33:16.277999] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-13T22:33:16.295391] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-13T22:33:16.299637] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T22:33:16.299716] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-13T22:33:16.423009] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-13T22:33:16.485981] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T22:33:16.575836] [INFO ] [REMOTE ] ZTR: Full fetch complete (26887 records). [2025-10-13T22:33:16.587200] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-13T22:33:16.831196] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T22:33:17.094708] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-13T22:33:17.094812] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-13T22:33:17.095670] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-13T22:33:17.095733] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-13T22:33:17.096505] [DEBUG] [LOCAL ] ZTR: Trimmed 26887 records to 16829 (keeping 200 days of data) [2025-10-13T22:33:17.203095] [DEBUG] [LOCAL ] ZTR: Primary data saved (16829 records). [2025-10-13T22:33:17.203287] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-13T22:33:17.203385] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTR took 28.4s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-13T22:33:17.217910] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-13T22:33:17.869415] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T22:33:18.017930] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-13T22:33:18.817999] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-13T22:33:19.923700] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T22:33:19.935346] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-13T22:33:20.605945] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-10-13T22:33:20.614476] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-13T22:33:21.686413] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-13T22:33:21.695322] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-13T22:33:21.789684] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T22:33:22.017903] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-13T22:33:22.221208] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T22:33:22.817891] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-13T22:33:23.057863] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T22:33:23.617905] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-13T22:33:23.864419] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T22:33:24.024104] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T22:33:24.417926] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-13T22:33:24.999960] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T22:33:25.005596] [INFO ] [REMOTE ] ZTS: Full fetch complete (76713 records). [2025-10-13T22:33:25.005789] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-13T22:33:25.166020] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:33:25.226677] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-13T22:33:25.448474] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-13T22:33:25.448558] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-13T22:33:25.449973] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-13T22:33:25.450051] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-13T22:33:25.451588] [DEBUG] [LOCAL ] ZTS: Trimmed 76713 records to 53112 (keeping 200 days of data) [2025-10-13T22:33:25.788178] [DEBUG] [LOCAL ] ZTS: Primary data saved (53112 records). [2025-10-13T22:33:25.788363] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-13T22:33:25.788464] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTS took 33.9s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-13T22:33:26.017983] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-13T22:33:26.856357] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T22:33:26.866110] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-13T22:33:27.263267] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T22:33:27.267720] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52796 records). [2025-10-13T22:33:27.267866] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-13T22:33:27.650844] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-13T22:33:27.650926] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-13T22:33:27.652018] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-13T22:33:27.652081] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-13T22:33:27.653163] [DEBUG] [LOCAL ] ZVIA: Trimmed 52796 records to 35625 (keeping 200 days of data) [2025-10-13T22:33:27.855585] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35625 records). [2025-10-13T22:33:27.855747] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-13T22:33:27.855841] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZVIA took 33.8s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-13T22:33:28.620406] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T22:33:28.631297] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-13T22:33:30.150762] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T22:33:30.159139] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-13T22:33:31.522268] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T22:33:31.530017] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-13T22:33:33.239906] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T22:33:33.250127] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-13T22:33:34.612706] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T22:33:34.622680] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-13T22:33:36.171543] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T22:33:36.180926] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-13T22:33:37.552061] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T22:33:37.557107] [INFO ] [REMOTE ] ZWS: Full fetch complete (61866 records). [2025-10-13T22:33:37.557253] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-13T22:33:37.956187] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-13T22:33:37.956271] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-13T22:33:37.957419] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-13T22:33:37.957484] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-13T22:33:37.958867] [DEBUG] [LOCAL ] ZWS: Trimmed 61866 records to 42321 (keeping 200 days of data) [2025-10-13T22:33:38.218590] [DEBUG] [LOCAL ] ZWS: Primary data saved (42321 records). [2025-10-13T22:33:38.218749] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-13T22:33:38.218838] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 22.4s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-13T22:33:38.219752] [INFO ] [MAIN ] Parallel update completed in 5h 33m 35s [2025-10-13T22:33:38.219831] [WARN ] [MAIN ] Failed symbols (561): AAMI, AAM, AAT, A, AAUC, ABT, ACCO, ACEL, ACR, AD... [2025-10-13T22:33:38.219919] [INFO ] [MAIN ] Update success rate: 76.3% (1810/2371 symbols) [2025-10-13T22:33:38.902994] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1810/2371 @ 76.34%)' [2025-10-13T22:33:38.903489] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-13T22:33:38.903558] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-13T22:33:38.903633] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-13T22:33:38.903796] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-13T22:33:38.903838] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-13T22:33:40.349281] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-13T22:33:40.349442] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-13T22:33:40.349688] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-13T22:33:40.350287] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-13T22:33:40.350343] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-13T22:33:40.350377] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-13T22:33:40.350432] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-13T22:33:40.350466] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-13T22:33:40.350495] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-13T22:33:40.350898] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-13T22:33:40.350951] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-13T22:33:40.351142] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-13T22:33:40.351181] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-13T22:33:40.351218] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-13T22:33:40.351254] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-13T22:33:40.373698] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-13T22:33:40.396229] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-13T22:33:40.396354] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-13T22:33:40.396390] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-13T22:33:40.396421] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-13T22:33:40.396507] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-13T22:33:40.396559] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-13T22:33:40.396597] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-13T22:33:40.397731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-13T22:33:40.397915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-13T22:33:40.398049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-13T22:33:40.398874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-13T22:33:40.399004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-13T22:33:40.399122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-13T22:33:40.399239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-13T22:33:40.399363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-13T22:33:40.399497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-13T22:33:40.399635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-13T22:33:40.399804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-13T22:33:40.400427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-13T22:33:40.400662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-13T22:33:40.400830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-13T22:33:40.401007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-13T22:33:40.401127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-13T22:33:40.401247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-13T22:33:40.401376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-13T22:33:40.401481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-13T22:33:40.401578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-13T22:33:40.401699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-13T22:33:40.401793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-13T22:33:40.401914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-13T22:33:40.402046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-13T22:33:40.402159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-13T22:33:40.402251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-13T22:33:40.402359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-13T22:33:40.402451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-13T22:33:40.402550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-13T22:33:40.402679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-13T22:33:40.402778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-13T22:33:40.402913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-13T22:33:40.403020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-13T22:33:40.403144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-13T22:33:40.403250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-13T22:33:40.403364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-13T22:33:40.403493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-13T22:33:40.403587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-13T22:33:40.403694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-13T22:33:40.403807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-13T22:33:40.403948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-13T22:33:40.404084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-13T22:33:40.404215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-13T22:33:40.404339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-13T22:33:40.404473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-13T22:33:40.404607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-13T22:33:40.404742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-13T22:33:40.404857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-13T22:33:40.404948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-13T22:33:40.405375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-13T22:33:40.405532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-13T22:33:40.405673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-13T22:33:40.405767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-13T22:33:40.405833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-13T22:33:40.405913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-13T22:33:40.406005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-13T22:33:40.406097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-13T22:33:40.406194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-13T22:33:40.406264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-13T22:33:40.406353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-13T22:33:40.406467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-13T22:33:40.406612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-13T22:33:40.406755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-13T22:33:40.406845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-13T22:33:40.406924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-13T22:33:40.407040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-13T22:33:40.407133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-13T22:33:40.407202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-13T22:33:40.407294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-13T22:33:40.407400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-13T22:33:40.407510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-13T22:33:40.407617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-13T22:33:40.407816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-13T22:33:40.407910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-13T22:33:40.408008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-13T22:33:40.408133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-13T22:33:40.408273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-13T22:33:40.408379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-13T22:33:40.408486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-13T22:33:40.408576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-13T22:33:40.408691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-13T22:33:40.408795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-13T22:33:40.408908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-13T22:33:40.409043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-13T22:33:40.409149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-13T22:33:40.409241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-13T22:33:40.409333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-13T22:33:40.409454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-13T22:33:40.409586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-13T22:33:40.409725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-13T22:33:40.409858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-13T22:33:40.409965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-13T22:33:40.410126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-13T22:33:40.410266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-13T22:33:40.410405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-13T22:33:40.410514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-13T22:33:40.410608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-13T22:33:40.410743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-13T22:33:40.410856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-13T22:33:40.410974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-13T22:33:40.411112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-13T22:33:40.411221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-13T22:33:40.411336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-13T22:33:40.411452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-13T22:33:40.411545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-13T22:33:40.411615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-13T22:33:40.411736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-13T22:33:40.411844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-13T22:33:40.411961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-13T22:33:40.412057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-13T22:33:40.412169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-13T22:33:40.412261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-13T22:33:40.412373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-13T22:33:40.412490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-13T22:33:40.412604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-13T22:33:40.412738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-13T22:33:40.412840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-13T22:33:40.412932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-13T22:33:40.413001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-13T22:33:40.413090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-13T22:33:40.413204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-13T22:33:40.413308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-13T22:33:40.413411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-13T22:33:40.413503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-13T22:33:40.413586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-13T22:33:40.413716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-13T22:33:40.413839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-13T22:33:40.413929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-13T22:33:40.414025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-13T22:33:40.414132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-13T22:33:40.414251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-13T22:33:40.414356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-13T22:33:40.414489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-13T22:33:40.414632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-13T22:33:40.414780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-13T22:33:40.414887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-13T22:33:40.415012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-13T22:33:40.415119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-13T22:33:40.415203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-13T22:33:40.415323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-13T22:33:40.415436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-13T22:33:40.415547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-13T22:33:40.415691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-13T22:33:40.415800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-13T22:33:40.415921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-13T22:33:40.416052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-13T22:33:40.416185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-13T22:33:40.416337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-13T22:33:40.416492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-13T22:33:40.416627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-13T22:33:40.416781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-13T22:33:40.416884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-13T22:33:40.416986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-13T22:33:40.417079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-13T22:33:40.417190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-13T22:33:40.417264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-13T22:33:40.417332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-13T22:33:40.417397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-13T22:33:40.417465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-13T22:33:40.417549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-13T22:33:40.417690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-13T22:33:40.417806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-13T22:33:40.417915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-13T22:33:40.418005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-13T22:33:40.418086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-13T22:33:40.418201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-13T22:33:40.418309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-13T22:33:40.418399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-13T22:33:40.418490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-13T22:33:40.418595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-13T22:33:40.418730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-13T22:33:40.418834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-13T22:33:40.418928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-13T22:33:40.419015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-13T22:33:40.419166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-13T22:33:40.419269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-13T22:33:40.419381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-13T22:33:40.419471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-13T22:33:40.419541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-13T22:33:40.419618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-13T22:33:40.419912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-13T22:33:40.419996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-13T22:33:40.420082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-13T22:33:40.420207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-13T22:33:40.420297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-13T22:33:40.420368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-13T22:33:40.420503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-13T22:33:40.420627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-13T22:33:40.420751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-13T22:33:40.420847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-13T22:33:40.420943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-13T22:33:40.421031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-13T22:33:40.421142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-13T22:33:40.421235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-13T22:33:40.421330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-13T22:33:40.421424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-13T22:33:40.421508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-13T22:33:40.421613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-13T22:33:40.421725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-13T22:33:40.421830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-13T22:33:40.421927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-13T22:33:40.421995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-13T22:33:40.422066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-13T22:33:40.422177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-13T22:33:40.422271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-13T22:33:40.422367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-13T22:33:40.422459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-13T22:33:40.422554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-13T22:33:40.422684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-13T22:33:40.422807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-13T22:33:40.422912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-13T22:33:40.422984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-13T22:33:40.423068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-13T22:33:40.423183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-13T22:33:40.423310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-13T22:33:40.423419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-13T22:33:40.423516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-13T22:33:40.423590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-13T22:33:40.423681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-13T22:33:40.423775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-13T22:33:40.423845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-13T22:33:40.423929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-13T22:33:40.424090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-13T22:33:40.424184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-13T22:33:40.424299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-13T22:33:40.424435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-13T22:33:40.424531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-13T22:33:40.424607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-13T22:33:40.424716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-13T22:33:40.424810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-13T22:33:40.424879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-13T22:33:40.424951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-13T22:33:40.425053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-13T22:33:40.425151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-13T22:33:40.425222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-13T22:33:40.425307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-13T22:33:40.425424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-13T22:33:40.425532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-13T22:33:40.425627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-13T22:33:40.425751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-13T22:33:40.425849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-13T22:33:40.425951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-13T22:33:40.426080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-13T22:33:40.426206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-13T22:33:40.426345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-13T22:33:40.426482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-13T22:33:40.426619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-13T22:33:40.426780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-13T22:33:40.426903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-13T22:33:40.426997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-13T22:33:40.427068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-13T22:33:40.427134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-13T22:33:40.427217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-13T22:33:40.427308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-13T22:33:40.427395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-13T22:33:40.427486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-13T22:33:40.427574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-13T22:33:40.427824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-13T22:33:40.427947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-13T22:33:40.428071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-13T22:33:40.428164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-13T22:33:40.428236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-13T22:33:40.428336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-13T22:33:40.428432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-13T22:33:40.428501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-13T22:33:40.428571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-13T22:33:40.428659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-13T22:33:40.428779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-13T22:33:40.428872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-13T22:33:40.428957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-13T22:33:40.429074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-13T22:33:40.429166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-13T22:33:40.429233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-13T22:33:40.429314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-13T22:33:40.429405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-13T22:33:40.429476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-13T22:33:40.429554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-13T22:33:40.429692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-13T22:33:40.429783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-13T22:33:40.429887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-13T22:33:40.429994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-13T22:33:40.430118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-13T22:33:40.430243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-13T22:33:40.430387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-13T22:33:40.430527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-13T22:33:40.430697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-13T22:33:40.430828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-13T22:33:40.430955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-13T22:33:40.431084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-13T22:33:40.431175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-13T22:33:40.431243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-13T22:33:40.431322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-13T22:33:40.431414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-13T22:33:40.431497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-13T22:33:40.431588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-13T22:33:40.431687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-13T22:33:40.431818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-13T22:33:40.431891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-13T22:33:40.431960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-13T22:33:40.432045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-13T22:33:40.432133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-13T22:33:40.432214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-13T22:33:40.432334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-13T22:33:40.432440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-13T22:33:40.432527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-13T22:33:40.432635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-13T22:33:40.432754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-13T22:33:40.432825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-13T22:33:40.432906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-13T22:33:40.433034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-13T22:33:40.433173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-13T22:33:40.433302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-13T22:33:40.433426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-13T22:33:40.433506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-13T22:33:40.433587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-13T22:33:40.433713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-13T22:33:40.433802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-13T22:33:40.433880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-13T22:33:40.433946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-13T22:33:40.434014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-13T22:33:40.434080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-13T22:33:40.434161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-13T22:33:40.434228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-13T22:33:40.434295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-13T22:33:40.434361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-13T22:33:40.434445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-13T22:33:40.434538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-13T22:33:40.434617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-13T22:33:40.434727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-13T22:33:40.434810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-13T22:33:40.434876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-13T22:33:40.434942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-13T22:33:40.435005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-13T22:33:40.435073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-13T22:33:40.435170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-13T22:33:40.435272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-13T22:33:40.435384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-13T22:33:40.435517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-13T22:33:40.435621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-13T22:33:40.435787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-13T22:33:40.435871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-13T22:33:40.435962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-13T22:33:40.436031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-13T22:33:40.436099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-13T22:33:40.436177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-13T22:33:40.436286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-13T22:33:40.436353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-13T22:33:40.436417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-13T22:33:40.436496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-13T22:33:40.436598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-13T22:33:40.436717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-13T22:33:40.436821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-13T22:33:40.436929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-13T22:33:40.437037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-13T22:33:40.437128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-13T22:33:40.437222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-13T22:33:40.437339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-13T22:33:40.437438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-13T22:33:40.437527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-13T22:33:40.437592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-13T22:33:40.437711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-13T22:33:40.437795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-13T22:33:40.437901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-13T22:33:40.437989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-13T22:33:40.438072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-13T22:33:40.438158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-13T22:33:40.438226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-13T22:33:40.438365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-13T22:33:40.438458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-13T22:33:40.438527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-13T22:33:40.438611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-13T22:33:40.438754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-13T22:33:40.438846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-13T22:33:40.438929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-13T22:33:40.439033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-13T22:33:40.439101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-13T22:33:40.439172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-13T22:33:40.439238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-13T22:33:40.439304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-13T22:33:40.439386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-13T22:33:40.439479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-13T22:33:40.439580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-13T22:33:40.439711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-13T22:33:40.439800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-13T22:33:40.439871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-13T22:33:40.439958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-13T22:33:40.440025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-13T22:33:40.440113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-13T22:33:40.440230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-13T22:33:40.440322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-13T22:33:40.440404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-13T22:33:40.440470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-13T22:33:40.440537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-13T22:33:40.440617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-13T22:33:40.440759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-13T22:33:40.440854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-13T22:33:40.440937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-13T22:33:40.441029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-13T22:33:40.441101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-13T22:33:40.441168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-13T22:33:40.441234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-13T22:33:40.441297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-13T22:33:40.441375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-13T22:33:40.441488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-13T22:33:40.441579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-13T22:33:40.441676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-13T22:33:40.441782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-13T22:33:40.441871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-13T22:33:40.441955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-13T22:33:40.442043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-13T22:33:40.442132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-13T22:33:40.442226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-13T22:33:40.442292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-13T22:33:40.442356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-13T22:33:40.442422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-13T22:33:40.442486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-13T22:33:40.442557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-13T22:33:40.442617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-13T22:33:40.442740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-13T22:33:40.442848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-13T22:33:40.442940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-13T22:33:40.443009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-13T22:33:40.443074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-13T22:33:40.443153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-13T22:33:40.443219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-13T22:33:40.443280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-13T22:33:40.443360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-13T22:33:40.443449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-13T22:33:40.443515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-13T22:33:40.443592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-13T22:33:40.443818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-13T22:33:40.443903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-13T22:33:40.444014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-13T22:33:40.444103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-13T22:33:40.444184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-13T22:33:40.444289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-13T22:33:40.444383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-13T22:33:40.444451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-13T22:33:40.444589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-13T22:33:40.444708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-13T22:33:40.444798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-13T22:33:40.444888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-13T22:33:40.444969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-13T22:33:40.445037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-13T22:33:40.445103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-13T22:33:40.445169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-13T22:33:40.445236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-13T22:33:40.445341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-13T22:33:40.445464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-13T22:33:40.445590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-13T22:33:40.445736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-13T22:33:40.445818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-13T22:33:40.445885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-13T22:33:40.445952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-13T22:33:40.446016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-13T22:33:40.446082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-13T22:33:40.446146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-13T22:33:40.446210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-13T22:33:40.446274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-13T22:33:40.446337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-13T22:33:40.446411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-13T22:33:40.446520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-13T22:33:40.446589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-13T22:33:40.446680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-13T22:33:40.446773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-13T22:33:40.446839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-13T22:33:40.446903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-13T22:33:40.446980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-13T22:33:40.447074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-13T22:33:40.447154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-13T22:33:40.447267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-13T22:33:40.447373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-13T22:33:40.447484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-13T22:33:40.447575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-13T22:33:40.447687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-13T22:33:40.447793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-13T22:33:40.447885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-13T22:33:40.447966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-13T22:33:40.448059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-13T22:33:40.448161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-13T22:33:40.448265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-13T22:33:40.448331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-13T22:33:40.448411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-13T22:33:40.448499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-13T22:33:40.448568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-13T22:33:40.448632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-13T22:33:40.448760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-13T22:33:40.448849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-13T22:33:40.448915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-13T22:33:40.448979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-13T22:33:40.449056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-13T22:33:40.449149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-13T22:33:40.449234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-13T22:33:40.449323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-13T22:33:40.449392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-13T22:33:40.449461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-13T22:33:40.449529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-13T22:33:40.449595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-13T22:33:40.449698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-13T22:33:40.449787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-13T22:33:40.449855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-13T22:33:40.449944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-13T22:33:40.450068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-13T22:33:40.450175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-13T22:33:40.450261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-13T22:33:40.450327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-13T22:33:40.450412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-13T22:33:40.450502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-13T22:33:40.450622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-13T22:33:40.450770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-13T22:33:40.450847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-13T22:33:40.450916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-13T22:33:40.450983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-13T22:33:40.451047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-13T22:33:40.451134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-13T22:33:40.451226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-13T22:33:40.451294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-13T22:33:40.451359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-13T22:33:40.451425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-13T22:33:40.451506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-13T22:33:40.451599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-13T22:33:40.451735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-13T22:33:40.451831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-13T22:33:40.451898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-13T22:33:40.451967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-13T22:33:40.452046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-13T22:33:40.452153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-13T22:33:40.452256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-13T22:33:40.452352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-13T22:33:40.452435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-13T22:33:40.452525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-13T22:33:40.452609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-13T22:33:40.452819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-13T22:33:40.452914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-13T22:33:40.453000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-13T22:33:40.453091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-13T22:33:40.453173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-13T22:33:40.453263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-13T22:33:40.453331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-13T22:33:40.453398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-13T22:33:40.453463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-13T22:33:40.453529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-13T22:33:40.453593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-13T22:33:40.453694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-13T22:33:40.453811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-13T22:33:40.453903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-13T22:33:40.453996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-13T22:33:40.454097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-13T22:33:40.454166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-13T22:33:40.454247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-13T22:33:40.454352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-13T22:33:40.454449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-13T22:33:40.454540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-13T22:33:40.454608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-13T22:33:40.454713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-13T22:33:40.454801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-13T22:33:40.454867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-13T22:33:40.454932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-13T22:33:40.454996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-13T22:33:40.455059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-13T22:33:40.455123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-13T22:33:40.455186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-13T22:33:40.455251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-13T22:33:40.455317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-13T22:33:40.455382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-13T22:33:40.455460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-13T22:33:40.455551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-13T22:33:40.455618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-13T22:33:40.455721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-13T22:33:40.455826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-13T22:33:40.455918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-13T22:33:40.455984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-13T22:33:40.456049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-13T22:33:40.456128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-13T22:33:40.456217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-13T22:33:40.456284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-13T22:33:40.456364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-13T22:33:40.456469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-13T22:33:40.456557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-13T22:33:40.456623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-13T22:33:40.456749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-13T22:33:40.456835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-13T22:33:40.456917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-13T22:33:40.457006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-13T22:33:40.457098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-13T22:33:40.457185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-13T22:33:40.457265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-13T22:33:40.457354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-13T22:33:40.457425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-13T22:33:40.457492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-13T22:33:40.457557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-13T22:33:40.457668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-13T22:33:40.457773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-13T22:33:40.457842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-13T22:33:40.457908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-13T22:33:40.457990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-13T22:33:40.458079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-13T22:33:40.458148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-13T22:33:40.458213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-13T22:33:40.458278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-13T22:33:40.458342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-13T22:33:40.458408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-13T22:33:40.458472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-13T22:33:40.458536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-13T22:33:40.458600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-13T22:33:40.458692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-13T22:33:40.458795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-13T22:33:40.458899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-13T22:33:40.458985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-13T22:33:40.459051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-13T22:33:40.459116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-13T22:33:40.459176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-13T22:33:40.459261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-13T22:33:40.459329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-13T22:33:40.459396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-13T22:33:40.459477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-13T22:33:40.459568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-13T22:33:40.459636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-13T22:33:40.459855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-13T22:33:40.459947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-13T22:33:40.460019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-13T22:33:40.460084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-13T22:33:40.460151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-13T22:33:40.460251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-13T22:33:40.460348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-13T22:33:40.460440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-13T22:33:40.460509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-13T22:33:40.460579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-13T22:33:40.460690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-13T22:33:40.460784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-13T22:33:40.460852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-13T22:33:40.460927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-13T22:33:40.460995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-13T22:33:40.461061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-13T22:33:40.461127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-13T22:33:40.461191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-13T22:33:40.461255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-13T22:33:40.461318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-13T22:33:40.461382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-13T22:33:40.461460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-13T22:33:40.461542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-13T22:33:40.461632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-13T22:33:40.461753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-13T22:33:40.461845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-13T22:33:40.461915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-13T22:33:40.461982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-13T22:33:40.462049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-13T22:33:40.462114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-13T22:33:40.462179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-13T22:33:40.462260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-13T22:33:40.462352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-13T22:33:40.462463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-13T22:33:40.462538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-13T22:33:40.462605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-13T22:33:40.462703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-13T22:33:40.462804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-13T22:33:40.462874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-13T22:33:40.462941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-13T22:33:40.463007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-13T22:33:40.463071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-13T22:33:40.463151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-13T22:33:40.463224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-13T22:33:40.463290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-13T22:33:40.463355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-13T22:33:40.463424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-13T22:33:40.463505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-13T22:33:40.463595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-13T22:33:40.463690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-13T22:33:40.463799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-13T22:33:40.463884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-13T22:33:40.463952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-13T22:33:40.464018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-13T22:33:40.464084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-13T22:33:40.464147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-13T22:33:40.464211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-13T22:33:40.464275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-13T22:33:40.464340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-13T22:33:40.464406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-13T22:33:40.464508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-13T22:33:40.464621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-13T22:33:40.464742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-13T22:33:40.464818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-13T22:33:40.464886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-13T22:33:40.464954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-13T22:33:40.465021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-13T22:33:40.465085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-13T22:33:40.465155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-13T22:33:40.465238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-13T22:33:40.465342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-13T22:33:40.465445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-13T22:33:40.465517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-13T22:33:40.465582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-13T22:33:40.465676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-13T22:33:40.465769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-13T22:33:40.465833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-13T22:33:40.465897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-13T22:33:40.465963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-13T22:33:40.466028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-13T22:33:40.466092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-13T22:33:40.466212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-13T22:33:40.466309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-13T22:33:40.466398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-13T22:33:40.466464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-13T22:33:40.466529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-13T22:33:40.466592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-13T22:33:40.466704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-13T22:33:40.466795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-13T22:33:40.466861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-13T22:33:40.466926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-13T22:33:40.466990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-13T22:33:40.467055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-13T22:33:40.467118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-13T22:33:40.467183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-13T22:33:40.467245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-13T22:33:40.467320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-13T22:33:40.467413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-13T22:33:40.467479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-13T22:33:40.467542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-13T22:33:40.467606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-13T22:33:40.467855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-13T22:33:40.468002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-13T22:33:40.468069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-13T22:33:40.468181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-13T22:33:40.468252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-13T22:33:40.468320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-13T22:33:40.468387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-13T22:33:40.468454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-13T22:33:40.468524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-13T22:33:40.468608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-13T22:33:40.468729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-13T22:33:40.468809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-13T22:33:40.468875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-13T22:33:40.468951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-13T22:33:40.469043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-13T22:33:40.469151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-13T22:33:40.469243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-13T22:33:40.469312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-13T22:33:40.469382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-13T22:33:40.469482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-13T22:33:40.469566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-13T22:33:40.469663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-13T22:33:40.469760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-13T22:33:40.469829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-13T22:33:40.469893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-13T22:33:40.469959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-13T22:33:40.470021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-13T22:33:40.470100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-13T22:33:40.470167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-13T22:33:40.470248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-13T22:33:40.470340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-13T22:33:40.470411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-13T22:33:40.470477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-13T22:33:40.470559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-13T22:33:40.470687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-13T22:33:40.470783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-13T22:33:40.470851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-13T22:33:40.470917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-13T22:33:40.470982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-13T22:33:40.471047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-13T22:33:40.471115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-13T22:33:40.471182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-13T22:33:40.471246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-13T22:33:40.471313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-13T22:33:40.471378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-13T22:33:40.471444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-13T22:33:40.471508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-13T22:33:40.471573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-13T22:33:40.471637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-13T22:33:40.471760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-13T22:33:40.471830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-13T22:33:40.471896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-13T22:33:40.471960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-13T22:33:40.472025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-13T22:33:40.472102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-13T22:33:40.472179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-13T22:33:40.472252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-13T22:33:40.472325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-13T22:33:40.472391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-13T22:33:40.472457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-13T22:33:40.472522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-13T22:33:40.472586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-13T22:33:40.472676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-13T22:33:40.472767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-13T22:33:40.472832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-13T22:33:40.472899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-13T22:33:40.472964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-13T22:33:40.473030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-13T22:33:40.473097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-13T22:33:40.473174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-13T22:33:40.473254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-13T22:33:40.473343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-13T22:33:40.473413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-13T22:33:40.473491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-13T22:33:40.473598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-13T22:33:40.473699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-13T22:33:40.473788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-13T22:33:40.473857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-13T22:33:40.473926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-13T22:33:40.473992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-13T22:33:40.474057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-13T22:33:40.474132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-13T22:33:40.474196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-13T22:33:40.474276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-13T22:33:40.474366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-13T22:33:40.474432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-13T22:33:40.474514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-13T22:33:40.474602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-13T22:33:40.474698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-13T22:33:40.474787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-13T22:33:40.474854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-13T22:33:40.474918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-13T22:33:40.474982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-13T22:33:40.475049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-13T22:33:40.475121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-13T22:33:40.475194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-13T22:33:40.475259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-13T22:33:40.475344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-13T22:33:40.475432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-13T22:33:40.475508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-13T22:33:40.475572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-13T22:33:40.475762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-13T22:33:40.475856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-13T22:33:40.475925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-13T22:33:40.475990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-13T22:33:40.476053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-13T22:33:40.476116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-13T22:33:40.476179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-13T22:33:40.476241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-13T22:33:40.476312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-13T22:33:40.476376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-13T22:33:40.476449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-13T22:33:40.476513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-13T22:33:40.476589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-13T22:33:40.476689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-13T22:33:40.476780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-13T22:33:40.476845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-13T22:33:40.476908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-13T22:33:40.476971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-13T22:33:40.477040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-13T22:33:40.477122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-13T22:33:40.477206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-13T22:33:40.477286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-13T22:33:40.477350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-13T22:33:40.477416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-13T22:33:40.477482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-13T22:33:40.477549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-13T22:33:40.477616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-13T22:33:40.477754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-13T22:33:40.477823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-13T22:33:40.477891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-13T22:33:40.477958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-13T22:33:40.478025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-13T22:33:40.478099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-13T22:33:40.478170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-13T22:33:40.478237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-13T22:33:40.478303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-13T22:33:40.478368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-13T22:33:40.478434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-13T22:33:40.478500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-13T22:33:40.478564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-13T22:33:40.478628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-13T22:33:40.478745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-13T22:33:40.478824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-13T22:33:40.478891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-13T22:33:40.478998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-13T22:33:40.479073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-13T22:33:40.479195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-13T22:33:40.479336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-13T22:33:40.479464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-13T22:33:40.479598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-13T22:33:40.479768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-13T22:33:40.479864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-13T22:33:40.479936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-13T22:33:40.480021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-13T22:33:40.480115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-13T22:33:40.480183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-13T22:33:40.480250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-13T22:33:40.480333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-13T22:33:40.480427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-13T22:33:40.480518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-13T22:33:40.480624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-13T22:33:40.480749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-13T22:33:40.480822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-13T22:33:40.480889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-13T22:33:40.480974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-13T22:33:40.481040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-13T22:33:40.481108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-13T22:33:40.481174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-13T22:33:40.481260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-13T22:33:40.481352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-13T22:33:40.481456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-13T22:33:40.481540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-13T22:33:40.481606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-13T22:33:40.481699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-13T22:33:40.481789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-13T22:33:40.481869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-13T22:33:40.481974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-13T22:33:40.482064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-13T22:33:40.482132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-13T22:33:40.482197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-13T22:33:40.482261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-13T22:33:40.482324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-13T22:33:40.482389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-13T22:33:40.482452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-13T22:33:40.482519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-13T22:33:40.482584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-13T22:33:40.482688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-13T22:33:40.482781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-13T22:33:40.482847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-13T22:33:40.482913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-13T22:33:40.482980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-13T22:33:40.483047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-13T22:33:40.483131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-13T22:33:40.483219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-13T22:33:40.483285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-13T22:33:40.483352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-13T22:33:40.483416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-13T22:33:40.483481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-13T22:33:40.483546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-13T22:33:40.483609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-13T22:33:40.483815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-13T22:33:40.483920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-13T22:33:40.483991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-13T22:33:40.484057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-13T22:33:40.484122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-13T22:33:40.484186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-13T22:33:40.484251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-13T22:33:40.484314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-13T22:33:40.484380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-13T22:33:40.484465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-13T22:33:40.484571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-13T22:33:40.484659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-13T22:33:40.484754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-13T22:33:40.484821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-13T22:33:40.484906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-13T22:33:40.485061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-13T22:33:40.485152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-13T22:33:40.485223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-13T22:33:40.485290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-13T22:33:40.485356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-13T22:33:40.485421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-13T22:33:40.485484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-13T22:33:40.485548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-13T22:33:40.485613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-13T22:33:40.485720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-13T22:33:40.485808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-13T22:33:40.485875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-13T22:33:40.485941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-13T22:33:40.486006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-13T22:33:40.486069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-13T22:33:40.486131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-13T22:33:40.486198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-13T22:33:40.486259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-13T22:33:40.486326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-13T22:33:40.486395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-13T22:33:40.486462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-13T22:33:40.486542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-13T22:33:40.486638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-13T22:33:40.486763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-13T22:33:40.486848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-13T22:33:40.486942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-13T22:33:40.487030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-13T22:33:40.487128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-13T22:33:40.487197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-13T22:33:40.487265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-13T22:33:40.487346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-13T22:33:40.487437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-13T22:33:40.487549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-13T22:33:40.487695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-13T22:33:40.487789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-13T22:33:40.487859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-13T22:33:40.487921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-13T22:33:40.487985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-13T22:33:40.488052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-13T22:33:40.488113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-13T22:33:40.488179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-13T22:33:40.488245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-13T22:33:40.488310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-13T22:33:40.488376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-13T22:33:40.488442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-13T22:33:40.488508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-13T22:33:40.488573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-13T22:33:40.488638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-13T22:33:40.488774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-13T22:33:40.488880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-13T22:33:40.488970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-13T22:33:40.489049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-13T22:33:40.489116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-13T22:33:40.489181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-13T22:33:40.489245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-13T22:33:40.489309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-13T22:33:40.489375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-13T22:33:40.489454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-13T22:33:40.489520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-13T22:33:40.489585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-13T22:33:40.489672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-13T22:33:40.489764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-13T22:33:40.489833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-13T22:33:40.489917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-13T22:33:40.490026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-13T22:33:40.490102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-13T22:33:40.490167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-13T22:33:40.490232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-13T22:33:40.490296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-13T22:33:40.490361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-13T22:33:40.490432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-13T22:33:40.490540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-13T22:33:40.490615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-13T22:33:40.490725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-13T22:33:40.490824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-13T22:33:40.490912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-13T22:33:40.490980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-13T22:33:40.491047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-13T22:33:40.491116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-13T22:33:40.491180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-13T22:33:40.491246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-13T22:33:40.491312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-13T22:33:40.491376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-13T22:33:40.491441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-13T22:33:40.491506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-13T22:33:40.491571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-13T22:33:40.491636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-13T22:33:40.491865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-13T22:33:40.491936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-13T22:33:40.492002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-13T22:33:40.492067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-13T22:33:40.492131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-13T22:33:40.492203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-13T22:33:40.492267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-13T22:33:40.492365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-13T22:33:40.492458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-13T22:33:40.492526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-13T22:33:40.492590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-13T22:33:40.492682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-13T22:33:40.492793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-13T22:33:40.492882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-13T22:33:40.492946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-13T22:33:40.493009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-13T22:33:40.493076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-13T22:33:40.493161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-13T22:33:40.493225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-13T22:33:40.493291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-13T22:33:40.493352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-13T22:33:40.493425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-13T22:33:40.493491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-13T22:33:40.493554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-13T22:33:40.493618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-13T22:33:40.493738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-13T22:33:40.493836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-13T22:33:40.493902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-13T22:33:40.493964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-13T22:33:40.494026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-13T22:33:40.494124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-13T22:33:40.494219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-13T22:33:40.494285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-13T22:33:40.494348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-13T22:33:40.494410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-13T22:33:40.494473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-13T22:33:40.494535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-13T22:33:40.494598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-13T22:33:40.494701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-13T22:33:40.494789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-13T22:33:40.494857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-13T22:33:40.494921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-13T22:33:40.494988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-13T22:33:40.495054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-13T22:33:40.495120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-13T22:33:40.495212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-13T22:33:40.495345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-13T22:33:40.495437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-13T22:33:40.495506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-13T22:33:40.495571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-13T22:33:40.495638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-13T22:33:40.495758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-13T22:33:40.495827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-13T22:33:40.495897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-13T22:33:40.495964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-13T22:33:40.496073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-13T22:33:40.496148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-13T22:33:40.496212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-13T22:33:40.496282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-13T22:33:40.496349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-13T22:33:40.496422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-13T22:33:40.496502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-13T22:33:40.496595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-13T22:33:40.496691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-13T22:33:40.496785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-13T22:33:40.496852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-13T22:33:40.496919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-13T22:33:40.496985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-13T22:33:40.497051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-13T22:33:40.497116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-13T22:33:40.497183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-13T22:33:40.497246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-13T22:33:40.497311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-13T22:33:40.497377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-13T22:33:40.497463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-13T22:33:40.497558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-13T22:33:40.497673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-13T22:33:40.497792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-13T22:33:40.497883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-13T22:33:40.497952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-13T22:33:40.498020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-13T22:33:40.498090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-13T22:33:40.498156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-13T22:33:40.498222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-13T22:33:40.498287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-13T22:33:40.498354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-13T22:33:40.498420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-13T22:33:40.498486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-13T22:33:40.498551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-13T22:33:40.498618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-13T22:33:40.498730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-13T22:33:40.498814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-13T22:33:40.498884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-13T22:33:40.498967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-13T22:33:40.499058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-13T22:33:40.499126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-13T22:33:40.499211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-13T22:33:40.499279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-13T22:33:40.499352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-13T22:33:40.499418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-13T22:33:40.499499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-13T22:33:40.499591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-13T22:33:40.499815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-13T22:33:40.499911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-13T22:33:40.499978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-13T22:33:40.500043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-13T22:33:40.500113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-13T22:33:40.500225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-13T22:33:40.500319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-13T22:33:40.500406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-13T22:33:40.500498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-13T22:33:40.500564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-13T22:33:40.500630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-13T22:33:40.500739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-13T22:33:40.500815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-13T22:33:40.500898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-13T22:33:40.500988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-13T22:33:40.501055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-13T22:33:40.501120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-13T22:33:40.501186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-13T22:33:40.501250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-13T22:33:40.501312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-13T22:33:40.501377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-13T22:33:40.501442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-13T22:33:40.501505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-13T22:33:40.501568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-13T22:33:40.501709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-13T22:33:40.501800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-13T22:33:40.501871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-13T22:33:40.501937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-13T22:33:40.502000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-13T22:33:40.502064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-13T22:33:40.502129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-13T22:33:40.502208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-13T22:33:40.502275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-13T22:33:40.502341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-13T22:33:40.502441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-13T22:33:40.502522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-13T22:33:40.502604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-13T22:33:40.502730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-13T22:33:40.502812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-13T22:33:40.502878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-13T22:33:40.502950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-13T22:33:40.503067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-13T22:33:40.503153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-13T22:33:40.503219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-13T22:33:40.503300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-13T22:33:40.503390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-13T22:33:40.503456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-13T22:33:40.503524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-13T22:33:40.503591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-13T22:33:40.503692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-13T22:33:40.503784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-13T22:33:40.503850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-13T22:33:40.503914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-13T22:33:40.503977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-13T22:33:40.504049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-13T22:33:40.504189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-13T22:33:40.504281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-13T22:33:40.504363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-13T22:33:40.504496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-13T22:33:40.504599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-13T22:33:40.504857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-13T22:33:40.504952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-13T22:33:40.505020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-13T22:33:40.505084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-13T22:33:40.505148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-13T22:33:40.505215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-13T22:33:40.505278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-13T22:33:40.505341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-13T22:33:40.505408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-13T22:33:40.505475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-13T22:33:40.505561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-13T22:33:40.505627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-13T22:33:40.505744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-13T22:33:40.505822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-13T22:33:40.505890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-13T22:33:40.505949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-13T22:33:40.506015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-13T22:33:40.506082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-13T22:33:40.506158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-13T22:33:40.506243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-13T22:33:40.506350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-13T22:33:40.506444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-13T22:33:40.506512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-13T22:33:40.506579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-13T22:33:40.506677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-13T22:33:40.506773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-13T22:33:40.506842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-13T22:33:40.506907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-13T22:33:40.506975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-13T22:33:40.507041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-13T22:33:40.507110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-13T22:33:40.507176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-13T22:33:40.507241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-13T22:33:40.507307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-13T22:33:40.507372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-13T22:33:40.507482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-13T22:33:40.507603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-13T22:33:40.507885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-13T22:33:40.507962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-13T22:33:40.508036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-13T22:33:40.508148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-13T22:33:40.508237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-13T22:33:40.508322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-13T22:33:40.508406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-13T22:33:40.508541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-13T22:33:40.508675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-13T22:33:40.508784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-13T22:33:40.508874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-13T22:33:40.508963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-13T22:33:40.509050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-13T22:33:40.509151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-13T22:33:40.509241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-13T22:33:40.509323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-13T22:33:40.509419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-13T22:33:40.509513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-13T22:33:40.509600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-13T22:33:40.509722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-13T22:33:40.509808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-13T22:33:40.509875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-13T22:33:40.509944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-13T22:33:40.510010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-13T22:33:40.510077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-13T22:33:40.510143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-13T22:33:40.510207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-13T22:33:40.510273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-13T22:33:40.510336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-13T22:33:40.510400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-13T22:33:40.510466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-13T22:33:40.510533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-13T22:33:40.510597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-13T22:33:40.510700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-13T22:33:40.510793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-13T22:33:40.510862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-13T22:33:40.510929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-13T22:33:40.510993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-13T22:33:40.511057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-13T22:33:40.511120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-13T22:33:40.511184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-13T22:33:40.511267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-13T22:33:40.511331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-13T22:33:40.511399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-13T22:33:40.511482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-13T22:33:40.511585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-13T22:33:40.511842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-13T22:33:40.511931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-13T22:33:40.511999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-13T22:33:40.512064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-13T22:33:40.512129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-13T22:33:40.512196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-13T22:33:40.512269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-13T22:33:40.512333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-13T22:33:40.512397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-13T22:33:40.512483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-13T22:33:40.512573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-13T22:33:40.512659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-13T22:33:40.512756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-13T22:33:40.512840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-13T22:33:40.512905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-13T22:33:40.512968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-13T22:33:40.513044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-13T22:33:40.513110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-13T22:33:40.513173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-13T22:33:40.513237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-13T22:33:40.513301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-13T22:33:40.513364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-13T22:33:40.513426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-13T22:33:40.513550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-13T22:33:40.513678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-13T22:33:40.513771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-13T22:33:40.513839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-13T22:33:40.513904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-13T22:33:40.513988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-13T22:33:40.514077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-13T22:33:40.514154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-13T22:33:40.514220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-13T22:33:40.514304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-13T22:33:40.514390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-13T22:33:40.514458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-13T22:33:40.514523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-13T22:33:40.514587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-13T22:33:40.514680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-13T22:33:40.514769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-13T22:33:40.514857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-13T22:33:40.514947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-13T22:33:40.515014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-13T22:33:40.515078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-13T22:33:40.515150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-13T22:33:40.515224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-13T22:33:40.515294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-13T22:33:40.515361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-13T22:33:40.515426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-13T22:33:40.515494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-13T22:33:40.515561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-13T22:33:40.515627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-13T22:33:40.515867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-13T22:33:40.515949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-13T22:33:40.516015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-13T22:33:40.516082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-13T22:33:40.516151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-13T22:33:40.516219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-13T22:33:40.516283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-13T22:33:40.516359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-13T22:33:40.516424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-13T22:33:40.516534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-13T22:33:40.516615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-13T22:33:40.516727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-13T22:33:40.516930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-13T22:33:40.517020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-13T22:33:40.517089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-13T22:33:40.517154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-13T22:33:40.517218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-13T22:33:40.517283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-13T22:33:40.517348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-13T22:33:40.517413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-13T22:33:40.517477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-13T22:33:40.517541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-13T22:33:40.517605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-13T22:33:40.517739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-13T22:33:40.517816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-13T22:33:40.517880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-13T22:33:40.517962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-13T22:33:40.518053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-13T22:33:40.518119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-13T22:33:40.518187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-13T22:33:40.518252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-13T22:33:40.518382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-13T22:33:40.518465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-13T22:33:40.518530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-13T22:33:40.518595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-13T22:33:40.518695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-13T22:33:40.518787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-13T22:33:40.518866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-13T22:33:40.518932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-13T22:33:40.518998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-13T22:33:40.519062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-13T22:33:40.519129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-13T22:33:40.519192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-13T22:33:40.519300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-13T22:33:40.519372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-13T22:33:40.519459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-13T22:33:40.519548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-13T22:33:40.519618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-13T22:33:40.519722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-13T22:33:40.519804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-13T22:33:40.519871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-13T22:33:40.519937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-13T22:33:40.520021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-13T22:33:40.520110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-13T22:33:40.520178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-13T22:33:40.520243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-13T22:33:40.520308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-13T22:33:40.520371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-13T22:33:40.520443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-13T22:33:40.520543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-13T22:33:40.520612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-13T22:33:40.520711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-13T22:33:40.520794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-13T22:33:40.520864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-13T22:33:40.520929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-13T22:33:40.521118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-13T22:33:40.521212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-13T22:33:40.521280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-13T22:33:40.521345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-13T22:33:40.521442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-13T22:33:40.521525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-13T22:33:40.521606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-13T22:33:40.521726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-13T22:33:40.521805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-13T22:33:40.521869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-13T22:33:40.521957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-13T22:33:40.522047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-13T22:33:40.522115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-13T22:33:40.522180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-13T22:33:40.522248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-13T22:33:40.522311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-13T22:33:40.522409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-13T22:33:40.522498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-13T22:33:40.522566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-13T22:33:40.522631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-13T22:33:40.522754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-13T22:33:40.522829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-13T22:33:40.522893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-13T22:33:40.522958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-13T22:33:40.523022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-13T22:33:40.523099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-13T22:33:40.523188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-13T22:33:40.523257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-13T22:33:40.523325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-13T22:33:40.523390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-13T22:33:40.523456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-13T22:33:40.523522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-13T22:33:40.523587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-13T22:33:40.523731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-13T22:33:40.523827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-13T22:33:40.523895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-13T22:33:40.523960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-13T22:33:40.524027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-13T22:33:40.524102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-13T22:33:40.524165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-13T22:33:40.524231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-13T22:33:40.524297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-13T22:33:40.524370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-13T22:33:40.524441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-13T22:33:40.524548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-13T22:33:40.524623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-13T22:33:40.524732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-13T22:33:40.524822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-13T22:33:40.524891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-13T22:33:40.525000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-13T22:33:40.525075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-13T22:33:40.525141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-13T22:33:40.525208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-13T22:33:40.525276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-13T22:33:40.525342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-13T22:33:40.525410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-13T22:33:40.525476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-13T22:33:40.525542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-13T22:33:40.525608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-13T22:33:40.525710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-13T22:33:40.525832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-13T22:33:40.525919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-13T22:33:40.526028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-13T22:33:40.526120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-13T22:33:40.526188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-13T22:33:40.526257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-13T22:33:40.526322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-13T22:33:40.526386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-13T22:33:40.526451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-13T22:33:40.526517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-13T22:33:40.526581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-13T22:33:40.526673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-13T22:33:40.526766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-13T22:33:40.526835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-13T22:33:40.526902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-13T22:33:40.526971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-13T22:33:40.527042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-13T22:33:40.527182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-13T22:33:40.527266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-13T22:33:40.527334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-13T22:33:40.527400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-13T22:33:40.527500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-13T22:33:40.527594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-13T22:33:40.527780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-13T22:33:40.527865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-13T22:33:40.527931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-13T22:33:40.527997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-13T22:33:40.528069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-13T22:33:40.528167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-13T22:33:40.528306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-13T22:33:40.528399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-13T22:33:40.528488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-13T22:33:40.528579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-13T22:33:40.528692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-13T22:33:40.528832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-13T22:33:40.528923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-13T22:33:40.528990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-13T22:33:40.529054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-13T22:33:40.529117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-13T22:33:40.529182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-13T22:33:40.529246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-13T22:33:40.529309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-13T22:33:40.529373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-13T22:33:40.529439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-13T22:33:40.529502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-13T22:33:40.529566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-13T22:33:40.529628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-13T22:33:40.529734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-13T22:33:40.529808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-13T22:33:40.529872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-13T22:33:40.529934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-13T22:33:40.529997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-13T22:33:40.530058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-13T22:33:40.530123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-13T22:33:40.530186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-13T22:33:40.530250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-13T22:33:40.530313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-13T22:33:40.530394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-13T22:33:40.530486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-13T22:33:40.530561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-13T22:33:40.530696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-13T22:33:40.530786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-13T22:33:40.530853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-13T22:33:40.530917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-13T22:33:40.530978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-13T22:33:40.531046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-13T22:33:40.531134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-13T22:33:40.531236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-13T22:33:40.531314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-13T22:33:40.531379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-13T22:33:40.531442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-13T22:33:40.531521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-13T22:33:40.531614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-13T22:33:40.531721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-13T22:33:40.531805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-13T22:33:40.531878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-13T22:33:40.531947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-13T22:33:40.532015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-13T22:33:40.532079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-13T22:33:40.532163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-13T22:33:40.532257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-13T22:33:40.532325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-13T22:33:40.532394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-13T22:33:40.532484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-13T22:33:40.532595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-13T22:33:40.532692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-13T22:33:40.532785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-13T22:33:40.532854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-13T22:33:40.532922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-13T22:33:40.532990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-13T22:33:40.533058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-13T22:33:40.533125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-13T22:33:40.533192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-13T22:33:40.533258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-13T22:33:40.533324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-13T22:33:40.533390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-13T22:33:40.533456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-13T22:33:40.533529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-13T22:33:40.533596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-13T22:33:40.533692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-13T22:33:40.533782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-13T22:33:40.533851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-13T22:33:40.533916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-13T22:33:40.533980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-13T22:33:40.534045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-13T22:33:40.534108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-13T22:33:40.534173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-13T22:33:40.534240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-13T22:33:40.534330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-13T22:33:40.534420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-13T22:33:40.534488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-13T22:33:40.534554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-13T22:33:40.534618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-13T22:33:40.534729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-13T22:33:40.534811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-13T22:33:40.534878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-13T22:33:40.534942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-13T22:33:40.535043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-13T22:33:40.535137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-13T22:33:40.535205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-13T22:33:40.535270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-13T22:33:40.535334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-13T22:33:40.535399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-13T22:33:40.535466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-13T22:33:40.535531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-13T22:33:40.535596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-13T22:33:40.535791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-13T22:33:40.535883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-13T22:33:40.535951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-13T22:33:40.536017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-13T22:33:40.536083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-13T22:33:40.536191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-13T22:33:40.536263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-13T22:33:40.536349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-13T22:33:40.536450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-13T22:33:40.536569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-13T22:33:40.536696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-13T22:33:40.536808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-13T22:33:40.536916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-13T22:33:40.537003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-13T22:33:40.537099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-13T22:33:40.537182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-13T22:33:40.537273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-13T22:33:40.537342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-13T22:33:40.537408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-13T22:33:40.537475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-13T22:33:40.537541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-13T22:33:40.537607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-13T22:33:40.537738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-13T22:33:40.537837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-13T22:33:40.537907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-13T22:33:40.537972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-13T22:33:40.538037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-13T22:33:40.538104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-13T22:33:40.538168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-13T22:33:40.538233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-13T22:33:40.538295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-13T22:33:40.538360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-13T22:33:40.538423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-13T22:33:40.538486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-13T22:33:40.538551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-13T22:33:40.538676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-13T22:33:40.538767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-13T22:33:40.538859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-13T22:33:40.538966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-13T22:33:40.539038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-13T22:33:40.539102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-13T22:33:40.539166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-13T22:33:40.539229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-13T22:33:40.539293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-13T22:33:40.539353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-13T22:33:40.539415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-13T22:33:40.539476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-13T22:33:40.539573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-13T22:33:40.539751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-13T22:33:40.539846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-13T22:33:40.539914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-13T22:33:40.539981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-13T22:33:40.540089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-13T22:33:40.540189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-13T22:33:40.540282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-13T22:33:40.540349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-13T22:33:40.540410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-13T22:33:40.540501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-13T22:33:40.540584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-13T22:33:40.540699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-13T22:33:40.540792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-13T22:33:40.540859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-13T22:33:40.540924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-13T22:33:40.540989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-13T22:33:40.541053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-13T22:33:40.541117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-13T22:33:40.541182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-13T22:33:40.541247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-13T22:33:40.541311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-13T22:33:40.541390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-13T22:33:40.541455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-13T22:33:40.541518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-13T22:33:40.541583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-13T22:33:40.541670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-13T22:33:40.541761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-13T22:33:40.541828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-13T22:33:40.541937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-13T22:33:40.542010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-13T22:33:40.542076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-13T22:33:40.542142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-13T22:33:40.542208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-13T22:33:40.542273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-13T22:33:40.542356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-10-13T22:33:40.542448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-13T22:33:40.542514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-13T22:33:40.542624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-13T22:33:40.542747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-13T22:33:40.542821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-13T22:33:40.542888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-13T22:33:40.542954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-13T22:33:40.543020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-13T22:33:40.543086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-13T22:33:40.543151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-13T22:33:40.543217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-13T22:33:40.543283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-13T22:33:40.543348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-13T22:33:40.543411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-13T22:33:40.543502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-13T22:33:40.543582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-13T22:33:40.543677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-13T22:33:40.543773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-13T22:33:40.543840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-13T22:33:40.543908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-13T22:33:40.543972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-13T22:33:40.544051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-13T22:33:40.544141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-13T22:33:40.544211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-13T22:33:40.544278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-13T22:33:40.544343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-13T22:33:40.544408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-13T22:33:40.544512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-13T22:33:40.544602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-13T22:33:40.544702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-13T22:33:40.544791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-13T22:33:40.544857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-13T22:33:40.544923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-13T22:33:40.544986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-13T22:33:40.545064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-13T22:33:40.545132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-13T22:33:40.545215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-13T22:33:40.545280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-13T22:33:40.545345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-13T22:33:40.545409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-13T22:33:40.545472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-13T22:33:40.545541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-13T22:33:40.545608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-13T22:33:40.545701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-13T22:33:40.545786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-13T22:33:40.545853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-13T22:33:40.545916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-13T22:33:40.545979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-13T22:33:40.546042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-13T22:33:40.546104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-13T22:33:40.546164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-13T22:33:40.546225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-13T22:33:40.546287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-13T22:33:40.546350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-13T22:33:40.546412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-13T22:33:40.546496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-13T22:33:40.546584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-13T22:33:40.546684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-13T22:33:40.546774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-13T22:33:40.546839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-13T22:33:40.546903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-13T22:33:40.546967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-13T22:33:40.547030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-13T22:33:40.547092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-13T22:33:40.547198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-13T22:33:40.547270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-13T22:33:40.547354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-13T22:33:40.547485] [INFO ] [LOCAL ] Deleted 1719 derivative data files. [2025-10-13T22:33:40.547522] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-13T22:33:40.549581] [INFO ] [LOCAL ] Found 1810 symbols with primary data. [2025-10-13T22:33:40.549941] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1810 symbols [2025-10-13T22:33:40.550958] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:40.550464] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:40.551864] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:40.578753] [DEBUG] [LOCAL ] AB: Loaded 25789 existing records from primary storage. [2025-10-13T22:33:40.578890] [INFO ] [MAIN ] AB: Loaded 25789 primary data records. [2025-10-13T22:33:40.774983] [DEBUG] [LOCAL ] AAP: Loaded 51899 existing records from primary storage. [2025-10-13T22:33:40.806381] [INFO ] [MAIN ] AAP: Loaded 51899 primary data records. [2025-10-13T22:33:41.005691] [DEBUG] [LOCAL ] AA: Loaded 53621 existing records from primary storage. [2025-10-13T22:33:41.017313] [INFO ] [MAIN ] AA: Loaded 53621 primary data records. [2025-10-13T22:33:41.602598] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:41.603996] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 25789 primary records. [2025-10-13T22:33:41.604231] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-13T22:33:41.624301] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-13T22:33:41.625109] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-13T22:33:41.627354] [INFO ] [MAIN ] Derivative Progress: 1/1810 symbols completed. AB took 1.1s. Estimated remaining: 32m 30s. Rate: 55.7 symbols/min [2025-10-13T22:33:41.627579] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:41.641878] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:41.642667] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51899 primary records. [2025-10-13T22:33:41.642822] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-13T22:33:41.675975] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-13T22:33:41.675886] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:41.676921] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53621 primary records. [2025-10-13T22:33:41.676150] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-13T22:33:41.679200] [INFO ] [MAIN ] Derivative Progress: 2/1810 symbols completed. AAP took 1.1s. Estimated remaining: 17m 1s. Rate: 106.2 symbols/min [2025-10-13T22:33:41.679379] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:41.677087] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-13T22:33:41.710063] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-13T22:33:41.710290] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-13T22:33:41.713317] [INFO ] [MAIN ] Derivative Progress: 3/1810 symbols completed. AA took 1.2s. Estimated remaining: 11m 41s. Rate: 154.7 symbols/min [2025-10-13T22:33:41.713554] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:41.731141] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-10-13T22:33:41.739813] [INFO ] [MAIN ] ABBV: Loaded 53686 primary data records. [2025-10-13T22:33:41.851488] [DEBUG] [LOCAL ] ABCB: Loaded 30598 existing records from primary storage. [2025-10-13T22:33:41.862776] [INFO ] [MAIN ] ABCB: Loaded 30598 primary data records. [2025-10-13T22:33:42.289741] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-13T22:33:42.313917] [INFO ] [MAIN ] ABEV: Loaded 53279 primary data records. [2025-10-13T22:33:42.590800] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:42.627073] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53686 primary records. [2025-10-13T22:33:42.663508] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-13T22:33:42.810509] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-10-13T22:33:42.811344] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-13T22:33:42.813517] [INFO ] [MAIN ] Derivative Progress: 4/1810 symbols completed. ABBV took 1.2s. Estimated remaining: 17m 2s. Rate: 106.0 symbols/min [2025-10-13T22:33:42.813855] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:42.828358] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:42.829972] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30598 primary records. [2025-10-13T22:33:42.831112] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-13T22:33:42.849350] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-13T22:33:42.849545] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-13T22:33:42.851954] [INFO ] [MAIN ] Derivative Progress: 5/1810 symbols completed. ABCB took 1.2s. Estimated remaining: 13m 51s. Rate: 130.3 symbols/min [2025-10-13T22:33:42.858499] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:42.870151] [DEBUG] [LOCAL ] ABG: Loaded 18555 existing records from primary storage. [2025-10-13T22:33:42.870584] [INFO ] [MAIN ] ABG: Loaded 18555 primary data records. [2025-10-13T22:33:42.914246] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:42.939392] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53279 primary records. [2025-10-13T22:33:42.953764] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-13T22:33:43.181990] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-13T22:33:43.245174] [DEBUG] [LOCAL ] ABM: Loaded 32067 existing records from primary storage. [2025-10-13T22:33:43.253110] [INFO ] [MAIN ] ABM: Loaded 32067 primary data records. [2025-10-13T22:33:43.245349] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-13T22:33:43.256491] [INFO ] [MAIN ] Derivative Progress: 6/1810 symbols completed. ABEV took 1.5s. Estimated remaining: 13m 34s. Rate: 133.0 symbols/min [2025-10-13T22:33:43.256636] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:43.607123] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:43.608136] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18555 primary records. [2025-10-13T22:33:43.608366] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-13T22:33:43.627754] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-13T22:33:43.628144] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-13T22:33:43.630539] [INFO ] [MAIN ] Derivative Progress: 7/1810 symbols completed. ABG took 0.8s. Estimated remaining: 13m 14s. Rate: 136.3 symbols/min [2025-10-13T22:33:43.630849] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:43.651433] [DEBUG] [LOCAL ] ABR: Loaded 51970 existing records from primary storage. [2025-10-13T22:33:43.651937] [INFO ] [MAIN ] ABR: Loaded 51970 primary data records. [2025-10-13T22:33:43.825252] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:43.845774] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32067 primary records. [2025-10-13T22:33:43.845886] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-13T22:33:43.861303] [DEBUG] [LOCAL ] ACA: Loaded 23039 existing records from primary storage. [2025-10-13T22:33:43.868086] [INFO ] [MAIN ] ACA: Loaded 23039 primary data records. [2025-10-13T22:33:44.052327] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-10-13T22:33:44.060173] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-13T22:33:44.063499] [INFO ] [MAIN ] Derivative Progress: 8/1810 symbols completed. ABM took 1.2s. Estimated remaining: 13m 11s. Rate: 136.6 symbols/min [2025-10-13T22:33:44.064888] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:44.435395] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:44.436428] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51970 primary records. [2025-10-13T22:33:44.438019] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-13T22:33:44.438197] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-13T22:33:44.438132] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-13T22:33:44.568841] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-13T22:33:44.574813] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-13T22:33:44.577028] [INFO ] [MAIN ] Derivative Progress: 9/1810 symbols completed. ABR took 1.3s. Estimated remaining: 13m 26s. Rate: 134.1 symbols/min [2025-10-13T22:33:44.582472] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:44.632201] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:44.673888] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23039 primary records. [2025-10-13T22:33:44.784076] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-13T22:33:44.811763] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-10-13T22:33:44.812402] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-13T22:33:44.815433] [INFO ] [MAIN ] Derivative Progress: 10/1810 symbols completed. ACA took 1.2s. Estimated remaining: 12m 48s. Rate: 140.7 symbols/min [2025-10-13T22:33:44.816190] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:44.857116] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:44.872387] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-13T22:33:44.872620] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-13T22:33:44.874247] [DEBUG] [LOCAL ] ACI: Loaded 53274 existing records from primary storage. [2025-10-13T22:33:44.874619] [INFO ] [MAIN ] ACI: Loaded 53274 primary data records. [2025-10-13T22:33:45.008987] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-13T22:33:45.009205] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-13T22:33:45.011795] [INFO ] [MAIN ] Derivative Progress: 11/1810 symbols completed. ACHR took 0.9s. Estimated remaining: 12m 10s. Rate: 147.9 symbols/min [2025-10-13T22:33:45.023789] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:45.103318] [DEBUG] [LOCAL ] ACM: Loaded 43041 existing records from primary storage. [2025-10-13T22:33:45.109471] [INFO ] [MAIN ] ACM: Loaded 43041 primary data records. [2025-10-13T22:33:45.598585] [DEBUG] [LOCAL ] ACN: Loaded 53429 existing records from primary storage. [2025-10-13T22:33:45.598922] [INFO ] [MAIN ] ACN: Loaded 53429 primary data records. [2025-10-13T22:33:45.693179] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:45.718818] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53274 primary records. [2025-10-13T22:33:45.731399] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-13T22:33:45.790483] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-13T22:33:45.817834] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-13T22:33:45.841685] [INFO ] [MAIN ] Derivative Progress: 12/1810 symbols completed. ACI took 1.3s. Estimated remaining: 13m 13s. Rate: 136.1 symbols/min [2025-10-13T22:33:45.842220] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:45.990805] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:45.995114] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43041 primary records. [2025-10-13T22:33:45.995512] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-13T22:33:46.022856] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-13T22:33:46.032627] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-13T22:33:46.035717] [INFO ] [MAIN ] Derivative Progress: 13/1810 symbols completed. ACM took 1.2s. Estimated remaining: 12m 38s. Rate: 142.2 symbols/min [2025-10-13T22:33:46.038373] [DEBUG] [LOCAL ] ACP: Loaded 30940 existing records from primary storage. [2025-10-13T22:33:46.038596] [INFO ] [MAIN ] ACP: Loaded 30940 primary data records. [2025-10-13T22:33:46.127027] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:46.144010] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53429 primary records. [2025-10-13T22:33:46.154315] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-13T22:33:46.228681] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-13T22:33:46.247707] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-13T22:33:46.259810] [INFO ] [MAIN ] Derivative Progress: 14/1810 symbols completed. ACN took 1.2s. Estimated remaining: 12m 13s. Rate: 147.1 symbols/min [2025-10-13T22:33:46.419466] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:46.420142] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30940 primary records. [2025-10-13T22:33:46.420205] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-13T22:33:46.435170] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-13T22:33:46.435305] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-13T22:33:46.438175] [INFO ] [MAIN ] Derivative Progress: 15/1810 symbols completed. ACP took 0.6s. Estimated remaining: 11m 45s. Rate: 152.8 symbols/min [2025-10-13T22:33:46.438758] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:46.438887] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:46.439028] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:46.453006] [DEBUG] [LOCAL ] ACV: Loaded 7678 existing records from primary storage. [2025-10-13T22:33:46.453337] [INFO ] [MAIN ] ACV: Loaded 7678 primary data records. [2025-10-13T22:33:46.586093] [DEBUG] [LOCAL ] ACRE: Loaded 33602 existing records from primary storage. [2025-10-13T22:33:46.622234] [INFO ] [MAIN ] ACRE: Loaded 33602 primary data records. [2025-10-13T22:33:46.911461] [DEBUG] [LOCAL ] ACVA: Loaded 49302 existing records from primary storage. [2025-10-13T22:33:46.918301] [INFO ] [MAIN ] ACVA: Loaded 49302 primary data records. [2025-10-13T22:33:47.455401] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:47.457000] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7678 primary records. [2025-10-13T22:33:47.457197] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-13T22:33:47.474686] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-10-13T22:33:47.476370] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-13T22:33:47.478868] [INFO ] [MAIN ] Derivative Progress: 16/1810 symbols completed. ACV took 1.0s. Estimated remaining: 12m 57s. Rate: 138.5 symbols/min [2025-10-13T22:33:47.480009] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:47.498295] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:47.499851] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33602 primary records. [2025-10-13T22:33:47.500045] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-13T22:33:47.529507] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-13T22:33:47.552555] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:47.552638] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-13T22:33:47.554585] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49302 primary records. [2025-10-13T22:33:47.556749] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-13T22:33:47.557601] [DEBUG] [LOCAL ] ADCT: Loaded 35218 existing records from primary storage. [2025-10-13T22:33:47.556677] [INFO ] [MAIN ] Derivative Progress: 17/1810 symbols completed. ACRE took 1.1s. Estimated remaining: 12m 19s. Rate: 145.6 symbols/min [2025-10-13T22:33:47.558737] [INFO ] [MAIN ] ADCT: Loaded 35218 primary data records. [2025-10-13T22:33:47.558633] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:47.686927] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-10-13T22:33:47.707771] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-13T22:33:47.747787] [INFO ] [MAIN ] Derivative Progress: 18/1810 symbols completed. ACVA took 1.3s. Estimated remaining: 11m 57s. Rate: 150.0 symbols/min [2025-10-13T22:33:47.767959] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:47.925768] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-13T22:33:47.926121] [INFO ] [MAIN ] ADM: Loaded 53394 primary data records. [2025-10-13T22:33:48.302173] [DEBUG] [LOCAL ] ADT: Loaded 53446 existing records from primary storage. [2025-10-13T22:33:48.315947] [INFO ] [MAIN ] ADT: Loaded 53446 primary data records. [2025-10-13T22:33:48.353722] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:48.354742] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 35218 primary records. [2025-10-13T22:33:48.373483] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-13T22:33:48.456865] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-13T22:33:48.521479] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-13T22:33:48.530015] [INFO ] [MAIN ] Derivative Progress: 19/1810 symbols completed. ADCT took 1.0s. Estimated remaining: 12m 32s. Rate: 142.9 symbols/min [2025-10-13T22:33:48.643230] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:48.664881] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:48.665805] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53394 primary records. [2025-10-13T22:33:48.666896] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-13T22:33:48.698666] [DEBUG] [LOCAL ] ADX: Loaded 27695 existing records from primary storage. [2025-10-13T22:33:48.700505] [INFO ] [MAIN ] ADX: Loaded 27695 primary data records. [2025-10-13T22:33:48.772736] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-13T22:33:48.795744] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-13T22:33:48.817017] [INFO ] [MAIN ] Derivative Progress: 20/1810 symbols completed. ADM took 1.3s. Estimated remaining: 12m 20s. Rate: 145.1 symbols/min [2025-10-13T22:33:48.821750] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:48.829548] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:48.830487] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53446 primary records. [2025-10-13T22:33:48.840922] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-13T22:33:48.926697] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-13T22:33:49.036869] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-13T22:33:49.039633] [INFO ] [MAIN ] Derivative Progress: 21/1810 symbols completed. ADT took 1.3s. Estimated remaining: 12m 3s. Rate: 148.4 symbols/min [2025-10-13T22:33:49.039969] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:49.065417] [DEBUG] [LOCAL ] AEFC: Loaded 8389 existing records from primary storage. [2025-10-13T22:33:49.065863] [INFO ] [MAIN ] AEFC: Loaded 8389 primary data records. [2025-10-13T22:33:49.180804] [DEBUG] [LOCAL ] AEE: Loaded 50188 existing records from primary storage. [2025-10-13T22:33:49.184224] [INFO ] [MAIN ] AEE: Loaded 50188 primary data records. [2025-10-13T22:33:49.513239] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:49.524956] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27695 primary records. [2025-10-13T22:33:49.544346] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-13T22:33:49.745790] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-13T22:33:49.746036] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-13T22:33:49.749576] [INFO ] [MAIN ] Derivative Progress: 22/1810 symbols completed. ADX took 1.1s. Estimated remaining: 12m 28s. Rate: 143.5 symbols/min [2025-10-13T22:33:49.750559] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:49.771494] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:49.772483] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8389 primary records. [2025-10-13T22:33:49.772832] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-13T22:33:49.790626] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-13T22:33:49.791573] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-13T22:33:49.793969] [INFO ] [MAIN ] Derivative Progress: 23/1810 symbols completed. AEFC took 0.8s. Estimated remaining: 11m 58s. Rate: 149.3 symbols/min [2025-10-13T22:33:49.794255] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:49.807760] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:49.808538] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50188 primary records. [2025-10-13T22:33:49.808813] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-13T22:33:49.838567] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-13T22:33:49.838711] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-13T22:33:49.841352] [INFO ] [MAIN ] Derivative Progress: 24/1810 symbols completed. AEE took 1.0s. Estimated remaining: 11m 31s. Rate: 155.0 symbols/min [2025-10-13T22:33:49.842482] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:49.859047] [DEBUG] [LOCAL ] AEM: Loaded 53478 existing records from primary storage. [2025-10-13T22:33:49.859334] [INFO ] [MAIN ] AEM: Loaded 53478 primary data records. [2025-10-13T22:33:50.022371] [DEBUG] [LOCAL ] AER: Loaded 48213 existing records from primary storage. [2025-10-13T22:33:50.049904] [INFO ] [MAIN ] AER: Loaded 48213 primary data records. [2025-10-13T22:33:50.461247] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-13T22:33:50.462117] [INFO ] [MAIN ] AES: Loaded 53669 primary data records. [2025-10-13T22:33:51.187938] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:51.190248] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53478 primary records. [2025-10-13T22:33:51.190457] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-13T22:33:51.221001] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-13T22:33:51.223071] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-13T22:33:51.226503] [INFO ] [MAIN ] Derivative Progress: 25/1810 symbols completed. AEM took 1.5s. Estimated remaining: 12m 42s. Rate: 140.5 symbols/min [2025-10-13T22:33:51.227049] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:51.246531] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:51.247526] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48213 primary records. [2025-10-13T22:33:51.247692] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-13T22:33:51.266310] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-13T22:33:51.268711] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-13T22:33:51.271424] [INFO ] [MAIN ] Derivative Progress: 26/1810 symbols completed. AER took 1.5s. Estimated remaining: 12m 16s. Rate: 145.5 symbols/min [2025-10-13T22:33:51.271798] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:51.285432] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:51.286181] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53669 primary records. [2025-10-13T22:33:51.286348] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-13T22:33:51.341623] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-13T22:33:51.343276] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-13T22:33:51.346550] [INFO ] [MAIN ] Derivative Progress: 27/1810 symbols completed. AES took 1.5s. Estimated remaining: 11m 53s. Rate: 150.0 symbols/min [2025-10-13T22:33:51.346777] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:51.343556] [DEBUG] [LOCAL ] AFB: Loaded 11281 existing records from primary storage. [2025-10-13T22:33:51.348284] [DEBUG] [LOCAL ] AESI: Loaded 49713 existing records from primary storage. [2025-10-13T22:33:51.348404] [INFO ] [MAIN ] AFB: Loaded 11281 primary data records. [2025-10-13T22:33:51.348957] [INFO ] [MAIN ] AESI: Loaded 49713 primary data records. [2025-10-13T22:33:51.494975] [DEBUG] [LOCAL ] AFGB: Loaded 2291 existing records from primary storage. [2025-10-13T22:33:51.541605] [INFO ] [MAIN ] AFGB: Loaded 2291 primary data records. [2025-10-13T22:33:52.290910] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:52.292531] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:52.293444] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11281 primary records. [2025-10-13T22:33:52.295899] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-13T22:33:52.295240] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49713 primary records. [2025-10-13T22:33:52.296153] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-13T22:33:52.335309] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:52.337012] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2291 primary records. [2025-10-13T22:33:52.337373] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-13T22:33:52.338880] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-13T22:33:52.340788] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-13T22:33:52.343730] [INFO ] [MAIN ] Derivative Progress: 28/1810 symbols completed. AESI took 1.1s. Estimated remaining: 12m 31s. Rate: 142.4 symbols/min [2025-10-13T22:33:52.352744] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-13T22:33:52.355762] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-13T22:33:52.358462] [INFO ] [MAIN ] Derivative Progress: 29/1810 symbols completed. AFB took 1.1s. Estimated remaining: 12m 5s. Rate: 147.3 symbols/min [2025-10-13T22:33:52.361639] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-10-13T22:33:52.361725] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-13T22:33:52.364414] [INFO ] [MAIN ] Derivative Progress: 30/1810 symbols completed. AFGB took 1.0s. Estimated remaining: 11m 41s. Rate: 152.4 symbols/min [2025-10-13T22:33:52.364800] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:52.364997] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:52.364934] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:52.373994] [DEBUG] [LOCAL ] AFGE: Loaded 2404 existing records from primary storage. [2025-10-13T22:33:52.372158] [DEBUG] [LOCAL ] AFGD: Loaded 1795 existing records from primary storage. [2025-10-13T22:33:52.376012] [INFO ] [MAIN ] AFGE: Loaded 2404 primary data records. [2025-10-13T22:33:52.375795] [INFO ] [MAIN ] AFGD: Loaded 1795 primary data records. [2025-10-13T22:33:52.375935] [DEBUG] [LOCAL ] AFGC: Loaded 2526 existing records from primary storage. [2025-10-13T22:33:52.441131] [INFO ] [MAIN ] AFGC: Loaded 2526 primary data records. [2025-10-13T22:33:53.320079] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:53.320944] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2404 primary records. [2025-10-13T22:33:53.321527] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-13T22:33:53.340812] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-13T22:33:53.366722] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-13T22:33:53.369006] [INFO ] [MAIN ] Derivative Progress: 31/1810 symbols completed. AFGE took 1.0s. Estimated remaining: 12m 16s. Rate: 145.1 symbols/min [2025-10-13T22:33:53.366568] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:53.369378] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:33:53.370275] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1795 primary records. [2025-10-13T22:33:53.370582] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-13T22:33:53.370449] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:53.371346] [INFO ] [MAIN ] AFGC: Generated 1793 derivative records from 2526 primary records. [2025-10-13T22:33:53.372320] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-13T22:33:53.397233] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1793 records). [2025-10-13T22:33:53.398243] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-13T22:33:53.401189] [INFO ] [MAIN ] Derivative Progress: 32/1810 symbols completed. AFGC took 1.0s. Estimated remaining: 11m 54s. Rate: 149.4 symbols/min [2025-10-13T22:33:53.401750] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:53.405903] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-10-13T22:33:53.406145] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-13T22:33:53.408859] [INFO ] [MAIN ] Derivative Progress: 33/1810 symbols completed. AFGD took 1.0s. Estimated remaining: 11m 32s. Rate: 154.0 symbols/min [2025-10-13T22:33:53.409037] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:53.451455] [DEBUG] [LOCAL ] AFL: Loaded 53185 existing records from primary storage. [2025-10-13T22:33:53.451775] [INFO ] [MAIN ] AFL: Loaded 53185 primary data records. [2025-10-13T22:33:53.658525] [DEBUG] [LOCAL ] AGCO: Loaded 42483 existing records from primary storage. [2025-10-13T22:33:53.689741] [INFO ] [MAIN ] AGCO: Loaded 42483 primary data records. [2025-10-13T22:33:53.710438] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-13T22:33:53.765062] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-10-13T22:33:54.560477] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:54.561496] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53185 primary records. [2025-10-13T22:33:54.562963] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-13T22:33:54.584029] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-13T22:33:54.584438] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-13T22:33:54.586906] [INFO ] [MAIN ] Derivative Progress: 34/1810 symbols completed. AFL took 1.2s. Estimated remaining: 12m 13s. Rate: 145.3 symbols/min [2025-10-13T22:33:54.599829] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:54.601554] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:54.602402] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42483 primary records. [2025-10-13T22:33:54.602482] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-13T22:33:54.635582] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:54.635724] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-13T22:33:54.642185] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53643 primary records. [2025-10-13T22:33:54.642411] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-13T22:33:54.642873] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-13T22:33:54.646803] [INFO ] [MAIN ] Derivative Progress: 35/1810 symbols completed. AGCO took 1.2s. Estimated remaining: 11m 55s. Rate: 149.0 symbols/min [2025-10-13T22:33:54.647529] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:54.667089] [DEBUG] [LOCAL ] AGD: Loaded 19042 existing records from primary storage. [2025-10-13T22:33:54.667813] [INFO ] [MAIN ] AGD: Loaded 19042 primary data records. [2025-10-13T22:33:54.735385] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-13T22:33:54.749308] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-13T22:33:54.774366] [INFO ] [MAIN ] Derivative Progress: 36/1810 symbols completed. AG took 1.4s. Estimated remaining: 11m 41s. Rate: 151.8 symbols/min [2025-10-13T22:33:54.777924] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:55.014494] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-13T22:33:55.015991] [INFO ] [MAIN ] AGI: Loaded 53423 primary data records. [2025-10-13T22:33:55.362096] [DEBUG] [LOCAL ] AGL: Loaded 52552 existing records from primary storage. [2025-10-13T22:33:55.362687] [INFO ] [MAIN ] AGL: Loaded 52552 primary data records. [2025-10-13T22:33:55.562774] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:55.677511] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 19042 primary records. [2025-10-13T22:33:55.678568] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-13T22:33:55.698456] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-13T22:33:55.699091] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-13T22:33:55.702396] [INFO ] [MAIN ] Derivative Progress: 37/1810 symbols completed. AGD took 1.1s. Estimated remaining: 12m 6s. Rate: 146.5 symbols/min [2025-10-13T22:33:55.704518] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:55.719421] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:55.720254] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53423 primary records. [2025-10-13T22:33:55.725268] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-13T22:33:55.748809] [DEBUG] [LOCAL ] AGM: Loaded 10647 existing records from primary storage. [2025-10-13T22:33:55.748430] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-13T22:33:55.749832] [INFO ] [MAIN ] AGM: Loaded 10647 primary data records. [2025-10-13T22:33:55.749932] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-13T22:33:55.753003] [INFO ] [MAIN ] Derivative Progress: 38/1810 symbols completed. AGI took 1.1s. Estimated remaining: 11m 49s. Rate: 150.0 symbols/min [2025-10-13T22:33:55.753154] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:55.878806] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:55.883821] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52552 primary records. [2025-10-13T22:33:55.889509] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-13T22:33:56.127179] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-13T22:33:56.127408] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-13T22:33:56.131194] [DEBUG] [LOCAL ] AGRO: Loaded 33364 existing records from primary storage. [2025-10-13T22:33:56.130105] [INFO ] [MAIN ] Derivative Progress: 39/1810 symbols completed. AGL took 1.4s. Estimated remaining: 11m 48s. Rate: 150.2 symbols/min [2025-10-13T22:33:56.131547] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:56.131616] [INFO ] [MAIN ] AGRO: Loaded 33364 primary data records. [2025-10-13T22:33:56.512890] [DEBUG] [LOCAL ] AGX: Loaded 33020 existing records from primary storage. [2025-10-13T22:33:56.527024] [INFO ] [MAIN ] AGX: Loaded 33020 primary data records. [2025-10-13T22:33:56.856251] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:56.859925] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10647 primary records. [2025-10-13T22:33:56.860146] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-13T22:33:56.886370] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-13T22:33:56.887075] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-13T22:33:56.892297] [INFO ] [MAIN ] Derivative Progress: 40/1810 symbols completed. AGM took 1.2s. Estimated remaining: 12m 3s. Rate: 146.9 symbols/min [2025-10-13T22:33:56.894092] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:56.910700] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:56.912208] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33364 primary records. [2025-10-13T22:33:56.912573] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-13T22:33:56.932247] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-13T22:33:56.932444] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-13T22:33:56.935697] [INFO ] [MAIN ] Derivative Progress: 41/1810 symbols completed. AGRO took 1.2s. Estimated remaining: 11m 47s. Rate: 150.1 symbols/min [2025-10-13T22:33:56.936562] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:56.966795] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:56.967679] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33020 primary records. [2025-10-13T22:33:56.967930] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-13T22:33:56.998962] [DEBUG] [LOCAL ] AHH: Loaded 40607 existing records from primary storage. [2025-10-13T22:33:56.999369] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-13T22:33:56.999808] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-13T22:33:57.002743] [INFO ] [MAIN ] Derivative Progress: 42/1810 symbols completed. AGX took 0.9s. Estimated remaining: 11m 33s. Rate: 153.2 symbols/min [2025-10-13T22:33:57.002866] [INFO ] [MAIN ] AHH: Loaded 40607 primary data records. [2025-10-13T22:33:57.003111] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:57.136966] [DEBUG] [LOCAL ] AHT: Loaded 6328 existing records from primary storage. [2025-10-13T22:33:57.143497] [INFO ] [MAIN ] AHT: Loaded 6328 primary data records. [2025-10-13T22:33:57.307823] [DEBUG] [LOCAL ] AHR: Loaded 49096 existing records from primary storage. [2025-10-13T22:33:57.456560] [INFO ] [MAIN ] AHR: Loaded 49096 primary data records. [2025-10-13T22:33:58.085972] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:58.087923] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40607 primary records. [2025-10-13T22:33:58.088269] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-13T22:33:58.122980] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:58.124431] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-13T22:33:58.124731] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-13T22:33:58.127263] [INFO ] [MAIN ] Derivative Progress: 43/1810 symbols completed. AHH took 1.2s. Estimated remaining: 12m 2s. Rate: 146.8 symbols/min [2025-10-13T22:33:58.128479] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6328 primary records. [2025-10-13T22:33:58.128706] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-13T22:33:58.147773] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-13T22:33:58.148096] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-13T22:33:58.163467] [INFO ] [MAIN ] Derivative Progress: 44/1810 symbols completed. AHT took 1.2s. Estimated remaining: 11m 47s. Rate: 149.9 symbols/min [2025-10-13T22:33:58.164127] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:58.165143] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49096 primary records. [2025-10-13T22:33:58.165213] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-13T22:33:58.181977] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-13T22:33:58.182055] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-13T22:33:58.186276] [INFO ] [MAIN ] Derivative Progress: 45/1810 symbols completed. AHR took 1.2s. Estimated remaining: 11m 32s. Rate: 153.1 symbols/min [2025-10-13T22:33:58.186812] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:58.186972] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:58.188058] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:58.244761] [DEBUG] [LOCAL ] AIN: Loaded 24485 existing records from primary storage. [2025-10-13T22:33:58.244979] [INFO ] [MAIN ] AIN: Loaded 24485 primary data records. [2025-10-13T22:33:58.385374] [DEBUG] [LOCAL ] AI: Loaded 53759 existing records from primary storage. [2025-10-13T22:33:58.384063] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-13T22:33:58.401520] [INFO ] [MAIN ] AI: Loaded 53759 primary data records. [2025-10-13T22:33:58.411974] [INFO ] [MAIN ] AIG: Loaded 53474 primary data records. [2025-10-13T22:33:59.331979] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:59.335252] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24485 primary records. [2025-10-13T22:33:59.337356] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-13T22:33:59.383732] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:59.384823] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:33:59.386092] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53759 primary records. [2025-10-13T22:33:59.386569] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-13T22:33:59.389707] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-13T22:33:59.388047] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53474 primary records. [2025-10-13T22:33:59.390464] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-13T22:33:59.390719] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-13T22:33:59.393456] [INFO ] [MAIN ] Derivative Progress: 46/1810 symbols completed. AIN took 1.2s. Estimated remaining: 12m 3s. Rate: 146.5 symbols/min [2025-10-13T22:33:59.401624] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:59.425523] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-13T22:33:59.425917] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-13T22:33:59.429455] [INFO ] [MAIN ] Derivative Progress: 47/1810 symbols completed. AI took 1.2s. Estimated remaining: 11m 48s. Rate: 149.4 symbols/min [2025-10-13T22:33:59.431366] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:59.439463] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-13T22:33:59.441816] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-13T22:33:59.444837] [INFO ] [MAIN ] Derivative Progress: 48/1810 symbols completed. AIG took 1.3s. Estimated remaining: 11m 34s. Rate: 152.4 symbols/min [2025-10-13T22:33:59.445226] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:33:59.452980] [DEBUG] [LOCAL ] AIO: Loaded 13409 existing records from primary storage. [2025-10-13T22:33:59.453182] [INFO ] [MAIN ] AIO: Loaded 13409 primary data records. [2025-10-13T22:33:59.821304] [DEBUG] [LOCAL ] AIT: Loaded 27046 existing records from primary storage. [2025-10-13T22:33:59.826802] [INFO ] [MAIN ] AIT: Loaded 27046 primary data records. [2025-10-13T22:33:59.720670] [DEBUG] [LOCAL ] AIR: Loaded 29044 existing records from primary storage. [2025-10-13T22:33:59.837904] [INFO ] [MAIN ] AIR: Loaded 29044 primary data records. [2025-10-13T22:34:00.521156] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:00.524322] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13409 primary records. [2025-10-13T22:34:00.525007] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-13T22:34:00.547874] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-13T22:34:00.548530] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-13T22:34:00.553858] [INFO ] [MAIN ] Derivative Progress: 49/1810 symbols completed. AIO took 1.2s. Estimated remaining: 11m 59s. Rate: 147.0 symbols/min [2025-10-13T22:34:00.554242] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:00.574104] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:00.587787] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 29044 primary records. [2025-10-13T22:34:00.588124] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-13T22:34:00.588565] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:00.590255] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27046 primary records. [2025-10-13T22:34:00.590858] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-13T22:34:00.635518] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-13T22:34:00.636189] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-13T22:34:00.639628] [INFO ] [MAIN ] Derivative Progress: 50/1810 symbols completed. AIR took 1.2s. Estimated remaining: 11m 47s. Rate: 149.3 symbols/min [2025-10-13T22:34:00.640546] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:00.643040] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-13T22:34:00.643328] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-13T22:34:00.647295] [INFO ] [MAIN ] Derivative Progress: 51/1810 symbols completed. AIT took 1.2s. Estimated remaining: 11m 33s. Rate: 152.3 symbols/min [2025-10-13T22:34:00.647742] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:00.662109] [DEBUG] [LOCAL ] AIV: Loaded 41190 existing records from primary storage. [2025-10-13T22:34:00.662600] [INFO ] [MAIN ] AIV: Loaded 41190 primary data records. [2025-10-13T22:34:00.759751] [DEBUG] [LOCAL ] AIZN: Loaded 4085 existing records from primary storage. [2025-10-13T22:34:00.778623] [INFO ] [MAIN ] AIZN: Loaded 4085 primary data records. [2025-10-13T22:34:00.981042] [DEBUG] [LOCAL ] AIZ: Loaded 29610 existing records from primary storage. [2025-10-13T22:34:01.153939] [INFO ] [MAIN ] AIZ: Loaded 29610 primary data records. [2025-10-13T22:34:01.719636] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:01.721741] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 41190 primary records. [2025-10-13T22:34:01.722317] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-13T22:34:01.758140] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:01.760570] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4085 primary records. [2025-10-13T22:34:01.762090] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-13T22:34:01.763297] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-13T22:34:01.763390] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-13T22:34:01.766148] [INFO ] [MAIN ] Derivative Progress: 52/1810 symbols completed. AIV took 1.2s. Estimated remaining: 11m 57s. Rate: 147.1 symbols/min [2025-10-13T22:34:01.778069] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:01.789012] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-13T22:34:01.789621] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-13T22:34:01.792709] [INFO ] [MAIN ] Derivative Progress: 53/1810 symbols completed. AIZN took 1.1s. Estimated remaining: 11m 44s. Rate: 149.7 symbols/min [2025-10-13T22:34:01.798497] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:01.813089] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:01.814262] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29610 primary records. [2025-10-13T22:34:01.815096] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-13T22:34:01.843960] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-13T22:34:01.844260] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-13T22:34:01.847218] [INFO ] [MAIN ] Derivative Progress: 54/1810 symbols completed. AIZ took 1.2s. Estimated remaining: 11m 33s. Rate: 152.1 symbols/min [2025-10-13T22:34:01.847711] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:01.894012] [DEBUG] [LOCAL ] AJG: Loaded 46567 existing records from primary storage. [2025-10-13T22:34:01.895478] [INFO ] [MAIN ] AJG: Loaded 46567 primary data records. [2025-10-13T22:34:01.931885] [DEBUG] [LOCAL ] AKR: Loaded 46010 existing records from primary storage. [2025-10-13T22:34:01.955973] [INFO ] [MAIN ] AKR: Loaded 46010 primary data records. [2025-10-13T22:34:02.166374] [DEBUG] [LOCAL ] AL: Loaded 44615 existing records from primary storage. [2025-10-13T22:34:02.239793] [INFO ] [MAIN ] AL: Loaded 44615 primary data records. [2025-10-13T22:34:03.046236] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:03.060382] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46567 primary records. [2025-10-13T22:34:03.060913] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-13T22:34:03.063520] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:03.077319] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 46010 primary records. [2025-10-13T22:34:03.079925] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-13T22:34:03.083888] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-13T22:34:03.087261] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-13T22:34:03.090364] [INFO ] [MAIN ] Derivative Progress: 55/1810 symbols completed. AJG took 1.3s. Estimated remaining: 11m 59s. Rate: 146.4 symbols/min [2025-10-13T22:34:03.107054] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:03.122534] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-13T22:34:03.122757] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-13T22:34:03.126008] [INFO ] [MAIN ] Derivative Progress: 56/1810 symbols completed. AKR took 1.3s. Estimated remaining: 11m 47s. Rate: 148.8 symbols/min [2025-10-13T22:34:03.121046] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:03.127786] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44615 primary records. [2025-10-13T22:34:03.126330] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:03.127979] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-13T22:34:03.155084] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-13T22:34:03.155296] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-13T22:34:03.159326] [INFO ] [MAIN ] Derivative Progress: 57/1810 symbols completed. AL took 1.3s. Estimated remaining: 11m 35s. Rate: 151.3 symbols/min [2025-10-13T22:34:03.163259] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:03.178626] [DEBUG] [LOCAL ] ALG: Loaded 9742 existing records from primary storage. [2025-10-13T22:34:03.178834] [INFO ] [MAIN ] ALG: Loaded 9742 primary data records. [2025-10-13T22:34:03.276959] [DEBUG] [LOCAL ] ALE: Loaded 31630 existing records from primary storage. [2025-10-13T22:34:03.289187] [INFO ] [MAIN ] ALE: Loaded 31630 primary data records. [2025-10-13T22:34:03.747963] [DEBUG] [LOCAL ] ALIT: Loaded 52786 existing records from primary storage. [2025-10-13T22:34:03.878992] [INFO ] [MAIN ] ALIT: Loaded 52786 primary data records. [2025-10-13T22:34:04.222256] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:04.224898] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9742 primary records. [2025-10-13T22:34:04.225082] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-13T22:34:04.246534] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-13T22:34:04.247861] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-13T22:34:04.250708] [INFO ] [MAIN ] Derivative Progress: 58/1810 symbols completed. ALG took 1.1s. Estimated remaining: 11m 56s. Rate: 146.8 symbols/min [2025-10-13T22:34:04.266345] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:04.267466] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31630 primary records. [2025-10-13T22:34:04.267754] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-13T22:34:04.286714] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-13T22:34:04.287221] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-13T22:34:04.289868] [INFO ] [MAIN ] Derivative Progress: 59/1810 symbols completed. ALE took 1.2s. Estimated remaining: 11m 45s. Rate: 149.1 symbols/min [2025-10-13T22:34:04.305855] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:04.306822] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52786 primary records. [2025-10-13T22:34:04.306896] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-13T22:34:04.325100] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-13T22:34:04.325234] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-13T22:34:04.328248] [INFO ] [MAIN ] Derivative Progress: 60/1810 symbols completed. ALIT took 1.2s. Estimated remaining: 11m 34s. Rate: 151.4 symbols/min [2025-10-13T22:34:04.329224] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:04.329126] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:04.328990] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:04.402760] [DEBUG] [LOCAL ] ALK: Loaded 53061 existing records from primary storage. [2025-10-13T22:34:04.416979] [INFO ] [MAIN ] ALK: Loaded 53061 primary data records. [2025-10-13T22:34:04.440960] [DEBUG] [LOCAL ] ALL: Loaded 49796 existing records from primary storage. [2025-10-13T22:34:04.463722] [INFO ] [MAIN ] ALL: Loaded 49796 primary data records. [2025-10-13T22:34:04.589423] [DEBUG] [LOCAL ] ALLE: Loaded 44301 existing records from primary storage. [2025-10-13T22:34:04.612417] [INFO ] [MAIN ] ALLE: Loaded 44301 primary data records. [2025-10-13T22:34:05.466906] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:05.470185] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53061 primary records. [2025-10-13T22:34:05.470319] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-13T22:34:05.497495] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:05.503456] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49796 primary records. [2025-10-13T22:34:05.507446] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-13T22:34:05.507334] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-13T22:34:05.507841] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-13T22:34:05.509871] [INFO ] [MAIN ] Derivative Progress: 61/1810 symbols completed. ALK took 1.2s. Estimated remaining: 11m 56s. Rate: 146.6 symbols/min [2025-10-13T22:34:05.524407] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:05.531825] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:05.532804] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44301 primary records. [2025-10-13T22:34:05.537698] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-13T22:34:05.543431] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-13T22:34:05.543872] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-13T22:34:05.558538] [INFO ] [MAIN ] Derivative Progress: 62/1810 symbols completed. ALL took 1.2s. Estimated remaining: 11m 45s. Rate: 148.7 symbols/min [2025-10-13T22:34:05.561658] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:05.564191] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-13T22:34:05.564366] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-13T22:34:05.567015] [INFO ] [MAIN ] Derivative Progress: 63/1810 symbols completed. ALLE took 1.2s. Estimated remaining: 11m 34s. Rate: 151.1 symbols/min [2025-10-13T22:34:05.567189] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:05.603448] [DEBUG] [LOCAL ] ALTG: Loaded 23514 existing records from primary storage. [2025-10-13T22:34:05.603697] [INFO ] [MAIN ] ALTG: Loaded 23514 primary data records. [2025-10-13T22:34:05.734550] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-13T22:34:05.761913] [INFO ] [MAIN ] ALLY: Loaded 53223 primary data records. [2025-10-13T22:34:05.839127] [DEBUG] [LOCAL ] ALSN: Loaded 43420 existing records from primary storage. [2025-10-13T22:34:05.907414] [INFO ] [MAIN ] ALSN: Loaded 43420 primary data records. [2025-10-13T22:34:06.586618] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:06.589243] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23514 primary records. [2025-10-13T22:34:06.589376] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-13T22:34:06.619023] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:06.621583] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53223 primary records. [2025-10-13T22:34:06.621982] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-13T22:34:06.637119] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-13T22:34:06.640039] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-13T22:34:06.645127] [INFO ] [MAIN ] Derivative Progress: 64/1810 symbols completed. ALTG took 1.1s. Estimated remaining: 11m 52s. Rate: 147.2 symbols/min [2025-10-13T22:34:06.647895] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:06.649393] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-13T22:34:06.649629] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-13T22:34:06.652704] [INFO ] [MAIN ] Derivative Progress: 65/1810 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 41s. Rate: 149.4 symbols/min [2025-10-13T22:34:06.653042] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:06.668768] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:06.669711] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43420 primary records. [2025-10-13T22:34:06.669808] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-13T22:34:06.695142] [DEBUG] [LOCAL ] ALUR: Loaded 9743 existing records from primary storage. [2025-10-13T22:34:06.695784] [INFO ] [MAIN ] ALUR: Loaded 9743 primary data records. [2025-10-13T22:34:06.695561] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-13T22:34:06.717084] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-13T22:34:06.742777] [INFO ] [MAIN ] Derivative Progress: 66/1810 symbols completed. ALSN took 1.2s. Estimated remaining: 11m 32s. Rate: 151.2 symbols/min [2025-10-13T22:34:06.765139] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:06.893411] [DEBUG] [LOCAL ] ALV: Loaded 42115 existing records from primary storage. [2025-10-13T22:34:06.895814] [INFO ] [MAIN ] ALV: Loaded 42115 primary data records. [2025-10-13T22:34:06.893772] [DEBUG] [LOCAL ] ALX: Loaded 6822 existing records from primary storage. [2025-10-13T22:34:06.896149] [INFO ] [MAIN ] ALX: Loaded 6822 primary data records. [2025-10-13T22:34:07.717725] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:07.719256] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 9743 primary records. [2025-10-13T22:34:07.719928] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-13T22:34:07.772381] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-13T22:34:07.773410] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:34:07.773787] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-13T22:34:07.775066] [INFO ] [MAIN ] ALX: Generated 1790 derivative records from 6822 primary records. [2025-10-13T22:34:07.775417] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:07.775542] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-13T22:34:07.779436] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42115 primary records. [2025-10-13T22:34:07.777993] [INFO ] [MAIN ] Derivative Progress: 67/1810 symbols completed. ALUR took 1.1s. Estimated remaining: 11m 48s. Rate: 147.6 symbols/min [2025-10-13T22:34:07.779688] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-13T22:34:07.780295] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:07.810537] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-13T22:34:07.812548] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-13T22:34:07.817788] [INFO ] [MAIN ] Derivative Progress: 68/1810 symbols completed. ALV took 1.2s. Estimated remaining: 11m 39s. Rate: 149.6 symbols/min [2025-10-13T22:34:07.818439] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:07.820719] [DEBUG] [LOCAL ] ALX: Derivative data saved (1790 records). [2025-10-13T22:34:07.821543] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-13T22:34:07.827036] [INFO ] [MAIN ] Derivative Progress: 69/1810 symbols completed. ALX took 1.1s. Estimated remaining: 11m 28s. Rate: 151.8 symbols/min [2025-10-13T22:34:07.829111] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:07.885088] [DEBUG] [LOCAL ] AM: Loaded 51957 existing records from primary storage. [2025-10-13T22:34:07.886090] [INFO ] [MAIN ] AM: Loaded 51957 primary data records. [2025-10-13T22:34:07.936980] [DEBUG] [LOCAL ] AMBC: Loaded 36300 existing records from primary storage. [2025-10-13T22:34:07.978200] [INFO ] [MAIN ] AMBC: Loaded 36300 primary data records. [2025-10-13T22:34:08.234875] [DEBUG] [LOCAL ] AMBP: Loaded 44625 existing records from primary storage. [2025-10-13T22:34:08.380681] [INFO ] [MAIN ] AMBP: Loaded 44625 primary data records. [2025-10-13T22:34:08.905223] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:08.918728] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51957 primary records. [2025-10-13T22:34:08.919271] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:08.919524] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-13T22:34:08.920757] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36300 primary records. [2025-10-13T22:34:08.921349] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-13T22:34:08.954218] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-13T22:34:08.956508] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-13T22:34:08.956890] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-13T22:34:08.959490] [INFO ] [MAIN ] Derivative Progress: 70/1810 symbols completed. AM took 1.2s. Estimated remaining: 11m 46s. Rate: 147.8 symbols/min [2025-10-13T22:34:08.959624] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-13T22:34:08.959759] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:08.962520] [INFO ] [MAIN ] Derivative Progress: 71/1810 symbols completed. AMBC took 1.1s. Estimated remaining: 11m 36s. Rate: 149.9 symbols/min [2025-10-13T22:34:08.963465] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:08.981323] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:08.982150] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44625 primary records. [2025-10-13T22:34:08.982329] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-13T22:34:09.001200] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-13T22:34:09.001486] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-13T22:34:09.006901] [INFO ] [MAIN ] Derivative Progress: 72/1810 symbols completed. AMBP took 1.2s. Estimated remaining: 11m 27s. Rate: 151.8 symbols/min [2025-10-13T22:34:09.007278] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:09.062870] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-13T22:34:09.076503] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-13T22:34:09.122324] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-13T22:34:09.169557] [INFO ] [MAIN ] AMC: Loaded 53762 primary data records. [2025-10-13T22:34:09.291067] [DEBUG] [LOCAL ] AME: Loaded 48705 existing records from primary storage. [2025-10-13T22:34:09.356570] [INFO ] [MAIN ] AME: Loaded 48705 primary data records. [2025-10-13T22:34:10.136830] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:10.138436] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-13T22:34:10.138697] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-13T22:34:10.153572] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:10.154857] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53762 primary records. [2025-10-13T22:34:10.162749] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-13T22:34:10.200067] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:10.202471] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48705 primary records. [2025-10-13T22:34:10.205589] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-13T22:34:10.205715] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-13T22:34:10.207139] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-13T22:34:10.209431] [INFO ] [MAIN ] Derivative Progress: 73/1810 symbols completed. AMCR took 1.2s. Estimated remaining: 11m 46s. Rate: 147.7 symbols/min [2025-10-13T22:34:10.218446] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-13T22:34:10.221177] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-13T22:34:10.224388] [INFO ] [MAIN ] Derivative Progress: 74/1810 symbols completed. AMC took 1.3s. Estimated remaining: 11m 36s. Rate: 149.6 symbols/min [2025-10-13T22:34:10.228978] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-13T22:34:10.229044] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-13T22:34:10.231732] [INFO ] [MAIN ] Derivative Progress: 75/1810 symbols completed. AME took 1.2s. Estimated remaining: 11m 27s. Rate: 151.6 symbols/min [2025-10-13T22:34:10.232199] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:10.232329] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:10.232448] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:10.269963] [DEBUG] [LOCAL ] AMG: Loaded 20121 existing records from primary storage. [2025-10-13T22:34:10.270144] [INFO ] [MAIN ] AMG: Loaded 20121 primary data records. [2025-10-13T22:34:10.430782] [DEBUG] [LOCAL ] AMN: Loaded 41763 existing records from primary storage. [2025-10-13T22:34:10.442674] [INFO ] [MAIN ] AMN: Loaded 41763 primary data records. [2025-10-13T22:34:10.474786] [DEBUG] [LOCAL ] AMH: Loaded 51797 existing records from primary storage. [2025-10-13T22:34:10.545905] [INFO ] [MAIN ] AMH: Loaded 51797 primary data records. [2025-10-13T22:34:11.342048] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:11.342887] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20121 primary records. [2025-10-13T22:34:11.343514] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-13T22:34:11.379036] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:11.381399] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41763 primary records. [2025-10-13T22:34:11.381800] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-13T22:34:11.382014] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-13T22:34:11.381861] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-13T22:34:11.384283] [INFO ] [MAIN ] Derivative Progress: 76/1810 symbols completed. AMG took 1.2s. Estimated remaining: 11m 44s. Rate: 147.9 symbols/min [2025-10-13T22:34:11.397560] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:11.399053] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:11.408329] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51797 primary records. [2025-10-13T22:34:11.412517] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-13T22:34:11.429826] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-13T22:34:11.432278] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-13T22:34:11.435330] [INFO ] [MAIN ] Derivative Progress: 77/1810 symbols completed. AMN took 1.2s. Estimated remaining: 11m 35s. Rate: 149.6 symbols/min [2025-10-13T22:34:11.435780] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:11.437403] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-13T22:34:11.437551] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-13T22:34:11.440898] [INFO ] [MAIN ] Derivative Progress: 78/1810 symbols completed. AMH took 1.2s. Estimated remaining: 11m 26s. Rate: 151.5 symbols/min [2025-10-13T22:34:11.441173] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:11.480778] [DEBUG] [LOCAL ] AMP: Loaded 32007 existing records from primary storage. [2025-10-13T22:34:11.481001] [INFO ] [MAIN ] AMP: Loaded 32007 primary data records. [2025-10-13T22:34:11.576288] [DEBUG] [LOCAL ] AMPY: Loaded 38869 existing records from primary storage. [2025-10-13T22:34:11.588530] [INFO ] [MAIN ] AMPY: Loaded 38869 primary data records. [2025-10-13T22:34:11.799862] [DEBUG] [LOCAL ] AMPX: Loaded 52323 existing records from primary storage. [2025-10-13T22:34:11.926964] [INFO ] [MAIN ] AMPX: Loaded 52323 primary data records. [2025-10-13T22:34:12.465285] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:12.467792] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32007 primary records. [2025-10-13T22:34:12.470005] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-13T22:34:12.500814] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-13T22:34:12.501162] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:12.501252] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-13T22:34:12.503831] [INFO ] [MAIN ] Derivative Progress: 79/1810 symbols completed. AMP took 1.1s. Estimated remaining: 11m 40s. Rate: 148.3 symbols/min [2025-10-13T22:34:12.504909] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 38869 primary records. [2025-10-13T22:34:12.504007] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:12.505230] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-13T22:34:12.525016] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-13T22:34:12.538293] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-13T22:34:12.541213] [INFO ] [MAIN ] Derivative Progress: 80/1810 symbols completed. AMPY took 1.1s. Estimated remaining: 11m 32s. Rate: 150.0 symbols/min [2025-10-13T22:34:12.541442] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:12.538593] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:12.542983] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52323 primary records. [2025-10-13T22:34:12.543297] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-13T22:34:12.572185] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-13T22:34:12.581170] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-13T22:34:12.585108] [INFO ] [MAIN ] Derivative Progress: 81/1810 symbols completed. AMPX took 1.1s. Estimated remaining: 11m 24s. Rate: 151.7 symbols/min [2025-10-13T22:34:12.585443] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:12.586358] [DEBUG] [LOCAL ] AMR: Loaded 28890 existing records from primary storage. [2025-10-13T22:34:12.586632] [INFO ] [MAIN ] AMR: Loaded 28890 primary data records. [2025-10-13T22:34:12.788555] [DEBUG] [LOCAL ] AMRC: Loaded 38297 existing records from primary storage. [2025-10-13T22:34:12.905930] [INFO ] [MAIN ] AMRC: Loaded 38297 primary data records. [2025-10-13T22:34:13.079905] [DEBUG] [LOCAL ] AMT: Loaded 52462 existing records from primary storage. [2025-10-13T22:34:13.102558] [INFO ] [MAIN ] AMT: Loaded 52462 primary data records. [2025-10-13T22:34:13.493430] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:13.653368] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28890 primary records. [2025-10-13T22:34:13.653986] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-13T22:34:13.673637] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-13T22:34:13.674098] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-13T22:34:13.676511] [INFO ] [MAIN ] Derivative Progress: 82/1810 symbols completed. AMR took 1.2s. Estimated remaining: 11m 38s. Rate: 148.5 symbols/min [2025-10-13T22:34:13.676839] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:13.702408] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:13.703367] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38297 primary records. [2025-10-13T22:34:13.703535] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-13T22:34:13.725070] [DEBUG] [LOCAL ] AMTB: Loaded 20503 existing records from primary storage. [2025-10-13T22:34:13.727679] [INFO ] [MAIN ] AMTB: Loaded 20503 primary data records. [2025-10-13T22:34:13.820480] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:13.831541] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52462 primary records. [2025-10-13T22:34:13.837526] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-13T22:34:13.813584] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-13T22:34:13.849614] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-13T22:34:13.852546] [INFO ] [MAIN ] Derivative Progress: 83/1810 symbols completed. AMRC took 1.3s. Estimated remaining: 11m 33s. Rate: 149.5 symbols/min [2025-10-13T22:34:13.859953] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:13.889313] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-13T22:34:13.909435] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-13T22:34:13.934388] [INFO ] [MAIN ] Derivative Progress: 84/1810 symbols completed. AMT took 1.3s. Estimated remaining: 11m 26s. Rate: 151.0 symbols/min [2025-10-13T22:34:13.948896] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:14.071639] [DEBUG] [LOCAL ] AMTD: Loaded 3779 existing records from primary storage. [2025-10-13T22:34:14.071874] [INFO ] [MAIN ] AMTD: Loaded 3779 primary data records. [2025-10-13T22:34:14.417769] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:14.421042] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20503 primary records. [2025-10-13T22:34:14.420099] [DEBUG] [LOCAL ] AMTM: Loaded 50593 existing records from primary storage. [2025-10-13T22:34:14.421479] [INFO ] [MAIN ] AMTM: Loaded 50593 primary data records. [2025-10-13T22:34:14.421401] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-13T22:34:14.524417] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-13T22:34:14.530319] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-13T22:34:14.532811] [INFO ] [MAIN ] Derivative Progress: 85/1810 symbols completed. AMTB took 0.9s. Estimated remaining: 11m 30s. Rate: 150.1 symbols/min [2025-10-13T22:34:14.544058] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:14.733960] [DEBUG] [LOCAL ] AMWL: Loaded 9437 existing records from primary storage. [2025-10-13T22:34:14.747999] [INFO ] [MAIN ] AMWL: Loaded 9437 primary data records. [2025-10-13T22:34:14.797525] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:14.830443] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3779 primary records. [2025-10-13T22:34:14.842165] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-13T22:34:15.069696] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-13T22:34:15.070483] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-13T22:34:15.073381] [INFO ] [MAIN ] Derivative Progress: 86/1810 symbols completed. AMTD took 1.2s. Estimated remaining: 11m 32s. Rate: 149.5 symbols/min [2025-10-13T22:34:15.073838] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:15.103547] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:15.104493] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50593 primary records. [2025-10-13T22:34:15.104703] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-13T22:34:15.123618] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-13T22:34:15.131579] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-13T22:34:15.138845] [INFO ] [MAIN ] Derivative Progress: 87/1810 symbols completed. AMTM took 1.2s. Estimated remaining: 11m 25s. Rate: 150.9 symbols/min [2025-10-13T22:34:15.139350] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:15.139177] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:15.140294] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9437 primary records. [2025-10-13T22:34:15.151029] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-13T22:34:15.166671] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-13T22:34:15.167850] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-13T22:34:15.170712] [INFO ] [MAIN ] Derivative Progress: 88/1810 symbols completed. AMWL took 0.6s. Estimated remaining: 11m 17s. Rate: 152.5 symbols/min [2025-10-13T22:34:15.185027] [DEBUG] [LOCAL ] AMX: Loaded 49092 existing records from primary storage. [2025-10-13T22:34:15.185171] [INFO ] [MAIN ] AMX: Loaded 49092 primary data records. [2025-10-13T22:34:15.529577] [DEBUG] [LOCAL ] ANF: Loaded 52071 existing records from primary storage. [2025-10-13T22:34:15.529824] [INFO ] [MAIN ] ANF: Loaded 52071 primary data records. [2025-10-13T22:34:15.847081] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:15.848496] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49092 primary records. [2025-10-13T22:34:15.848616] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-13T22:34:15.867749] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-13T22:34:15.867985] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-13T22:34:15.870965] [INFO ] [MAIN ] Derivative Progress: 89/1810 symbols completed. AMX took 0.8s. Estimated remaining: 11m 23s. Rate: 151.2 symbols/min [2025-10-13T22:34:15.887220] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:15.887873] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52071 primary records. [2025-10-13T22:34:15.887934] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-13T22:34:15.903099] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-13T22:34:15.903156] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-13T22:34:15.905757] [INFO ] [MAIN ] Derivative Progress: 90/1810 symbols completed. ANF took 0.8s. Estimated remaining: 11m 16s. Rate: 152.7 symbols/min [2025-10-13T22:34:15.906128] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:15.906637] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:15.906224] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:15.941394] [DEBUG] [LOCAL ] ANRO: Loaded 19332 existing records from primary storage. [2025-10-13T22:34:15.949959] [DEBUG] [LOCAL ] ANVS: Loaded 23559 existing records from primary storage. [2025-10-13T22:34:15.950121] [INFO ] [MAIN ] ANRO: Loaded 19332 primary data records. [2025-10-13T22:34:15.950297] [INFO ] [MAIN ] ANVS: Loaded 23559 primary data records. [2025-10-13T22:34:16.134501] [DEBUG] [LOCAL ] AOD: Loaded 30694 existing records from primary storage. [2025-10-13T22:34:16.194469] [INFO ] [MAIN ] AOD: Loaded 30694 primary data records. [2025-10-13T22:34:16.920706] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:16.922610] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23559 primary records. [2025-10-13T22:34:16.935843] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:16.935970] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-13T22:34:16.937129] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19332 primary records. [2025-10-13T22:34:16.937855] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-13T22:34:16.971100] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-13T22:34:16.963587] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-13T22:34:16.972036] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-13T22:34:16.971951] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-13T22:34:16.974969] [INFO ] [MAIN ] Derivative Progress: 91/1810 symbols completed. ANRO took 1.1s. Estimated remaining: 11m 28s. Rate: 149.9 symbols/min [2025-10-13T22:34:16.975216] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:16.978125] [INFO ] [MAIN ] Derivative Progress: 92/1810 symbols completed. ANVS took 1.1s. Estimated remaining: 11m 20s. Rate: 151.5 symbols/min [2025-10-13T22:34:16.978563] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:16.991997] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:16.993024] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30694 primary records. [2025-10-13T22:34:16.993251] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-13T22:34:17.013837] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-13T22:34:17.013958] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-13T22:34:17.016590] [INFO ] [MAIN ] Derivative Progress: 93/1810 symbols completed. AOD took 1.1s. Estimated remaining: 11m 13s. Rate: 153.0 symbols/min [2025-10-13T22:34:17.016888] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:17.024093] [DEBUG] [LOCAL ] AOMR: Loaded 16492 existing records from primary storage. [2025-10-13T22:34:17.024237] [INFO ] [MAIN ] AOMR: Loaded 16492 primary data records. [2025-10-13T22:34:17.382783] [DEBUG] [LOCAL ] AON: Loaded 45124 existing records from primary storage. [2025-10-13T22:34:17.392926] [INFO ] [MAIN ] AON: Loaded 45124 primary data records. [2025-10-13T22:34:17.424688] [DEBUG] [LOCAL ] APAM: Loaded 36096 existing records from primary storage. [2025-10-13T22:34:17.449494] [INFO ] [MAIN ] APAM: Loaded 36096 primary data records. [2025-10-13T22:34:18.016210] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:18.017124] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16492 primary records. [2025-10-13T22:34:18.017326] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-13T22:34:18.037457] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-13T22:34:18.037715] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-13T22:34:18.040433] [INFO ] [MAIN ] Derivative Progress: 94/1810 symbols completed. AOMR took 1.1s. Estimated remaining: 11m 24s. Rate: 150.4 symbols/min [2025-10-13T22:34:18.040884] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:18.060379] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:18.061276] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45124 primary records. [2025-10-13T22:34:18.061496] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-13T22:34:18.074797] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:18.086623] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36096 primary records. [2025-10-13T22:34:18.087002] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-13T22:34:18.108467] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-13T22:34:18.109601] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-13T22:34:18.109700] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-10-13T22:34:18.112141] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-13T22:34:18.111911] [INFO ] [MAIN ] Derivative Progress: 95/1810 symbols completed. AON took 1.1s. Estimated remaining: 11m 18s. Rate: 151.7 symbols/min [2025-10-13T22:34:18.125211] [INFO ] [MAIN ] Derivative Progress: 96/1810 symbols completed. APAM took 1.1s. Estimated remaining: 11m 11s. Rate: 153.3 symbols/min [2025-10-13T22:34:18.125052] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:18.125543] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:18.144471] [DEBUG] [LOCAL ] APD: Loaded 45325 existing records from primary storage. [2025-10-13T22:34:18.144605] [INFO ] [MAIN ] APD: Loaded 45325 primary data records. [2025-10-13T22:34:18.492551] [DEBUG] [LOCAL ] APG: Loaded 50584 existing records from primary storage. [2025-10-13T22:34:18.493672] [INFO ] [MAIN ] APG: Loaded 50584 primary data records. [2025-10-13T22:34:18.574901] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-13T22:34:18.592246] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-13T22:34:19.117313] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:19.128315] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45325 primary records. [2025-10-13T22:34:19.128677] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-13T22:34:19.149463] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-13T22:34:19.150094] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-13T22:34:19.152423] [INFO ] [MAIN ] Derivative Progress: 97/1810 symbols completed. APD took 1.1s. Estimated remaining: 11m 22s. Rate: 150.8 symbols/min [2025-10-13T22:34:19.152999] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:19.174030] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:19.174960] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50584 primary records. [2025-10-13T22:34:19.176469] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-13T22:34:19.206604] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:19.206347] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-13T22:34:19.207341] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-13T22:34:19.207545] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-13T22:34:19.207489] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-13T22:34:19.209901] [INFO ] [MAIN ] Derivative Progress: 98/1810 symbols completed. APG took 1.1s. Estimated remaining: 11m 15s. Rate: 152.1 symbols/min [2025-10-13T22:34:19.210185] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:19.241832] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-13T22:34:19.242027] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-13T22:34:19.246122] [INFO ] [MAIN ] Derivative Progress: 99/1810 symbols completed. APH took 1.1s. Estimated remaining: 11m 9s. Rate: 153.5 symbols/min [2025-10-13T22:34:19.246448] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:19.265796] [DEBUG] [LOCAL ] APO: Loaded 53387 existing records from primary storage. [2025-10-13T22:34:19.266083] [INFO ] [MAIN ] APO: Loaded 53387 primary data records. [2025-10-13T22:34:19.495049] [DEBUG] [LOCAL ] APTV: Loaded 52009 existing records from primary storage. [2025-10-13T22:34:19.633516] [INFO ] [MAIN ] APTV: Loaded 52009 primary data records. [2025-10-13T22:34:19.752188] [DEBUG] [LOCAL ] AQN: Loaded 51791 existing records from primary storage. [2025-10-13T22:34:19.776732] [INFO ] [MAIN ] AQN: Loaded 51791 primary data records. [2025-10-13T22:34:20.315274] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:20.317118] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53387 primary records. [2025-10-13T22:34:20.317489] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-13T22:34:20.334833] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-13T22:34:20.335920] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-13T22:34:20.338779] [INFO ] [MAIN ] Derivative Progress: 100/1810 symbols completed. APO took 1.2s. Estimated remaining: 11m 20s. Rate: 150.8 symbols/min [2025-10-13T22:34:20.339066] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:20.346384] [DEBUG] [LOCAL ] AQNB: Loaded 4117 existing records from primary storage. [2025-10-13T22:34:20.346678] [INFO ] [MAIN ] AQNB: Loaded 4117 primary data records. [2025-10-13T22:34:20.496182] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:20.532544] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52009 primary records. [2025-10-13T22:34:20.555123] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-13T22:34:20.520933] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:20.675735] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51791 primary records. [2025-10-13T22:34:20.693253] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-13T22:34:20.692016] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-13T22:34:20.693526] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-13T22:34:20.696681] [INFO ] [MAIN ] Derivative Progress: 101/1810 symbols completed. APTV took 1.5s. Estimated remaining: 11m 19s. Rate: 150.9 symbols/min [2025-10-13T22:34:20.705878] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:20.716151] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-10-13T22:34:20.716302] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-13T22:34:20.719171] [INFO ] [MAIN ] Derivative Progress: 102/1810 symbols completed. AQN took 1.5s. Estimated remaining: 11m 13s. Rate: 152.4 symbols/min [2025-10-13T22:34:20.719399] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:20.748972] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:34:20.749737] [INFO ] [MAIN ] AQNB: Generated 1792 derivative records from 4117 primary records. [2025-10-13T22:34:20.749839] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-13T22:34:20.777542] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1792 records). [2025-10-13T22:34:20.786186] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-13T22:34:20.788671] [INFO ] [MAIN ] Derivative Progress: 103/1810 symbols completed. AQNB took 0.4s. Estimated remaining: 11m 7s. Rate: 153.6 symbols/min [2025-10-13T22:34:20.789829] [DEBUG] [LOCAL ] ARDT: Loaded 27696 existing records from primary storage. [2025-10-13T22:34:20.789904] [INFO ] [MAIN ] ARDT: Loaded 27696 primary data records. [2025-10-13T22:34:20.905638] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-13T22:34:20.906158] [INFO ] [MAIN ] AR: Loaded 53587 primary data records. [2025-10-13T22:34:21.485749] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:21.486840] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27696 primary records. [2025-10-13T22:34:21.486930] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-13T22:34:21.505927] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-13T22:34:21.507869] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-13T22:34:21.510539] [INFO ] [MAIN ] Derivative Progress: 104/1810 symbols completed. ARDT took 0.8s. Estimated remaining: 11m 12s. Rate: 152.3 symbols/min [2025-10-13T22:34:21.524196] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:21.525021] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53587 primary records. [2025-10-13T22:34:21.525086] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-13T22:34:21.542099] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-13T22:34:21.542255] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-13T22:34:21.544915] [INFO ] [MAIN ] Derivative Progress: 105/1810 symbols completed. AR took 0.8s. Estimated remaining: 11m 6s. Rate: 153.7 symbols/min [2025-10-13T22:34:21.545714] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:21.545554] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:21.546046] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:21.626593] [DEBUG] [LOCAL ] ARE: Loaded 50891 existing records from primary storage. [2025-10-13T22:34:21.628611] [DEBUG] [LOCAL ] ARI: Loaded 43711 existing records from primary storage. [2025-10-13T22:34:21.629479] [INFO ] [MAIN ] ARE: Loaded 50891 primary data records. [2025-10-13T22:34:21.629402] [INFO ] [MAIN ] ARI: Loaded 43711 primary data records. [2025-10-13T22:34:21.729711] [DEBUG] [LOCAL ] ARES: Loaded 49688 existing records from primary storage. [2025-10-13T22:34:21.811264] [INFO ] [MAIN ] ARES: Loaded 49688 primary data records. [2025-10-13T22:34:22.617330] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:22.622141] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43711 primary records. [2025-10-13T22:34:22.622749] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-13T22:34:22.646318] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:22.654545] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50891 primary records. [2025-10-13T22:34:22.654842] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-13T22:34:22.662762] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-13T22:34:22.668674] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-13T22:34:22.669016] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:22.672342] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49688 primary records. [2025-10-13T22:34:22.671473] [INFO ] [MAIN ] Derivative Progress: 106/1810 symbols completed. ARI took 1.1s. Estimated remaining: 11m 17s. Rate: 151.0 symbols/min [2025-10-13T22:34:22.672662] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-13T22:34:22.679966] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:22.691385] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-13T22:34:22.699681] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-13T22:34:22.703106] [INFO ] [MAIN ] Derivative Progress: 107/1810 symbols completed. ARE took 1.2s. Estimated remaining: 11m 11s. Rate: 152.3 symbols/min [2025-10-13T22:34:22.706351] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:22.711253] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-10-13T22:34:22.713718] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-13T22:34:22.717889] [INFO ] [MAIN ] Derivative Progress: 108/1810 symbols completed. ARES took 1.2s. Estimated remaining: 11m 5s. Rate: 153.7 symbols/min [2025-10-13T22:34:22.718222] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:22.764995] [DEBUG] [LOCAL ] ARIS: Loaded 42525 existing records from primary storage. [2025-10-13T22:34:22.765347] [INFO ] [MAIN ] ARIS: Loaded 42525 primary data records. [2025-10-13T22:34:22.817168] [DEBUG] [LOCAL ] ARLO: Loaded 43759 existing records from primary storage. [2025-10-13T22:34:22.848804] [INFO ] [MAIN ] ARLO: Loaded 43759 primary data records. [2025-10-13T22:34:23.056787] [DEBUG] [LOCAL ] ARMK: Loaded 50343 existing records from primary storage. [2025-10-13T22:34:23.071709] [INFO ] [MAIN ] ARMK: Loaded 50343 primary data records. [2025-10-13T22:34:23.926307] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:23.929902] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42525 primary records. [2025-10-13T22:34:23.932445] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-13T22:34:23.966499] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-13T22:34:23.962282] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:23.966808] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-13T22:34:23.967884] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43759 primary records. [2025-10-13T22:34:23.970198] [INFO ] [MAIN ] Derivative Progress: 109/1810 symbols completed. ARIS took 1.3s. Estimated remaining: 11m 18s. Rate: 150.6 symbols/min [2025-10-13T22:34:23.970367] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-13T22:34:23.970497] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:23.991764] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-13T22:34:23.992066] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-13T22:34:23.994917] [INFO ] [MAIN ] Derivative Progress: 110/1810 symbols completed. ARLO took 1.3s. Estimated remaining: 11m 11s. Rate: 151.9 symbols/min [2025-10-13T22:34:23.995230] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:24.010343] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:24.011202] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50343 primary records. [2025-10-13T22:34:24.011432] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-13T22:34:24.028857] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-13T22:34:24.029041] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-13T22:34:24.034026] [INFO ] [MAIN ] Derivative Progress: 111/1810 symbols completed. ARMK took 1.3s. Estimated remaining: 11m 6s. Rate: 153.2 symbols/min [2025-10-13T22:34:24.047241] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:24.082044] [DEBUG] [LOCAL ] AROC: Loaded 48999 existing records from primary storage. [2025-10-13T22:34:24.082370] [INFO ] [MAIN ] AROC: Loaded 48999 primary data records. [2025-10-13T22:34:24.228220] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-13T22:34:24.241078] [INFO ] [MAIN ] ARR: Loaded 52091 primary data records. [2025-10-13T22:34:24.399418] [DEBUG] [LOCAL ] ARW: Loaded 33011 existing records from primary storage. [2025-10-13T22:34:24.525985] [INFO ] [MAIN ] ARW: Loaded 33011 primary data records. [2025-10-13T22:34:25.138174] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:25.140351] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48999 primary records. [2025-10-13T22:34:25.140776] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-13T22:34:25.163248] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-13T22:34:25.176573] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-13T22:34:25.176936] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:25.179728] [INFO ] [MAIN ] Derivative Progress: 112/1810 symbols completed. AROC took 1.2s. Estimated remaining: 11m 17s. Rate: 150.6 symbols/min [2025-10-13T22:34:25.181218] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:25.181061] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52091 primary records. [2025-10-13T22:34:25.181612] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-13T22:34:25.200258] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-13T22:34:25.200681] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-13T22:34:25.203405] [INFO ] [MAIN ] Derivative Progress: 113/1810 symbols completed. ARR took 1.2s. Estimated remaining: 11m 11s. Rate: 151.8 symbols/min [2025-10-13T22:34:25.203619] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:25.225316] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:25.226858] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33011 primary records. [2025-10-13T22:34:25.226980] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-13T22:34:25.254898] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-13T22:34:25.255778] [DEBUG] [LOCAL ] ASA: Loaded 14963 existing records from primary storage. [2025-10-13T22:34:25.256179] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-13T22:34:25.273040] [INFO ] [MAIN ] ASA: Loaded 14963 primary data records. [2025-10-13T22:34:25.287476] [INFO ] [MAIN ] Derivative Progress: 114/1810 symbols completed. ARW took 1.2s. Estimated remaining: 11m 6s. Rate: 152.9 symbols/min [2025-10-13T22:34:25.297248] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:25.442426] [DEBUG] [LOCAL ] AS: Loaded 53163 existing records from primary storage. [2025-10-13T22:34:25.548012] [INFO ] [MAIN ] AS: Loaded 53163 primary data records. [2025-10-13T22:34:25.736605] [DEBUG] [LOCAL ] ASAN: Loaded 52724 existing records from primary storage. [2025-10-13T22:34:25.749533] [INFO ] [MAIN ] ASAN: Loaded 52724 primary data records. [2025-10-13T22:34:26.354707] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:26.356708] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 14963 primary records. [2025-10-13T22:34:26.357158] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-13T22:34:26.375440] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-13T22:34:26.376118] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-13T22:34:26.379062] [INFO ] [MAIN ] Derivative Progress: 115/1810 symbols completed. ASA took 1.2s. Estimated remaining: 11m 15s. Rate: 150.6 symbols/min [2025-10-13T22:34:26.380926] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:26.404545] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:34:26.405947] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53163 primary records. [2025-10-13T22:34:26.406205] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-13T22:34:26.428586] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-10-13T22:34:26.436810] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-13T22:34:26.444109] [INFO ] [MAIN ] Derivative Progress: 116/1810 symbols completed. AS took 1.3s. Estimated remaining: 11m 10s. Rate: 151.7 symbols/min [2025-10-13T22:34:26.444437] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:26.445544] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:26.446946] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52724 primary records. [2025-10-13T22:34:26.447295] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-13T22:34:26.478967] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-13T22:34:26.479146] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-13T22:34:26.485776] [INFO ] [MAIN ] Derivative Progress: 117/1810 symbols completed. ASAN took 1.2s. Estimated remaining: 11m 5s. Rate: 152.8 symbols/min [2025-10-13T22:34:26.486155] [DEBUG] [LOCAL ] ASBA: Loaded 3450 existing records from primary storage. [2025-10-13T22:34:26.486507] [INFO ] [MAIN ] ASBA: Loaded 3450 primary data records. [2025-10-13T22:34:26.486607] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:26.628328] [DEBUG] [LOCAL ] ASB: Loaded 49582 existing records from primary storage. [2025-10-13T22:34:26.650403] [INFO ] [MAIN ] ASB: Loaded 49582 primary data records. [2025-10-13T22:34:26.953716] [DEBUG] [LOCAL ] ASC: Loaded 37351 existing records from primary storage. [2025-10-13T22:34:26.957488] [INFO ] [MAIN ] ASC: Loaded 37351 primary data records. [2025-10-13T22:34:27.493963] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:27.495447] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3450 primary records. [2025-10-13T22:34:27.495874] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-13T22:34:27.515103] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-13T22:34:27.515279] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-13T22:34:27.517504] [INFO ] [MAIN ] Derivative Progress: 118/1810 symbols completed. ASBA took 1.1s. Estimated remaining: 11m 13s. Rate: 150.7 symbols/min [2025-10-13T22:34:27.536440] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:27.537443] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49582 primary records. [2025-10-13T22:34:27.537738] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-13T22:34:27.557302] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-13T22:34:27.569546] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-13T22:34:27.572442] [INFO ] [MAIN ] Derivative Progress: 119/1810 symbols completed. ASB took 1.2s. Estimated remaining: 11m 8s. Rate: 151.8 symbols/min [2025-10-13T22:34:27.573043] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:27.573684] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37351 primary records. [2025-10-13T22:34:27.573749] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-13T22:34:27.589777] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-13T22:34:27.589858] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-13T22:34:27.592797] [INFO ] [MAIN ] Derivative Progress: 120/1810 symbols completed. ASC took 1.1s. Estimated remaining: 11m 3s. Rate: 153.1 symbols/min [2025-10-13T22:34:27.593501] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:27.593451] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:27.594046] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:27.628148] [DEBUG] [LOCAL ] ASG: Loaded 19522 existing records from primary storage. [2025-10-13T22:34:27.628446] [INFO ] [MAIN ] ASG: Loaded 19522 primary data records. [2025-10-13T22:34:27.747500] [DEBUG] [LOCAL ] ASGN: Loaded 36450 existing records from primary storage. [2025-10-13T22:34:27.757679] [INFO ] [MAIN ] ASGN: Loaded 36450 primary data records. [2025-10-13T22:34:27.736395] [DEBUG] [LOCAL ] ASGI: Loaded 22835 existing records from primary storage. [2025-10-13T22:34:27.773290] [INFO ] [MAIN ] ASGI: Loaded 22835 primary data records. [2025-10-13T22:34:28.756556] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:28.757880] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19522 primary records. [2025-10-13T22:34:28.759039] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-13T22:34:28.776449] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-13T22:34:28.777131] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-13T22:34:28.780891] [INFO ] [MAIN ] Derivative Progress: 121/1810 symbols completed. ASG took 1.2s. Estimated remaining: 11m 13s. Rate: 150.5 symbols/min [2025-10-13T22:34:28.781388] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:28.797179] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:28.798363] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22835 primary records. [2025-10-13T22:34:28.798821] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-13T22:34:28.833792] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:28.834846] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-13T22:34:28.836118] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36450 primary records. [2025-10-13T22:34:28.836482] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-13T22:34:28.836360] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-13T22:34:28.840534] [INFO ] [MAIN ] Derivative Progress: 122/1810 symbols completed. ASGI took 1.2s. Estimated remaining: 11m 8s. Rate: 151.6 symbols/min [2025-10-13T22:34:28.853176] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:28.871405] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-13T22:34:28.871906] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-13T22:34:28.875129] [INFO ] [MAIN ] Derivative Progress: 123/1810 symbols completed. ASGN took 1.3s. Estimated remaining: 11m 3s. Rate: 152.7 symbols/min [2025-10-13T22:34:28.885375] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:28.887522] [DEBUG] [LOCAL ] ASH: Loaded 37545 existing records from primary storage. [2025-10-13T22:34:28.888303] [INFO ] [MAIN ] ASH: Loaded 37545 primary data records. [2025-10-13T22:34:29.016747] [DEBUG] [LOCAL ] ASIX: Loaded 22959 existing records from primary storage. [2025-10-13T22:34:29.054059] [INFO ] [MAIN ] ASIX: Loaded 22959 primary data records. [2025-10-13T22:34:29.335223] [DEBUG] [LOCAL ] ASPN: Loaded 49849 existing records from primary storage. [2025-10-13T22:34:29.347969] [INFO ] [MAIN ] ASPN: Loaded 49849 primary data records. [2025-10-13T22:34:29.774863] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:29.781527] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37545 primary records. [2025-10-13T22:34:29.882032] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-13T22:34:29.966313] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-13T22:34:29.966781] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-13T22:34:29.969782] [INFO ] [MAIN ] Derivative Progress: 124/1810 symbols completed. ASH took 1.2s. Estimated remaining: 11m 12s. Rate: 150.5 symbols/min [2025-10-13T22:34:29.970817] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:29.996085] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:29.997243] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22959 primary records. [2025-10-13T22:34:29.997436] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-13T22:34:30.010871] [DEBUG] [LOCAL ] ASR: Loaded 9350 existing records from primary storage. [2025-10-13T22:34:30.019075] [INFO ] [MAIN ] ASR: Loaded 9350 primary data records. [2025-10-13T22:34:30.019000] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-13T22:34:30.057574] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-13T22:34:30.089792] [INFO ] [MAIN ] Derivative Progress: 125/1810 symbols completed. ASIX took 1.2s. Estimated remaining: 11m 8s. Rate: 151.4 symbols/min [2025-10-13T22:34:30.108039] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:30.357374] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:30.358387] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49849 primary records. [2025-10-13T22:34:30.358500] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-13T22:34:30.376500] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-13T22:34:30.392998] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-13T22:34:30.396405] [INFO ] [MAIN ] Derivative Progress: 126/1810 symbols completed. ASPN took 1.5s. Estimated remaining: 11m 6s. Rate: 151.7 symbols/min [2025-10-13T22:34:30.397208] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:30.421340] [DEBUG] [LOCAL ] ASX: Loaded 52872 existing records from primary storage. [2025-10-13T22:34:30.422112] [INFO ] [MAIN ] ASX: Loaded 52872 primary data records. [2025-10-13T22:34:30.555568] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:30.588504] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9350 primary records. [2025-10-13T22:34:30.628974] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-13T22:34:30.647591] [DEBUG] [LOCAL ] ATEN: Loaded 38519 existing records from primary storage. [2025-10-13T22:34:30.651749] [INFO ] [MAIN ] ATEN: Loaded 38519 primary data records. [2025-10-13T22:34:30.847134] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-13T22:34:30.857267] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-13T22:34:30.872424] [INFO ] [MAIN ] Derivative Progress: 127/1810 symbols completed. ASR took 0.9s. Estimated remaining: 11m 7s. Rate: 151.4 symbols/min [2025-10-13T22:34:30.899018] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:31.137113] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:31.147863] [DEBUG] [LOCAL ] ATGE: Loaded 31039 existing records from primary storage. [2025-10-13T22:34:31.147027] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52872 primary records. [2025-10-13T22:34:31.148347] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-13T22:34:31.149735] [INFO ] [MAIN ] ATGE: Loaded 31039 primary data records. [2025-10-13T22:34:31.202126] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-13T22:34:31.241991] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-13T22:34:31.249826] [INFO ] [MAIN ] Derivative Progress: 128/1810 symbols completed. ASX took 1.1s. Estimated remaining: 11m 6s. Rate: 151.5 symbols/min [2025-10-13T22:34:31.272435] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:31.359080] [DEBUG] [LOCAL ] ATHS: Loaded 6739 existing records from primary storage. [2025-10-13T22:34:31.389797] [INFO ] [MAIN ] ATHS: Loaded 6739 primary data records. [2025-10-13T22:34:31.486063] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:31.487018] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 38519 primary records. [2025-10-13T22:34:31.512688] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-13T22:34:31.610018] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-13T22:34:31.621164] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-13T22:34:31.634077] [INFO ] [MAIN ] Derivative Progress: 129/1810 symbols completed. ATEN took 1.2s. Estimated remaining: 11m 6s. Rate: 151.5 symbols/min [2025-10-13T22:34:31.639825] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:31.869004] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:31.869947] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31039 primary records. [2025-10-13T22:34:31.870037] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-13T22:34:31.887140] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-13T22:34:31.887556] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-13T22:34:31.889913] [INFO ] [MAIN ] Derivative Progress: 130/1810 symbols completed. ATGE took 1.0s. Estimated remaining: 11m 3s. Rate: 151.9 symbols/min [2025-10-13T22:34:31.903992] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:31.922896] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:31.937170] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6739 primary records. [2025-10-13T22:34:31.937336] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-13T22:34:31.938977] [DEBUG] [LOCAL ] ATI: Loaded 51366 existing records from primary storage. [2025-10-13T22:34:31.939087] [INFO ] [MAIN ] ATI: Loaded 51366 primary data records. [2025-10-13T22:34:32.030424] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-13T22:34:32.058354] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-13T22:34:32.074915] [INFO ] [MAIN ] Derivative Progress: 131/1810 symbols completed. ATHS took 0.8s. Estimated remaining: 11m 0s. Rate: 152.5 symbols/min [2025-10-13T22:34:32.085980] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:32.169336] [DEBUG] [LOCAL ] ATUS: Loaded 49722 existing records from primary storage. [2025-10-13T22:34:32.169630] [INFO ] [MAIN ] ATUS: Loaded 49722 primary data records. [2025-10-13T22:34:32.610712] [DEBUG] [LOCAL ] AUB: Loaded 46091 existing records from primary storage. [2025-10-13T22:34:32.611104] [INFO ] [MAIN ] AUB: Loaded 46091 primary data records. [2025-10-13T22:34:32.928198] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:32.929759] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51366 primary records. [2025-10-13T22:34:32.929946] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-13T22:34:32.950271] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-13T22:34:32.951265] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-13T22:34:32.954275] [INFO ] [MAIN ] Derivative Progress: 132/1810 symbols completed. ATI took 1.3s. Estimated remaining: 11m 6s. Rate: 151.1 symbols/min [2025-10-13T22:34:32.954859] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:32.968489] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:32.969405] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49722 primary records. [2025-10-13T22:34:32.969612] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-13T22:34:32.991095] [DEBUG] [LOCAL ] AUNA: Loaded 5088 existing records from primary storage. [2025-10-13T22:34:32.987965] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-13T22:34:32.991368] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-13T22:34:32.991304] [INFO ] [MAIN ] AUNA: Loaded 5088 primary data records. [2025-10-13T22:34:33.015582] [INFO ] [MAIN ] Derivative Progress: 133/1810 symbols completed. ATUS took 1.1s. Estimated remaining: 11m 2s. Rate: 152.1 symbols/min [2025-10-13T22:34:33.197053] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:34:33.203332] [INFO ] [MAIN ] AUB: Generated 1793 derivative records from 46091 primary records. [2025-10-13T22:34:33.203473] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-13T22:34:33.341340] [DEBUG] [LOCAL ] AUB: Derivative data saved (1793 records). [2025-10-13T22:34:33.341979] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-13T22:34:33.345101] [INFO ] [MAIN ] Derivative Progress: 134/1810 symbols completed. AUB took 1.3s. Estimated remaining: 11m 0s. Rate: 152.3 symbols/min [2025-10-13T22:34:33.367320] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:34:33.368056] [INFO ] [MAIN ] AUNA: Generated 1792 derivative records from 5088 primary records. [2025-10-13T22:34:33.368142] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-13T22:34:33.381778] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1792 records). [2025-10-13T22:34:33.381836] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-13T22:34:33.384946] [INFO ] [MAIN ] Derivative Progress: 135/1810 symbols completed. AUNA took 0.4s. Estimated remaining: 10m 56s. Rate: 153.3 symbols/min [2025-10-13T22:34:33.385469] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:33.385421] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:33.386052] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:33.399784] [DEBUG] [LOCAL ] AVAL: Loaded 8610 existing records from primary storage. [2025-10-13T22:34:33.399996] [INFO ] [MAIN ] AVAL: Loaded 8610 primary data records. [2025-10-13T22:34:33.739988] [DEBUG] [LOCAL ] AVB: Loaded 42176 existing records from primary storage. [2025-10-13T22:34:33.742036] [INFO ] [MAIN ] AVB: Loaded 42176 primary data records. [2025-10-13T22:34:33.764108] [DEBUG] [LOCAL ] AVA: Loaded 38997 existing records from primary storage. [2025-10-13T22:34:33.774616] [INFO ] [MAIN ] AVA: Loaded 38997 primary data records. [2025-10-13T22:34:34.414299] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:34.416478] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8610 primary records. [2025-10-13T22:34:34.416586] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-13T22:34:34.434661] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-13T22:34:34.435846] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-13T22:34:34.438301] [INFO ] [MAIN ] Derivative Progress: 136/1810 symbols completed. AVAL took 1.1s. Estimated remaining: 11m 3s. Rate: 151.4 symbols/min [2025-10-13T22:34:34.438632] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:34.469797] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:34.470931] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42176 primary records. [2025-10-13T22:34:34.479265] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-13T22:34:34.493400] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:34.503050] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 38997 primary records. [2025-10-13T22:34:34.503167] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-13T22:34:34.501456] [DEBUG] [LOCAL ] AVD: Loaded 22083 existing records from primary storage. [2025-10-13T22:34:34.511058] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-13T22:34:34.509871] [INFO ] [MAIN ] AVD: Loaded 22083 primary data records. [2025-10-13T22:34:34.511213] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-13T22:34:34.570383] [INFO ] [MAIN ] Derivative Progress: 137/1810 symbols completed. AVB took 1.2s. Estimated remaining: 10m 60s. Rate: 152.2 symbols/min [2025-10-13T22:34:34.602545] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:34.640478] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-13T22:34:34.640907] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-13T22:34:34.644523] [INFO ] [MAIN ] Derivative Progress: 138/1810 symbols completed. AVA took 1.3s. Estimated remaining: 10m 55s. Rate: 153.1 symbols/min [2025-10-13T22:34:34.660459] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:34.849344] [DEBUG] [LOCAL ] AVK: Loaded 18522 existing records from primary storage. [2025-10-13T22:34:34.849704] [INFO ] [MAIN ] AVK: Loaded 18522 primary data records. [2025-10-13T22:34:34.974389] [DEBUG] [LOCAL ] AVNS: Loaded 33586 existing records from primary storage. [2025-10-13T22:34:34.995146] [INFO ] [MAIN ] AVNS: Loaded 33586 primary data records. [2025-10-13T22:34:35.481011] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:35.485120] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22083 primary records. [2025-10-13T22:34:35.485393] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-13T22:34:35.505234] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-13T22:34:35.505445] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-13T22:34:35.507818] [INFO ] [MAIN ] Derivative Progress: 139/1810 symbols completed. AVD took 1.1s. Estimated remaining: 11m 1s. Rate: 151.8 symbols/min [2025-10-13T22:34:35.508051] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:35.522917] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:35.523838] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18522 primary records. [2025-10-13T22:34:35.523945] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-13T22:34:35.540843] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-13T22:34:35.541016] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-13T22:34:35.543484] [INFO ] [MAIN ] Derivative Progress: 140/1810 symbols completed. AVK took 0.9s. Estimated remaining: 10m 56s. Rate: 152.7 symbols/min [2025-10-13T22:34:35.543721] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:35.560843] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:35.561729] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33586 primary records. [2025-10-13T22:34:35.561929] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-13T22:34:35.589122] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-13T22:34:35.589398] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-13T22:34:35.592174] [INFO ] [MAIN ] Derivative Progress: 141/1810 symbols completed. AVNS took 0.9s. Estimated remaining: 10m 52s. Rate: 153.7 symbols/min [2025-10-13T22:34:35.592432] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:35.614558] [DEBUG] [LOCAL ] AVNT: Loaded 39118 existing records from primary storage. [2025-10-13T22:34:35.614795] [INFO ] [MAIN ] AVNT: Loaded 39118 primary data records. [2025-10-13T22:34:35.738458] [DEBUG] [LOCAL ] AVY: Loaded 37819 existing records from primary storage. [2025-10-13T22:34:35.761797] [INFO ] [MAIN ] AVY: Loaded 37819 primary data records. [2025-10-13T22:34:35.767450] [DEBUG] [LOCAL ] AWF: Loaded 24023 existing records from primary storage. [2025-10-13T22:34:35.772798] [INFO ] [MAIN ] AWF: Loaded 24023 primary data records. [2025-10-13T22:34:36.590801] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:36.591786] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39118 primary records. [2025-10-13T22:34:36.592019] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-13T22:34:36.624996] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:36.624721] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-13T22:34:36.633102] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24023 primary records. [2025-10-13T22:34:36.633202] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-13T22:34:36.633253] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-13T22:34:36.640705] [INFO ] [MAIN ] Derivative Progress: 142/1810 symbols completed. AVNT took 1.1s. Estimated remaining: 10m 59s. Rate: 151.9 symbols/min [2025-10-13T22:34:36.641300] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:36.640963] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:36.642216] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37819 primary records. [2025-10-13T22:34:36.654454] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-13T22:34:36.658549] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-13T22:34:36.658818] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-13T22:34:36.661392] [INFO ] [MAIN ] Derivative Progress: 143/1810 symbols completed. AWF took 1.1s. Estimated remaining: 10m 54s. Rate: 152.9 symbols/min [2025-10-13T22:34:36.669012] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:36.677385] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-13T22:34:36.677554] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-13T22:34:36.680361] [INFO ] [MAIN ] Derivative Progress: 144/1810 symbols completed. AVY took 1.1s. Estimated remaining: 10m 49s. Rate: 153.9 symbols/min [2025-10-13T22:34:36.680607] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:36.707737] [DEBUG] [LOCAL ] AWI: Loaded 25385 existing records from primary storage. [2025-10-13T22:34:36.714544] [INFO ] [MAIN ] AWI: Loaded 25385 primary data records. [2025-10-13T22:34:36.748950] [DEBUG] [LOCAL ] AWP: Loaded 21557 existing records from primary storage. [2025-10-13T22:34:36.766104] [INFO ] [MAIN ] AWP: Loaded 21557 primary data records. [2025-10-13T22:34:37.001208] [DEBUG] [LOCAL ] AWK: Loaded 48619 existing records from primary storage. [2025-10-13T22:34:37.080994] [INFO ] [MAIN ] AWK: Loaded 48619 primary data records. [2025-10-13T22:34:37.746207] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:37.746878] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:37.747897] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25385 primary records. [2025-10-13T22:34:37.748758] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21557 primary records. [2025-10-13T22:34:37.748853] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-13T22:34:37.749083] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-13T22:34:37.784194] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-13T22:34:37.784458] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-13T22:34:37.783114] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-13T22:34:37.787000] [INFO ] [MAIN ] Derivative Progress: 145/1810 symbols completed. AWI took 1.1s. Estimated remaining: 10m 57s. Rate: 152.0 symbols/min [2025-10-13T22:34:37.787264] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-13T22:34:37.790206] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:37.790686] [INFO ] [MAIN ] Derivative Progress: 146/1810 symbols completed. AWP took 1.1s. Estimated remaining: 10m 52s. Rate: 153.0 symbols/min [2025-10-13T22:34:37.791040] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:37.808844] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:37.809572] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48619 primary records. [2025-10-13T22:34:37.809711] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-13T22:34:37.841087] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-13T22:34:37.848396] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-13T22:34:37.851547] [INFO ] [MAIN ] Derivative Progress: 147/1810 symbols completed. AWK took 1.2s. Estimated remaining: 10m 48s. Rate: 153.9 symbols/min [2025-10-13T22:34:37.852317] [DEBUG] [LOCAL ] AWR: Loaded 22779 existing records from primary storage. [2025-10-13T22:34:37.852440] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:37.853716] [INFO ] [MAIN ] AWR: Loaded 22779 primary data records. [2025-10-13T22:34:37.905912] [DEBUG] [LOCAL ] AX: Loaded 28013 existing records from primary storage. [2025-10-13T22:34:37.926634] [INFO ] [MAIN ] AX: Loaded 28013 primary data records. [2025-10-13T22:34:38.481354] [DEBUG] [LOCAL ] AXL: Loaded 50550 existing records from primary storage. [2025-10-13T22:34:38.495968] [INFO ] [MAIN ] AXL: Loaded 50550 primary data records. [2025-10-13T22:34:38.875523] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:38.876515] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22779 primary records. [2025-10-13T22:34:38.877064] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-13T22:34:38.892174] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:38.893131] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28013 primary records. [2025-10-13T22:34:38.893444] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-13T22:34:38.921517] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-13T22:34:38.924875] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-13T22:34:38.931857] [INFO ] [MAIN ] Derivative Progress: 148/1810 symbols completed. AWR took 1.1s. Estimated remaining: 10m 56s. Rate: 152.1 symbols/min [2025-10-13T22:34:38.928804] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-13T22:34:38.932353] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-13T22:34:38.934957] [INFO ] [MAIN ] Derivative Progress: 149/1810 symbols completed. AX took 1.1s. Estimated remaining: 10m 51s. Rate: 153.1 symbols/min [2025-10-13T22:34:38.952050] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:38.952967] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50550 primary records. [2025-10-13T22:34:38.953032] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-13T22:34:38.968387] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-13T22:34:38.968504] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-13T22:34:38.971040] [INFO ] [MAIN ] Derivative Progress: 150/1810 symbols completed. AXL took 1.1s. Estimated remaining: 10m 47s. Rate: 154.1 symbols/min [2025-10-13T22:34:38.971736] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:38.971548] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:38.971624] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:38.986422] [DEBUG] [LOCAL ] AZO: Loaded 11208 existing records from primary storage. [2025-10-13T22:34:38.986724] [INFO ] [MAIN ] AZO: Loaded 11208 primary data records. [2025-10-13T22:34:39.176881] [DEBUG] [LOCAL ] AYI: Loaded 25068 existing records from primary storage. [2025-10-13T22:34:39.196259] [INFO ] [MAIN ] AYI: Loaded 25068 primary data records. [2025-10-13T22:34:39.355560] [DEBUG] [LOCAL ] AXS: Loaded 38639 existing records from primary storage. [2025-10-13T22:34:39.361745] [INFO ] [MAIN ] AXS: Loaded 38639 primary data records. [2025-10-13T22:34:40.025699] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:40.027936] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11208 primary records. [2025-10-13T22:34:40.028496] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-13T22:34:40.046918] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-13T22:34:40.048123] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-13T22:34:40.051390] [INFO ] [MAIN ] Derivative Progress: 151/1810 symbols completed. AZO took 1.1s. Estimated remaining: 10m 54s. Rate: 152.3 symbols/min [2025-10-13T22:34:40.051811] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:40.069975] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:40.070864] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25068 primary records. [2025-10-13T22:34:40.071043] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-13T22:34:40.096935] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-13T22:34:40.097148] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-13T22:34:40.099911] [INFO ] [MAIN ] Derivative Progress: 152/1810 symbols completed. AYI took 1.1s. Estimated remaining: 10m 50s. Rate: 153.1 symbols/min [2025-10-13T22:34:40.100400] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:40.113362] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:40.114392] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38639 primary records. [2025-10-13T22:34:40.115356] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-13T22:34:40.125084] [DEBUG] [LOCAL ] AZZ: Loaded 22566 existing records from primary storage. [2025-10-13T22:34:40.125983] [INFO ] [MAIN ] AZZ: Loaded 22566 primary data records. [2025-10-13T22:34:40.186136] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-13T22:34:40.214849] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-13T22:34:40.225422] [INFO ] [MAIN ] Derivative Progress: 153/1810 symbols completed. AXS took 1.3s. Estimated remaining: 10m 46s. Rate: 153.8 symbols/min [2025-10-13T22:34:40.251825] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:40.506690] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-13T22:34:40.507085] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-13T22:34:40.841072] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-13T22:34:40.841353] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-13T22:34:41.046739] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:41.167530] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22566 primary records. [2025-10-13T22:34:41.168073] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-13T22:34:41.188367] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-13T22:34:41.188939] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-13T22:34:41.192300] [INFO ] [MAIN ] Derivative Progress: 154/1810 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 52s. Rate: 152.4 symbols/min [2025-10-13T22:34:41.192482] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:41.211235] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:41.212243] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-13T22:34:41.212459] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-13T22:34:41.233886] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-13T22:34:41.235031] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-13T22:34:41.239286] [INFO ] [MAIN ] Derivative Progress: 155/1810 symbols completed. BA took 1.1s. Estimated remaining: 10m 48s. Rate: 153.2 symbols/min [2025-10-13T22:34:41.240571] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:41.271485] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:41.272394] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-13T22:34:41.272582] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-13T22:34:41.307720] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-13T22:34:41.307991] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-13T22:34:41.310937] [INFO ] [MAIN ] Derivative Progress: 156/1810 symbols completed. BABA took 1.1s. Estimated remaining: 10m 44s. Rate: 154.0 symbols/min [2025-10-13T22:34:41.312067] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-13T22:34:41.324258] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-13T22:34:41.324440] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:41.468130] [DEBUG] [LOCAL ] BAK: Loaded 39338 existing records from primary storage. [2025-10-13T22:34:41.498625] [INFO ] [MAIN ] BAK: Loaded 39338 primary data records. [2025-10-13T22:34:41.788768] [DEBUG] [LOCAL ] BALL: Loaded 51851 existing records from primary storage. [2025-10-13T22:34:41.809974] [INFO ] [MAIN ] BALL: Loaded 51851 primary data records. [2025-10-13T22:34:42.375936] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:42.377465] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-13T22:34:42.378334] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-13T22:34:42.399017] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-13T22:34:42.399131] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-13T22:34:42.401550] [INFO ] [MAIN ] Derivative Progress: 157/1810 symbols completed. BAC took 1.2s. Estimated remaining: 10m 51s. Rate: 152.3 symbols/min [2025-10-13T22:34:42.401961] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:42.423896] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:42.424910] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39338 primary records. [2025-10-13T22:34:42.425064] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-13T22:34:42.459630] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:42.477585] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51851 primary records. [2025-10-13T22:34:42.476184] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-13T22:34:42.477908] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-13T22:34:42.477826] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-13T22:34:42.482290] [INFO ] [MAIN ] Derivative Progress: 158/1810 symbols completed. BAK took 1.2s. Estimated remaining: 10m 48s. Rate: 153.1 symbols/min [2025-10-13T22:34:42.482577] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:42.503840] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-13T22:34:42.518390] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-13T22:34:42.522168] [INFO ] [MAIN ] Derivative Progress: 159/1810 symbols completed. BALL took 1.2s. Estimated remaining: 10m 44s. Rate: 153.9 symbols/min [2025-10-13T22:34:42.522561] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:42.523461] [DEBUG] [LOCAL ] BANC: Loaded 51326 existing records from primary storage. [2025-10-13T22:34:42.524337] [INFO ] [MAIN ] BANC: Loaded 51326 primary data records. [2025-10-13T22:34:42.701137] [DEBUG] [LOCAL ] BAP: Loaded 25796 existing records from primary storage. [2025-10-13T22:34:42.736529] [INFO ] [MAIN ] BAP: Loaded 25796 primary data records. [2025-10-13T22:34:42.950191] [DEBUG] [LOCAL ] BARK: Loaded 38175 existing records from primary storage. [2025-10-13T22:34:42.950509] [INFO ] [MAIN ] BARK: Loaded 38175 primary data records. [2025-10-13T22:34:43.783378] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:43.785957] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51326 primary records. [2025-10-13T22:34:43.786605] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-13T22:34:43.817341] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-13T22:34:43.818282] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-13T22:34:43.821520] [INFO ] [MAIN ] Derivative Progress: 160/1810 symbols completed. BANC took 1.4s. Estimated remaining: 10m 52s. Rate: 151.7 symbols/min [2025-10-13T22:34:43.822287] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:43.842915] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:43.845515] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38175 primary records. [2025-10-13T22:34:43.845786] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-13T22:34:43.872211] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:43.876270] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25796 primary records. [2025-10-13T22:34:43.877348] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-13T22:34:43.878171] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-13T22:34:43.878254] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-13T22:34:43.881624] [INFO ] [MAIN ] Derivative Progress: 161/1810 symbols completed. BARK took 1.4s. Estimated remaining: 10m 49s. Rate: 152.5 symbols/min [2025-10-13T22:34:43.882507] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:43.900109] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-13T22:34:43.900354] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-13T22:34:43.903847] [INFO ] [MAIN ] Derivative Progress: 162/1810 symbols completed. BAP took 1.4s. Estimated remaining: 10m 44s. Rate: 153.4 symbols/min [2025-10-13T22:34:43.904070] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:43.966051] [DEBUG] [LOCAL ] BAX: Loaded 53520 existing records from primary storage. [2025-10-13T22:34:43.966378] [INFO ] [MAIN ] BAX: Loaded 53520 primary data records. [2025-10-13T22:34:44.103933] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-13T22:34:44.120368] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-13T22:34:44.440143] [DEBUG] [LOCAL ] BB: Loaded 52937 existing records from primary storage. [2025-10-13T22:34:44.466489] [INFO ] [MAIN ] BB: Loaded 52937 primary data records. [2025-10-13T22:34:45.011636] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:45.013266] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53520 primary records. [2025-10-13T22:34:45.013878] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-13T22:34:45.048494] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:45.051006] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-13T22:34:45.051701] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-13T22:34:45.053288] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-13T22:34:45.054186] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-13T22:34:45.064761] [INFO ] [MAIN ] Derivative Progress: 163/1810 symbols completed. BAX took 1.2s. Estimated remaining: 10m 52s. Rate: 151.6 symbols/min [2025-10-13T22:34:45.074634] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-13T22:34:45.074922] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-13T22:34:45.078049] [INFO ] [MAIN ] Derivative Progress: 164/1810 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 48s. Rate: 152.5 symbols/min [2025-10-13T22:34:45.093783] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:45.094377] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52937 primary records. [2025-10-13T22:34:45.094439] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-13T22:34:45.109912] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-13T22:34:45.110007] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-13T22:34:45.113116] [INFO ] [MAIN ] Derivative Progress: 165/1810 symbols completed. BB took 1.2s. Estimated remaining: 10m 44s. Rate: 153.3 symbols/min [2025-10-13T22:34:45.114002] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:45.114166] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:45.113895] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:45.173699] [DEBUG] [LOCAL ] BBDC: Loaded 33121 existing records from primary storage. [2025-10-13T22:34:45.174034] [INFO ] [MAIN ] BBDC: Loaded 33121 primary data records. [2025-10-13T22:34:45.290288] [DEBUG] [LOCAL ] BBD: Loaded 53253 existing records from primary storage. [2025-10-13T22:34:45.315250] [DEBUG] [LOCAL ] BBAR: Loaded 42127 existing records from primary storage. [2025-10-13T22:34:45.314421] [INFO ] [MAIN ] BBD: Loaded 53253 primary data records. [2025-10-13T22:34:45.326684] [INFO ] [MAIN ] BBAR: Loaded 42127 primary data records. [2025-10-13T22:34:46.203251] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:46.205068] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33121 primary records. [2025-10-13T22:34:46.206341] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-13T22:34:46.224820] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-13T22:34:46.224986] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-13T22:34:46.228080] [INFO ] [MAIN ] Derivative Progress: 166/1810 symbols completed. BBDC took 1.1s. Estimated remaining: 10m 50s. Rate: 151.6 symbols/min [2025-10-13T22:34:46.228452] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:46.246739] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:46.248972] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53253 primary records. [2025-10-13T22:34:46.265971] [DEBUG] [LOCAL ] BBDO: Loaded 5048 existing records from primary storage. [2025-10-13T22:34:46.266350] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:46.249462] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-13T22:34:46.267673] [INFO ] [MAIN ] BBDO: Loaded 5048 primary data records. [2025-10-13T22:34:46.267443] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 42127 primary records. [2025-10-13T22:34:46.280765] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-13T22:34:46.398396] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-13T22:34:46.422532] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-13T22:34:46.426894] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-13T22:34:46.430064] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-13T22:34:46.429979] [INFO ] [MAIN ] Derivative Progress: 167/1810 symbols completed. BBD took 1.3s. Estimated remaining: 10m 48s. Rate: 152.1 symbols/min [2025-10-13T22:34:46.433539] [INFO ] [MAIN ] Derivative Progress: 168/1810 symbols completed. BBAR took 1.3s. Estimated remaining: 10m 44s. Rate: 153.0 symbols/min [2025-10-13T22:34:46.430304] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:46.455370] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:46.692964] [DEBUG] [LOCAL ] BBU: Loaded 5248 existing records from primary storage. [2025-10-13T22:34:46.693271] [INFO ] [MAIN ] BBU: Loaded 5248 primary data records. [2025-10-13T22:34:46.765079] [DEBUG] [LOCAL ] BBN: Loaded 18055 existing records from primary storage. [2025-10-13T22:34:46.795862] [INFO ] [MAIN ] BBN: Loaded 18055 primary data records. [2025-10-13T22:34:47.387318] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:47.388820] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5048 primary records. [2025-10-13T22:34:47.388968] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-13T22:34:47.406390] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-13T22:34:47.406874] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-13T22:34:47.409262] [INFO ] [MAIN ] Derivative Progress: 169/1810 symbols completed. BBDO took 1.2s. Estimated remaining: 10m 49s. Rate: 151.7 symbols/min [2025-10-13T22:34:47.409684] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:47.429549] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:47.431334] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 5248 primary records. [2025-10-13T22:34:47.431552] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-13T22:34:47.454846] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:47.460127] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18055 primary records. [2025-10-13T22:34:47.460526] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-13T22:34:47.463341] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-13T22:34:47.464130] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-13T22:34:47.467581] [INFO ] [MAIN ] Derivative Progress: 170/1810 symbols completed. BBU took 1.0s. Estimated remaining: 10m 46s. Rate: 152.4 symbols/min [2025-10-13T22:34:47.468239] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:47.484968] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-13T22:34:47.496904] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-13T22:34:47.500879] [INFO ] [MAIN ] Derivative Progress: 171/1810 symbols completed. BBN took 1.1s. Estimated remaining: 10m 42s. Rate: 153.2 symbols/min [2025-10-13T22:34:47.501125] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:47.529195] [DEBUG] [LOCAL ] BBVA: Loaded 49136 existing records from primary storage. [2025-10-13T22:34:47.529507] [INFO ] [MAIN ] BBVA: Loaded 49136 primary data records. [2025-10-13T22:34:47.630233] [DEBUG] [LOCAL ] BBW: Loaded 27362 existing records from primary storage. [2025-10-13T22:34:47.648732] [INFO ] [MAIN ] BBW: Loaded 27362 primary data records. [2025-10-13T22:34:48.013379] [DEBUG] [LOCAL ] BBWI: Loaded 53583 existing records from primary storage. [2025-10-13T22:34:48.045074] [INFO ] [MAIN ] BBWI: Loaded 53583 primary data records. [2025-10-13T22:34:48.640293] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:48.642826] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49136 primary records. [2025-10-13T22:34:48.643175] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-13T22:34:48.663986] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-13T22:34:48.664112] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-13T22:34:48.666433] [INFO ] [MAIN ] Derivative Progress: 172/1810 symbols completed. BBVA took 1.3s. Estimated remaining: 10m 49s. Rate: 151.5 symbols/min [2025-10-13T22:34:48.666754] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:48.686843] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:48.688042] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27362 primary records. [2025-10-13T22:34:48.688285] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-13T22:34:48.705843] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-13T22:34:48.706112] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-13T22:34:48.709595] [INFO ] [MAIN ] Derivative Progress: 173/1810 symbols completed. BBW took 1.2s. Estimated remaining: 10m 45s. Rate: 152.3 symbols/min [2025-10-13T22:34:48.710381] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:48.742397] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:48.743325] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53583 primary records. [2025-10-13T22:34:48.743490] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-13T22:34:48.782591] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-13T22:34:48.783899] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-13T22:34:48.783692] [DEBUG] [LOCAL ] BBY: Loaded 53453 existing records from primary storage. [2025-10-13T22:34:48.784127] [INFO ] [MAIN ] BBY: Loaded 53453 primary data records. [2025-10-13T22:34:48.788039] [INFO ] [MAIN ] Derivative Progress: 174/1810 symbols completed. BBWI took 1.3s. Estimated remaining: 10m 42s. Rate: 153.0 symbols/min [2025-10-13T22:34:48.788341] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:48.947870] [DEBUG] [LOCAL ] BC: Loaded 44145 existing records from primary storage. [2025-10-13T22:34:48.975550] [INFO ] [MAIN ] BC: Loaded 44145 primary data records. [2025-10-13T22:34:49.282022] [DEBUG] [LOCAL ] BCAT: Loaded 34066 existing records from primary storage. [2025-10-13T22:34:49.303805] [INFO ] [MAIN ] BCAT: Loaded 34066 primary data records. [2025-10-13T22:34:49.798422] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:49.800283] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53453 primary records. [2025-10-13T22:34:49.801134] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-13T22:34:49.824892] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-13T22:34:49.825466] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-13T22:34:49.828928] [INFO ] [MAIN ] Derivative Progress: 175/1810 symbols completed. BBY took 1.2s. Estimated remaining: 10m 47s. Rate: 151.6 symbols/min [2025-10-13T22:34:49.837315] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:49.843528] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:49.845121] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44145 primary records. [2025-10-13T22:34:49.845490] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-13T22:34:49.879908] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:49.879487] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-13T22:34:49.880862] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34066 primary records. [2025-10-13T22:34:49.891098] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-13T22:34:49.891211] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-13T22:34:49.895566] [INFO ] [MAIN ] Derivative Progress: 176/1810 symbols completed. BC took 1.2s. Estimated remaining: 10m 44s. Rate: 152.3 symbols/min [2025-10-13T22:34:49.907399] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:49.927037] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-13T22:34:49.926928] [DEBUG] [LOCAL ] BCH: Loaded 30043 existing records from primary storage. [2025-10-13T22:34:49.927372] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-13T22:34:49.927589] [INFO ] [MAIN ] BCH: Loaded 30043 primary data records. [2025-10-13T22:34:49.930841] [INFO ] [MAIN ] Derivative Progress: 177/1810 symbols completed. BCAT took 1.1s. Estimated remaining: 10m 40s. Rate: 153.1 symbols/min [2025-10-13T22:34:49.931208] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:50.092046] [DEBUG] [LOCAL ] BCO: Loaded 25559 existing records from primary storage. [2025-10-13T22:34:50.108604] [INFO ] [MAIN ] BCO: Loaded 25559 primary data records. [2025-10-13T22:34:50.479725] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-13T22:34:50.496338] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-13T22:34:51.049070] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:51.050405] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 30043 primary records. [2025-10-13T22:34:51.050536] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-13T22:34:51.068065] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-13T22:34:51.068233] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-13T22:34:51.070789] [INFO ] [MAIN ] Derivative Progress: 178/1810 symbols completed. BCH took 1.2s. Estimated remaining: 10m 47s. Rate: 151.4 symbols/min [2025-10-13T22:34:51.088273] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:51.089119] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25559 primary records. [2025-10-13T22:34:51.089264] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-13T22:34:51.107333] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-13T22:34:51.107514] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-13T22:34:51.110700] [INFO ] [MAIN ] Derivative Progress: 179/1810 symbols completed. BCO took 1.2s. Estimated remaining: 10m 43s. Rate: 152.2 symbols/min [2025-10-13T22:34:51.123227] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:51.123824] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53441 primary records. [2025-10-13T22:34:51.123883] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-13T22:34:51.142473] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-13T22:34:51.142616] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-13T22:34:51.146226] [INFO ] [MAIN ] Derivative Progress: 180/1810 symbols completed. BCS took 1.2s. Estimated remaining: 10m 39s. Rate: 153.0 symbols/min [2025-10-13T22:34:51.146705] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:51.146813] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:51.146627] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:51.195840] [DEBUG] [LOCAL ] BDC: Loaded 24544 existing records from primary storage. [2025-10-13T22:34:51.197231] [INFO ] [MAIN ] BDC: Loaded 24544 primary data records. [2025-10-13T22:34:51.213237] [DEBUG] [LOCAL ] BDJ: Loaded 29388 existing records from primary storage. [2025-10-13T22:34:51.213435] [INFO ] [MAIN ] BDJ: Loaded 29388 primary data records. [2025-10-13T22:34:51.224700] [DEBUG] [LOCAL ] BCSF: Loaded 28213 existing records from primary storage. [2025-10-13T22:34:51.245678] [INFO ] [MAIN ] BCSF: Loaded 28213 primary data records. [2025-10-13T22:34:52.173418] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:52.175414] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24544 primary records. [2025-10-13T22:34:52.176069] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-13T22:34:52.220722] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:52.222462] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 28213 primary records. [2025-10-13T22:34:52.221143] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:52.223174] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29388 primary records. [2025-10-13T22:34:52.224000] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-13T22:34:52.224205] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-13T22:34:52.224122] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-13T22:34:52.224332] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-13T22:34:52.227781] [INFO ] [MAIN ] Derivative Progress: 181/1810 symbols completed. BDC took 1.1s. Estimated remaining: 10m 45s. Rate: 151.5 symbols/min [2025-10-13T22:34:52.227999] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:52.258494] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-13T22:34:52.259020] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-13T22:34:52.262733] [INFO ] [MAIN ] Derivative Progress: 182/1810 symbols completed. BCSF took 1.1s. Estimated remaining: 10m 41s. Rate: 152.3 symbols/min [2025-10-13T22:34:52.262901] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:52.265423] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-13T22:34:52.265497] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-13T22:34:52.268603] [INFO ] [MAIN ] Derivative Progress: 183/1810 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 38s. Rate: 153.1 symbols/min [2025-10-13T22:34:52.268861] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:52.326699] [DEBUG] [LOCAL ] BDN: Loaded 47607 existing records from primary storage. [2025-10-13T22:34:52.326924] [INFO ] [MAIN ] BDN: Loaded 47607 primary data records. [2025-10-13T22:34:52.465938] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-13T22:34:52.471869] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-13T22:34:52.608529] [DEBUG] [LOCAL ] BDX: Loaded 52183 existing records from primary storage. [2025-10-13T22:34:52.620437] [INFO ] [MAIN ] BDX: Loaded 52183 primary data records. [2025-10-13T22:34:53.384587] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:53.385996] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47607 primary records. [2025-10-13T22:34:53.386512] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-13T22:34:53.420749] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-13T22:34:53.421050] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-13T22:34:53.415888] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:53.423149] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53661 primary records. [2025-10-13T22:34:53.425501] [INFO ] [MAIN ] Derivative Progress: 184/1810 symbols completed. BDN took 1.2s. Estimated remaining: 10m 44s. Rate: 151.5 symbols/min [2025-10-13T22:34:53.427246] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:53.426394] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-13T22:34:53.457866] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-13T22:34:53.458580] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-13T22:34:53.462923] [INFO ] [MAIN ] Derivative Progress: 185/1810 symbols completed. BE took 1.2s. Estimated remaining: 10m 40s. Rate: 152.2 symbols/min [2025-10-13T22:34:53.458447] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:53.463303] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:53.464190] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52183 primary records. [2025-10-13T22:34:53.465034] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-13T22:34:53.482415] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-13T22:34:53.482637] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-13T22:34:53.485956] [INFO ] [MAIN ] Derivative Progress: 186/1810 symbols completed. BDX took 1.2s. Estimated remaining: 10m 37s. Rate: 153.0 symbols/min [2025-10-13T22:34:53.486277] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:53.557207] [DEBUG] [LOCAL ] BEKE: Loaded 53220 existing records from primary storage. [2025-10-13T22:34:53.557547] [INFO ] [MAIN ] BEKE: Loaded 53220 primary data records. [2025-10-13T22:34:53.703427] [DEBUG] [LOCAL ] BEP: Loaded 38934 existing records from primary storage. [2025-10-13T22:34:53.704688] [INFO ] [MAIN ] BEP: Loaded 38934 primary data records. [2025-10-13T22:34:53.704547] [DEBUG] [LOCAL ] BEN: Loaded 53109 existing records from primary storage. [2025-10-13T22:34:53.762446] [INFO ] [MAIN ] BEN: Loaded 53109 primary data records. [2025-10-13T22:34:54.629741] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:54.630524] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53220 primary records. [2025-10-13T22:34:54.630874] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-13T22:34:54.648084] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-13T22:34:54.648324] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-13T22:34:54.650466] [INFO ] [MAIN ] Derivative Progress: 187/1810 symbols completed. BEKE took 1.2s. Estimated remaining: 10m 43s. Rate: 151.4 symbols/min [2025-10-13T22:34:54.650866] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:54.670675] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:54.680722] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38934 primary records. [2025-10-13T22:34:54.685973] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:54.686088] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-13T22:34:54.687023] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53109 primary records. [2025-10-13T22:34:54.687473] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-13T22:34:54.699477] [DEBUG] [LOCAL ] BEPH: Loaded 5283 existing records from primary storage. [2025-10-13T22:34:54.711704] [INFO ] [MAIN ] BEPH: Loaded 5283 primary data records. [2025-10-13T22:34:54.751760] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-13T22:34:54.764887] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-13T22:34:54.788902] [INFO ] [MAIN ] Derivative Progress: 188/1810 symbols completed. BEN took 1.3s. Estimated remaining: 10m 41s. Rate: 151.9 symbols/min [2025-10-13T22:34:54.795384] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-13T22:34:54.789506] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:54.795576] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-13T22:34:54.810136] [INFO ] [MAIN ] Derivative Progress: 189/1810 symbols completed. BEP took 1.3s. Estimated remaining: 10m 37s. Rate: 152.7 symbols/min [2025-10-13T22:34:54.832077] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:54.877497] [DEBUG] [LOCAL ] BEPI: Loaded 3617 existing records from primary storage. [2025-10-13T22:34:54.883128] [INFO ] [MAIN ] BEPI: Loaded 3617 primary data records. [2025-10-13T22:34:55.106561] [DEBUG] [LOCAL ] BEPJ: Loaded 3122 existing records from primary storage. [2025-10-13T22:34:55.125089] [INFO ] [MAIN ] BEPJ: Loaded 3122 primary data records. [2025-10-13T22:34:55.703321] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:55.704370] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5283 primary records. [2025-10-13T22:34:55.704726] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-13T22:34:55.721261] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-13T22:34:55.721453] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-13T22:34:55.724214] [INFO ] [MAIN ] Derivative Progress: 190/1810 symbols completed. BEPH took 1.1s. Estimated remaining: 10m 41s. Rate: 151.6 symbols/min [2025-10-13T22:34:55.724455] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:55.756454] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:55.756900] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:55.758616] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3617 primary records. [2025-10-13T22:34:55.757780] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3122 primary records. [2025-10-13T22:34:55.758881] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-13T22:34:55.759355] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-13T22:34:55.787164] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-13T22:34:55.787337] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-13T22:34:55.791902] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-13T22:34:55.791770] [INFO ] [MAIN ] Derivative Progress: 191/1810 symbols completed. BEPJ took 1.0s. Estimated remaining: 10m 38s. Rate: 152.3 symbols/min [2025-10-13T22:34:55.792241] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-13T22:34:55.792414] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:55.795717] [INFO ] [MAIN ] Derivative Progress: 192/1810 symbols completed. BEPI took 1.0s. Estimated remaining: 10m 34s. Rate: 153.1 symbols/min [2025-10-13T22:34:55.795915] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:55.820729] [DEBUG] [LOCAL ] BFK: Loaded 13519 existing records from primary storage. [2025-10-13T22:34:55.821451] [INFO ] [MAIN ] BFK: Loaded 13519 primary data records. [2025-10-13T22:34:55.902589] [DEBUG] [LOCAL ] BFAM: Loaded 33707 existing records from primary storage. [2025-10-13T22:34:55.913952] [INFO ] [MAIN ] BFAM: Loaded 33707 primary data records. [2025-10-13T22:34:56.154418] [DEBUG] [LOCAL ] BFH: Loaded 41480 existing records from primary storage. [2025-10-13T22:34:56.304625] [INFO ] [MAIN ] BFH: Loaded 41480 primary data records. [2025-10-13T22:34:56.879190] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:56.881520] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13519 primary records. [2025-10-13T22:34:56.881835] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-13T22:34:56.903680] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:56.908432] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33707 primary records. [2025-10-13T22:34:56.912589] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-13T22:34:56.912847] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-13T22:34:56.912712] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-13T22:34:56.915876] [INFO ] [MAIN ] Derivative Progress: 193/1810 symbols completed. BFK took 1.1s. Estimated remaining: 10m 40s. Rate: 151.6 symbols/min [2025-10-13T22:34:56.934939] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-13T22:34:56.947571] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-13T22:34:56.947513] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:56.951200] [INFO ] [MAIN ] Derivative Progress: 194/1810 symbols completed. BFAM took 1.2s. Estimated remaining: 10m 36s. Rate: 152.4 symbols/min [2025-10-13T22:34:56.948308] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41480 primary records. [2025-10-13T22:34:56.951422] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-13T22:34:56.966932] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-13T22:34:56.966991] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-13T22:34:56.970112] [INFO ] [MAIN ] Derivative Progress: 195/1810 symbols completed. BFH took 1.2s. Estimated remaining: 10m 33s. Rate: 153.1 symbols/min [2025-10-13T22:34:56.970526] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:56.970719] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:56.970632] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:56.984905] [DEBUG] [LOCAL ] BFS: Loaded 9473 existing records from primary storage. [2025-10-13T22:34:56.985148] [INFO ] [MAIN ] BFS: Loaded 9473 primary data records. [2025-10-13T22:34:57.044311] [DEBUG] [LOCAL ] BFZ: Loaded 11930 existing records from primary storage. [2025-10-13T22:34:57.070119] [INFO ] [MAIN ] BFZ: Loaded 11930 primary data records. [2025-10-13T22:34:57.495204] [DEBUG] [LOCAL ] BFLY: Loaded 51828 existing records from primary storage. [2025-10-13T22:34:57.496285] [INFO ] [MAIN ] BFLY: Loaded 51828 primary data records. [2025-10-13T22:34:57.945593] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:57.946905] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9473 primary records. [2025-10-13T22:34:57.960499] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:57.959365] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-13T22:34:57.971429] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11930 primary records. [2025-10-13T22:34:57.973055] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-13T22:34:57.993882] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-13T22:34:57.994379] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-13T22:34:57.998275] [INFO ] [MAIN ] Derivative Progress: 196/1810 symbols completed. BFZ took 1.0s. Estimated remaining: 10m 38s. Rate: 151.8 symbols/min [2025-10-13T22:34:58.000171] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:58.000036] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-13T22:34:58.001058] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-13T22:34:58.003539] [INFO ] [MAIN ] Derivative Progress: 197/1810 symbols completed. BFS took 1.0s. Estimated remaining: 10m 34s. Rate: 152.6 symbols/min [2025-10-13T22:34:58.003782] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:58.020810] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:58.021698] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51828 primary records. [2025-10-13T22:34:58.021761] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-13T22:34:58.042811] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-13T22:34:58.043069] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-13T22:34:58.046407] [INFO ] [MAIN ] Derivative Progress: 198/1810 symbols completed. BFLY took 1.1s. Estimated remaining: 10m 31s. Rate: 153.3 symbols/min [2025-10-13T22:34:58.046667] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:58.054025] [DEBUG] [LOCAL ] BGB: Loaded 18070 existing records from primary storage. [2025-10-13T22:34:58.054157] [INFO ] [MAIN ] BGB: Loaded 18070 primary data records. [2025-10-13T22:34:58.182119] [DEBUG] [LOCAL ] BGH: Loaded 17259 existing records from primary storage. [2025-10-13T22:34:58.198886] [INFO ] [MAIN ] BGH: Loaded 17259 primary data records. [2025-10-13T22:34:58.486549] [DEBUG] [LOCAL ] BG: Loaded 50492 existing records from primary storage. [2025-10-13T22:34:58.493042] [INFO ] [MAIN ] BG: Loaded 50492 primary data records. [2025-10-13T22:34:59.055537] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:59.057742] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 18070 primary records. [2025-10-13T22:34:59.058896] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-13T22:34:59.088564] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:59.091552] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17259 primary records. [2025-10-13T22:34:59.092744] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-13T22:34:59.092148] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-13T22:34:59.093693] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-13T22:34:59.097963] [INFO ] [MAIN ] Derivative Progress: 199/1810 symbols completed. BGB took 1.1s. Estimated remaining: 10m 36s. Rate: 152.0 symbols/min [2025-10-13T22:34:59.105475] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:59.124602] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:34:59.128235] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-13T22:34:59.129235] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50492 primary records. [2025-10-13T22:34:59.129336] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-13T22:34:59.131793] [INFO ] [MAIN ] Derivative Progress: 200/1810 symbols completed. BGH took 1.1s. Estimated remaining: 10m 33s. Rate: 152.7 symbols/min [2025-10-13T22:34:59.132056] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:59.132273] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-13T22:34:59.156328] [DEBUG] [LOCAL ] BGR: Loaded 13557 existing records from primary storage. [2025-10-13T22:34:59.156686] [INFO ] [MAIN ] BGR: Loaded 13557 primary data records. [2025-10-13T22:34:59.213283] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-13T22:34:59.233423] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-13T22:34:59.241872] [INFO ] [MAIN ] Derivative Progress: 201/1810 symbols completed. BG took 1.2s. Estimated remaining: 10m 30s. Rate: 153.3 symbols/min [2025-10-13T22:34:59.252688] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:34:59.474873] [DEBUG] [LOCAL ] BGSF: Loaded 7846 existing records from primary storage. [2025-10-13T22:34:59.491046] [INFO ] [MAIN ] BGSF: Loaded 7846 primary data records. [2025-10-13T22:34:59.523725] [DEBUG] [LOCAL ] BGS: Loaded 50490 existing records from primary storage. [2025-10-13T22:34:59.557678] [INFO ] [MAIN ] BGS: Loaded 50490 primary data records. [2025-10-13T22:35:00.151335] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:00.153052] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13557 primary records. [2025-10-13T22:35:00.153340] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-13T22:35:00.173224] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-13T22:35:00.173748] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-13T22:35:00.176921] [INFO ] [MAIN ] Derivative Progress: 202/1810 symbols completed. BGR took 1.1s. Estimated remaining: 10m 34s. Rate: 152.2 symbols/min [2025-10-13T22:35:00.177489] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:00.225150] [DEBUG] [LOCAL ] BGT: Loaded 16534 existing records from primary storage. [2025-10-13T22:35:00.226246] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:00.228435] [INFO ] [MAIN ] BGT: Loaded 16534 primary data records. [2025-10-13T22:35:00.227776] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7846 primary records. [2025-10-13T22:35:00.228308] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:00.228701] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-13T22:35:00.241310] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50490 primary records. [2025-10-13T22:35:00.251583] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-13T22:35:00.375509] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-13T22:35:00.380801] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-13T22:35:00.370149] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-13T22:35:00.421804] [INFO ] [MAIN ] Derivative Progress: 203/1810 symbols completed. BGS took 1.3s. Estimated remaining: 10m 32s. Rate: 152.5 symbols/min [2025-10-13T22:35:00.448474] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:00.448346] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-13T22:35:00.455098] [INFO ] [MAIN ] Derivative Progress: 204/1810 symbols completed. BGSF took 1.2s. Estimated remaining: 10m 29s. Rate: 153.2 symbols/min [2025-10-13T22:35:00.455472] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:00.603480] [DEBUG] [LOCAL ] BH: Loaded 16227 existing records from primary storage. [2025-10-13T22:35:00.603755] [INFO ] [MAIN ] BH: Loaded 16227 primary data records. [2025-10-13T22:35:00.616801] [DEBUG] [LOCAL ] BGY: Loaded 22024 existing records from primary storage. [2025-10-13T22:35:00.628681] [INFO ] [MAIN ] BGY: Loaded 22024 primary data records. [2025-10-13T22:35:01.193560] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:01.325079] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16534 primary records. [2025-10-13T22:35:01.326968] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-13T22:35:01.351302] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-13T22:35:01.352250] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-13T22:35:01.355165] [INFO ] [MAIN ] Derivative Progress: 205/1810 symbols completed. BGT took 1.2s. Estimated remaining: 10m 33s. Rate: 152.2 symbols/min [2025-10-13T22:35:01.355603] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:01.375745] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:01.376700] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16227 primary records. [2025-10-13T22:35:01.377020] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-13T22:35:01.394888] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-13T22:35:01.408887] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-13T22:35:01.411747] [INFO ] [MAIN ] Derivative Progress: 206/1810 symbols completed. BH took 1.0s. Estimated remaining: 10m 30s. Rate: 152.9 symbols/min [2025-10-13T22:35:01.412136] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:01.425465] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:01.426208] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22024 primary records. [2025-10-13T22:35:01.426389] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-13T22:35:01.442730] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-13T22:35:01.442819] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-13T22:35:01.446431] [INFO ] [MAIN ] Derivative Progress: 207/1810 symbols completed. BGY took 1.0s. Estimated remaining: 10m 26s. Rate: 153.5 symbols/min [2025-10-13T22:35:01.446689] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:01.462154] [DEBUG] [LOCAL ] BHC: Loaded 46690 existing records from primary storage. [2025-10-13T22:35:01.462499] [INFO ] [MAIN ] BHC: Loaded 46690 primary data records. [2025-10-13T22:35:01.605715] [DEBUG] [LOCAL ] BHE: Loaded 23897 existing records from primary storage. [2025-10-13T22:35:01.605988] [INFO ] [MAIN ] BHE: Loaded 23897 primary data records. [2025-10-13T22:35:01.756712] [DEBUG] [LOCAL ] BHK: Loaded 23543 existing records from primary storage. [2025-10-13T22:35:01.790908] [INFO ] [MAIN ] BHK: Loaded 23543 primary data records. [2025-10-13T22:35:02.541353] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:02.542469] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46690 primary records. [2025-10-13T22:35:02.543782] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-13T22:35:02.577213] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:02.578746] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 23897 primary records. [2025-10-13T22:35:02.579152] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-13T22:35:02.579596] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-13T22:35:02.581023] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-13T22:35:02.584709] [INFO ] [MAIN ] Derivative Progress: 208/1810 symbols completed. BHC took 1.2s. Estimated remaining: 10m 32s. Rate: 152.1 symbols/min [2025-10-13T22:35:02.615671] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-13T22:35:02.616259] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:02.617011] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23543 primary records. [2025-10-13T22:35:02.617074] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-13T22:35:02.617185] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-13T22:35:02.620572] [INFO ] [MAIN ] Derivative Progress: 209/1810 symbols completed. BHE took 1.2s. Estimated remaining: 10m 29s. Rate: 152.8 symbols/min [2025-10-13T22:35:02.637519] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-13T22:35:02.637594] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-13T22:35:02.641287] [INFO ] [MAIN ] Derivative Progress: 210/1810 symbols completed. BHK took 1.2s. Estimated remaining: 10m 25s. Rate: 153.5 symbols/min [2025-10-13T22:35:02.641798] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:02.641954] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:02.641914] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:02.666767] [DEBUG] [LOCAL ] BHR: Loaded 22109 existing records from primary storage. [2025-10-13T22:35:02.666929] [INFO ] [MAIN ] BHR: Loaded 22109 primary data records. [2025-10-13T22:35:02.895243] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-13T22:35:03.107277] [INFO ] [MAIN ] BHP: Loaded 53373 primary data records. [2025-10-13T22:35:03.144372] [DEBUG] [LOCAL ] BHVN: Loaded 50396 existing records from primary storage. [2025-10-13T22:35:03.159965] [INFO ] [MAIN ] BHVN: Loaded 50396 primary data records. [2025-10-13T22:35:03.769396] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:03.770917] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 22109 primary records. [2025-10-13T22:35:03.771517] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-13T22:35:03.788852] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-13T22:35:03.789293] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-13T22:35:03.792118] [INFO ] [MAIN ] Derivative Progress: 211/1810 symbols completed. BHR took 1.2s. Estimated remaining: 10m 31s. Rate: 152.1 symbols/min [2025-10-13T22:35:03.792294] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:03.811397] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:03.812607] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53373 primary records. [2025-10-13T22:35:03.812805] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-13T22:35:03.831907] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-13T22:35:03.832193] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-13T22:35:03.834764] [INFO ] [MAIN ] Derivative Progress: 212/1810 symbols completed. BHP took 1.2s. Estimated remaining: 10m 28s. Rate: 152.7 symbols/min [2025-10-13T22:35:03.835161] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:03.849307] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:03.850275] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50396 primary records. [2025-10-13T22:35:03.850418] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-13T22:35:03.881270] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-13T22:35:03.881346] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-13T22:35:03.884755] [INFO ] [MAIN ] Derivative Progress: 213/1810 symbols completed. BHVN took 1.2s. Estimated remaining: 10m 25s. Rate: 153.4 symbols/min [2025-10-13T22:35:03.884974] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:03.915194] [DEBUG] [LOCAL ] BILL: Loaded 52444 existing records from primary storage. [2025-10-13T22:35:03.915480] [INFO ] [MAIN ] BILL: Loaded 52444 primary data records. [2025-10-13T22:35:04.059318] [DEBUG] [LOCAL ] BIP: Loaded 39207 existing records from primary storage. [2025-10-13T22:35:04.086469] [INFO ] [MAIN ] BIP: Loaded 39207 primary data records. [2025-10-13T22:35:04.159159] [DEBUG] [LOCAL ] BIPC: Loaded 41208 existing records from primary storage. [2025-10-13T22:35:04.197356] [INFO ] [MAIN ] BIPC: Loaded 41208 primary data records. [2025-10-13T22:35:04.955146] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:04.956535] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52444 primary records. [2025-10-13T22:35:04.957219] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-13T22:35:04.977389] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-13T22:35:04.977493] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-13T22:35:04.979807] [INFO ] [MAIN ] Derivative Progress: 214/1810 symbols completed. BILL took 1.2s. Estimated remaining: 10m 30s. Rate: 152.1 symbols/min [2025-10-13T22:35:04.980229] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:04.996569] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:04.999476] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39207 primary records. [2025-10-13T22:35:04.999627] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-13T22:35:05.011109] [DEBUG] [LOCAL ] BIPH: Loaded 2553 existing records from primary storage. [2025-10-13T22:35:05.016763] [INFO ] [MAIN ] BIPH: Loaded 2553 primary data records. [2025-10-13T22:35:05.033279] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-13T22:35:05.097117] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-13T22:35:05.103171] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:05.121006] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41208 primary records. [2025-10-13T22:35:05.140744] [INFO ] [MAIN ] Derivative Progress: 215/1810 symbols completed. BIP took 1.3s. Estimated remaining: 10m 28s. Rate: 152.5 symbols/min [2025-10-13T22:35:05.141045] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-13T22:35:05.141602] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:05.430705] [DEBUG] [LOCAL ] BIPI: Loaded 3114 existing records from primary storage. [2025-10-13T22:35:05.430832] [INFO ] [MAIN ] BIPI: Loaded 3114 primary data records. [2025-10-13T22:35:05.427799] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-13T22:35:05.442235] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-13T22:35:05.466245] [INFO ] [MAIN ] Derivative Progress: 216/1810 symbols completed. BIPC took 1.6s. Estimated remaining: 10m 27s. Rate: 152.6 symbols/min [2025-10-13T22:35:05.478887] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:05.576575] [DEBUG] [LOCAL ] BIPJ: Loaded 3168 existing records from primary storage. [2025-10-13T22:35:05.605970] [INFO ] [MAIN ] BIPJ: Loaded 3168 primary data records. [2025-10-13T22:35:06.068732] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:06.071408] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2553 primary records. [2025-10-13T22:35:06.071755] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-13T22:35:06.090190] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-13T22:35:06.090494] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-13T22:35:06.093355] [INFO ] [MAIN ] Derivative Progress: 217/1810 symbols completed. BIPH took 1.1s. Estimated remaining: 10m 28s. Rate: 152.2 symbols/min [2025-10-13T22:35:06.093566] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:06.111750] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:06.112693] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3114 primary records. [2025-10-13T22:35:06.112780] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-13T22:35:06.127844] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-13T22:35:06.127912] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-13T22:35:06.130834] [INFO ] [MAIN ] Derivative Progress: 218/1810 symbols completed. BIPI took 1.0s. Estimated remaining: 10m 25s. Rate: 152.8 symbols/min [2025-10-13T22:35:06.130977] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:06.149280] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:06.149974] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3168 primary records. [2025-10-13T22:35:06.150211] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-13T22:35:06.170580] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-13T22:35:06.170769] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-13T22:35:06.174263] [INFO ] [MAIN ] Derivative Progress: 219/1810 symbols completed. BIPJ took 0.7s. Estimated remaining: 10m 22s. Rate: 153.5 symbols/min [2025-10-13T22:35:06.189137] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:06.199470] [DEBUG] [LOCAL ] BIT: Loaded 23487 existing records from primary storage. [2025-10-13T22:35:06.199603] [INFO ] [MAIN ] BIT: Loaded 23487 primary data records. [2025-10-13T22:35:06.320931] [DEBUG] [LOCAL ] BIRK: Loaded 51043 existing records from primary storage. [2025-10-13T22:35:06.342846] [INFO ] [MAIN ] BIRK: Loaded 51043 primary data records. [2025-10-13T22:35:06.657553] [DEBUG] [LOCAL ] BJ: Loaded 51584 existing records from primary storage. [2025-10-13T22:35:06.680539] [INFO ] [MAIN ] BJ: Loaded 51584 primary data records. [2025-10-13T22:35:07.356374] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:07.358088] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23487 primary records. [2025-10-13T22:35:07.358574] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-13T22:35:07.396119] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-13T22:35:07.410736] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-13T22:35:07.415669] [INFO ] [MAIN ] Derivative Progress: 220/1810 symbols completed. BIT took 1.3s. Estimated remaining: 10m 28s. Rate: 152.0 symbols/min [2025-10-13T22:35:07.416494] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:07.418307] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:07.422013] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 51043 primary records. [2025-10-13T22:35:07.424840] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-13T22:35:07.460344] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:07.463560] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51584 primary records. [2025-10-13T22:35:07.464280] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-13T22:35:07.485086] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-13T22:35:07.485815] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-13T22:35:07.490887] [INFO ] [MAIN ] Derivative Progress: 221/1810 symbols completed. BJ took 1.3s. Estimated remaining: 10m 25s. Rate: 152.5 symbols/min [2025-10-13T22:35:07.491087] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:07.494713] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-13T22:35:07.509793] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-13T22:35:07.513577] [INFO ] [MAIN ] Derivative Progress: 222/1810 symbols completed. BIRK took 1.4s. Estimated remaining: 10m 22s. Rate: 153.2 symbols/min [2025-10-13T22:35:07.514037] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:07.538400] [DEBUG] [LOCAL ] BK: Loaded 53535 existing records from primary storage. [2025-10-13T22:35:07.538925] [INFO ] [MAIN ] BK: Loaded 53535 primary data records. [2025-10-13T22:35:07.761442] [DEBUG] [LOCAL ] BKE: Loaded 33944 existing records from primary storage. [2025-10-13T22:35:07.779047] [DEBUG] [LOCAL ] BKD: Loaded 50414 existing records from primary storage. [2025-10-13T22:35:07.785435] [INFO ] [MAIN ] BKE: Loaded 33944 primary data records. [2025-10-13T22:35:07.889792] [INFO ] [MAIN ] BKD: Loaded 50414 primary data records. [2025-10-13T22:35:08.589263] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:08.590811] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53535 primary records. [2025-10-13T22:35:08.590896] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-13T22:35:08.610156] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-13T22:35:08.610407] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-13T22:35:08.612888] [INFO ] [MAIN ] Derivative Progress: 223/1810 symbols completed. BK took 1.2s. Estimated remaining: 10m 27s. Rate: 151.9 symbols/min [2025-10-13T22:35:08.644011] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:08.645255] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50414 primary records. [2025-10-13T22:35:08.645384] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-13T22:35:08.659170] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:08.671831] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 33944 primary records. [2025-10-13T22:35:08.677958] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-13T22:35:08.692759] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-13T22:35:08.697020] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-13T22:35:08.701310] [INFO ] [MAIN ] Derivative Progress: 224/1810 symbols completed. BKD took 1.2s. Estimated remaining: 10m 24s. Rate: 152.5 symbols/min [2025-10-13T22:35:08.706868] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-13T22:35:08.706968] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-13T22:35:08.709755] [INFO ] [MAIN ] Derivative Progress: 225/1810 symbols completed. BKE took 1.2s. Estimated remaining: 10m 21s. Rate: 153.1 symbols/min [2025-10-13T22:35:08.710228] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:08.710460] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:08.710313] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:08.724730] [DEBUG] [LOCAL ] BKN: Loaded 7347 existing records from primary storage. [2025-10-13T22:35:08.725430] [INFO ] [MAIN ] BKN: Loaded 7347 primary data records. [2025-10-13T22:35:08.908953] [DEBUG] [LOCAL ] BKKT: Loaded 36153 existing records from primary storage. [2025-10-13T22:35:08.920231] [DEBUG] [LOCAL ] BKH: Loaded 36967 existing records from primary storage. [2025-10-13T22:35:08.929320] [INFO ] [MAIN ] BKKT: Loaded 36153 primary data records. [2025-10-13T22:35:08.931891] [INFO ] [MAIN ] BKH: Loaded 36967 primary data records. [2025-10-13T22:35:09.802530] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:09.803716] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7347 primary records. [2025-10-13T22:35:09.804026] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-13T22:35:09.820764] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-13T22:35:09.821205] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-13T22:35:09.823538] [INFO ] [MAIN ] Derivative Progress: 226/1810 symbols completed. BKN took 1.1s. Estimated remaining: 10m 26s. Rate: 151.9 symbols/min [2025-10-13T22:35:09.823747] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:09.851982] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:09.857926] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 36153 primary records. [2025-10-13T22:35:09.858499] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-13T22:35:09.858422] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:09.860557] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36967 primary records. [2025-10-13T22:35:09.867852] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-13T22:35:09.875806] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-13T22:35:09.876027] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-13T22:35:09.879506] [INFO ] [MAIN ] Derivative Progress: 227/1810 symbols completed. BKKT took 1.2s. Estimated remaining: 10m 23s. Rate: 152.5 symbols/min [2025-10-13T22:35:09.879734] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:09.914049] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-13T22:35:09.914307] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-13T22:35:09.917699] [INFO ] [MAIN ] Derivative Progress: 228/1810 symbols completed. BKH took 1.2s. Estimated remaining: 10m 20s. Rate: 153.1 symbols/min [2025-10-13T22:35:09.917931] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:09.923529] [DEBUG] [LOCAL ] BKT: Loaded 12267 existing records from primary storage. [2025-10-13T22:35:09.924544] [INFO ] [MAIN ] BKT: Loaded 12267 primary data records. [2025-10-13T22:35:09.985300] [DEBUG] [LOCAL ] BKSY: Loaded 48596 existing records from primary storage. [2025-10-13T22:35:10.003984] [INFO ] [MAIN ] BKSY: Loaded 48596 primary data records. [2025-10-13T22:35:10.380442] [DEBUG] [LOCAL ] BKU: Loaded 41954 existing records from primary storage. [2025-10-13T22:35:10.509789] [INFO ] [MAIN ] BKU: Loaded 41954 primary data records. [2025-10-13T22:35:11.038546] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:11.041931] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 12267 primary records. [2025-10-13T22:35:11.042582] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-13T22:35:11.042458] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:11.043993] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48596 primary records. [2025-10-13T22:35:11.046708] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-13T22:35:11.080042] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-13T22:35:11.091989] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-13T22:35:11.092124] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-13T22:35:11.096482] [INFO ] [MAIN ] Derivative Progress: 229/1810 symbols completed. BKT took 1.2s. Estimated remaining: 10m 25s. Rate: 151.7 symbols/min [2025-10-13T22:35:11.097336] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-13T22:35:11.100997] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:11.101213] [INFO ] [MAIN ] Derivative Progress: 230/1810 symbols completed. BKSY took 1.3s. Estimated remaining: 10m 22s. Rate: 152.4 symbols/min [2025-10-13T22:35:11.102587] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:11.122905] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:11.123855] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41954 primary records. [2025-10-13T22:35:11.123970] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-13T22:35:11.151223] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-13T22:35:11.171159] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-13T22:35:11.174811] [INFO ] [MAIN ] Derivative Progress: 231/1810 symbols completed. BKU took 1.3s. Estimated remaining: 10m 19s. Rate: 152.9 symbols/min [2025-10-13T22:35:11.176025] [DEBUG] [LOCAL ] BKV: Loaded 29753 existing records from primary storage. [2025-10-13T22:35:11.176176] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:11.176355] [INFO ] [MAIN ] BKV: Loaded 29753 primary data records. [2025-10-13T22:35:11.286289] [DEBUG] [LOCAL ] BLCO: Loaded 35532 existing records from primary storage. [2025-10-13T22:35:11.309272] [INFO ] [MAIN ] BLCO: Loaded 35532 primary data records. [2025-10-13T22:35:11.684888] [DEBUG] [LOCAL ] BLD: Loaded 27619 existing records from primary storage. [2025-10-13T22:35:11.700446] [INFO ] [MAIN ] BLD: Loaded 27619 primary data records. [2025-10-13T22:35:12.241088] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:12.253977] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:12.255112] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35532 primary records. [2025-10-13T22:35:12.255277] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-13T22:35:12.256582] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29753 primary records. [2025-10-13T22:35:12.258119] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-13T22:35:12.285837] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-13T22:35:12.298494] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-13T22:35:12.307268] [INFO ] [MAIN ] Derivative Progress: 232/1810 symbols completed. BLCO took 1.2s. Estimated remaining: 10m 24s. Rate: 151.7 symbols/min [2025-10-13T22:35:12.308077] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:12.310061] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:12.314288] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27619 primary records. [2025-10-13T22:35:12.313583] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-13T22:35:12.314777] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-13T22:35:12.314530] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-13T22:35:12.318170] [INFO ] [MAIN ] Derivative Progress: 233/1810 symbols completed. BKV took 1.2s. Estimated remaining: 10m 21s. Rate: 152.3 symbols/min [2025-10-13T22:35:12.319954] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:12.343725] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-10-13T22:35:12.344011] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-13T22:35:12.347683] [INFO ] [MAIN ] Derivative Progress: 234/1810 symbols completed. BLD took 1.2s. Estimated remaining: 10m 18s. Rate: 152.9 symbols/min [2025-10-13T22:35:12.348038] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:12.406781] [DEBUG] [LOCAL ] BLDR: Loaded 51810 existing records from primary storage. [2025-10-13T22:35:12.407144] [INFO ] [MAIN ] BLDR: Loaded 51810 primary data records. [2025-10-13T22:35:12.523939] [DEBUG] [LOCAL ] BLK: Loaded 34143 existing records from primary storage. [2025-10-13T22:35:12.536549] [INFO ] [MAIN ] BLK: Loaded 34143 primary data records. [2025-10-13T22:35:12.606443] [DEBUG] [LOCAL ] BLND: Loaded 49275 existing records from primary storage. [2025-10-13T22:35:12.662780] [INFO ] [MAIN ] BLND: Loaded 49275 primary data records. [2025-10-13T22:35:13.434716] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:13.437002] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51810 primary records. [2025-10-13T22:35:13.437430] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-13T22:35:13.460252] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-13T22:35:13.461507] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-13T22:35:13.464313] [INFO ] [MAIN ] Derivative Progress: 235/1810 symbols completed. BLDR took 1.2s. Estimated remaining: 10m 23s. Rate: 151.8 symbols/min [2025-10-13T22:35:13.480228] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:13.479820] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:13.482305] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49275 primary records. [2025-10-13T22:35:13.482763] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-13T22:35:13.509961] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-13T22:35:13.515530] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-13T22:35:13.533965] [INFO ] [MAIN ] Derivative Progress: 236/1810 symbols completed. BLND took 1.2s. Estimated remaining: 10m 20s. Rate: 152.3 symbols/min [2025-10-13T22:35:13.528804] [DEBUG] [LOCAL ] BLW: Loaded 13268 existing records from primary storage. [2025-10-13T22:35:13.535183] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:13.535736] [INFO ] [MAIN ] BLW: Loaded 13268 primary data records. [2025-10-13T22:35:13.535482] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:13.549071] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34143 primary records. [2025-10-13T22:35:13.549335] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-13T22:35:13.684460] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-13T22:35:13.695144] [DEBUG] [LOCAL ] BLX: Loaded 15613 existing records from primary storage. [2025-10-13T22:35:13.709270] [INFO ] [MAIN ] BLX: Loaded 15613 primary data records. [2025-10-13T22:35:13.761742] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-13T22:35:13.837220] [INFO ] [MAIN ] Derivative Progress: 237/1810 symbols completed. BLK took 1.5s. Estimated remaining: 10m 19s. Rate: 152.4 symbols/min [2025-10-13T22:35:13.967207] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:14.256007] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:14.256892] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13268 primary records. [2025-10-13T22:35:14.257028] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-13T22:35:14.286412] [DEBUG] [LOCAL ] BMA: Loaded 35960 existing records from primary storage. [2025-10-13T22:35:14.287506] [INFO ] [MAIN ] BMA: Loaded 35960 primary data records. [2025-10-13T22:35:14.291999] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-13T22:35:14.292243] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-13T22:35:14.313597] [INFO ] [MAIN ] Derivative Progress: 238/1810 symbols completed. BLW took 0.8s. Estimated remaining: 10m 19s. Rate: 152.3 symbols/min [2025-10-13T22:35:14.372770] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:14.400771] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15613 primary records. [2025-10-13T22:35:14.406935] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-13T22:35:14.476274] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-13T22:35:14.498685] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-13T22:35:14.502285] [INFO ] [MAIN ] Derivative Progress: 239/1810 symbols completed. BLX took 1.0s. Estimated remaining: 10m 18s. Rate: 152.6 symbols/min [2025-10-13T22:35:14.662065] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:14.662728] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35960 primary records. [2025-10-13T22:35:14.662795] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-13T22:35:14.677896] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-13T22:35:14.677955] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-13T22:35:14.680537] [INFO ] [MAIN ] Derivative Progress: 240/1810 symbols completed. BMA took 0.7s. Estimated remaining: 10m 16s. Rate: 153.0 symbols/min [2025-10-13T22:35:14.681448] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:14.681538] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:14.681362] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:14.686589] [DEBUG] [LOCAL ] BMN: Loaded 2587 existing records from primary storage. [2025-10-13T22:35:14.686772] [INFO ] [MAIN ] BMN: Loaded 2587 primary data records. [2025-10-13T22:35:14.806113] [DEBUG] [LOCAL ] BME: Loaded 11201 existing records from primary storage. [2025-10-13T22:35:14.806808] [INFO ] [MAIN ] BME: Loaded 11201 primary data records. [2025-10-13T22:35:14.907089] [DEBUG] [LOCAL ] BMI: Loaded 24442 existing records from primary storage. [2025-10-13T22:35:14.959515] [INFO ] [MAIN ] BMI: Loaded 24442 primary data records. [2025-10-13T22:35:15.783774] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:15.785013] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2587 primary records. [2025-10-13T22:35:15.785185] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-13T22:35:15.804282] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-13T22:35:15.818795] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-13T22:35:15.819085] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:15.820181] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11201 primary records. [2025-10-13T22:35:15.822992] [INFO ] [MAIN ] Derivative Progress: 241/1810 symbols completed. BMN took 1.1s. Estimated remaining: 10m 20s. Rate: 151.8 symbols/min [2025-10-13T22:35:15.823269] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:15.820288] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-13T22:35:15.843995] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-13T22:35:15.845890] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-13T22:35:15.849841] [INFO ] [MAIN ] Derivative Progress: 242/1810 symbols completed. BME took 1.2s. Estimated remaining: 10m 17s. Rate: 152.4 symbols/min [2025-10-13T22:35:15.850138] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:15.863392] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:15.864144] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24442 primary records. [2025-10-13T22:35:15.864312] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-13T22:35:15.881389] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-13T22:35:15.881628] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-13T22:35:15.894288] [INFO ] [MAIN ] Derivative Progress: 243/1810 symbols completed. BMI took 1.2s. Estimated remaining: 10m 15s. Rate: 152.9 symbols/min [2025-10-13T22:35:15.894605] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:15.913257] [DEBUG] [LOCAL ] BMO: Loaded 41112 existing records from primary storage. [2025-10-13T22:35:15.913630] [INFO ] [MAIN ] BMO: Loaded 41112 primary data records. [2025-10-13T22:35:16.255202] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-13T22:35:16.270213] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-13T22:35:16.303972] [DEBUG] [LOCAL ] BN: Loaded 52987 existing records from primary storage. [2025-10-13T22:35:16.328839] [INFO ] [MAIN ] BN: Loaded 52987 primary data records. [2025-10-13T22:35:16.893776] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:16.895397] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41112 primary records. [2025-10-13T22:35:16.895853] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-13T22:35:16.914621] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-13T22:35:16.917253] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-13T22:35:16.920382] [INFO ] [MAIN ] Derivative Progress: 244/1810 symbols completed. BMO took 1.1s. Estimated remaining: 10m 19s. Rate: 151.9 symbols/min [2025-10-13T22:35:16.920635] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:16.935500] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:16.936380] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-13T22:35:16.936709] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-13T22:35:16.953374] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-13T22:35:16.953583] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-13T22:35:16.957786] [INFO ] [MAIN ] Derivative Progress: 245/1810 symbols completed. BMY took 1.1s. Estimated remaining: 10m 16s. Rate: 152.5 symbols/min [2025-10-13T22:35:16.958936] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:16.980974] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:16.981778] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52987 primary records. [2025-10-13T22:35:16.981874] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-13T22:35:17.009419] [DEBUG] [LOCAL ] BNED: Loaded 28770 existing records from primary storage. [2025-10-13T22:35:17.011099] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-13T22:35:17.011317] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-13T22:35:17.014725] [INFO ] [MAIN ] Derivative Progress: 246/1810 symbols completed. BN took 1.1s. Estimated remaining: 10m 13s. Rate: 153.0 symbols/min [2025-10-13T22:35:17.009334] [DEBUG] [LOCAL ] BNH: Loaded 5246 existing records from primary storage. [2025-10-13T22:35:17.015006] [INFO ] [MAIN ] BNH: Loaded 5246 primary data records. [2025-10-13T22:35:17.014818] [INFO ] [MAIN ] BNED: Loaded 28770 primary data records. [2025-10-13T22:35:17.015215] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:17.156522] [DEBUG] [LOCAL ] BNJ: Loaded 2668 existing records from primary storage. [2025-10-13T22:35:17.168046] [INFO ] [MAIN ] BNJ: Loaded 2668 primary data records. [2025-10-13T22:35:18.012408] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:18.015190] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5246 primary records. [2025-10-13T22:35:18.015484] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-13T22:35:18.015905] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:18.018354] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 28770 primary records. [2025-10-13T22:35:18.018697] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-13T22:35:18.063048] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:18.066132] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-13T22:35:18.068443] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2668 primary records. [2025-10-13T22:35:18.068619] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-13T22:35:18.071393] [INFO ] [MAIN ] Derivative Progress: 247/1810 symbols completed. BNED took 1.2s. Estimated remaining: 10m 17s. Rate: 152.0 symbols/min [2025-10-13T22:35:18.068780] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-13T22:35:18.071623] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-13T22:35:18.071770] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:18.072061] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-13T22:35:18.075247] [INFO ] [MAIN ] Derivative Progress: 248/1810 symbols completed. BNH took 1.1s. Estimated remaining: 10m 14s. Rate: 152.6 symbols/min [2025-10-13T22:35:18.076897] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:18.093070] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-13T22:35:18.093363] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-13T22:35:18.096831] [INFO ] [MAIN ] Derivative Progress: 249/1810 symbols completed. BNJ took 1.1s. Estimated remaining: 10m 12s. Rate: 153.2 symbols/min [2025-10-13T22:35:18.099813] [DEBUG] [LOCAL ] BNT: Loaded 3428 existing records from primary storage. [2025-10-13T22:35:18.099999] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:18.100355] [INFO ] [MAIN ] BNT: Loaded 3428 primary data records. [2025-10-13T22:35:18.238122] [DEBUG] [LOCAL ] BNY: Loaded 7160 existing records from primary storage. [2025-10-13T22:35:18.252620] [INFO ] [MAIN ] BNY: Loaded 7160 primary data records. [2025-10-13T22:35:18.558706] [DEBUG] [LOCAL ] BNS: Loaded 51465 existing records from primary storage. [2025-10-13T22:35:18.570545] [INFO ] [MAIN ] BNS: Loaded 51465 primary data records. [2025-10-13T22:35:19.079877] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:35:19.081173] [INFO ] [MAIN ] BNT: Generated 1793 derivative records from 3428 primary records. [2025-10-13T22:35:19.081387] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-13T22:35:19.098678] [DEBUG] [LOCAL ] BNT: Derivative data saved (1793 records). [2025-10-13T22:35:19.100435] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-13T22:35:19.103316] [INFO ] [MAIN ] Derivative Progress: 250/1810 symbols completed. BNT took 1.0s. Estimated remaining: 10m 15s. Rate: 152.2 symbols/min [2025-10-13T22:35:19.103605] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:19.118268] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:19.119196] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7160 primary records. [2025-10-13T22:35:19.119291] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-13T22:35:19.137514] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-13T22:35:19.145323] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-13T22:35:19.161260] [INFO ] [MAIN ] Derivative Progress: 251/1810 symbols completed. BNY took 1.1s. Estimated remaining: 10m 12s. Rate: 152.7 symbols/min [2025-10-13T22:35:19.161891] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:19.161776] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:19.163223] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51465 primary records. [2025-10-13T22:35:19.163456] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-13T22:35:19.180079] [DEBUG] [LOCAL ] BOC: Loaded 18609 existing records from primary storage. [2025-10-13T22:35:19.183423] [INFO ] [MAIN ] BOC: Loaded 18609 primary data records. [2025-10-13T22:35:19.193082] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-13T22:35:19.206491] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-13T22:35:19.209837] [INFO ] [MAIN ] Derivative Progress: 252/1810 symbols completed. BNS took 1.1s. Estimated remaining: 10m 10s. Rate: 153.3 symbols/min [2025-10-13T22:35:19.218250] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:19.306436] [DEBUG] [LOCAL ] BOE: Loaded 18261 existing records from primary storage. [2025-10-13T22:35:19.312173] [INFO ] [MAIN ] BOE: Loaded 18261 primary data records. [2025-10-13T22:35:19.643752] [DEBUG] [LOCAL ] BOH: Loaded 30490 existing records from primary storage. [2025-10-13T22:35:19.691703] [INFO ] [MAIN ] BOH: Loaded 30490 primary data records. [2025-10-13T22:35:20.183746] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:20.185578] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18609 primary records. [2025-10-13T22:35:20.186022] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-13T22:35:20.205368] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-13T22:35:20.206437] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-13T22:35:20.209262] [INFO ] [MAIN ] Derivative Progress: 253/1810 symbols completed. BOC took 1.1s. Estimated remaining: 10m 13s. Rate: 152.3 symbols/min [2025-10-13T22:35:20.222005] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:20.223931] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18261 primary records. [2025-10-13T22:35:20.224124] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-13T22:35:20.241126] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-13T22:35:20.241213] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-13T22:35:20.244244] [INFO ] [MAIN ] Derivative Progress: 254/1810 symbols completed. BOE took 1.1s. Estimated remaining: 10m 11s. Rate: 152.9 symbols/min [2025-10-13T22:35:20.260008] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:20.260576] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30490 primary records. [2025-10-13T22:35:20.260635] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-13T22:35:20.275842] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-13T22:35:20.275899] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-13T22:35:20.279086] [INFO ] [MAIN ] Derivative Progress: 255/1810 symbols completed. BOH took 1.1s. Estimated remaining: 10m 8s. Rate: 153.4 symbols/min [2025-10-13T22:35:20.279482] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:20.280013] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:20.280420] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:20.334885] [DEBUG] [LOCAL ] BOND: Loaded 32321 existing records from primary storage. [2025-10-13T22:35:20.335149] [INFO ] [MAIN ] BOND: Loaded 32321 primary data records. [2025-10-13T22:35:20.462419] [DEBUG] [LOCAL ] BOOT: Loaded 39875 existing records from primary storage. [2025-10-13T22:35:20.464114] [INFO ] [MAIN ] BOOT: Loaded 39875 primary data records. [2025-10-13T22:35:20.464833] [DEBUG] [LOCAL ] BORR: Loaded 51152 existing records from primary storage. [2025-10-13T22:35:20.476595] [INFO ] [MAIN ] BORR: Loaded 51152 primary data records. [2025-10-13T22:35:21.302621] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:21.303992] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32321 primary records. [2025-10-13T22:35:21.304530] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-13T22:35:21.335723] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-13T22:35:21.336830] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-13T22:35:21.339012] [INFO ] [MAIN ] Derivative Progress: 256/1810 symbols completed. BOND took 1.1s. Estimated remaining: 10m 12s. Rate: 152.4 symbols/min [2025-10-13T22:35:21.339411] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:21.339575] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:21.352382] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 39875 primary records. [2025-10-13T22:35:21.352734] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-13T22:35:21.361191] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:21.366986] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51152 primary records. [2025-10-13T22:35:21.367958] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-13T22:35:21.370490] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-13T22:35:21.370764] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-13T22:35:21.373790] [INFO ] [MAIN ] Derivative Progress: 257/1810 symbols completed. BOOT took 1.1s. Estimated remaining: 10m 9s. Rate: 152.9 symbols/min [2025-10-13T22:35:21.386206] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:21.396001] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-13T22:35:21.396097] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-13T22:35:21.399525] [INFO ] [MAIN ] Derivative Progress: 258/1810 symbols completed. BORR took 1.1s. Estimated remaining: 10m 7s. Rate: 153.5 symbols/min [2025-10-13T22:35:21.399861] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:21.408703] [DEBUG] [LOCAL ] BOW: Loaded 23502 existing records from primary storage. [2025-10-13T22:35:21.408992] [INFO ] [MAIN ] BOW: Loaded 23502 primary data records. [2025-10-13T22:35:21.771696] [DEBUG] [LOCAL ] BOX: Loaded 50236 existing records from primary storage. [2025-10-13T22:35:21.773176] [INFO ] [MAIN ] BOX: Loaded 50236 primary data records. [2025-10-13T22:35:21.773920] [DEBUG] [LOCAL ] BR: Loaded 34832 existing records from primary storage. [2025-10-13T22:35:21.785087] [INFO ] [MAIN ] BR: Loaded 34832 primary data records. [2025-10-13T22:35:22.384314] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:22.385284] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23502 primary records. [2025-10-13T22:35:22.385386] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-13T22:35:22.404872] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-13T22:35:22.405391] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-13T22:35:22.408426] [INFO ] [MAIN ] Derivative Progress: 259/1810 symbols completed. BOW took 1.1s. Estimated remaining: 10m 10s. Rate: 152.6 symbols/min [2025-10-13T22:35:22.408693] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:22.441858] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:22.442117] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:22.442909] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34832 primary records. [2025-10-13T22:35:22.443556] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50236 primary records. [2025-10-13T22:35:22.443039] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-13T22:35:22.443997] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-13T22:35:22.470370] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-13T22:35:22.470755] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-13T22:35:22.473116] [INFO ] [MAIN ] Derivative Progress: 260/1810 symbols completed. BR took 1.1s. Estimated remaining: 10m 8s. Rate: 153.1 symbols/min [2025-10-13T22:35:22.475918] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:22.477870] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-13T22:35:22.477961] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-13T22:35:22.481160] [INFO ] [MAIN ] Derivative Progress: 261/1810 symbols completed. BOX took 1.1s. Estimated remaining: 10m 5s. Rate: 153.6 symbols/min [2025-10-13T22:35:22.481376] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:22.518895] [DEBUG] [LOCAL ] BRBR: Loaded 51571 existing records from primary storage. [2025-10-13T22:35:22.519191] [INFO ] [MAIN ] BRBR: Loaded 51571 primary data records. [2025-10-13T22:35:22.626478] [DEBUG] [LOCAL ] BRC: Loaded 18661 existing records from primary storage. [2025-10-13T22:35:22.637256] [INFO ] [MAIN ] BRC: Loaded 18661 primary data records. [2025-10-13T22:35:22.939285] [DEBUG] [LOCAL ] BRCC: Loaded 40184 existing records from primary storage. [2025-10-13T22:35:22.945270] [INFO ] [MAIN ] BRCC: Loaded 40184 primary data records. [2025-10-13T22:35:23.534932] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:23.535832] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51571 primary records. [2025-10-13T22:35:23.536012] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-13T22:35:23.556228] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-13T22:35:23.557460] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-13T22:35:23.560894] [INFO ] [MAIN ] Derivative Progress: 262/1810 symbols completed. BRBR took 1.2s. Estimated remaining: 10m 9s. Rate: 152.6 symbols/min [2025-10-13T22:35:23.561335] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:23.576356] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:23.577080] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18661 primary records. [2025-10-13T22:35:23.577259] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-13T22:35:23.607171] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:23.609335] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40184 primary records. [2025-10-13T22:35:23.609486] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-13T22:35:23.609676] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-13T22:35:23.609433] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-13T22:35:23.613557] [INFO ] [MAIN ] Derivative Progress: 263/1810 symbols completed. BRC took 1.1s. Estimated remaining: 10m 6s. Rate: 153.1 symbols/min [2025-10-13T22:35:23.614883] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:23.631184] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-13T22:35:23.631317] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-13T22:35:23.634268] [INFO ] [MAIN ] Derivative Progress: 264/1810 symbols completed. BRCC took 1.2s. Estimated remaining: 10m 4s. Rate: 153.7 symbols/min [2025-10-13T22:35:23.634468] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:23.671828] [DEBUG] [LOCAL ] BRO: Loaded 52044 existing records from primary storage. [2025-10-13T22:35:23.679520] [INFO ] [MAIN ] BRO: Loaded 52044 primary data records. [2025-10-13T22:35:23.865201] [DEBUG] [LOCAL ] BRSP: Loaded 36738 existing records from primary storage. [2025-10-13T22:35:23.852886] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-13T22:35:23.873934] [INFO ] [MAIN ] BRSP: Loaded 36738 primary data records. [2025-10-13T22:35:23.874030] [INFO ] [MAIN ] BROS: Loaded 53300 primary data records. [2025-10-13T22:35:24.632538] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:24.633546] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 52044 primary records. [2025-10-13T22:35:24.633880] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-13T22:35:24.654670] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-13T22:35:24.655982] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-13T22:35:24.658318] [INFO ] [MAIN ] Derivative Progress: 265/1810 symbols completed. BRO took 1.1s. Estimated remaining: 10m 7s. Rate: 152.7 symbols/min [2025-10-13T22:35:24.658579] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:24.684091] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:24.685002] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36738 primary records. [2025-10-13T22:35:24.685210] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-13T22:35:24.685483] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:24.686794] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53300 primary records. [2025-10-13T22:35:24.687082] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-13T22:35:24.709122] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-13T22:35:24.709230] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-13T22:35:24.716234] [INFO ] [MAIN ] Derivative Progress: 266/1810 symbols completed. BRSP took 1.1s. Estimated remaining: 10m 5s. Rate: 153.2 symbols/min [2025-10-13T22:35:24.722359] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:24.733542] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-13T22:35:24.733707] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-13T22:35:24.736888] [INFO ] [MAIN ] Derivative Progress: 267/1810 symbols completed. BROS took 1.1s. Estimated remaining: 10m 2s. Rate: 153.8 symbols/min [2025-10-13T22:35:24.737917] [DEBUG] [LOCAL ] BRW: Loaded 20943 existing records from primary storage. [2025-10-13T22:35:24.737160] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:24.738088] [INFO ] [MAIN ] BRW: Loaded 20943 primary data records. [2025-10-13T22:35:25.069882] [DEBUG] [LOCAL ] BSAC: Loaded 32825 existing records from primary storage. [2025-10-13T22:35:25.070736] [INFO ] [MAIN ] BSAC: Loaded 32825 primary data records. [2025-10-13T22:35:25.192245] [DEBUG] [LOCAL ] BRX: Loaded 51788 existing records from primary storage. [2025-10-13T22:35:25.192497] [INFO ] [MAIN ] BRX: Loaded 51788 primary data records. [2025-10-13T22:35:25.755549] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:25.756623] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 20943 primary records. [2025-10-13T22:35:25.757025] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-13T22:35:25.776290] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-13T22:35:25.776658] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-13T22:35:25.779687] [INFO ] [MAIN ] Derivative Progress: 268/1810 symbols completed. BRW took 1.1s. Estimated remaining: 10m 5s. Rate: 152.8 symbols/min [2025-10-13T22:35:25.795267] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:25.796179] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32825 primary records. [2025-10-13T22:35:25.796279] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-13T22:35:25.816544] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-13T22:35:25.816889] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-13T22:35:25.832225] [INFO ] [MAIN ] Derivative Progress: 269/1810 symbols completed. BSAC took 1.1s. Estimated remaining: 10m 3s. Rate: 153.3 symbols/min [2025-10-13T22:35:25.832606] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:25.833219] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51788 primary records. [2025-10-13T22:35:25.833280] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-13T22:35:25.849034] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-13T22:35:25.849092] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-13T22:35:25.852151] [INFO ] [MAIN ] Derivative Progress: 270/1810 symbols completed. BRX took 1.1s. Estimated remaining: 10m 1s. Rate: 153.8 symbols/min [2025-10-13T22:35:25.852584] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:25.852539] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:25.852681] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:25.866620] [DEBUG] [LOCAL ] BSL: Loaded 8260 existing records from primary storage. [2025-10-13T22:35:25.867564] [INFO ] [MAIN ] BSL: Loaded 8260 primary data records. [2025-10-13T22:35:26.018824] [DEBUG] [LOCAL ] BSBR: Loaded 35612 existing records from primary storage. [2025-10-13T22:35:26.038784] [INFO ] [MAIN ] BSBR: Loaded 35612 primary data records. [2025-10-13T22:35:26.049572] [DEBUG] [LOCAL ] BSM: Loaded 32287 existing records from primary storage. [2025-10-13T22:35:26.085796] [INFO ] [MAIN ] BSM: Loaded 32287 primary data records. [2025-10-13T22:35:26.905310] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:26.906511] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8260 primary records. [2025-10-13T22:35:26.907196] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-13T22:35:26.930413] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-13T22:35:26.930852] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-13T22:35:26.933044] [INFO ] [MAIN ] Derivative Progress: 271/1810 symbols completed. BSL took 1.1s. Estimated remaining: 10m 4s. Rate: 152.8 symbols/min [2025-10-13T22:35:26.933341] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:26.974596] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:26.976498] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32287 primary records. [2025-10-13T22:35:26.975936] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:26.976768] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-13T22:35:26.983960] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35612 primary records. [2025-10-13T22:35:26.984461] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-13T22:35:27.007460] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-13T22:35:27.019226] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-13T22:35:27.021895] [DEBUG] [LOCAL ] BST: Loaded 18945 existing records from primary storage. [2025-10-13T22:35:27.023840] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-13T22:35:27.023941] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-13T22:35:27.027447] [INFO ] [MAIN ] Derivative Progress: 272/1810 symbols completed. BSM took 1.2s. Estimated remaining: 10m 2s. Rate: 153.3 symbols/min [2025-10-13T22:35:27.023459] [INFO ] [MAIN ] BST: Loaded 18945 primary data records. [2025-10-13T22:35:27.032367] [INFO ] [MAIN ] Derivative Progress: 273/1810 symbols completed. BSBR took 1.2s. Estimated remaining: 9m 60s. Rate: 153.8 symbols/min [2025-10-13T22:35:27.032090] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:27.044355] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:27.340633] [DEBUG] [LOCAL ] BSTZ: Loaded 25020 existing records from primary storage. [2025-10-13T22:35:27.340980] [INFO ] [MAIN ] BSTZ: Loaded 25020 primary data records. [2025-10-13T22:35:27.489446] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-13T22:35:27.505508] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-13T22:35:28.062674] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:28.064383] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18945 primary records. [2025-10-13T22:35:28.065025] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-13T22:35:28.085437] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-13T22:35:28.086998] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-13T22:35:28.089461] [INFO ] [MAIN ] Derivative Progress: 274/1810 symbols completed. BST took 1.2s. Estimated remaining: 10m 3s. Rate: 152.9 symbols/min [2025-10-13T22:35:28.089815] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:28.116030] [DEBUG] [LOCAL ] BTA: Loaded 5590 existing records from primary storage. [2025-10-13T22:35:28.119280] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:28.121279] [INFO ] [MAIN ] BTA: Loaded 5590 primary data records. [2025-10-13T22:35:28.121180] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 25020 primary records. [2025-10-13T22:35:28.157377] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-13T22:35:28.252475] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:28.278859] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-10-13T22:35:28.279553] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-13T22:35:28.468075] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-13T22:35:28.477126] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-13T22:35:28.477958] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-13T22:35:28.481359] [INFO ] [MAIN ] Derivative Progress: 275/1810 symbols completed. BSTZ took 1.4s. Estimated remaining: 10m 2s. Rate: 152.9 symbols/min [2025-10-13T22:35:28.481579] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:28.481793] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-13T22:35:28.485359] [INFO ] [MAIN ] Derivative Progress: 276/1810 symbols completed. BSX took 1.4s. Estimated remaining: 9m 60s. Rate: 153.4 symbols/min [2025-10-13T22:35:28.485980] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:28.514288] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:28.515017] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5590 primary records. [2025-10-13T22:35:28.529261] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-13T22:35:28.556892] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-13T22:35:28.557955] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-13T22:35:28.560480] [INFO ] [MAIN ] Derivative Progress: 277/1810 symbols completed. BTA took 0.5s. Estimated remaining: 9m 58s. Rate: 153.9 symbols/min [2025-10-13T22:35:28.574995] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:28.590534] [DEBUG] [LOCAL ] BTE: Loaded 52723 existing records from primary storage. [2025-10-13T22:35:28.591845] [INFO ] [MAIN ] BTE: Loaded 52723 primary data records. [2025-10-13T22:35:28.613727] [DEBUG] [LOCAL ] BTI: Loaded 53591 existing records from primary storage. [2025-10-13T22:35:28.629778] [INFO ] [MAIN ] BTI: Loaded 53591 primary data records. [2025-10-13T22:35:28.775494] [DEBUG] [LOCAL ] BTO: Loaded 8741 existing records from primary storage. [2025-10-13T22:35:28.790488] [INFO ] [MAIN ] BTO: Loaded 8741 primary data records. [2025-10-13T22:35:29.610610] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:29.611819] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:29.612494] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53591 primary records. [2025-10-13T22:35:29.611535] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52723 primary records. [2025-10-13T22:35:29.612604] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-13T22:35:29.612924] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-13T22:35:29.646556] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-13T22:35:29.645415] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-13T22:35:29.646850] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-13T22:35:29.660842] [INFO ] [MAIN ] Derivative Progress: 278/1810 symbols completed. BTE took 1.2s. Estimated remaining: 10m 1s. Rate: 152.9 symbols/min [2025-10-13T22:35:29.661624] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:29.654488] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-13T22:35:29.662504] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:29.663420] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8741 primary records. [2025-10-13T22:35:29.666218] [INFO ] [MAIN ] Derivative Progress: 279/1810 symbols completed. BTI took 1.2s. Estimated remaining: 9m 59s. Rate: 153.4 symbols/min [2025-10-13T22:35:29.666456] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-13T22:35:29.666405] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:29.686809] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-13T22:35:29.687023] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-13T22:35:29.690006] [INFO ] [MAIN ] Derivative Progress: 280/1810 symbols completed. BTO took 1.1s. Estimated remaining: 9m 56s. Rate: 153.9 symbols/min [2025-10-13T22:35:29.690198] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:29.696670] [DEBUG] [LOCAL ] BTT: Loaded 15801 existing records from primary storage. [2025-10-13T22:35:29.697013] [INFO ] [MAIN ] BTT: Loaded 15801 primary data records. [2025-10-13T22:35:30.008959] [DEBUG] [LOCAL ] BTZ: Loaded 22651 existing records from primary storage. [2025-10-13T22:35:30.018572] [INFO ] [MAIN ] BTZ: Loaded 22651 primary data records. [2025-10-13T22:35:30.100144] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-13T22:35:30.125896] [INFO ] [MAIN ] BTU: Loaded 53318 primary data records. [2025-10-13T22:35:30.721863] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:30.723093] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15801 primary records. [2025-10-13T22:35:30.723619] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-13T22:35:30.742325] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-13T22:35:30.742876] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-13T22:35:30.745310] [INFO ] [MAIN ] Derivative Progress: 281/1810 symbols completed. BTT took 1.1s. Estimated remaining: 9m 60s. Rate: 153.0 symbols/min [2025-10-13T22:35:30.745596] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:30.766112] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:30.767728] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22651 primary records. [2025-10-13T22:35:30.767988] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-13T22:35:30.794602] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:30.797363] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-13T22:35:30.797483] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-13T22:35:30.800866] [INFO ] [MAIN ] Derivative Progress: 282/1810 symbols completed. BTZ took 1.1s. Estimated remaining: 9m 57s. Rate: 153.5 symbols/min [2025-10-13T22:35:30.798250] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53318 primary records. [2025-10-13T22:35:30.801102] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-13T22:35:30.801216] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:30.834376] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-13T22:35:30.834610] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-13T22:35:30.837569] [INFO ] [MAIN ] Derivative Progress: 283/1810 symbols completed. BTU took 1.2s. Estimated remaining: 9m 55s. Rate: 154.0 symbols/min [2025-10-13T22:35:30.845175] [DEBUG] [LOCAL ] BUI: Loaded 11920 existing records from primary storage. [2025-10-13T22:35:30.859014] [INFO ] [MAIN ] BUI: Loaded 11920 primary data records. [2025-10-13T22:35:30.927096] [DEBUG] [LOCAL ] BUD: Loaded 52658 existing records from primary storage. [2025-10-13T22:35:30.949969] [INFO ] [MAIN ] BUD: Loaded 52658 primary data records. [2025-10-13T22:35:31.517792] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:31.519837] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11920 primary records. [2025-10-13T22:35:31.520027] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-13T22:35:31.541436] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:31.544770] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52658 primary records. [2025-10-13T22:35:31.546753] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-13T22:35:31.548960] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-13T22:35:31.549673] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-13T22:35:31.551981] [INFO ] [MAIN ] Derivative Progress: 284/1810 symbols completed. BUI took 0.8s. Estimated remaining: 9m 56s. Rate: 153.5 symbols/min [2025-10-13T22:35:31.566892] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-13T22:35:31.566972] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-13T22:35:31.569861] [INFO ] [MAIN ] Derivative Progress: 285/1810 symbols completed. BUD took 0.8s. Estimated remaining: 9m 54s. Rate: 154.0 symbols/min [2025-10-13T22:35:31.570361] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:31.570566] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:31.570425] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:31.591811] [DEBUG] [LOCAL ] BUXX: Loaded 15320 existing records from primary storage. [2025-10-13T22:35:31.602607] [INFO ] [MAIN ] BUXX: Loaded 15320 primary data records. [2025-10-13T22:35:31.735112] [DEBUG] [LOCAL ] BUR: Loaded 45304 existing records from primary storage. [2025-10-13T22:35:31.739454] [INFO ] [MAIN ] BUR: Loaded 45304 primary data records. [2025-10-13T22:35:31.878158] [DEBUG] [LOCAL ] BURL: Loaded 45749 existing records from primary storage. [2025-10-13T22:35:31.891078] [INFO ] [MAIN ] BURL: Loaded 45749 primary data records. [2025-10-13T22:35:32.647777] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:35:32.648823] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15320 primary records. [2025-10-13T22:35:32.649003] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-13T22:35:32.671819] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-13T22:35:32.672298] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-13T22:35:32.674963] [INFO ] [MAIN ] Derivative Progress: 286/1810 symbols completed. BUXX took 1.1s. Estimated remaining: 9m 57s. Rate: 153.0 symbols/min [2025-10-13T22:35:32.675248] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:32.689464] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:32.690548] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45304 primary records. [2025-10-13T22:35:32.690892] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-13T22:35:32.723425] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-13T22:35:32.723781] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-13T22:35:32.726722] [INFO ] [MAIN ] Derivative Progress: 287/1810 symbols completed. BUR took 1.2s. Estimated remaining: 9m 55s. Rate: 153.5 symbols/min [2025-10-13T22:35:32.727037] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:32.727292] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:32.728940] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45749 primary records. [2025-10-13T22:35:32.729120] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-13T22:35:32.754814] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-13T22:35:32.754885] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-13T22:35:32.757803] [INFO ] [MAIN ] Derivative Progress: 288/1810 symbols completed. BURL took 1.2s. Estimated remaining: 9m 53s. Rate: 154.0 symbols/min [2025-10-13T22:35:32.758093] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:32.773307] [DEBUG] [LOCAL ] BV: Loaded 38568 existing records from primary storage. [2025-10-13T22:35:32.773477] [INFO ] [MAIN ] BV: Loaded 38568 primary data records. [2025-10-13T22:35:32.972206] [DEBUG] [LOCAL ] BVN: Loaded 44224 existing records from primary storage. [2025-10-13T22:35:33.031438] [INFO ] [MAIN ] BVN: Loaded 44224 primary data records. [2025-10-13T22:35:33.036171] [DEBUG] [LOCAL ] BW: Loaded 40411 existing records from primary storage. [2025-10-13T22:35:33.135314] [INFO ] [MAIN ] BW: Loaded 40411 primary data records. [2025-10-13T22:35:33.830673] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:33.831836] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38568 primary records. [2025-10-13T22:35:33.831983] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-13T22:35:33.851304] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-10-13T22:35:33.853162] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-13T22:35:33.855217] [INFO ] [MAIN ] Derivative Progress: 289/1810 symbols completed. BV took 1.2s. Estimated remaining: 9m 56s. Rate: 153.0 symbols/min [2025-10-13T22:35:33.855542] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:33.871890] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:33.874834] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40411 primary records. [2025-10-13T22:35:33.875139] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-13T22:35:33.900427] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:33.901594] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44224 primary records. [2025-10-13T22:35:33.902895] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-13T22:35:33.908409] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-13T22:35:33.908556] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-13T22:35:33.919319] [INFO ] [MAIN ] Derivative Progress: 290/1810 symbols completed. BW took 1.2s. Estimated remaining: 9m 54s. Rate: 153.5 symbols/min [2025-10-13T22:35:33.923422] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:33.947450] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-13T22:35:33.947744] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-13T22:35:33.950509] [INFO ] [MAIN ] Derivative Progress: 291/1810 symbols completed. BVN took 1.2s. Estimated remaining: 9m 52s. Rate: 154.0 symbols/min [2025-10-13T22:35:33.955756] [DEBUG] [LOCAL ] BWG: Loaded 12657 existing records from primary storage. [2025-10-13T22:35:33.955953] [INFO ] [MAIN ] BWG: Loaded 12657 primary data records. [2025-10-13T22:35:33.956175] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:34.076976] [DEBUG] [LOCAL ] BWA: Loaded 52168 existing records from primary storage. [2025-10-13T22:35:34.077277] [INFO ] [MAIN ] BWA: Loaded 52168 primary data records. [2025-10-13T22:35:34.310053] [DEBUG] [LOCAL ] BWLP: Loaded 32405 existing records from primary storage. [2025-10-13T22:35:34.314380] [INFO ] [MAIN ] BWLP: Loaded 32405 primary data records. [2025-10-13T22:35:34.932229] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:34.933135] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12657 primary records. [2025-10-13T22:35:34.933396] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-13T22:35:34.963340] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:34.964810] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52168 primary records. [2025-10-13T22:35:34.965851] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-13T22:35:34.966009] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-13T22:35:34.966149] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-13T22:35:34.969834] [INFO ] [MAIN ] Derivative Progress: 292/1810 symbols completed. BWG took 1.0s. Estimated remaining: 9m 55s. Rate: 153.1 symbols/min [2025-10-13T22:35:34.978866] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:35.000546] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-13T22:35:35.001261] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:35.001353] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-13T22:35:35.003995] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32405 primary records. [2025-10-13T22:35:35.006514] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-13T22:35:35.006427] [INFO ] [MAIN ] Derivative Progress: 293/1810 symbols completed. BWA took 1.2s. Estimated remaining: 9m 53s. Rate: 153.6 symbols/min [2025-10-13T22:35:35.011037] [DEBUG] [LOCAL ] BWMX: Loaded 7770 existing records from primary storage. [2025-10-13T22:35:35.010819] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:35.011477] [INFO ] [MAIN ] BWMX: Loaded 7770 primary data records. [2025-10-13T22:35:35.109836] [DEBUG] [LOCAL ] BWNB: Loaded 4239 existing records from primary storage. [2025-10-13T22:35:35.121775] [INFO ] [MAIN ] BWNB: Loaded 4239 primary data records. [2025-10-13T22:35:35.186978] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-13T22:35:35.305269] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-13T22:35:35.450787] [INFO ] [MAIN ] Derivative Progress: 294/1810 symbols completed. BWLP took 1.5s. Estimated remaining: 9m 52s. Rate: 153.5 symbols/min [2025-10-13T22:35:35.472956] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:35.727866] [DEBUG] [LOCAL ] BWSN: Loaded 5132 existing records from primary storage. [2025-10-13T22:35:35.728229] [INFO ] [MAIN ] BWSN: Loaded 5132 primary data records. [2025-10-13T22:35:36.173322] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:36.176120] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7770 primary records. [2025-10-13T22:35:36.176432] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-13T22:35:36.205204] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-13T22:35:36.223524] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-13T22:35:36.223404] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:36.229414] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4239 primary records. [2025-10-13T22:35:36.227336] [INFO ] [MAIN ] Derivative Progress: 295/1810 symbols completed. BWMX took 1.2s. Estimated remaining: 9m 54s. Rate: 153.0 symbols/min [2025-10-13T22:35:36.231012] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:36.230354] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-13T22:35:36.259287] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-13T22:35:36.259771] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-13T22:35:36.264252] [INFO ] [MAIN ] Derivative Progress: 296/1810 symbols completed. BWNB took 1.3s. Estimated remaining: 9m 52s. Rate: 153.5 symbols/min [2025-10-13T22:35:36.265493] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:36.288425] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:35:36.289347] [INFO ] [MAIN ] BWSN: Generated 1793 derivative records from 5132 primary records. [2025-10-13T22:35:36.289485] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-13T22:35:36.308029] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1793 records). [2025-10-13T22:35:36.308428] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-13T22:35:36.326090] [INFO ] [MAIN ] Derivative Progress: 297/1810 symbols completed. BWSN took 0.9s. Estimated remaining: 9m 50s. Rate: 153.9 symbols/min [2025-10-13T22:35:36.326562] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:36.341079] [DEBUG] [LOCAL ] BXC: Loaded 13689 existing records from primary storage. [2025-10-13T22:35:36.341393] [INFO ] [MAIN ] BXC: Loaded 13689 primary data records. [2025-10-13T22:35:36.498082] [DEBUG] [LOCAL ] BWXT: Loaded 46959 existing records from primary storage. [2025-10-13T22:35:36.517392] [INFO ] [MAIN ] BWXT: Loaded 46959 primary data records. [2025-10-13T22:35:36.633237] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-13T22:35:36.711209] [INFO ] [MAIN ] BX: Loaded 53483 primary data records. [2025-10-13T22:35:37.444793] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:37.448965] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13689 primary records. [2025-10-13T22:35:37.449145] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-13T22:35:37.448062] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:37.450083] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46959 primary records. [2025-10-13T22:35:37.450291] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-13T22:35:37.486220] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:37.495474] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53483 primary records. [2025-10-13T22:35:37.497232] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-13T22:35:37.498273] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-13T22:35:37.498125] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-13T22:35:37.499575] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-13T22:35:37.499290] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-13T22:35:37.501861] [INFO ] [MAIN ] Derivative Progress: 298/1810 symbols completed. BXC took 1.2s. Estimated remaining: 9m 53s. Rate: 152.9 symbols/min [2025-10-13T22:35:37.516981] [INFO ] [MAIN ] Derivative Progress: 299/1810 symbols completed. BWXT took 1.3s. Estimated remaining: 9m 51s. Rate: 153.4 symbols/min [2025-10-13T22:35:37.521689] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-13T22:35:37.521784] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-13T22:35:37.525053] [INFO ] [MAIN ] Derivative Progress: 300/1810 symbols completed. BX took 1.3s. Estimated remaining: 9m 49s. Rate: 153.9 symbols/min [2025-10-13T22:35:37.525552] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:37.525883] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:37.525710] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:37.553439] [DEBUG] [LOCAL ] BXMX: Loaded 19531 existing records from primary storage. [2025-10-13T22:35:37.553669] [INFO ] [MAIN ] BXMX: Loaded 19531 primary data records. [2025-10-13T22:35:37.796276] [DEBUG] [LOCAL ] BXP: Loaded 49840 existing records from primary storage. [2025-10-13T22:35:37.796501] [INFO ] [MAIN ] BXP: Loaded 49840 primary data records. [2025-10-13T22:35:37.808762] [DEBUG] [LOCAL ] BXMT: Loaded 47241 existing records from primary storage. [2025-10-13T22:35:37.962583] [INFO ] [MAIN ] BXMT: Loaded 47241 primary data records. [2025-10-13T22:35:38.603885] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:38.605195] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19531 primary records. [2025-10-13T22:35:38.605300] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-13T22:35:38.625858] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-13T22:35:38.627015] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-13T22:35:38.629527] [INFO ] [MAIN ] Derivative Progress: 301/1810 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 52s. Rate: 152.9 symbols/min [2025-10-13T22:35:38.642846] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:38.643436] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:38.644222] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49840 primary records. [2025-10-13T22:35:38.644596] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-13T22:35:38.663960] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-13T22:35:38.664852] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-13T22:35:38.667993] [INFO ] [MAIN ] Derivative Progress: 302/1810 symbols completed. BXP took 1.1s. Estimated remaining: 9m 50s. Rate: 153.4 symbols/min [2025-10-13T22:35:38.681118] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:38.681804] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:38.683050] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47241 primary records. [2025-10-13T22:35:38.683257] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-13T22:35:38.701302] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-13T22:35:38.701585] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-13T22:35:38.704939] [INFO ] [MAIN ] Derivative Progress: 303/1810 symbols completed. BXMT took 1.2s. Estimated remaining: 9m 48s. Rate: 153.9 symbols/min [2025-10-13T22:35:38.705198] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:38.735276] [DEBUG] [LOCAL ] BY: Loaded 21757 existing records from primary storage. [2025-10-13T22:35:38.750172] [INFO ] [MAIN ] BY: Loaded 21757 primary data records. [2025-10-13T22:35:38.751769] [DEBUG] [LOCAL ] BXSL: Loaded 48025 existing records from primary storage. [2025-10-13T22:35:38.788937] [INFO ] [MAIN ] BXSL: Loaded 48025 primary data records. [2025-10-13T22:35:39.115922] [DEBUG] [LOCAL ] BYD: Loaded 44846 existing records from primary storage. [2025-10-13T22:35:39.185821] [INFO ] [MAIN ] BYD: Loaded 44846 primary data records. [2025-10-13T22:35:39.745599] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:39.747524] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21757 primary records. [2025-10-13T22:35:39.748663] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-13T22:35:39.778352] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:39.779737] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 48025 primary records. [2025-10-13T22:35:39.780930] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-13T22:35:39.782813] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-13T22:35:39.784582] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-13T22:35:39.794366] [INFO ] [MAIN ] Derivative Progress: 304/1810 symbols completed. BY took 1.1s. Estimated remaining: 9m 51s. Rate: 153.0 symbols/min [2025-10-13T22:35:39.794617] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:39.815243] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:39.817170] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44846 primary records. [2025-10-13T22:35:39.820727] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-13T22:35:39.822861] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-13T22:35:39.823273] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-13T22:35:39.842500] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-13T22:35:39.837571] [INFO ] [MAIN ] Derivative Progress: 305/1810 symbols completed. BXSL took 1.2s. Estimated remaining: 9m 49s. Rate: 153.4 symbols/min [2025-10-13T22:35:39.847085] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-13T22:35:39.850982] [DEBUG] [LOCAL ] BYM: Loaded 11777 existing records from primary storage. [2025-10-13T22:35:39.851179] [INFO ] [MAIN ] BYM: Loaded 11777 primary data records. [2025-10-13T22:35:39.850537] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:39.851252] [INFO ] [MAIN ] Derivative Progress: 306/1810 symbols completed. BYD took 1.1s. Estimated remaining: 9m 46s. Rate: 153.9 symbols/min [2025-10-13T22:35:39.892133] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:40.206729] [DEBUG] [LOCAL ] BZH: Loaded 32456 existing records from primary storage. [2025-10-13T22:35:40.207008] [INFO ] [MAIN ] BZH: Loaded 32456 primary data records. [2025-10-13T22:35:40.409278] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-13T22:35:40.433623] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-13T22:35:40.902570] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:40.903497] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11777 primary records. [2025-10-13T22:35:40.903839] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-13T22:35:40.921943] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-13T22:35:40.922419] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-13T22:35:40.925037] [INFO ] [MAIN ] Derivative Progress: 307/1810 symbols completed. BYM took 1.1s. Estimated remaining: 9m 49s. Rate: 153.0 symbols/min [2025-10-13T22:35:40.925297] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:40.944220] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:40.945155] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32456 primary records. [2025-10-13T22:35:40.945468] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-13T22:35:40.974452] [DEBUG] [LOCAL ] CAAP: Loaded 19758 existing records from primary storage. [2025-10-13T22:35:40.974143] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-13T22:35:40.974699] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-13T22:35:40.974570] [INFO ] [MAIN ] CAAP: Loaded 19758 primary data records. [2025-10-13T22:35:40.977382] [INFO ] [MAIN ] Derivative Progress: 308/1810 symbols completed. BZH took 1.1s. Estimated remaining: 9m 47s. Rate: 153.5 symbols/min [2025-10-13T22:35:40.977704] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:41.116332] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:41.172769] [DEBUG] [LOCAL ] CABO: Loaded 16807 existing records from primary storage. [2025-10-13T22:35:41.209114] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-13T22:35:41.208422] [INFO ] [MAIN ] CABO: Loaded 16807 primary data records. [2025-10-13T22:35:41.311415] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-13T22:35:41.458874] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-13T22:35:41.504621] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-13T22:35:41.658203] [INFO ] [MAIN ] Derivative Progress: 309/1810 symbols completed. C took 1.8s. Estimated remaining: 9m 48s. Rate: 153.1 symbols/min [2025-10-13T22:35:41.660544] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:41.701668] [DEBUG] [LOCAL ] CACI: Loaded 23367 existing records from primary storage. [2025-10-13T22:35:41.700828] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:41.702889] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19758 primary records. [2025-10-13T22:35:41.703254] [INFO ] [MAIN ] CACI: Loaded 23367 primary data records. [2025-10-13T22:35:41.703334] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-13T22:35:41.832806] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-13T22:35:41.843727] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-13T22:35:41.913063] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:41.904939] [INFO ] [MAIN ] Derivative Progress: 310/1810 symbols completed. CAAP took 1.0s. Estimated remaining: 9m 47s. Rate: 153.3 symbols/min [2025-10-13T22:35:41.932576] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:41.933693] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16807 primary records. [2025-10-13T22:35:42.078992] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-13T22:35:42.144721] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-13T22:35:42.145863] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-13T22:35:42.148701] [INFO ] [MAIN ] Derivative Progress: 311/1810 symbols completed. CABO took 1.2s. Estimated remaining: 9m 46s. Rate: 153.5 symbols/min [2025-10-13T22:35:42.149084] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:42.185992] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:42.210366] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 23367 primary records. [2025-10-13T22:35:42.210555] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-13T22:35:42.211958] [DEBUG] [LOCAL ] CADE: Loaded 49361 existing records from primary storage. [2025-10-13T22:35:42.213227] [INFO ] [MAIN ] CADE: Loaded 49361 primary data records. [2025-10-13T22:35:42.344846] [DEBUG] [LOCAL ] CAE: Loaded 39244 existing records from primary storage. [2025-10-13T22:35:42.347566] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-13T22:35:42.347223] [INFO ] [MAIN ] CAE: Loaded 39244 primary data records. [2025-10-13T22:35:42.363242] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-13T22:35:42.450633] [INFO ] [MAIN ] Derivative Progress: 312/1810 symbols completed. CACI took 0.8s. Estimated remaining: 9m 45s. Rate: 153.6 symbols/min [2025-10-13T22:35:42.487881] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:42.688132] [DEBUG] [LOCAL ] CAF: Loaded 3452 existing records from primary storage. [2025-10-13T22:35:42.699553] [INFO ] [MAIN ] CAF: Loaded 3452 primary data records. [2025-10-13T22:35:43.266004] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:43.267439] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49361 primary records. [2025-10-13T22:35:43.267763] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-13T22:35:43.285203] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-13T22:35:43.285476] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-13T22:35:43.287853] [INFO ] [MAIN ] Derivative Progress: 313/1810 symbols completed. CADE took 1.4s. Estimated remaining: 9m 47s. Rate: 153.0 symbols/min [2025-10-13T22:35:43.305712] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:43.306524] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39244 primary records. [2025-10-13T22:35:43.306731] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-13T22:35:43.325545] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-13T22:35:43.325754] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-13T22:35:43.328575] [INFO ] [MAIN ] Derivative Progress: 314/1810 symbols completed. CAE took 1.2s. Estimated remaining: 9m 45s. Rate: 153.4 symbols/min [2025-10-13T22:35:43.341339] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:43.342003] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3452 primary records. [2025-10-13T22:35:43.342067] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-13T22:35:43.356429] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-13T22:35:43.356527] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-13T22:35:43.359768] [INFO ] [MAIN ] Derivative Progress: 315/1810 symbols completed. CAF took 0.9s. Estimated remaining: 9m 43s. Rate: 153.9 symbols/min [2025-10-13T22:35:43.360227] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:43.360353] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:43.360474] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:43.436891] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-13T22:35:43.448690] [INFO ] [MAIN ] CAG: Loaded 53665 primary data records. [2025-10-13T22:35:43.494574] [DEBUG] [LOCAL ] CAL: Loaded 43025 existing records from primary storage. [2025-10-13T22:35:43.507484] [DEBUG] [LOCAL ] CAH: Loaded 51475 existing records from primary storage. [2025-10-13T22:35:43.506741] [INFO ] [MAIN ] CAL: Loaded 43025 primary data records. [2025-10-13T22:35:43.529122] [INFO ] [MAIN ] CAH: Loaded 51475 primary data records. [2025-10-13T22:35:44.463917] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:44.465243] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53665 primary records. [2025-10-13T22:35:44.465438] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-13T22:35:44.483898] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-13T22:35:44.486231] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-13T22:35:44.488364] [INFO ] [MAIN ] Derivative Progress: 316/1810 symbols completed. CAG took 1.1s. Estimated remaining: 9m 46s. Rate: 153.0 symbols/min [2025-10-13T22:35:44.489818] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:44.504820] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:44.513978] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43025 primary records. [2025-10-13T22:35:44.514201] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-13T22:35:44.520626] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:44.529924] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51475 primary records. [2025-10-13T22:35:44.532824] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-13T22:35:44.553525] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-13T22:35:44.554448] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-13T22:35:44.558349] [INFO ] [MAIN ] Derivative Progress: 317/1810 symbols completed. CAH took 1.2s. Estimated remaining: 9m 44s. Rate: 153.4 symbols/min [2025-10-13T22:35:44.558483] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-13T22:35:44.567981] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:44.568190] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-13T22:35:44.571366] [INFO ] [MAIN ] Derivative Progress: 318/1810 symbols completed. CAL took 1.2s. Estimated remaining: 9m 42s. Rate: 153.8 symbols/min [2025-10-13T22:35:44.571771] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:44.591089] [DEBUG] [LOCAL ] CAPL: Loaded 5669 existing records from primary storage. [2025-10-13T22:35:44.591259] [INFO ] [MAIN ] CAPL: Loaded 5669 primary data records. [2025-10-13T22:35:44.609313] [DEBUG] [LOCAL ] CALX: Loaded 37689 existing records from primary storage. [2025-10-13T22:35:44.655055] [INFO ] [MAIN ] CALX: Loaded 37689 primary data records. [2025-10-13T22:35:45.122864] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-13T22:35:45.234001] [INFO ] [MAIN ] CARR: Loaded 53602 primary data records. [2025-10-13T22:35:45.572778] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:45.586624] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5669 primary records. [2025-10-13T22:35:45.585879] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:45.586837] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-13T22:35:45.588510] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37689 primary records. [2025-10-13T22:35:45.588621] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-13T22:35:45.617214] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-13T22:35:45.621747] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-13T22:35:45.621906] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-13T22:35:45.621849] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-13T22:35:45.624468] [INFO ] [MAIN ] Derivative Progress: 319/1810 symbols completed. CALX took 1.1s. Estimated remaining: 9m 45s. Rate: 153.0 symbols/min [2025-10-13T22:35:45.627155] [INFO ] [MAIN ] Derivative Progress: 320/1810 symbols completed. CAPL took 1.1s. Estimated remaining: 9m 42s. Rate: 153.5 symbols/min [2025-10-13T22:35:45.627078] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:45.627284] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:45.647073] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:45.647882] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53602 primary records. [2025-10-13T22:35:45.647999] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-13T22:35:45.665963] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-13T22:35:45.666199] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-13T22:35:45.669351] [INFO ] [MAIN ] Derivative Progress: 321/1810 symbols completed. CARR took 1.1s. Estimated remaining: 9m 40s. Rate: 153.9 symbols/min [2025-10-13T22:35:45.669631] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:45.701053] [DEBUG] [LOCAL ] CATO: Loaded 6798 existing records from primary storage. [2025-10-13T22:35:45.701197] [INFO ] [MAIN ] CATO: Loaded 6798 primary data records. [2025-10-13T22:35:45.826265] [DEBUG] [LOCAL ] CARS: Loaded 39733 existing records from primary storage. [2025-10-13T22:35:45.838598] [DEBUG] [LOCAL ] CAT: Loaded 52927 existing records from primary storage. [2025-10-13T22:35:45.838690] [INFO ] [MAIN ] CARS: Loaded 39733 primary data records. [2025-10-13T22:35:45.844429] [INFO ] [MAIN ] CAT: Loaded 52927 primary data records. [2025-10-13T22:35:46.799261] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:46.800510] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6798 primary records. [2025-10-13T22:35:46.801143] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-13T22:35:46.818925] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-13T22:35:46.819725] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-13T22:35:46.821990] [INFO ] [MAIN ] Derivative Progress: 322/1810 symbols completed. CATO took 1.2s. Estimated remaining: 9m 44s. Rate: 153.0 symbols/min [2025-10-13T22:35:46.822457] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:46.839567] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:46.853395] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39733 primary records. [2025-10-13T22:35:46.853534] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-13T22:35:46.854474] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:46.864126] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52927 primary records. [2025-10-13T22:35:46.867158] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-13T22:35:46.889144] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-13T22:35:46.890189] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-13T22:35:46.893177] [INFO ] [MAIN ] Derivative Progress: 323/1810 symbols completed. CAT took 1.3s. Estimated remaining: 9m 42s. Rate: 153.4 symbols/min [2025-10-13T22:35:46.890097] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-13T22:35:46.893519] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:46.893394] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-13T22:35:46.896872] [INFO ] [MAIN ] Derivative Progress: 324/1810 symbols completed. CARS took 1.3s. Estimated remaining: 9m 39s. Rate: 153.9 symbols/min [2025-10-13T22:35:46.911150] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:46.923848] [DEBUG] [LOCAL ] CBAN: Loaded 10523 existing records from primary storage. [2025-10-13T22:35:46.924056] [INFO ] [MAIN ] CBAN: Loaded 10523 primary data records. [2025-10-13T22:35:47.049711] [DEBUG] [LOCAL ] CAVA: Loaded 53568 existing records from primary storage. [2025-10-13T22:35:47.055676] [INFO ] [MAIN ] CAVA: Loaded 53568 primary data records. [2025-10-13T22:35:47.285398] [DEBUG] [LOCAL ] CB: Loaded 49917 existing records from primary storage. [2025-10-13T22:35:47.368696] [INFO ] [MAIN ] CB: Loaded 49917 primary data records. [2025-10-13T22:35:47.937376] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:47.938687] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10523 primary records. [2025-10-13T22:35:47.939218] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-13T22:35:47.972547] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:47.974620] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53568 primary records. [2025-10-13T22:35:47.975119] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-13T22:35:47.976026] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-13T22:35:47.976227] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-13T22:35:47.978634] [INFO ] [MAIN ] Derivative Progress: 325/1810 symbols completed. CBAN took 1.1s. Estimated remaining: 9m 42s. Rate: 153.0 symbols/min [2025-10-13T22:35:47.980214] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:48.019972] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:48.020982] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-13T22:35:48.021235] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-13T22:35:48.022023] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49917 primary records. [2025-10-13T22:35:48.022243] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-13T22:35:48.025551] [INFO ] [MAIN ] Derivative Progress: 326/1810 symbols completed. CAVA took 1.2s. Estimated remaining: 9m 40s. Rate: 153.4 symbols/min [2025-10-13T22:35:48.043441] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:48.047839] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-13T22:35:48.048901] [DEBUG] [LOCAL ] CBL: Loaded 16249 existing records from primary storage. [2025-10-13T22:35:48.048343] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-13T22:35:48.052931] [INFO ] [MAIN ] CBL: Loaded 16249 primary data records. [2025-10-13T22:35:48.052087] [INFO ] [MAIN ] Derivative Progress: 327/1810 symbols completed. CB took 1.2s. Estimated remaining: 9m 38s. Rate: 153.9 symbols/min [2025-10-13T22:35:48.053249] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:48.096520] [DEBUG] [LOCAL ] CBNA: Loaded 2916 existing records from primary storage. [2025-10-13T22:35:48.125864] [INFO ] [MAIN ] CBNA: Loaded 2916 primary data records. [2025-10-13T22:35:48.732917] [DEBUG] [LOCAL ] CBRE: Loaded 50384 existing records from primary storage. [2025-10-13T22:35:48.742761] [INFO ] [MAIN ] CBRE: Loaded 50384 primary data records. [2025-10-13T22:35:49.077263] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:49.079301] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16249 primary records. [2025-10-13T22:35:49.091671] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-13T22:35:49.093041] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:35:49.094920] [INFO ] [MAIN ] CBNA: Generated 1791 derivative records from 2916 primary records. [2025-10-13T22:35:49.095277] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-13T22:35:49.124497] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1791 records). [2025-10-13T22:35:49.124602] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-13T22:35:49.127964] [INFO ] [MAIN ] Derivative Progress: 328/1810 symbols completed. CBNA took 1.1s. Estimated remaining: 9m 41s. Rate: 153.1 symbols/min [2025-10-13T22:35:49.131280] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-13T22:35:49.131524] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-13T22:35:49.134107] [INFO ] [MAIN ] Derivative Progress: 329/1810 symbols completed. CBL took 1.2s. Estimated remaining: 9m 39s. Rate: 153.5 symbols/min [2025-10-13T22:35:49.150032] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:49.150776] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50384 primary records. [2025-10-13T22:35:49.150840] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-13T22:35:49.167239] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-13T22:35:49.167389] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-13T22:35:49.170206] [INFO ] [MAIN ] Derivative Progress: 330/1810 symbols completed. CBRE took 1.1s. Estimated remaining: 9m 37s. Rate: 153.9 symbols/min [2025-10-13T22:35:49.170937] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:49.171073] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:49.171686] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:49.212135] [DEBUG] [LOCAL ] CBU: Loaded 22651 existing records from primary storage. [2025-10-13T22:35:49.212887] [INFO ] [MAIN ] CBU: Loaded 22651 primary data records. [2025-10-13T22:35:49.302507] [DEBUG] [LOCAL ] CBT: Loaded 30960 existing records from primary storage. [2025-10-13T22:35:49.319176] [INFO ] [MAIN ] CBT: Loaded 30960 primary data records. [2025-10-13T22:35:49.333179] [DEBUG] [LOCAL ] CBZ: Loaded 34102 existing records from primary storage. [2025-10-13T22:35:49.336872] [INFO ] [MAIN ] CBZ: Loaded 34102 primary data records. [2025-10-13T22:35:50.183067] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:50.184386] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22651 primary records. [2025-10-13T22:35:50.185422] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-13T22:35:50.216324] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:50.217296] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30960 primary records. [2025-10-13T22:35:50.218891] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-13T22:35:50.221762] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-13T22:35:50.222685] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-13T22:35:50.224900] [INFO ] [MAIN ] Derivative Progress: 331/1810 symbols completed. CBU took 1.1s. Estimated remaining: 9m 39s. Rate: 153.2 symbols/min [2025-10-13T22:35:50.225469] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:50.252336] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:50.253724] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 34102 primary records. [2025-10-13T22:35:50.254797] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-13T22:35:50.272081] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-13T22:35:50.274981] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-13T22:35:50.280025] [INFO ] [MAIN ] Derivative Progress: 332/1810 symbols completed. CBT took 1.1s. Estimated remaining: 9m 38s. Rate: 153.5 symbols/min [2025-10-13T22:35:50.280276] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:50.282273] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-13T22:35:50.282536] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-13T22:35:50.285622] [INFO ] [MAIN ] Derivative Progress: 333/1810 symbols completed. CBZ took 1.1s. Estimated remaining: 9m 35s. Rate: 154.0 symbols/min [2025-10-13T22:35:50.285917] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:50.324214] [DEBUG] [LOCAL ] CCIF: Loaded 15647 existing records from primary storage. [2025-10-13T22:35:50.324492] [INFO ] [MAIN ] CCIF: Loaded 15647 primary data records. [2025-10-13T22:35:50.443763] [DEBUG] [LOCAL ] CC: Loaded 52999 existing records from primary storage. [2025-10-13T22:35:50.444589] [INFO ] [MAIN ] CC: Loaded 52999 primary data records. [2025-10-13T22:35:50.808025] [DEBUG] [LOCAL ] CCI: Loaded 53123 existing records from primary storage. [2025-10-13T22:35:50.814211] [INFO ] [MAIN ] CCI: Loaded 53123 primary data records. [2025-10-13T22:35:51.371623] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:51.373182] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15647 primary records. [2025-10-13T22:35:51.373982] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-13T22:35:51.394161] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-13T22:35:51.394286] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-13T22:35:51.396711] [INFO ] [MAIN ] Derivative Progress: 334/1810 symbols completed. CCIF took 1.1s. Estimated remaining: 9m 38s. Rate: 153.2 symbols/min [2025-10-13T22:35:51.398044] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:51.413194] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:51.414327] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 52999 primary records. [2025-10-13T22:35:51.414470] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-13T22:35:51.432831] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-13T22:35:51.433065] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-13T22:35:51.436453] [INFO ] [MAIN ] Derivative Progress: 335/1810 symbols completed. CC took 1.2s. Estimated remaining: 9m 36s. Rate: 153.6 symbols/min [2025-10-13T22:35:51.436775] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:51.453833] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:51.454617] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53123 primary records. [2025-10-13T22:35:51.454759] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-13T22:35:51.472866] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-13T22:35:51.487265] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-13T22:35:51.492391] [INFO ] [MAIN ] Derivative Progress: 336/1810 symbols completed. CCI took 1.2s. Estimated remaining: 9m 34s. Rate: 154.0 symbols/min [2025-10-13T22:35:51.492835] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:51.522857] [DEBUG] [LOCAL ] CCJ: Loaded 53684 existing records from primary storage. [2025-10-13T22:35:51.523126] [INFO ] [MAIN ] CCJ: Loaded 53684 primary data records. [2025-10-13T22:35:51.652444] [DEBUG] [LOCAL ] CCK: Loaded 46359 existing records from primary storage. [2025-10-13T22:35:51.667054] [INFO ] [MAIN ] CCK: Loaded 46359 primary data records. [2025-10-13T22:35:51.848134] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-13T22:35:51.992207] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-13T22:35:52.629805] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:52.631884] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53684 primary records. [2025-10-13T22:35:52.632271] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-13T22:35:52.659928] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:52.662323] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46359 primary records. [2025-10-13T22:35:52.662830] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-13T22:35:52.682048] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-13T22:35:52.682246] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-13T22:35:52.685980] [INFO ] [MAIN ] Derivative Progress: 337/1810 symbols completed. CCK took 1.2s. Estimated remaining: 9m 38s. Rate: 153.0 symbols/min [2025-10-13T22:35:52.686359] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:52.690466] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-13T22:35:52.691675] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-13T22:35:52.694022] [INFO ] [MAIN ] Derivative Progress: 338/1810 symbols completed. CCJ took 1.3s. Estimated remaining: 9m 35s. Rate: 153.5 symbols/min [2025-10-13T22:35:52.694373] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:52.708856] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:52.709585] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-13T22:35:52.709720] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-13T22:35:52.729690] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-13T22:35:52.734121] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-13T22:35:52.736930] [INFO ] [MAIN ] Derivative Progress: 339/1810 symbols completed. CCL took 1.2s. Estimated remaining: 9m 34s. Rate: 153.9 symbols/min [2025-10-13T22:35:52.737299] [DEBUG] [LOCAL ] CCRD: Loaded 9386 existing records from primary storage. [2025-10-13T22:35:52.737459] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:52.738098] [INFO ] [MAIN ] CCRD: Loaded 9386 primary data records. [2025-10-13T22:35:52.952680] [DEBUG] [LOCAL ] CCO: Loaded 48214 existing records from primary storage. [2025-10-13T22:35:52.958414] [INFO ] [MAIN ] CCO: Loaded 48214 primary data records. [2025-10-13T22:35:52.935099] [DEBUG] [LOCAL ] CCU: Loaded 22590 existing records from primary storage. [2025-10-13T22:35:52.958560] [INFO ] [MAIN ] CCU: Loaded 22590 primary data records. [2025-10-13T22:35:53.747515] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:53.748803] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9386 primary records. [2025-10-13T22:35:53.748936] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-13T22:35:53.767563] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-13T22:35:53.768119] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-13T22:35:53.770373] [INFO ] [MAIN ] Derivative Progress: 340/1810 symbols completed. CCRD took 1.1s. Estimated remaining: 9m 36s. Rate: 153.1 symbols/min [2025-10-13T22:35:53.770895] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:53.795390] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:53.797411] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48214 primary records. [2025-10-13T22:35:53.797610] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-13T22:35:53.812933] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:53.825909] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 22590 primary records. [2025-10-13T22:35:53.826785] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-13T22:35:53.862945] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-13T22:35:53.864556] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-13T22:35:53.864338] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-13T22:35:53.868371] [INFO ] [MAIN ] Derivative Progress: 341/1810 symbols completed. CCU took 1.1s. Estimated remaining: 9m 34s. Rate: 153.5 symbols/min [2025-10-13T22:35:53.868814] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-13T22:35:53.872161] [INFO ] [MAIN ] Derivative Progress: 342/1810 symbols completed. CCO took 1.2s. Estimated remaining: 9m 32s. Rate: 153.9 symbols/min [2025-10-13T22:35:53.871957] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:53.872967] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:53.895595] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-13T22:35:53.895967] [INFO ] [MAIN ] CDE: Loaded 53643 primary data records. [2025-10-13T22:35:53.965844] [DEBUG] [LOCAL ] CDLR: Loaded 9992 existing records from primary storage. [2025-10-13T22:35:53.971403] [INFO ] [MAIN ] CDLR: Loaded 9992 primary data records. [2025-10-13T22:35:54.348446] [DEBUG] [LOCAL ] CDP: Loaded 42558 existing records from primary storage. [2025-10-13T22:35:54.359168] [INFO ] [MAIN ] CDP: Loaded 42558 primary data records. [2025-10-13T22:35:54.891495] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:54.892780] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53643 primary records. [2025-10-13T22:35:54.892883] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-13T22:35:54.915775] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-13T22:35:54.916445] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-13T22:35:54.931936] [INFO ] [MAIN ] Derivative Progress: 343/1810 symbols completed. CDE took 1.2s. Estimated remaining: 9m 35s. Rate: 153.1 symbols/min [2025-10-13T22:35:54.929161] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:54.932885] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9992 primary records. [2025-10-13T22:35:54.933406] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-13T22:35:54.950975] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-13T22:35:54.963358] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-13T22:35:54.963298] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:54.964031] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42558 primary records. [2025-10-13T22:35:54.966819] [INFO ] [MAIN ] Derivative Progress: 344/1810 symbols completed. CDLR took 1.1s. Estimated remaining: 9m 33s. Rate: 153.6 symbols/min [2025-10-13T22:35:54.966906] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-13T22:35:54.982194] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-13T22:35:54.982251] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-13T22:35:54.985186] [INFO ] [MAIN ] Derivative Progress: 345/1810 symbols completed. CDP took 1.1s. Estimated remaining: 9m 31s. Rate: 154.0 symbols/min [2025-10-13T22:35:54.985804] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:54.985907] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:54.985989] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:54.994055] [DEBUG] [LOCAL ] CEE: Loaded 5436 existing records from primary storage. [2025-10-13T22:35:54.994358] [INFO ] [MAIN ] CEE: Loaded 5436 primary data records. [2025-10-13T22:35:55.315667] [DEBUG] [LOCAL ] CDRE: Loaded 24847 existing records from primary storage. [2025-10-13T22:35:55.330638] [INFO ] [MAIN ] CDRE: Loaded 24847 primary data records. [2025-10-13T22:35:55.337535] [DEBUG] [LOCAL ] CE: Loaded 51411 existing records from primary storage. [2025-10-13T22:35:55.366834] [INFO ] [MAIN ] CE: Loaded 51411 primary data records. [2025-10-13T22:35:56.048616] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:56.050034] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5436 primary records. [2025-10-13T22:35:56.051212] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-13T22:35:56.067885] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-13T22:35:56.068037] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-13T22:35:56.070917] [INFO ] [MAIN ] Derivative Progress: 346/1810 symbols completed. CEE took 1.1s. Estimated remaining: 9m 33s. Rate: 153.2 symbols/min [2025-10-13T22:35:56.072124] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:56.117113] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:56.117730] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:56.118498] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51411 primary records. [2025-10-13T22:35:56.118870] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-13T22:35:56.119436] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24847 primary records. [2025-10-13T22:35:56.119547] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-13T22:35:56.164977] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-13T22:35:56.162553] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-13T22:35:56.165130] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-13T22:35:56.165274] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-13T22:35:56.168167] [INFO ] [MAIN ] Derivative Progress: 347/1810 symbols completed. CE took 1.2s. Estimated remaining: 9m 32s. Rate: 153.5 symbols/min [2025-10-13T22:35:56.172594] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:56.173205] [INFO ] [MAIN ] Derivative Progress: 348/1810 symbols completed. CDRE took 1.2s. Estimated remaining: 9m 30s. Rate: 154.0 symbols/min [2025-10-13T22:35:56.169741] [DEBUG] [LOCAL ] CEPU: Loaded 26365 existing records from primary storage. [2025-10-13T22:35:56.173712] [INFO ] [MAIN ] CEPU: Loaded 26365 primary data records. [2025-10-13T22:35:56.173837] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:56.536474] [DEBUG] [LOCAL ] CF: Loaded 52116 existing records from primary storage. [2025-10-13T22:35:56.551231] [INFO ] [MAIN ] CF: Loaded 52116 primary data records. [2025-10-13T22:35:56.612421] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-13T22:35:56.635500] [INFO ] [MAIN ] CFG: Loaded 53622 primary data records. [2025-10-13T22:35:57.254101] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:57.256788] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 26365 primary records. [2025-10-13T22:35:57.257147] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-13T22:35:57.275402] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-13T22:35:57.275832] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-13T22:35:57.278671] [INFO ] [MAIN ] Derivative Progress: 349/1810 symbols completed. CEPU took 1.2s. Estimated remaining: 9m 32s. Rate: 153.1 symbols/min [2025-10-13T22:35:57.280543] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:57.335636] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:57.336217] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:57.337706] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52116 primary records. [2025-10-13T22:35:57.338959] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-13T22:35:57.338869] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53622 primary records. [2025-10-13T22:35:57.339205] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-13T22:35:57.387183] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-13T22:35:57.386975] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-13T22:35:57.387724] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-13T22:35:57.387471] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-13T22:35:57.390665] [INFO ] [MAIN ] Derivative Progress: 350/1810 symbols completed. CFG took 1.2s. Estimated remaining: 9m 31s. Rate: 153.5 symbols/min [2025-10-13T22:35:57.390838] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:57.392169] [DEBUG] [LOCAL ] CFR: Loaded 32698 existing records from primary storage. [2025-10-13T22:35:57.396208] [INFO ] [MAIN ] CFR: Loaded 32698 primary data records. [2025-10-13T22:35:57.396075] [INFO ] [MAIN ] Derivative Progress: 351/1810 symbols completed. CF took 1.2s. Estimated remaining: 9m 29s. Rate: 153.9 symbols/min [2025-10-13T22:35:57.396570] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:57.457994] [DEBUG] [LOCAL ] CGV: Loaded 1391 existing records from primary storage. [2025-10-13T22:35:57.467142] [INFO ] [MAIN ] CGV: Loaded 1391 primary data records. [2025-10-13T22:35:57.709751] [DEBUG] [LOCAL ] CHCT: Loaded 24096 existing records from primary storage. [2025-10-13T22:35:57.857838] [INFO ] [MAIN ] CHCT: Loaded 24096 primary data records. [2025-10-13T22:35:58.386339] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:58.391016] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 32698 primary records. [2025-10-13T22:35:58.391559] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-13T22:35:58.406269] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:35:58.414915] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1391 primary records. [2025-10-13T22:35:58.415269] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-13T22:35:58.426082] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-13T22:35:58.442638] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-13T22:35:58.442901] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-13T22:35:58.438959] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-13T22:35:58.446075] [INFO ] [MAIN ] Derivative Progress: 352/1810 symbols completed. CFR took 1.2s. Estimated remaining: 9m 31s. Rate: 153.2 symbols/min [2025-10-13T22:35:58.462050] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:58.462235] [INFO ] [MAIN ] Derivative Progress: 353/1810 symbols completed. CGV took 1.1s. Estimated remaining: 9m 29s. Rate: 153.6 symbols/min [2025-10-13T22:35:58.463281] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:58.461725] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:58.464828] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24096 primary records. [2025-10-13T22:35:58.464926] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-13T22:35:58.482501] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-13T22:35:58.482716] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-13T22:35:58.485782] [INFO ] [MAIN ] Derivative Progress: 354/1810 symbols completed. CHCT took 1.1s. Estimated remaining: 9m 27s. Rate: 154.0 symbols/min [2025-10-13T22:35:58.486157] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:58.507411] [DEBUG] [LOCAL ] CHE: Loaded 15364 existing records from primary storage. [2025-10-13T22:35:58.507761] [INFO ] [MAIN ] CHE: Loaded 15364 primary data records. [2025-10-13T22:35:58.723350] [DEBUG] [LOCAL ] CHGG: Loaded 47763 existing records from primary storage. [2025-10-13T22:35:58.733019] [INFO ] [MAIN ] CHGG: Loaded 47763 primary data records. [2025-10-13T22:35:58.767425] [DEBUG] [LOCAL ] CHD: Loaded 52293 existing records from primary storage. [2025-10-13T22:35:58.792361] [INFO ] [MAIN ] CHD: Loaded 52293 primary data records. [2025-10-13T22:35:59.603724] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:59.605136] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15364 primary records. [2025-10-13T22:35:59.605821] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-13T22:35:59.625012] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-13T22:35:59.625187] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-13T22:35:59.627441] [INFO ] [MAIN ] Derivative Progress: 355/1810 symbols completed. CHE took 1.2s. Estimated remaining: 9m 30s. Rate: 153.2 symbols/min [2025-10-13T22:35:59.627800] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:59.663988] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:59.665962] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52293 primary records. [2025-10-13T22:35:59.672197] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-13T22:35:59.687895] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:35:59.704683] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-13T22:35:59.704589] [DEBUG] [LOCAL ] CHMI: Loaded 21617 existing records from primary storage. [2025-10-13T22:35:59.704922] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-13T22:35:59.705036] [INFO ] [MAIN ] CHMI: Loaded 21617 primary data records. [2025-10-13T22:35:59.699756] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47763 primary records. [2025-10-13T22:35:59.707385] [INFO ] [MAIN ] Derivative Progress: 356/1810 symbols completed. CHD took 1.2s. Estimated remaining: 9m 28s. Rate: 153.5 symbols/min [2025-10-13T22:35:59.707898] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-13T22:35:59.707746] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:35:59.789009] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-13T22:35:59.816590] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-13T22:35:59.831255] [INFO ] [MAIN ] Derivative Progress: 357/1810 symbols completed. CHGG took 1.3s. Estimated remaining: 9m 27s. Rate: 153.8 symbols/min [2025-10-13T22:35:59.831779] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:00.047269] [DEBUG] [LOCAL ] CHT: Loaded 19498 existing records from primary storage. [2025-10-13T22:36:00.059300] [INFO ] [MAIN ] CHT: Loaded 19498 primary data records. [2025-10-13T22:36:00.106747] [DEBUG] [LOCAL ] CHPT: Loaded 47848 existing records from primary storage. [2025-10-13T22:36:00.132421] [INFO ] [MAIN ] CHPT: Loaded 47848 primary data records. [2025-10-13T22:36:00.740141] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:00.741283] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21617 primary records. [2025-10-13T22:36:00.742427] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-13T22:36:00.759355] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-13T22:36:00.759605] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-13T22:36:00.762345] [INFO ] [MAIN ] Derivative Progress: 358/1810 symbols completed. CHMI took 1.1s. Estimated remaining: 9m 29s. Rate: 153.2 symbols/min [2025-10-13T22:36:00.783718] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:00.784720] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19498 primary records. [2025-10-13T22:36:00.784799] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-13T22:36:00.803423] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-10-13T22:36:00.803588] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-13T22:36:00.805665] [INFO ] [MAIN ] Derivative Progress: 359/1810 symbols completed. CHT took 1.0s. Estimated remaining: 9m 27s. Rate: 153.6 symbols/min [2025-10-13T22:36:00.818211] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:00.818894] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 47848 primary records. [2025-10-13T22:36:00.818954] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-13T22:36:00.834293] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-13T22:36:00.834350] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-13T22:36:00.837392] [INFO ] [MAIN ] Derivative Progress: 360/1810 symbols completed. CHPT took 1.1s. Estimated remaining: 9m 25s. Rate: 154.0 symbols/min [2025-10-13T22:36:00.838084] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:00.838264] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:00.838214] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:00.854575] [DEBUG] [LOCAL ] CIA: Loaded 16686 existing records from primary storage. [2025-10-13T22:36:00.854762] [INFO ] [MAIN ] CIA: Loaded 16686 primary data records. [2025-10-13T22:36:01.193781] [DEBUG] [LOCAL ] CHWY: Loaded 53653 existing records from primary storage. [2025-10-13T22:36:01.208784] [INFO ] [MAIN ] CHWY: Loaded 53653 primary data records. [2025-10-13T22:36:01.243477] [DEBUG] [LOCAL ] CI: Loaded 49808 existing records from primary storage. [2025-10-13T22:36:01.293109] [INFO ] [MAIN ] CI: Loaded 49808 primary data records. [2025-10-13T22:36:01.870070] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:01.871780] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16686 primary records. [2025-10-13T22:36:01.871868] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-13T22:36:01.891346] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-13T22:36:01.892814] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-13T22:36:01.895520] [INFO ] [MAIN ] Derivative Progress: 361/1810 symbols completed. CIA took 1.1s. Estimated remaining: 9m 27s. Rate: 153.2 symbols/min [2025-10-13T22:36:01.896000] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:01.905145] [DEBUG] [LOCAL ] CIF: Loaded 4061 existing records from primary storage. [2025-10-13T22:36:01.905524] [INFO ] [MAIN ] CIF: Loaded 4061 primary data records. [2025-10-13T22:36:02.044607] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:02.105479] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53653 primary records. [2025-10-13T22:36:02.112395] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-13T22:36:02.250859] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:02.253433] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49808 primary records. [2025-10-13T22:36:02.256394] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-13T22:36:02.262979] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-13T22:36:02.278916] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-13T22:36:02.279092] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-13T22:36:02.279029] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-13T22:36:02.281672] [INFO ] [MAIN ] Derivative Progress: 362/1810 symbols completed. CHWY took 1.4s. Estimated remaining: 9m 27s. Rate: 153.2 symbols/min [2025-10-13T22:36:02.285453] [INFO ] [MAIN ] Derivative Progress: 363/1810 symbols completed. CI took 1.4s. Estimated remaining: 9m 25s. Rate: 153.7 symbols/min [2025-10-13T22:36:02.285382] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:02.285806] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:02.292671] [DEBUG] [LOCAL ] CIMN: Loaded 2757 existing records from primary storage. [2025-10-13T22:36:02.293108] [INFO ] [MAIN ] CIMN: Loaded 2757 primary data records. [2025-10-13T22:36:02.431422] [DEBUG] [LOCAL ] CII: Loaded 15346 existing records from primary storage. [2025-10-13T22:36:02.487489] [INFO ] [MAIN ] CII: Loaded 15346 primary data records. [2025-10-13T22:36:02.673695] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:02.690267] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4061 primary records. [2025-10-13T22:36:02.715339] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-13T22:36:02.791270] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-13T22:36:02.821197] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-13T22:36:02.834666] [INFO ] [MAIN ] Derivative Progress: 364/1810 symbols completed. CIF took 0.9s. Estimated remaining: 9m 25s. Rate: 153.5 symbols/min [2025-10-13T22:36:02.894834] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:03.031177] [DEBUG] [LOCAL ] CIO: Loaded 20708 existing records from primary storage. [2025-10-13T22:36:03.032470] [INFO ] [MAIN ] CIO: Loaded 20708 primary data records. [2025-10-13T22:36:03.032066] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:36:03.039482] [INFO ] [MAIN ] CIMN: Generated 1793 derivative records from 2757 primary records. [2025-10-13T22:36:03.039752] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-13T22:36:03.106880] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1793 records). [2025-10-13T22:36:03.126080] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-13T22:36:03.141785] [INFO ] [MAIN ] Derivative Progress: 365/1810 symbols completed. CIMN took 0.9s. Estimated remaining: 9m 25s. Rate: 153.6 symbols/min [2025-10-13T22:36:03.147131] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:03.399339] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:03.400332] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15346 primary records. [2025-10-13T22:36:03.400556] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-13T22:36:03.437098] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-13T22:36:03.437731] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-13T22:36:03.440873] [INFO ] [MAIN ] Derivative Progress: 366/1810 symbols completed. CII took 1.2s. Estimated remaining: 9m 24s. Rate: 153.7 symbols/min [2025-10-13T22:36:03.441885] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:03.470212] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-13T22:36:03.476053] [DEBUG] [LOCAL ] CLCO: Loaded 12940 existing records from primary storage. [2025-10-13T22:36:03.476506] [INFO ] [MAIN ] CL: Loaded 53648 primary data records. [2025-10-13T22:36:03.476722] [INFO ] [MAIN ] CLCO: Loaded 12940 primary data records. [2025-10-13T22:36:03.943413] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:04.000277] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20708 primary records. [2025-10-13T22:36:04.009185] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-13T22:36:04.160861] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-13T22:36:04.161052] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-13T22:36:04.164184] [INFO ] [MAIN ] Derivative Progress: 367/1810 symbols completed. CIO took 1.3s. Estimated remaining: 9m 25s. Rate: 153.3 symbols/min [2025-10-13T22:36:04.164718] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:04.199383] [DEBUG] [LOCAL ] CLDT: Loaded 25453 existing records from primary storage. [2025-10-13T22:36:04.201283] [INFO ] [MAIN ] CLDT: Loaded 25453 primary data records. [2025-10-13T22:36:04.249887] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:04.299123] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:04.319384] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53648 primary records. [2025-10-13T22:36:04.324704] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-13T22:36:04.339835] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12940 primary records. [2025-10-13T22:36:04.344969] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-13T22:36:04.576677] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-13T22:36:04.580984] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-13T22:36:04.580430] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-13T22:36:04.581102] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-13T22:36:04.584027] [INFO ] [MAIN ] Derivative Progress: 368/1810 symbols completed. CLCO took 1.1s. Estimated remaining: 9m 24s. Rate: 153.3 symbols/min [2025-10-13T22:36:04.588168] [INFO ] [MAIN ] Derivative Progress: 369/1810 symbols completed. CL took 1.4s. Estimated remaining: 9m 22s. Rate: 153.7 symbols/min [2025-10-13T22:36:04.588347] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:04.588129] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:04.624440] [DEBUG] [LOCAL ] CLH: Loaded 27824 existing records from primary storage. [2025-10-13T22:36:04.624863] [INFO ] [MAIN ] CLH: Loaded 27824 primary data records. [2025-10-13T22:36:04.698115] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:04.740813] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25453 primary records. [2025-10-13T22:36:04.752563] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-13T22:36:04.811216] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-13T22:36:04.822910] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-13T22:36:05.154401] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-13T22:36:05.174377] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-13T22:36:05.177441] [INFO ] [MAIN ] Derivative Progress: 370/1810 symbols completed. CLDT took 1.0s. Estimated remaining: 9m 23s. Rate: 153.5 symbols/min [2025-10-13T22:36:05.177662] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:05.429822] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:05.430876] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27824 primary records. [2025-10-13T22:36:05.431759] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-13T22:36:05.451557] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-13T22:36:05.451735] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-13T22:36:05.454399] [INFO ] [MAIN ] Derivative Progress: 371/1810 symbols completed. CLH took 0.9s. Estimated remaining: 9m 22s. Rate: 153.6 symbols/min [2025-10-13T22:36:05.454906] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:05.477808] [DEBUG] [LOCAL ] CLS: Loaded 53587 existing records from primary storage. [2025-10-13T22:36:05.478509] [INFO ] [MAIN ] CLS: Loaded 53587 primary data records. [2025-10-13T22:36:05.655800] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:05.817267] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-13T22:36:05.827265] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-13T22:36:05.864340] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-13T22:36:05.865909] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-13T22:36:05.869433] [INFO ] [MAIN ] Derivative Progress: 372/1810 symbols completed. CLF took 1.3s. Estimated remaining: 9m 22s. Rate: 153.6 symbols/min [2025-10-13T22:36:05.869728] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:05.865635] [DEBUG] [LOCAL ] CLVT: Loaded 51978 existing records from primary storage. [2025-10-13T22:36:05.871027] [INFO ] [MAIN ] CLVT: Loaded 51978 primary data records. [2025-10-13T22:36:06.078245] [DEBUG] [LOCAL ] CLW: Loaded 21621 existing records from primary storage. [2025-10-13T22:36:06.086726] [INFO ] [MAIN ] CLW: Loaded 21621 primary data records. [2025-10-13T22:36:06.256181] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:06.286498] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53587 primary records. [2025-10-13T22:36:06.304369] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-13T22:36:06.363372] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-13T22:36:06.369533] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-13T22:36:06.401597] [INFO ] [MAIN ] Derivative Progress: 373/1810 symbols completed. CLS took 1.2s. Estimated remaining: 9m 22s. Rate: 153.4 symbols/min [2025-10-13T22:36:06.582997] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:06.584346] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51978 primary records. [2025-10-13T22:36:06.584475] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-13T22:36:06.607606] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-13T22:36:06.608686] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-13T22:36:06.611558] [INFO ] [MAIN ] Derivative Progress: 374/1810 symbols completed. CLVT took 1.2s. Estimated remaining: 9m 21s. Rate: 153.6 symbols/min [2025-10-13T22:36:06.625355] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:06.626192] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21621 primary records. [2025-10-13T22:36:06.626256] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-13T22:36:06.642477] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-13T22:36:06.642572] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-13T22:36:06.645508] [INFO ] [MAIN ] Derivative Progress: 375/1810 symbols completed. CLW took 0.8s. Estimated remaining: 9m 19s. Rate: 154.0 symbols/min [2025-10-13T22:36:06.646157] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:06.646513] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:06.646374] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:06.676856] [DEBUG] [LOCAL ] CMBT: Loaded 25580 existing records from primary storage. [2025-10-13T22:36:06.677080] [INFO ] [MAIN ] CMBT: Loaded 25580 primary data records. [2025-10-13T22:36:06.863813] [DEBUG] [LOCAL ] CLX: Loaded 51636 existing records from primary storage. [2025-10-13T22:36:06.864541] [INFO ] [MAIN ] CLX: Loaded 51636 primary data records. [2025-10-13T22:36:06.876169] [DEBUG] [LOCAL ] CM: Loaded 48771 existing records from primary storage. [2025-10-13T22:36:06.881932] [INFO ] [MAIN ] CM: Loaded 48771 primary data records. [2025-10-13T22:36:07.814416] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:07.815989] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 25580 primary records. [2025-10-13T22:36:07.816094] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-13T22:36:07.852741] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-13T22:36:07.854390] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-13T22:36:07.856678] [INFO ] [MAIN ] Derivative Progress: 376/1810 symbols completed. CMBT took 1.2s. Estimated remaining: 9m 22s. Rate: 153.1 symbols/min [2025-10-13T22:36:07.856840] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:07.858781] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:07.872918] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48771 primary records. [2025-10-13T22:36:07.873320] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:07.873573] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-13T22:36:07.875019] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51636 primary records. [2025-10-13T22:36:07.875743] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-13T22:36:07.904305] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-13T22:36:07.904830] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-13T22:36:07.907343] [INFO ] [MAIN ] Derivative Progress: 377/1810 symbols completed. CLX took 1.3s. Estimated remaining: 9m 20s. Rate: 153.5 symbols/min [2025-10-13T22:36:07.907553] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:07.912390] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-13T22:36:07.912551] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-13T22:36:07.920123] [INFO ] [MAIN ] Derivative Progress: 378/1810 symbols completed. CM took 1.3s. Estimated remaining: 9m 18s. Rate: 153.9 symbols/min [2025-10-13T22:36:07.920434] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:07.925403] [DEBUG] [LOCAL ] CMCM: Loaded 4858 existing records from primary storage. [2025-10-13T22:36:07.925797] [INFO ] [MAIN ] CMCM: Loaded 4858 primary data records. [2025-10-13T22:36:08.069545] [DEBUG] [LOCAL ] CMC: Loaded 45377 existing records from primary storage. [2025-10-13T22:36:08.106802] [INFO ] [MAIN ] CMC: Loaded 45377 primary data records. [2025-10-13T22:36:08.407449] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-10-13T22:36:08.413703] [INFO ] [MAIN ] CMG: Loaded 53720 primary data records. [2025-10-13T22:36:09.077021] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:09.086143] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4858 primary records. [2025-10-13T22:36:09.086466] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-13T22:36:09.103854] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-13T22:36:09.104282] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-13T22:36:09.107864] [INFO ] [MAIN ] Derivative Progress: 379/1810 symbols completed. CMCM took 1.2s. Estimated remaining: 9m 21s. Rate: 153.1 symbols/min [2025-10-13T22:36:09.108738] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:09.129663] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:09.130883] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45377 primary records. [2025-10-13T22:36:09.131068] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-13T22:36:09.155188] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-13T22:36:09.155591] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-13T22:36:09.159460] [INFO ] [MAIN ] Derivative Progress: 380/1810 symbols completed. CMC took 1.3s. Estimated remaining: 9m 19s. Rate: 153.4 symbols/min [2025-10-13T22:36:09.175837] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:09.188168] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:09.189669] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53720 primary records. [2025-10-13T22:36:09.190335] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-13T22:36:09.211690] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-13T22:36:09.224881] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-13T22:36:09.229449] [INFO ] [MAIN ] Derivative Progress: 381/1810 symbols completed. CMG took 1.3s. Estimated remaining: 9m 18s. Rate: 153.8 symbols/min [2025-10-13T22:36:09.230269] [DEBUG] [LOCAL ] CMI: Loaded 41651 existing records from primary storage. [2025-10-13T22:36:09.230623] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:09.230775] [INFO ] [MAIN ] CMI: Loaded 41651 primary data records. [2025-10-13T22:36:09.442863] [DEBUG] [LOCAL ] CMP: Loaded 35860 existing records from primary storage. [2025-10-13T22:36:09.449176] [INFO ] [MAIN ] CMP: Loaded 35860 primary data records. [2025-10-13T22:36:09.702107] [DEBUG] [LOCAL ] CMPO: Loaded 38915 existing records from primary storage. [2025-10-13T22:36:09.702541] [INFO ] [MAIN ] CMPO: Loaded 38915 primary data records. [2025-10-13T22:36:10.262102] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:10.263982] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41651 primary records. [2025-10-13T22:36:10.264221] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-13T22:36:10.283114] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-13T22:36:10.283505] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-13T22:36:10.285954] [INFO ] [MAIN ] Derivative Progress: 382/1810 symbols completed. CMI took 1.2s. Estimated remaining: 9m 20s. Rate: 153.1 symbols/min [2025-10-13T22:36:10.287938] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:10.308380] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:10.309775] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 35860 primary records. [2025-10-13T22:36:10.310273] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-13T22:36:10.358230] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:10.357682] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-13T22:36:10.358518] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-13T22:36:10.361263] [INFO ] [MAIN ] Derivative Progress: 383/1810 symbols completed. CMP took 1.2s. Estimated remaining: 9m 18s. Rate: 153.4 symbols/min [2025-10-13T22:36:10.362201] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38915 primary records. [2025-10-13T22:36:10.372396] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:10.374296] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-13T22:36:10.376253] [DEBUG] [LOCAL ] CMRE: Loaded 35869 existing records from primary storage. [2025-10-13T22:36:10.376841] [INFO ] [MAIN ] CMRE: Loaded 35869 primary data records. [2025-10-13T22:36:10.501336] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-13T22:36:10.527516] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-13T22:36:10.531369] [INFO ] [MAIN ] Derivative Progress: 384/1810 symbols completed. CMPO took 1.3s. Estimated remaining: 9m 17s. Rate: 153.6 symbols/min [2025-10-13T22:36:10.546980] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:10.747702] [DEBUG] [LOCAL ] CMSA: Loaded 3581 existing records from primary storage. [2025-10-13T22:36:10.749252] [DEBUG] [LOCAL ] CMS: Loaded 52606 existing records from primary storage. [2025-10-13T22:36:10.749376] [INFO ] [MAIN ] CMS: Loaded 52606 primary data records. [2025-10-13T22:36:10.749487] [INFO ] [MAIN ] CMSA: Loaded 3581 primary data records. [2025-10-13T22:36:11.461385] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:11.462782] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35869 primary records. [2025-10-13T22:36:11.463009] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-13T22:36:11.483567] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-13T22:36:11.484056] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-13T22:36:11.486322] [INFO ] [MAIN ] Derivative Progress: 385/1810 symbols completed. CMRE took 1.2s. Estimated remaining: 9m 19s. Rate: 153.0 symbols/min [2025-10-13T22:36:11.486592] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:11.497384] [DEBUG] [LOCAL ] CMSC: Loaded 4921 existing records from primary storage. [2025-10-13T22:36:11.498966] [INFO ] [MAIN ] CMSC: Loaded 4921 primary data records. [2025-10-13T22:36:11.547024] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:11.605403] [INFO ] [MAIN ] CMSA: Generated 1794 derivative records from 3581 primary records. [2025-10-13T22:36:11.616131] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:11.633462] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52606 primary records. [2025-10-13T22:36:11.633557] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-13T22:36:11.632579] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-13T22:36:11.855767] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-13T22:36:11.857003] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-13T22:36:11.860344] [INFO ] [MAIN ] Derivative Progress: 386/1810 symbols completed. CMSA took 1.3s. Estimated remaining: 9m 18s. Rate: 153.1 symbols/min [2025-10-13T22:36:11.862394] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-13T22:36:11.862566] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:11.862845] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-13T22:36:11.869005] [INFO ] [MAIN ] Derivative Progress: 387/1810 symbols completed. CMS took 1.5s. Estimated remaining: 9m 16s. Rate: 153.5 symbols/min [2025-10-13T22:36:11.870194] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:11.882306] [DEBUG] [LOCAL ] CMU: Loaded 6355 existing records from primary storage. [2025-10-13T22:36:11.882637] [INFO ] [MAIN ] CMU: Loaded 6355 primary data records. [2025-10-13T22:36:12.042301] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:12.194958] [DEBUG] [LOCAL ] CMTG: Loaded 35912 existing records from primary storage. [2025-10-13T22:36:12.106041] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 4921 primary records. [2025-10-13T22:36:12.220347] [INFO ] [MAIN ] CMTG: Loaded 35912 primary data records. [2025-10-13T22:36:12.228714] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-13T22:36:12.324809] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-13T22:36:12.352266] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-13T22:36:12.360672] [INFO ] [MAIN ] Derivative Progress: 388/1810 symbols completed. CMSC took 0.9s. Estimated remaining: 9m 16s. Rate: 153.3 symbols/min [2025-10-13T22:36:12.568390] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:12.569409] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6355 primary records. [2025-10-13T22:36:12.569595] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-13T22:36:12.585713] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-13T22:36:12.585808] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-13T22:36:12.588602] [INFO ] [MAIN ] Derivative Progress: 389/1810 symbols completed. CMU took 0.7s. Estimated remaining: 9m 15s. Rate: 153.5 symbols/min [2025-10-13T22:36:12.604314] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:12.604941] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 35912 primary records. [2025-10-13T22:36:12.605003] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-13T22:36:12.620617] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-13T22:36:12.620713] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-13T22:36:12.623052] [INFO ] [MAIN ] Derivative Progress: 390/1810 symbols completed. CMTG took 0.8s. Estimated remaining: 9m 14s. Rate: 153.9 symbols/min [2025-10-13T22:36:12.623501] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:12.623608] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:12.623436] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:12.636002] [DEBUG] [LOCAL ] CNF: Loaded 10620 existing records from primary storage. [2025-10-13T22:36:12.636317] [INFO ] [MAIN ] CNF: Loaded 10620 primary data records. [2025-10-13T22:36:12.959070] [DEBUG] [LOCAL ] CNA: Loaded 32939 existing records from primary storage. [2025-10-13T22:36:12.959819] [INFO ] [MAIN ] CNA: Loaded 32939 primary data records. [2025-10-13T22:36:13.060666] [DEBUG] [LOCAL ] CNC: Loaded 53764 existing records from primary storage. [2025-10-13T22:36:13.080151] [INFO ] [MAIN ] CNC: Loaded 53764 primary data records. [2025-10-13T22:36:13.660354] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:13.662144] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 10620 primary records. [2025-10-13T22:36:13.663305] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-13T22:36:13.681771] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-10-13T22:36:13.682524] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-13T22:36:13.686034] [INFO ] [MAIN ] Derivative Progress: 391/1810 symbols completed. CNF took 1.1s. Estimated remaining: 9m 16s. Rate: 153.2 symbols/min [2025-10-13T22:36:13.687213] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:13.705758] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:13.706718] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32939 primary records. [2025-10-13T22:36:13.707085] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-13T22:36:13.726215] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-13T22:36:13.726405] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-13T22:36:13.729074] [INFO ] [MAIN ] Derivative Progress: 392/1810 symbols completed. CNA took 1.1s. Estimated remaining: 9m 14s. Rate: 153.5 symbols/min [2025-10-13T22:36:13.744236] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:13.744814] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:13.746166] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53764 primary records. [2025-10-13T22:36:13.746325] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-13T22:36:13.765747] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-13T22:36:13.765944] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-13T22:36:13.769079] [INFO ] [MAIN ] Derivative Progress: 393/1810 symbols completed. CNC took 1.1s. Estimated remaining: 9m 12s. Rate: 153.9 symbols/min [2025-10-13T22:36:13.769326] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:13.833976] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-13T22:36:13.834400] [INFO ] [MAIN ] CNH: Loaded 53551 primary data records. [2025-10-13T22:36:13.975672] [DEBUG] [LOCAL ] CNI: Loaded 51689 existing records from primary storage. [2025-10-13T22:36:14.000975] [INFO ] [MAIN ] CNI: Loaded 51689 primary data records. [2025-10-13T22:36:14.118000] [DEBUG] [LOCAL ] CNK: Loaded 52898 existing records from primary storage. [2025-10-13T22:36:14.172182] [INFO ] [MAIN ] CNK: Loaded 52898 primary data records. [2025-10-13T22:36:14.847668] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:14.849428] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53551 primary records. [2025-10-13T22:36:14.849900] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-13T22:36:14.878968] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-13T22:36:14.884229] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-13T22:36:14.886820] [INFO ] [MAIN ] Derivative Progress: 394/1810 symbols completed. CNH took 1.2s. Estimated remaining: 9m 15s. Rate: 153.2 symbols/min [2025-10-13T22:36:14.887221] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:14.888398] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51689 primary records. [2025-10-13T22:36:14.888926] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:14.889090] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-13T22:36:14.921141] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:14.922878] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52898 primary records. [2025-10-13T22:36:14.923627] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-13T22:36:14.940407] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-13T22:36:14.941180] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-13T22:36:14.944332] [INFO ] [MAIN ] Derivative Progress: 395/1810 symbols completed. CNI took 1.2s. Estimated remaining: 9m 13s. Rate: 153.5 symbols/min [2025-10-13T22:36:14.946023] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:14.964914] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-13T22:36:14.965066] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-13T22:36:14.968958] [INFO ] [MAIN ] Derivative Progress: 396/1810 symbols completed. CNK took 1.2s. Estimated remaining: 9m 11s. Rate: 153.9 symbols/min [2025-10-13T22:36:14.969396] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:14.990490] [DEBUG] [LOCAL ] CNM: Loaded 51013 existing records from primary storage. [2025-10-13T22:36:14.990830] [INFO ] [MAIN ] CNM: Loaded 51013 primary data records. [2025-10-13T22:36:15.149506] [DEBUG] [LOCAL ] CNMD: Loaded 32170 existing records from primary storage. [2025-10-13T22:36:15.179194] [INFO ] [MAIN ] CNMD: Loaded 32170 primary data records. [2025-10-13T22:36:15.360837] [DEBUG] [LOCAL ] CNNE: Loaded 35998 existing records from primary storage. [2025-10-13T22:36:15.410338] [INFO ] [MAIN ] CNNE: Loaded 35998 primary data records. [2025-10-13T22:36:15.970495] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:15.971694] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51013 primary records. [2025-10-13T22:36:15.972319] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-13T22:36:15.992767] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-13T22:36:16.005244] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-13T22:36:16.008062] [INFO ] [MAIN ] Derivative Progress: 397/1810 symbols completed. CNM took 1.1s. Estimated remaining: 9m 13s. Rate: 153.2 symbols/min [2025-10-13T22:36:16.008366] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:16.008824] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:16.010264] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32170 primary records. [2025-10-13T22:36:16.010542] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-13T22:36:16.029758] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-13T22:36:16.030893] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-13T22:36:16.034107] [INFO ] [MAIN ] Derivative Progress: 398/1810 symbols completed. CNMD took 1.1s. Estimated remaining: 9m 12s. Rate: 153.6 symbols/min [2025-10-13T22:36:16.034315] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:16.050299] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:16.051262] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 35998 primary records. [2025-10-13T22:36:16.051417] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-13T22:36:16.079232] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-13T22:36:16.079491] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-13T22:36:16.082778] [INFO ] [MAIN ] Derivative Progress: 399/1810 symbols completed. CNNE took 1.1s. Estimated remaining: 9m 10s. Rate: 153.9 symbols/min [2025-10-13T22:36:16.083159] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:16.117073] [DEBUG] [LOCAL ] CNO: Loaded 40746 existing records from primary storage. [2025-10-13T22:36:16.117405] [INFO ] [MAIN ] CNO: Loaded 40746 primary data records. [2025-10-13T22:36:16.242800] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-13T22:36:16.260211] [INFO ] [MAIN ] CNP: Loaded 53480 primary data records. [2025-10-13T22:36:16.572457] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-13T22:36:16.579676] [INFO ] [MAIN ] CNQ: Loaded 53583 primary data records. [2025-10-13T22:36:17.093493] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:17.094863] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40746 primary records. [2025-10-13T22:36:17.095141] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-13T22:36:17.111955] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-13T22:36:17.112170] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-13T22:36:17.114992] [INFO ] [MAIN ] Derivative Progress: 400/1810 symbols completed. CNO took 1.1s. Estimated remaining: 9m 12s. Rate: 153.3 symbols/min [2025-10-13T22:36:17.115681] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:17.132574] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:17.133326] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53480 primary records. [2025-10-13T22:36:17.133455] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-13T22:36:17.155606] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-13T22:36:17.155831] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-13T22:36:17.158388] [INFO ] [MAIN ] Derivative Progress: 401/1810 symbols completed. CNP took 1.1s. Estimated remaining: 9m 10s. Rate: 153.6 symbols/min [2025-10-13T22:36:17.158526] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:17.170273] [DEBUG] [LOCAL ] CNS: Loaded 21008 existing records from primary storage. [2025-10-13T22:36:17.182819] [INFO ] [MAIN ] CNS: Loaded 21008 primary data records. [2025-10-13T22:36:17.183462] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:17.184300] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53583 primary records. [2025-10-13T22:36:17.184472] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-13T22:36:17.542235] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-13T22:36:17.543071] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-13T22:36:17.546375] [INFO ] [MAIN ] Derivative Progress: 402/1810 symbols completed. CNQ took 1.5s. Estimated remaining: 9m 10s. Rate: 153.6 symbols/min [2025-10-13T22:36:17.548349] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:17.565697] [DEBUG] [LOCAL ] CNX: Loaded 51343 existing records from primary storage. [2025-10-13T22:36:17.566543] [INFO ] [MAIN ] CNX: Loaded 51343 primary data records. [2025-10-13T22:36:17.907004] [DEBUG] [LOCAL ] CODI: Loaded 41051 existing records from primary storage. [2025-10-13T22:36:17.907370] [INFO ] [MAIN ] CODI: Loaded 41051 primary data records. [2025-10-13T22:36:17.957163] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:17.977228] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 21008 primary records. [2025-10-13T22:36:17.977680] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-13T22:36:18.041221] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-13T22:36:18.046710] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-13T22:36:18.049815] [INFO ] [MAIN ] Derivative Progress: 403/1810 symbols completed. CNS took 0.9s. Estimated remaining: 9m 10s. Rate: 153.5 symbols/min [2025-10-13T22:36:18.249988] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:18.250858] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51343 primary records. [2025-10-13T22:36:18.251207] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-13T22:36:18.268281] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-13T22:36:18.268526] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-13T22:36:18.271307] [INFO ] [MAIN ] Derivative Progress: 404/1810 symbols completed. CNX took 1.1s. Estimated remaining: 9m 9s. Rate: 153.7 symbols/min [2025-10-13T22:36:18.286516] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:18.287073] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 41051 primary records. [2025-10-13T22:36:18.287132] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-13T22:36:18.302157] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-13T22:36:18.302218] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-13T22:36:18.304593] [INFO ] [MAIN ] Derivative Progress: 405/1810 symbols completed. CODI took 0.8s. Estimated remaining: 9m 7s. Rate: 154.0 symbols/min [2025-10-13T22:36:18.305084] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:18.305027] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:18.305174] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:18.387918] [DEBUG] [LOCAL ] COHR: Loaded 53380 existing records from primary storage. [2025-10-13T22:36:18.402207] [INFO ] [MAIN ] COHR: Loaded 53380 primary data records. [2025-10-13T22:36:18.426332] [DEBUG] [LOCAL ] COLD: Loaded 52362 existing records from primary storage. [2025-10-13T22:36:18.448404] [INFO ] [MAIN ] COLD: Loaded 52362 primary data records. [2025-10-13T22:36:18.527333] [DEBUG] [LOCAL ] COF: Loaded 53614 existing records from primary storage. [2025-10-13T22:36:18.557241] [INFO ] [MAIN ] COF: Loaded 53614 primary data records. [2025-10-13T22:36:19.462139] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:19.463242] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53380 primary records. [2025-10-13T22:36:19.463736] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-13T22:36:19.485448] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-13T22:36:19.485708] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-13T22:36:19.487861] [INFO ] [MAIN ] Derivative Progress: 406/1810 symbols completed. COHR took 1.2s. Estimated remaining: 9m 10s. Rate: 153.3 symbols/min [2025-10-13T22:36:19.488237] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:19.506141] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:19.508379] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52362 primary records. [2025-10-13T22:36:19.508700] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-13T22:36:19.531454] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:19.541961] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53614 primary records. [2025-10-13T22:36:19.540893] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-13T22:36:19.542252] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-13T22:36:19.542160] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-13T22:36:19.545596] [INFO ] [MAIN ] Derivative Progress: 407/1810 symbols completed. COLD took 1.2s. Estimated remaining: 9m 8s. Rate: 153.6 symbols/min [2025-10-13T22:36:19.546843] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:19.564016] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-13T22:36:19.564180] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-13T22:36:19.568074] [INFO ] [MAIN ] Derivative Progress: 408/1810 symbols completed. COF took 1.3s. Estimated remaining: 9m 6s. Rate: 153.9 symbols/min [2025-10-13T22:36:19.568309] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:19.615289] [DEBUG] [LOCAL ] COMP: Loaded 53405 existing records from primary storage. [2025-10-13T22:36:19.616311] [INFO ] [MAIN ] COMP: Loaded 53405 primary data records. [2025-10-13T22:36:19.682111] [DEBUG] [LOCAL ] COOK: Loaded 24847 existing records from primary storage. [2025-10-13T22:36:19.720057] [INFO ] [MAIN ] COOK: Loaded 24847 primary data records. [2025-10-13T22:36:19.785547] [DEBUG] [LOCAL ] CON: Loaded 38882 existing records from primary storage. [2025-10-13T22:36:19.825742] [INFO ] [MAIN ] CON: Loaded 38882 primary data records. [2025-10-13T22:36:20.662526] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:20.664438] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53405 primary records. [2025-10-13T22:36:20.664815] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-13T22:36:20.684584] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-13T22:36:20.685079] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-13T22:36:20.687670] [INFO ] [MAIN ] Derivative Progress: 409/1810 symbols completed. COMP took 1.2s. Estimated remaining: 9m 9s. Rate: 153.2 symbols/min [2025-10-13T22:36:20.688035] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:20.708128] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:20.710610] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24847 primary records. [2025-10-13T22:36:20.710848] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-13T22:36:20.739005] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:20.742406] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38882 primary records. [2025-10-13T22:36:20.743087] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-13T22:36:20.743469] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-13T22:36:20.743580] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-13T22:36:20.746909] [INFO ] [MAIN ] Derivative Progress: 410/1810 symbols completed. COOK took 1.2s. Estimated remaining: 9m 7s. Rate: 153.6 symbols/min [2025-10-13T22:36:20.747366] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:20.777258] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-13T22:36:20.777437] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-13T22:36:20.780409] [INFO ] [MAIN ] Derivative Progress: 411/1810 symbols completed. CON took 1.2s. Estimated remaining: 9m 5s. Rate: 153.9 symbols/min [2025-10-13T22:36:20.781827] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:20.804378] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-13T22:36:20.804681] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-13T22:36:21.180243] [DEBUG] [LOCAL ] COUR: Loaded 49182 existing records from primary storage. [2025-10-13T22:36:21.196735] [DEBUG] [LOCAL ] COTY: Loaded 53263 existing records from primary storage. [2025-10-13T22:36:21.197053] [INFO ] [MAIN ] COTY: Loaded 53263 primary data records. [2025-10-13T22:36:21.195993] [INFO ] [MAIN ] COUR: Loaded 49182 primary data records. [2025-10-13T22:36:21.874531] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:21.876240] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-13T22:36:21.877128] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-13T22:36:21.897715] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-13T22:36:21.898456] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-13T22:36:21.901759] [INFO ] [MAIN ] Derivative Progress: 412/1810 symbols completed. COP took 1.2s. Estimated remaining: 9m 8s. Rate: 153.2 symbols/min [2025-10-13T22:36:21.903164] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:21.920115] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:21.921619] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49182 primary records. [2025-10-13T22:36:21.921880] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-13T22:36:21.946731] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:21.949035] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53263 primary records. [2025-10-13T22:36:21.951900] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-13T22:36:21.952070] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-13T22:36:21.952283] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-13T22:36:21.954575] [INFO ] [MAIN ] Derivative Progress: 413/1810 symbols completed. COUR took 1.2s. Estimated remaining: 9m 6s. Rate: 153.5 symbols/min [2025-10-13T22:36:21.954820] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:21.986910] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-13T22:36:21.987251] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-13T22:36:21.990105] [INFO ] [MAIN ] Derivative Progress: 414/1810 symbols completed. COTY took 1.2s. Estimated remaining: 9m 4s. Rate: 153.9 symbols/min [2025-10-13T22:36:21.990260] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:22.018271] [DEBUG] [LOCAL ] CP: Loaded 53252 existing records from primary storage. [2025-10-13T22:36:22.027725] [INFO ] [MAIN ] CP: Loaded 53252 primary data records. [2025-10-13T22:36:22.034143] [DEBUG] [LOCAL ] CPA: Loaded 28392 existing records from primary storage. [2025-10-13T22:36:22.076703] [INFO ] [MAIN ] CPA: Loaded 28392 primary data records. [2025-10-13T22:36:22.298449] [DEBUG] [LOCAL ] CPAY: Loaded 30418 existing records from primary storage. [2025-10-13T22:36:22.319887] [INFO ] [MAIN ] CPAY: Loaded 30418 primary data records. [2025-10-13T22:36:23.007059] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:23.008969] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53252 primary records. [2025-10-13T22:36:23.009138] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-13T22:36:23.040170] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:23.041842] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-13T22:36:23.041945] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-13T22:36:23.045347] [INFO ] [MAIN ] Derivative Progress: 415/1810 symbols completed. CP took 1.1s. Estimated remaining: 9m 6s. Rate: 153.2 symbols/min [2025-10-13T22:36:23.042610] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28392 primary records. [2025-10-13T22:36:23.045635] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:23.046473] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-13T22:36:23.065619] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-13T22:36:23.082091] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:23.082857] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30418 primary records. [2025-10-13T22:36:23.082967] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-13T22:36:23.085584] [INFO ] [MAIN ] Derivative Progress: 416/1810 symbols completed. CPA took 1.1s. Estimated remaining: 9m 5s. Rate: 153.6 symbols/min [2025-10-13T22:36:23.085730] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-13T22:36:23.086700] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:23.092513] [DEBUG] [LOCAL ] CPF: Loaded 15233 existing records from primary storage. [2025-10-13T22:36:23.092839] [INFO ] [MAIN ] CPF: Loaded 15233 primary data records. [2025-10-13T22:36:23.178111] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-13T22:36:23.199323] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-13T22:36:23.208551] [INFO ] [MAIN ] Derivative Progress: 417/1810 symbols completed. CPAY took 1.2s. Estimated remaining: 9m 3s. Rate: 153.8 symbols/min [2025-10-13T22:36:23.216307] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:23.252868] [DEBUG] [LOCAL ] CPK: Loaded 13769 existing records from primary storage. [2025-10-13T22:36:23.284714] [INFO ] [MAIN ] CPK: Loaded 13769 primary data records. [2025-10-13T22:36:23.854893] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-13T22:36:23.867440] [INFO ] [MAIN ] CPNG: Loaded 53679 primary data records. [2025-10-13T22:36:24.181935] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:24.191750] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15233 primary records. [2025-10-13T22:36:24.192227] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-13T22:36:24.212228] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-13T22:36:24.214179] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-13T22:36:24.216537] [INFO ] [MAIN ] Derivative Progress: 418/1810 symbols completed. CPF took 1.2s. Estimated remaining: 9m 5s. Rate: 153.2 symbols/min [2025-10-13T22:36:24.231605] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:24.233571] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13769 primary records. [2025-10-13T22:36:24.233980] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-13T22:36:24.252885] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-13T22:36:24.253060] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-13T22:36:24.256106] [INFO ] [MAIN ] Derivative Progress: 419/1810 symbols completed. CPK took 1.2s. Estimated remaining: 9m 3s. Rate: 153.6 symbols/min [2025-10-13T22:36:24.271124] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:24.271758] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53679 primary records. [2025-10-13T22:36:24.271819] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-13T22:36:24.287205] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-13T22:36:24.287266] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-13T22:36:24.289968] [INFO ] [MAIN ] Derivative Progress: 420/1810 symbols completed. CPNG took 1.1s. Estimated remaining: 9m 2s. Rate: 153.9 symbols/min [2025-10-13T22:36:24.290408] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:24.290686] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:24.290554] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:24.336033] [DEBUG] [LOCAL ] CPS: Loaded 25382 existing records from primary storage. [2025-10-13T22:36:24.336223] [INFO ] [MAIN ] CPS: Loaded 25382 primary data records. [2025-10-13T22:36:24.495060] [DEBUG] [LOCAL ] CPRI: Loaded 52498 existing records from primary storage. [2025-10-13T22:36:24.510673] [INFO ] [MAIN ] CPRI: Loaded 52498 primary data records. [2025-10-13T22:36:24.511768] [DEBUG] [LOCAL ] CPT: Loaded 44474 existing records from primary storage. [2025-10-13T22:36:24.551558] [INFO ] [MAIN ] CPT: Loaded 44474 primary data records. [2025-10-13T22:36:25.303488] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:25.304899] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25382 primary records. [2025-10-13T22:36:25.305380] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-13T22:36:25.328597] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-13T22:36:25.328765] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-13T22:36:25.331198] [INFO ] [MAIN ] Derivative Progress: 421/1810 symbols completed. CPS took 1.0s. Estimated remaining: 9m 4s. Rate: 153.3 symbols/min [2025-10-13T22:36:25.339223] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:25.356715] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:25.357975] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52498 primary records. [2025-10-13T22:36:25.358185] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-13T22:36:25.357222] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:25.358808] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44474 primary records. [2025-10-13T22:36:25.359543] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-13T22:36:25.394466] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-13T22:36:25.395078] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-13T22:36:25.398549] [INFO ] [MAIN ] Derivative Progress: 422/1810 symbols completed. CPRI took 1.1s. Estimated remaining: 9m 2s. Rate: 153.6 symbols/min [2025-10-13T22:36:25.399017] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:25.406182] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-13T22:36:25.407302] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-13T22:36:25.410282] [INFO ] [MAIN ] Derivative Progress: 423/1810 symbols completed. CPT took 1.1s. Estimated remaining: 9m 1s. Rate: 153.9 symbols/min [2025-10-13T22:36:25.410893] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:25.410691] [DEBUG] [LOCAL ] CQP: Loaded 18920 existing records from primary storage. [2025-10-13T22:36:25.411554] [INFO ] [MAIN ] CQP: Loaded 18920 primary data records. [2025-10-13T22:36:25.534855] [DEBUG] [LOCAL ] CR: Loaded 24133 existing records from primary storage. [2025-10-13T22:36:25.534123] [DEBUG] [LOCAL ] CRBD: Loaded 8964 existing records from primary storage. [2025-10-13T22:36:25.550557] [INFO ] [MAIN ] CRBD: Loaded 8964 primary data records. [2025-10-13T22:36:25.555814] [INFO ] [MAIN ] CR: Loaded 24133 primary data records. [2025-10-13T22:36:26.407298] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:26.410474] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18920 primary records. [2025-10-13T22:36:26.411118] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-13T22:36:26.450419] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-13T22:36:26.451689] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-13T22:36:26.453970] [INFO ] [MAIN ] Derivative Progress: 424/1810 symbols completed. CQP took 1.1s. Estimated remaining: 9m 2s. Rate: 153.3 symbols/min [2025-10-13T22:36:26.454229] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:26.451467] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:26.456999] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8964 primary records. [2025-10-13T22:36:26.458127] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-13T22:36:26.504092] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-13T22:36:26.505296] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-13T22:36:26.505212] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:26.506402] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24133 primary records. [2025-10-13T22:36:26.506530] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-13T22:36:26.509721] [INFO ] [MAIN ] Derivative Progress: 425/1810 symbols completed. CRBD took 1.1s. Estimated remaining: 9m 1s. Rate: 153.7 symbols/min [2025-10-13T22:36:26.510009] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:26.552049] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-13T22:36:26.552973] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-13T22:36:26.557583] [INFO ] [MAIN ] Derivative Progress: 426/1810 symbols completed. CR took 1.2s. Estimated remaining: 8m 59s. Rate: 154.0 symbols/min [2025-10-13T22:36:26.574196] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:26.576184] [DEBUG] [LOCAL ] CRBG: Loaded 52546 existing records from primary storage. [2025-10-13T22:36:26.576570] [INFO ] [MAIN ] CRBG: Loaded 52546 primary data records. [2025-10-13T22:36:26.915067] [DEBUG] [LOCAL ] CRC: Loaded 44022 existing records from primary storage. [2025-10-13T22:36:26.915513] [INFO ] [MAIN ] CRC: Loaded 44022 primary data records. [2025-10-13T22:36:27.049503] [DEBUG] [LOCAL ] CRGY: Loaded 52490 existing records from primary storage. [2025-10-13T22:36:27.065242] [INFO ] [MAIN ] CRGY: Loaded 52490 primary data records. [2025-10-13T22:36:27.612013] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:27.613593] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52546 primary records. [2025-10-13T22:36:27.614517] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-13T22:36:27.636500] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-13T22:36:27.636734] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-13T22:36:27.639391] [INFO ] [MAIN ] Derivative Progress: 427/1810 symbols completed. CRBG took 1.2s. Estimated remaining: 9m 1s. Rate: 153.3 symbols/min [2025-10-13T22:36:27.654427] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:27.655043] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:27.656469] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44022 primary records. [2025-10-13T22:36:27.656744] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-13T22:36:27.677600] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-13T22:36:27.677985] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-13T22:36:27.680697] [INFO ] [MAIN ] Derivative Progress: 428/1810 symbols completed. CRC took 1.2s. Estimated remaining: 8m 60s. Rate: 153.7 symbols/min [2025-10-13T22:36:27.681074] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:27.698430] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:27.700360] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52490 primary records. [2025-10-13T22:36:27.700554] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-13T22:36:27.719078] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-13T22:36:27.719203] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-13T22:36:27.722724] [INFO ] [MAIN ] Derivative Progress: 429/1810 symbols completed. CRGY took 1.1s. Estimated remaining: 8m 58s. Rate: 154.0 symbols/min [2025-10-13T22:36:27.723053] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:27.788485] [DEBUG] [LOCAL ] CRH: Loaded 53445 existing records from primary storage. [2025-10-13T22:36:27.789324] [DEBUG] [LOCAL ] CRI: Loaded 49698 existing records from primary storage. [2025-10-13T22:36:27.789606] [INFO ] [MAIN ] CRH: Loaded 53445 primary data records. [2025-10-13T22:36:27.789845] [INFO ] [MAIN ] CRI: Loaded 49698 primary data records. [2025-10-13T22:36:28.037860] [DEBUG] [LOCAL ] CRL: Loaded 42928 existing records from primary storage. [2025-10-13T22:36:28.054437] [INFO ] [MAIN ] CRL: Loaded 42928 primary data records. [2025-10-13T22:36:29.022777] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:29.025591] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53445 primary records. [2025-10-13T22:36:29.024953] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:29.025742] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-13T22:36:29.027331] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49698 primary records. [2025-10-13T22:36:29.027948] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-13T22:36:29.066592] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-13T22:36:29.070898] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-13T22:36:29.070598] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-13T22:36:29.074936] [INFO ] [MAIN ] Derivative Progress: 430/1810 symbols completed. CRH took 1.4s. Estimated remaining: 9m 1s. Rate: 153.1 symbols/min [2025-10-13T22:36:29.075144] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-13T22:36:29.075754] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:29.084758] [INFO ] [MAIN ] Derivative Progress: 431/1810 symbols completed. CRI took 1.4s. Estimated remaining: 8m 59s. Rate: 153.4 symbols/min [2025-10-13T22:36:29.096561] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:29.095751] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:29.098213] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42928 primary records. [2025-10-13T22:36:29.098607] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-13T22:36:29.122694] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-13T22:36:29.122896] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-13T22:36:29.126479] [INFO ] [MAIN ] Derivative Progress: 432/1810 symbols completed. CRL took 1.4s. Estimated remaining: 8m 58s. Rate: 153.8 symbols/min [2025-10-13T22:36:29.126925] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:29.140305] [DEBUG] [LOCAL ] CRT: Loaded 4929 existing records from primary storage. [2025-10-13T22:36:29.140637] [INFO ] [MAIN ] CRT: Loaded 4929 primary data records. [2025-10-13T22:36:29.351944] [DEBUG] [LOCAL ] CRS: Loaded 43179 existing records from primary storage. [2025-10-13T22:36:29.368563] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-13T22:36:29.408182] [INFO ] [MAIN ] CRS: Loaded 43179 primary data records. [2025-10-13T22:36:29.417889] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-13T22:36:30.279103] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:30.280356] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4929 primary records. [2025-10-13T22:36:30.280690] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-13T22:36:30.304245] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-13T22:36:30.309694] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-13T22:36:30.312046] [INFO ] [MAIN ] Derivative Progress: 433/1810 symbols completed. CRT took 1.2s. Estimated remaining: 8m 60s. Rate: 153.0 symbols/min [2025-10-13T22:36:30.337739] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:30.339048] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43179 primary records. [2025-10-13T22:36:30.338138] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:30.339738] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-13T22:36:30.339872] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-13T22:36:30.339827] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-13T22:36:30.374746] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-13T22:36:30.375580] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-13T22:36:30.378831] [INFO ] [MAIN ] Derivative Progress: 434/1810 symbols completed. CRM took 1.3s. Estimated remaining: 8m 58s. Rate: 153.3 symbols/min [2025-10-13T22:36:30.383963] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-13T22:36:30.384039] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-13T22:36:30.387149] [INFO ] [MAIN ] Derivative Progress: 435/1810 symbols completed. CRS took 1.3s. Estimated remaining: 8m 57s. Rate: 153.7 symbols/min [2025-10-13T22:36:30.387673] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:30.387733] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:30.387859] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:30.409538] [DEBUG] [LOCAL ] CSR: Loaded 13229 existing records from primary storage. [2025-10-13T22:36:30.418971] [INFO ] [MAIN ] CSR: Loaded 13229 primary data records. [2025-10-13T22:36:30.540922] [DEBUG] [LOCAL ] CSL: Loaded 31512 existing records from primary storage. [2025-10-13T22:36:30.552084] [INFO ] [MAIN ] CSL: Loaded 31512 primary data records. [2025-10-13T22:36:30.590802] [DEBUG] [LOCAL ] CSAN: Loaded 42131 existing records from primary storage. [2025-10-13T22:36:30.690331] [INFO ] [MAIN ] CSAN: Loaded 42131 primary data records. [2025-10-13T22:36:31.396234] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:31.397121] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 13229 primary records. [2025-10-13T22:36:31.397377] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-13T22:36:31.420062] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-13T22:36:31.432727] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-13T22:36:31.443281] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:31.442837] [INFO ] [MAIN ] Derivative Progress: 436/1810 symbols completed. CSR took 1.1s. Estimated remaining: 8m 59s. Rate: 153.1 symbols/min [2025-10-13T22:36:31.443489] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:31.444397] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31512 primary records. [2025-10-13T22:36:31.449837] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-13T22:36:31.450410] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:31.451200] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42131 primary records. [2025-10-13T22:36:31.451303] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-13T22:36:31.485553] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-13T22:36:31.485819] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-13T22:36:31.485474] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-13T22:36:31.485916] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-13T22:36:31.488804] [INFO ] [MAIN ] Derivative Progress: 437/1810 symbols completed. CSL took 1.1s. Estimated remaining: 8m 57s. Rate: 153.4 symbols/min [2025-10-13T22:36:31.492028] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:31.492751] [INFO ] [MAIN ] Derivative Progress: 438/1810 symbols completed. CSAN took 1.1s. Estimated remaining: 8m 55s. Rate: 153.7 symbols/min [2025-10-13T22:36:31.492880] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:31.502302] [DEBUG] [LOCAL ] CTBB: Loaded 6924 existing records from primary storage. [2025-10-13T22:36:31.516079] [INFO ] [MAIN ] CTBB: Loaded 6924 primary data records. [2025-10-13T22:36:31.605417] [DEBUG] [LOCAL ] CSV: Loaded 12750 existing records from primary storage. [2025-10-13T22:36:31.636491] [INFO ] [MAIN ] CSV: Loaded 12750 primary data records. [2025-10-13T22:36:31.703863] [DEBUG] [LOCAL ] CSTM: Loaded 47634 existing records from primary storage. [2025-10-13T22:36:31.725739] [INFO ] [MAIN ] CSTM: Loaded 47634 primary data records. [2025-10-13T22:36:32.593717] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:32.594925] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12750 primary records. [2025-10-13T22:36:32.595023] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-13T22:36:32.595413] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:32.597865] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 6924 primary records. [2025-10-13T22:36:32.604937] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-13T22:36:32.643856] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-13T22:36:32.644399] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-13T22:36:32.644291] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:32.646269] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47634 primary records. [2025-10-13T22:36:32.649978] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-13T22:36:32.649604] [INFO ] [MAIN ] Derivative Progress: 439/1810 symbols completed. CSV took 1.2s. Estimated remaining: 8m 57s. Rate: 153.1 symbols/min [2025-10-13T22:36:32.651360] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:32.652342] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-13T22:36:32.652690] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-13T22:36:32.655340] [INFO ] [MAIN ] Derivative Progress: 440/1810 symbols completed. CTBB took 1.2s. Estimated remaining: 8m 56s. Rate: 153.4 symbols/min [2025-10-13T22:36:32.662994] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:32.672431] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-13T22:36:32.674326] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-13T22:36:32.677590] [INFO ] [MAIN ] Derivative Progress: 441/1810 symbols completed. CSTM took 1.2s. Estimated remaining: 8m 54s. Rate: 153.7 symbols/min [2025-10-13T22:36:32.677964] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:32.682448] [DEBUG] [LOCAL ] CTDD: Loaded 5638 existing records from primary storage. [2025-10-13T22:36:32.682882] [INFO ] [MAIN ] CTDD: Loaded 5638 primary data records. [2025-10-13T22:36:32.910810] [DEBUG] [LOCAL ] CTO: Loaded 27753 existing records from primary storage. [2025-10-13T22:36:32.984698] [INFO ] [MAIN ] CTO: Loaded 27753 primary data records. [2025-10-13T22:36:33.084393] [DEBUG] [LOCAL ] CTOS: Loaded 37028 existing records from primary storage. [2025-10-13T22:36:33.096579] [INFO ] [MAIN ] CTOS: Loaded 37028 primary data records. [2025-10-13T22:36:33.670406] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:36:33.672963] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5638 primary records. [2025-10-13T22:36:33.673235] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-13T22:36:33.713822] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-10-13T22:36:33.715435] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:33.716043] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-13T22:36:33.717149] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27753 primary records. [2025-10-13T22:36:33.717351] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-13T22:36:33.720375] [INFO ] [MAIN ] Derivative Progress: 442/1810 symbols completed. CTDD took 1.1s. Estimated remaining: 8m 56s. Rate: 153.1 symbols/min [2025-10-13T22:36:33.722166] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:33.757092] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:33.758790] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-13T22:36:33.758900] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-13T22:36:33.759812] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37028 primary records. [2025-10-13T22:36:33.762573] [INFO ] [MAIN ] Derivative Progress: 443/1810 symbols completed. CTO took 1.1s. Estimated remaining: 8m 54s. Rate: 153.5 symbols/min [2025-10-13T22:36:33.763081] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:33.762961] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-13T22:36:33.783054] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-13T22:36:33.783228] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-13T22:36:33.786743] [INFO ] [MAIN ] Derivative Progress: 444/1810 symbols completed. CTOS took 1.1s. Estimated remaining: 8m 53s. Rate: 153.8 symbols/min [2025-10-13T22:36:33.787127] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:33.836386] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-13T22:36:33.836702] [INFO ] [MAIN ] CTRA: Loaded 53646 primary data records. [2025-10-13T22:36:33.925072] [DEBUG] [LOCAL ] CTS: Loaded 19511 existing records from primary storage. [2025-10-13T22:36:33.961352] [INFO ] [MAIN ] CTS: Loaded 19511 primary data records. [2025-10-13T22:36:33.980366] [DEBUG] [LOCAL ] CTRI: Loaded 39822 existing records from primary storage. [2025-10-13T22:36:34.032450] [INFO ] [MAIN ] CTRI: Loaded 39822 primary data records. [2025-10-13T22:36:34.872807] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:34.875781] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53646 primary records. [2025-10-13T22:36:34.877159] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-13T22:36:34.901577] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:34.920256] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19511 primary records. [2025-10-13T22:36:34.920908] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-13T22:36:34.922910] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:34.939790] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 39822 primary records. [2025-10-13T22:36:34.940436] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-13T22:36:34.942796] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-13T22:36:34.944707] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-13T22:36:34.947365] [INFO ] [MAIN ] Derivative Progress: 445/1810 symbols completed. CTRA took 1.2s. Estimated remaining: 8m 55s. Rate: 153.1 symbols/min [2025-10-13T22:36:34.957203] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:34.963070] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-13T22:36:34.963702] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-13T22:36:34.967931] [INFO ] [MAIN ] Derivative Progress: 446/1810 symbols completed. CTS took 1.2s. Estimated remaining: 8m 53s. Rate: 153.4 symbols/min [2025-10-13T22:36:34.968404] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:34.973186] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-13T22:36:34.973454] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-13T22:36:34.977469] [INFO ] [MAIN ] Derivative Progress: 447/1810 symbols completed. CTRI took 1.2s. Estimated remaining: 8m 52s. Rate: 153.8 symbols/min [2025-10-13T22:36:34.977778] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:35.055354] [DEBUG] [LOCAL ] CTVA: Loaded 53277 existing records from primary storage. [2025-10-13T22:36:35.055598] [INFO ] [MAIN ] CTVA: Loaded 53277 primary data records. [2025-10-13T22:36:35.178097] [DEBUG] [LOCAL ] CUK: Loaded 51023 existing records from primary storage. [2025-10-13T22:36:35.192275] [INFO ] [MAIN ] CUK: Loaded 51023 primary data records. [2025-10-13T22:36:35.196728] [DEBUG] [LOCAL ] CUBE: Loaded 50841 existing records from primary storage. [2025-10-13T22:36:35.209320] [INFO ] [MAIN ] CUBE: Loaded 50841 primary data records. [2025-10-13T22:36:36.122458] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:36.123711] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53277 primary records. [2025-10-13T22:36:36.123936] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-13T22:36:36.142291] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-13T22:36:36.142754] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-13T22:36:36.146271] [INFO ] [MAIN ] Derivative Progress: 448/1810 symbols completed. CTVA took 1.2s. Estimated remaining: 8m 54s. Rate: 153.1 symbols/min [2025-10-13T22:36:36.161950] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:36.163531] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51023 primary records. [2025-10-13T22:36:36.164097] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-13T22:36:36.191595] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:36.193821] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50841 primary records. [2025-10-13T22:36:36.194369] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-13T22:36:36.203822] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-13T22:36:36.207182] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-13T22:36:36.210496] [INFO ] [MAIN ] Derivative Progress: 449/1810 symbols completed. CUK took 1.2s. Estimated remaining: 8m 52s. Rate: 153.4 symbols/min [2025-10-13T22:36:36.216278] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-13T22:36:36.216436] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-13T22:36:36.219865] [INFO ] [MAIN ] Derivative Progress: 450/1810 symbols completed. CUBE took 1.3s. Estimated remaining: 8m 51s. Rate: 153.7 symbols/min [2025-10-13T22:36:36.220502] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:36.220392] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:36.221734] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:36.227312] [DEBUG] [LOCAL ] CULP: Loaded 2895 existing records from primary storage. [2025-10-13T22:36:36.227545] [INFO ] [MAIN ] CULP: Loaded 2895 primary data records. [2025-10-13T22:36:36.365930] [DEBUG] [LOCAL ] CURV: Loaded 26844 existing records from primary storage. [2025-10-13T22:36:36.405351] [INFO ] [MAIN ] CURV: Loaded 26844 primary data records. [2025-10-13T22:36:36.724723] [DEBUG] [LOCAL ] CUZ: Loaded 49541 existing records from primary storage. [2025-10-13T22:36:36.725959] [INFO ] [MAIN ] CUZ: Loaded 49541 primary data records. [2025-10-13T22:36:37.283184] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:36:37.284256] [INFO ] [MAIN ] CULP: Generated 1793 derivative records from 2895 primary records. [2025-10-13T22:36:37.284468] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-13T22:36:37.301205] [DEBUG] [LOCAL ] CULP: Derivative data saved (1793 records). [2025-10-13T22:36:37.301755] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-13T22:36:37.303885] [INFO ] [MAIN ] Derivative Progress: 451/1810 symbols completed. CULP took 1.1s. Estimated remaining: 8m 53s. Rate: 153.1 symbols/min [2025-10-13T22:36:37.304328] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:37.325667] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:37.327210] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26844 primary records. [2025-10-13T22:36:37.327312] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-13T22:36:37.348296] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:37.353143] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49541 primary records. [2025-10-13T22:36:37.353240] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-13T22:36:37.371690] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-13T22:36:37.372125] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-13T22:36:37.375455] [INFO ] [MAIN ] Derivative Progress: 452/1810 symbols completed. CUZ took 1.2s. Estimated remaining: 8m 51s. Rate: 153.4 symbols/min [2025-10-13T22:36:37.375602] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:37.391367] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-13T22:36:37.391451] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-13T22:36:37.394181] [INFO ] [MAIN ] Derivative Progress: 453/1810 symbols completed. CURV took 1.2s. Estimated remaining: 8m 50s. Rate: 153.7 symbols/min [2025-10-13T22:36:37.394583] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:37.417210] [DEBUG] [LOCAL ] CVE: Loaded 53561 existing records from primary storage. [2025-10-13T22:36:37.417567] [INFO ] [MAIN ] CVE: Loaded 53561 primary data records. [2025-10-13T22:36:37.779423] [DEBUG] [LOCAL ] CVNA: Loaded 52878 existing records from primary storage. [2025-10-13T22:36:37.779850] [INFO ] [MAIN ] CVNA: Loaded 52878 primary data records. [2025-10-13T22:36:37.794021] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-13T22:36:37.823950] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-13T22:36:38.512523] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:38.514054] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53561 primary records. [2025-10-13T22:36:38.514219] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-13T22:36:38.536934] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-13T22:36:38.538262] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-13T22:36:38.541306] [INFO ] [MAIN ] Derivative Progress: 454/1810 symbols completed. CVE took 1.2s. Estimated remaining: 8m 52s. Rate: 153.0 symbols/min [2025-10-13T22:36:38.542093] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:38.576363] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:38.589143] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52878 primary records. [2025-10-13T22:36:38.589357] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-13T22:36:38.589706] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:38.592122] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-13T22:36:38.592284] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-13T22:36:38.621789] [DEBUG] [LOCAL ] CW: Loaded 22235 existing records from primary storage. [2025-10-13T22:36:38.622740] [INFO ] [MAIN ] CW: Loaded 22235 primary data records. [2025-10-13T22:36:38.630099] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-13T22:36:38.652474] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-13T22:36:38.652382] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-13T22:36:38.655278] [INFO ] [MAIN ] Derivative Progress: 455/1810 symbols completed. CVNA took 1.3s. Estimated remaining: 8m 50s. Rate: 153.3 symbols/min [2025-10-13T22:36:38.662249] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:38.672840] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-13T22:36:38.686258] [INFO ] [MAIN ] Derivative Progress: 456/1810 symbols completed. CVS took 1.3s. Estimated remaining: 8m 49s. Rate: 153.6 symbols/min [2025-10-13T22:36:38.708222] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:39.012307] [DEBUG] [LOCAL ] CWEN: Loaded 45292 existing records from primary storage. [2025-10-13T22:36:39.012936] [INFO ] [MAIN ] CWEN: Loaded 45292 primary data records. [2025-10-13T22:36:39.125293] [DEBUG] [LOCAL ] CWH: Loaded 51335 existing records from primary storage. [2025-10-13T22:36:39.146511] [INFO ] [MAIN ] CWH: Loaded 51335 primary data records. [2025-10-13T22:36:39.434344] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:39.462903] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22235 primary records. [2025-10-13T22:36:39.468208] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-13T22:36:39.554913] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-13T22:36:39.560327] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-13T22:36:39.563594] [INFO ] [MAIN ] Derivative Progress: 457/1810 symbols completed. CW took 1.0s. Estimated remaining: 8m 50s. Rate: 153.2 symbols/min [2025-10-13T22:36:39.598407] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:39.768352] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:39.771614] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45292 primary records. [2025-10-13T22:36:39.772470] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-13T22:36:39.805925] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-13T22:36:39.806589] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-13T22:36:39.809524] [INFO ] [MAIN ] Derivative Progress: 458/1810 symbols completed. CWEN took 1.1s. Estimated remaining: 8m 49s. Rate: 153.3 symbols/min [2025-10-13T22:36:39.809924] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:39.825378] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:39.826487] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51335 primary records. [2025-10-13T22:36:39.826836] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-13T22:36:39.859259] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-13T22:36:39.860469] [DEBUG] [LOCAL ] CWK: Loaded 49523 existing records from primary storage. [2025-10-13T22:36:39.859590] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-13T22:36:39.863507] [INFO ] [MAIN ] CWK: Loaded 49523 primary data records. [2025-10-13T22:36:39.863392] [INFO ] [MAIN ] Derivative Progress: 459/1810 symbols completed. CWH took 1.2s. Estimated remaining: 8m 48s. Rate: 153.6 symbols/min [2025-10-13T22:36:39.863975] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:40.021866] [DEBUG] [LOCAL ] CWT: Loaded 28118 existing records from primary storage. [2025-10-13T22:36:40.045853] [INFO ] [MAIN ] CWT: Loaded 28118 primary data records. [2025-10-13T22:36:40.461145] [DEBUG] [LOCAL ] CX: Loaded 52816 existing records from primary storage. [2025-10-13T22:36:40.514347] [INFO ] [MAIN ] CX: Loaded 52816 primary data records. [2025-10-13T22:36:40.911571] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:40.912878] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49523 primary records. [2025-10-13T22:36:40.913259] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-13T22:36:40.948507] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:40.949709] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-13T22:36:40.951363] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 28118 primary records. [2025-10-13T22:36:40.951746] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-13T22:36:40.951498] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-13T22:36:40.954699] [INFO ] [MAIN ] Derivative Progress: 460/1810 symbols completed. CWK took 1.4s. Estimated remaining: 8m 49s. Rate: 153.0 symbols/min [2025-10-13T22:36:40.963879] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:40.971760] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-13T22:36:40.972098] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-13T22:36:40.974552] [INFO ] [MAIN ] Derivative Progress: 461/1810 symbols completed. CWT took 1.2s. Estimated remaining: 8m 48s. Rate: 153.3 symbols/min [2025-10-13T22:36:40.974731] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:40.983195] [DEBUG] [LOCAL ] CXE: Loaded 6159 existing records from primary storage. [2025-10-13T22:36:40.983375] [INFO ] [MAIN ] CXE: Loaded 6159 primary data records. [2025-10-13T22:36:41.008110] [DEBUG] [LOCAL ] CXH: Loaded 4435 existing records from primary storage. [2025-10-13T22:36:41.025002] [INFO ] [MAIN ] CXH: Loaded 4435 primary data records. [2025-10-13T22:36:41.188501] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:41.199006] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52816 primary records. [2025-10-13T22:36:41.206578] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-13T22:36:41.504533] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-13T22:36:41.616683] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-13T22:36:41.620206] [INFO ] [MAIN ] Derivative Progress: 462/1810 symbols completed. CX took 1.8s. Estimated remaining: 8m 48s. Rate: 153.1 symbols/min [2025-10-13T22:36:41.620717] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:41.692710] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:36:41.694436] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:41.695269] [INFO ] [MAIN ] CXH: Generated 1793 derivative records from 4435 primary records. [2025-10-13T22:36:41.695994] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-13T22:36:41.695941] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6159 primary records. [2025-10-13T22:36:41.696620] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-13T22:36:41.697733] [DEBUG] [LOCAL ] CXM: Loaded 47604 existing records from primary storage. [2025-10-13T22:36:41.698160] [INFO ] [MAIN ] CXM: Loaded 47604 primary data records. [2025-10-13T22:36:41.773608] [DEBUG] [LOCAL ] CXH: Derivative data saved (1793 records). [2025-10-13T22:36:41.780216] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-13T22:36:41.803994] [INFO ] [MAIN ] Derivative Progress: 463/1810 symbols completed. CXH took 0.8s. Estimated remaining: 8m 47s. Rate: 153.3 symbols/min [2025-10-13T22:36:41.841638] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-13T22:36:41.853688] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-13T22:36:41.856334] [INFO ] [MAIN ] Derivative Progress: 464/1810 symbols completed. CXE took 0.9s. Estimated remaining: 8m 46s. Rate: 153.6 symbols/min [2025-10-13T22:36:42.089247] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:42.090386] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47604 primary records. [2025-10-13T22:36:42.090512] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-13T22:36:42.107537] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-13T22:36:42.107604] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-13T22:36:42.110185] [INFO ] [MAIN ] Derivative Progress: 465/1810 symbols completed. CXM took 0.5s. Estimated remaining: 8m 45s. Rate: 153.7 symbols/min [2025-10-13T22:36:42.111616] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:42.111499] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:42.111777] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:42.155905] [DEBUG] [LOCAL ] CXT: Loaded 30997 existing records from primary storage. [2025-10-13T22:36:42.156051] [INFO ] [MAIN ] CXT: Loaded 30997 primary data records. [2025-10-13T22:36:42.316858] [DEBUG] [LOCAL ] CYH: Loaded 47691 existing records from primary storage. [2025-10-13T22:36:42.351215] [DEBUG] [LOCAL ] CXW: Loaded 43921 existing records from primary storage. [2025-10-13T22:36:42.380448] [INFO ] [MAIN ] CYH: Loaded 47691 primary data records. [2025-10-13T22:36:42.499052] [INFO ] [MAIN ] CXW: Loaded 43921 primary data records. [2025-10-13T22:36:43.177439] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:43.179402] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30997 primary records. [2025-10-13T22:36:43.179885] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-13T22:36:43.198147] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-13T22:36:43.198358] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-13T22:36:43.201694] [INFO ] [MAIN ] Derivative Progress: 466/1810 symbols completed. CXT took 1.1s. Estimated remaining: 8m 47s. Rate: 153.1 symbols/min [2025-10-13T22:36:43.202899] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:43.219458] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:43.221845] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47691 primary records. [2025-10-13T22:36:43.222010] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-13T22:36:43.251617] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-13T22:36:43.252084] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-13T22:36:43.252001] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:43.254884] [INFO ] [MAIN ] Derivative Progress: 467/1810 symbols completed. CYH took 1.1s. Estimated remaining: 8m 45s. Rate: 153.4 symbols/min [2025-10-13T22:36:43.255105] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:43.256329] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43921 primary records. [2025-10-13T22:36:43.256510] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-13T22:36:43.276924] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-13T22:36:43.277147] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-13T22:36:43.279894] [INFO ] [MAIN ] Derivative Progress: 468/1810 symbols completed. CXW took 1.2s. Estimated remaining: 8m 44s. Rate: 153.7 symbols/min [2025-10-13T22:36:43.280163] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:43.288428] [DEBUG] [LOCAL ] DAC: Loaded 12609 existing records from primary storage. [2025-10-13T22:36:43.288708] [INFO ] [MAIN ] DAC: Loaded 12609 primary data records. [2025-10-13T22:36:43.436493] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-10-13T22:36:43.442739] [INFO ] [MAIN ] D: Loaded 53646 primary data records. [2025-10-13T22:36:43.815096] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-13T22:36:43.834069] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-13T22:36:44.263415] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:44.265416] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12609 primary records. [2025-10-13T22:36:44.265959] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-13T22:36:44.284937] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-13T22:36:44.285632] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-13T22:36:44.287964] [INFO ] [MAIN ] Derivative Progress: 469/1810 symbols completed. DAC took 1.0s. Estimated remaining: 8m 45s. Rate: 153.2 symbols/min [2025-10-13T22:36:44.288253] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:44.308268] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:44.309164] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53646 primary records. [2025-10-13T22:36:44.309364] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-13T22:36:44.327212] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-13T22:36:44.327356] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-13T22:36:44.330500] [INFO ] [MAIN ] Derivative Progress: 470/1810 symbols completed. D took 1.1s. Estimated remaining: 8m 44s. Rate: 153.4 symbols/min [2025-10-13T22:36:44.331361] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:44.344894] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:44.345533] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-13T22:36:44.345675] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-13T22:36:44.372046] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-13T22:36:44.372188] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-13T22:36:44.374987] [INFO ] [MAIN ] Derivative Progress: 471/1810 symbols completed. DAL took 1.1s. Estimated remaining: 8m 43s. Rate: 153.7 symbols/min [2025-10-13T22:36:44.375936] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:44.393212] [DEBUG] [LOCAL ] DAN: Loaded 49335 existing records from primary storage. [2025-10-13T22:36:44.393439] [INFO ] [MAIN ] DAN: Loaded 49335 primary data records. [2025-10-13T22:36:44.743464] [DEBUG] [LOCAL ] DAR: Loaded 51978 existing records from primary storage. [2025-10-13T22:36:44.744112] [INFO ] [MAIN ] DAR: Loaded 51978 primary data records. [2025-10-13T22:36:44.832476] [DEBUG] [LOCAL ] DAVA: Loaded 41698 existing records from primary storage. [2025-10-13T22:36:44.857065] [INFO ] [MAIN ] DAVA: Loaded 41698 primary data records. [2025-10-13T22:36:45.367981] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:45.370272] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49335 primary records. [2025-10-13T22:36:45.370555] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-13T22:36:45.388935] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-13T22:36:45.389161] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-13T22:36:45.391727] [INFO ] [MAIN ] Derivative Progress: 472/1810 symbols completed. DAN took 1.1s. Estimated remaining: 8m 44s. Rate: 153.2 symbols/min [2025-10-13T22:36:45.392250] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:45.410088] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:45.412098] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51978 primary records. [2025-10-13T22:36:45.412294] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-13T22:36:45.434438] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:45.441495] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41698 primary records. [2025-10-13T22:36:45.441944] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-13T22:36:45.442061] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-13T22:36:45.442156] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-13T22:36:45.444977] [INFO ] [MAIN ] Derivative Progress: 473/1810 symbols completed. DAR took 1.1s. Estimated remaining: 8m 43s. Rate: 153.5 symbols/min [2025-10-13T22:36:45.445454] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:45.472261] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-13T22:36:45.472429] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-13T22:36:45.475164] [INFO ] [MAIN ] Derivative Progress: 474/1810 symbols completed. DAVA took 1.1s. Estimated remaining: 8m 41s. Rate: 153.8 symbols/min [2025-10-13T22:36:45.475381] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:45.496066] [DEBUG] [LOCAL ] DAY: Loaded 49187 existing records from primary storage. [2025-10-13T22:36:45.496286] [INFO ] [MAIN ] DAY: Loaded 49187 primary data records. [2025-10-13T22:36:45.846798] [DEBUG] [LOCAL ] DB: Loaded 52505 existing records from primary storage. [2025-10-13T22:36:45.848939] [INFO ] [MAIN ] DB: Loaded 52505 primary data records. [2025-10-13T22:36:45.861120] [DEBUG] [LOCAL ] DBI: Loaded 44091 existing records from primary storage. [2025-10-13T22:36:45.885914] [INFO ] [MAIN ] DBI: Loaded 44091 primary data records. [2025-10-13T22:36:46.515259] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:46.517041] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49187 primary records. [2025-10-13T22:36:46.517349] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-13T22:36:46.540593] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-13T22:36:46.541010] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-13T22:36:46.543557] [INFO ] [MAIN ] Derivative Progress: 475/1810 symbols completed. DAY took 1.2s. Estimated remaining: 8m 43s. Rate: 153.2 symbols/min [2025-10-13T22:36:46.543834] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:46.558421] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:46.559304] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52505 primary records. [2025-10-13T22:36:46.559559] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-13T22:36:46.597717] [DEBUG] [LOCAL ] DBL: Loaded 9289 existing records from primary storage. [2025-10-13T22:36:46.598307] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:46.598554] [INFO ] [MAIN ] DBL: Loaded 9289 primary data records. [2025-10-13T22:36:46.599379] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44091 primary records. [2025-10-13T22:36:46.611069] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-13T22:36:46.630632] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-13T22:36:46.635928] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-13T22:36:46.638969] [INFO ] [MAIN ] Derivative Progress: 476/1810 symbols completed. DB took 1.2s. Estimated remaining: 8m 42s. Rate: 153.5 symbols/min [2025-10-13T22:36:46.673761] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:46.723240] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-13T22:36:46.734188] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-13T22:36:46.742250] [INFO ] [MAIN ] Derivative Progress: 477/1810 symbols completed. DBI took 1.3s. Estimated remaining: 8m 40s. Rate: 153.7 symbols/min [2025-10-13T22:36:46.752822] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:46.972307] [DEBUG] [LOCAL ] DBRG: Loaded 49849 existing records from primary storage. [2025-10-13T22:36:46.973938] [INFO ] [MAIN ] DBRG: Loaded 49849 primary data records. [2025-10-13T22:36:46.974441] [DEBUG] [LOCAL ] DCI: Loaded 37041 existing records from primary storage. [2025-10-13T22:36:46.974619] [INFO ] [MAIN ] DCI: Loaded 37041 primary data records. [2025-10-13T22:36:47.207155] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:47.218518] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9289 primary records. [2025-10-13T22:36:47.229178] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-13T22:36:47.606256] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-13T22:36:47.606579] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-13T22:36:47.609329] [INFO ] [MAIN ] Derivative Progress: 478/1810 symbols completed. DBL took 1.1s. Estimated remaining: 8m 41s. Rate: 153.3 symbols/min [2025-10-13T22:36:47.639529] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:47.652519] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49849 primary records. [2025-10-13T22:36:47.652777] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:47.653357] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37041 primary records. [2025-10-13T22:36:47.653431] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-13T22:36:47.653485] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-13T22:36:47.681781] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-13T22:36:47.682666] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-13T22:36:47.685418] [INFO ] [MAIN ] Derivative Progress: 479/1810 symbols completed. DBRG took 1.0s. Estimated remaining: 8m 40s. Rate: 153.6 symbols/min [2025-10-13T22:36:47.689030] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-13T22:36:47.689108] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-13T22:36:47.691346] [INFO ] [MAIN ] Derivative Progress: 480/1810 symbols completed. DCI took 0.9s. Estimated remaining: 8m 39s. Rate: 153.9 symbols/min [2025-10-13T22:36:47.691812] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:47.692151] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:47.692024] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:47.708190] [DEBUG] [LOCAL ] DCO: Loaded 14327 existing records from primary storage. [2025-10-13T22:36:47.708333] [INFO ] [MAIN ] DCO: Loaded 14327 primary data records. [2025-10-13T22:36:48.036274] [DEBUG] [LOCAL ] DDD: Loaded 50954 existing records from primary storage. [2025-10-13T22:36:48.045172] [INFO ] [MAIN ] DDD: Loaded 50954 primary data records. [2025-10-13T22:36:48.113429] [DEBUG] [LOCAL ] DD: Loaded 52897 existing records from primary storage. [2025-10-13T22:36:48.136314] [INFO ] [MAIN ] DD: Loaded 52897 primary data records. [2025-10-13T22:36:48.782823] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:48.784553] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 14327 primary records. [2025-10-13T22:36:48.784920] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-13T22:36:48.805951] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-13T22:36:48.806170] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-13T22:36:48.808870] [INFO ] [MAIN ] Derivative Progress: 481/1810 symbols completed. DCO took 1.1s. Estimated remaining: 8m 40s. Rate: 153.3 symbols/min [2025-10-13T22:36:48.809505] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:48.823225] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:48.824393] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50954 primary records. [2025-10-13T22:36:48.824662] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-13T22:36:48.842945] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-13T22:36:48.843093] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-13T22:36:48.845384] [INFO ] [MAIN ] Derivative Progress: 482/1810 symbols completed. DDD took 1.2s. Estimated remaining: 8m 39s. Rate: 153.6 symbols/min [2025-10-13T22:36:48.845534] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:48.864897] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:48.878314] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52897 primary records. [2025-10-13T22:36:48.878482] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-13T22:36:48.895482] [DEBUG] [LOCAL ] DDS: Loaded 12758 existing records from primary storage. [2025-10-13T22:36:48.897110] [INFO ] [MAIN ] DDS: Loaded 12758 primary data records. [2025-10-13T22:36:49.006868] [DEBUG] [LOCAL ] DDL: Loaded 36862 existing records from primary storage. [2025-10-13T22:36:49.016803] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-10-13T22:36:49.025484] [INFO ] [MAIN ] DDL: Loaded 36862 primary data records. [2025-10-13T22:36:49.025620] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-13T22:36:49.033476] [INFO ] [MAIN ] Derivative Progress: 483/1810 symbols completed. DD took 1.3s. Estimated remaining: 8m 38s. Rate: 153.8 symbols/min [2025-10-13T22:36:49.033730] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:49.103682] [DEBUG] [LOCAL ] DDT: Loaded 2104 existing records from primary storage. [2025-10-13T22:36:49.138791] [INFO ] [MAIN ] DDT: Loaded 2104 primary data records. [2025-10-13T22:36:49.886527] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:49.887611] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 12758 primary records. [2025-10-13T22:36:49.887921] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-13T22:36:49.915976] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-10-13T22:36:49.921082] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-13T22:36:49.923921] [INFO ] [MAIN ] Derivative Progress: 484/1810 symbols completed. DDS took 1.1s. Estimated remaining: 8m 39s. Rate: 153.3 symbols/min [2025-10-13T22:36:49.924228] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:49.924786] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:49.927463] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36862 primary records. [2025-10-13T22:36:49.927824] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-13T22:36:49.956339] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-13T22:36:49.952185] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:49.957331] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2104 primary records. [2025-10-13T22:36:49.956463] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-13T22:36:49.959923] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-13T22:36:49.959851] [INFO ] [MAIN ] Derivative Progress: 485/1810 symbols completed. DDL took 1.2s. Estimated remaining: 8m 37s. Rate: 153.6 symbols/min [2025-10-13T22:36:49.960922] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:49.976664] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-10-13T22:36:49.976890] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-13T22:36:49.979589] [INFO ] [MAIN ] Derivative Progress: 486/1810 symbols completed. DDT took 0.9s. Estimated remaining: 8m 36s. Rate: 153.9 symbols/min [2025-10-13T22:36:49.979786] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:50.042549] [DEBUG] [LOCAL ] DE: Loaded 47658 existing records from primary storage. [2025-10-13T22:36:50.042834] [INFO ] [MAIN ] DE: Loaded 47658 primary data records. [2025-10-13T22:36:50.043472] [DEBUG] [LOCAL ] DEA: Loaded 40492 existing records from primary storage. [2025-10-13T22:36:50.064340] [INFO ] [MAIN ] DEA: Loaded 40492 primary data records. [2025-10-13T22:36:50.203890] [DEBUG] [LOCAL ] DEC: Loaded 30365 existing records from primary storage. [2025-10-13T22:36:50.228939] [INFO ] [MAIN ] DEC: Loaded 30365 primary data records. [2025-10-13T22:36:51.031944] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:51.040153] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47658 primary records. [2025-10-13T22:36:51.041555] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-13T22:36:51.041933] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:51.044609] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40492 primary records. [2025-10-13T22:36:51.045465] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-13T22:36:51.075630] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:51.076877] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-13T22:36:51.076977] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-13T22:36:51.079201] [INFO ] [MAIN ] Derivative Progress: 487/1810 symbols completed. DE took 1.2s. Estimated remaining: 8m 38s. Rate: 153.4 symbols/min [2025-10-13T22:36:51.086498] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:51.087469] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30365 primary records. [2025-10-13T22:36:51.087713] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-13T22:36:51.104984] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-13T22:36:51.107720] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-13T22:36:51.113121] [INFO ] [MAIN ] Derivative Progress: 488/1810 symbols completed. DEA took 1.2s. Estimated remaining: 8m 36s. Rate: 153.6 symbols/min [2025-10-13T22:36:51.113974] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:51.114741] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-13T22:36:51.115352] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-13T22:36:51.118277] [INFO ] [MAIN ] Derivative Progress: 489/1810 symbols completed. DEC took 1.1s. Estimated remaining: 8m 35s. Rate: 154.0 symbols/min [2025-10-13T22:36:51.118522] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:51.187787] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-10-13T22:36:51.188113] [INFO ] [MAIN ] DECK: Loaded 53297 primary data records. [2025-10-13T22:36:51.246264] [DEBUG] [LOCAL ] DEI: Loaded 48334 existing records from primary storage. [2025-10-13T22:36:51.286750] [INFO ] [MAIN ] DEI: Loaded 48334 primary data records. [2025-10-13T22:36:51.375026] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-13T22:36:51.395904] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-13T22:36:52.146051] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:52.159629] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53297 primary records. [2025-10-13T22:36:52.159780] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-13T22:36:52.162005] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:52.173337] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48334 primary records. [2025-10-13T22:36:52.179452] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-13T22:36:52.181539] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-13T22:36:52.196786] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-13T22:36:52.203302] [INFO ] [MAIN ] Derivative Progress: 490/1810 symbols completed. DECK took 1.1s. Estimated remaining: 8m 36s. Rate: 153.4 symbols/min [2025-10-13T22:36:52.205218] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:52.208351] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:52.212971] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-13T22:36:52.213873] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-13T22:36:52.213157] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-13T22:36:52.213966] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-13T22:36:52.217255] [INFO ] [MAIN ] Derivative Progress: 491/1810 symbols completed. DEI took 1.1s. Estimated remaining: 8m 35s. Rate: 153.7 symbols/min [2025-10-13T22:36:52.217445] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:52.235386] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-13T22:36:52.235498] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-13T22:36:52.238361] [INFO ] [MAIN ] Derivative Progress: 492/1810 symbols completed. DELL took 1.1s. Estimated remaining: 8m 34s. Rate: 154.0 symbols/min [2025-10-13T22:36:52.238598] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:52.279247] [DEBUG] [LOCAL ] DFIN: Loaded 22684 existing records from primary storage. [2025-10-13T22:36:52.279382] [INFO ] [MAIN ] DFIN: Loaded 22684 primary data records. [2025-10-13T22:36:52.387268] [DEBUG] [LOCAL ] DFH: Loaded 32203 existing records from primary storage. [2025-10-13T22:36:52.404576] [INFO ] [MAIN ] DFH: Loaded 32203 primary data records. [2025-10-13T22:36:52.448104] [DEBUG] [LOCAL ] DEO: Loaded 49199 existing records from primary storage. [2025-10-13T22:36:52.489413] [INFO ] [MAIN ] DEO: Loaded 49199 primary data records. [2025-10-13T22:36:53.300991] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:53.303086] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22684 primary records. [2025-10-13T22:36:53.303186] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-13T22:36:53.328481] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-13T22:36:53.333891] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-13T22:36:53.333835] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:53.336721] [INFO ] [MAIN ] Derivative Progress: 493/1810 symbols completed. DFIN took 1.1s. Estimated remaining: 8m 35s. Rate: 153.4 symbols/min [2025-10-13T22:36:53.334793] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32203 primary records. [2025-10-13T22:36:53.337361] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-13T22:36:53.354229] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-13T22:36:53.354454] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-13T22:36:53.356991] [INFO ] [MAIN ] Derivative Progress: 494/1810 symbols completed. DFH took 1.1s. Estimated remaining: 8m 34s. Rate: 153.7 symbols/min [2025-10-13T22:36:53.378464] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:53.379135] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49199 primary records. [2025-10-13T22:36:53.379194] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-13T22:36:53.394780] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-10-13T22:36:53.394890] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-13T22:36:53.398028] [INFO ] [MAIN ] Derivative Progress: 495/1810 symbols completed. DEO took 1.2s. Estimated remaining: 8m 32s. Rate: 154.0 symbols/min [2025-10-13T22:36:53.398675] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:53.398846] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:53.398795] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:53.417329] [DEBUG] [LOCAL ] DFP: Loaded 11208 existing records from primary storage. [2025-10-13T22:36:53.417756] [INFO ] [MAIN ] DFP: Loaded 11208 primary data records. [2025-10-13T22:36:53.765920] [DEBUG] [LOCAL ] DGX: Loaded 44805 existing records from primary storage. [2025-10-13T22:36:53.766249] [INFO ] [MAIN ] DGX: Loaded 44805 primary data records. [2025-10-13T22:36:53.827491] [DEBUG] [LOCAL ] DG: Loaded 53278 existing records from primary storage. [2025-10-13T22:36:53.841321] [INFO ] [MAIN ] DG: Loaded 53278 primary data records. [2025-10-13T22:36:54.467114] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:54.469083] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11208 primary records. [2025-10-13T22:36:54.469186] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-13T22:36:54.486721] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-13T22:36:54.487181] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-13T22:36:54.490081] [INFO ] [MAIN ] Derivative Progress: 496/1810 symbols completed. DFP took 1.1s. Estimated remaining: 8m 34s. Rate: 153.4 symbols/min [2025-10-13T22:36:54.490671] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:54.510669] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:54.511566] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44805 primary records. [2025-10-13T22:36:54.511938] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-13T22:36:54.534520] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-13T22:36:54.542063] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-13T22:36:54.545505] [INFO ] [MAIN ] Derivative Progress: 497/1810 symbols completed. DGX took 1.1s. Estimated remaining: 8m 33s. Rate: 153.7 symbols/min [2025-10-13T22:36:54.546672] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:54.548846] [DEBUG] [LOCAL ] DHF: Loaded 21235 existing records from primary storage. [2025-10-13T22:36:54.549076] [INFO ] [MAIN ] DHF: Loaded 21235 primary data records. [2025-10-13T22:36:54.593305] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:36:54.627067] [INFO ] [MAIN ] DG: Generated 1793 derivative records from 53278 primary records. [2025-10-13T22:36:54.638627] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-13T22:36:54.865009] [DEBUG] [LOCAL ] DG: Derivative data saved (1793 records). [2025-10-13T22:36:54.873872] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-13T22:36:54.877994] [INFO ] [MAIN ] Derivative Progress: 498/1810 symbols completed. DG took 1.5s. Estimated remaining: 8m 32s. Rate: 153.8 symbols/min [2025-10-13T22:36:54.892566] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:54.916801] [DEBUG] [LOCAL ] DHI: Loaded 53356 existing records from primary storage. [2025-10-13T22:36:54.917197] [INFO ] [MAIN ] DHI: Loaded 53356 primary data records. [2025-10-13T22:36:55.086213] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:55.087695] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21235 primary records. [2025-10-13T22:36:55.117894] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-13T22:36:55.169010] [DEBUG] [LOCAL ] DHR: Loaded 53378 existing records from primary storage. [2025-10-13T22:36:55.207428] [INFO ] [MAIN ] DHR: Loaded 53378 primary data records. [2025-10-13T22:36:55.208389] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-13T22:36:55.378210] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-13T22:36:55.439730] [INFO ] [MAIN ] Derivative Progress: 499/1810 symbols completed. DHF took 0.9s. Estimated remaining: 8m 32s. Rate: 153.6 symbols/min [2025-10-13T22:36:55.464842] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:55.700279] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:55.701389] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53356 primary records. [2025-10-13T22:36:55.701665] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-13T22:36:55.719469] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-13T22:36:55.720789] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-13T22:36:55.737197] [INFO ] [MAIN ] Derivative Progress: 500/1810 symbols completed. DHI took 1.2s. Estimated remaining: 8m 31s. Rate: 153.7 symbols/min [2025-10-13T22:36:55.738564] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:55.739537] [DEBUG] [LOCAL ] DHT: Loaded 47907 existing records from primary storage. [2025-10-13T22:36:55.740432] [INFO ] [MAIN ] DHT: Loaded 47907 primary data records. [2025-10-13T22:36:55.790603] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:55.809478] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53378 primary records. [2025-10-13T22:36:55.828258] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-13T22:36:55.880639] [DEBUG] [LOCAL ] DHX: Loaded 13254 existing records from primary storage. [2025-10-13T22:36:55.898862] [INFO ] [MAIN ] DHX: Loaded 13254 primary data records. [2025-10-13T22:36:55.933922] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-13T22:36:55.981707] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-13T22:36:56.162874] [INFO ] [MAIN ] Derivative Progress: 501/1810 symbols completed. DHR took 1.3s. Estimated remaining: 8m 31s. Rate: 153.7 symbols/min [2025-10-13T22:36:56.175100] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:56.434991] [DEBUG] [LOCAL ] DIAX: Loaded 13102 existing records from primary storage. [2025-10-13T22:36:56.435148] [INFO ] [MAIN ] DIAX: Loaded 13102 primary data records. [2025-10-13T22:36:56.763076] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:56.763971] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47907 primary records. [2025-10-13T22:36:56.764313] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-13T22:36:56.785377] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-13T22:36:56.786313] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-13T22:36:56.790286] [INFO ] [MAIN ] Derivative Progress: 502/1810 symbols completed. DHT took 1.3s. Estimated remaining: 8m 31s. Rate: 153.5 symbols/min [2025-10-13T22:36:56.790638] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:56.805223] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:56.806465] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13254 primary records. [2025-10-13T22:36:56.806608] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-13T22:36:56.822810] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-13T22:36:56.822984] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-13T22:36:56.825590] [INFO ] [MAIN ] Derivative Progress: 503/1810 symbols completed. DHX took 1.1s. Estimated remaining: 8m 30s. Rate: 153.8 symbols/min [2025-10-13T22:36:56.826027] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:56.843111] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:56.843875] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13102 primary records. [2025-10-13T22:36:56.844080] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-13T22:36:56.869442] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-13T22:36:56.869574] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-13T22:36:56.872056] [INFO ] [MAIN ] Derivative Progress: 504/1810 symbols completed. DIAX took 0.7s. Estimated remaining: 8m 29s. Rate: 154.0 symbols/min [2025-10-13T22:36:56.884171] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:56.885605] [DEBUG] [LOCAL ] DIN: Loaded 37419 existing records from primary storage. [2025-10-13T22:36:56.885930] [INFO ] [MAIN ] DIN: Loaded 37419 primary data records. [2025-10-13T22:36:57.232604] [DEBUG] [LOCAL ] DINO: Loaded 52852 existing records from primary storage. [2025-10-13T22:36:57.232998] [INFO ] [MAIN ] DINO: Loaded 52852 primary data records. [2025-10-13T22:36:57.416479] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-13T22:36:57.431835] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-13T22:36:57.891150] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:57.892358] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37419 primary records. [2025-10-13T22:36:57.893036] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-13T22:36:57.911334] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-13T22:36:57.911878] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-13T22:36:57.914370] [INFO ] [MAIN ] Derivative Progress: 505/1810 symbols completed. DIN took 1.1s. Estimated remaining: 8m 30s. Rate: 153.5 symbols/min [2025-10-13T22:36:57.914522] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:57.933363] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:57.934234] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52852 primary records. [2025-10-13T22:36:57.934474] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-13T22:36:57.951595] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-13T22:36:57.951781] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-13T22:36:57.954187] [INFO ] [MAIN ] Derivative Progress: 506/1810 symbols completed. DINO took 1.1s. Estimated remaining: 8m 29s. Rate: 153.8 symbols/min [2025-10-13T22:36:57.954375] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:57.971049] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:57.971809] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-13T22:36:57.971914] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-13T22:36:58.003473] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-13T22:36:58.009920] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-13T22:36:58.012977] [INFO ] [MAIN ] Derivative Progress: 507/1810 symbols completed. DIS took 1.1s. Estimated remaining: 8m 27s. Rate: 154.1 symbols/min [2025-10-13T22:36:58.013183] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:58.013818] [DEBUG] [LOCAL ] DKL: Loaded 17768 existing records from primary storage. [2025-10-13T22:36:58.014442] [INFO ] [MAIN ] DKL: Loaded 17768 primary data records. [2025-10-13T22:36:58.138958] [DEBUG] [LOCAL ] DK: Loaded 49383 existing records from primary storage. [2025-10-13T22:36:58.149616] [INFO ] [MAIN ] DK: Loaded 49383 primary data records. [2025-10-13T22:36:58.714167] [DEBUG] [LOCAL ] DKS: Loaded 49726 existing records from primary storage. [2025-10-13T22:36:58.714450] [INFO ] [MAIN ] DKS: Loaded 49726 primary data records. [2025-10-13T22:36:59.056936] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:59.058814] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 17768 primary records. [2025-10-13T22:36:59.060173] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-13T22:36:59.092358] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:59.097356] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-13T22:36:59.098518] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49383 primary records. [2025-10-13T22:36:59.098897] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-13T22:36:59.099409] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-13T22:36:59.102157] [INFO ] [MAIN ] Derivative Progress: 508/1810 symbols completed. DKL took 1.1s. Estimated remaining: 8m 29s. Rate: 153.5 symbols/min [2025-10-13T22:36:59.123799] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-13T22:36:59.136706] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:36:59.136355] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-13T22:36:59.141149] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49726 primary records. [2025-10-13T22:36:59.140234] [INFO ] [MAIN ] Derivative Progress: 509/1810 symbols completed. DK took 1.2s. Estimated remaining: 8m 28s. Rate: 153.8 symbols/min [2025-10-13T22:36:59.141397] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-13T22:36:59.157658] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-13T22:36:59.157749] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-13T22:36:59.160375] [INFO ] [MAIN ] Derivative Progress: 510/1810 symbols completed. DKS took 1.1s. Estimated remaining: 8m 26s. Rate: 154.1 symbols/min [2025-10-13T22:36:59.160992] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:59.160880] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:59.161161] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:36:59.171487] [DEBUG] [LOCAL ] DLNG: Loaded 6171 existing records from primary storage. [2025-10-13T22:36:59.171675] [INFO ] [MAIN ] DLNG: Loaded 6171 primary data records. [2025-10-13T22:36:59.397159] [DEBUG] [LOCAL ] DLB: Loaded 32122 existing records from primary storage. [2025-10-13T22:36:59.511030] [INFO ] [MAIN ] DLB: Loaded 32122 primary data records. [2025-10-13T22:36:59.592532] [DEBUG] [LOCAL ] DLR: Loaded 50768 existing records from primary storage. [2025-10-13T22:36:59.607774] [INFO ] [MAIN ] DLR: Loaded 50768 primary data records. [2025-10-13T22:37:00.178411] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:00.179547] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6171 primary records. [2025-10-13T22:37:00.180213] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-13T22:37:00.202063] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-13T22:37:00.202226] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-13T22:37:00.205208] [INFO ] [MAIN ] Derivative Progress: 511/1810 symbols completed. DLNG took 1.0s. Estimated remaining: 8m 28s. Rate: 153.6 symbols/min [2025-10-13T22:37:00.205961] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:00.238729] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:00.239367] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:00.240471] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32122 primary records. [2025-10-13T22:37:00.240746] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-13T22:37:00.241953] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50768 primary records. [2025-10-13T22:37:00.243211] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-13T22:37:00.260922] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-13T22:37:00.277862] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-13T22:37:00.278000] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-13T22:37:00.288138] [INFO ] [MAIN ] Derivative Progress: 512/1810 symbols completed. DLB took 1.1s. Estimated remaining: 8m 26s. Rate: 153.8 symbols/min [2025-10-13T22:37:00.278329] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-13T22:37:00.291361] [INFO ] [MAIN ] Derivative Progress: 513/1810 symbols completed. DLR took 1.1s. Estimated remaining: 8m 25s. Rate: 154.1 symbols/min [2025-10-13T22:37:00.288442] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:00.292198] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:00.309810] [DEBUG] [LOCAL ] DMA: Loaded 4704 existing records from primary storage. [2025-10-13T22:37:00.307094] [DEBUG] [LOCAL ] DLX: Loaded 28464 existing records from primary storage. [2025-10-13T22:37:00.309954] [INFO ] [MAIN ] DLX: Loaded 28464 primary data records. [2025-10-13T22:37:00.310108] [INFO ] [MAIN ] DMA: Loaded 4704 primary data records. [2025-10-13T22:37:00.478376] [DEBUG] [LOCAL ] DLY: Loaded 20376 existing records from primary storage. [2025-10-13T22:37:00.519936] [INFO ] [MAIN ] DLY: Loaded 20376 primary data records. [2025-10-13T22:37:01.314490] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:01.329599] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28464 primary records. [2025-10-13T22:37:01.330475] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-13T22:37:01.330211] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:37:01.333009] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4704 primary records. [2025-10-13T22:37:01.333433] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-13T22:37:01.357506] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-13T22:37:01.362299] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-13T22:37:01.365326] [INFO ] [MAIN ] Derivative Progress: 514/1810 symbols completed. DLX took 1.2s. Estimated remaining: 8m 26s. Rate: 153.6 symbols/min [2025-10-13T22:37:01.369311] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:01.369130] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-10-13T22:37:01.369754] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-13T22:37:01.372715] [INFO ] [MAIN ] Derivative Progress: 515/1810 symbols completed. DMA took 1.1s. Estimated remaining: 8m 25s. Rate: 153.9 symbols/min [2025-10-13T22:37:01.374158] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:01.397876] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:01.398986] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20376 primary records. [2025-10-13T22:37:01.399143] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-13T22:37:01.404573] [DEBUG] [LOCAL ] DMO: Loaded 9990 existing records from primary storage. [2025-10-13T22:37:01.410154] [INFO ] [MAIN ] DMO: Loaded 9990 primary data records. [2025-10-13T22:37:01.418160] [DEBUG] [LOCAL ] DMB: Loaded 10219 existing records from primary storage. [2025-10-13T22:37:01.454530] [INFO ] [MAIN ] DMB: Loaded 10219 primary data records. [2025-10-13T22:37:01.469861] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-13T22:37:01.535717] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-13T22:37:01.629517] [INFO ] [MAIN ] Derivative Progress: 516/1810 symbols completed. DLY took 1.3s. Estimated remaining: 8m 24s. Rate: 154.0 symbols/min [2025-10-13T22:37:01.669997] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:02.087869] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:02.092465] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9990 primary records. [2025-10-13T22:37:02.093779] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-13T22:37:02.116512] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-13T22:37:02.134153] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-13T22:37:02.136837] [INFO ] [MAIN ] Derivative Progress: 517/1810 symbols completed. DMO took 0.8s. Estimated remaining: 8m 24s. Rate: 153.9 symbols/min [2025-10-13T22:37:02.139274] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:02.139079] [DEBUG] [LOCAL ] DNA: Loaded 48522 existing records from primary storage. [2025-10-13T22:37:02.153900] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:02.154138] [INFO ] [MAIN ] DNA: Loaded 48522 primary data records. [2025-10-13T22:37:02.155040] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10219 primary records. [2025-10-13T22:37:02.155316] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-13T22:37:02.263258] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-13T22:37:02.284221] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-13T22:37:02.313586] [INFO ] [MAIN ] Derivative Progress: 518/1810 symbols completed. DMB took 0.9s. Estimated remaining: 8m 23s. Rate: 154.0 symbols/min [2025-10-13T22:37:02.313939] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:02.576369] [DEBUG] [LOCAL ] DNOW: Loaded 43595 existing records from primary storage. [2025-10-13T22:37:02.576784] [INFO ] [MAIN ] DNOW: Loaded 43595 primary data records. [2025-10-13T22:37:02.920916] [DEBUG] [LOCAL ] DOC: Loaded 53550 existing records from primary storage. [2025-10-13T22:37:02.922448] [INFO ] [MAIN ] DOC: Loaded 53550 primary data records. [2025-10-13T22:37:03.251178] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:03.262055] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48522 primary records. [2025-10-13T22:37:03.262428] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-13T22:37:03.283769] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-13T22:37:03.286272] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-13T22:37:03.289018] [INFO ] [MAIN ] Derivative Progress: 519/1810 symbols completed. DNA took 1.6s. Estimated remaining: 8m 24s. Rate: 153.6 symbols/min [2025-10-13T22:37:03.289719] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:03.304934] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:03.306633] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43595 primary records. [2025-10-13T22:37:03.307942] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-13T22:37:03.328206] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-13T22:37:03.328626] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-13T22:37:03.331103] [INFO ] [MAIN ] Derivative Progress: 520/1810 symbols completed. DNOW took 1.2s. Estimated remaining: 8m 23s. Rate: 153.9 symbols/min [2025-10-13T22:37:03.331519] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:03.350046] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:03.351058] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53550 primary records. [2025-10-13T22:37:03.351240] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-13T22:37:03.384841] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-13T22:37:03.385179] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-13T22:37:03.388409] [INFO ] [MAIN ] Derivative Progress: 521/1810 symbols completed. DOC took 1.1s. Estimated remaining: 8m 22s. Rate: 154.1 symbols/min [2025-10-13T22:37:03.388978] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:03.406904] [DEBUG] [LOCAL ] DOCN: Loaded 50954 existing records from primary storage. [2025-10-13T22:37:03.407224] [INFO ] [MAIN ] DOCN: Loaded 50954 primary data records. [2025-10-13T22:37:03.563638] [DEBUG] [LOCAL ] DOCS: Loaded 50877 existing records from primary storage. [2025-10-13T22:37:03.589206] [INFO ] [MAIN ] DOCS: Loaded 50877 primary data records. [2025-10-13T22:37:03.900733] [DEBUG] [LOCAL ] DOLE: Loaded 39143 existing records from primary storage. [2025-10-13T22:37:03.912981] [INFO ] [MAIN ] DOLE: Loaded 39143 primary data records. [2025-10-13T22:37:04.526681] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:04.528022] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50954 primary records. [2025-10-13T22:37:04.528246] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-13T22:37:04.547165] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-13T22:37:04.547318] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-13T22:37:04.551586] [INFO ] [MAIN ] Derivative Progress: 522/1810 symbols completed. DOCN took 1.3s. Estimated remaining: 8m 23s. Rate: 153.5 symbols/min [2025-10-13T22:37:04.552460] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:04.566973] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:04.568377] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 50877 primary records. [2025-10-13T22:37:04.568718] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-13T22:37:04.585985] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-13T22:37:04.587454] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-13T22:37:04.590629] [INFO ] [MAIN ] Derivative Progress: 523/1810 symbols completed. DOCS took 1.3s. Estimated remaining: 8m 22s. Rate: 153.8 symbols/min [2025-10-13T22:37:04.605780] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:04.617835] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 39143 primary records. [2025-10-13T22:37:04.617923] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-13T22:37:04.644206] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-13T22:37:04.645505] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-13T22:37:04.649169] [INFO ] [MAIN ] Derivative Progress: 524/1810 symbols completed. DOLE took 1.3s. Estimated remaining: 8m 21s. Rate: 154.0 symbols/min [2025-10-13T22:37:04.650453] [DEBUG] [LOCAL ] DOUG: Loaded 34290 existing records from primary storage. [2025-10-13T22:37:04.650631] [INFO ] [MAIN ] DOUG: Loaded 34290 primary data records. [2025-10-13T22:37:05.006128] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:05.006941] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34290 primary records. [2025-10-13T22:37:05.007007] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-13T22:37:05.023339] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-13T22:37:05.023428] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-13T22:37:05.026045] [INFO ] [MAIN ] Derivative Progress: 525/1810 symbols completed. DOUG took 0.5s. Estimated remaining: 8m 20s. Rate: 154.1 symbols/min [2025-10-13T22:37:05.027151] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:05.027067] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:05.026964] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:05.047144] [DEBUG] [LOCAL ] DPG: Loaded 13590 existing records from primary storage. [2025-10-13T22:37:05.047352] [INFO ] [MAIN ] DPG: Loaded 13590 primary data records. [2025-10-13T22:37:05.315086] [DEBUG] [LOCAL ] DOV: Loaded 45577 existing records from primary storage. [2025-10-13T22:37:05.428936] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-13T22:37:05.443388] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-13T22:37:05.443247] [INFO ] [MAIN ] DOV: Loaded 45577 primary data records. [2025-10-13T22:37:06.072528] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:06.073609] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13590 primary records. [2025-10-13T22:37:06.074700] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-13T22:37:06.092780] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-13T22:37:06.092868] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-13T22:37:06.096394] [INFO ] [MAIN ] Derivative Progress: 526/1810 symbols completed. DPG took 1.1s. Estimated remaining: 8m 22s. Rate: 153.5 symbols/min [2025-10-13T22:37:06.097414] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:06.112266] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:06.113292] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-13T22:37:06.113402] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-13T22:37:06.133093] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-13T22:37:06.133599] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-13T22:37:06.136053] [INFO ] [MAIN ] Derivative Progress: 527/1810 symbols completed. DOW took 1.1s. Estimated remaining: 8m 21s. Rate: 153.8 symbols/min [2025-10-13T22:37:06.136462] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:06.149930] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:06.150935] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45577 primary records. [2025-10-13T22:37:06.151180] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-13T22:37:06.168337] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-13T22:37:06.168554] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-13T22:37:06.171437] [INFO ] [MAIN ] Derivative Progress: 528/1810 symbols completed. DOV took 1.1s. Estimated remaining: 8m 19s. Rate: 154.1 symbols/min [2025-10-13T22:37:06.171593] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:06.210354] [DEBUG] [LOCAL ] DQ: Loaded 43622 existing records from primary storage. [2025-10-13T22:37:06.216840] [INFO ] [MAIN ] DQ: Loaded 43622 primary data records. [2025-10-13T22:37:06.310238] [DEBUG] [LOCAL ] DRD: Loaded 37620 existing records from primary storage. [2025-10-13T22:37:06.341229] [INFO ] [MAIN ] DRD: Loaded 37620 primary data records. [2025-10-13T22:37:06.341087] [DEBUG] [LOCAL ] DSL: Loaded 28681 existing records from primary storage. [2025-10-13T22:37:06.341524] [INFO ] [MAIN ] DSL: Loaded 28681 primary data records. [2025-10-13T22:37:07.197840] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:07.200411] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43622 primary records. [2025-10-13T22:37:07.200601] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-13T22:37:07.226501] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:07.227229] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37620 primary records. [2025-10-13T22:37:07.227563] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-13T22:37:07.248817] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-13T22:37:07.249372] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-13T22:37:07.254922] [INFO ] [MAIN ] Derivative Progress: 529/1810 symbols completed. DQ took 1.2s. Estimated remaining: 8m 21s. Rate: 153.6 symbols/min [2025-10-13T22:37:07.255261] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:07.252411] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-13T22:37:07.256483] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-13T22:37:07.260269] [INFO ] [MAIN ] Derivative Progress: 530/1810 symbols completed. DRD took 1.1s. Estimated remaining: 8m 19s. Rate: 153.8 symbols/min [2025-10-13T22:37:07.260621] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:07.276109] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:07.277320] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28681 primary records. [2025-10-13T22:37:07.277591] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-13T22:37:07.280016] [DEBUG] [LOCAL ] DSMC: Loaded 1838 existing records from primary storage. [2025-10-13T22:37:07.281110] [INFO ] [MAIN ] DSMC: Loaded 1838 primary data records. [2025-10-13T22:37:07.366136] [DEBUG] [LOCAL ] DSM: Loaded 14307 existing records from primary storage. [2025-10-13T22:37:07.382814] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-13T22:37:07.398995] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-13T22:37:07.381465] [INFO ] [MAIN ] DSM: Loaded 14307 primary data records. [2025-10-13T22:37:07.409302] [INFO ] [MAIN ] Derivative Progress: 531/1810 symbols completed. DSL took 1.2s. Estimated remaining: 8m 18s. Rate: 154.0 symbols/min [2025-10-13T22:37:07.424446] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:07.811825] [DEBUG] [LOCAL ] DSU: Loaded 22953 existing records from primary storage. [2025-10-13T22:37:07.812929] [INFO ] [MAIN ] DSU: Loaded 22953 primary data records. [2025-10-13T22:37:08.270757] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:37:08.273311] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1838 primary records. [2025-10-13T22:37:08.273819] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-13T22:37:08.299567] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:08.303283] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14307 primary records. [2025-10-13T22:37:08.304946] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-13T22:37:08.305003] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-10-13T22:37:08.305634] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-13T22:37:08.308249] [INFO ] [MAIN ] Derivative Progress: 532/1810 symbols completed. DSMC took 1.0s. Estimated remaining: 8m 19s. Rate: 153.6 symbols/min [2025-10-13T22:37:08.308787] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:08.324610] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-13T22:37:08.324913] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-13T22:37:08.327926] [INFO ] [MAIN ] Derivative Progress: 533/1810 symbols completed. DSM took 1.1s. Estimated remaining: 8m 18s. Rate: 153.9 symbols/min [2025-10-13T22:37:08.328184] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:08.351214] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:08.351982] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22953 primary records. [2025-10-13T22:37:08.352161] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-13T22:37:08.368804] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-13T22:37:08.375776] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-13T22:37:08.379949] [INFO ] [MAIN ] Derivative Progress: 534/1810 symbols completed. DSU took 1.0s. Estimated remaining: 8m 17s. Rate: 154.2 symbols/min [2025-10-13T22:37:08.380107] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:08.381939] [DEBUG] [LOCAL ] DSX: Loaded 24104 existing records from primary storage. [2025-10-13T22:37:08.382200] [INFO ] [MAIN ] DSX: Loaded 24104 primary data records. [2025-10-13T22:37:08.767132] [DEBUG] [LOCAL ] DT: Loaded 52943 existing records from primary storage. [2025-10-13T22:37:08.768332] [INFO ] [MAIN ] DT: Loaded 52943 primary data records. [2025-10-13T22:37:08.889886] [DEBUG] [LOCAL ] DTE: Loaded 47508 existing records from primary storage. [2025-10-13T22:37:08.891447] [INFO ] [MAIN ] DTE: Loaded 47508 primary data records. [2025-10-13T22:37:09.392621] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:09.393887] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24104 primary records. [2025-10-13T22:37:09.394174] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-13T22:37:09.413512] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-13T22:37:09.414065] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-13T22:37:09.416776] [INFO ] [MAIN ] Derivative Progress: 535/1810 symbols completed. DSX took 1.1s. Estimated remaining: 8m 18s. Rate: 153.7 symbols/min [2025-10-13T22:37:09.417274] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:09.428222] [DEBUG] [LOCAL ] DTG: Loaded 5799 existing records from primary storage. [2025-10-13T22:37:09.429901] [INFO ] [MAIN ] DTG: Loaded 5799 primary data records. [2025-10-13T22:37:09.532283] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:09.550914] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52943 primary records. [2025-10-13T22:37:09.552300] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-13T22:37:09.776677] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-13T22:37:09.768437] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:09.777454] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-13T22:37:09.780793] [INFO ] [MAIN ] Derivative Progress: 536/1810 symbols completed. DT took 1.5s. Estimated remaining: 8m 17s. Rate: 153.7 symbols/min [2025-10-13T22:37:09.781075] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:09.778612] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47508 primary records. [2025-10-13T22:37:09.781279] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-13T22:37:09.800466] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-13T22:37:09.800576] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-13T22:37:09.804056] [INFO ] [MAIN ] Derivative Progress: 537/1810 symbols completed. DTE took 1.4s. Estimated remaining: 8m 16s. Rate: 154.0 symbols/min [2025-10-13T22:37:09.804489] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:09.838784] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:09.839518] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5799 primary records. [2025-10-13T22:37:09.839674] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-13T22:37:09.854762] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-13T22:37:09.854851] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-13T22:37:09.857470] [INFO ] [MAIN ] Derivative Progress: 538/1810 symbols completed. DTG took 0.4s. Estimated remaining: 8m 15s. Rate: 154.2 symbols/min [2025-10-13T22:37:09.871546] [DEBUG] [LOCAL ] DTM: Loaded 43975 existing records from primary storage. [2025-10-13T22:37:09.871776] [INFO ] [MAIN ] DTM: Loaded 43975 primary data records. [2025-10-13T22:37:10.078411] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-13T22:37:10.179107] [INFO ] [MAIN ] DUK: Loaded 53437 primary data records. [2025-10-13T22:37:10.561521] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:10.562427] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 43975 primary records. [2025-10-13T22:37:10.562617] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-13T22:37:10.581201] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-10-13T22:37:10.581844] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-13T22:37:10.584545] [INFO ] [MAIN ] Derivative Progress: 539/1810 symbols completed. DTM took 0.8s. Estimated remaining: 8m 15s. Rate: 154.0 symbols/min [2025-10-13T22:37:10.597525] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:10.598269] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53437 primary records. [2025-10-13T22:37:10.598333] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-13T22:37:10.615067] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-10-13T22:37:10.615163] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-13T22:37:10.617737] [INFO ] [MAIN ] Derivative Progress: 540/1810 symbols completed. DUK took 0.8s. Estimated remaining: 8m 14s. Rate: 154.2 symbols/min [2025-10-13T22:37:10.618366] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:10.618493] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:10.619071] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:10.627483] [DEBUG] [LOCAL ] DUKB: Loaded 6319 existing records from primary storage. [2025-10-13T22:37:10.627672] [INFO ] [MAIN ] DUKB: Loaded 6319 primary data records. [2025-10-13T22:37:10.968984] [DEBUG] [LOCAL ] DV: Loaded 51298 existing records from primary storage. [2025-10-13T22:37:10.969303] [INFO ] [MAIN ] DV: Loaded 51298 primary data records. [2025-10-13T22:37:11.061522] [DEBUG] [LOCAL ] DX: Loaded 52474 existing records from primary storage. [2025-10-13T22:37:11.086096] [INFO ] [MAIN ] DX: Loaded 52474 primary data records. [2025-10-13T22:37:11.490008] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:37:11.506398] [INFO ] [MAIN ] DUKB: Generated 1793 derivative records from 6319 primary records. [2025-10-13T22:37:11.508928] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-13T22:37:11.664377] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1793 records). [2025-10-13T22:37:11.664701] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-13T22:37:11.667635] [INFO ] [MAIN ] Derivative Progress: 541/1810 symbols completed. DUKB took 1.0s. Estimated remaining: 8m 15s. Rate: 153.8 symbols/min [2025-10-13T22:37:11.668185] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:11.689286] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:11.690363] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51298 primary records. [2025-10-13T22:37:11.690663] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-13T22:37:11.723324] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-13T22:37:11.723784] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-13T22:37:11.726267] [INFO ] [MAIN ] Derivative Progress: 542/1810 symbols completed. DV took 1.1s. Estimated remaining: 8m 14s. Rate: 154.0 symbols/min [2025-10-13T22:37:11.726707] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:11.726927] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:11.728050] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52474 primary records. [2025-10-13T22:37:11.728786] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-13T22:37:11.757754] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-13T22:37:11.757904] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-13T22:37:11.760999] [INFO ] [MAIN ] Derivative Progress: 543/1810 symbols completed. DX took 1.1s. Estimated remaining: 8m 13s. Rate: 154.3 symbols/min [2025-10-13T22:37:11.761325] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:11.777228] [DEBUG] [LOCAL ] DXC: Loaded 49851 existing records from primary storage. [2025-10-13T22:37:11.777460] [INFO ] [MAIN ] DXC: Loaded 49851 primary data records. [2025-10-13T22:37:12.111068] [DEBUG] [LOCAL ] DY: Loaded 28501 existing records from primary storage. [2025-10-13T22:37:12.112849] [INFO ] [MAIN ] DY: Loaded 28501 primary data records. [2025-10-13T22:37:12.112560] [DEBUG] [LOCAL ] DXYZ: Loaded 37107 existing records from primary storage. [2025-10-13T22:37:12.113157] [INFO ] [MAIN ] DXYZ: Loaded 37107 primary data records. [2025-10-13T22:37:12.793328] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:12.795055] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49851 primary records. [2025-10-13T22:37:12.795476] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-13T22:37:12.814000] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-13T22:37:12.815366] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-13T22:37:12.819317] [INFO ] [MAIN ] Derivative Progress: 544/1810 symbols completed. DXC took 1.2s. Estimated remaining: 8m 14s. Rate: 153.8 symbols/min [2025-10-13T22:37:12.820307] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:12.836868] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:12.850121] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28501 primary records. [2025-10-13T22:37:12.849364] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:12.850784] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 37107 primary records. [2025-10-13T22:37:12.850979] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-13T22:37:12.850870] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-13T22:37:12.884739] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-13T22:37:12.885422] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-13T22:37:12.888157] [INFO ] [MAIN ] Derivative Progress: 545/1810 symbols completed. DY took 1.1s. Estimated remaining: 8m 13s. Rate: 154.0 symbols/min [2025-10-13T22:37:12.888923] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:12.890632] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-13T22:37:12.891105] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-13T22:37:12.902487] [INFO ] [MAIN ] Derivative Progress: 546/1810 symbols completed. DXYZ took 1.2s. Estimated remaining: 8m 12s. Rate: 154.3 symbols/min [2025-10-13T22:37:12.902762] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:12.919582] [DEBUG] [LOCAL ] EAI: Loaded 4003 existing records from primary storage. [2025-10-13T22:37:12.919351] [DEBUG] [LOCAL ] E: Loaded 33186 existing records from primary storage. [2025-10-13T22:37:12.919821] [INFO ] [MAIN ] E: Loaded 33186 primary data records. [2025-10-13T22:37:12.919979] [INFO ] [MAIN ] EAI: Loaded 4003 primary data records. [2025-10-13T22:37:13.227049] [DEBUG] [LOCAL ] EAF: Loaded 41883 existing records from primary storage. [2025-10-13T22:37:13.241008] [INFO ] [MAIN ] EAF: Loaded 41883 primary data records. [2025-10-13T22:37:13.864505] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:13.865939] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 4003 primary records. [2025-10-13T22:37:13.866037] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-13T22:37:13.885050] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-13T22:37:13.885295] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-13T22:37:13.900522] [INFO ] [MAIN ] Derivative Progress: 547/1810 symbols completed. EAI took 1.0s. Estimated remaining: 8m 13s. Rate: 153.8 symbols/min [2025-10-13T22:37:13.906265] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:13.909022] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:13.910468] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33186 primary records. [2025-10-13T22:37:13.910811] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-13T22:37:13.930636] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-13T22:37:13.931004] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-13T22:37:13.935803] [INFO ] [MAIN ] Derivative Progress: 548/1810 symbols completed. E took 1.1s. Estimated remaining: 8m 11s. Rate: 154.1 symbols/min [2025-10-13T22:37:13.937158] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:13.953531] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:13.955023] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 41883 primary records. [2025-10-13T22:37:13.966199] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-13T22:37:13.997205] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-13T22:37:13.998219] [DEBUG] [LOCAL ] EB: Loaded 36701 existing records from primary storage. [2025-10-13T22:37:13.997393] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-13T22:37:14.001497] [INFO ] [MAIN ] Derivative Progress: 549/1810 symbols completed. EAF took 1.1s. Estimated remaining: 8m 10s. Rate: 154.3 symbols/min [2025-10-13T22:37:14.001922] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:14.001773] [INFO ] [MAIN ] EB: Loaded 36701 primary data records. [2025-10-13T22:37:14.157072] [DEBUG] [LOCAL ] EBR: Loaded 43212 existing records from primary storage. [2025-10-13T22:37:14.162536] [INFO ] [MAIN ] EBR: Loaded 43212 primary data records. [2025-10-13T22:37:14.533696] [DEBUG] [LOCAL ] EBS: Loaded 46756 existing records from primary storage. [2025-10-13T22:37:14.554108] [INFO ] [MAIN ] EBS: Loaded 46756 primary data records. [2025-10-13T22:37:15.049245] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:15.051549] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 36701 primary records. [2025-10-13T22:37:15.051774] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-13T22:37:15.070402] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-13T22:37:15.070668] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-13T22:37:15.074185] [INFO ] [MAIN ] Derivative Progress: 550/1810 symbols completed. EB took 1.2s. Estimated remaining: 8m 11s. Rate: 153.8 symbols/min [2025-10-13T22:37:15.088015] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:15.089293] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:15.090520] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43212 primary records. [2025-10-13T22:37:15.090737] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-13T22:37:15.107712] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-13T22:37:15.107800] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-13T22:37:15.110438] [INFO ] [MAIN ] Derivative Progress: 551/1810 symbols completed. EBR took 1.2s. Estimated remaining: 8m 10s. Rate: 154.1 symbols/min [2025-10-13T22:37:15.110900] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:15.129920] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:15.130964] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46756 primary records. [2025-10-13T22:37:15.131081] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-13T22:37:15.160422] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-13T22:37:15.160737] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-13T22:37:15.163677] [INFO ] [MAIN ] Derivative Progress: 552/1810 symbols completed. EBS took 1.2s. Estimated remaining: 8m 9s. Rate: 154.3 symbols/min [2025-10-13T22:37:15.164062] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:15.198311] [DEBUG] [LOCAL ] ECAT: Loaded 29435 existing records from primary storage. [2025-10-13T22:37:15.200123] [INFO ] [MAIN ] ECAT: Loaded 29435 primary data records. [2025-10-13T22:37:15.223173] [DEBUG] [LOCAL ] EC: Loaded 49023 existing records from primary storage. [2025-10-13T22:37:15.246084] [INFO ] [MAIN ] EC: Loaded 49023 primary data records. [2025-10-13T22:37:15.503723] [DEBUG] [LOCAL ] ECC: Loaded 43166 existing records from primary storage. [2025-10-13T22:37:15.578337] [INFO ] [MAIN ] ECC: Loaded 43166 primary data records. [2025-10-13T22:37:16.195110] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:16.196247] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29435 primary records. [2025-10-13T22:37:16.196753] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-13T22:37:16.225044] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:16.229872] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-13T22:37:16.228925] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49023 primary records. [2025-10-13T22:37:16.230253] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-13T22:37:16.230352] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-13T22:37:16.233851] [INFO ] [MAIN ] Derivative Progress: 553/1810 symbols completed. ECAT took 1.1s. Estimated remaining: 8m 10s. Rate: 153.8 symbols/min [2025-10-13T22:37:16.253671] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-13T22:37:16.266459] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-13T22:37:16.266755] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:16.270334] [INFO ] [MAIN ] Derivative Progress: 554/1810 symbols completed. EC took 1.2s. Estimated remaining: 8m 9s. Rate: 154.1 symbols/min [2025-10-13T22:37:16.271356] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43166 primary records. [2025-10-13T22:37:16.271462] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-13T22:37:16.286954] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-13T22:37:16.287017] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-13T22:37:16.290412] [INFO ] [MAIN ] Derivative Progress: 555/1810 symbols completed. ECC took 1.1s. Estimated remaining: 8m 8s. Rate: 154.4 symbols/min [2025-10-13T22:37:16.291214] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:16.290920] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:16.291104] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:16.297959] [DEBUG] [LOCAL ] ECCU: Loaded 2215 existing records from primary storage. [2025-10-13T22:37:16.298202] [INFO ] [MAIN ] ECCU: Loaded 2215 primary data records. [2025-10-13T22:37:16.677784] [DEBUG] [LOCAL ] ECG: Loaded 33411 existing records from primary storage. [2025-10-13T22:37:16.678763] [INFO ] [MAIN ] ECG: Loaded 33411 primary data records. [2025-10-13T22:37:16.679822] [DEBUG] [LOCAL ] ECL: Loaded 46627 existing records from primary storage. [2025-10-13T22:37:16.717566] [INFO ] [MAIN ] ECL: Loaded 46627 primary data records. [2025-10-13T22:37:17.354408] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:37:17.356307] [INFO ] [MAIN ] ECCU: Generated 1791 derivative records from 2215 primary records. [2025-10-13T22:37:17.358199] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-13T22:37:17.377415] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1791 records). [2025-10-13T22:37:17.378126] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-13T22:37:17.381510] [INFO ] [MAIN ] Derivative Progress: 556/1810 symbols completed. ECCU took 1.1s. Estimated remaining: 8m 9s. Rate: 153.9 symbols/min [2025-10-13T22:37:17.381905] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:17.401695] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:17.410076] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33411 primary records. [2025-10-13T22:37:17.410207] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-13T22:37:17.436480] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:17.443118] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46627 primary records. [2025-10-13T22:37:17.445703] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-13T22:37:17.448337] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-13T22:37:17.448617] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-13T22:37:17.463514] [INFO ] [MAIN ] Derivative Progress: 557/1810 symbols completed. ECG took 1.2s. Estimated remaining: 8m 8s. Rate: 154.1 symbols/min [2025-10-13T22:37:17.467432] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-13T22:37:17.459959] [DEBUG] [LOCAL ] ECO: Loaded 18380 existing records from primary storage. [2025-10-13T22:37:17.467728] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-13T22:37:17.463726] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:17.467961] [INFO ] [MAIN ] ECO: Loaded 18380 primary data records. [2025-10-13T22:37:17.471535] [INFO ] [MAIN ] Derivative Progress: 558/1810 symbols completed. ECL took 1.2s. Estimated remaining: 8m 7s. Rate: 154.3 symbols/min [2025-10-13T22:37:17.476988] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:17.852080] [DEBUG] [LOCAL ] ECVT: Loaded 43268 existing records from primary storage. [2025-10-13T22:37:17.852627] [INFO ] [MAIN ] ECVT: Loaded 43268 primary data records. [2025-10-13T22:37:17.886381] [DEBUG] [LOCAL ] ED: Loaded 52680 existing records from primary storage. [2025-10-13T22:37:17.912087] [INFO ] [MAIN ] ED: Loaded 52680 primary data records. [2025-10-13T22:37:18.513349] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:18.515013] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18380 primary records. [2025-10-13T22:37:18.516533] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-13T22:37:18.538155] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-13T22:37:18.538457] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-13T22:37:18.541731] [INFO ] [MAIN ] Derivative Progress: 559/1810 symbols completed. ECO took 1.2s. Estimated remaining: 8m 8s. Rate: 153.9 symbols/min [2025-10-13T22:37:18.542270] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:18.561353] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:18.562899] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43268 primary records. [2025-10-13T22:37:18.564108] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-13T22:37:18.599599] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:18.601943] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52680 primary records. [2025-10-13T22:37:18.602678] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-13T22:37:18.628032] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-13T22:37:18.628779] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-13T22:37:18.632074] [INFO ] [MAIN ] Derivative Progress: 560/1810 symbols completed. ECVT took 1.2s. Estimated remaining: 8m 7s. Rate: 154.1 symbols/min [2025-10-13T22:37:18.633029] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:18.634522] [DEBUG] [LOCAL ] EDD: Loaded 26815 existing records from primary storage. [2025-10-13T22:37:18.635777] [INFO ] [MAIN ] EDD: Loaded 26815 primary data records. [2025-10-13T22:37:18.703670] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-13T22:37:18.747946] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-13T22:37:18.799840] [INFO ] [MAIN ] Derivative Progress: 561/1810 symbols completed. ED took 1.3s. Estimated remaining: 8m 6s. Rate: 154.2 symbols/min [2025-10-13T22:37:18.828320] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:18.975976] [DEBUG] [LOCAL ] EDN: Loaded 18698 existing records from primary storage. [2025-10-13T22:37:18.976295] [INFO ] [MAIN ] EDN: Loaded 18698 primary data records. [2025-10-13T22:37:19.314056] [DEBUG] [LOCAL ] EE: Loaded 33066 existing records from primary storage. [2025-10-13T22:37:19.314733] [INFO ] [MAIN ] EE: Loaded 33066 primary data records. [2025-10-13T22:37:19.485227] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:19.514418] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 26815 primary records. [2025-10-13T22:37:19.538037] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-13T22:37:19.677920] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-13T22:37:19.678288] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-13T22:37:19.681077] [INFO ] [MAIN ] Derivative Progress: 562/1810 symbols completed. EDD took 1.1s. Estimated remaining: 8m 7s. Rate: 153.9 symbols/min [2025-10-13T22:37:19.684248] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:19.700469] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:37:19.702225] [INFO ] [MAIN ] EDN: Generated 1793 derivative records from 18698 primary records. [2025-10-13T22:37:19.702624] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-13T22:37:19.732355] [DEBUG] [LOCAL ] EEX: Loaded 10407 existing records from primary storage. [2025-10-13T22:37:19.727739] [DEBUG] [LOCAL ] EDN: Derivative data saved (1793 records). [2025-10-13T22:37:19.732927] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-13T22:37:19.733106] [INFO ] [MAIN ] EEX: Loaded 10407 primary data records. [2025-10-13T22:37:19.748081] [INFO ] [MAIN ] Derivative Progress: 563/1810 symbols completed. EDN took 1.1s. Estimated remaining: 8m 6s. Rate: 154.1 symbols/min [2025-10-13T22:37:19.768214] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:19.895236] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:19.899513] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 33066 primary records. [2025-10-13T22:37:19.905238] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-13T22:37:20.076244] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-13T22:37:20.089567] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-13T22:37:20.094725] [INFO ] [MAIN ] Derivative Progress: 564/1810 symbols completed. EE took 1.3s. Estimated remaining: 8m 5s. Rate: 154.1 symbols/min [2025-10-13T22:37:20.095121] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:20.097171] [DEBUG] [LOCAL ] EFC: Loaded 46412 existing records from primary storage. [2025-10-13T22:37:20.097675] [INFO ] [MAIN ] EFC: Loaded 46412 primary data records. [2025-10-13T22:37:20.212631] [DEBUG] [LOCAL ] EFR: Loaded 15082 existing records from primary storage. [2025-10-13T22:37:20.218341] [INFO ] [MAIN ] EFR: Loaded 15082 primary data records. [2025-10-13T22:37:20.383731] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:20.507499] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 10407 primary records. [2025-10-13T22:37:20.535322] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-13T22:37:20.827818] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-13T22:37:20.830008] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-13T22:37:20.833205] [INFO ] [MAIN ] Derivative Progress: 565/1810 symbols completed. EEX took 1.1s. Estimated remaining: 8m 5s. Rate: 153.9 symbols/min [2025-10-13T22:37:20.833428] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:20.855487] [DEBUG] [LOCAL ] EFT: Loaded 13195 existing records from primary storage. [2025-10-13T22:37:20.856003] [INFO ] [MAIN ] EFT: Loaded 13195 primary data records. [2025-10-13T22:37:20.932225] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:20.974306] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46412 primary records. [2025-10-13T22:37:20.980136] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-13T22:37:21.205529] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:21.212760] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 15082 primary records. [2025-10-13T22:37:21.212369] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-10-13T22:37:21.213050] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-13T22:37:21.214788] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-13T22:37:21.217854] [INFO ] [MAIN ] Derivative Progress: 566/1810 symbols completed. EFC took 1.4s. Estimated remaining: 8m 5s. Rate: 153.9 symbols/min [2025-10-13T22:37:21.230682] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:21.237436] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-13T22:37:21.237576] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-13T22:37:21.241017] [INFO ] [MAIN ] Derivative Progress: 567/1810 symbols completed. EFR took 1.1s. Estimated remaining: 8m 4s. Rate: 154.2 symbols/min [2025-10-13T22:37:21.241171] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:21.293892] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:21.295302] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13195 primary records. [2025-10-13T22:37:21.294524] [DEBUG] [LOCAL ] EFXT: Loaded 29521 existing records from primary storage. [2025-10-13T22:37:21.295529] [INFO ] [MAIN ] EFXT: Loaded 29521 primary data records. [2025-10-13T22:37:21.295436] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-13T22:37:21.339429] [DEBUG] [LOCAL ] EG: Loaded 27796 existing records from primary storage. [2025-10-13T22:37:21.370937] [INFO ] [MAIN ] EG: Loaded 27796 primary data records. [2025-10-13T22:37:21.399240] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-13T22:37:21.426116] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-13T22:37:21.437723] [INFO ] [MAIN ] Derivative Progress: 568/1810 symbols completed. EFT took 0.6s. Estimated remaining: 8m 3s. Rate: 154.3 symbols/min [2025-10-13T22:37:22.025577] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:22.027096] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29521 primary records. [2025-10-13T22:37:22.027218] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-13T22:37:22.046559] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-13T22:37:22.046676] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-13T22:37:22.049897] [INFO ] [MAIN ] Derivative Progress: 569/1810 symbols completed. EFXT took 0.8s. Estimated remaining: 8m 3s. Rate: 154.1 symbols/min [2025-10-13T22:37:22.066080] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:22.066869] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27796 primary records. [2025-10-13T22:37:22.066932] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-13T22:37:22.083817] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-13T22:37:22.083888] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-13T22:37:22.086873] [INFO ] [MAIN ] Derivative Progress: 570/1810 symbols completed. EG took 0.8s. Estimated remaining: 8m 2s. Rate: 154.4 symbols/min [2025-10-13T22:37:22.087455] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:22.087549] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:22.087395] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:22.141102] [DEBUG] [LOCAL ] EHAB: Loaded 29307 existing records from primary storage. [2025-10-13T22:37:22.141458] [INFO ] [MAIN ] EHAB: Loaded 29307 primary data records. [2025-10-13T22:37:22.193709] [DEBUG] [LOCAL ] EGP: Loaded 30338 existing records from primary storage. [2025-10-13T22:37:22.205668] [INFO ] [MAIN ] EGP: Loaded 30338 primary data records. [2025-10-13T22:37:22.339376] [DEBUG] [LOCAL ] EGO: Loaded 51689 existing records from primary storage. [2025-10-13T22:37:22.376493] [INFO ] [MAIN ] EGO: Loaded 51689 primary data records. [2025-10-13T22:37:23.121441] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:23.123590] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29307 primary records. [2025-10-13T22:37:23.125738] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-13T22:37:23.154564] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:23.156462] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30338 primary records. [2025-10-13T22:37:23.156950] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-13T22:37:23.174405] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-13T22:37:23.174525] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-13T22:37:23.178043] [INFO ] [MAIN ] Derivative Progress: 571/1810 symbols completed. EHAB took 1.1s. Estimated remaining: 8m 3s. Rate: 153.9 symbols/min [2025-10-13T22:37:23.178721] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:23.183354] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-13T22:37:23.183557] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-13T22:37:23.187069] [INFO ] [MAIN ] Derivative Progress: 572/1810 symbols completed. EGP took 1.1s. Estimated remaining: 8m 2s. Rate: 154.2 symbols/min [2025-10-13T22:37:23.200245] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:23.200120] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:23.201238] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51689 primary records. [2025-10-13T22:37:23.201714] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-13T22:37:23.218561] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-13T22:37:23.221409] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-13T22:37:23.225071] [INFO ] [MAIN ] Derivative Progress: 573/1810 symbols completed. EGO took 1.1s. Estimated remaining: 8m 1s. Rate: 154.4 symbols/min [2025-10-13T22:37:23.225408] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:23.231778] [DEBUG] [LOCAL ] EHI: Loaded 10658 existing records from primary storage. [2025-10-13T22:37:23.232089] [INFO ] [MAIN ] EHI: Loaded 10658 primary data records. [2025-10-13T22:37:23.432436] [DEBUG] [LOCAL ] EIC: Loaded 22931 existing records from primary storage. [2025-10-13T22:37:23.443063] [INFO ] [MAIN ] EIC: Loaded 22931 primary data records. [2025-10-13T22:37:23.640155] [DEBUG] [LOCAL ] EHC: Loaded 41048 existing records from primary storage. [2025-10-13T22:37:23.660823] [INFO ] [MAIN ] EHC: Loaded 41048 primary data records. [2025-10-13T22:37:24.303954] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:24.305252] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10658 primary records. [2025-10-13T22:37:24.305719] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-13T22:37:24.325947] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-13T22:37:24.326387] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-13T22:37:24.328905] [INFO ] [MAIN ] Derivative Progress: 574/1810 symbols completed. EHI took 1.1s. Estimated remaining: 8m 2s. Rate: 153.9 symbols/min [2025-10-13T22:37:24.329225] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:24.347831] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:24.348708] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 22931 primary records. [2025-10-13T22:37:24.348799] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-13T22:37:24.386344] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:24.396713] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41048 primary records. [2025-10-13T22:37:24.398638] [DEBUG] [LOCAL ] EIG: Loaded 20178 existing records from primary storage. [2025-10-13T22:37:24.398073] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-13T22:37:24.398819] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-13T22:37:24.400025] [INFO ] [MAIN ] EIG: Loaded 20178 primary data records. [2025-10-13T22:37:24.433788] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-13T22:37:24.461627] [INFO ] [MAIN ] Derivative Progress: 575/1810 symbols completed. EIC took 1.2s. Estimated remaining: 8m 1s. Rate: 154.1 symbols/min [2025-10-13T22:37:24.475231] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:24.476971] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-13T22:37:24.498792] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-13T22:37:24.530179] [INFO ] [MAIN ] Derivative Progress: 576/1810 symbols completed. EHC took 1.4s. Estimated remaining: 7m 60s. Rate: 154.3 symbols/min [2025-10-13T22:37:24.530633] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:24.831129] [DEBUG] [LOCAL ] EIX: Loaded 53364 existing records from primary storage. [2025-10-13T22:37:24.851880] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:24.852010] [INFO ] [MAIN ] EIX: Loaded 53364 primary data records. [2025-10-13T22:37:24.852944] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20178 primary records. [2025-10-13T22:37:24.853121] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-13T22:37:24.874424] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-13T22:37:24.890449] [INFO ] [MAIN ] EL: Loaded 53376 primary data records. [2025-10-13T22:37:25.192665] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-13T22:37:25.297021] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-13T22:37:25.310161] [INFO ] [MAIN ] Derivative Progress: 577/1810 symbols completed. EIG took 1.0s. Estimated remaining: 8m 0s. Rate: 154.0 symbols/min [2025-10-13T22:37:25.327701] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:25.529338] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:25.545169] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53364 primary records. [2025-10-13T22:37:25.545566] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-13T22:37:25.581268] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-13T22:37:25.595748] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-13T22:37:25.596124] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:25.595313] [DEBUG] [LOCAL ] ELAN: Loaded 53299 existing records from primary storage. [2025-10-13T22:37:25.598721] [INFO ] [MAIN ] Derivative Progress: 578/1810 symbols completed. EIX took 1.1s. Estimated remaining: 7m 60s. Rate: 154.1 symbols/min [2025-10-13T22:37:25.599053] [INFO ] [MAIN ] ELAN: Loaded 53299 primary data records. [2025-10-13T22:37:25.600227] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53376 primary records. [2025-10-13T22:37:25.612093] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:25.621498] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-13T22:37:25.728166] [DEBUG] [LOCAL ] ELC: Loaded 3505 existing records from primary storage. [2025-10-13T22:37:25.730348] [INFO ] [MAIN ] ELC: Loaded 3505 primary data records. [2025-10-13T22:37:25.867049] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-13T22:37:26.015587] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-13T22:37:26.037482] [INFO ] [MAIN ] Derivative Progress: 579/1810 symbols completed. EL took 1.5s. Estimated remaining: 7m 59s. Rate: 154.1 symbols/min [2025-10-13T22:37:26.042133] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:26.289469] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:26.290802] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53299 primary records. [2025-10-13T22:37:26.290883] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-13T22:37:26.324253] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-13T22:37:26.333447] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-13T22:37:26.342530] [DEBUG] [LOCAL ] ELF: Loaded 52038 existing records from primary storage. [2025-10-13T22:37:26.341144] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:26.343553] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3505 primary records. [2025-10-13T22:37:26.340612] [INFO ] [MAIN ] Derivative Progress: 580/1810 symbols completed. ELAN took 1.0s. Estimated remaining: 7m 59s. Rate: 154.1 symbols/min [2025-10-13T22:37:26.343754] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:26.343877] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-13T22:37:26.345342] [INFO ] [MAIN ] ELF: Loaded 52038 primary data records. [2025-10-13T22:37:26.441940] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-13T22:37:26.447222] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-13T22:37:26.461964] [INFO ] [MAIN ] Derivative Progress: 581/1810 symbols completed. ELC took 0.8s. Estimated remaining: 7m 58s. Rate: 154.3 symbols/min [2025-10-13T22:37:26.469910] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:26.704259] [DEBUG] [LOCAL ] ELME: Loaded 39410 existing records from primary storage. [2025-10-13T22:37:26.704764] [INFO ] [MAIN ] ELME: Loaded 39410 primary data records. [2025-10-13T22:37:26.805073] [DEBUG] [LOCAL ] ELP: Loaded 25644 existing records from primary storage. [2025-10-13T22:37:26.815884] [INFO ] [MAIN ] ELP: Loaded 25644 primary data records. [2025-10-13T22:37:27.370205] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:27.371556] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52038 primary records. [2025-10-13T22:37:27.372057] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-13T22:37:27.390664] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-13T22:37:27.391199] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-13T22:37:27.393425] [INFO ] [MAIN ] Derivative Progress: 582/1810 symbols completed. ELF took 1.4s. Estimated remaining: 7m 59s. Rate: 153.9 symbols/min [2025-10-13T22:37:27.393849] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:27.410632] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:27.411333] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39410 primary records. [2025-10-13T22:37:27.411421] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-13T22:37:27.440537] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:27.443791] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25644 primary records. [2025-10-13T22:37:27.444467] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-13T22:37:27.444622] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-13T22:37:27.444152] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-13T22:37:27.447203] [INFO ] [MAIN ] Derivative Progress: 583/1810 symbols completed. ELME took 1.1s. Estimated remaining: 7m 58s. Rate: 154.2 symbols/min [2025-10-13T22:37:27.472670] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-13T22:37:27.472800] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-13T22:37:27.475376] [INFO ] [MAIN ] Derivative Progress: 584/1810 symbols completed. ELP took 1.0s. Estimated remaining: 7m 56s. Rate: 154.4 symbols/min [2025-10-13T22:37:27.492348] [DEBUG] [LOCAL ] ELS: Loaded 49898 existing records from primary storage. [2025-10-13T22:37:27.492483] [INFO ] [MAIN ] ELS: Loaded 49898 primary data records. [2025-10-13T22:37:27.804332] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:27.804996] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49898 primary records. [2025-10-13T22:37:27.805058] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-13T22:37:27.821423] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-13T22:37:27.821486] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-13T22:37:27.823608] [INFO ] [MAIN ] Derivative Progress: 585/1810 symbols completed. ELS took 0.4s. Estimated remaining: 7m 56s. Rate: 154.4 symbols/min [2025-10-13T22:37:27.824208] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:27.824787] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:27.824331] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:27.830202] [DEBUG] [LOCAL ] EMF: Loaded 3279 existing records from primary storage. [2025-10-13T22:37:27.830325] [INFO ] [MAIN ] EMF: Loaded 3279 primary data records. [2025-10-13T22:37:28.008026] [DEBUG] [LOCAL ] EME: Loaded 31109 existing records from primary storage. [2025-10-13T22:37:28.027099] [INFO ] [MAIN ] EME: Loaded 31109 primary data records. [2025-10-13T22:37:28.290571] [DEBUG] [LOCAL ] ELV: Loaded 50650 existing records from primary storage. [2025-10-13T22:37:28.323250] [INFO ] [MAIN ] ELV: Loaded 50650 primary data records. [2025-10-13T22:37:28.849313] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:28.850234] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3279 primary records. [2025-10-13T22:37:28.850484] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-13T22:37:28.870216] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-13T22:37:28.878054] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-13T22:37:28.886857] [INFO ] [MAIN ] Derivative Progress: 586/1810 symbols completed. EMF took 1.1s. Estimated remaining: 7m 57s. Rate: 154.0 symbols/min [2025-10-13T22:37:28.887018] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:28.884490] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:28.888196] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31109 primary records. [2025-10-13T22:37:28.888528] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-13T22:37:28.908781] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-13T22:37:28.908926] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-13T22:37:28.911050] [INFO ] [MAIN ] Derivative Progress: 587/1810 symbols completed. EME took 1.1s. Estimated remaining: 7m 56s. Rate: 154.2 symbols/min [2025-10-13T22:37:28.911449] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:28.929871] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:28.930901] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50650 primary records. [2025-10-13T22:37:28.934680] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-13T22:37:28.953345] [DEBUG] [LOCAL ] EMO: Loaded 13184 existing records from primary storage. [2025-10-13T22:37:28.954872] [INFO ] [MAIN ] EMO: Loaded 13184 primary data records. [2025-10-13T22:37:29.053225] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-13T22:37:29.075165] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-13T22:37:29.078480] [INFO ] [MAIN ] Derivative Progress: 588/1810 symbols completed. ELV took 1.3s. Estimated remaining: 7m 55s. Rate: 154.4 symbols/min [2025-10-13T22:37:29.106970] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:29.164829] [DEBUG] [LOCAL ] EMN: Loaded 50714 existing records from primary storage. [2025-10-13T22:37:29.170546] [INFO ] [MAIN ] EMN: Loaded 50714 primary data records. [2025-10-13T22:37:29.294175] [DEBUG] [LOCAL ] EMP: Loaded 3063 existing records from primary storage. [2025-10-13T22:37:29.320063] [INFO ] [MAIN ] EMP: Loaded 3063 primary data records. [2025-10-13T22:37:29.957544] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:29.958689] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 13184 primary records. [2025-10-13T22:37:29.959675] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-13T22:37:29.980934] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-13T22:37:29.983386] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-13T22:37:29.986110] [INFO ] [MAIN ] Derivative Progress: 589/1810 symbols completed. EMO took 1.1s. Estimated remaining: 7m 56s. Rate: 154.0 symbols/min [2025-10-13T22:37:29.986368] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:30.001799] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:30.003818] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50714 primary records. [2025-10-13T22:37:30.016143] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-13T22:37:30.016451] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:30.017891] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3063 primary records. [2025-10-13T22:37:30.020229] [DEBUG] [LOCAL ] ENFY: Loaded 3596 existing records from primary storage. [2025-10-13T22:37:30.031194] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-13T22:37:30.027487] [INFO ] [MAIN ] ENFY: Loaded 3596 primary data records. [2025-10-13T22:37:30.151908] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-13T22:37:30.152989] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-13T22:37:30.152562] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-13T22:37:30.155577] [INFO ] [MAIN ] Derivative Progress: 590/1810 symbols completed. EMN took 1.3s. Estimated remaining: 7m 55s. Rate: 154.2 symbols/min [2025-10-13T22:37:30.153089] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-13T22:37:30.156131] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:30.174365] [INFO ] [MAIN ] Derivative Progress: 591/1810 symbols completed. EMP took 1.1s. Estimated remaining: 7m 54s. Rate: 154.4 symbols/min [2025-10-13T22:37:30.174898] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:30.350437] [DEBUG] [LOCAL ] ENO: Loaded 1870 existing records from primary storage. [2025-10-13T22:37:30.350637] [INFO ] [MAIN ] ENO: Loaded 1870 primary data records. [2025-10-13T22:37:30.557296] [DEBUG] [LOCAL ] ENIC: Loaded 36489 existing records from primary storage. [2025-10-13T22:37:30.557561] [INFO ] [MAIN ] ENIC: Loaded 36489 primary data records. [2025-10-13T22:37:31.034445] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:37:31.035265] [INFO ] [MAIN ] ENFY: Generated 1791 derivative records from 3596 primary records. [2025-10-13T22:37:31.035427] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-13T22:37:31.050191] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1791 records). [2025-10-13T22:37:31.051357] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-13T22:37:31.054200] [INFO ] [MAIN ] Derivative Progress: 592/1810 symbols completed. ENFY took 1.1s. Estimated remaining: 7m 54s. Rate: 154.1 symbols/min [2025-10-13T22:37:31.054805] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:31.074020] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:31.074991] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1870 primary records. [2025-10-13T22:37:31.075222] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-13T22:37:31.091011] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-10-13T22:37:31.091205] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-13T22:37:31.093790] [INFO ] [MAIN ] Derivative Progress: 593/1810 symbols completed. ENO took 0.9s. Estimated remaining: 7m 53s. Rate: 154.3 symbols/min [2025-10-13T22:37:31.093941] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:31.122105] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:31.122866] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36489 primary records. [2025-10-13T22:37:31.123022] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-13T22:37:31.152923] [DEBUG] [LOCAL ] ENOV: Loaded 44876 existing records from primary storage. [2025-10-13T22:37:31.153070] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-13T22:37:31.153278] [INFO ] [MAIN ] ENOV: Loaded 44876 primary data records. [2025-10-13T22:37:31.153213] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-13T22:37:31.155867] [INFO ] [MAIN ] Derivative Progress: 594/1810 symbols completed. ENIC took 1.0s. Estimated remaining: 7m 52s. Rate: 154.5 symbols/min [2025-10-13T22:37:31.156121] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:31.337578] [DEBUG] [LOCAL ] ENR: Loaded 43561 existing records from primary storage. [2025-10-13T22:37:31.353693] [INFO ] [MAIN ] ENR: Loaded 43561 primary data records. [2025-10-13T22:37:31.609308] [DEBUG] [LOCAL ] ENS: Loaded 29433 existing records from primary storage. [2025-10-13T22:37:31.609584] [INFO ] [MAIN ] ENS: Loaded 29433 primary data records. [2025-10-13T22:37:32.105214] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:32.107051] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44876 primary records. [2025-10-13T22:37:32.107809] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-13T22:37:32.130177] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-13T22:37:32.138071] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-13T22:37:32.145142] [INFO ] [MAIN ] Derivative Progress: 595/1810 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 53s. Rate: 154.1 symbols/min [2025-10-13T22:37:32.146072] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:32.147093] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:32.146985] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43561 primary records. [2025-10-13T22:37:32.147269] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-13T22:37:32.180472] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-13T22:37:32.180126] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:32.180673] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-13T22:37:32.181538] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29433 primary records. [2025-10-13T22:37:32.184160] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-13T22:37:32.184065] [INFO ] [MAIN ] Derivative Progress: 596/1810 symbols completed. ENR took 1.1s. Estimated remaining: 7m 52s. Rate: 154.4 symbols/min [2025-10-13T22:37:32.192170] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:32.222150] [DEBUG] [LOCAL ] ENVA: Loaded 25436 existing records from primary storage. [2025-10-13T22:37:32.224252] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-13T22:37:32.223561] [INFO ] [MAIN ] ENVA: Loaded 25436 primary data records. [2025-10-13T22:37:32.249900] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-13T22:37:32.268352] [INFO ] [MAIN ] Derivative Progress: 597/1810 symbols completed. ENS took 1.1s. Estimated remaining: 7m 51s. Rate: 154.6 symbols/min [2025-10-13T22:37:32.268538] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:32.301424] [DEBUG] [LOCAL ] EOD: Loaded 14986 existing records from primary storage. [2025-10-13T22:37:32.323209] [INFO ] [MAIN ] EOD: Loaded 14986 primary data records. [2025-10-13T22:37:32.884159] [DEBUG] [LOCAL ] EOG: Loaded 53349 existing records from primary storage. [2025-10-13T22:37:32.884949] [INFO ] [MAIN ] EOG: Loaded 53349 primary data records. [2025-10-13T22:37:33.223265] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:33.226929] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25436 primary records. [2025-10-13T22:37:33.228777] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-13T22:37:33.243021] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:33.244250] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14986 primary records. [2025-10-13T22:37:33.252594] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-13T22:37:33.277173] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-13T22:37:33.277581] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-13T22:37:33.281938] [INFO ] [MAIN ] Derivative Progress: 598/1810 symbols completed. EOD took 1.1s. Estimated remaining: 7m 52s. Rate: 154.2 symbols/min [2025-10-13T22:37:33.283411] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-13T22:37:33.283790] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-13T22:37:33.286518] [INFO ] [MAIN ] Derivative Progress: 599/1810 symbols completed. ENVA took 1.1s. Estimated remaining: 7m 51s. Rate: 154.4 symbols/min [2025-10-13T22:37:33.301956] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:33.302595] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53349 primary records. [2025-10-13T22:37:33.302683] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-13T22:37:33.318521] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-13T22:37:33.318589] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-13T22:37:33.321201] [INFO ] [MAIN ] Derivative Progress: 600/1810 symbols completed. EOG took 1.1s. Estimated remaining: 7m 49s. Rate: 154.7 symbols/min [2025-10-13T22:37:33.321741] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:33.322004] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:33.321900] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:33.331425] [DEBUG] [LOCAL ] EOT: Loaded 6803 existing records from primary storage. [2025-10-13T22:37:33.331670] [INFO ] [MAIN ] EOT: Loaded 6803 primary data records. [2025-10-13T22:37:33.434950] [DEBUG] [LOCAL ] EOS: Loaded 15359 existing records from primary storage. [2025-10-13T22:37:33.450140] [INFO ] [MAIN ] EOS: Loaded 15359 primary data records. [2025-10-13T22:37:33.450534] [DEBUG] [LOCAL ] EOI: Loaded 10791 existing records from primary storage. [2025-10-13T22:37:33.473369] [INFO ] [MAIN ] EOI: Loaded 10791 primary data records. [2025-10-13T22:37:34.320735] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:34.322395] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6803 primary records. [2025-10-13T22:37:34.322545] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-13T22:37:34.358482] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-13T22:37:34.358751] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-13T22:37:34.358114] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:34.375499] [INFO ] [MAIN ] Derivative Progress: 601/1810 symbols completed. EOT took 1.1s. Estimated remaining: 7m 50s. Rate: 154.2 symbols/min [2025-10-13T22:37:34.376978] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10791 primary records. [2025-10-13T22:37:34.372872] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:34.377373] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:34.377605] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-13T22:37:34.379106] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15359 primary records. [2025-10-13T22:37:34.380395] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-13T22:37:34.423331] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-13T22:37:34.424359] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-13T22:37:34.427755] [INFO ] [MAIN ] Derivative Progress: 602/1810 symbols completed. EOS took 1.1s. Estimated remaining: 7m 49s. Rate: 154.4 symbols/min [2025-10-13T22:37:34.428480] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-13T22:37:34.428634] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:34.429053] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-13T22:37:34.432701] [INFO ] [MAIN ] Derivative Progress: 603/1810 symbols completed. EOI took 1.1s. Estimated remaining: 7m 48s. Rate: 154.7 symbols/min [2025-10-13T22:37:34.432913] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:34.443863] [DEBUG] [LOCAL ] EPAC: Loaded 26461 existing records from primary storage. [2025-10-13T22:37:34.444145] [INFO ] [MAIN ] EPAC: Loaded 26461 primary data records. [2025-10-13T22:37:34.818246] [DEBUG] [LOCAL ] EPAM: Loaded 39518 existing records from primary storage. [2025-10-13T22:37:34.820686] [INFO ] [MAIN ] EPAM: Loaded 39518 primary data records. [2025-10-13T22:37:34.826577] [DEBUG] [LOCAL ] EPC: Loaded 39804 existing records from primary storage. [2025-10-13T22:37:34.834132] [INFO ] [MAIN ] EPC: Loaded 39804 primary data records. [2025-10-13T22:37:35.457452] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:35.459699] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26461 primary records. [2025-10-13T22:37:35.460256] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-13T22:37:35.485510] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-13T22:37:35.485931] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-13T22:37:35.488783] [INFO ] [MAIN ] Derivative Progress: 604/1810 symbols completed. EPAC took 1.1s. Estimated remaining: 7m 49s. Rate: 154.3 symbols/min [2025-10-13T22:37:35.489206] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:35.523179] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:35.529873] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39518 primary records. [2025-10-13T22:37:35.530459] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-13T22:37:35.530343] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:35.532429] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39804 primary records. [2025-10-13T22:37:35.532634] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-13T22:37:35.570359] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-13T22:37:35.586088] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-13T22:37:35.589339] [INFO ] [MAIN ] Derivative Progress: 605/1810 symbols completed. EPC took 1.2s. Estimated remaining: 7m 48s. Rate: 154.4 symbols/min [2025-10-13T22:37:35.590176] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:35.593403] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-13T22:37:35.593802] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-13T22:37:35.596834] [INFO ] [MAIN ] Derivative Progress: 606/1810 symbols completed. EPAM took 1.2s. Estimated remaining: 7m 47s. Rate: 154.7 symbols/min [2025-10-13T22:37:35.597076] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:35.615312] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-13T22:37:35.615743] [INFO ] [MAIN ] EPD: Loaded 53611 primary data records. [2025-10-13T22:37:35.701930] [DEBUG] [LOCAL ] EQBK: Loaded 11061 existing records from primary storage. [2025-10-13T22:37:35.718428] [INFO ] [MAIN ] EQBK: Loaded 11061 primary data records. [2025-10-13T22:37:36.025874] [DEBUG] [LOCAL ] EPR: Loaded 43903 existing records from primary storage. [2025-10-13T22:37:36.031272] [INFO ] [MAIN ] EPR: Loaded 43903 primary data records. [2025-10-13T22:37:36.709795] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:36.711764] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53611 primary records. [2025-10-13T22:37:36.712150] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-13T22:37:36.748686] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-13T22:37:36.749372] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:36.750211] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 11061 primary records. [2025-10-13T22:37:36.750708] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-13T22:37:36.750491] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-13T22:37:36.753393] [INFO ] [MAIN ] Derivative Progress: 607/1810 symbols completed. EPD took 1.3s. Estimated remaining: 7m 48s. Rate: 154.2 symbols/min [2025-10-13T22:37:36.753763] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:36.789593] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:36.791502] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43903 primary records. [2025-10-13T22:37:36.790559] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-13T22:37:36.791752] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-13T22:37:36.791682] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-13T22:37:36.795390] [INFO ] [MAIN ] Derivative Progress: 608/1810 symbols completed. EQBK took 1.2s. Estimated remaining: 7m 47s. Rate: 154.4 symbols/min [2025-10-13T22:37:36.803703] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:36.814329] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-13T22:37:36.814547] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-13T22:37:36.818751] [INFO ] [MAIN ] Derivative Progress: 609/1810 symbols completed. EPR took 1.2s. Estimated remaining: 7m 46s. Rate: 154.7 symbols/min [2025-10-13T22:37:36.819124] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:36.873362] [DEBUG] [LOCAL ] EQH: Loaded 52685 existing records from primary storage. [2025-10-13T22:37:36.873701] [INFO ] [MAIN ] EQH: Loaded 52685 primary data records. [2025-10-13T22:37:37.061921] [DEBUG] [LOCAL ] EQNR: Loaded 53028 existing records from primary storage. [2025-10-13T22:37:37.073089] [INFO ] [MAIN ] EQNR: Loaded 53028 primary data records. [2025-10-13T22:37:37.219463] [DEBUG] [LOCAL ] EQR: Loaded 51677 existing records from primary storage. [2025-10-13T22:37:37.369631] [INFO ] [MAIN ] EQR: Loaded 51677 primary data records. [2025-10-13T22:37:38.032380] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:38.033938] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52685 primary records. [2025-10-13T22:37:38.034082] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-13T22:37:38.062797] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-13T22:37:38.076546] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:38.076186] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-13T22:37:38.081367] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53028 primary records. [2025-10-13T22:37:38.080043] [INFO ] [MAIN ] Derivative Progress: 610/1810 symbols completed. EQH took 1.3s. Estimated remaining: 7m 47s. Rate: 154.1 symbols/min [2025-10-13T22:37:38.081897] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-13T22:37:38.082046] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:38.104756] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-13T22:37:38.120032] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-13T22:37:38.123087] [INFO ] [MAIN ] Derivative Progress: 611/1810 symbols completed. EQNR took 1.3s. Estimated remaining: 7m 46s. Rate: 154.3 symbols/min [2025-10-13T22:37:38.123886] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:38.123602] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:38.125738] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51677 primary records. [2025-10-13T22:37:38.125830] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-13T22:37:38.149062] [DEBUG] [LOCAL ] EQV: Loaded 2666 existing records from primary storage. [2025-10-13T22:37:38.149355] [INFO ] [MAIN ] EQV: Loaded 2666 primary data records. [2025-10-13T22:37:38.146416] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-13T22:37:38.172683] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-13T22:37:38.207081] [INFO ] [MAIN ] Derivative Progress: 612/1810 symbols completed. EQR took 1.4s. Estimated remaining: 7m 45s. Rate: 154.5 symbols/min [2025-10-13T22:37:38.214606] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:38.379358] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-13T22:37:38.400580] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-13T22:37:38.854276] [DEBUG] [LOCAL ] ERJ: Loaded 50324 existing records from primary storage. [2025-10-13T22:37:38.889342] [INFO ] [MAIN ] ERJ: Loaded 50324 primary data records. [2025-10-13T22:37:39.370827] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:39.372305] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2666 primary records. [2025-10-13T22:37:39.372783] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-13T22:37:39.388839] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-13T22:37:39.389388] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-13T22:37:39.394139] [INFO ] [MAIN ] Derivative Progress: 613/1810 symbols completed. EQV took 1.3s. Estimated remaining: 7m 46s. Rate: 154.0 symbols/min [2025-10-13T22:37:39.409314] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:39.410050] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53685 primary records. [2025-10-13T22:37:39.410208] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-13T22:37:39.428503] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-13T22:37:39.428634] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-13T22:37:39.431180] [INFO ] [MAIN ] Derivative Progress: 614/1810 symbols completed. EQT took 1.3s. Estimated remaining: 7m 45s. Rate: 154.2 symbols/min [2025-10-13T22:37:39.443594] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:39.444190] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50324 primary records. [2025-10-13T22:37:39.444247] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-13T22:37:39.459544] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-13T22:37:39.459601] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-13T22:37:39.462665] [INFO ] [MAIN ] Derivative Progress: 615/1810 symbols completed. ERJ took 1.2s. Estimated remaining: 7m 44s. Rate: 154.4 symbols/min [2025-10-13T22:37:39.463091] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:39.463375] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:39.463456] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:39.499487] [DEBUG] [LOCAL ] ESAB: Loaded 26029 existing records from primary storage. [2025-10-13T22:37:39.499625] [INFO ] [MAIN ] ESAB: Loaded 26029 primary data records. [2025-10-13T22:37:39.631942] [DEBUG] [LOCAL ] ERO: Loaded 41700 existing records from primary storage. [2025-10-13T22:37:39.632227] [INFO ] [MAIN ] ERO: Loaded 41700 primary data records. [2025-10-13T22:37:39.828136] [DEBUG] [LOCAL ] ES: Loaded 52672 existing records from primary storage. [2025-10-13T22:37:39.953697] [INFO ] [MAIN ] ES: Loaded 52672 primary data records. [2025-10-13T22:37:40.478596] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:40.481336] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26029 primary records. [2025-10-13T22:37:40.482182] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-13T22:37:40.510444] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:40.514874] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41700 primary records. [2025-10-13T22:37:40.515047] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-13T22:37:40.514983] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-13T22:37:40.515945] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-13T22:37:40.518217] [INFO ] [MAIN ] Derivative Progress: 616/1810 symbols completed. ESAB took 1.1s. Estimated remaining: 7m 45s. Rate: 154.0 symbols/min [2025-10-13T22:37:40.518370] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:40.545817] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:40.547415] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52672 primary records. [2025-10-13T22:37:40.547702] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-13T22:37:40.556952] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-13T22:37:40.557100] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-13T22:37:40.570581] [INFO ] [MAIN ] Derivative Progress: 617/1810 symbols completed. ERO took 1.1s. Estimated remaining: 7m 44s. Rate: 154.2 symbols/min [2025-10-13T22:37:40.571754] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-13T22:37:40.571926] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-13T22:37:40.574778] [INFO ] [MAIN ] Derivative Progress: 618/1810 symbols completed. ES took 1.1s. Estimated remaining: 7m 43s. Rate: 154.5 symbols/min [2025-10-13T22:37:40.572050] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:40.575004] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:40.582496] [DEBUG] [LOCAL ] ESE: Loaded 16500 existing records from primary storage. [2025-10-13T22:37:40.582780] [INFO ] [MAIN ] ESE: Loaded 16500 primary data records. [2025-10-13T22:37:40.916958] [DEBUG] [LOCAL ] ESNT: Loaded 38336 existing records from primary storage. [2025-10-13T22:37:40.917350] [INFO ] [MAIN ] ESNT: Loaded 38336 primary data records. [2025-10-13T22:37:41.041569] [DEBUG] [LOCAL ] ESI: Loaded 50681 existing records from primary storage. [2025-10-13T22:37:41.062978] [INFO ] [MAIN ] ESI: Loaded 50681 primary data records. [2025-10-13T22:37:41.605485] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:41.607077] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16500 primary records. [2025-10-13T22:37:41.607526] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-13T22:37:41.628107] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-13T22:37:41.628517] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-13T22:37:41.630939] [INFO ] [MAIN ] Derivative Progress: 619/1810 symbols completed. ESE took 1.1s. Estimated remaining: 7m 44s. Rate: 154.1 symbols/min [2025-10-13T22:37:41.631328] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:41.652900] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:41.655103] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38336 primary records. [2025-10-13T22:37:41.655301] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-13T22:37:41.681472] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:41.682781] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50681 primary records. [2025-10-13T22:37:41.683088] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-13T22:37:41.709908] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-13T22:37:41.711635] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-13T22:37:41.714805] [INFO ] [MAIN ] Derivative Progress: 620/1810 symbols completed. ESNT took 1.1s. Estimated remaining: 7m 43s. Rate: 154.3 symbols/min [2025-10-13T22:37:41.717227] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:41.718395] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-13T22:37:41.718973] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-13T22:37:41.733499] [INFO ] [MAIN ] Derivative Progress: 621/1810 symbols completed. ESI took 1.2s. Estimated remaining: 7m 42s. Rate: 154.5 symbols/min [2025-10-13T22:37:41.735182] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:41.736508] [DEBUG] [LOCAL ] ESRT: Loaded 46391 existing records from primary storage. [2025-10-13T22:37:41.736746] [INFO ] [MAIN ] ESRT: Loaded 46391 primary data records. [2025-10-13T22:37:42.064974] [DEBUG] [LOCAL ] ESS: Loaded 29854 existing records from primary storage. [2025-10-13T22:37:42.065820] [INFO ] [MAIN ] ESS: Loaded 29854 primary data records. [2025-10-13T22:37:42.187595] [DEBUG] [LOCAL ] ESTC: Loaded 50268 existing records from primary storage. [2025-10-13T22:37:42.236053] [INFO ] [MAIN ] ESTC: Loaded 50268 primary data records. [2025-10-13T22:37:42.697116] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:42.699040] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46391 primary records. [2025-10-13T22:37:42.699387] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-13T22:37:42.716774] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-13T22:37:42.716968] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-13T22:37:42.719498] [INFO ] [MAIN ] Derivative Progress: 622/1810 symbols completed. ESRT took 1.1s. Estimated remaining: 7m 43s. Rate: 154.1 symbols/min [2025-10-13T22:37:42.719714] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:42.738487] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:42.739425] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29854 primary records. [2025-10-13T22:37:42.739631] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-13T22:37:42.756715] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-13T22:37:42.757055] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-13T22:37:42.759353] [INFO ] [MAIN ] Derivative Progress: 623/1810 symbols completed. ESS took 1.0s. Estimated remaining: 7m 41s. Rate: 154.3 symbols/min [2025-10-13T22:37:42.759683] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:42.776468] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:42.777185] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50268 primary records. [2025-10-13T22:37:42.777308] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-13T22:37:42.809353] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-13T22:37:42.809692] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-13T22:37:42.812472] [INFO ] [MAIN ] Derivative Progress: 624/1810 symbols completed. ESTC took 1.1s. Estimated remaining: 7m 40s. Rate: 154.5 symbols/min [2025-10-13T22:37:42.817030] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:42.817373] [DEBUG] [LOCAL ] ETB: Loaded 12121 existing records from primary storage. [2025-10-13T22:37:42.817465] [INFO ] [MAIN ] ETB: Loaded 12121 primary data records. [2025-10-13T22:37:42.937541] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-13T22:37:42.943535] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-13T22:37:43.115610] [DEBUG] [LOCAL ] ETD: Loaded 27310 existing records from primary storage. [2025-10-13T22:37:43.132558] [INFO ] [MAIN ] ETD: Loaded 27310 primary data records. [2025-10-13T22:37:43.885079] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:43.885977] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12121 primary records. [2025-10-13T22:37:43.886225] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-13T22:37:43.918564] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-13T22:37:43.919105] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:43.919253] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-13T22:37:43.920232] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-13T22:37:43.922712] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-13T22:37:43.922588] [INFO ] [MAIN ] Derivative Progress: 625/1810 symbols completed. ETB took 1.2s. Estimated remaining: 7m 41s. Rate: 154.1 symbols/min [2025-10-13T22:37:43.923780] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:43.944050] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-13T22:37:43.952057] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-13T22:37:43.959744] [INFO ] [MAIN ] Derivative Progress: 626/1810 symbols completed. ET took 1.2s. Estimated remaining: 7m 40s. Rate: 154.3 symbols/min [2025-10-13T22:37:43.960222] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:43.960779] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:43.966586] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27310 primary records. [2025-10-13T22:37:43.966895] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-13T22:37:43.988910] [DEBUG] [LOCAL ] ETG: Loaded 16585 existing records from primary storage. [2025-10-13T22:37:43.989618] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-13T22:37:43.989793] [INFO ] [MAIN ] ETG: Loaded 16585 primary data records. [2025-10-13T22:37:43.989906] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-13T22:37:43.992751] [INFO ] [MAIN ] Derivative Progress: 627/1810 symbols completed. ETD took 1.2s. Estimated remaining: 7m 39s. Rate: 154.5 symbols/min [2025-10-13T22:37:44.004436] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:44.152313] [DEBUG] [LOCAL ] ETJ: Loaded 16965 existing records from primary storage. [2025-10-13T22:37:44.185453] [INFO ] [MAIN ] ETJ: Loaded 16965 primary data records. [2025-10-13T22:37:44.543169] [DEBUG] [LOCAL ] ETN: Loaded 52670 existing records from primary storage. [2025-10-13T22:37:44.549201] [INFO ] [MAIN ] ETN: Loaded 52670 primary data records. [2025-10-13T22:37:44.868221] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:44.974926] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16585 primary records. [2025-10-13T22:37:44.984908] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-13T22:37:45.003171] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-13T22:37:45.004096] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-13T22:37:45.006800] [INFO ] [MAIN ] Derivative Progress: 628/1810 symbols completed. ETG took 1.1s. Estimated remaining: 7m 40s. Rate: 154.1 symbols/min [2025-10-13T22:37:45.024960] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:45.025725] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16965 primary records. [2025-10-13T22:37:45.025948] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-13T22:37:45.042187] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-13T22:37:45.042530] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-13T22:37:45.044639] [INFO ] [MAIN ] Derivative Progress: 629/1810 symbols completed. ETJ took 1.1s. Estimated remaining: 7m 39s. Rate: 154.4 symbols/min [2025-10-13T22:37:45.060480] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:45.061187] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52670 primary records. [2025-10-13T22:37:45.061248] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-13T22:37:45.076533] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-13T22:37:45.076593] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-13T22:37:45.079441] [INFO ] [MAIN ] Derivative Progress: 630/1810 symbols completed. ETN took 1.1s. Estimated remaining: 7m 38s. Rate: 154.6 symbols/min [2025-10-13T22:37:45.080188] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:45.080124] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:45.080714] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:45.090628] [DEBUG] [LOCAL ] ETO: Loaded 6923 existing records from primary storage. [2025-10-13T22:37:45.090904] [INFO ] [MAIN ] ETO: Loaded 6923 primary data records. [2025-10-13T22:37:45.458205] [DEBUG] [LOCAL ] ETR: Loaded 53213 existing records from primary storage. [2025-10-13T22:37:45.459811] [INFO ] [MAIN ] ETR: Loaded 53213 primary data records. [2025-10-13T22:37:45.518509] [DEBUG] [LOCAL ] ETSY: Loaded 53582 existing records from primary storage. [2025-10-13T22:37:45.531723] [INFO ] [MAIN ] ETSY: Loaded 53582 primary data records. [2025-10-13T22:37:46.105582] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:46.106710] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6923 primary records. [2025-10-13T22:37:46.107048] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-13T22:37:46.125885] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-13T22:37:46.126229] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-13T22:37:46.128901] [INFO ] [MAIN ] Derivative Progress: 631/1810 symbols completed. ETO took 1.0s. Estimated remaining: 7m 39s. Rate: 154.2 symbols/min [2025-10-13T22:37:46.129321] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:46.153237] [DEBUG] [MAIN ] ETSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:46.166274] [INFO ] [MAIN ] ETSY: Generated 1794 derivative records from 53582 primary records. [2025-10-13T22:37:46.172409] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-13T22:37:46.172780] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:46.174517] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53213 primary records. [2025-10-13T22:37:46.174695] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-13T22:37:46.208878] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-13T22:37:46.209489] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-13T22:37:46.210190] [DEBUG] [LOCAL ] ETV: Loaded 22265 existing records from primary storage. [2025-10-13T22:37:46.212749] [INFO ] [MAIN ] Derivative Progress: 632/1810 symbols completed. ETR took 1.1s. Estimated remaining: 7m 38s. Rate: 154.4 symbols/min [2025-10-13T22:37:46.214231] [INFO ] [MAIN ] ETV: Loaded 22265 primary data records. [2025-10-13T22:37:46.213182] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:46.270728] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1794 records). [2025-10-13T22:37:46.279377] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-13T22:37:46.299153] [INFO ] [MAIN ] Derivative Progress: 633/1810 symbols completed. ETSY took 1.2s. Estimated remaining: 7m 37s. Rate: 154.5 symbols/min [2025-10-13T22:37:46.309839] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:46.530908] [DEBUG] [LOCAL ] ETX: Loaded 5243 existing records from primary storage. [2025-10-13T22:37:46.531471] [DEBUG] [LOCAL ] ETW: Loaded 25671 existing records from primary storage. [2025-10-13T22:37:46.531547] [INFO ] [MAIN ] ETX: Loaded 5243 primary data records. [2025-10-13T22:37:46.531682] [INFO ] [MAIN ] ETW: Loaded 25671 primary data records. [2025-10-13T22:37:47.206703] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:47.207867] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 22265 primary records. [2025-10-13T22:37:47.208042] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-13T22:37:47.228035] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-13T22:37:47.228254] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-13T22:37:47.230374] [INFO ] [MAIN ] Derivative Progress: 634/1810 symbols completed. ETV took 1.1s. Estimated remaining: 7m 38s. Rate: 154.2 symbols/min [2025-10-13T22:37:47.230860] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:47.270106] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:47.270849] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:47.271521] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25671 primary records. [2025-10-13T22:37:47.272236] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5243 primary records. [2025-10-13T22:37:47.272304] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-13T22:37:47.272395] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-13T22:37:47.299138] [DEBUG] [LOCAL ] ETY: Loaded 23106 existing records from primary storage. [2025-10-13T22:37:47.307035] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-13T22:37:47.310896] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-13T22:37:47.311042] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-13T22:37:47.307200] [INFO ] [MAIN ] ETY: Loaded 23106 primary data records. [2025-10-13T22:37:47.313666] [INFO ] [MAIN ] Derivative Progress: 635/1810 symbols completed. ETW took 1.1s. Estimated remaining: 7m 37s. Rate: 154.4 symbols/min [2025-10-13T22:37:47.313792] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-13T22:37:47.337822] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:47.352116] [INFO ] [MAIN ] Derivative Progress: 636/1810 symbols completed. ETX took 1.0s. Estimated remaining: 7m 36s. Rate: 154.6 symbols/min [2025-10-13T22:37:47.360531] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:47.517106] [DEBUG] [LOCAL ] EVC: Loaded 18112 existing records from primary storage. [2025-10-13T22:37:47.626777] [INFO ] [MAIN ] EVC: Loaded 18112 primary data records. [2025-10-13T22:37:47.718495] [DEBUG] [LOCAL ] EVEX: Loaded 31962 existing records from primary storage. [2025-10-13T22:37:47.736202] [INFO ] [MAIN ] EVEX: Loaded 31962 primary data records. [2025-10-13T22:37:48.272256] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:48.274054] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23106 primary records. [2025-10-13T22:37:48.274478] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-13T22:37:48.293150] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-13T22:37:48.293484] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-13T22:37:48.296188] [INFO ] [MAIN ] Derivative Progress: 637/1810 symbols completed. ETY took 1.1s. Estimated remaining: 7m 36s. Rate: 154.3 symbols/min [2025-10-13T22:37:48.296502] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:48.313796] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:48.314508] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18112 primary records. [2025-10-13T22:37:48.314663] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-13T22:37:48.335167] [DEBUG] [LOCAL ] EVF: Loaded 9881 existing records from primary storage. [2025-10-13T22:37:48.335495] [INFO ] [MAIN ] EVF: Loaded 9881 primary data records. [2025-10-13T22:37:48.413903] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-13T22:37:48.428199] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-13T22:37:48.440920] [INFO ] [MAIN ] Derivative Progress: 638/1810 symbols completed. EVC took 1.1s. Estimated remaining: 7m 35s. Rate: 154.4 symbols/min [2025-10-13T22:37:48.447925] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:48.473236] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:48.491061] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 31962 primary records. [2025-10-13T22:37:48.491278] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-13T22:37:48.718634] [DEBUG] [LOCAL ] EVG: Loaded 5949 existing records from primary storage. [2025-10-13T22:37:48.714201] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-13T22:37:48.718987] [INFO ] [MAIN ] EVG: Loaded 5949 primary data records. [2025-10-13T22:37:48.724730] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-13T22:37:48.743731] [INFO ] [MAIN ] Derivative Progress: 639/1810 symbols completed. EVEX took 1.4s. Estimated remaining: 7m 35s. Rate: 154.5 symbols/min [2025-10-13T22:37:48.760171] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:49.094736] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:49.095704] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9881 primary records. [2025-10-13T22:37:49.096083] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-13T22:37:49.113049] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-13T22:37:49.113220] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-13T22:37:49.115705] [INFO ] [MAIN ] Derivative Progress: 640/1810 symbols completed. EVF took 0.8s. Estimated remaining: 7m 34s. Rate: 154.5 symbols/min [2025-10-13T22:37:49.116171] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:49.132820] [DEBUG] [LOCAL ] EVH: Loaded 49622 existing records from primary storage. [2025-10-13T22:37:49.133263] [INFO ] [MAIN ] EVH: Loaded 49622 primary data records. [2025-10-13T22:37:49.228062] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:49.234124] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5949 primary records. [2025-10-13T22:37:49.260535] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-13T22:37:49.261591] [DEBUG] [LOCAL ] EVN: Loaded 10781 existing records from primary storage. [2025-10-13T22:37:49.262353] [INFO ] [MAIN ] EVN: Loaded 10781 primary data records. [2025-10-13T22:37:49.601814] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-13T22:37:49.630728] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-13T22:37:49.651010] [INFO ] [MAIN ] Derivative Progress: 641/1810 symbols completed. EVG took 1.2s. Estimated remaining: 7m 34s. Rate: 154.4 symbols/min [2025-10-13T22:37:49.656737] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:49.799772] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:49.800604] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49622 primary records. [2025-10-13T22:37:49.800814] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-13T22:37:49.818287] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-13T22:37:49.831995] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-13T22:37:49.834637] [INFO ] [MAIN ] Derivative Progress: 642/1810 symbols completed. EVH took 1.1s. Estimated remaining: 7m 34s. Rate: 154.5 symbols/min [2025-10-13T22:37:49.834968] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:49.862286] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:49.863245] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10781 primary records. [2025-10-13T22:37:49.866857] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-13T22:37:49.867547] [DEBUG] [LOCAL ] EVR: Loaded 34612 existing records from primary storage. [2025-10-13T22:37:49.868748] [INFO ] [MAIN ] EVR: Loaded 34612 primary data records. [2025-10-13T22:37:49.904742] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-13T22:37:49.920327] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-13T22:37:49.961370] [INFO ] [MAIN ] Derivative Progress: 643/1810 symbols completed. EVN took 0.8s. Estimated remaining: 7m 33s. Rate: 154.7 symbols/min [2025-10-13T22:37:49.953493] [DEBUG] [LOCAL ] EVT: Loaded 16812 existing records from primary storage. [2025-10-13T22:37:49.973559] [INFO ] [MAIN ] EVT: Loaded 16812 primary data records. [2025-10-13T22:37:50.539754] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:50.553440] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34612 primary records. [2025-10-13T22:37:50.553861] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-13T22:37:50.553771] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:50.555386] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16812 primary records. [2025-10-13T22:37:50.555948] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-13T22:37:50.589218] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-13T22:37:50.589334] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-13T22:37:50.591932] [INFO ] [MAIN ] Derivative Progress: 644/1810 symbols completed. EVR took 0.9s. Estimated remaining: 7m 33s. Rate: 154.5 symbols/min [2025-10-13T22:37:50.593449] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-13T22:37:50.593538] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-13T22:37:50.596284] [INFO ] [MAIN ] Derivative Progress: 645/1810 symbols completed. EVT took 0.8s. Estimated remaining: 7m 32s. Rate: 154.8 symbols/min [2025-10-13T22:37:50.596777] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:50.596728] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:50.597829] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:50.653048] [DEBUG] [LOCAL ] EVTC: Loaded 26524 existing records from primary storage. [2025-10-13T22:37:50.653364] [INFO ] [MAIN ] EVTC: Loaded 26524 primary data records. [2025-10-13T22:37:50.663989] [DEBUG] [LOCAL ] EVTR: Loaded 24474 existing records from primary storage. [2025-10-13T22:37:50.677051] [INFO ] [MAIN ] EVTR: Loaded 24474 primary data records. [2025-10-13T22:37:50.735483] [DEBUG] [LOCAL ] EVTL: Loaded 39852 existing records from primary storage. [2025-10-13T22:37:50.753909] [INFO ] [MAIN ] EVTL: Loaded 39852 primary data records. [2025-10-13T22:37:51.699633] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:37:51.706009] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:51.707018] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 24474 primary records. [2025-10-13T22:37:51.709394] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26524 primary records. [2025-10-13T22:37:51.709295] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-13T22:37:51.709541] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-13T22:37:51.740304] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-10-13T22:37:51.741308] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-13T22:37:51.746148] [INFO ] [MAIN ] Derivative Progress: 646/1810 symbols completed. EVTR took 1.1s. Estimated remaining: 7m 33s. Rate: 154.3 symbols/min [2025-10-13T22:37:51.746319] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:51.762256] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-13T22:37:51.763153] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-13T22:37:51.763040] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:51.766308] [INFO ] [MAIN ] Derivative Progress: 647/1810 symbols completed. EVTC took 1.2s. Estimated remaining: 7m 32s. Rate: 154.5 symbols/min [2025-10-13T22:37:51.766592] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:51.768150] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 39852 primary records. [2025-10-13T22:37:51.768470] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-13T22:37:51.785765] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-13T22:37:51.785975] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-13T22:37:51.789488] [INFO ] [MAIN ] Derivative Progress: 648/1810 symbols completed. EVTL took 1.2s. Estimated remaining: 7m 31s. Rate: 154.8 symbols/min [2025-10-13T22:37:51.789870] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:51.837859] [DEBUG] [LOCAL ] EXG: Loaded 34103 existing records from primary storage. [2025-10-13T22:37:51.838114] [INFO ] [MAIN ] EXG: Loaded 34103 primary data records. [2025-10-13T22:37:51.975330] [DEBUG] [LOCAL ] EW: Loaded 53401 existing records from primary storage. [2025-10-13T22:37:51.981196] [INFO ] [MAIN ] EW: Loaded 53401 primary data records. [2025-10-13T22:37:52.160082] [DEBUG] [LOCAL ] EXK: Loaded 53166 existing records from primary storage. [2025-10-13T22:37:52.173618] [INFO ] [MAIN ] EXK: Loaded 53166 primary data records. [2025-10-13T22:37:52.819766] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:52.821210] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34103 primary records. [2025-10-13T22:37:52.821397] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-13T22:37:52.857752] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:52.858573] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-13T22:37:52.858952] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-13T22:37:52.861799] [INFO ] [MAIN ] Derivative Progress: 649/1810 symbols completed. EXG took 1.1s. Estimated remaining: 7m 31s. Rate: 154.3 symbols/min [2025-10-13T22:37:52.864752] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:52.863945] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53401 primary records. [2025-10-13T22:37:52.865157] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-13T22:37:52.881812] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-13T22:37:52.894527] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-13T22:37:52.897179] [INFO ] [MAIN ] Derivative Progress: 650/1810 symbols completed. EW took 1.2s. Estimated remaining: 7m 30s. Rate: 154.5 symbols/min [2025-10-13T22:37:52.897821] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:52.897715] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:52.899102] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53166 primary records. [2025-10-13T22:37:52.899329] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-13T22:37:52.916173] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-13T22:37:52.924752] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-13T22:37:52.927527] [INFO ] [MAIN ] Derivative Progress: 651/1810 symbols completed. EXK took 1.1s. Estimated remaining: 7m 29s. Rate: 154.8 symbols/min [2025-10-13T22:37:52.927821] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:52.940220] [DEBUG] [LOCAL ] EXP: Loaded 29534 existing records from primary storage. [2025-10-13T22:37:52.940381] [INFO ] [MAIN ] EXP: Loaded 29534 primary data records. [2025-10-13T22:37:53.287223] [DEBUG] [LOCAL ] EXPD: Loaded 47915 existing records from primary storage. [2025-10-13T22:37:53.295494] [INFO ] [MAIN ] EXPD: Loaded 47915 primary data records. [2025-10-13T22:37:53.419683] [DEBUG] [LOCAL ] EXR: Loaded 45363 existing records from primary storage. [2025-10-13T22:37:53.430368] [INFO ] [MAIN ] EXR: Loaded 45363 primary data records. [2025-10-13T22:37:53.940885] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:53.942511] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29534 primary records. [2025-10-13T22:37:53.942664] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-13T22:37:53.970342] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-13T22:37:53.971873] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-13T22:37:53.975019] [INFO ] [MAIN ] Derivative Progress: 652/1810 symbols completed. EXP took 1.1s. Estimated remaining: 7m 30s. Rate: 154.4 symbols/min [2025-10-13T22:37:53.976058] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:53.991110] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:53.993520] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47915 primary records. [2025-10-13T22:37:53.993744] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-13T22:37:54.015516] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:54.020999] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45363 primary records. [2025-10-13T22:37:54.023394] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-13T22:37:54.039241] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-13T22:37:54.040589] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-13T22:37:54.042820] [INFO ] [MAIN ] Derivative Progress: 653/1810 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 29s. Rate: 154.6 symbols/min [2025-10-13T22:37:54.043470] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:54.047759] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-13T22:37:54.047946] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-13T22:37:54.050967] [INFO ] [MAIN ] Derivative Progress: 654/1810 symbols completed. EXR took 1.1s. Estimated remaining: 7m 28s. Rate: 154.8 symbols/min [2025-10-13T22:37:54.051261] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:54.117200] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-13T22:37:54.129135] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-13T22:37:54.129999] [DEBUG] [LOCAL ] FAF: Loaded 41545 existing records from primary storage. [2025-10-13T22:37:54.162689] [INFO ] [MAIN ] FAF: Loaded 41545 primary data records. [2025-10-13T22:37:54.309535] [DEBUG] [LOCAL ] FBIN: Loaded 50364 existing records from primary storage. [2025-10-13T22:37:54.326511] [INFO ] [MAIN ] FBIN: Loaded 50364 primary data records. [2025-10-13T22:37:55.130493] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:55.131342] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-13T22:37:55.131565] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-13T22:37:55.144828] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:55.145689] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41545 primary records. [2025-10-13T22:37:55.156670] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-13T22:37:55.161374] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-13T22:37:55.161740] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-13T22:37:55.164620] [INFO ] [MAIN ] Derivative Progress: 655/1810 symbols completed. F took 1.2s. Estimated remaining: 7m 29s. Rate: 154.4 symbols/min [2025-10-13T22:37:55.175483] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:55.183184] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-13T22:37:55.183680] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-13T22:37:55.186968] [INFO ] [MAIN ] Derivative Progress: 656/1810 symbols completed. FAF took 1.1s. Estimated remaining: 7m 28s. Rate: 154.6 symbols/min [2025-10-13T22:37:55.200188] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:55.200441] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:55.201382] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50364 primary records. [2025-10-13T22:37:55.201556] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-13T22:37:55.227003] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-13T22:37:55.227200] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-13T22:37:55.229917] [INFO ] [MAIN ] Derivative Progress: 657/1810 symbols completed. FBIN took 1.2s. Estimated remaining: 7m 27s. Rate: 154.8 symbols/min [2025-10-13T22:37:55.230238] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:55.240755] [DEBUG] [LOCAL ] FBK: Loaded 27039 existing records from primary storage. [2025-10-13T22:37:55.240883] [INFO ] [MAIN ] FBK: Loaded 27039 primary data records. [2025-10-13T22:37:55.577427] [DEBUG] [LOCAL ] FBRT: Loaded 35334 existing records from primary storage. [2025-10-13T22:37:55.579279] [INFO ] [MAIN ] FBRT: Loaded 35334 primary data records. [2025-10-13T22:37:55.579005] [DEBUG] [LOCAL ] FBP: Loaded 45728 existing records from primary storage. [2025-10-13T22:37:55.600457] [INFO ] [MAIN ] FBP: Loaded 45728 primary data records. [2025-10-13T22:37:56.235417] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:56.237297] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 27039 primary records. [2025-10-13T22:37:56.238157] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-13T22:37:56.258432] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-13T22:37:56.259301] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-13T22:37:56.261466] [INFO ] [MAIN ] Derivative Progress: 658/1810 symbols completed. FBK took 1.1s. Estimated remaining: 7m 28s. Rate: 154.4 symbols/min [2025-10-13T22:37:56.284757] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:56.286005] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45728 primary records. [2025-10-13T22:37:56.298716] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-13T22:37:56.299342] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:56.301336] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 35334 primary records. [2025-10-13T22:37:56.301425] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-13T22:37:56.331367] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-13T22:37:56.333980] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-13T22:37:56.338529] [INFO ] [MAIN ] Derivative Progress: 659/1810 symbols completed. FBP took 1.1s. Estimated remaining: 7m 27s. Rate: 154.6 symbols/min [2025-10-13T22:37:56.338960] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-13T22:37:56.339193] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-13T22:37:56.341914] [INFO ] [MAIN ] Derivative Progress: 660/1810 symbols completed. FBRT took 1.1s. Estimated remaining: 7m 26s. Rate: 154.8 symbols/min [2025-10-13T22:37:56.342432] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:56.342546] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:56.342755] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:56.367990] [DEBUG] [LOCAL ] FC: Loaded 14956 existing records from primary storage. [2025-10-13T22:37:56.369106] [INFO ] [MAIN ] FC: Loaded 14956 primary data records. [2025-10-13T22:37:56.468257] [DEBUG] [LOCAL ] FCN: Loaded 26021 existing records from primary storage. [2025-10-13T22:37:56.484792] [INFO ] [MAIN ] FCN: Loaded 26021 primary data records. [2025-10-13T22:37:56.674314] [DEBUG] [LOCAL ] FCF: Loaded 39256 existing records from primary storage. [2025-10-13T22:37:56.804723] [INFO ] [MAIN ] FCF: Loaded 39256 primary data records. [2025-10-13T22:37:57.388981] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:57.391671] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 14956 primary records. [2025-10-13T22:37:57.392406] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-13T22:37:57.410780] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-13T22:37:57.411126] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-13T22:37:57.413100] [INFO ] [MAIN ] Derivative Progress: 661/1810 symbols completed. FC took 1.1s. Estimated remaining: 7m 26s. Rate: 154.4 symbols/min [2025-10-13T22:37:57.413257] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:57.444187] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:57.444515] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:57.445333] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26021 primary records. [2025-10-13T22:37:57.445963] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39256 primary records. [2025-10-13T22:37:57.446098] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-13T22:37:57.446174] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-13T22:37:57.483485] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-13T22:37:57.485478] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-13T22:37:57.488842] [INFO ] [MAIN ] Derivative Progress: 662/1810 symbols completed. FCN took 1.1s. Estimated remaining: 7m 26s. Rate: 154.6 symbols/min [2025-10-13T22:37:57.489263] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:57.490231] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-13T22:37:57.490359] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-13T22:37:57.492975] [INFO ] [MAIN ] Derivative Progress: 663/1810 symbols completed. FCF took 1.2s. Estimated remaining: 7m 25s. Rate: 154.8 symbols/min [2025-10-13T22:37:57.493483] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:57.506622] [DEBUG] [LOCAL ] FCPT: Loaded 37317 existing records from primary storage. [2025-10-13T22:37:57.506793] [INFO ] [MAIN ] FCPT: Loaded 37317 primary data records. [2025-10-13T22:37:57.619684] [DEBUG] [LOCAL ] FCT: Loaded 14759 existing records from primary storage. [2025-10-13T22:37:57.623157] [INFO ] [MAIN ] FCT: Loaded 14759 primary data records. [2025-10-13T22:37:58.153272] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-13T22:37:58.153519] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-13T22:37:58.471277] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:58.472438] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37317 primary records. [2025-10-13T22:37:58.472758] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-13T22:37:58.492900] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-13T22:37:58.493379] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-13T22:37:58.495614] [INFO ] [MAIN ] Derivative Progress: 664/1810 symbols completed. FCPT took 1.1s. Estimated remaining: 7m 25s. Rate: 154.5 symbols/min [2025-10-13T22:37:58.496110] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:58.516863] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:58.518157] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14759 primary records. [2025-10-13T22:37:58.518448] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-13T22:37:58.541853] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-13T22:37:58.562877] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:58.563766] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-13T22:37:58.562959] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-13T22:37:58.566584] [INFO ] [MAIN ] Derivative Progress: 665/1810 symbols completed. FCT took 1.1s. Estimated remaining: 7m 24s. Rate: 154.6 symbols/min [2025-10-13T22:37:58.566840] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-13T22:37:58.567845] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:58.592862] [DEBUG] [LOCAL ] FDP: Loaded 29912 existing records from primary storage. [2025-10-13T22:37:58.593523] [INFO ] [MAIN ] FDP: Loaded 29912 primary data records. [2025-10-13T22:37:58.630136] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-13T22:37:58.706753] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-13T22:37:58.712680] [INFO ] [MAIN ] Derivative Progress: 666/1810 symbols completed. FCX took 1.2s. Estimated remaining: 7m 23s. Rate: 154.8 symbols/min [2025-10-13T22:37:58.718766] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:58.904025] [DEBUG] [LOCAL ] FDS: Loaded 27413 existing records from primary storage. [2025-10-13T22:37:58.912947] [INFO ] [MAIN ] FDS: Loaded 27413 primary data records. [2025-10-13T22:37:59.305790] [DEBUG] [LOCAL ] FDX: Loaded 51396 existing records from primary storage. [2025-10-13T22:37:59.307768] [INFO ] [MAIN ] FDX: Loaded 51396 primary data records. [2025-10-13T22:37:59.357631] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:59.363968] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 29912 primary records. [2025-10-13T22:37:59.377398] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-13T22:37:59.510815] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-13T22:37:59.533117] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-13T22:37:59.552159] [INFO ] [MAIN ] Derivative Progress: 667/1810 symbols completed. FDP took 1.1s. Estimated remaining: 7m 24s. Rate: 154.5 symbols/min [2025-10-13T22:37:59.553019] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:59.713776] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:59.714765] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 27413 primary records. [2025-10-13T22:37:59.715448] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-13T22:37:59.733590] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-13T22:37:59.734347] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-13T22:37:59.737313] [INFO ] [MAIN ] Derivative Progress: 668/1810 symbols completed. FDS took 1.2s. Estimated remaining: 7m 23s. Rate: 154.6 symbols/min [2025-10-13T22:37:59.737591] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:37:59.781510] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:37:59.782786] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51396 primary records. [2025-10-13T22:37:59.782960] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-13T22:37:59.811900] [DEBUG] [LOCAL ] FE: Loaded 53432 existing records from primary storage. [2025-10-13T22:37:59.814930] [INFO ] [MAIN ] FE: Loaded 53432 primary data records. [2025-10-13T22:37:59.816613] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-13T22:37:59.821960] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-13T22:37:59.853095] [INFO ] [MAIN ] Derivative Progress: 669/1810 symbols completed. FDX took 1.1s. Estimated remaining: 7m 22s. Rate: 154.8 symbols/min [2025-10-13T22:37:59.892282] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:00.024264] [DEBUG] [LOCAL ] FERG: Loaded 48791 existing records from primary storage. [2025-10-13T22:38:00.074711] [DEBUG] [LOCAL ] FET: Loaded 12840 existing records from primary storage. [2025-10-13T22:38:00.194509] [INFO ] [MAIN ] FERG: Loaded 48791 primary data records. [2025-10-13T22:38:00.194690] [INFO ] [MAIN ] FET: Loaded 12840 primary data records. [2025-10-13T22:38:00.869592] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:00.871521] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53432 primary records. [2025-10-13T22:38:00.871766] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-13T22:38:00.891140] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-13T22:38:00.891484] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-13T22:38:00.893917] [INFO ] [MAIN ] Derivative Progress: 670/1810 symbols completed. FE took 1.3s. Estimated remaining: 7m 23s. Rate: 154.4 symbols/min [2025-10-13T22:38:00.894233] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:00.912350] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:00.913073] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12840 primary records. [2025-10-13T22:38:00.913351] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-13T22:38:00.947950] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-13T22:38:00.953110] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:00.953205] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-13T22:38:00.963842] [INFO ] [MAIN ] Derivative Progress: 671/1810 symbols completed. FET took 1.1s. Estimated remaining: 7m 22s. Rate: 154.6 symbols/min [2025-10-13T22:38:00.965640] [DEBUG] [LOCAL ] FF: Loaded 24334 existing records from primary storage. [2025-10-13T22:38:00.964955] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48791 primary records. [2025-10-13T22:38:00.965939] [INFO ] [MAIN ] FF: Loaded 24334 primary data records. [2025-10-13T22:38:00.966140] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-13T22:38:00.965851] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:01.111386] [DEBUG] [LOCAL ] FFA: Loaded 6060 existing records from primary storage. [2025-10-13T22:38:01.150241] [INFO ] [MAIN ] FFA: Loaded 6060 primary data records. [2025-10-13T22:38:01.151044] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-13T22:38:01.191057] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-13T22:38:01.335035] [INFO ] [MAIN ] Derivative Progress: 672/1810 symbols completed. FERG took 1.6s. Estimated remaining: 7m 22s. Rate: 154.6 symbols/min [2025-10-13T22:38:01.382381] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:01.595618] [DEBUG] [LOCAL ] FFC: Loaded 16800 existing records from primary storage. [2025-10-13T22:38:01.596041] [INFO ] [MAIN ] FFC: Loaded 16800 primary data records. [2025-10-13T22:38:02.049623] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:02.050797] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24334 primary records. [2025-10-13T22:38:02.051095] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-13T22:38:02.072456] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-13T22:38:02.073269] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-13T22:38:02.075845] [INFO ] [MAIN ] Derivative Progress: 673/1810 symbols completed. FF took 1.2s. Estimated remaining: 7m 22s. Rate: 154.4 symbols/min [2025-10-13T22:38:02.094113] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:02.095298] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 6060 primary records. [2025-10-13T22:38:02.095627] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-13T22:38:02.113738] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-13T22:38:02.114470] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-13T22:38:02.116960] [INFO ] [MAIN ] Derivative Progress: 674/1810 symbols completed. FFA took 1.2s. Estimated remaining: 7m 21s. Rate: 154.6 symbols/min [2025-10-13T22:38:02.130340] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:02.131104] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16800 primary records. [2025-10-13T22:38:02.131187] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-13T22:38:02.148135] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-13T22:38:02.148287] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-13T22:38:02.151503] [INFO ] [MAIN ] Derivative Progress: 675/1810 symbols completed. FFC took 0.8s. Estimated remaining: 7m 20s. Rate: 154.8 symbols/min [2025-10-13T22:38:02.152068] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:02.152196] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:02.152315] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:02.160057] [DEBUG] [LOCAL ] FGN: Loaded 3758 existing records from primary storage. [2025-10-13T22:38:02.160381] [INFO ] [MAIN ] FGN: Loaded 3758 primary data records. [2025-10-13T22:38:02.302673] [DEBUG] [LOCAL ] FG: Loaded 22312 existing records from primary storage. [2025-10-13T22:38:02.324635] [DEBUG] [LOCAL ] FFWM: Loaded 35828 existing records from primary storage. [2025-10-13T22:38:02.318695] [INFO ] [MAIN ] FG: Loaded 22312 primary data records. [2025-10-13T22:38:02.378903] [INFO ] [MAIN ] FFWM: Loaded 35828 primary data records. [2025-10-13T22:38:03.216107] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:03.218527] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3758 primary records. [2025-10-13T22:38:03.218984] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-13T22:38:03.238383] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-13T22:38:03.240588] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-13T22:38:03.243947] [INFO ] [MAIN ] Derivative Progress: 676/1810 symbols completed. FGN took 1.1s. Estimated remaining: 7m 21s. Rate: 154.4 symbols/min [2025-10-13T22:38:03.244497] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:03.262398] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:03.263758] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22312 primary records. [2025-10-13T22:38:03.263921] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-13T22:38:03.278194] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:03.287796] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35828 primary records. [2025-10-13T22:38:03.291789] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-13T22:38:03.296085] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-13T22:38:03.296548] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-13T22:38:03.299094] [INFO ] [MAIN ] Derivative Progress: 677/1810 symbols completed. FG took 1.1s. Estimated remaining: 7m 20s. Rate: 154.6 symbols/min [2025-10-13T22:38:03.306378] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:03.328821] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-13T22:38:03.329154] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-13T22:38:03.332364] [INFO ] [MAIN ] Derivative Progress: 678/1810 symbols completed. FFWM took 1.2s. Estimated remaining: 7m 19s. Rate: 154.8 symbols/min [2025-10-13T22:38:03.333581] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:03.349501] [DEBUG] [LOCAL ] FHI: Loaded 39869 existing records from primary storage. [2025-10-13T22:38:03.349975] [INFO ] [MAIN ] FHI: Loaded 39869 primary data records. [2025-10-13T22:38:03.725329] [DEBUG] [LOCAL ] FHN: Loaded 53388 existing records from primary storage. [2025-10-13T22:38:03.725525] [INFO ] [MAIN ] FHN: Loaded 53388 primary data records. [2025-10-13T22:38:03.863376] [DEBUG] [LOCAL ] FI: Loaded 53574 existing records from primary storage. [2025-10-13T22:38:03.921622] [INFO ] [MAIN ] FI: Loaded 53574 primary data records. [2025-10-13T22:38:04.367987] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:04.369011] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39869 primary records. [2025-10-13T22:38:04.369240] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-13T22:38:04.388931] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-13T22:38:04.389850] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-13T22:38:04.392407] [INFO ] [MAIN ] Derivative Progress: 679/1810 symbols completed. FHI took 1.1s. Estimated remaining: 7m 19s. Rate: 154.4 symbols/min [2025-10-13T22:38:04.392906] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:04.412088] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:04.412976] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53388 primary records. [2025-10-13T22:38:04.413331] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-13T22:38:04.448209] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-13T22:38:04.448504] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-13T22:38:04.448955] [DEBUG] [LOCAL ] FICO: Loaded 21625 existing records from primary storage. [2025-10-13T22:38:04.449145] [INFO ] [MAIN ] FICO: Loaded 21625 primary data records. [2025-10-13T22:38:04.451204] [INFO ] [MAIN ] Derivative Progress: 680/1810 symbols completed. FHN took 1.1s. Estimated remaining: 7m 19s. Rate: 154.6 symbols/min [2025-10-13T22:38:04.464428] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:04.497054] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:04.522554] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53574 primary records. [2025-10-13T22:38:04.548965] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-13T22:38:04.789459] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-13T22:38:04.803308] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-13T22:38:04.807457] [INFO ] [MAIN ] Derivative Progress: 681/1810 symbols completed. FI took 1.5s. Estimated remaining: 7m 18s. Rate: 154.6 symbols/min [2025-10-13T22:38:04.808049] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:04.834096] [DEBUG] [LOCAL ] FIGS: Loaded 48637 existing records from primary storage. [2025-10-13T22:38:04.834523] [INFO ] [MAIN ] FIGS: Loaded 48637 primary data records. [2025-10-13T22:38:04.996770] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:05.022546] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 21625 primary records. [2025-10-13T22:38:05.047050] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-13T22:38:05.092875] [DEBUG] [LOCAL ] FIHL: Loaded 39496 existing records from primary storage. [2025-10-13T22:38:05.218122] [INFO ] [MAIN ] FIHL: Loaded 39496 primary data records. [2025-10-13T22:38:05.323990] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-10-13T22:38:05.375999] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-13T22:38:05.404878] [INFO ] [MAIN ] Derivative Progress: 682/1810 symbols completed. FICO took 1.0s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-10-13T22:38:05.423607] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:05.594160] [DEBUG] [LOCAL ] FINS: Loaded 8300 existing records from primary storage. [2025-10-13T22:38:05.594910] [INFO ] [MAIN ] FINS: Loaded 8300 primary data records. [2025-10-13T22:38:05.726320] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:05.727074] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48637 primary records. [2025-10-13T22:38:05.727251] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-13T22:38:05.954078] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-13T22:38:05.954502] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-13T22:38:05.957347] [INFO ] [MAIN ] Derivative Progress: 683/1810 symbols completed. FIGS took 1.5s. Estimated remaining: 7m 18s. Rate: 154.4 symbols/min [2025-10-13T22:38:05.954884] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:05.958424] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:05.958313] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39496 primary records. [2025-10-13T22:38:05.958917] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-13T22:38:05.979747] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-13T22:38:05.980156] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-13T22:38:05.982613] [INFO ] [MAIN ] Derivative Progress: 684/1810 symbols completed. FIHL took 1.2s. Estimated remaining: 7m 17s. Rate: 154.6 symbols/min [2025-10-13T22:38:05.983446] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:06.019547] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:06.020482] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8300 primary records. [2025-10-13T22:38:06.020601] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-13T22:38:06.051713] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-13T22:38:06.051966] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-13T22:38:06.056208] [INFO ] [MAIN ] Derivative Progress: 685/1810 symbols completed. FINS took 0.6s. Estimated remaining: 7m 16s. Rate: 154.8 symbols/min [2025-10-13T22:38:06.057250] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:06.056987] [DEBUG] [LOCAL ] FINV: Loaded 45299 existing records from primary storage. [2025-10-13T22:38:06.058190] [INFO ] [MAIN ] FINV: Loaded 45299 primary data records. [2025-10-13T22:38:06.248792] [DEBUG] [LOCAL ] FIS: Loaded 53345 existing records from primary storage. [2025-10-13T22:38:06.282903] [INFO ] [MAIN ] FIS: Loaded 53345 primary data records. [2025-10-13T22:38:06.428501] [DEBUG] [LOCAL ] FIX: Loaded 29043 existing records from primary storage. [2025-10-13T22:38:06.466957] [INFO ] [MAIN ] FIX: Loaded 29043 primary data records. [2025-10-13T22:38:07.076902] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:07.078418] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45299 primary records. [2025-10-13T22:38:07.078812] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-13T22:38:07.114953] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-13T22:38:07.114376] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:07.116706] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53345 primary records. [2025-10-13T22:38:07.117001] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-13T22:38:07.116923] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-13T22:38:07.131988] [INFO ] [MAIN ] Derivative Progress: 686/1810 symbols completed. FINV took 1.2s. Estimated remaining: 7m 17s. Rate: 154.4 symbols/min [2025-10-13T22:38:07.133034] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:07.134523] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 29043 primary records. [2025-10-13T22:38:07.133267] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:07.134728] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-13T22:38:07.171993] [DEBUG] [LOCAL ] FLC: Loaded 5442 existing records from primary storage. [2025-10-13T22:38:07.173908] [INFO ] [MAIN ] FLC: Loaded 5442 primary data records. [2025-10-13T22:38:07.213867] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-13T22:38:07.242752] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-13T22:38:07.265004] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-13T22:38:07.268267] [INFO ] [MAIN ] Derivative Progress: 687/1810 symbols completed. FIX took 1.2s. Estimated remaining: 7m 16s. Rate: 154.5 symbols/min [2025-10-13T22:38:07.268405] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-13T22:38:07.282437] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:07.284816] [INFO ] [MAIN ] Derivative Progress: 688/1810 symbols completed. FIS took 1.3s. Estimated remaining: 7m 15s. Rate: 154.8 symbols/min [2025-10-13T22:38:07.569721] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:07.570526] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5442 primary records. [2025-10-13T22:38:07.570658] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-13T22:38:07.571961] [DEBUG] [LOCAL ] FLG: Loaded 53323 existing records from primary storage. [2025-10-13T22:38:07.572315] [INFO ] [MAIN ] FLG: Loaded 53323 primary data records. [2025-10-13T22:38:07.689124] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-13T22:38:07.695025] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-13T22:38:07.697727] [INFO ] [MAIN ] Derivative Progress: 689/1810 symbols completed. FLC took 0.6s. Estimated remaining: 7m 15s. Rate: 154.7 symbols/min [2025-10-13T22:38:07.894697] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:07.895341] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53323 primary records. [2025-10-13T22:38:07.895433] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-13T22:38:07.911116] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-13T22:38:07.911179] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-13T22:38:07.913460] [INFO ] [MAIN ] Derivative Progress: 690/1810 symbols completed. FLG took 0.6s. Estimated remaining: 7m 14s. Rate: 154.8 symbols/min [2025-10-13T22:38:07.914293] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:07.914182] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:07.914044] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:07.983788] [DEBUG] [LOCAL ] FLNG: Loaded 33739 existing records from primary storage. [2025-10-13T22:38:07.984028] [INFO ] [MAIN ] FLNG: Loaded 33739 primary data records. [2025-10-13T22:38:08.095375] [DEBUG] [LOCAL ] FLO: Loaded 52028 existing records from primary storage. [2025-10-13T22:38:08.113585] [INFO ] [MAIN ] FLO: Loaded 52028 primary data records. [2025-10-13T22:38:08.118660] [DEBUG] [LOCAL ] FLR: Loaded 53204 existing records from primary storage. [2025-10-13T22:38:08.119082] [INFO ] [MAIN ] FLR: Loaded 53204 primary data records. [2025-10-13T22:38:08.996365] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:08.998467] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33739 primary records. [2025-10-13T22:38:08.999074] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-13T22:38:09.020443] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-13T22:38:09.020631] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-13T22:38:09.022906] [INFO ] [MAIN ] Derivative Progress: 691/1810 symbols completed. FLNG took 1.1s. Estimated remaining: 7m 15s. Rate: 154.4 symbols/min [2025-10-13T22:38:09.024041] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:09.043752] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:09.044577] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 52028 primary records. [2025-10-13T22:38:09.044743] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-13T22:38:09.057734] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:09.065522] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53204 primary records. [2025-10-13T22:38:09.069382] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-13T22:38:09.087471] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-13T22:38:09.088185] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-13T22:38:09.090448] [INFO ] [MAIN ] Derivative Progress: 692/1810 symbols completed. FLR took 1.2s. Estimated remaining: 7m 14s. Rate: 154.6 symbols/min [2025-10-13T22:38:09.091079] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:09.093796] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-13T22:38:09.093932] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-13T22:38:09.096700] [INFO ] [MAIN ] Derivative Progress: 693/1810 symbols completed. FLO took 1.2s. Estimated remaining: 7m 13s. Rate: 154.8 symbols/min [2025-10-13T22:38:09.096942] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:09.134465] [DEBUG] [LOCAL ] FLS: Loaded 50339 existing records from primary storage. [2025-10-13T22:38:09.141257] [INFO ] [MAIN ] FLS: Loaded 50339 primary data records. [2025-10-13T22:38:09.153239] [DEBUG] [LOCAL ] FLXR: Loaded 20860 existing records from primary storage. [2025-10-13T22:38:09.153395] [INFO ] [MAIN ] FLXR: Loaded 20860 primary data records. [2025-10-13T22:38:09.400149] [DEBUG] [LOCAL ] FLUT: Loaded 50771 existing records from primary storage. [2025-10-13T22:38:09.426185] [INFO ] [MAIN ] FLUT: Loaded 50771 primary data records. [2025-10-13T22:38:10.129613] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:10.142578] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50339 primary records. [2025-10-13T22:38:10.142701] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-13T22:38:10.142993] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:10.143687] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20860 primary records. [2025-10-13T22:38:10.146060] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-13T22:38:10.186326] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-13T22:38:10.185964] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:10.187159] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-13T22:38:10.190289] [INFO ] [MAIN ] Derivative Progress: 694/1810 symbols completed. FLXR took 1.1s. Estimated remaining: 7m 14s. Rate: 154.4 symbols/min [2025-10-13T22:38:10.190718] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:10.187883] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50771 primary records. [2025-10-13T22:38:10.191163] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-13T22:38:10.205580] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-13T22:38:10.210003] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-13T22:38:10.208850] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-13T22:38:10.210101] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-13T22:38:10.212169] [INFO ] [MAIN ] Derivative Progress: 695/1810 symbols completed. FLS took 1.2s. Estimated remaining: 7m 13s. Rate: 154.6 symbols/min [2025-10-13T22:38:10.215170] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:10.215268] [INFO ] [MAIN ] Derivative Progress: 696/1810 symbols completed. FLUT took 1.1s. Estimated remaining: 7m 12s. Rate: 154.9 symbols/min [2025-10-13T22:38:10.215496] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:10.223055] [DEBUG] [LOCAL ] FMN: Loaded 5362 existing records from primary storage. [2025-10-13T22:38:10.223260] [INFO ] [MAIN ] FMN: Loaded 5362 primary data records. [2025-10-13T22:38:10.561933] [DEBUG] [LOCAL ] FMS: Loaded 30169 existing records from primary storage. [2025-10-13T22:38:10.560704] [DEBUG] [LOCAL ] FMC: Loaded 51819 existing records from primary storage. [2025-10-13T22:38:10.562089] [INFO ] [MAIN ] FMS: Loaded 30169 primary data records. [2025-10-13T22:38:10.562310] [INFO ] [MAIN ] FMC: Loaded 51819 primary data records. [2025-10-13T22:38:11.180284] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:11.181855] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5362 primary records. [2025-10-13T22:38:11.182267] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-13T22:38:11.199829] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-13T22:38:11.200357] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-13T22:38:11.202445] [INFO ] [MAIN ] Derivative Progress: 697/1810 symbols completed. FMN took 1.0s. Estimated remaining: 7m 12s. Rate: 154.5 symbols/min [2025-10-13T22:38:11.202749] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:11.234864] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:11.235392] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:11.236186] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51819 primary records. [2025-10-13T22:38:11.236935] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30169 primary records. [2025-10-13T22:38:11.237050] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-13T22:38:11.237925] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-13T22:38:11.275153] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-13T22:38:11.275687] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-13T22:38:11.279678] [INFO ] [MAIN ] Derivative Progress: 698/1810 symbols completed. FMS took 1.1s. Estimated remaining: 7m 11s. Rate: 154.7 symbols/min [2025-10-13T22:38:11.280291] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:11.282666] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-13T22:38:11.282844] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-13T22:38:11.295815] [INFO ] [MAIN ] Derivative Progress: 699/1810 symbols completed. FMC took 1.1s. Estimated remaining: 7m 10s. Rate: 154.9 symbols/min [2025-10-13T22:38:11.296127] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:11.297543] [DEBUG] [LOCAL ] FMX: Loaded 40458 existing records from primary storage. [2025-10-13T22:38:11.300435] [DEBUG] [LOCAL ] FMY: Loaded 1389 existing records from primary storage. [2025-10-13T22:38:11.300575] [INFO ] [MAIN ] FMX: Loaded 40458 primary data records. [2025-10-13T22:38:11.300715] [INFO ] [MAIN ] FMY: Loaded 1389 primary data records. [2025-10-13T22:38:11.945780] [DEBUG] [LOCAL ] FN: Loaded 37947 existing records from primary storage. [2025-10-13T22:38:11.946156] [INFO ] [MAIN ] FN: Loaded 37947 primary data records. [2025-10-13T22:38:12.285830] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:38:12.291788] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:12.293134] [INFO ] [MAIN ] FMY: Generated 1792 derivative records from 1389 primary records. [2025-10-13T22:38:12.293272] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-13T22:38:12.295306] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40458 primary records. [2025-10-13T22:38:12.296097] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-13T22:38:12.329202] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-13T22:38:12.329461] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-13T22:38:12.329315] [DEBUG] [LOCAL ] FMY: Derivative data saved (1792 records). [2025-10-13T22:38:12.331750] [INFO ] [MAIN ] Derivative Progress: 700/1810 symbols completed. FMX took 1.1s. Estimated remaining: 7m 11s. Rate: 154.5 symbols/min [2025-10-13T22:38:12.332278] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-13T22:38:12.334818] [INFO ] [MAIN ] Derivative Progress: 701/1810 symbols completed. FMY took 1.1s. Estimated remaining: 7m 10s. Rate: 154.8 symbols/min [2025-10-13T22:38:12.334730] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:12.335384] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:12.354355] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:12.355214] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 37947 primary records. [2025-10-13T22:38:12.355327] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-13T22:38:12.375905] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-13T22:38:12.376070] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-13T22:38:12.379473] [INFO ] [MAIN ] Derivative Progress: 702/1810 symbols completed. FN took 1.1s. Estimated remaining: 7m 9s. Rate: 154.9 symbols/min [2025-10-13T22:38:12.379805] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:12.454049] [DEBUG] [LOCAL ] FND: Loaded 52147 existing records from primary storage. [2025-10-13T22:38:12.455681] [DEBUG] [LOCAL ] FNB: Loaded 52572 existing records from primary storage. [2025-10-13T22:38:12.455926] [INFO ] [MAIN ] FND: Loaded 52147 primary data records. [2025-10-13T22:38:12.456194] [INFO ] [MAIN ] FNB: Loaded 52572 primary data records. [2025-10-13T22:38:12.725855] [DEBUG] [LOCAL ] FNF: Loaded 48986 existing records from primary storage. [2025-10-13T22:38:12.737303] [INFO ] [MAIN ] FNF: Loaded 48986 primary data records. [2025-10-13T22:38:13.516306] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:13.529400] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52572 primary records. [2025-10-13T22:38:13.530453] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:13.530133] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-13T22:38:13.531081] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52147 primary records. [2025-10-13T22:38:13.531777] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-13T22:38:13.566774] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-13T22:38:13.568623] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-13T22:38:13.571357] [INFO ] [MAIN ] Derivative Progress: 703/1810 symbols completed. FNB took 1.2s. Estimated remaining: 7m 10s. Rate: 154.5 symbols/min [2025-10-13T22:38:13.573735] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-13T22:38:13.573836] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-13T22:38:13.576263] [INFO ] [MAIN ] Derivative Progress: 704/1810 symbols completed. FND took 1.2s. Estimated remaining: 7m 9s. Rate: 154.7 symbols/min [2025-10-13T22:38:13.590225] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:13.590988] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48986 primary records. [2025-10-13T22:38:13.591052] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-13T22:38:13.608232] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-13T22:38:13.608300] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-13T22:38:13.612990] [INFO ] [MAIN ] Derivative Progress: 705/1810 symbols completed. FNF took 1.2s. Estimated remaining: 7m 8s. Rate: 154.9 symbols/min [2025-10-13T22:38:13.613415] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:13.613545] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:13.613624] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:13.634449] [DEBUG] [LOCAL ] FOF: Loaded 8585 existing records from primary storage. [2025-10-13T22:38:13.634687] [INFO ] [MAIN ] FOF: Loaded 8585 primary data records. [2025-10-13T22:38:13.719138] [DEBUG] [LOCAL ] FOA: Loaded 13120 existing records from primary storage. [2025-10-13T22:38:13.743143] [INFO ] [MAIN ] FOA: Loaded 13120 primary data records. [2025-10-13T22:38:14.149401] [DEBUG] [LOCAL ] FNV: Loaded 46111 existing records from primary storage. [2025-10-13T22:38:14.270330] [INFO ] [MAIN ] FNV: Loaded 46111 primary data records. [2025-10-13T22:38:14.603920] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:14.605099] [INFO ] [MAIN ] FOF: Generated 1793 derivative records from 8585 primary records. [2025-10-13T22:38:14.605424] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-13T22:38:14.631872] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:14.634242] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13120 primary records. [2025-10-13T22:38:14.634670] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-13T22:38:14.653507] [DEBUG] [LOCAL ] FOF: Derivative data saved (1793 records). [2025-10-13T22:38:14.654681] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-13T22:38:14.657305] [INFO ] [MAIN ] Derivative Progress: 706/1810 symbols completed. FOF took 1.0s. Estimated remaining: 7m 9s. Rate: 154.5 symbols/min [2025-10-13T22:38:14.657889] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:14.663205] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-13T22:38:14.664095] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-13T22:38:14.666793] [INFO ] [MAIN ] Derivative Progress: 707/1810 symbols completed. FOA took 1.1s. Estimated remaining: 7m 8s. Rate: 154.8 symbols/min [2025-10-13T22:38:14.667040] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:14.686170] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:14.686978] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46111 primary records. [2025-10-13T22:38:14.687138] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-13T22:38:14.708208] [DEBUG] [LOCAL ] FOR: Loaded 19785 existing records from primary storage. [2025-10-13T22:38:14.709830] [INFO ] [MAIN ] FOR: Loaded 19785 primary data records. [2025-10-13T22:38:14.767461] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-13T22:38:14.776234] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-13T22:38:14.778862] [INFO ] [MAIN ] Derivative Progress: 708/1810 symbols completed. FNV took 1.2s. Estimated remaining: 7m 7s. Rate: 154.9 symbols/min [2025-10-13T22:38:14.801236] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:15.059861] [DEBUG] [LOCAL ] FOUR: Loaded 49672 existing records from primary storage. [2025-10-13T22:38:15.060552] [INFO ] [MAIN ] FOUR: Loaded 49672 primary data records. [2025-10-13T22:38:15.112291] [DEBUG] [LOCAL ] FPF: Loaded 18766 existing records from primary storage. [2025-10-13T22:38:15.134276] [INFO ] [MAIN ] FPF: Loaded 18766 primary data records. [2025-10-13T22:38:15.757256] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:15.758425] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19785 primary records. [2025-10-13T22:38:15.758557] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-13T22:38:15.779224] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-13T22:38:15.779346] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-13T22:38:15.782180] [INFO ] [MAIN ] Derivative Progress: 709/1810 symbols completed. FOR took 1.1s. Estimated remaining: 7m 7s. Rate: 154.6 symbols/min [2025-10-13T22:38:15.782533] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:15.807526] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:15.810092] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49672 primary records. [2025-10-13T22:38:15.810244] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-13T22:38:15.842120] [DEBUG] [LOCAL ] FPH: Loaded 19370 existing records from primary storage. [2025-10-13T22:38:15.843449] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:15.844111] [INFO ] [MAIN ] FPH: Loaded 19370 primary data records. [2025-10-13T22:38:15.848309] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18766 primary records. [2025-10-13T22:38:15.848518] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-13T22:38:15.860533] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-13T22:38:15.885865] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-13T22:38:15.906852] [INFO ] [MAIN ] Derivative Progress: 710/1810 symbols completed. FOUR took 1.2s. Estimated remaining: 7m 7s. Rate: 154.7 symbols/min [2025-10-13T22:38:15.928200] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:16.164998] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-13T22:38:16.165153] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-13T22:38:16.168084] [INFO ] [MAIN ] Derivative Progress: 711/1810 symbols completed. FPF took 1.4s. Estimated remaining: 7m 6s. Rate: 154.8 symbols/min [2025-10-13T22:38:16.168323] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:16.197188] [DEBUG] [LOCAL ] FRA: Loaded 14428 existing records from primary storage. [2025-10-13T22:38:16.197546] [INFO ] [MAIN ] FRA: Loaded 14428 primary data records. [2025-10-13T22:38:16.301459] [DEBUG] [LOCAL ] FR: Loaded 46458 existing records from primary storage. [2025-10-13T22:38:16.319888] [INFO ] [MAIN ] FR: Loaded 46458 primary data records. [2025-10-13T22:38:16.437310] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:16.629513] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19370 primary records. [2025-10-13T22:38:16.633912] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-13T22:38:16.852583] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-13T22:38:16.853019] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-13T22:38:16.855705] [INFO ] [MAIN ] Derivative Progress: 712/1810 symbols completed. FPH took 1.1s. Estimated remaining: 7m 6s. Rate: 154.6 symbols/min [2025-10-13T22:38:16.855981] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:16.893065] [DEBUG] [LOCAL ] FRGE: Loaded 16319 existing records from primary storage. [2025-10-13T22:38:16.892633] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:16.893395] [INFO ] [MAIN ] FRGE: Loaded 16319 primary data records. [2025-10-13T22:38:16.894405] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14428 primary records. [2025-10-13T22:38:16.894579] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-13T22:38:17.048932] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:17.057881] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46458 primary records. [2025-10-13T22:38:17.068565] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-13T22:38:17.069342] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-13T22:38:17.105236] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-13T22:38:17.147419] [INFO ] [MAIN ] Derivative Progress: 713/1810 symbols completed. FRA took 1.0s. Estimated remaining: 7m 6s. Rate: 154.7 symbols/min [2025-10-13T22:38:17.158915] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:17.289397] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-13T22:38:17.289587] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-13T22:38:17.292462] [INFO ] [MAIN ] Derivative Progress: 714/1810 symbols completed. FR took 1.4s. Estimated remaining: 7m 5s. Rate: 154.8 symbols/min [2025-10-13T22:38:17.292787] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:17.321110] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:17.335609] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 16319 primary records. [2025-10-13T22:38:17.335751] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-13T22:38:17.387239] [DEBUG] [LOCAL ] FRT: Loaded 41675 existing records from primary storage. [2025-10-13T22:38:17.388368] [INFO ] [MAIN ] FRT: Loaded 41675 primary data records. [2025-10-13T22:38:17.390164] [DEBUG] [LOCAL ] FRO: Loaded 51695 existing records from primary storage. [2025-10-13T22:38:17.389169] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-13T22:38:17.390570] [INFO ] [MAIN ] FRO: Loaded 51695 primary data records. [2025-10-13T22:38:17.390389] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-13T22:38:17.434674] [INFO ] [MAIN ] Derivative Progress: 715/1810 symbols completed. FRGE took 0.6s. Estimated remaining: 7m 4s. Rate: 154.9 symbols/min [2025-10-13T22:38:17.478960] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:18.081583] [DEBUG] [LOCAL ] FSCO: Loaded 38370 existing records from primary storage. [2025-10-13T22:38:18.082230] [INFO ] [MAIN ] FSCO: Loaded 38370 primary data records. [2025-10-13T22:38:18.418888] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:18.423849] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51695 primary records. [2025-10-13T22:38:18.424148] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-13T22:38:18.456677] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-13T22:38:18.457111] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:18.457363] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-13T22:38:18.459762] [INFO ] [MAIN ] Derivative Progress: 716/1810 symbols completed. FRO took 1.3s. Estimated remaining: 7m 5s. Rate: 154.6 symbols/min [2025-10-13T22:38:18.461111] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41675 primary records. [2025-10-13T22:38:18.461392] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-13T22:38:18.462048] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:18.485975] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-13T22:38:18.486158] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-13T22:38:18.496357] [INFO ] [MAIN ] Derivative Progress: 717/1810 symbols completed. FRT took 1.2s. Estimated remaining: 7m 4s. Rate: 154.8 symbols/min [2025-10-13T22:38:18.501887] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:18.502738] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38370 primary records. [2025-10-13T22:38:18.502860] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:18.502999] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-13T22:38:18.520923] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-13T22:38:18.521150] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-13T22:38:18.523890] [INFO ] [MAIN ] Derivative Progress: 718/1810 symbols completed. FSCO took 1.0s. Estimated remaining: 7m 3s. Rate: 155.0 symbols/min [2025-10-13T22:38:18.570593] [DEBUG] [LOCAL ] FSK: Loaded 49449 existing records from primary storage. [2025-10-13T22:38:18.570773] [INFO ] [MAIN ] FSK: Loaded 49449 primary data records. [2025-10-13T22:38:18.689479] [DEBUG] [LOCAL ] FSLY: Loaded 51276 existing records from primary storage. [2025-10-13T22:38:18.699925] [INFO ] [MAIN ] FSLY: Loaded 51276 primary data records. [2025-10-13T22:38:19.196734] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:19.197534] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49449 primary records. [2025-10-13T22:38:19.197747] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-13T22:38:19.214204] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-13T22:38:19.214500] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-13T22:38:19.216500] [INFO ] [MAIN ] Derivative Progress: 719/1810 symbols completed. FSK took 0.8s. Estimated remaining: 7m 3s. Rate: 154.8 symbols/min [2025-10-13T22:38:19.231521] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:19.232107] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51276 primary records. [2025-10-13T22:38:19.232166] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-13T22:38:19.247748] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-13T22:38:19.247817] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-13T22:38:19.250331] [INFO ] [MAIN ] Derivative Progress: 720/1810 symbols completed. FSLY took 0.7s. Estimated remaining: 7m 2s. Rate: 155.0 symbols/min [2025-10-13T22:38:19.250849] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:19.250921] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:19.250801] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:19.260887] [DEBUG] [LOCAL ] FT: Loaded 6748 existing records from primary storage. [2025-10-13T22:38:19.261191] [INFO ] [MAIN ] FT: Loaded 6748 primary data records. [2025-10-13T22:38:19.627345] [DEBUG] [LOCAL ] FSS: Loaded 33816 existing records from primary storage. [2025-10-13T22:38:19.628518] [INFO ] [MAIN ] FSS: Loaded 33816 primary data records. [2025-10-13T22:38:19.733002] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-13T22:38:19.738874] [INFO ] [MAIN ] FSM: Loaded 53298 primary data records. [2025-10-13T22:38:20.305693] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:20.306807] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6748 primary records. [2025-10-13T22:38:20.307118] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-13T22:38:20.331474] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-13T22:38:20.339568] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-13T22:38:20.342386] [INFO ] [MAIN ] Derivative Progress: 721/1810 symbols completed. FT took 1.1s. Estimated remaining: 7m 3s. Rate: 154.6 symbols/min [2025-10-13T22:38:20.347336] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:20.348526] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:20.351529] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33816 primary records. [2025-10-13T22:38:20.352167] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-13T22:38:20.371185] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-13T22:38:20.371727] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-13T22:38:20.373980] [INFO ] [MAIN ] Derivative Progress: 722/1810 symbols completed. FSS took 1.1s. Estimated remaining: 7m 2s. Rate: 154.8 symbols/min [2025-10-13T22:38:20.376826] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:20.386119] [DEBUG] [LOCAL ] FTHY: Loaded 12332 existing records from primary storage. [2025-10-13T22:38:20.399614] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:20.399731] [INFO ] [MAIN ] FTHY: Loaded 12332 primary data records. [2025-10-13T22:38:20.400787] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53298 primary records. [2025-10-13T22:38:20.421855] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-13T22:38:20.560378] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-13T22:38:20.560533] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-13T22:38:20.581830] [INFO ] [MAIN ] Derivative Progress: 723/1810 symbols completed. FSM took 1.3s. Estimated remaining: 7m 1s. Rate: 154.9 symbols/min [2025-10-13T22:38:20.615758] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:20.745746] [DEBUG] [LOCAL ] FTI: Loaded 53299 existing records from primary storage. [2025-10-13T22:38:20.746638] [INFO ] [MAIN ] FTI: Loaded 53299 primary data records. [2025-10-13T22:38:20.926364] [DEBUG] [LOCAL ] FTK: Loaded 32807 existing records from primary storage. [2025-10-13T22:38:20.954699] [INFO ] [MAIN ] FTK: Loaded 32807 primary data records. [2025-10-13T22:38:21.418726] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:21.419882] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12332 primary records. [2025-10-13T22:38:21.420005] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-13T22:38:21.442147] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-13T22:38:21.442496] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-13T22:38:21.444915] [INFO ] [MAIN ] Derivative Progress: 724/1810 symbols completed. FTHY took 1.1s. Estimated remaining: 7m 1s. Rate: 154.6 symbols/min [2025-10-13T22:38:21.445612] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:21.459638] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:21.460945] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53299 primary records. [2025-10-13T22:38:21.461316] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-13T22:38:21.477855] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-13T22:38:21.478122] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-13T22:38:21.480823] [INFO ] [MAIN ] Derivative Progress: 725/1810 symbols completed. FTI took 1.1s. Estimated remaining: 7m 0s. Rate: 154.8 symbols/min [2025-10-13T22:38:21.481108] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:21.497795] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:21.498573] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32807 primary records. [2025-10-13T22:38:21.498708] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-13T22:38:21.525527] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-13T22:38:21.525775] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-13T22:38:21.528478] [INFO ] [MAIN ] Derivative Progress: 726/1810 symbols completed. FTK took 0.9s. Estimated remaining: 6m 60s. Rate: 155.0 symbols/min [2025-10-13T22:38:21.528774] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:21.532992] [DEBUG] [LOCAL ] FTWO: Loaded 1896 existing records from primary storage. [2025-10-13T22:38:21.533817] [INFO ] [MAIN ] FTWO: Loaded 1896 primary data records. [2025-10-13T22:38:21.624691] [DEBUG] [LOCAL ] FTS: Loaded 42510 existing records from primary storage. [2025-10-13T22:38:21.630415] [INFO ] [MAIN ] FTS: Loaded 42510 primary data records. [2025-10-13T22:38:21.856726] [DEBUG] [LOCAL ] FTV: Loaded 53035 existing records from primary storage. [2025-10-13T22:38:21.857124] [INFO ] [MAIN ] FTV: Loaded 53035 primary data records. [2025-10-13T22:38:22.469830] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:22.473202] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1896 primary records. [2025-10-13T22:38:22.473500] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-13T22:38:22.496915] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:22.500837] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42510 primary records. [2025-10-13T22:38:22.501165] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-13T22:38:22.502062] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-13T22:38:22.504870] [INFO ] [MAIN ] Derivative Progress: 727/1810 symbols completed. FTWO took 1.0s. Estimated remaining: 7m 0s. Rate: 154.7 symbols/min [2025-10-13T22:38:22.502017] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-13T22:38:22.506434] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:22.531319] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:22.533874] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 53035 primary records. [2025-10-13T22:38:22.534748] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-13T22:38:22.536719] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-13T22:38:22.536806] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-13T22:38:22.539449] [INFO ] [MAIN ] Derivative Progress: 728/1810 symbols completed. FTS took 1.1s. Estimated remaining: 6m 59s. Rate: 154.9 symbols/min [2025-10-13T22:38:22.539597] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:22.555579] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-13T22:38:22.555754] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-13T22:38:22.558424] [INFO ] [MAIN ] Derivative Progress: 729/1810 symbols completed. FTV took 1.1s. Estimated remaining: 6m 58s. Rate: 155.1 symbols/min [2025-10-13T22:38:22.558557] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:22.601331] [DEBUG] [LOCAL ] FUL: Loaded 32704 existing records from primary storage. [2025-10-13T22:38:22.601494] [INFO ] [MAIN ] FUL: Loaded 32704 primary data records. [2025-10-13T22:38:22.731150] [DEBUG] [LOCAL ] FUBO: Loaded 53715 existing records from primary storage. [2025-10-13T22:38:22.731673] [INFO ] [MAIN ] FUBO: Loaded 53715 primary data records. [2025-10-13T22:38:23.030086] [DEBUG] [LOCAL ] FUN: Loaded 51875 existing records from primary storage. [2025-10-13T22:38:23.034021] [INFO ] [MAIN ] FUN: Loaded 51875 primary data records. [2025-10-13T22:38:23.582354] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:23.583214] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32704 primary records. [2025-10-13T22:38:23.583419] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-13T22:38:23.604147] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-13T22:38:23.605260] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-13T22:38:23.607480] [INFO ] [MAIN ] Derivative Progress: 730/1810 symbols completed. FUL took 1.1s. Estimated remaining: 6m 59s. Rate: 154.7 symbols/min [2025-10-13T22:38:23.607917] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:23.623500] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:23.624348] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53715 primary records. [2025-10-13T22:38:23.624602] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-13T22:38:23.645052] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:23.652449] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51875 primary records. [2025-10-13T22:38:23.652843] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-13T22:38:23.661534] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-13T22:38:23.668924] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-13T22:38:23.676640] [INFO ] [MAIN ] Derivative Progress: 731/1810 symbols completed. FUBO took 1.2s. Estimated remaining: 6m 58s. Rate: 154.9 symbols/min [2025-10-13T22:38:23.677310] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:23.687343] [DEBUG] [LOCAL ] FVR: Loaded 21321 existing records from primary storage. [2025-10-13T22:38:23.689072] [INFO ] [MAIN ] FVR: Loaded 21321 primary data records. [2025-10-13T22:38:23.689140] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-13T22:38:23.709980] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-13T22:38:23.746471] [INFO ] [MAIN ] Derivative Progress: 732/1810 symbols completed. FUN took 1.2s. Estimated remaining: 6m 57s. Rate: 155.1 symbols/min [2025-10-13T22:38:23.767380] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:23.891771] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-13T22:38:23.993124] [INFO ] [MAIN ] FXED: Loaded 1252 primary data records. [2025-10-13T22:38:24.105823] [DEBUG] [LOCAL ] FVRR: Loaded 40494 existing records from primary storage. [2025-10-13T22:38:24.119344] [INFO ] [MAIN ] FVRR: Loaded 40494 primary data records. [2025-10-13T22:38:24.625990] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:24.626743] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21321 primary records. [2025-10-13T22:38:24.626983] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-13T22:38:24.646196] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-13T22:38:24.646614] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-13T22:38:24.649029] [INFO ] [MAIN ] Derivative Progress: 733/1810 symbols completed. FVR took 1.0s. Estimated remaining: 6m 57s. Rate: 154.8 symbols/min [2025-10-13T22:38:24.666032] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:24.666714] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1252 primary records. [2025-10-13T22:38:24.666874] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-13T22:38:24.683165] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-13T22:38:24.683293] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-13T22:38:24.685793] [INFO ] [MAIN ] Derivative Progress: 734/1810 symbols completed. FXED took 0.9s. Estimated remaining: 6m 57s. Rate: 155.0 symbols/min [2025-10-13T22:38:24.698200] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:24.698773] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40494 primary records. [2025-10-13T22:38:24.698836] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-13T22:38:24.713926] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-13T22:38:24.713984] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-13T22:38:24.716598] [INFO ] [MAIN ] Derivative Progress: 735/1810 symbols completed. FVRR took 1.0s. Estimated remaining: 6m 56s. Rate: 155.2 symbols/min [2025-10-13T22:38:24.717031] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:24.717203] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:24.717102] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:24.724369] [DEBUG] [LOCAL ] GAM: Loaded 3987 existing records from primary storage. [2025-10-13T22:38:24.724512] [INFO ] [MAIN ] GAM: Loaded 3987 primary data records. [2025-10-13T22:38:24.898881] [DEBUG] [LOCAL ] GAB: Loaded 27677 existing records from primary storage. [2025-10-13T22:38:24.938510] [INFO ] [MAIN ] GAB: Loaded 27677 primary data records. [2025-10-13T22:38:25.167849] [DEBUG] [LOCAL ] G: Loaded 50010 existing records from primary storage. [2025-10-13T22:38:25.185556] [INFO ] [MAIN ] G: Loaded 50010 primary data records. [2025-10-13T22:38:25.750613] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:25.752546] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 3987 primary records. [2025-10-13T22:38:25.752638] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-13T22:38:25.769950] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-13T22:38:25.770836] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-13T22:38:25.773490] [INFO ] [MAIN ] Derivative Progress: 736/1810 symbols completed. GAM took 1.1s. Estimated remaining: 6m 56s. Rate: 154.8 symbols/min [2025-10-13T22:38:25.774507] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:25.796570] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:25.797410] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27677 primary records. [2025-10-13T22:38:25.797960] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-13T22:38:25.817467] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-13T22:38:25.817902] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-13T22:38:25.821105] [INFO ] [MAIN ] Derivative Progress: 737/1810 symbols completed. GAB took 1.1s. Estimated remaining: 6m 55s. Rate: 155.0 symbols/min [2025-10-13T22:38:25.821281] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:25.839161] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:25.840019] [INFO ] [MAIN ] G: Generated 1794 derivative records from 50010 primary records. [2025-10-13T22:38:25.840220] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-13T22:38:25.884773] [DEBUG] [LOCAL ] GATX: Loaded 18135 existing records from primary storage. [2025-10-13T22:38:25.885936] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-13T22:38:25.886195] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-13T22:38:25.885620] [INFO ] [MAIN ] GATX: Loaded 18135 primary data records. [2025-10-13T22:38:25.903277] [INFO ] [MAIN ] Derivative Progress: 738/1810 symbols completed. G took 1.2s. Estimated remaining: 6m 54s. Rate: 155.2 symbols/min [2025-10-13T22:38:25.916386] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:25.942299] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-13T22:38:25.987054] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-13T22:38:26.153094] [DEBUG] [LOCAL ] GBAB: Loaded 13018 existing records from primary storage. [2025-10-13T22:38:26.177776] [INFO ] [MAIN ] GBAB: Loaded 13018 primary data records. [2025-10-13T22:38:26.902679] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:26.904205] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18135 primary records. [2025-10-13T22:38:26.904785] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-13T22:38:26.921872] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-13T22:38:26.924079] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-13T22:38:26.927534] [INFO ] [MAIN ] Derivative Progress: 739/1810 symbols completed. GATX took 1.1s. Estimated remaining: 6m 55s. Rate: 154.8 symbols/min [2025-10-13T22:38:26.927731] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:26.942573] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:26.943371] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-13T22:38:26.943510] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-13T22:38:26.963279] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-13T22:38:26.963520] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-13T22:38:26.966049] [INFO ] [MAIN ] Derivative Progress: 740/1810 symbols completed. GAP took 1.2s. Estimated remaining: 6m 54s. Rate: 155.0 symbols/min [2025-10-13T22:38:26.966507] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:26.980942] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:26.981914] [INFO ] [MAIN ] GBAB: Generated 1793 derivative records from 13018 primary records. [2025-10-13T22:38:26.982110] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-13T22:38:27.008874] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1793 records). [2025-10-13T22:38:27.009086] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-13T22:38:27.013764] [INFO ] [MAIN ] Derivative Progress: 741/1810 symbols completed. GBAB took 1.1s. Estimated remaining: 6m 53s. Rate: 155.2 symbols/min [2025-10-13T22:38:27.014726] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:27.027938] [DEBUG] [LOCAL ] GBCI: Loaded 40690 existing records from primary storage. [2025-10-13T22:38:27.037533] [INFO ] [MAIN ] GBCI: Loaded 40690 primary data records. [2025-10-13T22:38:27.150026] [DEBUG] [LOCAL ] GBTG: Loaded 40089 existing records from primary storage. [2025-10-13T22:38:27.181988] [INFO ] [MAIN ] GBTG: Loaded 40089 primary data records. [2025-10-13T22:38:27.498424] [DEBUG] [LOCAL ] GBX: Loaded 29077 existing records from primary storage. [2025-10-13T22:38:27.498747] [INFO ] [MAIN ] GBX: Loaded 29077 primary data records. [2025-10-13T22:38:28.025252] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:28.026350] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40690 primary records. [2025-10-13T22:38:28.026504] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-13T22:38:28.059121] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-13T22:38:28.059573] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-13T22:38:28.059407] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:28.060295] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40089 primary records. [2025-10-13T22:38:28.063004] [INFO ] [MAIN ] Derivative Progress: 742/1810 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 54s. Rate: 154.8 symbols/min [2025-10-13T22:38:28.060580] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-13T22:38:28.063161] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:28.097450] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-13T22:38:28.098063] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-13T22:38:28.098494] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:28.101267] [INFO ] [MAIN ] Derivative Progress: 743/1810 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 53s. Rate: 155.0 symbols/min [2025-10-13T22:38:28.101460] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:28.102731] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29077 primary records. [2025-10-13T22:38:28.102916] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-13T22:38:28.129885] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-13T22:38:28.130103] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-13T22:38:28.133040] [INFO ] [MAIN ] Derivative Progress: 744/1810 symbols completed. GBX took 1.1s. Estimated remaining: 6m 52s. Rate: 155.2 symbols/min [2025-10-13T22:38:28.133363] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:28.165701] [DEBUG] [LOCAL ] GCI: Loaded 43935 existing records from primary storage. [2025-10-13T22:38:28.166082] [INFO ] [MAIN ] GCI: Loaded 43935 primary data records. [2025-10-13T22:38:28.165999] [DEBUG] [LOCAL ] GCV: Loaded 7706 existing records from primary storage. [2025-10-13T22:38:28.177528] [INFO ] [MAIN ] GCV: Loaded 7706 primary data records. [2025-10-13T22:38:28.187306] [DEBUG] [LOCAL ] GCTS: Loaded 20410 existing records from primary storage. [2025-10-13T22:38:28.187455] [INFO ] [MAIN ] GCTS: Loaded 20410 primary data records. [2025-10-13T22:38:29.163740] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:29.166164] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 43935 primary records. [2025-10-13T22:38:29.166320] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-13T22:38:29.203699] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:29.204434] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:29.210315] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20410 primary records. [2025-10-13T22:38:29.209729] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-13T22:38:29.209626] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7706 primary records. [2025-10-13T22:38:29.210509] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-13T22:38:29.210422] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-13T22:38:29.210580] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-13T22:38:29.213882] [INFO ] [MAIN ] Derivative Progress: 745/1810 symbols completed. GCI took 1.2s. Estimated remaining: 6m 53s. Rate: 154.9 symbols/min [2025-10-13T22:38:29.241019] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:29.241125] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-13T22:38:29.242553] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-13T22:38:29.245311] [INFO ] [MAIN ] Derivative Progress: 746/1810 symbols completed. GCV took 1.1s. Estimated remaining: 6m 52s. Rate: 155.0 symbols/min [2025-10-13T22:38:29.246002] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:29.249416] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-13T22:38:29.249724] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-13T22:38:29.252380] [INFO ] [MAIN ] Derivative Progress: 747/1810 symbols completed. GCTS took 1.2s. Estimated remaining: 6m 51s. Rate: 155.2 symbols/min [2025-10-13T22:38:29.252603] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:29.257325] [DEBUG] [LOCAL ] GDL: Loaded 2501 existing records from primary storage. [2025-10-13T22:38:29.257527] [INFO ] [MAIN ] GDL: Loaded 2501 primary data records. [2025-10-13T22:38:29.608307] [DEBUG] [LOCAL ] GDDY: Loaded 49810 existing records from primary storage. [2025-10-13T22:38:29.608486] [INFO ] [MAIN ] GDDY: Loaded 49810 primary data records. [2025-10-13T22:38:29.609843] [DEBUG] [LOCAL ] GD: Loaded 46773 existing records from primary storage. [2025-10-13T22:38:29.615689] [INFO ] [MAIN ] GD: Loaded 46773 primary data records. [2025-10-13T22:38:30.260974] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:38:30.262812] [INFO ] [MAIN ] GDL: Generated 1790 derivative records from 2501 primary records. [2025-10-13T22:38:30.262937] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-13T22:38:30.280718] [DEBUG] [LOCAL ] GDL: Derivative data saved (1790 records). [2025-10-13T22:38:30.281166] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-13T22:38:30.283768] [INFO ] [MAIN ] Derivative Progress: 748/1810 symbols completed. GDL took 1.0s. Estimated remaining: 6m 51s. Rate: 154.9 symbols/min [2025-10-13T22:38:30.305844] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:30.307500] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46773 primary records. [2025-10-13T22:38:30.307584] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-13T22:38:30.339406] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-13T22:38:30.339498] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-13T22:38:30.337926] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:30.341835] [INFO ] [MAIN ] Derivative Progress: 749/1810 symbols completed. GD took 1.1s. Estimated remaining: 6m 51s. Rate: 155.1 symbols/min [2025-10-13T22:38:30.342805] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49810 primary records. [2025-10-13T22:38:30.342932] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-13T22:38:30.361333] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-13T22:38:30.361405] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-13T22:38:30.364609] [INFO ] [MAIN ] Derivative Progress: 750/1810 symbols completed. GDDY took 1.1s. Estimated remaining: 6m 50s. Rate: 155.3 symbols/min [2025-10-13T22:38:30.365277] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:30.365462] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:30.366315] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:30.376561] [DEBUG] [LOCAL ] GDO: Loaded 5913 existing records from primary storage. [2025-10-13T22:38:30.376855] [INFO ] [MAIN ] GDO: Loaded 5913 primary data records. [2025-10-13T22:38:30.510937] [DEBUG] [LOCAL ] GDV: Loaded 19548 existing records from primary storage. [2025-10-13T22:38:30.537718] [INFO ] [MAIN ] GDV: Loaded 19548 primary data records. [2025-10-13T22:38:30.615981] [DEBUG] [LOCAL ] GDOT: Loaded 37679 existing records from primary storage. [2025-10-13T22:38:30.664001] [INFO ] [MAIN ] GDOT: Loaded 37679 primary data records. [2025-10-13T22:38:31.677036] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:31.678954] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5913 primary records. [2025-10-13T22:38:31.679203] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-13T22:38:31.699905] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-13T22:38:31.702452] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-13T22:38:31.705220] [INFO ] [MAIN ] Derivative Progress: 751/1810 symbols completed. GDO took 1.3s. Estimated remaining: 6m 51s. Rate: 154.8 symbols/min [2025-10-13T22:38:31.705817] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:31.719976] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:31.721288] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19548 primary records. [2025-10-13T22:38:31.721467] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-13T22:38:31.738392] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-13T22:38:31.738612] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-13T22:38:31.742841] [INFO ] [MAIN ] Derivative Progress: 752/1810 symbols completed. GDV took 1.4s. Estimated remaining: 6m 50s. Rate: 154.9 symbols/min [2025-10-13T22:38:31.744673] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:31.767779] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:31.768926] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37679 primary records. [2025-10-13T22:38:31.769015] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-13T22:38:31.801059] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-13T22:38:31.808042] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-13T22:38:31.814673] [DEBUG] [LOCAL ] GEF: Loaded 20781 existing records from primary storage. [2025-10-13T22:38:31.813375] [INFO ] [MAIN ] Derivative Progress: 753/1810 symbols completed. GDOT took 1.4s. Estimated remaining: 6m 49s. Rate: 155.1 symbols/min [2025-10-13T22:38:31.814833] [INFO ] [MAIN ] GEF: Loaded 20781 primary data records. [2025-10-13T22:38:31.815142] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:32.003955] [DEBUG] [LOCAL ] GE: Loaded 53706 existing records from primary storage. [2025-10-13T22:38:32.031442] [INFO ] [MAIN ] GE: Loaded 53706 primary data records. [2025-10-13T22:38:32.278068] [DEBUG] [LOCAL ] GEL: Loaded 31996 existing records from primary storage. [2025-10-13T22:38:32.289771] [INFO ] [MAIN ] GEL: Loaded 31996 primary data records. [2025-10-13T22:38:32.857736] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:32.860090] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20781 primary records. [2025-10-13T22:38:32.860228] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-13T22:38:32.896887] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-13T22:38:32.897452] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-13T22:38:32.897350] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:32.900978] [INFO ] [MAIN ] Derivative Progress: 754/1810 symbols completed. GEF took 1.2s. Estimated remaining: 6m 49s. Rate: 154.7 symbols/min [2025-10-13T22:38:32.901177] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:32.898353] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53706 primary records. [2025-10-13T22:38:32.902322] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-13T22:38:32.933043] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:32.936626] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 31996 primary records. [2025-10-13T22:38:32.937382] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-13T22:38:32.937285] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-13T22:38:32.938029] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-13T22:38:32.940812] [INFO ] [MAIN ] Derivative Progress: 755/1810 symbols completed. GE took 1.2s. Estimated remaining: 6m 49s. Rate: 154.9 symbols/min [2025-10-13T22:38:32.941036] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:32.957858] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-13T22:38:32.958034] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-13T22:38:32.960844] [INFO ] [MAIN ] Derivative Progress: 756/1810 symbols completed. GEL took 1.1s. Estimated remaining: 6m 48s. Rate: 155.1 symbols/min [2025-10-13T22:38:32.961101] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:33.014973] [DEBUG] [LOCAL ] GENI: Loaded 52939 existing records from primary storage. [2025-10-13T22:38:33.025057] [INFO ] [MAIN ] GENI: Loaded 52939 primary data records. [2025-10-13T22:38:33.155111] [DEBUG] [LOCAL ] GES: Loaded 38436 existing records from primary storage. [2025-10-13T22:38:33.161549] [INFO ] [MAIN ] GES: Loaded 38436 primary data records. [2025-10-13T22:38:33.156277] [DEBUG] [LOCAL ] GEO: Loaded 51877 existing records from primary storage. [2025-10-13T22:38:33.166922] [INFO ] [MAIN ] GEO: Loaded 51877 primary data records. [2025-10-13T22:38:34.017887] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:34.019386] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52939 primary records. [2025-10-13T22:38:34.019729] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-13T22:38:34.040743] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-13T22:38:34.040919] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-13T22:38:34.043302] [INFO ] [MAIN ] Derivative Progress: 757/1810 symbols completed. GENI took 1.1s. Estimated remaining: 6m 48s. Rate: 154.8 symbols/min [2025-10-13T22:38:34.055275] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:34.068995] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:34.069361] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:34.070210] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51877 primary records. [2025-10-13T22:38:34.070927] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-13T22:38:34.070829] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 38436 primary records. [2025-10-13T22:38:34.071021] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-13T22:38:34.100004] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-13T22:38:34.100574] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-13T22:38:34.104084] [INFO ] [MAIN ] Derivative Progress: 758/1810 symbols completed. GES took 1.1s. Estimated remaining: 6m 47s. Rate: 154.9 symbols/min [2025-10-13T22:38:34.104926] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:34.116477] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-13T22:38:34.116565] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-13T22:38:34.119188] [INFO ] [MAIN ] Derivative Progress: 759/1810 symbols completed. GEO took 1.2s. Estimated remaining: 6m 47s. Rate: 155.1 symbols/min [2025-10-13T22:38:34.119407] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:34.124709] [DEBUG] [LOCAL ] GF: Loaded 2724 existing records from primary storage. [2025-10-13T22:38:34.125266] [INFO ] [MAIN ] GF: Loaded 2724 primary data records. [2025-10-13T22:38:34.200107] [DEBUG] [LOCAL ] GETY: Loaded 35067 existing records from primary storage. [2025-10-13T22:38:34.213556] [INFO ] [MAIN ] GETY: Loaded 35067 primary data records. [2025-10-13T22:38:34.786140] [DEBUG] [LOCAL ] GEV: Loaded 53002 existing records from primary storage. [2025-10-13T22:38:34.786836] [INFO ] [MAIN ] GEV: Loaded 53002 primary data records. [2025-10-13T22:38:35.129995] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:35.132170] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2724 primary records. [2025-10-13T22:38:35.133176] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-13T22:38:35.157212] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:35.161059] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35067 primary records. [2025-10-13T22:38:35.162245] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-13T22:38:35.175671] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-13T22:38:35.178449] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-13T22:38:35.183238] [INFO ] [MAIN ] Derivative Progress: 760/1810 symbols completed. GF took 1.1s. Estimated remaining: 6m 47s. Rate: 154.8 symbols/min [2025-10-13T22:38:35.185150] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:35.186891] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-13T22:38:35.187884] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-13T22:38:35.191259] [INFO ] [MAIN ] Derivative Progress: 761/1810 symbols completed. GETY took 1.1s. Estimated remaining: 6m 46s. Rate: 155.0 symbols/min [2025-10-13T22:38:35.191614] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:35.210446] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:35.211246] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53002 primary records. [2025-10-13T22:38:35.211439] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-13T22:38:35.248140] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-13T22:38:35.248839] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-13T22:38:35.251817] [INFO ] [MAIN ] Derivative Progress: 762/1810 symbols completed. GEV took 1.1s. Estimated remaining: 6m 45s. Rate: 155.1 symbols/min [2025-10-13T22:38:35.252119] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:35.248628] [DEBUG] [LOCAL ] GFF: Loaded 30038 existing records from primary storage. [2025-10-13T22:38:35.252742] [INFO ] [MAIN ] GFF: Loaded 30038 primary data records. [2025-10-13T22:38:35.605136] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-13T22:38:35.616023] [INFO ] [MAIN ] GFI: Loaded 53116 primary data records. [2025-10-13T22:38:35.747246] [DEBUG] [LOCAL ] GFL: Loaded 47788 existing records from primary storage. [2025-10-13T22:38:35.763720] [INFO ] [MAIN ] GFL: Loaded 47788 primary data records. [2025-10-13T22:38:36.253374] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:36.254607] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30038 primary records. [2025-10-13T22:38:36.255597] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-13T22:38:36.275698] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-13T22:38:36.276545] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-13T22:38:36.279893] [INFO ] [MAIN ] Derivative Progress: 763/1810 symbols completed. GFF took 1.1s. Estimated remaining: 6m 46s. Rate: 154.8 symbols/min [2025-10-13T22:38:36.299054] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:36.299732] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53116 primary records. [2025-10-13T22:38:36.299922] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-13T22:38:36.329372] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:36.330879] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47788 primary records. [2025-10-13T22:38:36.331152] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-13T22:38:36.331743] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-13T22:38:36.332055] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-13T22:38:36.334898] [INFO ] [MAIN ] Derivative Progress: 764/1810 symbols completed. GFI took 1.1s. Estimated remaining: 6m 45s. Rate: 155.0 symbols/min [2025-10-13T22:38:36.349170] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-13T22:38:36.349227] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-13T22:38:36.352221] [INFO ] [MAIN ] Derivative Progress: 765/1810 symbols completed. GFL took 1.1s. Estimated remaining: 6m 44s. Rate: 155.2 symbols/min [2025-10-13T22:38:36.352627] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:36.352775] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:36.352577] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:36.363417] [DEBUG] [LOCAL ] GFR: Loaded 7832 existing records from primary storage. [2025-10-13T22:38:36.363584] [INFO ] [MAIN ] GFR: Loaded 7832 primary data records. [2025-10-13T22:38:36.699013] [DEBUG] [LOCAL ] GGG: Loaded 40761 existing records from primary storage. [2025-10-13T22:38:36.699710] [INFO ] [MAIN ] GGG: Loaded 40761 primary data records. [2025-10-13T22:38:36.819067] [DEBUG] [LOCAL ] GGB: Loaded 51339 existing records from primary storage. [2025-10-13T22:38:36.822682] [INFO ] [MAIN ] GGB: Loaded 51339 primary data records. [2025-10-13T22:38:37.334048] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:38:37.335184] [INFO ] [MAIN ] GFR: Generated 1792 derivative records from 7832 primary records. [2025-10-13T22:38:37.336103] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-13T22:38:37.352849] [DEBUG] [LOCAL ] GFR: Derivative data saved (1792 records). [2025-10-13T22:38:37.353012] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-13T22:38:37.356462] [INFO ] [MAIN ] Derivative Progress: 766/1810 symbols completed. GFR took 1.0s. Estimated remaining: 6m 45s. Rate: 154.8 symbols/min [2025-10-13T22:38:37.356883] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:37.375878] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:37.380581] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40761 primary records. [2025-10-13T22:38:37.381029] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-13T22:38:37.398600] [DEBUG] [LOCAL ] GGT: Loaded 14336 existing records from primary storage. [2025-10-13T22:38:37.402829] [INFO ] [MAIN ] GGT: Loaded 14336 primary data records. [2025-10-13T22:38:37.402919] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-13T22:38:37.403023] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-13T22:38:37.405743] [INFO ] [MAIN ] Derivative Progress: 767/1810 symbols completed. GGG took 1.1s. Estimated remaining: 6m 44s. Rate: 155.0 symbols/min [2025-10-13T22:38:37.417541] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:37.513056] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:37.521494] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51339 primary records. [2025-10-13T22:38:37.525150] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-13T22:38:37.527955] [DEBUG] [LOCAL ] GGZ: Loaded 2409 existing records from primary storage. [2025-10-13T22:38:37.555448] [INFO ] [MAIN ] GGZ: Loaded 2409 primary data records. [2025-10-13T22:38:37.839485] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-13T22:38:37.857838] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-13T22:38:37.871701] [INFO ] [MAIN ] Derivative Progress: 768/1810 symbols completed. GGB took 1.5s. Estimated remaining: 6m 43s. Rate: 155.0 symbols/min [2025-10-13T22:38:37.882719] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:37.939689] [DEBUG] [LOCAL ] GHC: Loaded 2904 existing records from primary storage. [2025-10-13T22:38:37.963764] [INFO ] [MAIN ] GHC: Loaded 2904 primary data records. [2025-10-13T22:38:38.402962] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:38.404364] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14336 primary records. [2025-10-13T22:38:38.404568] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-13T22:38:38.423515] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-13T22:38:38.423747] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-13T22:38:38.426340] [INFO ] [MAIN ] Derivative Progress: 769/1810 symbols completed. GGT took 1.1s. Estimated remaining: 6m 43s. Rate: 154.9 symbols/min [2025-10-13T22:38:38.426884] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:38.442137] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:38.443011] [INFO ] [MAIN ] GGZ: Generated 1793 derivative records from 2409 primary records. [2025-10-13T22:38:38.443366] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-13T22:38:38.461450] [DEBUG] [LOCAL ] GHG: Loaded 3279 existing records from primary storage. [2025-10-13T22:38:38.463099] [INFO ] [MAIN ] GHG: Loaded 3279 primary data records. [2025-10-13T22:38:38.463262] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1793 records). [2025-10-13T22:38:38.463355] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-13T22:38:38.501514] [INFO ] [MAIN ] Derivative Progress: 770/1810 symbols completed. GGZ took 1.1s. Estimated remaining: 6m 42s. Rate: 155.1 symbols/min [2025-10-13T22:38:38.534319] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:38.581148] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:38.597445] [INFO ] [MAIN ] GHC: Generated 1793 derivative records from 2904 primary records. [2025-10-13T22:38:38.609915] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-13T22:38:38.794042] [DEBUG] [LOCAL ] GHC: Derivative data saved (1793 records). [2025-10-13T22:38:38.793667] [DEBUG] [LOCAL ] GHI: Loaded 7235 existing records from primary storage. [2025-10-13T22:38:38.794309] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-13T22:38:38.794405] [INFO ] [MAIN ] GHI: Loaded 7235 primary data records. [2025-10-13T22:38:38.797193] [INFO ] [MAIN ] Derivative Progress: 771/1810 symbols completed. GHC took 0.9s. Estimated remaining: 6m 42s. Rate: 155.1 symbols/min [2025-10-13T22:38:38.818615] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:38.942746] [DEBUG] [LOCAL ] GHLD: Loaded 4242 existing records from primary storage. [2025-10-13T22:38:39.111740] [INFO ] [MAIN ] GHLD: Loaded 4242 primary data records. [2025-10-13T22:38:39.434101] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:39.501301] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3279 primary records. [2025-10-13T22:38:39.515496] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-13T22:38:39.532236] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-10-13T22:38:39.532793] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-13T22:38:39.535315] [INFO ] [MAIN ] Derivative Progress: 772/1810 symbols completed. GHG took 1.1s. Estimated remaining: 6m 42s. Rate: 154.9 symbols/min [2025-10-13T22:38:39.535812] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:39.560104] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:39.561212] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7235 primary records. [2025-10-13T22:38:39.561411] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-13T22:38:39.586702] [DEBUG] [LOCAL ] GHM: Loaded 14248 existing records from primary storage. [2025-10-13T22:38:39.587942] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-13T22:38:39.588434] [INFO ] [MAIN ] GHM: Loaded 14248 primary data records. [2025-10-13T22:38:39.588320] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-13T22:38:39.634733] [INFO ] [MAIN ] Derivative Progress: 773/1810 symbols completed. GHI took 1.1s. Estimated remaining: 6m 41s. Rate: 155.1 symbols/min [2025-10-13T22:38:39.667004] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:39.731027] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:39.747782] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4242 primary records. [2025-10-13T22:38:39.785260] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-13T22:38:39.948290] [DEBUG] [LOCAL ] GHY: Loaded 20868 existing records from primary storage. [2025-10-13T22:38:39.949452] [INFO ] [MAIN ] GHY: Loaded 20868 primary data records. [2025-10-13T22:38:40.011615] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-10-13T22:38:40.033910] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-13T22:38:40.060689] [INFO ] [MAIN ] Derivative Progress: 774/1810 symbols completed. GHLD took 1.2s. Estimated remaining: 6m 41s. Rate: 155.1 symbols/min [2025-10-13T22:38:40.064191] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:40.298806] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:40.299828] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14248 primary records. [2025-10-13T22:38:40.299977] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-13T22:38:40.327272] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-13T22:38:40.328436] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-13T22:38:40.328369] [DEBUG] [LOCAL ] GIB: Loaded 31605 existing records from primary storage. [2025-10-13T22:38:40.330819] [INFO ] [MAIN ] Derivative Progress: 775/1810 symbols completed. GHM took 0.8s. Estimated remaining: 6m 40s. Rate: 155.1 symbols/min [2025-10-13T22:38:40.331210] [INFO ] [MAIN ] GIB: Loaded 31605 primary data records. [2025-10-13T22:38:40.331091] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:40.452310] [DEBUG] [LOCAL ] GIC: Loaded 13429 existing records from primary storage. [2025-10-13T22:38:40.491190] [INFO ] [MAIN ] GIC: Loaded 13429 primary data records. [2025-10-13T22:38:40.725106] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:40.758255] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20868 primary records. [2025-10-13T22:38:40.769293] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-13T22:38:40.992143] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-13T22:38:40.992746] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-13T22:38:40.996401] [INFO ] [MAIN ] Derivative Progress: 776/1810 symbols completed. GHY took 1.3s. Estimated remaining: 6m 40s. Rate: 155.0 symbols/min [2025-10-13T22:38:40.996898] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:41.020947] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:41.021863] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31605 primary records. [2025-10-13T22:38:41.022091] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-13T22:38:41.053859] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:41.055180] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13429 primary records. [2025-10-13T22:38:41.056275] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-13T22:38:41.057104] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-13T22:38:41.058290] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-13T22:38:41.071096] [INFO ] [MAIN ] Derivative Progress: 777/1810 symbols completed. GIB took 1.0s. Estimated remaining: 6m 40s. Rate: 155.1 symbols/min [2025-10-13T22:38:41.078857] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:41.089420] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-13T22:38:41.102089] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-13T22:38:41.105235] [INFO ] [MAIN ] Derivative Progress: 778/1810 symbols completed. GIC took 0.8s. Estimated remaining: 6m 39s. Rate: 155.3 symbols/min [2025-10-13T22:38:41.106244] [DEBUG] [LOCAL ] GIL: Loaded 43786 existing records from primary storage. [2025-10-13T22:38:41.106427] [INFO ] [MAIN ] GIL: Loaded 43786 primary data records. [2025-10-13T22:38:41.462157] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-13T22:38:41.462435] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-10-13T22:38:41.775361] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:41.776417] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43786 primary records. [2025-10-13T22:38:41.776597] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-13T22:38:41.794448] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-13T22:38:41.794577] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-13T22:38:41.797389] [INFO ] [MAIN ] Derivative Progress: 779/1810 symbols completed. GIL took 0.8s. Estimated remaining: 6m 39s. Rate: 155.2 symbols/min [2025-10-13T22:38:41.820052] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:41.820797] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-10-13T22:38:41.820863] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-13T22:38:41.839195] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-13T22:38:41.839307] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-13T22:38:41.842022] [INFO ] [MAIN ] Derivative Progress: 780/1810 symbols completed. GIS took 0.8s. Estimated remaining: 6m 38s. Rate: 155.3 symbols/min [2025-10-13T22:38:41.842513] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:41.842586] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:41.842708] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:41.925586] [DEBUG] [LOCAL ] GKOS: Loaded 42521 existing records from primary storage. [2025-10-13T22:38:41.927394] [DEBUG] [LOCAL ] GL: Loaded 37661 existing records from primary storage. [2025-10-13T22:38:41.927838] [INFO ] [MAIN ] GL: Loaded 37661 primary data records. [2025-10-13T22:38:41.927949] [INFO ] [MAIN ] GKOS: Loaded 42521 primary data records. [2025-10-13T22:38:42.045953] [DEBUG] [LOCAL ] GLOB: Loaded 47959 existing records from primary storage. [2025-10-13T22:38:42.101067] [INFO ] [MAIN ] GLOB: Loaded 47959 primary data records. [2025-10-13T22:38:42.966118] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:42.967456] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42521 primary records. [2025-10-13T22:38:42.966389] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:42.975233] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-13T22:38:42.981740] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37661 primary records. [2025-10-13T22:38:42.981962] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-13T22:38:42.982176] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:42.994794] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47959 primary records. [2025-10-13T22:38:42.998843] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-13T22:38:42.999103] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-13T22:38:43.010530] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-13T22:38:43.014871] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-13T22:38:43.015011] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-13T22:38:43.016996] [INFO ] [MAIN ] Derivative Progress: 781/1810 symbols completed. GKOS took 1.2s. Estimated remaining: 6m 39s. Rate: 154.9 symbols/min [2025-10-13T22:38:43.020120] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:43.027823] [INFO ] [MAIN ] Derivative Progress: 782/1810 symbols completed. GL took 1.2s. Estimated remaining: 6m 38s. Rate: 155.1 symbols/min [2025-10-13T22:38:43.028298] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:43.037184] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-13T22:38:43.037458] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-13T22:38:43.040423] [INFO ] [MAIN ] Derivative Progress: 783/1810 symbols completed. GLOB took 1.2s. Estimated remaining: 6m 37s. Rate: 155.3 symbols/min [2025-10-13T22:38:43.043166] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:43.049446] [DEBUG] [LOCAL ] GLP: Loaded 9245 existing records from primary storage. [2025-10-13T22:38:43.049632] [INFO ] [MAIN ] GLP: Loaded 9245 primary data records. [2025-10-13T22:38:43.392050] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-13T22:38:43.392619] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-13T22:38:43.509279] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-13T22:38:43.512865] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-13T22:38:43.966935] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:44.085268] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9245 primary records. [2025-10-13T22:38:44.086471] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-13T22:38:44.104163] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-13T22:38:44.105871] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-13T22:38:44.108366] [INFO ] [MAIN ] Derivative Progress: 784/1810 symbols completed. GLP took 1.1s. Estimated remaining: 6m 37s. Rate: 155.0 symbols/min [2025-10-13T22:38:44.108635] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:44.129414] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:44.130700] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-13T22:38:44.130890] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-13T22:38:44.150358] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-13T22:38:44.150587] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-13T22:38:44.152981] [INFO ] [MAIN ] Derivative Progress: 785/1810 symbols completed. GLW took 1.1s. Estimated remaining: 6m 36s. Rate: 155.1 symbols/min [2025-10-13T22:38:44.153176] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:44.166910] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:44.167549] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-13T22:38:44.167738] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-13T22:38:44.198100] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-13T22:38:44.198304] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-13T22:38:44.201188] [INFO ] [MAIN ] Derivative Progress: 786/1810 symbols completed. GM took 1.2s. Estimated remaining: 6m 36s. Rate: 155.3 symbols/min [2025-10-13T22:38:44.201504] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:44.222587] [DEBUG] [LOCAL ] GME: Loaded 53783 existing records from primary storage. [2025-10-13T22:38:44.222842] [INFO ] [MAIN ] GME: Loaded 53783 primary data records. [2025-10-13T22:38:44.429844] [DEBUG] [LOCAL ] GMED: Loaded 48340 existing records from primary storage. [2025-10-13T22:38:44.451850] [INFO ] [MAIN ] GMED: Loaded 48340 primary data records. [2025-10-13T22:38:44.683466] [DEBUG] [LOCAL ] GMRE: Loaded 37093 existing records from primary storage. [2025-10-13T22:38:44.684847] [INFO ] [MAIN ] GMRE: Loaded 37093 primary data records. [2025-10-13T22:38:45.223366] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:45.225769] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53783 primary records. [2025-10-13T22:38:45.226132] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-13T22:38:45.245600] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-13T22:38:45.245894] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-13T22:38:45.248047] [INFO ] [MAIN ] Derivative Progress: 787/1810 symbols completed. GME took 1.1s. Estimated remaining: 6m 36s. Rate: 155.0 symbols/min [2025-10-13T22:38:45.248222] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:45.263397] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:45.264147] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48340 primary records. [2025-10-13T22:38:45.264326] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-13T22:38:45.286704] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-13T22:38:45.292960] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-13T22:38:45.295323] [INFO ] [MAIN ] Derivative Progress: 788/1810 symbols completed. GMED took 1.1s. Estimated remaining: 6m 35s. Rate: 155.1 symbols/min [2025-10-13T22:38:45.295693] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:45.296797] [DEBUG] [LOCAL ] GNE: Loaded 17941 existing records from primary storage. [2025-10-13T22:38:45.297084] [INFO ] [MAIN ] GNE: Loaded 17941 primary data records. [2025-10-13T22:38:45.406625] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:45.429178] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37093 primary records. [2025-10-13T22:38:45.432556] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-13T22:38:45.705544] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-13T22:38:45.705788] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-13T22:38:45.708692] [INFO ] [MAIN ] Derivative Progress: 789/1810 symbols completed. GMRE took 1.5s. Estimated remaining: 6m 35s. Rate: 155.1 symbols/min [2025-10-13T22:38:45.709428] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:45.710818] [DEBUG] [LOCAL ] GNK: Loaded 40257 existing records from primary storage. [2025-10-13T22:38:45.711021] [INFO ] [MAIN ] GNK: Loaded 40257 primary data records. [2025-10-13T22:38:46.066340] [DEBUG] [LOCAL ] GNL: Loaded 46678 existing records from primary storage. [2025-10-13T22:38:46.067151] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:46.067252] [INFO ] [MAIN ] GNL: Loaded 46678 primary data records. [2025-10-13T22:38:46.068080] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17941 primary records. [2025-10-13T22:38:46.068318] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-13T22:38:46.164082] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-13T22:38:46.174897] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-13T22:38:46.177209] [INFO ] [MAIN ] Derivative Progress: 790/1810 symbols completed. GNE took 0.9s. Estimated remaining: 6m 35s. Rate: 155.1 symbols/min [2025-10-13T22:38:46.188174] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:46.392617] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:46.393441] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40257 primary records. [2025-10-13T22:38:46.394193] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-13T22:38:46.414746] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-13T22:38:46.415206] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-13T22:38:46.417453] [INFO ] [MAIN ] Derivative Progress: 791/1810 symbols completed. GNK took 1.1s. Estimated remaining: 6m 34s. Rate: 155.2 symbols/min [2025-10-13T22:38:46.417957] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:46.440824] [DEBUG] [LOCAL ] GNT: Loaded 8395 existing records from primary storage. [2025-10-13T22:38:46.441361] [INFO ] [MAIN ] GNT: Loaded 8395 primary data records. [2025-10-13T22:38:46.562391] [DEBUG] [LOCAL ] GNRC: Loaded 45346 existing records from primary storage. [2025-10-13T22:38:46.568848] [INFO ] [MAIN ] GNRC: Loaded 45346 primary data records. [2025-10-13T22:38:46.715296] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:46.743285] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46678 primary records. [2025-10-13T22:38:46.748601] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-13T22:38:46.981473] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-13T22:38:46.981679] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-13T22:38:47.090527] [INFO ] [MAIN ] Derivative Progress: 792/1810 symbols completed. GNL took 1.4s. Estimated remaining: 6m 34s. Rate: 155.0 symbols/min [2025-10-13T22:38:47.100254] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:47.127200] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:47.128153] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8395 primary records. [2025-10-13T22:38:47.132811] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-13T22:38:47.172055] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:47.174082] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45346 primary records. [2025-10-13T22:38:47.174425] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-13T22:38:47.199434] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-13T22:38:47.200668] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-13T22:38:47.205538] [INFO ] [MAIN ] Derivative Progress: 793/1810 symbols completed. GNT took 0.8s. Estimated remaining: 6m 33s. Rate: 155.2 symbols/min [2025-10-13T22:38:47.208953] [DEBUG] [LOCAL ] GNW: Loaded 51406 existing records from primary storage. [2025-10-13T22:38:47.210746] [INFO ] [MAIN ] GNW: Loaded 51406 primary data records. [2025-10-13T22:38:47.280720] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-13T22:38:47.301976] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-13T22:38:47.315156] [INFO ] [MAIN ] Derivative Progress: 794/1810 symbols completed. GNRC took 1.1s. Estimated remaining: 6m 33s. Rate: 155.3 symbols/min [2025-10-13T22:38:47.552248] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:47.552995] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51406 primary records. [2025-10-13T22:38:47.553062] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-13T22:38:47.568980] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-13T22:38:47.569096] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-13T22:38:47.571445] [INFO ] [MAIN ] Derivative Progress: 795/1810 symbols completed. GNW took 0.5s. Estimated remaining: 6m 32s. Rate: 155.4 symbols/min [2025-10-13T22:38:47.572083] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:47.572208] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:47.572698] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:47.625166] [DEBUG] [LOCAL ] GOLF: Loaded 31005 existing records from primary storage. [2025-10-13T22:38:47.625322] [INFO ] [MAIN ] GOLF: Loaded 31005 primary data records. [2025-10-13T22:38:47.774736] [DEBUG] [LOCAL ] GOOS: Loaded 44767 existing records from primary storage. [2025-10-13T22:38:47.775470] [DEBUG] [LOCAL ] GOF: Loaded 42577 existing records from primary storage. [2025-10-13T22:38:47.794577] [INFO ] [MAIN ] GOOS: Loaded 44767 primary data records. [2025-10-13T22:38:47.794730] [INFO ] [MAIN ] GOF: Loaded 42577 primary data records. [2025-10-13T22:38:48.653679] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:48.654925] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31005 primary records. [2025-10-13T22:38:48.655320] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-13T22:38:48.674544] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-13T22:38:48.674879] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-13T22:38:48.676917] [INFO ] [MAIN ] Derivative Progress: 796/1810 symbols completed. GOLF took 1.1s. Estimated remaining: 6m 33s. Rate: 155.0 symbols/min [2025-10-13T22:38:48.677356] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:48.711483] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:48.711883] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:48.713794] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44767 primary records. [2025-10-13T22:38:48.712832] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42577 primary records. [2025-10-13T22:38:48.714104] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-13T22:38:48.714017] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-13T22:38:48.745074] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-13T22:38:48.755418] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-13T22:38:48.757997] [INFO ] [MAIN ] Derivative Progress: 797/1810 symbols completed. GOF took 1.2s. Estimated remaining: 6m 32s. Rate: 155.2 symbols/min [2025-10-13T22:38:48.758184] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:48.762314] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-13T22:38:48.774308] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-13T22:38:48.777893] [INFO ] [MAIN ] Derivative Progress: 798/1810 symbols completed. GOOS took 1.2s. Estimated remaining: 6m 31s. Rate: 155.3 symbols/min [2025-10-13T22:38:48.778197] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:48.779239] [DEBUG] [LOCAL ] GOTU: Loaded 37454 existing records from primary storage. [2025-10-13T22:38:48.779991] [INFO ] [MAIN ] GOTU: Loaded 37454 primary data records. [2025-10-13T22:38:48.991898] [DEBUG] [LOCAL ] GPI: Loaded 14798 existing records from primary storage. [2025-10-13T22:38:49.011366] [INFO ] [MAIN ] GPI: Loaded 14798 primary data records. [2025-10-13T22:38:49.132816] [DEBUG] [LOCAL ] GPC: Loaded 46150 existing records from primary storage. [2025-10-13T22:38:49.147866] [INFO ] [MAIN ] GPC: Loaded 46150 primary data records. [2025-10-13T22:38:49.843278] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:49.845192] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37454 primary records. [2025-10-13T22:38:49.845566] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-13T22:38:49.866007] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-13T22:38:49.866555] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-13T22:38:49.869289] [INFO ] [MAIN ] Derivative Progress: 799/1810 symbols completed. GOTU took 1.2s. Estimated remaining: 6m 31s. Rate: 155.0 symbols/min [2025-10-13T22:38:49.870074] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:49.891906] [DEBUG] [LOCAL ] GPJA: Loaded 4251 existing records from primary storage. [2025-10-13T22:38:49.893160] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:49.894707] [INFO ] [MAIN ] GPJA: Loaded 4251 primary data records. [2025-10-13T22:38:49.916058] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14798 primary records. [2025-10-13T22:38:49.931473] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-13T22:38:50.037159] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:50.039477] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46150 primary records. [2025-10-13T22:38:50.039856] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-13T22:38:50.056530] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-13T22:38:50.089824] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-13T22:38:50.117131] [INFO ] [MAIN ] Derivative Progress: 800/1810 symbols completed. GPI took 1.3s. Estimated remaining: 6m 31s. Rate: 155.1 symbols/min [2025-10-13T22:38:50.246317] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:50.248185] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-13T22:38:50.248951] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-13T22:38:50.251539] [INFO ] [MAIN ] Derivative Progress: 801/1810 symbols completed. GPC took 1.5s. Estimated remaining: 6m 30s. Rate: 155.2 symbols/min [2025-10-13T22:38:50.251830] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:50.288832] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:50.290306] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4251 primary records. [2025-10-13T22:38:50.297389] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-13T22:38:50.299177] [DEBUG] [LOCAL ] GPMT: Loaded 25859 existing records from primary storage. [2025-10-13T22:38:50.300297] [INFO ] [MAIN ] GPMT: Loaded 25859 primary data records. [2025-10-13T22:38:50.434204] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-10-13T22:38:50.474394] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-13T22:38:50.520170] [DEBUG] [LOCAL ] GPK: Loaded 52741 existing records from primary storage. [2025-10-13T22:38:50.522565] [INFO ] [MAIN ] Derivative Progress: 802/1810 symbols completed. GPJA took 0.7s. Estimated remaining: 6m 30s. Rate: 155.2 symbols/min [2025-10-13T22:38:50.645882] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:50.646739] [INFO ] [MAIN ] GPK: Loaded 52741 primary data records. [2025-10-13T22:38:51.008231] [DEBUG] [LOCAL ] GPN: Loaded 52044 existing records from primary storage. [2025-10-13T22:38:51.009885] [INFO ] [MAIN ] GPN: Loaded 52044 primary data records. [2025-10-13T22:38:51.023271] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:51.038057] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25859 primary records. [2025-10-13T22:38:51.073970] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-13T22:38:51.165703] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-13T22:38:51.193778] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-13T22:38:51.224458] [INFO ] [MAIN ] Derivative Progress: 803/1810 symbols completed. GPMT took 1.0s. Estimated remaining: 6m 30s. Rate: 155.1 symbols/min [2025-10-13T22:38:51.231899] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:51.367638] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:51.369581] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52741 primary records. [2025-10-13T22:38:51.369923] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-13T22:38:51.388880] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-13T22:38:51.389172] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-13T22:38:51.391887] [INFO ] [MAIN ] Derivative Progress: 804/1810 symbols completed. GPK took 1.1s. Estimated remaining: 6m 29s. Rate: 155.2 symbols/min [2025-10-13T22:38:51.392780] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:51.412209] [DEBUG] [LOCAL ] GPOR: Loaded 23188 existing records from primary storage. [2025-10-13T22:38:51.412610] [INFO ] [MAIN ] GPOR: Loaded 23188 primary data records. [2025-10-13T22:38:51.574605] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:51.599215] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52044 primary records. [2025-10-13T22:38:51.610779] [DEBUG] [LOCAL ] GPRK: Loaded 39556 existing records from primary storage. [2025-10-13T22:38:51.616193] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-13T22:38:51.621636] [INFO ] [MAIN ] GPRK: Loaded 39556 primary data records. [2025-10-13T22:38:52.021353] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-13T22:38:52.028553] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-13T22:38:52.036690] [INFO ] [MAIN ] Derivative Progress: 805/1810 symbols completed. GPN took 1.4s. Estimated remaining: 6m 29s. Rate: 155.1 symbols/min [2025-10-13T22:38:52.047468] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:52.282151] [DEBUG] [LOCAL ] GRBK: Loaded 27134 existing records from primary storage. [2025-10-13T22:38:52.282915] [INFO ] [MAIN ] GRBK: Loaded 27134 primary data records. [2025-10-13T22:38:52.408295] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:52.438198] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23188 primary records. [2025-10-13T22:38:52.481685] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-13T22:38:52.505383] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:52.625285] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39556 primary records. [2025-10-13T22:38:52.633692] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-13T22:38:52.643724] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-13T22:38:52.645530] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-13T22:38:52.649293] [INFO ] [MAIN ] Derivative Progress: 806/1810 symbols completed. GPOR took 1.4s. Estimated remaining: 6m 29s. Rate: 155.0 symbols/min [2025-10-13T22:38:52.657473] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:52.670602] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-13T22:38:52.670928] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-13T22:38:52.673689] [INFO ] [MAIN ] Derivative Progress: 807/1810 symbols completed. GPRK took 1.3s. Estimated remaining: 6m 28s. Rate: 155.1 symbols/min [2025-10-13T22:38:52.675008] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:52.686300] [DEBUG] [LOCAL ] GRC: Loaded 9233 existing records from primary storage. [2025-10-13T22:38:52.686779] [INFO ] [MAIN ] GRC: Loaded 9233 primary data records. [2025-10-13T22:38:52.841169] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:52.846911] [DEBUG] [LOCAL ] GRDN: Loaded 20887 existing records from primary storage. [2025-10-13T22:38:52.871181] [INFO ] [MAIN ] GRDN: Loaded 20887 primary data records. [2025-10-13T22:38:52.871030] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27134 primary records. [2025-10-13T22:38:53.086514] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-13T22:38:53.219837] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-13T22:38:53.230726] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-13T22:38:53.233376] [INFO ] [MAIN ] Derivative Progress: 808/1810 symbols completed. GRBK took 1.2s. Estimated remaining: 6m 28s. Rate: 155.0 symbols/min [2025-10-13T22:38:53.398455] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:53.399909] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9233 primary records. [2025-10-13T22:38:53.400000] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-13T22:38:53.418519] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-13T22:38:53.418784] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-13T22:38:53.421398] [INFO ] [MAIN ] Derivative Progress: 809/1810 symbols completed. GRC took 0.8s. Estimated remaining: 6m 27s. Rate: 155.1 symbols/min [2025-10-13T22:38:53.438722] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:38:53.439456] [INFO ] [MAIN ] GRDN: Generated 1793 derivative records from 20887 primary records. [2025-10-13T22:38:53.439519] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-13T22:38:53.455269] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1793 records). [2025-10-13T22:38:53.455357] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-13T22:38:53.458677] [INFO ] [MAIN ] Derivative Progress: 810/1810 symbols completed. GRDN took 0.8s. Estimated remaining: 6m 26s. Rate: 155.3 symbols/min [2025-10-13T22:38:53.459488] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:53.459390] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:53.459236] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:53.522148] [DEBUG] [LOCAL ] GRNT: Loaded 33945 existing records from primary storage. [2025-10-13T22:38:53.522431] [INFO ] [MAIN ] GRNT: Loaded 33945 primary data records. [2025-10-13T22:38:53.637023] [DEBUG] [LOCAL ] GRND: Loaded 50041 existing records from primary storage. [2025-10-13T22:38:53.654684] [INFO ] [MAIN ] GRND: Loaded 50041 primary data records. [2025-10-13T22:38:53.655347] [DEBUG] [LOCAL ] GRMN: Loaded 40513 existing records from primary storage. [2025-10-13T22:38:53.655599] [INFO ] [MAIN ] GRMN: Loaded 40513 primary data records. [2025-10-13T22:38:54.613403] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:54.613089] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:54.615021] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33945 primary records. [2025-10-13T22:38:54.616066] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50041 primary records. [2025-10-13T22:38:54.628906] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-13T22:38:54.628835] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:54.629245] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-13T22:38:54.630394] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40513 primary records. [2025-10-13T22:38:54.631614] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-13T22:38:54.677000] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-13T22:38:54.679870] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-13T22:38:54.680260] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-13T22:38:54.680378] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-13T22:38:54.683090] [INFO ] [MAIN ] Derivative Progress: 811/1810 symbols completed. GRMN took 1.2s. Estimated remaining: 6m 27s. Rate: 154.9 symbols/min [2025-10-13T22:38:54.687730] [INFO ] [MAIN ] Derivative Progress: 812/1810 symbols completed. GRND took 1.2s. Estimated remaining: 6m 26s. Rate: 155.1 symbols/min [2025-10-13T22:38:54.683783] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:54.687954] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:54.688398] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-13T22:38:54.689254] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-13T22:38:54.691478] [INFO ] [MAIN ] Derivative Progress: 813/1810 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 25s. Rate: 155.3 symbols/min [2025-10-13T22:38:54.691765] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:54.708759] [DEBUG] [LOCAL ] GROV: Loaded 8755 existing records from primary storage. [2025-10-13T22:38:54.708944] [INFO ] [MAIN ] GROV: Loaded 8755 primary data records. [2025-10-13T22:38:54.709245] [DEBUG] [LOCAL ] GRX: Loaded 4762 existing records from primary storage. [2025-10-13T22:38:54.747191] [INFO ] [MAIN ] GRX: Loaded 4762 primary data records. [2025-10-13T22:38:55.355325] [DEBUG] [LOCAL ] GS: Loaded 51775 existing records from primary storage. [2025-10-13T22:38:55.356879] [INFO ] [MAIN ] GS: Loaded 51775 primary data records. [2025-10-13T22:38:55.757448] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:38:55.763365] [INFO ] [MAIN ] GRX: Generated 1792 derivative records from 4762 primary records. [2025-10-13T22:38:55.763567] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-13T22:38:55.764354] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:55.765179] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8755 primary records. [2025-10-13T22:38:55.765746] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-13T22:38:55.796045] [DEBUG] [LOCAL ] GRX: Derivative data saved (1792 records). [2025-10-13T22:38:55.799159] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-13T22:38:55.802054] [INFO ] [MAIN ] Derivative Progress: 814/1810 symbols completed. GRX took 1.1s. Estimated remaining: 6m 26s. Rate: 154.9 symbols/min [2025-10-13T22:38:55.802849] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:55.807173] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-13T22:38:55.807557] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-13T22:38:55.811337] [INFO ] [MAIN ] Derivative Progress: 815/1810 symbols completed. GROV took 1.1s. Estimated remaining: 6m 25s. Rate: 155.1 symbols/min [2025-10-13T22:38:55.811765] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:55.838102] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:55.839014] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51775 primary records. [2025-10-13T22:38:55.839164] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-13T22:38:55.866211] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-13T22:38:55.866547] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-13T22:38:55.870235] [INFO ] [MAIN ] Derivative Progress: 816/1810 symbols completed. GS took 1.2s. Estimated remaining: 6m 24s. Rate: 155.3 symbols/min [2025-10-13T22:38:55.871828] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:55.885721] [DEBUG] [LOCAL ] GSBD: Loaded 39619 existing records from primary storage. [2025-10-13T22:38:55.885908] [INFO ] [MAIN ] GSBD: Loaded 39619 primary data records. [2025-10-13T22:38:56.088202] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-13T22:38:56.098814] [INFO ] [MAIN ] GSK: Loaded 53502 primary data records. [2025-10-13T22:38:56.319474] [DEBUG] [LOCAL ] GSL: Loaded 33280 existing records from primary storage. [2025-10-13T22:38:56.345280] [INFO ] [MAIN ] GSL: Loaded 33280 primary data records. [2025-10-13T22:38:56.919183] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:56.920903] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39619 primary records. [2025-10-13T22:38:56.921291] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-13T22:38:56.957172] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-13T22:38:56.957807] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-13T22:38:56.957538] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:56.958894] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53502 primary records. [2025-10-13T22:38:56.962093] [INFO ] [MAIN ] Derivative Progress: 817/1810 symbols completed. GSBD took 1.2s. Estimated remaining: 6m 25s. Rate: 154.9 symbols/min [2025-10-13T22:38:56.959105] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-13T22:38:56.962999] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:56.981397] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-13T22:38:56.982758] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-13T22:38:56.986926] [INFO ] [MAIN ] Derivative Progress: 818/1810 symbols completed. GSK took 1.2s. Estimated remaining: 6m 24s. Rate: 155.1 symbols/min [2025-10-13T22:38:56.987280] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:57.002488] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:57.003546] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33280 primary records. [2025-10-13T22:38:57.003820] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-13T22:38:57.020863] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-13T22:38:57.020989] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-13T22:38:57.023628] [INFO ] [MAIN ] Derivative Progress: 819/1810 symbols completed. GSL took 1.2s. Estimated remaining: 6m 23s. Rate: 155.3 symbols/min [2025-10-13T22:38:57.023907] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:57.077411] [DEBUG] [LOCAL ] GTES: Loaded 50407 existing records from primary storage. [2025-10-13T22:38:57.078698] [INFO ] [MAIN ] GTES: Loaded 50407 primary data records. [2025-10-13T22:38:57.209361] [DEBUG] [LOCAL ] GTLS: Loaded 43230 existing records from primary storage. [2025-10-13T22:38:57.209592] [INFO ] [MAIN ] GTLS: Loaded 43230 primary data records. [2025-10-13T22:38:57.301266] [DEBUG] [LOCAL ] GTN: Loaded 45242 existing records from primary storage. [2025-10-13T22:38:57.327718] [INFO ] [MAIN ] GTN: Loaded 45242 primary data records. [2025-10-13T22:38:58.107936] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:58.109169] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50407 primary records. [2025-10-13T22:38:58.109334] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-13T22:38:58.139621] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:58.141240] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43230 primary records. [2025-10-13T22:38:58.141335] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-13T22:38:58.160736] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-13T22:38:58.161879] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-13T22:38:58.165194] [INFO ] [MAIN ] Derivative Progress: 820/1810 symbols completed. GTES took 1.2s. Estimated remaining: 6m 23s. Rate: 154.9 symbols/min [2025-10-13T22:38:58.166214] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-13T22:38:58.166630] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-13T22:38:58.169397] [INFO ] [MAIN ] Derivative Progress: 821/1810 symbols completed. GTLS took 1.2s. Estimated remaining: 6m 23s. Rate: 155.1 symbols/min [2025-10-13T22:38:58.169731] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:58.165736] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:58.184047] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:58.184853] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45242 primary records. [2025-10-13T22:38:58.185047] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-13T22:38:58.204058] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-13T22:38:58.204210] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-13T22:38:58.207710] [INFO ] [MAIN ] Derivative Progress: 822/1810 symbols completed. GTN took 1.2s. Estimated remaining: 6m 22s. Rate: 155.3 symbols/min [2025-10-13T22:38:58.207972] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:58.213854] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-10-13T22:38:58.213958] [INFO ] [MAIN ] GUG: Loaded 12212 primary data records. [2025-10-13T22:38:58.344457] [DEBUG] [LOCAL ] GTY: Loaded 30265 existing records from primary storage. [2025-10-13T22:38:58.345111] [INFO ] [MAIN ] GTY: Loaded 30265 primary data records. [2025-10-13T22:38:58.437636] [DEBUG] [LOCAL ] GUT: Loaded 15567 existing records from primary storage. [2025-10-13T22:38:58.561727] [INFO ] [MAIN ] GUT: Loaded 15567 primary data records. [2025-10-13T22:38:59.198867] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:59.200362] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12212 primary records. [2025-10-13T22:38:59.200897] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-13T22:38:59.219441] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-13T22:38:59.219633] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-13T22:38:59.221825] [INFO ] [MAIN ] Derivative Progress: 823/1810 symbols completed. GUG took 1.1s. Estimated remaining: 6m 22s. Rate: 155.0 symbols/min [2025-10-13T22:38:59.239124] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:59.239939] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30265 primary records. [2025-10-13T22:38:59.240074] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-13T22:38:59.268284] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:38:59.270969] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-13T22:38:59.271069] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-13T22:38:59.271742] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15567 primary records. [2025-10-13T22:38:59.271824] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-13T22:38:59.274466] [INFO ] [MAIN ] Derivative Progress: 824/1810 symbols completed. GTY took 1.1s. Estimated remaining: 6m 21s. Rate: 155.1 symbols/min [2025-10-13T22:38:59.289844] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-13T22:38:59.289904] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-13T22:38:59.292584] [INFO ] [MAIN ] Derivative Progress: 825/1810 symbols completed. GUT took 1.1s. Estimated remaining: 6m 21s. Rate: 155.3 symbols/min [2025-10-13T22:38:59.293014] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:59.293125] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:59.293282] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:38:59.321363] [DEBUG] [LOCAL ] GWW: Loaded 19568 existing records from primary storage. [2025-10-13T22:38:59.328918] [INFO ] [MAIN ] GWW: Loaded 19568 primary data records. [2025-10-13T22:38:59.328831] [DEBUG] [LOCAL ] GWH: Loaded 17922 existing records from primary storage. [2025-10-13T22:38:59.329124] [INFO ] [MAIN ] GWH: Loaded 17922 primary data records. [2025-10-13T22:38:59.578837] [DEBUG] [LOCAL ] GWRE: Loaded 40055 existing records from primary storage. [2025-10-13T22:38:59.594694] [INFO ] [MAIN ] GWRE: Loaded 40055 primary data records. [2025-10-13T22:39:00.366948] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:00.368087] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19568 primary records. [2025-10-13T22:39:00.368218] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-13T22:39:00.395337] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:00.397005] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 17922 primary records. [2025-10-13T22:39:00.397367] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-13T22:39:00.417419] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-13T22:39:00.418178] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-13T22:39:00.421051] [INFO ] [MAIN ] Derivative Progress: 826/1810 symbols completed. GWH took 1.1s. Estimated remaining: 6m 21s. Rate: 154.9 symbols/min [2025-10-13T22:39:00.429284] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:00.434608] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-13T22:39:00.436170] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-13T22:39:00.435572] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:00.439353] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40055 primary records. [2025-10-13T22:39:00.439571] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-13T22:39:00.438613] [INFO ] [MAIN ] Derivative Progress: 827/1810 symbols completed. GWW took 1.1s. Estimated remaining: 6m 20s. Rate: 155.1 symbols/min [2025-10-13T22:39:00.440846] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:00.458301] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-13T22:39:00.460673] [DEBUG] [LOCAL ] GYLD: Loaded 1541 existing records from primary storage. [2025-10-13T22:39:00.460890] [INFO ] [MAIN ] GYLD: Loaded 1541 primary data records. [2025-10-13T22:39:00.460970] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-13T22:39:00.464097] [INFO ] [MAIN ] Derivative Progress: 828/1810 symbols completed. GWRE took 1.2s. Estimated remaining: 6m 19s. Rate: 155.3 symbols/min [2025-10-13T22:39:00.485053] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:00.804327] [DEBUG] [LOCAL ] GXO: Loaded 46910 existing records from primary storage. [2025-10-13T22:39:00.804736] [INFO ] [MAIN ] GXO: Loaded 46910 primary data records. [2025-10-13T22:39:00.874967] [DEBUG] [LOCAL ] H: Loaded 44516 existing records from primary storage. [2025-10-13T22:39:00.875855] [INFO ] [MAIN ] H: Loaded 44516 primary data records. [2025-10-13T22:39:01.467460] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:39:01.469204] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1541 primary records. [2025-10-13T22:39:01.469829] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-13T22:39:01.491280] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-13T22:39:01.492431] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-13T22:39:01.495591] [INFO ] [MAIN ] Derivative Progress: 829/1810 symbols completed. GYLD took 1.1s. Estimated remaining: 6m 20s. Rate: 155.0 symbols/min [2025-10-13T22:39:01.495919] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:01.511382] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:01.514469] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 46910 primary records. [2025-10-13T22:39:01.515272] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-13T22:39:01.537415] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:01.542776] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44516 primary records. [2025-10-13T22:39:01.543966] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-13T22:39:01.557299] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-13T22:39:01.561763] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-13T22:39:01.564270] [INFO ] [MAIN ] Derivative Progress: 830/1810 symbols completed. GXO took 1.1s. Estimated remaining: 6m 19s. Rate: 155.1 symbols/min [2025-10-13T22:39:01.564482] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:01.580327] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-13T22:39:01.580412] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-13T22:39:01.583132] [INFO ] [MAIN ] Derivative Progress: 831/1810 symbols completed. H took 1.1s. Estimated remaining: 6m 18s. Rate: 155.3 symbols/min [2025-10-13T22:39:01.583398] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:01.601987] [DEBUG] [LOCAL ] HAE: Loaded 39430 existing records from primary storage. [2025-10-13T22:39:01.602242] [INFO ] [MAIN ] HAE: Loaded 39430 primary data records. [2025-10-13T22:39:01.987997] [DEBUG] [LOCAL ] HAFN: Loaded 43057 existing records from primary storage. [2025-10-13T22:39:02.002867] [INFO ] [MAIN ] HAFN: Loaded 43057 primary data records. [2025-10-13T22:39:02.036768] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-13T22:39:02.042212] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-13T22:39:02.617849] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:02.619418] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39430 primary records. [2025-10-13T22:39:02.619841] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-13T22:39:02.639040] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-13T22:39:02.639674] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-13T22:39:02.642425] [INFO ] [MAIN ] Derivative Progress: 832/1810 symbols completed. HAE took 1.1s. Estimated remaining: 6m 19s. Rate: 155.0 symbols/min [2025-10-13T22:39:02.642832] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:02.664580] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:02.665618] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-13T22:39:02.665756] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-13T22:39:02.695834] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:02.697675] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43057 primary records. [2025-10-13T22:39:02.698116] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-13T22:39:02.714727] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-13T22:39:02.715154] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-13T22:39:02.718340] [INFO ] [MAIN ] Derivative Progress: 833/1810 symbols completed. HAL took 1.1s. Estimated remaining: 6m 18s. Rate: 155.1 symbols/min [2025-10-13T22:39:02.718768] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:02.735724] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-13T22:39:02.735879] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-13T22:39:02.739326] [INFO ] [MAIN ] Derivative Progress: 834/1810 symbols completed. HAFN took 1.2s. Estimated remaining: 6m 17s. Rate: 155.3 symbols/min [2025-10-13T22:39:02.739726] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:02.758281] [DEBUG] [LOCAL ] HASI: Loaded 47474 existing records from primary storage. [2025-10-13T22:39:02.758518] [INFO ] [MAIN ] HASI: Loaded 47474 primary data records. [2025-10-13T22:39:02.818060] [DEBUG] [LOCAL ] HBB: Loaded 6478 existing records from primary storage. [2025-10-13T22:39:02.862826] [INFO ] [MAIN ] HBB: Loaded 6478 primary data records. [2025-10-13T22:39:03.053895] [DEBUG] [LOCAL ] HAYW: Loaded 48879 existing records from primary storage. [2025-10-13T22:39:03.161583] [INFO ] [MAIN ] HAYW: Loaded 48879 primary data records. [2025-10-13T22:39:03.725987] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:03.739216] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47474 primary records. [2025-10-13T22:39:03.739923] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-13T22:39:03.740528] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:39:03.742351] [INFO ] [MAIN ] HBB: Generated 1790 derivative records from 6478 primary records. [2025-10-13T22:39:03.742638] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-13T22:39:03.775895] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-13T22:39:03.776427] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-13T22:39:03.776271] [DEBUG] [LOCAL ] HBB: Derivative data saved (1790 records). [2025-10-13T22:39:03.791447] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-13T22:39:03.778722] [INFO ] [MAIN ] Derivative Progress: 835/1810 symbols completed. HASI took 1.1s. Estimated remaining: 6m 17s. Rate: 155.0 symbols/min [2025-10-13T22:39:03.795684] [INFO ] [MAIN ] Derivative Progress: 836/1810 symbols completed. HBB took 1.1s. Estimated remaining: 6m 17s. Rate: 155.2 symbols/min [2025-10-13T22:39:03.791758] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:03.796242] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:03.796780] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:03.798043] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48879 primary records. [2025-10-13T22:39:03.798313] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-13T22:39:03.817047] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-13T22:39:03.817170] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-13T22:39:03.820368] [INFO ] [MAIN ] Derivative Progress: 837/1810 symbols completed. HAYW took 1.1s. Estimated remaining: 6m 16s. Rate: 155.3 symbols/min [2025-10-13T22:39:03.820611] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:03.902555] [DEBUG] [LOCAL ] HBM: Loaded 52941 existing records from primary storage. [2025-10-13T22:39:03.903590] [INFO ] [MAIN ] HBM: Loaded 52941 primary data records. [2025-10-13T22:39:03.903480] [DEBUG] [LOCAL ] HBI: Loaded 52982 existing records from primary storage. [2025-10-13T22:39:03.915219] [INFO ] [MAIN ] HBI: Loaded 52982 primary data records. [2025-10-13T22:39:04.134776] [DEBUG] [LOCAL ] HCA: Loaded 46919 existing records from primary storage. [2025-10-13T22:39:04.234544] [INFO ] [MAIN ] HCA: Loaded 46919 primary data records. [2025-10-13T22:39:04.890608] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:04.892404] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52982 primary records. [2025-10-13T22:39:04.893049] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-13T22:39:04.915294] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:04.923541] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52941 primary records. [2025-10-13T22:39:04.924062] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-13T22:39:04.926352] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-13T22:39:04.926823] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-13T22:39:04.928749] [INFO ] [MAIN ] Derivative Progress: 838/1810 symbols completed. HBI took 1.1s. Estimated remaining: 6m 16s. Rate: 155.0 symbols/min [2025-10-13T22:39:04.945749] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-13T22:39:04.945863] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-13T22:39:04.948594] [INFO ] [MAIN ] Derivative Progress: 839/1810 symbols completed. HBM took 1.2s. Estimated remaining: 6m 15s. Rate: 155.2 symbols/min [2025-10-13T22:39:04.968560] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:04.969229] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46919 primary records. [2025-10-13T22:39:04.969330] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-13T22:39:04.985546] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-13T22:39:04.985609] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-13T22:39:04.989778] [INFO ] [MAIN ] Derivative Progress: 840/1810 symbols completed. HCA took 1.2s. Estimated remaining: 6m 15s. Rate: 155.3 symbols/min [2025-10-13T22:39:04.990273] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:04.990549] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:04.990365] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:05.022125] [DEBUG] [LOCAL ] HCI: Loaded 14057 existing records from primary storage. [2025-10-13T22:39:05.022476] [INFO ] [MAIN ] HCI: Loaded 14057 primary data records. [2025-10-13T22:39:05.209198] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-13T22:39:05.259744] [INFO ] [MAIN ] HD: Loaded 53493 primary data records. [2025-10-13T22:39:05.260621] [DEBUG] [LOCAL ] HCC: Loaded 45223 existing records from primary storage. [2025-10-13T22:39:05.395693] [INFO ] [MAIN ] HCC: Loaded 45223 primary data records. [2025-10-13T22:39:06.070173] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:06.071321] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14057 primary records. [2025-10-13T22:39:06.071697] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-13T22:39:06.100613] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-13T22:39:06.106490] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:06.107330] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53493 primary records. [2025-10-13T22:39:06.106242] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-13T22:39:06.107778] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-13T22:39:06.109670] [INFO ] [MAIN ] Derivative Progress: 841/1810 symbols completed. HCI took 1.1s. Estimated remaining: 6m 15s. Rate: 155.0 symbols/min [2025-10-13T22:39:06.110694] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:06.127366] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-13T22:39:06.129372] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-13T22:39:06.132164] [INFO ] [MAIN ] Derivative Progress: 842/1810 symbols completed. HD took 1.1s. Estimated remaining: 6m 14s. Rate: 155.2 symbols/min [2025-10-13T22:39:06.132990] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:06.148074] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:06.151180] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45223 primary records. [2025-10-13T22:39:06.151258] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-13T22:39:06.167188] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-13T22:39:06.167422] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-13T22:39:06.170002] [INFO ] [MAIN ] Derivative Progress: 843/1810 symbols completed. HCC took 1.2s. Estimated remaining: 6m 14s. Rate: 155.3 symbols/min [2025-10-13T22:39:06.170262] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:06.232388] [DEBUG] [LOCAL ] HDB: Loaded 51946 existing records from primary storage. [2025-10-13T22:39:06.232703] [INFO ] [MAIN ] HDB: Loaded 51946 primary data records. [2025-10-13T22:39:06.356675] [DEBUG] [LOCAL ] HEI: Loaded 31410 existing records from primary storage. [2025-10-13T22:39:06.383694] [INFO ] [MAIN ] HEI: Loaded 31410 primary data records. [2025-10-13T22:39:06.368196] [DEBUG] [LOCAL ] HE: Loaded 48960 existing records from primary storage. [2025-10-13T22:39:06.404960] [INFO ] [MAIN ] HE: Loaded 48960 primary data records. [2025-10-13T22:39:07.150614] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:07.151533] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51946 primary records. [2025-10-13T22:39:07.151632] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-13T22:39:07.170808] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-13T22:39:07.171103] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-13T22:39:07.173020] [INFO ] [MAIN ] Derivative Progress: 844/1810 symbols completed. HDB took 1.1s. Estimated remaining: 6m 14s. Rate: 155.0 symbols/min [2025-10-13T22:39:07.173342] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:07.209697] [DEBUG] [LOCAL ] HEQ: Loaded 6723 existing records from primary storage. [2025-10-13T22:39:07.210604] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:07.210358] [INFO ] [MAIN ] HEQ: Loaded 6723 primary data records. [2025-10-13T22:39:07.210159] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:07.231537] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31410 primary records. [2025-10-13T22:39:07.246836] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-13T22:39:07.254029] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48960 primary records. [2025-10-13T22:39:07.254502] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-13T22:39:07.320897] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-13T22:39:07.331796] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-13T22:39:07.334219] [INFO ] [MAIN ] Derivative Progress: 845/1810 symbols completed. HEI took 1.2s. Estimated remaining: 6m 13s. Rate: 155.1 symbols/min [2025-10-13T22:39:07.342783] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:07.405007] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-13T22:39:07.538237] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-13T22:39:07.542478] [INFO ] [MAIN ] Derivative Progress: 846/1810 symbols completed. HE took 1.4s. Estimated remaining: 6m 13s. Rate: 155.2 symbols/min [2025-10-13T22:39:07.542753] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:07.563185] [DEBUG] [LOCAL ] HFRO: Loaded 17162 existing records from primary storage. [2025-10-13T22:39:07.563468] [INFO ] [MAIN ] HFRO: Loaded 17162 primary data records. [2025-10-13T22:39:07.711967] [DEBUG] [LOCAL ] HESM: Loaded 48421 existing records from primary storage. [2025-10-13T22:39:07.712508] [INFO ] [MAIN ] HESM: Loaded 48421 primary data records. [2025-10-13T22:39:07.899490] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:08.051814] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6723 primary records. [2025-10-13T22:39:08.104371] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-13T22:39:08.297125] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-13T22:39:08.298328] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-13T22:39:08.301167] [INFO ] [MAIN ] Derivative Progress: 847/1810 symbols completed. HEQ took 1.1s. Estimated remaining: 6m 13s. Rate: 155.1 symbols/min [2025-10-13T22:39:08.301709] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:08.323241] [DEBUG] [LOCAL ] HGER: Loaded 14728 existing records from primary storage. [2025-10-13T22:39:08.331964] [INFO ] [MAIN ] HGER: Loaded 14728 primary data records. [2025-10-13T22:39:08.349500] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:08.370934] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17162 primary records. [2025-10-13T22:39:08.383203] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-13T22:39:08.465565] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-13T22:39:08.481983] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-13T22:39:08.485891] [INFO ] [MAIN ] Derivative Progress: 848/1810 symbols completed. HFRO took 0.9s. Estimated remaining: 6m 12s. Rate: 155.2 symbols/min [2025-10-13T22:39:08.497326] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:08.696036] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:08.696947] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48421 primary records. [2025-10-13T22:39:08.697166] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-13T22:39:08.723864] [DEBUG] [LOCAL ] HGLB: Loaded 9724 existing records from primary storage. [2025-10-13T22:39:08.718802] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-13T22:39:08.724024] [INFO ] [MAIN ] HGLB: Loaded 9724 primary data records. [2025-10-13T22:39:08.729850] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-13T22:39:08.732456] [INFO ] [MAIN ] Derivative Progress: 849/1810 symbols completed. HESM took 1.4s. Estimated remaining: 6m 11s. Rate: 155.2 symbols/min [2025-10-13T22:39:08.749401] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:08.922257] [DEBUG] [LOCAL ] HGTY: Loaded 13154 existing records from primary storage. [2025-10-13T22:39:09.037960] [INFO ] [MAIN ] HGTY: Loaded 13154 primary data records. [2025-10-13T22:39:09.162041] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:09.169304] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 14728 primary records. [2025-10-13T22:39:09.169493] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-13T22:39:09.374986] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-13T22:39:09.375477] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-13T22:39:09.378067] [INFO ] [MAIN ] Derivative Progress: 850/1810 symbols completed. HGER took 1.1s. Estimated remaining: 6m 11s. Rate: 155.1 symbols/min [2025-10-13T22:39:09.378973] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:09.400740] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:39:09.402030] [INFO ] [MAIN ] HGLB: Generated 1793 derivative records from 9724 primary records. [2025-10-13T22:39:09.402353] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-13T22:39:09.418838] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1793 records). [2025-10-13T22:39:09.419007] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-13T22:39:09.421157] [INFO ] [MAIN ] Derivative Progress: 851/1810 symbols completed. HGLB took 0.9s. Estimated remaining: 6m 11s. Rate: 155.3 symbols/min [2025-10-13T22:39:09.421510] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:09.449901] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:09.450607] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13154 primary records. [2025-10-13T22:39:09.450795] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-13T22:39:09.478867] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-13T22:39:09.479124] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-13T22:39:09.489510] [INFO ] [MAIN ] Derivative Progress: 852/1810 symbols completed. HGTY took 0.7s. Estimated remaining: 6m 10s. Rate: 155.4 symbols/min [2025-10-13T22:39:09.489800] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:09.491096] [DEBUG] [LOCAL ] HGV: Loaded 46369 existing records from primary storage. [2025-10-13T22:39:09.491383] [INFO ] [MAIN ] HGV: Loaded 46369 primary data records. [2025-10-13T22:39:09.565749] [DEBUG] [LOCAL ] HHH: Loaded 33136 existing records from primary storage. [2025-10-13T22:39:09.582852] [INFO ] [MAIN ] HHH: Loaded 33136 primary data records. [2025-10-13T22:39:10.161074] [DEBUG] [LOCAL ] HI: Loaded 35572 existing records from primary storage. [2025-10-13T22:39:10.161527] [INFO ] [MAIN ] HI: Loaded 35572 primary data records. [2025-10-13T22:39:10.506139] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:10.506974] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46369 primary records. [2025-10-13T22:39:10.508098] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-13T22:39:10.527085] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-13T22:39:10.527192] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-13T22:39:10.529990] [INFO ] [MAIN ] Derivative Progress: 853/1810 symbols completed. HGV took 1.2s. Estimated remaining: 6m 10s. Rate: 155.1 symbols/min [2025-10-13T22:39:10.550512] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:10.552146] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 33136 primary records. [2025-10-13T22:39:10.552447] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-13T22:39:10.571253] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-13T22:39:10.571423] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-13T22:39:10.575055] [INFO ] [MAIN ] Derivative Progress: 854/1810 symbols completed. HHH took 1.2s. Estimated remaining: 6m 9s. Rate: 155.3 symbols/min [2025-10-13T22:39:10.590483] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:10.591136] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35572 primary records. [2025-10-13T22:39:10.591200] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-13T22:39:10.607215] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-13T22:39:10.607273] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-13T22:39:10.609919] [INFO ] [MAIN ] Derivative Progress: 855/1810 symbols completed. HI took 1.1s. Estimated remaining: 6m 9s. Rate: 155.4 symbols/min [2025-10-13T22:39:10.610445] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:10.610601] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:10.610375] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:10.671949] [DEBUG] [LOCAL ] HII: Loaded 33833 existing records from primary storage. [2025-10-13T22:39:10.672187] [INFO ] [MAIN ] HII: Loaded 33833 primary data records. [2025-10-13T22:39:10.772491] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-13T22:39:10.790729] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-13T22:39:10.871789] [DEBUG] [LOCAL ] HIG: Loaded 51154 existing records from primary storage. [2025-10-13T22:39:10.881166] [INFO ] [MAIN ] HIG: Loaded 51154 primary data records. [2025-10-13T22:39:11.693821] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:11.713796] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-13T22:39:11.726225] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-13T22:39:11.720130] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:11.737428] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51154 primary records. [2025-10-13T22:39:11.738078] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:11.743183] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-13T22:39:11.746626] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-13T22:39:11.748052] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 33833 primary records. [2025-10-13T22:39:11.748854] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-13T22:39:11.749496] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-13T22:39:11.759459] [INFO ] [MAIN ] Derivative Progress: 856/1810 symbols completed. HIMS took 1.1s. Estimated remaining: 6m 9s. Rate: 155.1 symbols/min [2025-10-13T22:39:11.765799] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:11.786282] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-13T22:39:11.787516] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-13T22:39:11.790060] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-13T22:39:11.793233] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-13T22:39:11.792957] [INFO ] [MAIN ] Derivative Progress: 857/1810 symbols completed. HIG took 1.2s. Estimated remaining: 6m 8s. Rate: 155.2 symbols/min [2025-10-13T22:39:11.795925] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:11.796458] [INFO ] [MAIN ] Derivative Progress: 858/1810 symbols completed. HII took 1.2s. Estimated remaining: 6m 8s. Rate: 155.4 symbols/min [2025-10-13T22:39:11.797275] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:11.822688] [DEBUG] [LOCAL ] HIO: Loaded 24076 existing records from primary storage. [2025-10-13T22:39:11.823042] [INFO ] [MAIN ] HIO: Loaded 24076 primary data records. [2025-10-13T22:39:11.930184] [DEBUG] [LOCAL ] HIPO: Loaded 21977 existing records from primary storage. [2025-10-13T22:39:11.934205] [INFO ] [MAIN ] HIPO: Loaded 21977 primary data records. [2025-10-13T22:39:12.313885] [DEBUG] [LOCAL ] HIW: Loaded 44556 existing records from primary storage. [2025-10-13T22:39:12.320055] [INFO ] [MAIN ] HIW: Loaded 44556 primary data records. [2025-10-13T22:39:12.891900] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:12.892986] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24076 primary records. [2025-10-13T22:39:12.893089] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-13T22:39:12.913118] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-13T22:39:12.915451] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-13T22:39:12.918504] [INFO ] [MAIN ] Derivative Progress: 859/1810 symbols completed. HIO took 1.2s. Estimated remaining: 6m 8s. Rate: 155.1 symbols/min [2025-10-13T22:39:12.918825] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:12.934500] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:12.936038] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21977 primary records. [2025-10-13T22:39:12.936336] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-13T22:39:12.967778] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:12.970588] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-13T22:39:12.971786] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44556 primary records. [2025-10-13T22:39:12.971913] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-13T22:39:12.978392] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-13T22:39:12.982520] [INFO ] [MAIN ] Derivative Progress: 860/1810 symbols completed. HIPO took 1.2s. Estimated remaining: 6m 7s. Rate: 155.2 symbols/min [2025-10-13T22:39:12.990104] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:13.006087] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-13T22:39:13.006349] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-13T22:39:13.002235] [DEBUG] [LOCAL ] HIX: Loaded 20501 existing records from primary storage. [2025-10-13T22:39:13.006919] [INFO ] [MAIN ] HIX: Loaded 20501 primary data records. [2025-10-13T22:39:13.009607] [INFO ] [MAIN ] Derivative Progress: 861/1810 symbols completed. HIW took 1.2s. Estimated remaining: 6m 6s. Rate: 155.4 symbols/min [2025-10-13T22:39:13.010230] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:13.179603] [DEBUG] [LOCAL ] HKD: Loaded 18625 existing records from primary storage. [2025-10-13T22:39:13.190723] [INFO ] [MAIN ] HKD: Loaded 18625 primary data records. [2025-10-13T22:39:13.499193] [DEBUG] [LOCAL ] HL: Loaded 53672 existing records from primary storage. [2025-10-13T22:39:13.525596] [INFO ] [MAIN ] HL: Loaded 53672 primary data records. [2025-10-13T22:39:14.076481] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:14.078691] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20501 primary records. [2025-10-13T22:39:14.079200] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-13T22:39:14.119326] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:14.121769] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18625 primary records. [2025-10-13T22:39:14.122280] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-13T22:39:14.122779] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-13T22:39:14.124928] [INFO ] [MAIN ] Derivative Progress: 862/1810 symbols completed. HIX took 1.2s. Estimated remaining: 6m 7s. Rate: 155.0 symbols/min [2025-10-13T22:39:14.122687] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-13T22:39:14.125186] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:14.148179] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-13T22:39:14.148472] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-13T22:39:14.151261] [INFO ] [MAIN ] Derivative Progress: 863/1810 symbols completed. HKD took 1.2s. Estimated remaining: 6m 6s. Rate: 155.2 symbols/min [2025-10-13T22:39:14.151395] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:14.167829] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:14.168818] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53672 primary records. [2025-10-13T22:39:14.169000] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-13T22:39:14.188469] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-13T22:39:14.188747] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-13T22:39:14.191422] [INFO ] [MAIN ] Derivative Progress: 864/1810 symbols completed. HL took 1.2s. Estimated remaining: 6m 5s. Rate: 155.4 symbols/min [2025-10-13T22:39:14.191831] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:14.230033] [DEBUG] [LOCAL ] HLF: Loaded 48470 existing records from primary storage. [2025-10-13T22:39:14.238712] [INFO ] [MAIN ] HLF: Loaded 48470 primary data records. [2025-10-13T22:39:14.240376] [DEBUG] [LOCAL ] HLI: Loaded 30937 existing records from primary storage. [2025-10-13T22:39:14.261320] [INFO ] [MAIN ] HLI: Loaded 30937 primary data records. [2025-10-13T22:39:14.505970] [DEBUG] [LOCAL ] HLIO: Loaded 28073 existing records from primary storage. [2025-10-13T22:39:14.537840] [INFO ] [MAIN ] HLIO: Loaded 28073 primary data records. [2025-10-13T22:39:15.255702] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:15.256872] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30937 primary records. [2025-10-13T22:39:15.257196] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-13T22:39:15.271104] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:15.279088] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48470 primary records. [2025-10-13T22:39:15.283262] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-13T22:39:15.302261] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-13T22:39:15.314315] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-13T22:39:15.304810] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-13T22:39:15.321446] [INFO ] [MAIN ] Derivative Progress: 865/1810 symbols completed. HLI took 1.2s. Estimated remaining: 6m 6s. Rate: 155.0 symbols/min [2025-10-13T22:39:15.319315] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-13T22:39:15.321902] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:15.325043] [INFO ] [MAIN ] Derivative Progress: 866/1810 symbols completed. HLF took 1.2s. Estimated remaining: 6m 5s. Rate: 155.2 symbols/min [2025-10-13T22:39:15.322475] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:15.326278] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28073 primary records. [2025-10-13T22:39:15.326400] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-13T22:39:15.327427] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:15.346596] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-13T22:39:15.346890] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-13T22:39:15.349805] [INFO ] [MAIN ] Derivative Progress: 867/1810 symbols completed. HLIO took 1.2s. Estimated remaining: 6m 4s. Rate: 155.4 symbols/min [2025-10-13T22:39:15.350045] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:15.376386] [DEBUG] [LOCAL ] HLLY: Loaded 33620 existing records from primary storage. [2025-10-13T22:39:15.376528] [INFO ] [MAIN ] HLLY: Loaded 33620 primary data records. [2025-10-13T22:39:15.713253] [DEBUG] [LOCAL ] HLN: Loaded 53113 existing records from primary storage. [2025-10-13T22:39:15.714706] [INFO ] [MAIN ] HLN: Loaded 53113 primary data records. [2025-10-13T22:39:15.787979] [DEBUG] [LOCAL ] HLT: Loaded 50609 existing records from primary storage. [2025-10-13T22:39:15.809632] [INFO ] [MAIN ] HLT: Loaded 50609 primary data records. [2025-10-13T22:39:16.397977] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:16.400116] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33620 primary records. [2025-10-13T22:39:16.400819] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-13T22:39:16.420347] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-13T22:39:16.421724] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-13T22:39:16.424827] [INFO ] [MAIN ] Derivative Progress: 868/1810 symbols completed. HLLY took 1.1s. Estimated remaining: 6m 5s. Rate: 155.1 symbols/min [2025-10-13T22:39:16.447327] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:16.450106] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50609 primary records. [2025-10-13T22:39:16.450925] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-13T22:39:16.477811] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:16.479524] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53113 primary records. [2025-10-13T22:39:16.479864] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-13T22:39:16.481896] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-13T22:39:16.482270] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-13T22:39:16.485699] [INFO ] [MAIN ] Derivative Progress: 869/1810 symbols completed. HLT took 1.1s. Estimated remaining: 6m 4s. Rate: 155.2 symbols/min [2025-10-13T22:39:16.501275] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-13T22:39:16.501407] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-13T22:39:16.503548] [INFO ] [MAIN ] Derivative Progress: 870/1810 symbols completed. HLN took 1.2s. Estimated remaining: 6m 3s. Rate: 155.4 symbols/min [2025-10-13T22:39:16.504109] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:16.504002] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:16.505012] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:16.528617] [DEBUG] [LOCAL ] HMN: Loaded 23424 existing records from primary storage. [2025-10-13T22:39:16.528838] [INFO ] [MAIN ] HMN: Loaded 23424 primary data records. [2025-10-13T22:39:16.678100] [DEBUG] [LOCAL ] HMC: Loaded 46553 existing records from primary storage. [2025-10-13T22:39:16.690431] [INFO ] [MAIN ] HMC: Loaded 46553 primary data records. [2025-10-13T22:39:16.953829] [DEBUG] [LOCAL ] HMY: Loaded 53167 existing records from primary storage. [2025-10-13T22:39:16.990265] [INFO ] [MAIN ] HMY: Loaded 53167 primary data records. [2025-10-13T22:39:17.554160] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:17.555777] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23424 primary records. [2025-10-13T22:39:17.556164] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-13T22:39:17.575755] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-13T22:39:17.590071] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-13T22:39:17.590355] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:17.593716] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46553 primary records. [2025-10-13T22:39:17.593974] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-13T22:39:17.592921] [INFO ] [MAIN ] Derivative Progress: 871/1810 symbols completed. HMN took 1.1s. Estimated remaining: 6m 3s. Rate: 155.1 symbols/min [2025-10-13T22:39:17.595196] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:17.610569] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-13T22:39:17.610939] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-13T22:39:17.613175] [INFO ] [MAIN ] Derivative Progress: 872/1810 symbols completed. HMC took 1.1s. Estimated remaining: 6m 3s. Rate: 155.2 symbols/min [2025-10-13T22:39:17.613485] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:17.631409] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:17.632197] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53167 primary records. [2025-10-13T22:39:17.632303] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-13T22:39:17.656843] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-13T22:39:17.656992] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-13T22:39:17.659535] [INFO ] [MAIN ] Derivative Progress: 873/1810 symbols completed. HMY took 1.2s. Estimated remaining: 6m 2s. Rate: 155.4 symbols/min [2025-10-13T22:39:17.659778] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:17.670115] [DEBUG] [LOCAL ] HNI: Loaded 29427 existing records from primary storage. [2025-10-13T22:39:17.670250] [INFO ] [MAIN ] HNI: Loaded 29427 primary data records. [2025-10-13T22:39:17.842288] [DEBUG] [LOCAL ] HOG: Loaded 50870 existing records from primary storage. [2025-10-13T22:39:17.876436] [INFO ] [MAIN ] HOG: Loaded 50870 primary data records. [2025-10-13T22:39:18.128254] [DEBUG] [LOCAL ] HOMB: Loaded 43542 existing records from primary storage. [2025-10-13T22:39:18.134485] [INFO ] [MAIN ] HOMB: Loaded 43542 primary data records. [2025-10-13T22:39:18.694215] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:18.696008] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29427 primary records. [2025-10-13T22:39:18.696477] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-13T22:39:18.714048] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-13T22:39:18.714191] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-13T22:39:18.716317] [INFO ] [MAIN ] Derivative Progress: 874/1810 symbols completed. HNI took 1.1s. Estimated remaining: 6m 2s. Rate: 155.1 symbols/min [2025-10-13T22:39:18.716604] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:18.736713] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:18.737588] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 50870 primary records. [2025-10-13T22:39:18.737722] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-13T22:39:18.754086] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-13T22:39:18.754384] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-13T22:39:18.757200] [INFO ] [MAIN ] Derivative Progress: 875/1810 symbols completed. HOG took 1.1s. Estimated remaining: 6m 1s. Rate: 155.2 symbols/min [2025-10-13T22:39:18.757518] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:18.788822] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:18.789781] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43542 primary records. [2025-10-13T22:39:18.789938] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-13T22:39:18.810204] [DEBUG] [LOCAL ] HOV: Loaded 13969 existing records from primary storage. [2025-10-13T22:39:18.826628] [INFO ] [MAIN ] HOV: Loaded 13969 primary data records. [2025-10-13T22:39:18.829576] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-13T22:39:18.852857] [DEBUG] [LOCAL ] HOUS: Loaded 45081 existing records from primary storage. [2025-10-13T22:39:18.841192] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-13T22:39:18.874845] [INFO ] [MAIN ] HOUS: Loaded 45081 primary data records. [2025-10-13T22:39:18.874741] [INFO ] [MAIN ] Derivative Progress: 876/1810 symbols completed. HOMB took 1.2s. Estimated remaining: 6m 1s. Rate: 155.4 symbols/min [2025-10-13T22:39:18.906598] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:19.483728] [DEBUG] [LOCAL ] HP: Loaded 51538 existing records from primary storage. [2025-10-13T22:39:19.484375] [INFO ] [MAIN ] HP: Loaded 51538 primary data records. [2025-10-13T22:39:19.702426] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:19.819208] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:19.818838] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 45081 primary records. [2025-10-13T22:39:19.828172] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-13T22:39:19.829090] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13969 primary records. [2025-10-13T22:39:19.829336] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-13T22:39:19.858387] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-13T22:39:19.863382] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-13T22:39:19.859270] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-13T22:39:19.865562] [INFO ] [MAIN ] Derivative Progress: 877/1810 symbols completed. HOUS took 1.1s. Estimated remaining: 6m 1s. Rate: 155.1 symbols/min [2025-10-13T22:39:19.866184] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:19.866096] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-13T22:39:19.869147] [INFO ] [MAIN ] Derivative Progress: 878/1810 symbols completed. HOV took 1.1s. Estimated remaining: 6m 0s. Rate: 155.3 symbols/min [2025-10-13T22:39:19.869497] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:19.883030] [DEBUG] [LOCAL ] HPF: Loaded 7500 existing records from primary storage. [2025-10-13T22:39:19.883353] [INFO ] [MAIN ] HPF: Loaded 7500 primary data records. [2025-10-13T22:39:20.022483] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:20.028878] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51538 primary records. [2025-10-13T22:39:20.077467] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-13T22:39:20.335103] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-13T22:39:20.336323] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-13T22:39:20.371431] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-13T22:39:20.376992] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-13T22:39:20.399811] [INFO ] [MAIN ] Derivative Progress: 879/1810 symbols completed. HP took 1.5s. Estimated remaining: 5m 60s. Rate: 155.2 symbols/min [2025-10-13T22:39:20.408955] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:20.650543] [DEBUG] [LOCAL ] HPI: Loaded 10635 existing records from primary storage. [2025-10-13T22:39:20.651040] [INFO ] [MAIN ] HPI: Loaded 10635 primary data records. [2025-10-13T22:39:20.789208] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:20.827928] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7500 primary records. [2025-10-13T22:39:20.855324] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-13T22:39:21.012197] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-13T22:39:21.012983] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-13T22:39:21.015219] [INFO ] [MAIN ] Derivative Progress: 880/1810 symbols completed. HPF took 1.1s. Estimated remaining: 5m 60s. Rate: 155.1 symbols/min [2025-10-13T22:39:21.015514] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:21.036631] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:21.037398] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-13T22:39:21.037727] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-13T22:39:21.055767] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-13T22:39:21.056102] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-13T22:39:21.058517] [INFO ] [MAIN ] Derivative Progress: 881/1810 symbols completed. HPE took 1.2s. Estimated remaining: 5m 59s. Rate: 155.2 symbols/min [2025-10-13T22:39:21.058691] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:21.102331] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:21.119280] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10635 primary records. [2025-10-13T22:39:21.119545] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-13T22:39:21.121614] [DEBUG] [LOCAL ] HPP: Loaded 51145 existing records from primary storage. [2025-10-13T22:39:21.131780] [INFO ] [MAIN ] HPP: Loaded 51145 primary data records. [2025-10-13T22:39:21.179570] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-13T22:39:21.184941] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-13T22:39:21.187785] [INFO ] [MAIN ] Derivative Progress: 882/1810 symbols completed. HPI took 0.8s. Estimated remaining: 5m 58s. Rate: 155.4 symbols/min [2025-10-13T22:39:21.187940] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:21.385892] [DEBUG] [LOCAL ] HPS: Loaded 10321 existing records from primary storage. [2025-10-13T22:39:21.411073] [INFO ] [MAIN ] HPS: Loaded 10321 primary data records. [2025-10-13T22:39:21.343445] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-13T22:39:21.411246] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-10-13T22:39:22.302222] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:22.303671] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51145 primary records. [2025-10-13T22:39:22.303868] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-13T22:39:22.323237] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-13T22:39:22.323442] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-13T22:39:22.325748] [INFO ] [MAIN ] Derivative Progress: 883/1810 symbols completed. HPP took 1.3s. Estimated remaining: 5m 59s. Rate: 155.0 symbols/min [2025-10-13T22:39:22.345047] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:22.346184] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10321 primary records. [2025-10-13T22:39:22.346405] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-13T22:39:22.363760] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-13T22:39:22.363880] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-13T22:39:22.366421] [INFO ] [MAIN ] Derivative Progress: 884/1810 symbols completed. HPS took 1.2s. Estimated remaining: 5m 58s. Rate: 155.2 symbols/min [2025-10-13T22:39:22.388597] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:22.389706] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-10-13T22:39:22.389815] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-13T22:39:22.411427] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-13T22:39:22.411520] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-13T22:39:22.415238] [INFO ] [MAIN ] Derivative Progress: 885/1810 symbols completed. HPQ took 1.4s. Estimated remaining: 5m 57s. Rate: 155.3 symbols/min [2025-10-13T22:39:22.415767] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:22.416404] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:22.416180] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:22.443752] [DEBUG] [LOCAL ] HQL: Loaded 16787 existing records from primary storage. [2025-10-13T22:39:22.443900] [INFO ] [MAIN ] HQL: Loaded 16787 primary data records. [2025-10-13T22:39:22.523433] [DEBUG] [LOCAL ] HQH: Loaded 25666 existing records from primary storage. [2025-10-13T22:39:22.536037] [INFO ] [MAIN ] HQH: Loaded 25666 primary data records. [2025-10-13T22:39:22.901526] [DEBUG] [LOCAL ] HR: Loaded 52098 existing records from primary storage. [2025-10-13T22:39:22.901850] [INFO ] [MAIN ] HR: Loaded 52098 primary data records. [2025-10-13T22:39:23.536593] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:23.538556] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16787 primary records. [2025-10-13T22:39:23.539559] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-13T22:39:23.566630] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-13T22:39:23.567589] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-13T22:39:23.570737] [INFO ] [MAIN ] Derivative Progress: 886/1810 symbols completed. HQL took 1.2s. Estimated remaining: 5m 58s. Rate: 155.0 symbols/min [2025-10-13T22:39:23.573503] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:23.593208] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:23.594318] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25666 primary records. [2025-10-13T22:39:23.594712] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-13T22:39:23.625208] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-13T22:39:23.625378] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-13T22:39:23.630446] [INFO ] [MAIN ] Derivative Progress: 887/1810 symbols completed. HQH took 1.2s. Estimated remaining: 5m 57s. Rate: 155.1 symbols/min [2025-10-13T22:39:23.633048] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:23.654922] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:23.656526] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 52098 primary records. [2025-10-13T22:39:23.656891] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-13T22:39:23.692951] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-13T22:39:23.693374] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-13T22:39:23.696878] [INFO ] [MAIN ] Derivative Progress: 888/1810 symbols completed. HR took 1.3s. Estimated remaining: 5m 56s. Rate: 155.3 symbols/min [2025-10-13T22:39:23.697301] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:23.731726] [DEBUG] [LOCAL ] HRB: Loaded 48339 existing records from primary storage. [2025-10-13T22:39:23.732158] [INFO ] [MAIN ] HRB: Loaded 48339 primary data records. [2025-10-13T22:39:23.848063] [DEBUG] [LOCAL ] HRI: Loaded 32515 existing records from primary storage. [2025-10-13T22:39:23.848328] [INFO ] [MAIN ] HRI: Loaded 32515 primary data records. [2025-10-13T22:39:24.391794] [DEBUG] [LOCAL ] HRL: Loaded 53111 existing records from primary storage. [2025-10-13T22:39:24.512818] [INFO ] [MAIN ] HRL: Loaded 53111 primary data records. [2025-10-13T22:39:24.916249] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:24.911012] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:24.917152] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48339 primary records. [2025-10-13T22:39:24.918013] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32515 primary records. [2025-10-13T22:39:24.918169] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-13T22:39:24.918460] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-13T22:39:24.951459] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-13T22:39:24.951598] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-13T22:39:24.951762] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-13T22:39:24.954373] [INFO ] [MAIN ] Derivative Progress: 889/1810 symbols completed. HRI took 1.3s. Estimated remaining: 5m 57s. Rate: 154.9 symbols/min [2025-10-13T22:39:24.954489] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-13T22:39:24.954603] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:24.956979] [INFO ] [MAIN ] Derivative Progress: 890/1810 symbols completed. HRB took 1.4s. Estimated remaining: 5m 56s. Rate: 155.0 symbols/min [2025-10-13T22:39:24.959560] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:24.974729] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:24.975383] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53111 primary records. [2025-10-13T22:39:24.975443] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-13T22:39:24.993272] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-13T22:39:24.993459] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-13T22:39:24.996033] [INFO ] [MAIN ] Derivative Progress: 891/1810 symbols completed. HRL took 1.3s. Estimated remaining: 5m 55s. Rate: 155.2 symbols/min [2025-10-13T22:39:24.996345] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:25.042917] [DEBUG] [LOCAL ] HSHP: Loaded 14975 existing records from primary storage. [2025-10-13T22:39:25.043789] [INFO ] [MAIN ] HSHP: Loaded 14975 primary data records. [2025-10-13T22:39:25.043685] [DEBUG] [LOCAL ] HRTG: Loaded 34109 existing records from primary storage. [2025-10-13T22:39:25.055589] [INFO ] [MAIN ] HRTG: Loaded 34109 primary data records. [2025-10-13T22:39:25.252448] [DEBUG] [LOCAL ] HSBC: Loaded 50994 existing records from primary storage. [2025-10-13T22:39:25.268972] [INFO ] [MAIN ] HSBC: Loaded 50994 primary data records. [2025-10-13T22:39:25.994346] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:25.996634] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 14975 primary records. [2025-10-13T22:39:25.996764] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-13T22:39:26.024725] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-13T22:39:26.024975] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-13T22:39:26.032304] [INFO ] [MAIN ] Derivative Progress: 892/1810 symbols completed. HSHP took 1.0s. Estimated remaining: 5m 56s. Rate: 154.9 symbols/min [2025-10-13T22:39:26.032827] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:26.041211] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:26.046947] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:26.048671] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 34109 primary records. [2025-10-13T22:39:26.048895] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-13T22:39:26.049480] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50994 primary records. [2025-10-13T22:39:26.049628] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-13T22:39:26.078397] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-13T22:39:26.078532] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-13T22:39:26.080746] [INFO ] [MAIN ] Derivative Progress: 893/1810 symbols completed. HRTG took 1.1s. Estimated remaining: 5m 55s. Rate: 155.1 symbols/min [2025-10-13T22:39:26.080899] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:26.085038] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-13T22:39:26.085216] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-13T22:39:26.087906] [INFO ] [MAIN ] Derivative Progress: 894/1810 symbols completed. HSBC took 1.1s. Estimated remaining: 5m 54s. Rate: 155.2 symbols/min [2025-10-13T22:39:26.088461] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:26.119438] [DEBUG] [LOCAL ] HTD: Loaded 14053 existing records from primary storage. [2025-10-13T22:39:26.120150] [INFO ] [MAIN ] HTD: Loaded 14053 primary data records. [2025-10-13T22:39:26.258277] [DEBUG] [LOCAL ] HSY: Loaded 50382 existing records from primary storage. [2025-10-13T22:39:26.269900] [INFO ] [MAIN ] HSY: Loaded 50382 primary data records. [2025-10-13T22:39:26.417497] [DEBUG] [LOCAL ] HTGC: Loaded 47669 existing records from primary storage. [2025-10-13T22:39:26.561123] [INFO ] [MAIN ] HTGC: Loaded 47669 primary data records. [2025-10-13T22:39:27.184795] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:27.186560] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 14053 primary records. [2025-10-13T22:39:27.187246] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-13T22:39:27.221914] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:27.223547] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50382 primary records. [2025-10-13T22:39:27.222801] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-13T22:39:27.223817] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-13T22:39:27.224321] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-13T22:39:27.227312] [INFO ] [MAIN ] Derivative Progress: 895/1810 symbols completed. HTD took 1.1s. Estimated remaining: 5m 54s. Rate: 154.9 symbols/min [2025-10-13T22:39:27.227499] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:27.247385] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-13T22:39:27.247739] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-13T22:39:27.250420] [INFO ] [MAIN ] Derivative Progress: 896/1810 symbols completed. HSY took 1.2s. Estimated remaining: 5m 54s. Rate: 155.1 symbols/min [2025-10-13T22:39:27.266567] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:27.267341] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:27.268977] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47669 primary records. [2025-10-13T22:39:27.269113] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-13T22:39:27.285991] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-13T22:39:27.296165] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-13T22:39:27.298756] [INFO ] [MAIN ] Derivative Progress: 897/1810 symbols completed. HTGC took 1.2s. Estimated remaining: 5m 53s. Rate: 155.2 symbols/min [2025-10-13T22:39:27.299027] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:27.314320] [DEBUG] [LOCAL ] HTH: Loaded 32523 existing records from primary storage. [2025-10-13T22:39:27.314572] [INFO ] [MAIN ] HTH: Loaded 32523 primary data records. [2025-10-13T22:39:27.491818] [DEBUG] [LOCAL ] HUBB: Loaded 36459 existing records from primary storage. [2025-10-13T22:39:27.505207] [INFO ] [MAIN ] HUBB: Loaded 36459 primary data records. [2025-10-13T22:39:27.812429] [DEBUG] [LOCAL ] HUBS: Loaded 39971 existing records from primary storage. [2025-10-13T22:39:27.829706] [INFO ] [MAIN ] HUBS: Loaded 39971 primary data records. [2025-10-13T22:39:28.280037] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:28.281245] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32523 primary records. [2025-10-13T22:39:28.281415] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-13T22:39:28.300675] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-13T22:39:28.300882] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-13T22:39:28.306269] [INFO ] [MAIN ] Derivative Progress: 898/1810 symbols completed. HTH took 1.1s. Estimated remaining: 5m 53s. Rate: 154.9 symbols/min [2025-10-13T22:39:28.321554] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:28.322744] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36459 primary records. [2025-10-13T22:39:28.322971] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-13T22:39:28.342413] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-13T22:39:28.342594] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-13T22:39:28.344898] [INFO ] [MAIN ] Derivative Progress: 899/1810 symbols completed. HUBB took 1.1s. Estimated remaining: 5m 52s. Rate: 155.1 symbols/min [2025-10-13T22:39:28.357305] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:28.357986] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39971 primary records. [2025-10-13T22:39:28.358048] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-13T22:39:28.373658] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-13T22:39:28.373729] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-13T22:39:28.376500] [INFO ] [MAIN ] Derivative Progress: 900/1810 symbols completed. HUBS took 1.1s. Estimated remaining: 5m 52s. Rate: 155.2 symbols/min [2025-10-13T22:39:28.377241] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:28.377402] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:28.377962] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:28.396562] [DEBUG] [LOCAL ] HVT: Loaded 15205 existing records from primary storage. [2025-10-13T22:39:28.396805] [INFO ] [MAIN ] HVT: Loaded 15205 primary data records. [2025-10-13T22:39:28.744308] [DEBUG] [LOCAL ] HUN: Loaded 53215 existing records from primary storage. [2025-10-13T22:39:28.779617] [INFO ] [MAIN ] HUN: Loaded 53215 primary data records. [2025-10-13T22:39:28.797260] [DEBUG] [LOCAL ] HUYA: Loaded 43863 existing records from primary storage. [2025-10-13T22:39:28.817126] [INFO ] [MAIN ] HUYA: Loaded 43863 primary data records. [2025-10-13T22:39:29.439714] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:29.442515] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15205 primary records. [2025-10-13T22:39:29.443460] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-13T22:39:29.461975] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-13T22:39:29.462704] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-13T22:39:29.465711] [INFO ] [MAIN ] Derivative Progress: 901/1810 symbols completed. HVT took 1.1s. Estimated remaining: 5m 52s. Rate: 154.9 symbols/min [2025-10-13T22:39:29.466175] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:29.485132] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:29.488048] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53215 primary records. [2025-10-13T22:39:29.501467] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:29.502169] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43863 primary records. [2025-10-13T22:39:29.502242] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-13T22:39:29.501202] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-13T22:39:29.531818] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-13T22:39:29.532565] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-13T22:39:29.537391] [INFO ] [MAIN ] Derivative Progress: 902/1810 symbols completed. HUYA took 1.2s. Estimated remaining: 5m 51s. Rate: 155.1 symbols/min [2025-10-13T22:39:29.538243] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:29.539805] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-13T22:39:29.539915] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-13T22:39:29.542610] [INFO ] [MAIN ] Derivative Progress: 903/1810 symbols completed. HUN took 1.2s. Estimated remaining: 5m 51s. Rate: 155.2 symbols/min [2025-10-13T22:39:29.542973] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:29.569042] [DEBUG] [LOCAL ] HY: Loaded 10021 existing records from primary storage. [2025-10-13T22:39:29.569280] [INFO ] [MAIN ] HY: Loaded 10021 primary data records. [2025-10-13T22:39:29.681022] [DEBUG] [LOCAL ] HWM: Loaded 52832 existing records from primary storage. [2025-10-13T22:39:29.691553] [INFO ] [MAIN ] HWM: Loaded 52832 primary data records. [2025-10-13T22:39:29.826964] [DEBUG] [LOCAL ] HXL: Loaded 45906 existing records from primary storage. [2025-10-13T22:39:29.866577] [INFO ] [MAIN ] HXL: Loaded 45906 primary data records. [2025-10-13T22:39:30.545627] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:30.548281] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10021 primary records. [2025-10-13T22:39:30.548390] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-13T22:39:30.577531] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:30.579196] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52832 primary records. [2025-10-13T22:39:30.579590] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-13T22:39:30.584047] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-13T22:39:30.595720] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-13T22:39:30.598131] [INFO ] [MAIN ] Derivative Progress: 904/1810 symbols completed. HY took 1.1s. Estimated remaining: 5m 51s. Rate: 154.9 symbols/min [2025-10-13T22:39:30.599570] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:30.620801] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:30.622193] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-13T22:39:30.622117] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45906 primary records. [2025-10-13T22:39:30.624413] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-13T22:39:30.622298] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-13T22:39:30.628466] [INFO ] [MAIN ] Derivative Progress: 905/1810 symbols completed. HWM took 1.2s. Estimated remaining: 5m 50s. Rate: 155.1 symbols/min [2025-10-13T22:39:30.640043] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:30.655921] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-13T22:39:30.653153] [DEBUG] [LOCAL ] HYI: Loaded 9920 existing records from primary storage. [2025-10-13T22:39:30.656150] [INFO ] [MAIN ] HYI: Loaded 9920 primary data records. [2025-10-13T22:39:30.656535] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-13T22:39:30.671617] [INFO ] [MAIN ] Derivative Progress: 906/1810 symbols completed. HXL took 1.1s. Estimated remaining: 5m 49s. Rate: 155.3 symbols/min [2025-10-13T22:39:30.705967] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:30.794790] [DEBUG] [LOCAL ] HYTR: Loaded 3131 existing records from primary storage. [2025-10-13T22:39:30.819686] [INFO ] [MAIN ] HYTR: Loaded 3131 primary data records. [2025-10-13T22:39:31.133851] [DEBUG] [LOCAL ] HYT: Loaded 33656 existing records from primary storage. [2025-10-13T22:39:31.142043] [INFO ] [MAIN ] HYT: Loaded 33656 primary data records. [2025-10-13T22:39:31.689159] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:31.690191] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9920 primary records. [2025-10-13T22:39:31.690479] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-13T22:39:31.712668] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-13T22:39:31.712998] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-13T22:39:31.715363] [INFO ] [MAIN ] Derivative Progress: 907/1810 symbols completed. HYI took 1.1s. Estimated remaining: 5m 50s. Rate: 155.0 symbols/min [2025-10-13T22:39:31.715708] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:31.730208] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:39:31.731375] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3131 primary records. [2025-10-13T22:39:31.731560] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-13T22:39:31.750385] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-13T22:39:31.750711] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-13T22:39:31.753241] [INFO ] [MAIN ] Derivative Progress: 908/1810 symbols completed. HYTR took 1.0s. Estimated remaining: 5m 49s. Rate: 155.1 symbols/min [2025-10-13T22:39:31.761889] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:31.776140] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:31.777049] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33656 primary records. [2025-10-13T22:39:31.777300] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-13T22:39:31.808179] [DEBUG] [LOCAL ] HZO: Loaded 29044 existing records from primary storage. [2025-10-13T22:39:31.808779] [INFO ] [MAIN ] HZO: Loaded 29044 primary data records. [2025-10-13T22:39:31.806750] [DEBUG] [LOCAL ] IAE: Loaded 6226 existing records from primary storage. [2025-10-13T22:39:31.809151] [INFO ] [MAIN ] IAE: Loaded 6226 primary data records. [2025-10-13T22:39:31.864367] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-13T22:39:31.874805] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-13T22:39:31.884600] [INFO ] [MAIN ] Derivative Progress: 909/1810 symbols completed. HYT took 1.2s. Estimated remaining: 5m 48s. Rate: 155.2 symbols/min [2025-10-13T22:39:31.978849] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:32.498899] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:32.501025] [DEBUG] [LOCAL ] IAG: Loaded 53486 existing records from primary storage. [2025-10-13T22:39:32.501166] [INFO ] [MAIN ] IAG: Loaded 53486 primary data records. [2025-10-13T22:39:32.499745] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6226 primary records. [2025-10-13T22:39:32.501410] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-13T22:39:32.593137] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-13T22:39:32.614303] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-13T22:39:32.628594] [INFO ] [MAIN ] Derivative Progress: 910/1810 symbols completed. IAE took 0.9s. Estimated remaining: 5m 48s. Rate: 155.1 symbols/min [2025-10-13T22:39:32.656469] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:32.657349] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:32.689249] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29044 primary records. [2025-10-13T22:39:32.744268] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-13T22:39:32.934448] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-13T22:39:32.935056] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-13T22:39:32.938416] [INFO ] [MAIN ] Derivative Progress: 911/1810 symbols completed. HZO took 1.2s. Estimated remaining: 5m 48s. Rate: 155.1 symbols/min [2025-10-13T22:39:32.939048] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:32.978162] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:32.979008] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53486 primary records. [2025-10-13T22:39:32.979187] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-13T22:39:32.996808] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-13T22:39:32.997101] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-13T22:39:32.999448] [INFO ] [MAIN ] Derivative Progress: 912/1810 symbols completed. IAG took 1.0s. Estimated remaining: 5m 47s. Rate: 155.3 symbols/min [2025-10-13T22:39:33.015128] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:33.029399] [DEBUG] [LOCAL ] IBM: Loaded 53633 existing records from primary storage. [2025-10-13T22:39:33.029562] [INFO ] [MAIN ] IBM: Loaded 53633 primary data records. [2025-10-13T22:39:33.147206] [DEBUG] [LOCAL ] IBN: Loaded 52832 existing records from primary storage. [2025-10-13T22:39:33.196205] [INFO ] [MAIN ] IBN: Loaded 52832 primary data records. [2025-10-13T22:39:33.489720] [DEBUG] [LOCAL ] IBP: Loaded 28889 existing records from primary storage. [2025-10-13T22:39:33.511585] [INFO ] [MAIN ] IBP: Loaded 28889 primary data records. [2025-10-13T22:39:34.056172] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:34.058824] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53633 primary records. [2025-10-13T22:39:34.059121] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-13T22:39:34.079430] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-13T22:39:34.079891] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-13T22:39:34.082555] [INFO ] [MAIN ] Derivative Progress: 913/1810 symbols completed. IBM took 1.4s. Estimated remaining: 5m 47s. Rate: 155.0 symbols/min [2025-10-13T22:39:34.096623] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:34.097356] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52832 primary records. [2025-10-13T22:39:34.097436] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-13T22:39:34.117508] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-13T22:39:34.117955] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-13T22:39:34.121699] [INFO ] [MAIN ] Derivative Progress: 914/1810 symbols completed. IBN took 1.2s. Estimated remaining: 5m 47s. Rate: 155.1 symbols/min [2025-10-13T22:39:34.134822] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:34.135435] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28889 primary records. [2025-10-13T22:39:34.135494] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-13T22:39:34.151211] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-13T22:39:34.151270] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-13T22:39:34.154037] [INFO ] [MAIN ] Derivative Progress: 915/1810 symbols completed. IBP took 1.1s. Estimated remaining: 5m 46s. Rate: 155.3 symbols/min [2025-10-13T22:39:34.154454] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:34.154555] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:34.154673] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:34.222301] [DEBUG] [LOCAL ] ICL: Loaded 38494 existing records from primary storage. [2025-10-13T22:39:34.223292] [INFO ] [MAIN ] ICL: Loaded 38494 primary data records. [2025-10-13T22:39:34.223178] [DEBUG] [LOCAL ] IBTA: Loaded 36817 existing records from primary storage. [2025-10-13T22:39:34.223614] [INFO ] [MAIN ] IBTA: Loaded 36817 primary data records. [2025-10-13T22:39:34.479359] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-13T22:39:34.518910] [INFO ] [MAIN ] ICE: Loaded 53011 primary data records. [2025-10-13T22:39:35.276291] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:35.277372] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38494 primary records. [2025-10-13T22:39:35.277556] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-13T22:39:35.301841] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:35.303398] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 36817 primary records. [2025-10-13T22:39:35.304898] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-13T22:39:35.321441] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-13T22:39:35.323506] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-13T22:39:35.340036] [INFO ] [MAIN ] Derivative Progress: 916/1810 symbols completed. ICL took 1.2s. Estimated remaining: 5m 46s. Rate: 154.9 symbols/min [2025-10-13T22:39:35.340818] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:35.342190] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:35.344053] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53011 primary records. [2025-10-13T22:39:35.344817] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-13T22:39:35.360935] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-13T22:39:35.365963] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-13T22:39:35.364926] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-13T22:39:35.366260] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-13T22:39:35.368947] [INFO ] [MAIN ] Derivative Progress: 917/1810 symbols completed. IBTA took 1.2s. Estimated remaining: 5m 46s. Rate: 155.1 symbols/min [2025-10-13T22:39:35.369114] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:35.372747] [INFO ] [MAIN ] Derivative Progress: 918/1810 symbols completed. ICE took 1.2s. Estimated remaining: 5m 45s. Rate: 155.2 symbols/min [2025-10-13T22:39:35.373227] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:35.394019] [DEBUG] [LOCAL ] IDE: Loaded 9063 existing records from primary storage. [2025-10-13T22:39:35.394285] [INFO ] [MAIN ] IDE: Loaded 9063 primary data records. [2025-10-13T22:39:35.530053] [DEBUG] [LOCAL ] IDT: Loaded 18345 existing records from primary storage. [2025-10-13T22:39:35.536726] [DEBUG] [LOCAL ] IDA: Loaded 32732 existing records from primary storage. [2025-10-13T22:39:35.536910] [INFO ] [MAIN ] IDA: Loaded 32732 primary data records. [2025-10-13T22:39:35.536839] [INFO ] [MAIN ] IDT: Loaded 18345 primary data records. [2025-10-13T22:39:36.368324] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:36.370169] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 9063 primary records. [2025-10-13T22:39:36.370981] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-13T22:39:36.405063] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-13T22:39:36.405609] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-13T22:39:36.408165] [INFO ] [MAIN ] Derivative Progress: 919/1810 symbols completed. IDE took 1.0s. Estimated remaining: 5m 45s. Rate: 154.9 symbols/min [2025-10-13T22:39:36.406102] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:36.408402] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:36.409781] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18345 primary records. [2025-10-13T22:39:36.418459] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-13T22:39:36.424217] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:36.437777] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32732 primary records. [2025-10-13T22:39:36.437921] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-13T22:39:36.441924] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-13T22:39:36.442162] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-13T22:39:36.444735] [INFO ] [MAIN ] Derivative Progress: 920/1810 symbols completed. IDT took 1.1s. Estimated remaining: 5m 44s. Rate: 155.1 symbols/min [2025-10-13T22:39:36.444963] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:36.462998] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-13T22:39:36.463226] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-13T22:39:36.465884] [INFO ] [MAIN ] Derivative Progress: 921/1810 symbols completed. IDA took 1.1s. Estimated remaining: 5m 44s. Rate: 155.3 symbols/min [2025-10-13T22:39:36.466180] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:36.507056] [DEBUG] [LOCAL ] IFN: Loaded 18400 existing records from primary storage. [2025-10-13T22:39:36.520529] [INFO ] [MAIN ] IFN: Loaded 18400 primary data records. [2025-10-13T22:39:36.553809] [DEBUG] [LOCAL ] IEX: Loaded 38338 existing records from primary storage. [2025-10-13T22:39:36.625848] [INFO ] [MAIN ] IEX: Loaded 38338 primary data records. [2025-10-13T22:39:36.643747] [DEBUG] [LOCAL ] IFF: Loaded 51078 existing records from primary storage. [2025-10-13T22:39:36.664790] [INFO ] [MAIN ] IFF: Loaded 51078 primary data records. [2025-10-13T22:39:37.560527] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:37.561919] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18400 primary records. [2025-10-13T22:39:37.562199] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-13T22:39:37.580849] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-13T22:39:37.582513] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-13T22:39:37.584814] [INFO ] [MAIN ] Derivative Progress: 922/1810 symbols completed. IFN took 1.1s. Estimated remaining: 5m 44s. Rate: 154.9 symbols/min [2025-10-13T22:39:37.585189] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:37.599737] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:37.600924] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51078 primary records. [2025-10-13T22:39:37.601256] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-13T22:39:37.618999] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-13T22:39:37.619135] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-13T22:39:37.629111] [INFO ] [MAIN ] Derivative Progress: 923/1810 symbols completed. IFF took 1.2s. Estimated remaining: 5m 43s. Rate: 155.1 symbols/min [2025-10-13T22:39:37.629366] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:37.651593] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:37.653930] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38338 primary records. [2025-10-13T22:39:37.654629] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-13T22:39:37.654508] [DEBUG] [LOCAL ] IFS: Loaded 22767 existing records from primary storage. [2025-10-13T22:39:37.655783] [INFO ] [MAIN ] IFS: Loaded 22767 primary data records. [2025-10-13T22:39:37.751867] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-13T22:39:37.756058] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-13T22:39:37.764909] [DEBUG] [LOCAL ] IGA: Loaded 10122 existing records from primary storage. [2025-10-13T22:39:37.759405] [INFO ] [MAIN ] Derivative Progress: 924/1810 symbols completed. IEX took 1.4s. Estimated remaining: 5m 43s. Rate: 155.2 symbols/min [2025-10-13T22:39:37.776166] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:37.770267] [INFO ] [MAIN ] IGA: Loaded 10122 primary data records. [2025-10-13T22:39:38.142893] [DEBUG] [LOCAL ] IGD: Loaded 19338 existing records from primary storage. [2025-10-13T22:39:38.156920] [INFO ] [MAIN ] IGD: Loaded 19338 primary data records. [2025-10-13T22:39:38.667383] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:38.669984] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22767 primary records. [2025-10-13T22:39:38.670882] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-13T22:39:38.692167] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-13T22:39:38.704992] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-13T22:39:38.708346] [INFO ] [MAIN ] Derivative Progress: 925/1810 symbols completed. IFS took 1.1s. Estimated remaining: 5m 43s. Rate: 155.0 symbols/min [2025-10-13T22:39:38.708852] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:38.710084] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10122 primary records. [2025-10-13T22:39:38.710427] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-13T22:39:38.710707] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:38.728769] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-13T22:39:38.728973] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-13T22:39:38.731292] [INFO ] [MAIN ] Derivative Progress: 926/1810 symbols completed. IGA took 1.1s. Estimated remaining: 5m 42s. Rate: 155.1 symbols/min [2025-10-13T22:39:38.734379] [DEBUG] [LOCAL ] IGI: Loaded 3896 existing records from primary storage. [2025-10-13T22:39:38.734498] [INFO ] [MAIN ] IGI: Loaded 3896 primary data records. [2025-10-13T22:39:38.745920] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:39.017039] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:39.103911] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19338 primary records. [2025-10-13T22:39:39.104295] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-13T22:39:39.124946] [DEBUG] [LOCAL ] IGR: Loaded 30339 existing records from primary storage. [2025-10-13T22:39:39.143107] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-13T22:39:39.143453] [INFO ] [MAIN ] IGR: Loaded 30339 primary data records. [2025-10-13T22:39:39.143841] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-13T22:39:39.147914] [INFO ] [MAIN ] Derivative Progress: 927/1810 symbols completed. IGD took 1.4s. Estimated remaining: 5m 42s. Rate: 155.1 symbols/min [2025-10-13T22:39:39.148074] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:39.207250] [DEBUG] [LOCAL ] IH: Loaded 2809 existing records from primary storage. [2025-10-13T22:39:39.229715] [INFO ] [MAIN ] IH: Loaded 2809 primary data records. [2025-10-13T22:39:39.648343] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:39.701527] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3896 primary records. [2025-10-13T22:39:39.829007] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-13T22:39:39.849927] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-13T22:39:39.850601] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-13T22:39:39.854003] [INFO ] [MAIN ] Derivative Progress: 928/1810 symbols completed. IGI took 1.1s. Estimated remaining: 5m 41s. Rate: 155.0 symbols/min [2025-10-13T22:39:39.884200] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:39.898773] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30339 primary records. [2025-10-13T22:39:39.899271] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-13T22:39:39.899552] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:39.901529] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2809 primary records. [2025-10-13T22:39:39.901896] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-13T22:39:39.925502] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-13T22:39:39.929081] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-13T22:39:39.932071] [INFO ] [MAIN ] Derivative Progress: 929/1810 symbols completed. IGR took 1.2s. Estimated remaining: 5m 41s. Rate: 155.1 symbols/min [2025-10-13T22:39:39.935219] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-13T22:39:39.935332] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-13T22:39:39.939537] [INFO ] [MAIN ] Derivative Progress: 930/1810 symbols completed. IH took 0.8s. Estimated remaining: 5m 40s. Rate: 155.3 symbols/min [2025-10-13T22:39:39.940123] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:39.940042] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:39.940341] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:39.953507] [DEBUG] [LOCAL ] IHD: Loaded 7224 existing records from primary storage. [2025-10-13T22:39:39.954082] [INFO ] [MAIN ] IHD: Loaded 7224 primary data records. [2025-10-13T22:39:40.110094] [DEBUG] [LOCAL ] IHG: Loaded 24225 existing records from primary storage. [2025-10-13T22:39:40.181678] [INFO ] [MAIN ] IHG: Loaded 24225 primary data records. [2025-10-13T22:39:40.187538] [DEBUG] [LOCAL ] IHS: Loaded 37878 existing records from primary storage. [2025-10-13T22:39:40.307980] [INFO ] [MAIN ] IHS: Loaded 37878 primary data records. [2025-10-13T22:39:41.085254] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:41.088374] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7224 primary records. [2025-10-13T22:39:41.088627] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-13T22:39:41.109178] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-13T22:39:41.109436] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-13T22:39:41.112413] [INFO ] [MAIN ] Derivative Progress: 931/1810 symbols completed. IHD took 1.2s. Estimated remaining: 5m 40s. Rate: 154.9 symbols/min [2025-10-13T22:39:41.112886] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:41.123980] [DEBUG] [LOCAL ] IIF: Loaded 5598 existing records from primary storage. [2025-10-13T22:39:41.126838] [INFO ] [MAIN ] IIF: Loaded 5598 primary data records. [2025-10-13T22:39:41.247784] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:41.259211] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:41.260583] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24225 primary records. [2025-10-13T22:39:41.283977] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-13T22:39:41.285037] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 37878 primary records. [2025-10-13T22:39:41.286297] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-13T22:39:41.372042] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-13T22:39:41.373538] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-13T22:39:41.378833] [INFO ] [MAIN ] Derivative Progress: 932/1810 symbols completed. IHG took 1.4s. Estimated remaining: 5m 40s. Rate: 155.0 symbols/min [2025-10-13T22:39:41.383063] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-13T22:39:41.383202] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-13T22:39:41.383315] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:41.408914] [INFO ] [MAIN ] Derivative Progress: 933/1810 symbols completed. IHS took 1.5s. Estimated remaining: 5m 39s. Rate: 155.1 symbols/min [2025-10-13T22:39:41.515073] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:41.557281] [DEBUG] [LOCAL ] IIM: Loaded 15729 existing records from primary storage. [2025-10-13T22:39:41.558185] [DEBUG] [LOCAL ] IIIN: Loaded 15957 existing records from primary storage. [2025-10-13T22:39:41.559425] [INFO ] [MAIN ] IIIN: Loaded 15957 primary data records. [2025-10-13T22:39:41.559357] [INFO ] [MAIN ] IIM: Loaded 15729 primary data records. [2025-10-13T22:39:41.694854] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:41.748667] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5598 primary records. [2025-10-13T22:39:41.797732] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-13T22:39:42.229551] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-13T22:39:42.229899] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-13T22:39:42.233083] [INFO ] [MAIN ] Derivative Progress: 934/1810 symbols completed. IIF took 1.1s. Estimated remaining: 5m 39s. Rate: 154.9 symbols/min [2025-10-13T22:39:42.233673] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:42.277574] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:42.280152] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 15957 primary records. [2025-10-13T22:39:42.280359] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-13T22:39:42.315464] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:42.319440] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15729 primary records. [2025-10-13T22:39:42.317219] [DEBUG] [LOCAL ] IIPR: Loaded 29422 existing records from primary storage. [2025-10-13T22:39:42.319837] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-13T22:39:42.320542] [INFO ] [MAIN ] IIPR: Loaded 29422 primary data records. [2025-10-13T22:39:42.416555] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-13T22:39:42.383060] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-13T22:39:42.418012] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-13T22:39:42.420422] [INFO ] [MAIN ] Derivative Progress: 935/1810 symbols completed. IIIN took 1.0s. Estimated remaining: 5m 39s. Rate: 155.0 symbols/min [2025-10-13T22:39:42.425793] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-13T22:39:42.431110] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:42.435222] [INFO ] [MAIN ] Derivative Progress: 936/1810 symbols completed. IIM took 0.9s. Estimated remaining: 5m 38s. Rate: 155.2 symbols/min [2025-10-13T22:39:42.445886] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:42.716498] [DEBUG] [LOCAL ] IMAX: Loaded 43065 existing records from primary storage. [2025-10-13T22:39:42.717277] [INFO ] [MAIN ] IMAX: Loaded 43065 primary data records. [2025-10-13T22:39:42.835177] [DEBUG] [LOCAL ] INFA: Loaded 49157 existing records from primary storage. [2025-10-13T22:39:42.841403] [INFO ] [MAIN ] INFA: Loaded 49157 primary data records. [2025-10-13T22:39:43.286979] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:43.393827] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29422 primary records. [2025-10-13T22:39:43.404286] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-13T22:39:43.426629] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-13T22:39:43.427466] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-13T22:39:43.431210] [INFO ] [MAIN ] Derivative Progress: 937/1810 symbols completed. IIPR took 1.2s. Estimated remaining: 5m 38s. Rate: 154.9 symbols/min [2025-10-13T22:39:43.431937] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:43.455783] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:43.460404] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 43065 primary records. [2025-10-13T22:39:43.460564] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-13T22:39:43.474445] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:43.483298] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49157 primary records. [2025-10-13T22:39:43.483526] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-13T22:39:43.500168] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-13T22:39:43.503766] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-13T22:39:43.508280] [INFO ] [MAIN ] Derivative Progress: 938/1810 symbols completed. IMAX took 1.1s. Estimated remaining: 5m 37s. Rate: 155.1 symbols/min [2025-10-13T22:39:43.513160] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:43.513055] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-13T22:39:43.513805] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-13T22:39:43.516762] [INFO ] [MAIN ] Derivative Progress: 939/1810 symbols completed. INFA took 1.1s. Estimated remaining: 5m 37s. Rate: 155.2 symbols/min [2025-10-13T22:39:43.517061] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:43.569373] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-13T22:39:43.569754] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-13T22:39:43.691037] [DEBUG] [LOCAL ] INGM: Loaded 28621 existing records from primary storage. [2025-10-13T22:39:43.703455] [INFO ] [MAIN ] INGM: Loaded 28621 primary data records. [2025-10-13T22:39:43.884487] [DEBUG] [LOCAL ] ING: Loaded 50726 existing records from primary storage. [2025-10-13T22:39:43.889954] [INFO ] [MAIN ] ING: Loaded 50726 primary data records. [2025-10-13T22:39:44.544385] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:44.545583] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53596 primary records. [2025-10-13T22:39:44.545740] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-13T22:39:44.559428] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:44.567470] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28621 primary records. [2025-10-13T22:39:44.567605] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-13T22:39:44.586380] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-13T22:39:44.591430] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-13T22:39:44.598204] [INFO ] [MAIN ] Derivative Progress: 940/1810 symbols completed. INFY took 1.2s. Estimated remaining: 5m 37s. Rate: 154.9 symbols/min [2025-10-13T22:39:44.599926] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:44.602979] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-13T22:39:44.603164] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-13T22:39:44.605588] [INFO ] [MAIN ] Derivative Progress: 941/1810 symbols completed. INGM took 1.1s. Estimated remaining: 5m 36s. Rate: 155.1 symbols/min [2025-10-13T22:39:44.618397] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:44.619259] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:44.620221] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50726 primary records. [2025-10-13T22:39:44.620389] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-13T22:39:44.641966] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-13T22:39:44.642113] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-13T22:39:44.644629] [INFO ] [MAIN ] Derivative Progress: 942/1810 symbols completed. ING took 1.1s. Estimated remaining: 5m 35s. Rate: 155.2 symbols/min [2025-10-13T22:39:44.644869] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:44.681539] [DEBUG] [LOCAL ] INGR: Loaded 33810 existing records from primary storage. [2025-10-13T22:39:44.693073] [INFO ] [MAIN ] INGR: Loaded 33810 primary data records. [2025-10-13T22:39:44.702383] [DEBUG] [LOCAL ] INN: Loaded 41803 existing records from primary storage. [2025-10-13T22:39:44.713873] [INFO ] [MAIN ] INN: Loaded 41803 primary data records. [2025-10-13T22:39:44.912102] [DEBUG] [LOCAL ] INSP: Loaded 38084 existing records from primary storage. [2025-10-13T22:39:44.936495] [INFO ] [MAIN ] INSP: Loaded 38084 primary data records. [2025-10-13T22:39:45.662393] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:45.663258] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33810 primary records. [2025-10-13T22:39:45.663565] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-13T22:39:45.684065] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-13T22:39:45.684497] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-13T22:39:45.686867] [INFO ] [MAIN ] Derivative Progress: 943/1810 symbols completed. INGR took 1.1s. Estimated remaining: 5m 36s. Rate: 155.0 symbols/min [2025-10-13T22:39:45.701148] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:45.702380] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41803 primary records. [2025-10-13T22:39:45.702466] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-13T22:39:45.721908] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-13T22:39:45.722213] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-13T22:39:45.737576] [INFO ] [MAIN ] Derivative Progress: 944/1810 symbols completed. INN took 1.1s. Estimated remaining: 5m 35s. Rate: 155.1 symbols/min [2025-10-13T22:39:45.738051] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:45.739112] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 38084 primary records. [2025-10-13T22:39:45.739240] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-13T22:39:45.755342] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-13T22:39:45.755402] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-13T22:39:45.757996] [INFO ] [MAIN ] Derivative Progress: 945/1810 symbols completed. INSP took 1.1s. Estimated remaining: 5m 34s. Rate: 155.3 symbols/min [2025-10-13T22:39:45.758376] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:45.758499] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:45.759045] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:45.796267] [DEBUG] [LOCAL ] INVX: Loaded 29284 existing records from primary storage. [2025-10-13T22:39:45.796497] [INFO ] [MAIN ] INVX: Loaded 29284 primary data records. [2025-10-13T22:39:45.928320] [DEBUG] [LOCAL ] INSW: Loaded 39735 existing records from primary storage. [2025-10-13T22:39:45.944441] [INFO ] [MAIN ] INSW: Loaded 39735 primary data records. [2025-10-13T22:39:46.074132] [DEBUG] [LOCAL ] INVH: Loaded 53181 existing records from primary storage. [2025-10-13T22:39:46.220511] [INFO ] [MAIN ] INVH: Loaded 53181 primary data records. [2025-10-13T22:39:46.757953] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:46.758708] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29284 primary records. [2025-10-13T22:39:46.758881] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-13T22:39:46.777665] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-13T22:39:46.778070] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-13T22:39:46.787626] [INFO ] [MAIN ] Derivative Progress: 946/1810 symbols completed. INVX took 1.0s. Estimated remaining: 5m 34s. Rate: 155.0 symbols/min [2025-10-13T22:39:46.787905] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:46.794781] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:46.795596] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39735 primary records. [2025-10-13T22:39:46.795771] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-13T22:39:46.825939] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-13T22:39:46.826039] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-13T22:39:46.825352] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:46.828395] [INFO ] [MAIN ] Derivative Progress: 947/1810 symbols completed. INSW took 1.1s. Estimated remaining: 5m 34s. Rate: 155.1 symbols/min [2025-10-13T22:39:46.829178] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53181 primary records. [2025-10-13T22:39:46.829397] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:46.829308] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-13T22:39:46.846785] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-13T22:39:46.846943] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-13T22:39:46.849550] [INFO ] [MAIN ] Derivative Progress: 948/1810 symbols completed. INVH took 1.1s. Estimated remaining: 5m 33s. Rate: 155.3 symbols/min [2025-10-13T22:39:46.849865] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:46.902268] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-13T22:39:46.902508] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-13T22:39:47.032146] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-13T22:39:47.032332] [INFO ] [MAIN ] IOT: Loaded 53475 primary data records. [2025-10-13T22:39:47.225545] [DEBUG] [LOCAL ] IP: Loaded 53310 existing records from primary storage. [2025-10-13T22:39:47.357639] [INFO ] [MAIN ] IP: Loaded 53310 primary data records. [2025-10-13T22:39:47.874343] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:47.875318] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-13T22:39:47.875727] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-13T22:39:47.895362] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-13T22:39:47.907686] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-13T22:39:47.910028] [INFO ] [MAIN ] Derivative Progress: 949/1810 symbols completed. IONQ took 1.1s. Estimated remaining: 5m 33s. Rate: 155.0 symbols/min [2025-10-13T22:39:47.910370] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:47.910678] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:47.911990] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53475 primary records. [2025-10-13T22:39:47.912218] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-13T22:39:47.928946] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-13T22:39:47.929088] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-13T22:39:47.931422] [INFO ] [MAIN ] Derivative Progress: 950/1810 symbols completed. IOT took 1.1s. Estimated remaining: 5m 33s. Rate: 155.2 symbols/min [2025-10-13T22:39:47.931670] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:47.949325] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:47.950128] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53310 primary records. [2025-10-13T22:39:47.950244] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-13T22:39:47.971235] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-13T22:39:47.971374] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-13T22:39:47.973804] [INFO ] [MAIN ] Derivative Progress: 951/1810 symbols completed. IP took 1.1s. Estimated remaining: 5m 32s. Rate: 155.3 symbols/min [2025-10-13T22:39:47.974003] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:47.995053] [DEBUG] [LOCAL ] IPI: Loaded 21272 existing records from primary storage. [2025-10-13T22:39:47.995278] [INFO ] [MAIN ] IPI: Loaded 21272 primary data records. [2025-10-13T22:39:48.123429] [DEBUG] [LOCAL ] IQI: Loaded 17869 existing records from primary storage. [2025-10-13T22:39:48.119940] [DEBUG] [LOCAL ] IPG: Loaded 53329 existing records from primary storage. [2025-10-13T22:39:48.123670] [INFO ] [MAIN ] IQI: Loaded 17869 primary data records. [2025-10-13T22:39:48.123776] [INFO ] [MAIN ] IPG: Loaded 53329 primary data records. [2025-10-13T22:39:48.977012] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:39:48.977955] [INFO ] [MAIN ] IPI: Generated 1793 derivative records from 21272 primary records. [2025-10-13T22:39:48.978212] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-13T22:39:48.996029] [DEBUG] [LOCAL ] IPI: Derivative data saved (1793 records). [2025-10-13T22:39:48.997924] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-13T22:39:49.000093] [INFO ] [MAIN ] Derivative Progress: 952/1810 symbols completed. IPI took 1.1s. Estimated remaining: 5m 32s. Rate: 155.0 symbols/min [2025-10-13T22:39:49.001086] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:49.022633] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:49.027984] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53329 primary records. [2025-10-13T22:39:49.028083] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-13T22:39:49.032321] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:49.043729] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17869 primary records. [2025-10-13T22:39:49.043814] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-13T22:39:49.048822] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-13T22:39:49.048916] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-13T22:39:49.051971] [INFO ] [MAIN ] Derivative Progress: 953/1810 symbols completed. IPG took 1.1s. Estimated remaining: 5m 31s. Rate: 155.2 symbols/min [2025-10-13T22:39:49.062936] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:49.067371] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-13T22:39:49.067535] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-13T22:39:49.070197] [INFO ] [MAIN ] Derivative Progress: 954/1810 symbols completed. IQI took 1.1s. Estimated remaining: 5m 31s. Rate: 155.3 symbols/min [2025-10-13T22:39:49.070735] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:49.110636] [DEBUG] [LOCAL ] IQV: Loaded 50121 existing records from primary storage. [2025-10-13T22:39:49.110936] [INFO ] [MAIN ] IQV: Loaded 50121 primary data records. [2025-10-13T22:39:49.322748] [DEBUG] [LOCAL ] IRM: Loaded 49203 existing records from primary storage. [2025-10-13T22:39:49.451302] [INFO ] [MAIN ] IRM: Loaded 49203 primary data records. [2025-10-13T22:39:49.452337] [DEBUG] [LOCAL ] IR: Loaded 52765 existing records from primary storage. [2025-10-13T22:39:49.473403] [INFO ] [MAIN ] IR: Loaded 52765 primary data records. [2025-10-13T22:39:50.071717] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:50.073466] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50121 primary records. [2025-10-13T22:39:50.073571] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-13T22:39:50.092039] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-13T22:39:50.092349] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-13T22:39:50.095157] [INFO ] [MAIN ] Derivative Progress: 955/1810 symbols completed. IQV took 1.1s. Estimated remaining: 5m 31s. Rate: 155.1 symbols/min [2025-10-13T22:39:50.095447] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:50.134543] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:50.134371] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:50.135379] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49203 primary records. [2025-10-13T22:39:50.136024] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52765 primary records. [2025-10-13T22:39:50.136199] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-13T22:39:50.136147] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-13T22:39:50.173632] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-13T22:39:50.174815] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-13T22:39:50.174985] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-13T22:39:50.174919] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-13T22:39:50.177585] [INFO ] [MAIN ] Derivative Progress: 956/1810 symbols completed. IRM took 1.1s. Estimated remaining: 5m 30s. Rate: 155.2 symbols/min [2025-10-13T22:39:50.180635] [INFO ] [MAIN ] Derivative Progress: 957/1810 symbols completed. IR took 1.1s. Estimated remaining: 5m 29s. Rate: 155.3 symbols/min [2025-10-13T22:39:50.177814] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:50.180873] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:50.178610] [DEBUG] [LOCAL ] IRS: Loaded 22924 existing records from primary storage. [2025-10-13T22:39:50.181319] [INFO ] [MAIN ] IRS: Loaded 22924 primary data records. [2025-10-13T22:39:50.364919] [DEBUG] [LOCAL ] ISD: Loaded 15901 existing records from primary storage. [2025-10-13T22:39:50.369821] [INFO ] [MAIN ] ISD: Loaded 15901 primary data records. [2025-10-13T22:39:50.801098] [DEBUG] [LOCAL ] IRT: Loaded 50560 existing records from primary storage. [2025-10-13T22:39:50.815338] [INFO ] [MAIN ] IRT: Loaded 50560 primary data records. [2025-10-13T22:39:50.998593] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:51.035359] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 22924 primary records. [2025-10-13T22:39:51.035678] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-13T22:39:51.252476] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-13T22:39:51.254397] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-13T22:39:51.256839] [INFO ] [MAIN ] Derivative Progress: 958/1810 symbols completed. IRS took 1.2s. Estimated remaining: 5m 30s. Rate: 155.1 symbols/min [2025-10-13T22:39:51.272547] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:51.273407] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15901 primary records. [2025-10-13T22:39:51.273525] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-13T22:39:51.292130] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-13T22:39:51.292350] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-13T22:39:51.294882] [INFO ] [MAIN ] Derivative Progress: 959/1810 symbols completed. ISD took 1.1s. Estimated remaining: 5m 29s. Rate: 155.2 symbols/min [2025-10-13T22:39:51.310945] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:51.311615] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50560 primary records. [2025-10-13T22:39:51.311700] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-13T22:39:51.327363] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-13T22:39:51.327422] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-13T22:39:51.331212] [INFO ] [MAIN ] Derivative Progress: 960/1810 symbols completed. IRT took 1.2s. Estimated remaining: 5m 28s. Rate: 155.3 symbols/min [2025-10-13T22:39:51.331826] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:51.331965] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:51.331770] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:51.383919] [DEBUG] [LOCAL ] ITGR: Loaded 31229 existing records from primary storage. [2025-10-13T22:39:51.384068] [INFO ] [MAIN ] ITGR: Loaded 31229 primary data records. [2025-10-13T22:39:51.516502] [DEBUG] [LOCAL ] ITT: Loaded 32826 existing records from primary storage. [2025-10-13T22:39:51.517475] [DEBUG] [LOCAL ] IT: Loaded 42159 existing records from primary storage. [2025-10-13T22:39:51.538483] [INFO ] [MAIN ] IT: Loaded 42159 primary data records. [2025-10-13T22:39:51.538744] [INFO ] [MAIN ] ITT: Loaded 32826 primary data records. [2025-10-13T22:39:52.336488] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:52.337260] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31229 primary records. [2025-10-13T22:39:52.337424] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-13T22:39:52.369030] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-13T22:39:52.369451] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-13T22:39:52.369761] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:52.370493] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42159 primary records. [2025-10-13T22:39:52.374078] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-13T22:39:52.373727] [INFO ] [MAIN ] Derivative Progress: 961/1810 symbols completed. ITGR took 1.0s. Estimated remaining: 5m 28s. Rate: 155.1 symbols/min [2025-10-13T22:39:52.385242] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:52.403072] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:52.406548] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32826 primary records. [2025-10-13T22:39:52.407077] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-13T22:39:52.408816] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-13T22:39:52.408922] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-13T22:39:52.412305] [INFO ] [MAIN ] Derivative Progress: 962/1810 symbols completed. IT took 1.1s. Estimated remaining: 5m 28s. Rate: 155.2 symbols/min [2025-10-13T22:39:52.412506] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:52.429356] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-13T22:39:52.429504] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-13T22:39:52.432038] [INFO ] [MAIN ] Derivative Progress: 963/1810 symbols completed. ITT took 1.1s. Estimated remaining: 5m 27s. Rate: 155.4 symbols/min [2025-10-13T22:39:52.432340] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:52.501127] [DEBUG] [LOCAL ] ITW: Loaded 45832 existing records from primary storage. [2025-10-13T22:39:52.516749] [INFO ] [MAIN ] ITW: Loaded 45832 primary data records. [2025-10-13T22:39:52.576186] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-10-13T22:39:52.575067] [DEBUG] [LOCAL ] IVR: Loaded 48122 existing records from primary storage. [2025-10-13T22:39:52.581811] [INFO ] [MAIN ] ITUB: Loaded 53318 primary data records. [2025-10-13T22:39:52.582209] [INFO ] [MAIN ] IVR: Loaded 48122 primary data records. [2025-10-13T22:39:53.594071] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:53.608940] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:53.610443] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45832 primary records. [2025-10-13T22:39:53.611558] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53318 primary records. [2025-10-13T22:39:53.612967] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-13T22:39:53.614375] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-13T22:39:53.633233] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-13T22:39:53.640221] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-13T22:39:53.646692] [INFO ] [MAIN ] Derivative Progress: 964/1810 symbols completed. ITW took 1.2s. Estimated remaining: 5m 27s. Rate: 155.0 symbols/min [2025-10-13T22:39:53.646965] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:53.652453] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-13T22:39:53.660923] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-13T22:39:53.669927] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:53.669476] [INFO ] [MAIN ] Derivative Progress: 965/1810 symbols completed. ITUB took 1.3s. Estimated remaining: 5m 27s. Rate: 155.2 symbols/min [2025-10-13T22:39:53.670256] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:53.671429] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 48122 primary records. [2025-10-13T22:39:53.672058] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-13T22:39:53.702916] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-13T22:39:53.703129] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-13T22:39:53.705849] [INFO ] [MAIN ] Derivative Progress: 966/1810 symbols completed. IVR took 1.3s. Estimated remaining: 5m 26s. Rate: 155.3 symbols/min [2025-10-13T22:39:53.706587] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:53.717748] [DEBUG] [LOCAL ] IVT: Loaded 31261 existing records from primary storage. [2025-10-13T22:39:53.717987] [INFO ] [MAIN ] IVT: Loaded 31261 primary data records. [2025-10-13T22:39:53.936886] [DEBUG] [LOCAL ] IX: Loaded 22373 existing records from primary storage. [2025-10-13T22:39:53.955692] [INFO ] [MAIN ] IX: Loaded 22373 primary data records. [2025-10-13T22:39:54.085362] [DEBUG] [LOCAL ] IVZ: Loaded 53118 existing records from primary storage. [2025-10-13T22:39:54.099547] [INFO ] [MAIN ] IVZ: Loaded 53118 primary data records. [2025-10-13T22:39:54.780208] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:54.781218] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31261 primary records. [2025-10-13T22:39:54.781482] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-13T22:39:54.801720] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-13T22:39:54.801842] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-13T22:39:54.804060] [INFO ] [MAIN ] Derivative Progress: 967/1810 symbols completed. IVT took 1.2s. Estimated remaining: 5m 26s. Rate: 155.0 symbols/min [2025-10-13T22:39:54.804251] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:54.824857] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:54.829248] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22373 primary records. [2025-10-13T22:39:54.829491] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-13T22:39:54.844791] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:54.854567] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53118 primary records. [2025-10-13T22:39:54.857496] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-13T22:39:54.866446] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-13T22:39:54.866572] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-13T22:39:54.869776] [INFO ] [MAIN ] Derivative Progress: 968/1810 symbols completed. IX took 1.2s. Estimated remaining: 5m 26s. Rate: 155.2 symbols/min [2025-10-13T22:39:54.870040] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:54.898247] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-13T22:39:54.898437] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-13T22:39:54.902066] [INFO ] [MAIN ] Derivative Progress: 969/1810 symbols completed. IVZ took 1.2s. Estimated remaining: 5m 25s. Rate: 155.3 symbols/min [2025-10-13T22:39:54.902356] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:54.920224] [DEBUG] [LOCAL ] J: Loaded 40285 existing records from primary storage. [2025-10-13T22:39:54.920689] [INFO ] [MAIN ] J: Loaded 40285 primary data records. [2025-10-13T22:39:55.083307] [DEBUG] [LOCAL ] JBGS: Loaded 42181 existing records from primary storage. [2025-10-13T22:39:55.099196] [INFO ] [MAIN ] JBGS: Loaded 42181 primary data records. [2025-10-13T22:39:55.433826] [DEBUG] [LOCAL ] JBI: Loaded 43124 existing records from primary storage. [2025-10-13T22:39:55.449422] [INFO ] [MAIN ] JBI: Loaded 43124 primary data records. [2025-10-13T22:39:56.014757] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:56.016382] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40285 primary records. [2025-10-13T22:39:56.016484] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-13T22:39:56.044089] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-13T22:39:56.044960] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-13T22:39:56.047477] [INFO ] [MAIN ] Derivative Progress: 970/1810 symbols completed. J took 1.2s. Estimated remaining: 5m 25s. Rate: 155.0 symbols/min [2025-10-13T22:39:56.047894] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:56.065105] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:56.067120] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42181 primary records. [2025-10-13T22:39:56.067556] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-13T22:39:56.082086] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:56.083440] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43124 primary records. [2025-10-13T22:39:56.083575] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-13T22:39:56.115163] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-13T22:39:56.115911] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-13T22:39:56.119812] [INFO ] [MAIN ] Derivative Progress: 971/1810 symbols completed. JBGS took 1.2s. Estimated remaining: 5m 25s. Rate: 155.1 symbols/min [2025-10-13T22:39:56.120516] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:56.126536] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-13T22:39:56.126890] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-13T22:39:56.130392] [INFO ] [MAIN ] Derivative Progress: 972/1810 symbols completed. JBI took 1.2s. Estimated remaining: 5m 24s. Rate: 155.3 symbols/min [2025-10-13T22:39:56.130736] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:56.152446] [DEBUG] [LOCAL ] JCE: Loaded 7371 existing records from primary storage. [2025-10-13T22:39:56.152704] [INFO ] [MAIN ] JCE: Loaded 7371 primary data records. [2025-10-13T22:39:56.295670] [DEBUG] [LOCAL ] JBL: Loaded 48384 existing records from primary storage. [2025-10-13T22:39:56.296010] [INFO ] [MAIN ] JBL: Loaded 48384 primary data records. [2025-10-13T22:39:56.302264] [DEBUG] [LOCAL ] JBND: Loaded 26674 existing records from primary storage. [2025-10-13T22:39:56.325383] [INFO ] [MAIN ] JBND: Loaded 26674 primary data records. [2025-10-13T22:39:57.202423] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:57.203898] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7371 primary records. [2025-10-13T22:39:57.204213] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-13T22:39:57.222523] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-13T22:39:57.222979] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-13T22:39:57.225150] [INFO ] [MAIN ] Derivative Progress: 973/1810 symbols completed. JCE took 1.1s. Estimated remaining: 5m 24s. Rate: 155.0 symbols/min [2025-10-13T22:39:57.246697] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:57.247684] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26674 primary records. [2025-10-13T22:39:57.247772] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-13T22:39:57.262609] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:57.264123] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48384 primary records. [2025-10-13T22:39:57.264476] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-13T22:39:57.297408] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-13T22:39:57.297916] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-13T22:39:57.300344] [INFO ] [MAIN ] Derivative Progress: 974/1810 symbols completed. JBND took 1.2s. Estimated remaining: 5m 23s. Rate: 155.1 symbols/min [2025-10-13T22:39:57.301747] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-13T22:39:57.301922] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-13T22:39:57.305839] [INFO ] [MAIN ] Derivative Progress: 975/1810 symbols completed. JBL took 1.3s. Estimated remaining: 5m 23s. Rate: 155.3 symbols/min [2025-10-13T22:39:57.306489] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:57.306801] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:57.306726] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:57.357839] [DEBUG] [LOCAL ] JELD: Loaded 46105 existing records from primary storage. [2025-10-13T22:39:57.358126] [INFO ] [MAIN ] JELD: Loaded 46105 primary data records. [2025-10-13T22:39:57.538885] [DEBUG] [LOCAL ] JEF: Loaded 50183 existing records from primary storage. [2025-10-13T22:39:57.544190] [INFO ] [MAIN ] JEF: Loaded 50183 primary data records. [2025-10-13T22:39:57.753180] [DEBUG] [LOCAL ] JCI: Loaded 53533 existing records from primary storage. [2025-10-13T22:39:57.846635] [INFO ] [MAIN ] JCI: Loaded 53533 primary data records. [2025-10-13T22:39:58.408370] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:58.409744] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46105 primary records. [2025-10-13T22:39:58.410547] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-13T22:39:58.428832] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-13T22:39:58.428958] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-13T22:39:58.431039] [INFO ] [MAIN ] Derivative Progress: 976/1810 symbols completed. JELD took 1.1s. Estimated remaining: 5m 23s. Rate: 155.0 symbols/min [2025-10-13T22:39:58.431329] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:58.446181] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:58.447010] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50183 primary records. [2025-10-13T22:39:58.447196] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-13T22:39:58.466013] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-13T22:39:58.466521] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-13T22:39:58.478574] [INFO ] [MAIN ] Derivative Progress: 977/1810 symbols completed. JEF took 1.2s. Estimated remaining: 5m 22s. Rate: 155.1 symbols/min [2025-10-13T22:39:58.484139] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:58.495374] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:58.496865] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53533 primary records. [2025-10-13T22:39:58.497039] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-13T22:39:58.531241] [DEBUG] [LOCAL ] JGH: Loaded 12022 existing records from primary storage. [2025-10-13T22:39:58.533334] [DEBUG] [LOCAL ] JFR: Loaded 30972 existing records from primary storage. [2025-10-13T22:39:58.534079] [INFO ] [MAIN ] JGH: Loaded 12022 primary data records. [2025-10-13T22:39:58.546710] [INFO ] [MAIN ] JFR: Loaded 30972 primary data records. [2025-10-13T22:39:58.616677] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-13T22:39:58.649403] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-13T22:39:58.697093] [INFO ] [MAIN ] Derivative Progress: 978/1810 symbols completed. JCI took 1.4s. Estimated remaining: 5m 22s. Rate: 155.2 symbols/min [2025-10-13T22:39:58.704248] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:59.262825] [DEBUG] [LOCAL ] JHG: Loaded 47620 existing records from primary storage. [2025-10-13T22:39:59.263509] [INFO ] [MAIN ] JHG: Loaded 47620 primary data records. [2025-10-13T22:39:59.474525] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:59.484043] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 12022 primary records. [2025-10-13T22:39:59.485274] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-13T22:39:59.697199] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:39:59.699060] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-13T22:39:59.700295] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-13T22:39:59.703966] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30972 primary records. [2025-10-13T22:39:59.702835] [INFO ] [MAIN ] Derivative Progress: 979/1810 symbols completed. JGH took 1.2s. Estimated remaining: 5m 22s. Rate: 154.9 symbols/min [2025-10-13T22:39:59.704498] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-13T22:39:59.704694] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:59.733135] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-13T22:39:59.732860] [DEBUG] [LOCAL ] JHI: Loaded 3933 existing records from primary storage. [2025-10-13T22:39:59.733356] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-13T22:39:59.733451] [INFO ] [MAIN ] JHI: Loaded 3933 primary data records. [2025-10-13T22:39:59.736716] [INFO ] [MAIN ] Derivative Progress: 980/1810 symbols completed. JFR took 1.3s. Estimated remaining: 5m 21s. Rate: 155.1 symbols/min [2025-10-13T22:39:59.749544] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:39:59.855762] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-13T22:39:59.861765] [INFO ] [MAIN ] JHS: Loaded 2944 primary data records. [2025-10-13T22:40:00.272763] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:00.387279] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47620 primary records. [2025-10-13T22:40:00.388668] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-13T22:40:00.412081] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-13T22:40:00.412228] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-13T22:40:00.414775] [INFO ] [MAIN ] Derivative Progress: 981/1810 symbols completed. JHG took 1.7s. Estimated remaining: 5m 21s. Rate: 154.9 symbols/min [2025-10-13T22:40:00.415521] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:00.440220] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:00.441612] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3933 primary records. [2025-10-13T22:40:00.444863] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-13T22:40:00.460768] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:00.462359] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2944 primary records. [2025-10-13T22:40:00.473538] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-13T22:40:00.506285] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-13T22:40:00.505628] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-13T22:40:00.506484] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-13T22:40:00.508785] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-13T22:40:00.508683] [INFO ] [MAIN ] Derivative Progress: 982/1810 symbols completed. JHI took 0.8s. Estimated remaining: 5m 20s. Rate: 155.1 symbols/min [2025-10-13T22:40:00.511878] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:00.512307] [INFO ] [MAIN ] Derivative Progress: 983/1810 symbols completed. JHS took 0.8s. Estimated remaining: 5m 20s. Rate: 155.2 symbols/min [2025-10-13T22:40:00.512775] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:00.533259] [DEBUG] [LOCAL ] JHX: Loaded 53153 existing records from primary storage. [2025-10-13T22:40:00.540334] [INFO ] [MAIN ] JHX: Loaded 53153 primary data records. [2025-10-13T22:40:00.649591] [DEBUG] [LOCAL ] JILL: Loaded 16095 existing records from primary storage. [2025-10-13T22:40:00.671217] [INFO ] [MAIN ] JILL: Loaded 16095 primary data records. [2025-10-13T22:40:00.961889] [DEBUG] [LOCAL ] JKS: Loaded 39731 existing records from primary storage. [2025-10-13T22:40:00.987048] [INFO ] [MAIN ] JKS: Loaded 39731 primary data records. [2025-10-13T22:40:01.702537] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:01.703998] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53153 primary records. [2025-10-13T22:40:01.704263] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-13T22:40:01.753199] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-13T22:40:01.754339] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-13T22:40:01.757285] [INFO ] [MAIN ] Derivative Progress: 984/1810 symbols completed. JHX took 1.3s. Estimated remaining: 5m 20s. Rate: 154.9 symbols/min [2025-10-13T22:40:01.757448] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:01.754847] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:01.761192] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16095 primary records. [2025-10-13T22:40:01.763521] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-13T22:40:01.779622] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:01.790263] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39731 primary records. [2025-10-13T22:40:01.795087] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-13T22:40:01.818057] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-13T22:40:01.828879] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-13T22:40:01.828975] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-13T22:40:01.829214] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-13T22:40:01.831882] [INFO ] [MAIN ] Derivative Progress: 985/1810 symbols completed. JILL took 1.3s. Estimated remaining: 5m 19s. Rate: 155.0 symbols/min [2025-10-13T22:40:01.835702] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:01.835902] [INFO ] [MAIN ] Derivative Progress: 986/1810 symbols completed. JKS took 1.3s. Estimated remaining: 5m 19s. Rate: 155.2 symbols/min [2025-10-13T22:40:01.836419] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:01.852214] [DEBUG] [LOCAL ] JLL: Loaded 31667 existing records from primary storage. [2025-10-13T22:40:01.852554] [INFO ] [MAIN ] JLL: Loaded 31667 primary data records. [2025-10-13T22:40:01.894894] [DEBUG] [LOCAL ] JLS: Loaded 4178 existing records from primary storage. [2025-10-13T22:40:01.913755] [INFO ] [MAIN ] JLS: Loaded 4178 primary data records. [2025-10-13T22:40:02.562442] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-13T22:40:02.563065] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-13T22:40:02.906347] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:02.907505] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31667 primary records. [2025-10-13T22:40:02.907892] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-13T22:40:02.923278] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:02.925107] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4178 primary records. [2025-10-13T22:40:02.938277] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-13T22:40:02.950825] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-13T22:40:02.955397] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-13T22:40:02.958884] [INFO ] [MAIN ] Derivative Progress: 987/1810 symbols completed. JLL took 1.2s. Estimated remaining: 5m 19s. Rate: 154.9 symbols/min [2025-10-13T22:40:02.960104] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:02.966637] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-13T22:40:02.969207] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-13T22:40:02.972605] [INFO ] [MAIN ] Derivative Progress: 988/1810 symbols completed. JLS took 1.1s. Estimated remaining: 5m 18s. Rate: 155.0 symbols/min [2025-10-13T22:40:02.994423] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:02.995507] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-13T22:40:02.995668] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-13T22:40:03.037930] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-13T22:40:03.038105] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-13T22:40:03.040524] [INFO ] [MAIN ] Derivative Progress: 989/1810 symbols completed. JNJ took 1.2s. Estimated remaining: 5m 18s. Rate: 155.1 symbols/min [2025-10-13T22:40:03.060976] [DEBUG] [LOCAL ] JOBY: Loaded 53803 existing records from primary storage. [2025-10-13T22:40:03.061178] [INFO ] [MAIN ] JOBY: Loaded 53803 primary data records. [2025-10-13T22:40:03.377229] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:03.377880] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53803 primary records. [2025-10-13T22:40:03.377943] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-13T22:40:03.392974] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-13T22:40:03.393031] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-13T22:40:03.395228] [INFO ] [MAIN ] Derivative Progress: 990/1810 symbols completed. JOBY took 0.4s. Estimated remaining: 5m 17s. Rate: 155.2 symbols/min [2025-10-13T22:40:03.395610] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:03.395665] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:03.395795] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:03.406989] [DEBUG] [LOCAL ] JOF: Loaded 6875 existing records from primary storage. [2025-10-13T22:40:03.407166] [INFO ] [MAIN ] JOF: Loaded 6875 primary data records. [2025-10-13T22:40:03.544216] [DEBUG] [LOCAL ] JOE: Loaded 23909 existing records from primary storage. [2025-10-13T22:40:03.550453] [INFO ] [MAIN ] JOE: Loaded 23909 primary data records. [2025-10-13T22:40:03.716153] [DEBUG] [LOCAL ] JPC: Loaded 37227 existing records from primary storage. [2025-10-13T22:40:03.840803] [INFO ] [MAIN ] JPC: Loaded 37227 primary data records. [2025-10-13T22:40:04.459227] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:04.460346] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6875 primary records. [2025-10-13T22:40:04.460514] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-13T22:40:04.479275] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-13T22:40:04.479604] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-13T22:40:04.482008] [INFO ] [MAIN ] Derivative Progress: 991/1810 symbols completed. JOF took 1.1s. Estimated remaining: 5m 17s. Rate: 154.9 symbols/min [2025-10-13T22:40:04.482307] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:04.504497] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:04.506940] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23909 primary records. [2025-10-13T22:40:04.507466] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-13T22:40:04.543306] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:04.545769] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-13T22:40:04.547247] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-13T22:40:04.547154] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37227 primary records. [2025-10-13T22:40:04.550634] [INFO ] [MAIN ] Derivative Progress: 992/1810 symbols completed. JOE took 1.2s. Estimated remaining: 5m 17s. Rate: 155.0 symbols/min [2025-10-13T22:40:04.547554] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-13T22:40:04.550877] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:04.568149] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-13T22:40:04.568344] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-13T22:40:04.570853] [INFO ] [MAIN ] Derivative Progress: 993/1810 symbols completed. JPC took 1.2s. Estimated remaining: 5m 16s. Rate: 155.1 symbols/min [2025-10-13T22:40:04.571076] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:04.612433] [DEBUG] [LOCAL ] JRI: Loaded 15394 existing records from primary storage. [2025-10-13T22:40:04.623329] [INFO ] [MAIN ] JRI: Loaded 15394 primary data records. [2025-10-13T22:40:04.645104] [DEBUG] [LOCAL ] JQC: Loaded 33961 existing records from primary storage. [2025-10-13T22:40:04.646369] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-13T22:40:04.645313] [INFO ] [MAIN ] JQC: Loaded 33961 primary data records. [2025-10-13T22:40:04.683810] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-13T22:40:05.603984] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:05.604863] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-13T22:40:05.608200] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-13T22:40:05.638623] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:05.648624] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33961 primary records. [2025-10-13T22:40:05.648948] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:05.649684] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15394 primary records. [2025-10-13T22:40:05.649060] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-13T22:40:05.655282] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-13T22:40:05.656122] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-13T22:40:05.658453] [INFO ] [MAIN ] Derivative Progress: 994/1810 symbols completed. JPM took 1.2s. Estimated remaining: 5m 16s. Rate: 154.9 symbols/min [2025-10-13T22:40:05.658872] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:05.655190] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-13T22:40:05.691333] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-13T22:40:05.691427] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-13T22:40:05.691770] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-13T22:40:05.691898] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-13T22:40:05.694552] [INFO ] [MAIN ] Derivative Progress: 995/1810 symbols completed. JQC took 1.1s. Estimated remaining: 5m 15s. Rate: 155.0 symbols/min [2025-10-13T22:40:05.694782] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:05.697466] [INFO ] [MAIN ] Derivative Progress: 996/1810 symbols completed. JRI took 1.1s. Estimated remaining: 5m 15s. Rate: 155.2 symbols/min [2025-10-13T22:40:05.697933] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:05.709613] [DEBUG] [LOCAL ] JRS: Loaded 11663 existing records from primary storage. [2025-10-13T22:40:05.710142] [INFO ] [MAIN ] JRS: Loaded 11663 primary data records. [2025-10-13T22:40:06.095252] [DEBUG] [LOCAL ] K: Loaded 50349 existing records from primary storage. [2025-10-13T22:40:06.093986] [DEBUG] [LOCAL ] JXN: Loaded 44862 existing records from primary storage. [2025-10-13T22:40:06.095672] [INFO ] [MAIN ] K: Loaded 50349 primary data records. [2025-10-13T22:40:06.095603] [INFO ] [MAIN ] JXN: Loaded 44862 primary data records. [2025-10-13T22:40:06.739116] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:06.741437] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11663 primary records. [2025-10-13T22:40:06.741908] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-13T22:40:06.762066] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-13T22:40:06.762219] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-13T22:40:06.765110] [INFO ] [MAIN ] Derivative Progress: 997/1810 symbols completed. JRS took 1.1s. Estimated remaining: 5m 15s. Rate: 154.9 symbols/min [2025-10-13T22:40:06.765417] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:06.788117] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:06.790238] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50349 primary records. [2025-10-13T22:40:06.790338] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-13T22:40:06.797982] [DEBUG] [LOCAL ] KAI: Loaded 13493 existing records from primary storage. [2025-10-13T22:40:06.805172] [INFO ] [MAIN ] KAI: Loaded 13493 primary data records. [2025-10-13T22:40:06.824071] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-13T22:40:06.857298] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-13T22:40:06.863002] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:06.883765] [INFO ] [MAIN ] Derivative Progress: 998/1810 symbols completed. K took 1.2s. Estimated remaining: 5m 14s. Rate: 155.0 symbols/min [2025-10-13T22:40:06.898490] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 44862 primary records. [2025-10-13T22:40:06.898765] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-13T22:40:06.898707] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:07.137195] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-13T22:40:07.137595] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-13T22:40:07.140153] [INFO ] [MAIN ] Derivative Progress: 999/1810 symbols completed. JXN took 1.4s. Estimated remaining: 5m 14s. Rate: 155.0 symbols/min [2025-10-13T22:40:07.140487] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:07.175168] [DEBUG] [LOCAL ] KAR: Loaded 40157 existing records from primary storage. [2025-10-13T22:40:07.175535] [INFO ] [MAIN ] KAR: Loaded 40157 primary data records. [2025-10-13T22:40:07.258808] [DEBUG] [LOCAL ] KB: Loaded 23448 existing records from primary storage. [2025-10-13T22:40:07.264072] [INFO ] [MAIN ] KB: Loaded 23448 primary data records. [2025-10-13T22:40:07.407024] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:07.425072] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13493 primary records. [2025-10-13T22:40:07.441210] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-13T22:40:07.864473] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-13T22:40:07.864871] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-13T22:40:07.867014] [INFO ] [MAIN ] Derivative Progress: 1000/1810 symbols completed. KAI took 1.1s. Estimated remaining: 5m 14s. Rate: 154.9 symbols/min [2025-10-13T22:40:07.867188] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:07.897283] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:07.898195] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23448 primary records. [2025-10-13T22:40:07.898307] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-13T22:40:07.911338] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:07.926093] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40157 primary records. [2025-10-13T22:40:07.929955] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-13T22:40:07.931273] [DEBUG] [LOCAL ] KBDC: Loaded 22026 existing records from primary storage. [2025-10-13T22:40:07.931585] [INFO ] [MAIN ] KBDC: Loaded 22026 primary data records. [2025-10-13T22:40:07.983884] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-13T22:40:07.984454] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-13T22:40:07.987020] [INFO ] [MAIN ] Derivative Progress: 1001/1810 symbols completed. KAR took 1.1s. Estimated remaining: 5m 13s. Rate: 155.0 symbols/min [2025-10-13T22:40:07.994137] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:08.022554] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-13T22:40:08.033986] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-13T22:40:08.057323] [INFO ] [MAIN ] Derivative Progress: 1002/1810 symbols completed. KB took 0.9s. Estimated remaining: 5m 12s. Rate: 155.1 symbols/min [2025-10-13T22:40:08.068560] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:08.293994] [DEBUG] [LOCAL ] KBH: Loaded 48810 existing records from primary storage. [2025-10-13T22:40:08.294502] [INFO ] [MAIN ] KBH: Loaded 48810 primary data records. [2025-10-13T22:40:08.484971] [DEBUG] [LOCAL ] KBR: Loaded 48028 existing records from primary storage. [2025-10-13T22:40:08.503000] [INFO ] [MAIN ] KBR: Loaded 48028 primary data records. [2025-10-13T22:40:08.537110] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:08.718236] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 22026 primary records. [2025-10-13T22:40:08.731153] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-13T22:40:08.827083] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-13T22:40:08.875002] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-13T22:40:08.917023] [INFO ] [MAIN ] Derivative Progress: 1003/1810 symbols completed. KBDC took 1.0s. Estimated remaining: 5m 12s. Rate: 155.0 symbols/min [2025-10-13T22:40:09.050621] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:09.051476] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48810 primary records. [2025-10-13T22:40:09.052298] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-13T22:40:09.068982] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-13T22:40:09.069253] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-13T22:40:09.071966] [INFO ] [MAIN ] Derivative Progress: 1004/1810 symbols completed. KBH took 1.1s. Estimated remaining: 5m 12s. Rate: 155.0 symbols/min [2025-10-13T22:40:09.086774] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:09.087423] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48028 primary records. [2025-10-13T22:40:09.087495] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-13T22:40:09.102977] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-13T22:40:09.103035] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-13T22:40:09.105158] [INFO ] [MAIN ] Derivative Progress: 1005/1810 symbols completed. KBR took 1.0s. Estimated remaining: 5m 11s. Rate: 155.2 symbols/min [2025-10-13T22:40:09.105604] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:09.105768] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:09.105703] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:09.113009] [DEBUG] [LOCAL ] KEN: Loaded 4698 existing records from primary storage. [2025-10-13T22:40:09.113320] [INFO ] [MAIN ] KEN: Loaded 4698 primary data records. [2025-10-13T22:40:09.306349] [DEBUG] [LOCAL ] KEP: Loaded 31657 existing records from primary storage. [2025-10-13T22:40:09.441407] [INFO ] [MAIN ] KEP: Loaded 31657 primary data records. [2025-10-13T22:40:09.527958] [DEBUG] [LOCAL ] KD: Loaded 52360 existing records from primary storage. [2025-10-13T22:40:09.539365] [INFO ] [MAIN ] KD: Loaded 52360 primary data records. [2025-10-13T22:40:10.133602] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:10.135320] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4698 primary records. [2025-10-13T22:40:10.135678] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-13T22:40:10.154282] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-13T22:40:10.154672] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-13T22:40:10.158839] [INFO ] [MAIN ] Derivative Progress: 1006/1810 symbols completed. KEN took 1.1s. Estimated remaining: 5m 11s. Rate: 154.9 symbols/min [2025-10-13T22:40:10.161834] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:10.191722] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:10.191965] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:10.192894] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52360 primary records. [2025-10-13T22:40:10.193991] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-13T22:40:10.193906] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31657 primary records. [2025-10-13T22:40:10.194143] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-13T22:40:10.225335] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-13T22:40:10.225857] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-13T22:40:10.228252] [INFO ] [MAIN ] Derivative Progress: 1007/1810 symbols completed. KEP took 1.1s. Estimated remaining: 5m 11s. Rate: 155.1 symbols/min [2025-10-13T22:40:10.229411] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:10.240447] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-13T22:40:10.240745] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-13T22:40:10.243310] [INFO ] [MAIN ] Derivative Progress: 1008/1810 symbols completed. KD took 1.1s. Estimated remaining: 5m 10s. Rate: 155.2 symbols/min [2025-10-13T22:40:10.243519] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:10.260301] [DEBUG] [LOCAL ] KF: Loaded 2335 existing records from primary storage. [2025-10-13T22:40:10.261929] [INFO ] [MAIN ] KF: Loaded 2335 primary data records. [2025-10-13T22:40:10.293830] [DEBUG] [LOCAL ] KEX: Loaded 38528 existing records from primary storage. [2025-10-13T22:40:10.318870] [INFO ] [MAIN ] KEX: Loaded 38528 primary data records. [2025-10-13T22:40:10.720016] [DEBUG] [LOCAL ] KEYS: Loaded 43256 existing records from primary storage. [2025-10-13T22:40:10.731515] [INFO ] [MAIN ] KEYS: Loaded 43256 primary data records. [2025-10-13T22:40:11.253353] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:11.255291] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2335 primary records. [2025-10-13T22:40:11.255811] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-13T22:40:11.283798] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:11.286438] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38528 primary records. [2025-10-13T22:40:11.288100] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-13T22:40:11.304472] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-13T22:40:11.308552] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-13T22:40:11.309175] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-13T22:40:11.311902] [INFO ] [MAIN ] Derivative Progress: 1009/1810 symbols completed. KEX took 1.2s. Estimated remaining: 5m 10s. Rate: 154.9 symbols/min [2025-10-13T22:40:11.312453] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-13T22:40:11.312152] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:11.315090] [INFO ] [MAIN ] Derivative Progress: 1010/1810 symbols completed. KF took 1.1s. Estimated remaining: 5m 10s. Rate: 155.1 symbols/min [2025-10-13T22:40:11.315603] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:11.338139] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:11.339138] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43256 primary records. [2025-10-13T22:40:11.339337] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-13T22:40:11.345033] [DEBUG] [LOCAL ] KFS: Loaded 8662 existing records from primary storage. [2025-10-13T22:40:11.351708] [INFO ] [MAIN ] KFS: Loaded 8662 primary data records. [2025-10-13T22:40:11.477923] [DEBUG] [LOCAL ] KFRC: Loaded 20312 existing records from primary storage. [2025-10-13T22:40:11.485304] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-13T22:40:11.495708] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-13T22:40:11.484595] [INFO ] [MAIN ] KFRC: Loaded 20312 primary data records. [2025-10-13T22:40:11.498259] [INFO ] [MAIN ] Derivative Progress: 1011/1810 symbols completed. KEYS took 1.3s. Estimated remaining: 5m 9s. Rate: 155.2 symbols/min [2025-10-13T22:40:11.529578] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:12.059911] [DEBUG] [LOCAL ] KFY: Loaded 30001 existing records from primary storage. [2025-10-13T22:40:12.060917] [INFO ] [MAIN ] KFY: Loaded 30001 primary data records. [2025-10-13T22:40:12.417312] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:12.418703] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8662 primary records. [2025-10-13T22:40:12.418860] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-13T22:40:12.447714] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-13T22:40:12.453630] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:12.454529] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20312 primary records. [2025-10-13T22:40:12.454620] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-13T22:40:12.454826] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-13T22:40:12.457248] [INFO ] [MAIN ] Derivative Progress: 1012/1810 symbols completed. KFS took 1.1s. Estimated remaining: 5m 9s. Rate: 154.9 symbols/min [2025-10-13T22:40:12.459292] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:12.476035] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-13T22:40:12.476319] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-13T22:40:12.479485] [INFO ] [MAIN ] Derivative Progress: 1013/1810 symbols completed. KFRC took 1.2s. Estimated remaining: 5m 8s. Rate: 155.1 symbols/min [2025-10-13T22:40:12.480147] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:12.498089] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:12.498885] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30001 primary records. [2025-10-13T22:40:12.498957] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-13T22:40:12.517185] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-13T22:40:12.517369] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-13T22:40:12.520180] [INFO ] [MAIN ] Derivative Progress: 1014/1810 symbols completed. KFY took 1.0s. Estimated remaining: 5m 8s. Rate: 155.2 symbols/min [2025-10-13T22:40:12.520474] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:12.564918] [DEBUG] [LOCAL ] KGS: Loaded 46095 existing records from primary storage. [2025-10-13T22:40:12.565272] [INFO ] [MAIN ] KGS: Loaded 46095 primary data records. [2025-10-13T22:40:12.708132] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-13T22:40:12.724262] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-13T22:40:13.015182] [DEBUG] [LOCAL ] KIM: Loaded 52996 existing records from primary storage. [2025-10-13T22:40:13.027132] [INFO ] [MAIN ] KIM: Loaded 52996 primary data records. [2025-10-13T22:40:13.592552] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:13.594942] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 46095 primary records. [2025-10-13T22:40:13.595612] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-13T22:40:13.614110] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-13T22:40:13.614620] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-13T22:40:13.617173] [INFO ] [MAIN ] Derivative Progress: 1015/1810 symbols completed. KGS took 1.1s. Estimated remaining: 5m 8s. Rate: 154.9 symbols/min [2025-10-13T22:40:13.617562] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:13.637780] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:13.638945] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53700 primary records. [2025-10-13T22:40:13.639321] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-13T22:40:13.663051] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-13T22:40:13.663528] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-13T22:40:13.666065] [INFO ] [MAIN ] Derivative Progress: 1016/1810 symbols completed. KGC took 1.2s. Estimated remaining: 5m 7s. Rate: 155.1 symbols/min [2025-10-13T22:40:13.673916] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:13.677522] [DEBUG] [LOCAL ] KIO: Loaded 21587 existing records from primary storage. [2025-10-13T22:40:13.678339] [INFO ] [MAIN ] KIO: Loaded 21587 primary data records. [2025-10-13T22:40:13.766119] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:13.790272] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 52996 primary records. [2025-10-13T22:40:13.793577] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-13T22:40:13.868402] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-13T22:40:13.885706] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-13T22:40:13.891024] [INFO ] [MAIN ] Derivative Progress: 1017/1810 symbols completed. KIM took 1.4s. Estimated remaining: 5m 7s. Rate: 155.1 symbols/min [2025-10-13T22:40:14.021626] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:14.054138] [DEBUG] [LOCAL ] KKRS: Loaded 5732 existing records from primary storage. [2025-10-13T22:40:14.054582] [INFO ] [MAIN ] KKRS: Loaded 5732 primary data records. [2025-10-13T22:40:14.177919] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-13T22:40:14.179370] [INFO ] [MAIN ] KKR: Loaded 53503 primary data records. [2025-10-13T22:40:14.714628] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:14.715535] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21587 primary records. [2025-10-13T22:40:14.715769] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-13T22:40:14.737115] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-13T22:40:14.737838] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-13T22:40:14.740675] [INFO ] [MAIN ] Derivative Progress: 1018/1810 symbols completed. KIO took 1.1s. Estimated remaining: 5m 7s. Rate: 155.0 symbols/min [2025-10-13T22:40:14.758127] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:14.759137] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5732 primary records. [2025-10-13T22:40:14.759236] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-13T22:40:14.774166] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-13T22:40:14.774297] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-13T22:40:14.776932] [INFO ] [MAIN ] Derivative Progress: 1019/1810 symbols completed. KKRS took 0.8s. Estimated remaining: 5m 6s. Rate: 155.1 symbols/min [2025-10-13T22:40:14.792447] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:14.793025] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53503 primary records. [2025-10-13T22:40:14.793161] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-13T22:40:14.808562] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-13T22:40:14.808622] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-13T22:40:14.811251] [INFO ] [MAIN ] Derivative Progress: 1020/1810 symbols completed. KKR took 1.1s. Estimated remaining: 5m 5s. Rate: 155.2 symbols/min [2025-10-13T22:40:14.811681] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:14.811808] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:14.811613] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:14.819382] [DEBUG] [LOCAL ] KMPB: Loaded 3733 existing records from primary storage. [2025-10-13T22:40:14.819688] [INFO ] [MAIN ] KMPB: Loaded 3733 primary data records. [2025-10-13T22:40:15.030504] [DEBUG] [LOCAL ] KLC: Loaded 36593 existing records from primary storage. [2025-10-13T22:40:15.088784] [INFO ] [MAIN ] KLC: Loaded 36593 primary data records. [2025-10-13T22:40:15.214739] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-13T22:40:15.252519] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-13T22:40:15.871711] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:40:15.873386] [INFO ] [MAIN ] KMPB: Generated 1793 derivative records from 3733 primary records. [2025-10-13T22:40:15.873981] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-13T22:40:15.897211] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1793 records). [2025-10-13T22:40:15.897809] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-13T22:40:15.900983] [INFO ] [MAIN ] Derivative Progress: 1021/1810 symbols completed. KMPB took 1.1s. Estimated remaining: 5m 6s. Rate: 155.0 symbols/min [2025-10-13T22:40:15.901439] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:15.923189] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:15.923983] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36593 primary records. [2025-10-13T22:40:15.924200] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-13T22:40:15.944818] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-13T22:40:15.946053] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-13T22:40:15.948311] [INFO ] [MAIN ] Derivative Progress: 1022/1810 symbols completed. KLC took 1.1s. Estimated remaining: 5m 5s. Rate: 155.1 symbols/min [2025-10-13T22:40:15.948711] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:15.963416] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:15.975604] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-13T22:40:15.975911] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-13T22:40:15.992437] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-13T22:40:15.993483] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-13T22:40:15.996095] [INFO ] [MAIN ] Derivative Progress: 1023/1810 symbols completed. KMI took 1.2s. Estimated remaining: 5m 4s. Rate: 155.2 symbols/min [2025-10-13T22:40:16.008303] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:16.009407] [DEBUG] [LOCAL ] KMPR: Loaded 39744 existing records from primary storage. [2025-10-13T22:40:16.010096] [INFO ] [MAIN ] KMPR: Loaded 39744 primary data records. [2025-10-13T22:40:16.200767] [DEBUG] [LOCAL ] KMT: Loaded 42905 existing records from primary storage. [2025-10-13T22:40:16.211637] [INFO ] [MAIN ] KMT: Loaded 42905 primary data records. [2025-10-13T22:40:16.633747] [DEBUG] [LOCAL ] KMX: Loaded 53264 existing records from primary storage. [2025-10-13T22:40:16.648596] [INFO ] [MAIN ] KMX: Loaded 53264 primary data records. [2025-10-13T22:40:17.229006] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:17.230028] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39744 primary records. [2025-10-13T22:40:17.231676] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-13T22:40:17.250248] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-13T22:40:17.250754] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-13T22:40:17.253297] [INFO ] [MAIN ] Derivative Progress: 1024/1810 symbols completed. KMPR took 1.4s. Estimated remaining: 5m 5s. Rate: 154.9 symbols/min [2025-10-13T22:40:17.253701] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:17.274296] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:17.275160] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42905 primary records. [2025-10-13T22:40:17.275513] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-13T22:40:17.311340] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:17.311446] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-13T22:40:17.311788] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-13T22:40:17.312558] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53264 primary records. [2025-10-13T22:40:17.324692] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-13T22:40:17.324512] [INFO ] [MAIN ] Derivative Progress: 1025/1810 symbols completed. KMT took 1.4s. Estimated remaining: 5m 4s. Rate: 155.0 symbols/min [2025-10-13T22:40:17.325726] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:17.341544] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-13T22:40:17.341626] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-13T22:40:17.344094] [INFO ] [MAIN ] Derivative Progress: 1026/1810 symbols completed. KMX took 1.3s. Estimated remaining: 5m 3s. Rate: 155.1 symbols/min [2025-10-13T22:40:17.344413] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:17.358462] [DEBUG] [LOCAL ] KN: Loaded 38584 existing records from primary storage. [2025-10-13T22:40:17.358784] [INFO ] [MAIN ] KN: Loaded 38584 primary data records. [2025-10-13T22:40:17.480398] [DEBUG] [LOCAL ] KNOP: Loaded 10368 existing records from primary storage. [2025-10-13T22:40:17.480689] [INFO ] [MAIN ] KNOP: Loaded 10368 primary data records. [2025-10-13T22:40:17.765077] [DEBUG] [LOCAL ] KNF: Loaded 36521 existing records from primary storage. [2025-10-13T22:40:17.777941] [INFO ] [MAIN ] KNF: Loaded 36521 primary data records. [2025-10-13T22:40:18.356723] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:18.357861] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38584 primary records. [2025-10-13T22:40:18.358068] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-13T22:40:18.384847] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-13T22:40:18.391085] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:18.391814] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10368 primary records. [2025-10-13T22:40:18.392536] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-13T22:40:18.393244] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-13T22:40:18.395913] [INFO ] [MAIN ] Derivative Progress: 1027/1810 symbols completed. KN took 1.1s. Estimated remaining: 5m 3s. Rate: 154.9 symbols/min [2025-10-13T22:40:18.396856] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:18.422260] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:18.424938] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-13T22:40:18.425069] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-13T22:40:18.427665] [INFO ] [MAIN ] Derivative Progress: 1028/1810 symbols completed. KNOP took 1.1s. Estimated remaining: 5m 3s. Rate: 155.0 symbols/min [2025-10-13T22:40:18.424105] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36521 primary records. [2025-10-13T22:40:18.427913] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:18.428346] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-13T22:40:18.444888] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-13T22:40:18.445096] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-13T22:40:18.447789] [INFO ] [MAIN ] Derivative Progress: 1029/1810 symbols completed. KNF took 1.1s. Estimated remaining: 5m 2s. Rate: 155.2 symbols/min [2025-10-13T22:40:18.447964] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:18.461328] [DEBUG] [LOCAL ] KNSL: Loaded 18409 existing records from primary storage. [2025-10-13T22:40:18.461474] [INFO ] [MAIN ] KNSL: Loaded 18409 primary data records. [2025-10-13T22:40:18.660472] [DEBUG] [LOCAL ] KNTK: Loaded 46863 existing records from primary storage. [2025-10-13T22:40:18.672405] [INFO ] [MAIN ] KNTK: Loaded 46863 primary data records. [2025-10-13T22:40:18.929759] [DEBUG] [LOCAL ] KNX: Loaded 52602 existing records from primary storage. [2025-10-13T22:40:18.941519] [INFO ] [MAIN ] KNX: Loaded 52602 primary data records. [2025-10-13T22:40:19.432475] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:19.433809] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18409 primary records. [2025-10-13T22:40:19.433977] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-13T22:40:19.452052] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-13T22:40:19.453568] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-13T22:40:19.456477] [INFO ] [MAIN ] Derivative Progress: 1030/1810 symbols completed. KNSL took 1.1s. Estimated remaining: 5m 2s. Rate: 154.9 symbols/min [2025-10-13T22:40:19.456854] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:19.470501] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:19.471216] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46863 primary records. [2025-10-13T22:40:19.471406] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-13T22:40:19.503791] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-13T22:40:19.503975] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-13T22:40:19.503032] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:19.507292] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52602 primary records. [2025-10-13T22:40:19.507419] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-13T22:40:19.506403] [INFO ] [MAIN ] Derivative Progress: 1031/1810 symbols completed. KNTK took 1.1s. Estimated remaining: 5m 1s. Rate: 155.1 symbols/min [2025-10-13T22:40:19.508462] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:19.536866] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-13T22:40:19.537795] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-13T22:40:19.540472] [INFO ] [MAIN ] Derivative Progress: 1032/1810 symbols completed. KNX took 1.1s. Estimated remaining: 5m 1s. Rate: 155.2 symbols/min [2025-10-13T22:40:19.540735] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:19.557231] [DEBUG] [LOCAL ] KODK: Loaded 43626 existing records from primary storage. [2025-10-13T22:40:19.565020] [INFO ] [MAIN ] KODK: Loaded 43626 primary data records. [2025-10-13T22:40:19.663137] [DEBUG] [LOCAL ] KOP: Loaded 17485 existing records from primary storage. [2025-10-13T22:40:19.682082] [DEBUG] [LOCAL ] KOF: Loaded 26539 existing records from primary storage. [2025-10-13T22:40:19.689877] [INFO ] [MAIN ] KOP: Loaded 17485 primary data records. [2025-10-13T22:40:19.693312] [INFO ] [MAIN ] KOF: Loaded 26539 primary data records. [2025-10-13T22:40:20.559997] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:20.561223] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43626 primary records. [2025-10-13T22:40:20.561479] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-13T22:40:20.581621] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-13T22:40:20.594199] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-13T22:40:20.596610] [INFO ] [MAIN ] Derivative Progress: 1033/1810 symbols completed. KODK took 1.1s. Estimated remaining: 5m 1s. Rate: 154.9 symbols/min [2025-10-13T22:40:20.597110] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:20.612342] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17485 primary records. [2025-10-13T22:40:20.613016] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-13T22:40:20.612934] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:20.614817] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26539 primary records. [2025-10-13T22:40:20.615164] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-13T22:40:20.644308] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-13T22:40:20.646226] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-13T22:40:20.649021] [INFO ] [MAIN ] Derivative Progress: 1034/1810 symbols completed. KOP took 1.1s. Estimated remaining: 5m 0s. Rate: 155.1 symbols/min [2025-10-13T22:40:20.651570] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-13T22:40:20.651737] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-13T22:40:20.654815] [INFO ] [MAIN ] Derivative Progress: 1035/1810 symbols completed. KOF took 1.1s. Estimated remaining: 4m 60s. Rate: 155.2 symbols/min [2025-10-13T22:40:20.655371] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:20.655301] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:20.655506] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:20.661480] [DEBUG] [LOCAL ] KORE: Loaded 2146 existing records from primary storage. [2025-10-13T22:40:20.661631] [INFO ] [MAIN ] KORE: Loaded 2146 primary data records. [2025-10-13T22:40:21.021293] [DEBUG] [LOCAL ] KOS: Loaded 53089 existing records from primary storage. [2025-10-13T22:40:21.022260] [INFO ] [MAIN ] KOS: Loaded 53089 primary data records. [2025-10-13T22:40:21.023238] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-13T22:40:21.023597] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-13T22:40:21.675353] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:21.677144] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2146 primary records. [2025-10-13T22:40:21.677580] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-13T22:40:21.701993] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-13T22:40:21.702537] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-13T22:40:21.705764] [INFO ] [MAIN ] Derivative Progress: 1036/1810 symbols completed. KORE took 1.1s. Estimated remaining: 4m 60s. Rate: 155.0 symbols/min [2025-10-13T22:40:21.706121] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:21.729767] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:21.742803] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53089 primary records. [2025-10-13T22:40:21.743885] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-13T22:40:21.743798] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:21.744809] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-13T22:40:21.745778] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-13T22:40:21.780515] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-13T22:40:21.780751] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-13T22:40:21.794666] [INFO ] [MAIN ] Derivative Progress: 1037/1810 symbols completed. KOS took 1.1s. Estimated remaining: 4m 59s. Rate: 155.1 symbols/min [2025-10-13T22:40:21.796934] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:21.796746] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-13T22:40:21.797247] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-13T22:40:21.800564] [INFO ] [MAIN ] Derivative Progress: 1038/1810 symbols completed. KR took 1.1s. Estimated remaining: 4m 58s. Rate: 155.2 symbols/min [2025-10-13T22:40:21.800958] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:21.819220] [DEBUG] [LOCAL ] KRC: Loaded 48286 existing records from primary storage. [2025-10-13T22:40:21.819487] [INFO ] [MAIN ] KRC: Loaded 48286 primary data records. [2025-10-13T22:40:21.995301] [DEBUG] [LOCAL ] KREF: Loaded 37962 existing records from primary storage. [2025-10-13T22:40:22.018425] [INFO ] [MAIN ] KREF: Loaded 37962 primary data records. [2025-10-13T22:40:22.250903] [DEBUG] [LOCAL ] KRG: Loaded 49255 existing records from primary storage. [2025-10-13T22:40:22.302309] [INFO ] [MAIN ] KRG: Loaded 49255 primary data records. [2025-10-13T22:40:22.862539] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:22.863765] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48286 primary records. [2025-10-13T22:40:22.864129] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-13T22:40:22.895800] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:22.896862] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37962 primary records. [2025-10-13T22:40:22.897173] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-13T22:40:22.899213] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-13T22:40:22.899381] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-13T22:40:22.909625] [INFO ] [MAIN ] Derivative Progress: 1039/1810 symbols completed. KRC took 1.2s. Estimated remaining: 4m 59s. Rate: 154.9 symbols/min [2025-10-13T22:40:22.910621] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:22.918428] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-13T22:40:22.919476] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-13T22:40:22.922314] [INFO ] [MAIN ] Derivative Progress: 1040/1810 symbols completed. KREF took 1.1s. Estimated remaining: 4m 58s. Rate: 155.1 symbols/min [2025-10-13T22:40:22.922833] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:22.936087] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:22.936744] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49255 primary records. [2025-10-13T22:40:22.936886] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-13T22:40:22.960522] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-13T22:40:22.960728] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-13T22:40:22.963128] [INFO ] [MAIN ] Derivative Progress: 1041/1810 symbols completed. KRG took 1.2s. Estimated remaining: 4m 57s. Rate: 155.2 symbols/min [2025-10-13T22:40:22.963387] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:22.974051] [DEBUG] [LOCAL ] KRO: Loaded 26376 existing records from primary storage. [2025-10-13T22:40:22.974238] [INFO ] [MAIN ] KRO: Loaded 26376 primary data records. [2025-10-13T22:40:23.174959] [DEBUG] [LOCAL ] KRP: Loaded 36498 existing records from primary storage. [2025-10-13T22:40:23.272691] [INFO ] [MAIN ] KRP: Loaded 36498 primary data records. [2025-10-13T22:40:23.434768] [DEBUG] [LOCAL ] KSS: Loaded 53596 existing records from primary storage. [2025-10-13T22:40:23.450493] [INFO ] [MAIN ] KSS: Loaded 53596 primary data records. [2025-10-13T22:40:23.929044] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:23.930006] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26376 primary records. [2025-10-13T22:40:23.930342] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-13T22:40:23.952579] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-13T22:40:23.961099] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-13T22:40:23.966332] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:23.967063] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36498 primary records. [2025-10-13T22:40:23.969705] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-13T22:40:23.969594] [INFO ] [MAIN ] Derivative Progress: 1042/1810 symbols completed. KRO took 1.1s. Estimated remaining: 4m 57s. Rate: 155.0 symbols/min [2025-10-13T22:40:23.970898] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:23.988014] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-13T22:40:23.988260] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-13T22:40:23.991511] [INFO ] [MAIN ] Derivative Progress: 1043/1810 symbols completed. KRP took 1.1s. Estimated remaining: 4m 57s. Rate: 155.1 symbols/min [2025-10-13T22:40:23.992574] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:24.007314] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:24.008098] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53596 primary records. [2025-10-13T22:40:24.008213] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-13T22:40:24.034585] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-13T22:40:24.034868] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-13T22:40:24.037406] [INFO ] [MAIN ] Derivative Progress: 1044/1810 symbols completed. KSS took 1.1s. Estimated remaining: 4m 56s. Rate: 155.2 symbols/min [2025-10-13T22:40:24.037779] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:24.066010] [DEBUG] [LOCAL ] KT: Loaded 45544 existing records from primary storage. [2025-10-13T22:40:24.066256] [INFO ] [MAIN ] KT: Loaded 45544 primary data records. [2025-10-13T22:40:24.091409] [DEBUG] [LOCAL ] KTF: Loaded 11915 existing records from primary storage. [2025-10-13T22:40:24.113996] [INFO ] [MAIN ] KTF: Loaded 11915 primary data records. [2025-10-13T22:40:24.283900] [DEBUG] [LOCAL ] KTB: Loaded 40542 existing records from primary storage. [2025-10-13T22:40:24.295125] [INFO ] [MAIN ] KTB: Loaded 40542 primary data records. [2025-10-13T22:40:25.025957] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:25.028472] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45544 primary records. [2025-10-13T22:40:25.029261] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-13T22:40:25.055996] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:25.058764] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-13T22:40:25.059464] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 11915 primary records. [2025-10-13T22:40:25.058860] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-13T22:40:25.062065] [INFO ] [MAIN ] Derivative Progress: 1045/1810 symbols completed. KT took 1.1s. Estimated remaining: 4m 56s. Rate: 155.0 symbols/min [2025-10-13T22:40:25.062208] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-13T22:40:25.062337] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:25.080730] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-13T22:40:25.081019] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-13T22:40:25.083555] [INFO ] [MAIN ] Derivative Progress: 1046/1810 symbols completed. KTF took 1.0s. Estimated remaining: 4m 55s. Rate: 155.1 symbols/min [2025-10-13T22:40:25.083760] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:25.097559] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:25.098409] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40542 primary records. [2025-10-13T22:40:25.098522] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-13T22:40:25.115123] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-13T22:40:25.116099] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-13T22:40:25.118873] [INFO ] [MAIN ] Derivative Progress: 1047/1810 symbols completed. KTB took 1.1s. Estimated remaining: 4m 55s. Rate: 155.3 symbols/min [2025-10-13T22:40:25.119099] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:25.168805] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-13T22:40:25.169559] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-13T22:40:25.262930] [DEBUG] [LOCAL ] KVYO: Loaded 50682 existing records from primary storage. [2025-10-13T22:40:25.285827] [INFO ] [MAIN ] KVYO: Loaded 50682 primary data records. [2025-10-13T22:40:25.423977] [DEBUG] [LOCAL ] KW: Loaded 40483 existing records from primary storage. [2025-10-13T22:40:25.475111] [INFO ] [MAIN ] KW: Loaded 40483 primary data records. [2025-10-13T22:40:26.241812] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:26.243723] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-13T22:40:26.243914] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-13T22:40:26.271692] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:40:26.276697] [INFO ] [MAIN ] KVYO: Generated 1793 derivative records from 50682 primary records. [2025-10-13T22:40:26.276911] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-13T22:40:26.278284] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-13T22:40:26.278630] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-13T22:40:26.281066] [INFO ] [MAIN ] Derivative Progress: 1048/1810 symbols completed. KVUE took 1.2s. Estimated remaining: 4m 55s. Rate: 155.0 symbols/min [2025-10-13T22:40:26.299507] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1793 records). [2025-10-13T22:40:26.299767] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-13T22:40:26.302449] [INFO ] [MAIN ] Derivative Progress: 1049/1810 symbols completed. KVYO took 1.2s. Estimated remaining: 4m 54s. Rate: 155.1 symbols/min [2025-10-13T22:40:26.315307] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:26.315901] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40483 primary records. [2025-10-13T22:40:26.315962] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-13T22:40:26.331056] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-13T22:40:26.331152] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-13T22:40:26.333563] [INFO ] [MAIN ] Derivative Progress: 1050/1810 symbols completed. KW took 1.2s. Estimated remaining: 4m 54s. Rate: 155.3 symbols/min [2025-10-13T22:40:26.333982] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:26.334165] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:26.334098] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:26.362555] [DEBUG] [LOCAL ] KWR: Loaded 16178 existing records from primary storage. [2025-10-13T22:40:26.370998] [INFO ] [MAIN ] KWR: Loaded 16178 primary data records. [2025-10-13T22:40:26.471515] [DEBUG] [LOCAL ] KYN: Loaded 30165 existing records from primary storage. [2025-10-13T22:40:26.523627] [INFO ] [MAIN ] KYN: Loaded 30165 primary data records. [2025-10-13T22:40:26.524805] [DEBUG] [LOCAL ] L: Loaded 41080 existing records from primary storage. [2025-10-13T22:40:26.540475] [INFO ] [MAIN ] L: Loaded 41080 primary data records. [2025-10-13T22:40:27.387712] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:27.388964] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16178 primary records. [2025-10-13T22:40:27.389237] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-13T22:40:27.410323] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-13T22:40:27.410449] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-13T22:40:27.412597] [INFO ] [MAIN ] Derivative Progress: 1051/1810 symbols completed. KWR took 1.1s. Estimated remaining: 4m 54s. Rate: 155.0 symbols/min [2025-10-13T22:40:27.413060] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:27.426836] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:27.427539] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30165 primary records. [2025-10-13T22:40:27.427752] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-13T22:40:27.446428] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-13T22:40:27.446687] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-13T22:40:27.449598] [INFO ] [MAIN ] Derivative Progress: 1052/1810 symbols completed. KYN took 1.1s. Estimated remaining: 4m 53s. Rate: 155.1 symbols/min [2025-10-13T22:40:27.457350] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:27.463508] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:27.464381] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41080 primary records. [2025-10-13T22:40:27.464519] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-13T22:40:27.482197] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-13T22:40:27.482417] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-13T22:40:27.484618] [INFO ] [MAIN ] Derivative Progress: 1053/1810 symbols completed. L took 1.2s. Estimated remaining: 4m 53s. Rate: 155.3 symbols/min [2025-10-13T22:40:27.500271] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:27.505128] [DEBUG] [LOCAL ] LANV: Loaded 2815 existing records from primary storage. [2025-10-13T22:40:27.505347] [INFO ] [MAIN ] LANV: Loaded 2815 primary data records. [2025-10-13T22:40:27.643866] [DEBUG] [LOCAL ] LAC: Loaded 52482 existing records from primary storage. [2025-10-13T22:40:27.665552] [INFO ] [MAIN ] LAC: Loaded 52482 primary data records. [2025-10-13T22:40:27.660306] [DEBUG] [LOCAL ] LADR: Loaded 39324 existing records from primary storage. [2025-10-13T22:40:27.695211] [INFO ] [MAIN ] LADR: Loaded 39324 primary data records. [2025-10-13T22:40:28.488925] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:40:28.489691] [INFO ] [MAIN ] LANV: Generated 1792 derivative records from 2815 primary records. [2025-10-13T22:40:28.489950] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-13T22:40:28.504296] [DEBUG] [LOCAL ] LANV: Derivative data saved (1792 records). [2025-10-13T22:40:28.504578] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-13T22:40:28.507633] [INFO ] [MAIN ] Derivative Progress: 1054/1810 symbols completed. LANV took 1.0s. Estimated remaining: 4m 53s. Rate: 155.0 symbols/min [2025-10-13T22:40:28.511554] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:28.524936] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:28.538056] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:28.537805] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52482 primary records. [2025-10-13T22:40:28.538225] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-13T22:40:28.538913] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39324 primary records. [2025-10-13T22:40:28.543239] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-13T22:40:28.574845] [DEBUG] [LOCAL ] LAW: Loaded 14500 existing records from primary storage. [2025-10-13T22:40:28.578850] [INFO ] [MAIN ] LAW: Loaded 14500 primary data records. [2025-10-13T22:40:28.579025] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-13T22:40:28.584676] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-13T22:40:28.604144] [INFO ] [MAIN ] Derivative Progress: 1055/1810 symbols completed. LADR took 1.1s. Estimated remaining: 4m 52s. Rate: 155.1 symbols/min [2025-10-13T22:40:28.621012] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:28.679678] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-13T22:40:28.695780] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-13T22:40:28.702549] [INFO ] [MAIN ] Derivative Progress: 1056/1810 symbols completed. LAC took 1.3s. Estimated remaining: 4m 51s. Rate: 155.2 symbols/min [2025-10-13T22:40:28.714220] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:28.941800] [DEBUG] [LOCAL ] LAZ: Loaded 44790 existing records from primary storage. [2025-10-13T22:40:28.942076] [INFO ] [MAIN ] LAZ: Loaded 44790 primary data records. [2025-10-13T22:40:29.063186] [DEBUG] [LOCAL ] LB: Loaded 37646 existing records from primary storage. [2025-10-13T22:40:29.064073] [INFO ] [MAIN ] LB: Loaded 37646 primary data records. [2025-10-13T22:40:29.394247] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:29.449935] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14500 primary records. [2025-10-13T22:40:29.561162] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-13T22:40:29.583975] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-13T22:40:29.584290] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-13T22:40:29.586760] [INFO ] [MAIN ] Derivative Progress: 1057/1810 symbols completed. LAW took 1.1s. Estimated remaining: 4m 51s. Rate: 155.0 symbols/min [2025-10-13T22:40:29.588602] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:29.612203] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:29.613375] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44790 primary records. [2025-10-13T22:40:29.613701] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-13T22:40:29.637192] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-13T22:40:29.651125] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-13T22:40:29.651554] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:29.654569] [INFO ] [MAIN ] Derivative Progress: 1058/1810 symbols completed. LAZ took 1.0s. Estimated remaining: 4m 51s. Rate: 155.2 symbols/min [2025-10-13T22:40:29.652445] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37646 primary records. [2025-10-13T22:40:29.654873] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:29.655093] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-13T22:40:29.673581] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-13T22:40:29.687349] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-13T22:40:29.690032] [INFO ] [MAIN ] Derivative Progress: 1059/1810 symbols completed. LB took 1.0s. Estimated remaining: 4m 50s. Rate: 155.3 symbols/min [2025-10-13T22:40:29.690347] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:29.715528] [DEBUG] [LOCAL ] LBRT: Loaded 52952 existing records from primary storage. [2025-10-13T22:40:29.725217] [INFO ] [MAIN ] LBRT: Loaded 52952 primary data records. [2025-10-13T22:40:29.848366] [DEBUG] [LOCAL ] LC: Loaded 48079 existing records from primary storage. [2025-10-13T22:40:29.854388] [INFO ] [MAIN ] LC: Loaded 48079 primary data records. [2025-10-13T22:40:29.914879] [DEBUG] [LOCAL ] LCII: Loaded 27562 existing records from primary storage. [2025-10-13T22:40:29.933392] [INFO ] [MAIN ] LCII: Loaded 27562 primary data records. [2025-10-13T22:40:30.719763] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:30.721782] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52952 primary records. [2025-10-13T22:40:30.722010] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-13T22:40:30.735268] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:30.736687] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48079 primary records. [2025-10-13T22:40:30.750718] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-13T22:40:30.757557] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-13T22:40:30.773259] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-13T22:40:30.773754] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-13T22:40:30.775948] [INFO ] [MAIN ] Derivative Progress: 1060/1810 symbols completed. LBRT took 1.2s. Estimated remaining: 4m 50s. Rate: 155.0 symbols/min [2025-10-13T22:40:30.776218] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:30.789198] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:30.790388] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27562 primary records. [2025-10-13T22:40:30.790586] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-13T22:40:30.788846] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-13T22:40:30.793812] [INFO ] [MAIN ] Derivative Progress: 1061/1810 symbols completed. LC took 1.1s. Estimated remaining: 4m 50s. Rate: 155.2 symbols/min [2025-10-13T22:40:30.794103] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:30.810986] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-13T22:40:30.811213] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-13T22:40:30.813703] [INFO ] [MAIN ] Derivative Progress: 1062/1810 symbols completed. LCII took 1.1s. Estimated remaining: 4m 49s. Rate: 155.3 symbols/min [2025-10-13T22:40:30.813900] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:30.839034] [DEBUG] [LOCAL ] LDP: Loaded 12892 existing records from primary storage. [2025-10-13T22:40:30.839133] [INFO ] [MAIN ] LDP: Loaded 12892 primary data records. [2025-10-13T22:40:30.976532] [DEBUG] [LOCAL ] LDI: Loaded 44727 existing records from primary storage. [2025-10-13T22:40:30.977097] [INFO ] [MAIN ] LDI: Loaded 44727 primary data records. [2025-10-13T22:40:30.993722] [DEBUG] [LOCAL ] LDOS: Loaded 45172 existing records from primary storage. [2025-10-13T22:40:31.022142] [INFO ] [MAIN ] LDOS: Loaded 45172 primary data records. [2025-10-13T22:40:31.828912] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:31.829970] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12892 primary records. [2025-10-13T22:40:31.830292] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-13T22:40:31.846907] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-13T22:40:31.847089] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-13T22:40:31.849515] [INFO ] [MAIN ] Derivative Progress: 1063/1810 symbols completed. LDP took 1.0s. Estimated remaining: 4m 49s. Rate: 155.1 symbols/min [2025-10-13T22:40:31.867780] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:31.880382] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45172 primary records. [2025-10-13T22:40:31.880543] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:31.880695] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-13T22:40:31.881227] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44727 primary records. [2025-10-13T22:40:31.881852] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-13T22:40:31.912464] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-13T22:40:31.913814] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-13T22:40:31.916523] [INFO ] [MAIN ] Derivative Progress: 1064/1810 symbols completed. LDOS took 1.1s. Estimated remaining: 4m 48s. Rate: 155.2 symbols/min [2025-10-13T22:40:31.917031] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-13T22:40:31.917161] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-13T22:40:31.920047] [INFO ] [MAIN ] Derivative Progress: 1065/1810 symbols completed. LDI took 1.1s. Estimated remaining: 4m 48s. Rate: 155.3 symbols/min [2025-10-13T22:40:31.920530] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:31.920632] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:31.920474] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:31.973130] [DEBUG] [LOCAL ] LEA: Loaded 41508 existing records from primary storage. [2025-10-13T22:40:31.973319] [INFO ] [MAIN ] LEA: Loaded 41508 primary data records. [2025-10-13T22:40:32.141026] [DEBUG] [LOCAL ] LEG: Loaded 50184 existing records from primary storage. [2025-10-13T22:40:32.192743] [INFO ] [MAIN ] LEG: Loaded 50184 primary data records. [2025-10-13T22:40:32.200474] [DEBUG] [LOCAL ] LEN: Loaded 53175 existing records from primary storage. [2025-10-13T22:40:32.338460] [INFO ] [MAIN ] LEN: Loaded 53175 primary data records. [2025-10-13T22:40:32.972464] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:32.973676] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41508 primary records. [2025-10-13T22:40:32.974138] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-13T22:40:32.993404] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-13T22:40:32.993727] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-13T22:40:32.996033] [INFO ] [MAIN ] Derivative Progress: 1066/1810 symbols completed. LEA took 1.1s. Estimated remaining: 4m 48s. Rate: 155.1 symbols/min [2025-10-13T22:40:32.996385] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:33.031767] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:33.032032] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:33.032890] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53175 primary records. [2025-10-13T22:40:33.033495] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50184 primary records. [2025-10-13T22:40:33.033583] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-13T22:40:33.033721] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-13T22:40:33.062760] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-13T22:40:33.064944] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-13T22:40:33.068392] [INFO ] [MAIN ] Derivative Progress: 1067/1810 symbols completed. LEN took 1.1s. Estimated remaining: 4m 47s. Rate: 155.2 symbols/min [2025-10-13T22:40:33.065897] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-13T22:40:33.068624] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:33.068783] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-13T22:40:33.072078] [INFO ] [MAIN ] Derivative Progress: 1068/1810 symbols completed. LEG took 1.2s. Estimated remaining: 4m 47s. Rate: 155.3 symbols/min [2025-10-13T22:40:33.072326] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:33.130552] [DEBUG] [LOCAL ] LGI: Loaded 10043 existing records from primary storage. [2025-10-13T22:40:33.130953] [DEBUG] [LOCAL ] LFT: Loaded 18325 existing records from primary storage. [2025-10-13T22:40:33.131115] [INFO ] [MAIN ] LFT: Loaded 18325 primary data records. [2025-10-13T22:40:33.132251] [DEBUG] [LOCAL ] LEVI: Loaded 51716 existing records from primary storage. [2025-10-13T22:40:33.131246] [INFO ] [MAIN ] LGI: Loaded 10043 primary data records. [2025-10-13T22:40:33.143788] [INFO ] [MAIN ] LEVI: Loaded 51716 primary data records. [2025-10-13T22:40:34.127634] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:34.128719] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18325 primary records. [2025-10-13T22:40:34.128955] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-13T22:40:34.148565] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-13T22:40:34.149926] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-13T22:40:34.153522] [INFO ] [MAIN ] Derivative Progress: 1069/1810 symbols completed. LFT took 1.1s. Estimated remaining: 4m 47s. Rate: 155.1 symbols/min [2025-10-13T22:40:34.153806] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:34.167996] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:34.180825] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:34.182599] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51716 primary records. [2025-10-13T22:40:34.181802] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10043 primary records. [2025-10-13T22:40:34.182711] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-13T22:40:34.182951] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-13T22:40:34.213628] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-13T22:40:34.214123] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-13T22:40:34.218180] [INFO ] [MAIN ] Derivative Progress: 1070/1810 symbols completed. LEVI took 1.2s. Estimated remaining: 4m 46s. Rate: 155.2 symbols/min [2025-10-13T22:40:34.218611] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:34.219558] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-13T22:40:34.220360] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-13T22:40:34.223448] [INFO ] [MAIN ] Derivative Progress: 1071/1810 symbols completed. LGI took 1.2s. Estimated remaining: 4m 45s. Rate: 155.3 symbols/min [2025-10-13T22:40:34.224272] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:34.251051] [DEBUG] [LOCAL ] LH: Loaded 37690 existing records from primary storage. [2025-10-13T22:40:34.251287] [INFO ] [MAIN ] LH: Loaded 37690 primary data records. [2025-10-13T22:40:34.387102] [DEBUG] [LOCAL ] LII: Loaded 27925 existing records from primary storage. [2025-10-13T22:40:34.387246] [INFO ] [MAIN ] LII: Loaded 27925 primary data records. [2025-10-13T22:40:34.693045] [DEBUG] [LOCAL ] LHX: Loaded 48591 existing records from primary storage. [2025-10-13T22:40:34.693796] [INFO ] [MAIN ] LHX: Loaded 48591 primary data records. [2025-10-13T22:40:35.263383] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:35.277820] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37690 primary records. [2025-10-13T22:40:35.279308] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-13T22:40:35.279087] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:35.280943] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27925 primary records. [2025-10-13T22:40:35.281988] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-13T22:40:35.305932] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-13T22:40:35.307662] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-13T22:40:35.313027] [INFO ] [MAIN ] Derivative Progress: 1072/1810 symbols completed. LH took 1.2s. Estimated remaining: 4m 46s. Rate: 155.1 symbols/min [2025-10-13T22:40:35.317473] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:35.317329] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-13T22:40:35.321043] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-13T22:40:35.324153] [INFO ] [MAIN ] Derivative Progress: 1073/1810 symbols completed. LII took 1.1s. Estimated remaining: 4m 45s. Rate: 155.2 symbols/min [2025-10-13T22:40:35.324496] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:35.340149] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:35.341026] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48591 primary records. [2025-10-13T22:40:35.341205] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-13T22:40:35.345267] [DEBUG] [LOCAL ] LITB: Loaded 4216 existing records from primary storage. [2025-10-13T22:40:35.345780] [INFO ] [MAIN ] LITB: Loaded 4216 primary data records. [2025-10-13T22:40:35.407367] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-13T22:40:35.435177] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-13T22:40:35.437775] [INFO ] [MAIN ] Derivative Progress: 1074/1810 symbols completed. LHX took 1.2s. Estimated remaining: 4m 44s. Rate: 155.3 symbols/min [2025-10-13T22:40:35.437956] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:35.701984] [DEBUG] [LOCAL ] LION: Loaded 46070 existing records from primary storage. [2025-10-13T22:40:35.702350] [INFO ] [MAIN ] LION: Loaded 46070 primary data records. [2025-10-13T22:40:35.955038] [DEBUG] [LOCAL ] LLY: Loaded 53276 existing records from primary storage. [2025-10-13T22:40:36.082360] [INFO ] [MAIN ] LLY: Loaded 53276 primary data records. [2025-10-13T22:40:36.256964] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:36.293628] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4216 primary records. [2025-10-13T22:40:36.473279] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-13T22:40:36.506622] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-13T22:40:36.507396] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-13T22:40:36.510472] [INFO ] [MAIN ] Derivative Progress: 1075/1810 symbols completed. LITB took 1.2s. Estimated remaining: 4m 44s. Rate: 155.1 symbols/min [2025-10-13T22:40:36.510961] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:36.534591] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:36.535946] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 46070 primary records. [2025-10-13T22:40:36.536251] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-13T22:40:36.553909] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-13T22:40:36.554249] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-13T22:40:36.556821] [INFO ] [MAIN ] Derivative Progress: 1076/1810 symbols completed. LION took 1.2s. Estimated remaining: 4m 44s. Rate: 155.2 symbols/min [2025-10-13T22:40:36.557067] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:36.594125] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:36.595159] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53276 primary records. [2025-10-13T22:40:36.595366] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-13T22:40:36.616255] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-13T22:40:36.633896] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-13T22:40:36.638280] [INFO ] [MAIN ] Derivative Progress: 1077/1810 symbols completed. LLY took 1.2s. Estimated remaining: 4m 43s. Rate: 155.3 symbols/min [2025-10-13T22:40:36.640258] [DEBUG] [LOCAL ] LMND: Loaded 52006 existing records from primary storage. [2025-10-13T22:40:36.640555] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:36.640776] [INFO ] [MAIN ] LMND: Loaded 52006 primary data records. [2025-10-13T22:40:36.797339] [DEBUG] [LOCAL ] LMT: Loaded 49667 existing records from primary storage. [2025-10-13T22:40:36.798866] [INFO ] [MAIN ] LMT: Loaded 49667 primary data records. [2025-10-13T22:40:37.321368] [DEBUG] [LOCAL ] LNC: Loaded 51595 existing records from primary storage. [2025-10-13T22:40:37.321583] [INFO ] [MAIN ] LNC: Loaded 51595 primary data records. [2025-10-13T22:40:37.631872] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:37.632847] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 52006 primary records. [2025-10-13T22:40:37.633103] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-13T22:40:37.650922] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-13T22:40:37.651269] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-13T22:40:37.653953] [INFO ] [MAIN ] Derivative Progress: 1078/1810 symbols completed. LMND took 1.1s. Estimated remaining: 4m 43s. Rate: 155.1 symbols/min [2025-10-13T22:40:37.671186] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:37.671873] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49667 primary records. [2025-10-13T22:40:37.672021] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-13T22:40:37.688229] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-13T22:40:37.688299] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-13T22:40:37.690809] [INFO ] [MAIN ] Derivative Progress: 1079/1810 symbols completed. LMT took 1.1s. Estimated remaining: 4m 43s. Rate: 155.2 symbols/min [2025-10-13T22:40:37.705514] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:37.706066] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51595 primary records. [2025-10-13T22:40:37.706124] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-13T22:40:37.721227] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-13T22:40:37.721286] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-13T22:40:37.723584] [INFO ] [MAIN ] Derivative Progress: 1080/1810 symbols completed. LNC took 1.1s. Estimated remaining: 4m 42s. Rate: 155.3 symbols/min [2025-10-13T22:40:37.724017] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:37.724181] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:37.724116] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:37.732067] [DEBUG] [LOCAL ] LND: Loaded 5002 existing records from primary storage. [2025-10-13T22:40:37.732353] [INFO ] [MAIN ] LND: Loaded 5002 primary data records. [2025-10-13T22:40:38.076957] [DEBUG] [LOCAL ] LOAR: Loaded 42298 existing records from primary storage. [2025-10-13T22:40:38.078551] [INFO ] [MAIN ] LOAR: Loaded 42298 primary data records. [2025-10-13T22:40:38.144847] [DEBUG] [LOCAL ] LNG: Loaded 51287 existing records from primary storage. [2025-10-13T22:40:38.162355] [INFO ] [MAIN ] LNG: Loaded 51287 primary data records. [2025-10-13T22:40:38.815933] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:38.817436] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 5002 primary records. [2025-10-13T22:40:38.817835] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-13T22:40:38.837634] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-13T22:40:38.838199] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-13T22:40:38.841513] [INFO ] [MAIN ] Derivative Progress: 1081/1810 symbols completed. LND took 1.1s. Estimated remaining: 4m 42s. Rate: 155.1 symbols/min [2025-10-13T22:40:38.842303] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:38.862551] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:38.865081] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42298 primary records. [2025-10-13T22:40:38.865320] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-13T22:40:38.894753] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:38.907505] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-13T22:40:38.905930] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51287 primary records. [2025-10-13T22:40:38.907745] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-13T22:40:38.907819] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-13T22:40:38.910715] [INFO ] [MAIN ] Derivative Progress: 1082/1810 symbols completed. LOAR took 1.2s. Estimated remaining: 4m 41s. Rate: 155.2 symbols/min [2025-10-13T22:40:38.911968] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:38.942610] [DEBUG] [LOCAL ] LOB: Loaded 26773 existing records from primary storage. [2025-10-13T22:40:38.944751] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-13T22:40:38.944853] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-13T22:40:38.944991] [INFO ] [MAIN ] LOB: Loaded 26773 primary data records. [2025-10-13T22:40:38.947393] [INFO ] [MAIN ] Derivative Progress: 1083/1810 symbols completed. LNG took 1.2s. Estimated remaining: 4m 41s. Rate: 155.3 symbols/min [2025-10-13T22:40:38.992078] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:38.985395] [DEBUG] [LOCAL ] LOCL: Loaded 3674 existing records from primary storage. [2025-10-13T22:40:39.002369] [INFO ] [MAIN ] LOCL: Loaded 3674 primary data records. [2025-10-13T22:40:39.326500] [DEBUG] [LOCAL ] LOMA: Loaded 32558 existing records from primary storage. [2025-10-13T22:40:39.342698] [INFO ] [MAIN ] LOMA: Loaded 32558 primary data records. [2025-10-13T22:40:39.932048] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:39.929504] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:39.933823] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3674 primary records. [2025-10-13T22:40:39.934480] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 26773 primary records. [2025-10-13T22:40:39.934678] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-13T22:40:39.934615] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-13T22:40:39.974769] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-13T22:40:39.975330] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:39.976569] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-13T22:40:39.979551] [INFO ] [MAIN ] Derivative Progress: 1084/1810 symbols completed. LOCL took 1.1s. Estimated remaining: 4m 41s. Rate: 155.1 symbols/min [2025-10-13T22:40:39.981334] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:39.980744] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32558 primary records. [2025-10-13T22:40:39.981872] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-13T22:40:39.994713] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-13T22:40:39.998197] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-13T22:40:40.004736] [INFO ] [MAIN ] Derivative Progress: 1085/1810 symbols completed. LOB took 1.2s. Estimated remaining: 4m 40s. Rate: 155.2 symbols/min [2025-10-13T22:40:40.005155] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:40.004900] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-13T22:40:40.005753] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-13T22:40:40.009049] [INFO ] [MAIN ] Derivative Progress: 1086/1810 symbols completed. LOMA took 1.0s. Estimated remaining: 4m 40s. Rate: 155.3 symbols/min [2025-10-13T22:40:40.009402] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:40.044830] [DEBUG] [LOCAL ] LPL: Loaded 27908 existing records from primary storage. [2025-10-13T22:40:40.058993] [INFO ] [MAIN ] LPL: Loaded 27908 primary data records. [2025-10-13T22:40:40.171367] [DEBUG] [LOCAL ] LPG: Loaded 39569 existing records from primary storage. [2025-10-13T22:40:40.196411] [INFO ] [MAIN ] LPG: Loaded 39569 primary data records. [2025-10-13T22:40:40.231239] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-13T22:40:40.284141] [INFO ] [MAIN ] LOW: Loaded 52993 primary data records. [2025-10-13T22:40:41.045313] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:41.046813] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 27908 primary records. [2025-10-13T22:40:41.046962] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-13T22:40:41.064120] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-13T22:40:41.064335] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-13T22:40:41.066446] [INFO ] [MAIN ] Derivative Progress: 1087/1810 symbols completed. LPL took 1.1s. Estimated remaining: 4m 40s. Rate: 155.1 symbols/min [2025-10-13T22:40:41.066927] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:41.086925] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:41.100623] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39569 primary records. [2025-10-13T22:40:41.101398] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-13T22:40:41.101321] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:41.102870] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52993 primary records. [2025-10-13T22:40:41.103199] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-13T22:40:41.131080] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-13T22:40:41.133542] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-13T22:40:41.136234] [INFO ] [MAIN ] Derivative Progress: 1088/1810 symbols completed. LOW took 1.2s. Estimated remaining: 4m 39s. Rate: 155.2 symbols/min [2025-10-13T22:40:41.137059] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:41.149882] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-13T22:40:41.149994] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-13T22:40:41.152887] [INFO ] [MAIN ] Derivative Progress: 1089/1810 symbols completed. LPG took 1.1s. Estimated remaining: 4m 38s. Rate: 155.3 symbols/min [2025-10-13T22:40:41.153214] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:41.175313] [DEBUG] [LOCAL ] LPX: Loaded 40079 existing records from primary storage. [2025-10-13T22:40:41.175492] [INFO ] [MAIN ] LPX: Loaded 40079 primary data records. [2025-10-13T22:40:41.339308] [DEBUG] [LOCAL ] LSPD: Loaded 42619 existing records from primary storage. [2025-10-13T22:40:41.340055] [INFO ] [MAIN ] LSPD: Loaded 42619 primary data records. [2025-10-13T22:40:41.519396] [DEBUG] [LOCAL ] LRN: Loaded 39598 existing records from primary storage. [2025-10-13T22:40:41.553907] [INFO ] [MAIN ] LRN: Loaded 39598 primary data records. [2025-10-13T22:40:42.227413] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:42.229097] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 40079 primary records. [2025-10-13T22:40:42.229478] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-13T22:40:42.258530] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-13T22:40:42.258849] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-13T22:40:42.274140] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:42.275385] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42619 primary records. [2025-10-13T22:40:42.273750] [INFO ] [MAIN ] Derivative Progress: 1090/1810 symbols completed. LPX took 1.2s. Estimated remaining: 4m 39s. Rate: 155.1 symbols/min [2025-10-13T22:40:42.275626] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:42.275730] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-13T22:40:42.309139] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-13T22:40:42.309739] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:42.310692] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39598 primary records. [2025-10-13T22:40:42.310977] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-13T22:40:42.310778] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-13T22:40:42.313632] [INFO ] [MAIN ] Derivative Progress: 1091/1810 symbols completed. LSPD took 1.2s. Estimated remaining: 4m 38s. Rate: 155.2 symbols/min [2025-10-13T22:40:42.314860] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:42.340511] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-13T22:40:42.340777] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-13T22:40:42.343683] [INFO ] [MAIN ] Derivative Progress: 1092/1810 symbols completed. LRN took 1.2s. Estimated remaining: 4m 37s. Rate: 155.3 symbols/min [2025-10-13T22:40:42.344042] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:42.358404] [DEBUG] [LOCAL ] LTC: Loaded 30464 existing records from primary storage. [2025-10-13T22:40:42.358824] [INFO ] [MAIN ] LTC: Loaded 30464 primary data records. [2025-10-13T22:40:42.660343] [DEBUG] [LOCAL ] LTM: Loaded 38494 existing records from primary storage. [2025-10-13T22:40:42.759951] [DEBUG] [LOCAL ] LTH: Loaded 51751 existing records from primary storage. [2025-10-13T22:40:42.760396] [INFO ] [MAIN ] LTH: Loaded 51751 primary data records. [2025-10-13T22:40:42.770156] [INFO ] [MAIN ] LTM: Loaded 38494 primary data records. [2025-10-13T22:40:43.484874] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:43.487262] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30464 primary records. [2025-10-13T22:40:43.487542] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-13T22:40:43.506673] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-13T22:40:43.507767] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-13T22:40:43.511221] [INFO ] [MAIN ] Derivative Progress: 1093/1810 symbols completed. LTC took 1.2s. Estimated remaining: 4m 37s. Rate: 155.0 symbols/min [2025-10-13T22:40:43.529700] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:43.530511] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51751 primary records. [2025-10-13T22:40:43.530673] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-13T22:40:43.559432] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:43.560634] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 38494 primary records. [2025-10-13T22:40:43.560961] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-13T22:40:43.563366] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-13T22:40:43.563604] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-13T22:40:43.573685] [INFO ] [MAIN ] Derivative Progress: 1094/1810 symbols completed. LTH took 1.3s. Estimated remaining: 4m 37s. Rate: 155.2 symbols/min [2025-10-13T22:40:43.581459] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-13T22:40:43.581522] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-13T22:40:43.584470] [INFO ] [MAIN ] Derivative Progress: 1095/1810 symbols completed. LTM took 1.2s. Estimated remaining: 4m 36s. Rate: 155.3 symbols/min [2025-10-13T22:40:43.585030] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:43.584960] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:43.585203] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:43.611850] [DEBUG] [LOCAL ] LUCK: Loaded 24238 existing records from primary storage. [2025-10-13T22:40:43.612018] [INFO ] [MAIN ] LUCK: Loaded 24238 primary data records. [2025-10-13T22:40:43.958838] [DEBUG] [LOCAL ] LU: Loaded 48999 existing records from primary storage. [2025-10-13T22:40:43.961726] [INFO ] [MAIN ] LU: Loaded 48999 primary data records. [2025-10-13T22:40:43.960436] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-13T22:40:43.962011] [INFO ] [MAIN ] LUMN: Loaded 53646 primary data records. [2025-10-13T22:40:44.700111] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:44.701778] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24238 primary records. [2025-10-13T22:40:44.702025] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-13T22:40:44.720929] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-13T22:40:44.722111] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-13T22:40:44.725631] [INFO ] [MAIN ] Derivative Progress: 1096/1810 symbols completed. LUCK took 1.1s. Estimated remaining: 4m 36s. Rate: 155.0 symbols/min [2025-10-13T22:40:44.726194] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:44.749210] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:44.762860] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53646 primary records. [2025-10-13T22:40:44.763053] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-13T22:40:44.763762] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:44.765158] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48999 primary records. [2025-10-13T22:40:44.765504] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-13T22:40:44.798294] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-13T22:40:44.798502] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-13T22:40:44.801056] [INFO ] [MAIN ] Derivative Progress: 1097/1810 symbols completed. LU took 1.2s. Estimated remaining: 4m 36s. Rate: 155.1 symbols/min [2025-10-13T22:40:44.791534] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-13T22:40:44.801535] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-13T22:40:44.801220] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:44.804071] [INFO ] [MAIN ] Derivative Progress: 1098/1810 symbols completed. LUMN took 1.2s. Estimated remaining: 4m 35s. Rate: 155.3 symbols/min [2025-10-13T22:40:44.804275] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:44.842324] [DEBUG] [LOCAL ] LVWR: Loaded 18399 existing records from primary storage. [2025-10-13T22:40:44.842547] [INFO ] [MAIN ] LVWR: Loaded 18399 primary data records. [2025-10-13T22:40:44.922266] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-13T22:40:44.956461] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-13T22:40:45.160133] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-13T22:40:45.279726] [INFO ] [MAIN ] LVS: Loaded 53570 primary data records. [2025-10-13T22:40:45.837161] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:45.838541] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18399 primary records. [2025-10-13T22:40:45.839815] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-13T22:40:45.874115] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:45.877416] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-13T22:40:45.878816] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-13T22:40:45.910421] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-13T22:40:45.899037] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-13T22:40:45.911119] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-13T22:40:45.911024] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:45.911986] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53570 primary records. [2025-10-13T22:40:45.911272] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-13T22:40:45.914809] [INFO ] [MAIN ] Derivative Progress: 1099/1810 symbols completed. LUV took 1.2s. Estimated remaining: 4m 35s. Rate: 155.0 symbols/min [2025-10-13T22:40:45.915025] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-13T22:40:45.915175] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:45.918086] [INFO ] [MAIN ] Derivative Progress: 1100/1810 symbols completed. LVWR took 1.1s. Estimated remaining: 4m 35s. Rate: 155.2 symbols/min [2025-10-13T22:40:45.919153] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:45.936608] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-13T22:40:45.936753] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-13T22:40:45.939596] [INFO ] [MAIN ] Derivative Progress: 1101/1810 symbols completed. LVS took 1.1s. Estimated remaining: 4m 34s. Rate: 155.3 symbols/min [2025-10-13T22:40:45.939938] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:45.955588] [DEBUG] [LOCAL ] LXFR: Loaded 16750 existing records from primary storage. [2025-10-13T22:40:45.955825] [INFO ] [MAIN ] LXFR: Loaded 16750 primary data records. [2025-10-13T22:40:46.184316] [DEBUG] [LOCAL ] LW: Loaded 51248 existing records from primary storage. [2025-10-13T22:40:46.205199] [INFO ] [MAIN ] LW: Loaded 51248 primary data records. [2025-10-13T22:40:46.306900] [DEBUG] [LOCAL ] LXP: Loaded 50766 existing records from primary storage. [2025-10-13T22:40:46.320679] [INFO ] [MAIN ] LXP: Loaded 50766 primary data records. [2025-10-13T22:40:47.049913] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:47.051451] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16750 primary records. [2025-10-13T22:40:47.051983] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-13T22:40:47.072105] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-13T22:40:47.072421] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-13T22:40:47.075624] [INFO ] [MAIN ] Derivative Progress: 1102/1810 symbols completed. LXFR took 1.2s. Estimated remaining: 4m 34s. Rate: 155.0 symbols/min [2025-10-13T22:40:47.075976] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:47.093735] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:47.094572] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51248 primary records. [2025-10-13T22:40:47.095049] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-13T22:40:47.138367] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-13T22:40:47.138806] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-13T22:40:47.138729] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:47.141342] [INFO ] [MAIN ] Derivative Progress: 1103/1810 symbols completed. LW took 1.2s. Estimated remaining: 4m 33s. Rate: 155.1 symbols/min [2025-10-13T22:40:47.142192] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50766 primary records. [2025-10-13T22:40:47.142426] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:47.142558] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-13T22:40:47.169399] [DEBUG] [LOCAL ] LXU: Loaded 31881 existing records from primary storage. [2025-10-13T22:40:47.170290] [INFO ] [MAIN ] LXU: Loaded 31881 primary data records. [2025-10-13T22:40:47.170942] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-13T22:40:47.182788] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-13T22:40:47.228535] [INFO ] [MAIN ] Derivative Progress: 1104/1810 symbols completed. LXP took 1.3s. Estimated remaining: 4m 33s. Rate: 155.2 symbols/min [2025-10-13T22:40:47.243674] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:47.530678] [DEBUG] [LOCAL ] LYB: Loaded 53612 existing records from primary storage. [2025-10-13T22:40:47.532303] [INFO ] [MAIN ] LYB: Loaded 53612 primary data records. [2025-10-13T22:40:47.658012] [DEBUG] [LOCAL ] LYG: Loaded 52750 existing records from primary storage. [2025-10-13T22:40:47.658329] [INFO ] [MAIN ] LYG: Loaded 52750 primary data records. [2025-10-13T22:40:48.059449] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:48.064403] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31881 primary records. [2025-10-13T22:40:48.180027] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-13T22:40:48.200583] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-13T22:40:48.201485] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-13T22:40:48.204408] [INFO ] [MAIN ] Derivative Progress: 1105/1810 symbols completed. LXU took 1.1s. Estimated remaining: 4m 33s. Rate: 155.0 symbols/min [2025-10-13T22:40:48.204902] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:48.227115] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:48.229823] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53612 primary records. [2025-10-13T22:40:48.230007] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-13T22:40:48.243872] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:48.253106] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52750 primary records. [2025-10-13T22:40:48.257492] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-13T22:40:48.267841] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-13T22:40:48.271720] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-13T22:40:48.274348] [INFO ] [MAIN ] Derivative Progress: 1106/1810 symbols completed. LYB took 1.1s. Estimated remaining: 4m 32s. Rate: 155.1 symbols/min [2025-10-13T22:40:48.288146] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:48.292860] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-13T22:40:48.293031] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-13T22:40:48.295555] [INFO ] [MAIN ] Derivative Progress: 1107/1810 symbols completed. LYG took 1.1s. Estimated remaining: 4m 32s. Rate: 155.3 symbols/min [2025-10-13T22:40:48.295839] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:48.318633] [DEBUG] [LOCAL ] LYV: Loaded 51146 existing records from primary storage. [2025-10-13T22:40:48.318933] [INFO ] [MAIN ] LYV: Loaded 51146 primary data records. [2025-10-13T22:40:48.360571] [DEBUG] [LOCAL ] LZM: Loaded 14519 existing records from primary storage. [2025-10-13T22:40:48.399319] [INFO ] [MAIN ] LZM: Loaded 14519 primary data records. [2025-10-13T22:40:48.634425] [DEBUG] [LOCAL ] LZB: Loaded 35162 existing records from primary storage. [2025-10-13T22:40:48.744717] [INFO ] [MAIN ] LZB: Loaded 35162 primary data records. [2025-10-13T22:40:49.310263] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:49.311252] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51146 primary records. [2025-10-13T22:40:49.311492] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-13T22:40:49.341771] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:49.343272] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14519 primary records. [2025-10-13T22:40:49.343787] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-13T22:40:49.346464] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-13T22:40:49.346574] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-13T22:40:49.349015] [INFO ] [MAIN ] Derivative Progress: 1108/1810 symbols completed. LYV took 1.1s. Estimated remaining: 4m 32s. Rate: 155.0 symbols/min [2025-10-13T22:40:49.377845] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-13T22:40:49.378106] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:49.378860] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35162 primary records. [2025-10-13T22:40:49.378952] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-13T22:40:49.379031] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-13T22:40:49.381579] [INFO ] [MAIN ] Derivative Progress: 1109/1810 symbols completed. LZM took 1.1s. Estimated remaining: 4m 31s. Rate: 155.2 symbols/min [2025-10-13T22:40:49.396334] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-13T22:40:49.396391] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-13T22:40:49.398971] [INFO ] [MAIN ] Derivative Progress: 1110/1810 symbols completed. LZB took 1.1s. Estimated remaining: 4m 30s. Rate: 155.3 symbols/min [2025-10-13T22:40:49.399345] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:49.399445] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:49.399513] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:49.472192] [DEBUG] [LOCAL ] MA: Loaded 52495 existing records from primary storage. [2025-10-13T22:40:49.472400] [INFO ] [MAIN ] MA: Loaded 52495 primary data records. [2025-10-13T22:40:49.604214] [DEBUG] [LOCAL ] MAA: Loaded 42748 existing records from primary storage. [2025-10-13T22:40:49.608320] [INFO ] [MAIN ] MAA: Loaded 42748 primary data records. [2025-10-13T22:40:49.630390] [DEBUG] [LOCAL ] M: Loaded 53546 existing records from primary storage. [2025-10-13T22:40:49.688385] [INFO ] [MAIN ] M: Loaded 53546 primary data records. [2025-10-13T22:40:50.467742] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:50.469181] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52495 primary records. [2025-10-13T22:40:50.469297] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-13T22:40:50.487013] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-13T22:40:50.489173] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-13T22:40:50.491984] [INFO ] [MAIN ] Derivative Progress: 1111/1810 symbols completed. MA took 1.1s. Estimated remaining: 4m 31s. Rate: 155.0 symbols/min [2025-10-13T22:40:50.492431] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:50.506857] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:50.507900] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42748 primary records. [2025-10-13T22:40:50.509070] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-13T22:40:50.536086] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:50.537400] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53546 primary records. [2025-10-13T22:40:50.537496] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-13T22:40:50.556173] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-13T22:40:50.556934] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-13T22:40:50.560012] [INFO ] [MAIN ] Derivative Progress: 1112/1810 symbols completed. M took 1.2s. Estimated remaining: 4m 30s. Rate: 155.2 symbols/min [2025-10-13T22:40:50.560733] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:50.573119] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-13T22:40:50.573389] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-13T22:40:50.575779] [INFO ] [MAIN ] Derivative Progress: 1113/1810 symbols completed. MAA took 1.2s. Estimated remaining: 4m 29s. Rate: 155.3 symbols/min [2025-10-13T22:40:50.576040] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:50.605222] [DEBUG] [LOCAL ] MAC: Loaded 49667 existing records from primary storage. [2025-10-13T22:40:50.605431] [INFO ] [MAIN ] MAC: Loaded 49667 primary data records. [2025-10-13T22:40:50.715444] [DEBUG] [LOCAL ] MAGN: Loaded 35865 existing records from primary storage. [2025-10-13T22:40:50.746146] [INFO ] [MAIN ] MAGN: Loaded 35865 primary data records. [2025-10-13T22:40:51.118950] [DEBUG] [LOCAL ] MAIN: Loaded 41692 existing records from primary storage. [2025-10-13T22:40:51.152714] [INFO ] [MAIN ] MAIN: Loaded 41692 primary data records. [2025-10-13T22:40:51.582054] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:51.583554] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49667 primary records. [2025-10-13T22:40:51.583917] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-13T22:40:51.604862] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-13T22:40:51.605970] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-13T22:40:51.608290] [INFO ] [MAIN ] Derivative Progress: 1114/1810 symbols completed. MAC took 1.1s. Estimated remaining: 4m 29s. Rate: 155.1 symbols/min [2025-10-13T22:40:51.608497] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:51.623229] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:51.623960] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35865 primary records. [2025-10-13T22:40:51.624396] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-13T22:40:51.654861] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:51.655524] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41692 primary records. [2025-10-13T22:40:51.655585] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-13T22:40:51.672679] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-13T22:40:51.682792] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-13T22:40:51.685566] [INFO ] [MAIN ] Derivative Progress: 1115/1810 symbols completed. MAGN took 1.1s. Estimated remaining: 4m 29s. Rate: 155.2 symbols/min [2025-10-13T22:40:51.686525] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:51.688629] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-13T22:40:51.688761] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-13T22:40:51.692230] [INFO ] [MAIN ] Derivative Progress: 1116/1810 symbols completed. MAIN took 1.1s. Estimated remaining: 4m 28s. Rate: 155.3 symbols/min [2025-10-13T22:40:51.692707] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:51.713920] [DEBUG] [LOCAL ] MAN: Loaded 43860 existing records from primary storage. [2025-10-13T22:40:51.714172] [INFO ] [MAIN ] MAN: Loaded 43860 primary data records. [2025-10-13T22:40:51.843804] [DEBUG] [LOCAL ] MANU: Loaded 26909 existing records from primary storage. [2025-10-13T22:40:51.864610] [INFO ] [MAIN ] MANU: Loaded 26909 primary data records. [2025-10-13T22:40:52.184954] [DEBUG] [LOCAL ] MAS: Loaded 52261 existing records from primary storage. [2025-10-13T22:40:52.196897] [INFO ] [MAIN ] MAS: Loaded 52261 primary data records. [2025-10-13T22:40:52.758517] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:52.759895] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43860 primary records. [2025-10-13T22:40:52.760031] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-13T22:40:52.780456] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-13T22:40:52.781790] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-13T22:40:52.784104] [INFO ] [MAIN ] Derivative Progress: 1117/1810 symbols completed. MAN took 1.2s. Estimated remaining: 4m 28s. Rate: 155.1 symbols/min [2025-10-13T22:40:52.784796] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:52.799199] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:52.800120] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26909 primary records. [2025-10-13T22:40:52.800352] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-13T22:40:52.819853] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-13T22:40:52.820279] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-13T22:40:52.822962] [INFO ] [MAIN ] Derivative Progress: 1118/1810 symbols completed. MANU took 1.1s. Estimated remaining: 4m 28s. Rate: 155.2 symbols/min [2025-10-13T22:40:52.835573] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:52.835959] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:52.836974] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52261 primary records. [2025-10-13T22:40:52.837422] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-13T22:40:52.873731] [DEBUG] [LOCAL ] MATV: Loaded 35685 existing records from primary storage. [2025-10-13T22:40:52.873151] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-13T22:40:52.873859] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-13T22:40:52.876460] [INFO ] [MAIN ] Derivative Progress: 1119/1810 symbols completed. MAS took 1.2s. Estimated remaining: 4m 27s. Rate: 155.3 symbols/min [2025-10-13T22:40:52.873946] [INFO ] [MAIN ] MATV: Loaded 35685 primary data records. [2025-10-13T22:40:52.876766] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:53.186125] [DEBUG] [LOCAL ] MATX: Loaded 31771 existing records from primary storage. [2025-10-13T22:40:53.195025] [INFO ] [MAIN ] MATX: Loaded 31771 primary data records. [2025-10-13T22:40:53.308667] [DEBUG] [LOCAL ] MAX: Loaded 30984 existing records from primary storage. [2025-10-13T22:40:53.320386] [INFO ] [MAIN ] MAX: Loaded 30984 primary data records. [2025-10-13T22:40:53.847673] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:53.849298] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 35685 primary records. [2025-10-13T22:40:53.849520] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-13T22:40:53.866358] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-13T22:40:53.866442] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-13T22:40:53.868726] [INFO ] [MAIN ] Derivative Progress: 1120/1810 symbols completed. MATV took 1.1s. Estimated remaining: 4m 27s. Rate: 155.1 symbols/min [2025-10-13T22:40:53.869001] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:53.888278] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:53.889045] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31771 primary records. [2025-10-13T22:40:53.889169] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-13T22:40:53.906940] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-13T22:40:53.908839] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-13T22:40:53.912535] [INFO ] [MAIN ] Derivative Progress: 1121/1810 symbols completed. MATX took 1.1s. Estimated remaining: 4m 26s. Rate: 155.2 symbols/min [2025-10-13T22:40:53.912973] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:53.926598] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:53.938032] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30984 primary records. [2025-10-13T22:40:53.938096] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-13T22:40:53.953720] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-13T22:40:53.953857] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-13T22:40:53.956682] [INFO ] [MAIN ] Derivative Progress: 1122/1810 symbols completed. MAX took 1.1s. Estimated remaining: 4m 26s. Rate: 155.3 symbols/min [2025-10-13T22:40:53.957699] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:53.975933] [DEBUG] [LOCAL ] MBC: Loaded 43762 existing records from primary storage. [2025-10-13T22:40:53.976255] [INFO ] [MAIN ] MBC: Loaded 43762 primary data records. [2025-10-13T22:40:54.086430] [DEBUG] [LOCAL ] MBI: Loaded 24337 existing records from primary storage. [2025-10-13T22:40:54.097763] [INFO ] [MAIN ] MBI: Loaded 24337 primary data records. [2025-10-13T22:40:54.411169] [DEBUG] [LOCAL ] MC: Loaded 44007 existing records from primary storage. [2025-10-13T22:40:54.411449] [INFO ] [MAIN ] MC: Loaded 44007 primary data records. [2025-10-13T22:40:54.976896] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:54.979453] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43762 primary records. [2025-10-13T22:40:54.979746] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-13T22:40:55.002487] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:55.007628] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24337 primary records. [2025-10-13T22:40:55.008321] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-13T22:40:55.031502] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-13T22:40:55.032307] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-13T22:40:55.036162] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-13T22:40:55.036426] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-13T22:40:55.035582] [INFO ] [MAIN ] Derivative Progress: 1123/1810 symbols completed. MBI took 1.1s. Estimated remaining: 4m 26s. Rate: 155.1 symbols/min [2025-10-13T22:40:55.051522] [INFO ] [MAIN ] Derivative Progress: 1124/1810 symbols completed. MBC took 1.2s. Estimated remaining: 4m 25s. Rate: 155.2 symbols/min [2025-10-13T22:40:55.051867] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:55.052715] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44007 primary records. [2025-10-13T22:40:55.052910] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-13T22:40:55.068348] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-13T22:40:55.068406] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-13T22:40:55.071285] [INFO ] [MAIN ] Derivative Progress: 1125/1810 symbols completed. MC took 1.1s. Estimated remaining: 4m 25s. Rate: 155.3 symbols/min [2025-10-13T22:40:55.071854] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:55.071790] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:55.071726] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:55.085072] [DEBUG] [LOCAL ] MCI: Loaded 6520 existing records from primary storage. [2025-10-13T22:40:55.085383] [INFO ] [MAIN ] MCI: Loaded 6520 primary data records. [2025-10-13T22:40:55.132149] [DEBUG] [LOCAL ] MCB: Loaded 11344 existing records from primary storage. [2025-10-13T22:40:55.152520] [INFO ] [MAIN ] MCB: Loaded 11344 primary data records. [2025-10-13T22:40:55.341233] [DEBUG] [LOCAL ] MCK: Loaded 38713 existing records from primary storage. [2025-10-13T22:40:55.362207] [INFO ] [MAIN ] MCK: Loaded 38713 primary data records. [2025-10-13T22:40:56.060920] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:56.061977] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6520 primary records. [2025-10-13T22:40:56.063094] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-13T22:40:56.094092] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-13T22:40:56.094306] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-13T22:40:56.096843] [INFO ] [MAIN ] Derivative Progress: 1126/1810 symbols completed. MCI took 1.0s. Estimated remaining: 4m 25s. Rate: 155.1 symbols/min [2025-10-13T22:40:56.097148] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:56.097622] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:56.099228] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11344 primary records. [2025-10-13T22:40:56.099431] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-13T22:40:56.119756] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-13T22:40:56.119983] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-13T22:40:56.122690] [INFO ] [MAIN ] Derivative Progress: 1127/1810 symbols completed. MCB took 1.1s. Estimated remaining: 4m 24s. Rate: 155.2 symbols/min [2025-10-13T22:40:56.140417] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:56.140556] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:56.141416] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38713 primary records. [2025-10-13T22:40:56.141599] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-13T22:40:56.142125] [DEBUG] [LOCAL ] MCN: Loaded 8171 existing records from primary storage. [2025-10-13T22:40:56.143806] [INFO ] [MAIN ] MCN: Loaded 8171 primary data records. [2025-10-13T22:40:56.274921] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-13T22:40:56.275460] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-13T22:40:56.304731] [INFO ] [MAIN ] Derivative Progress: 1128/1810 symbols completed. MCK took 1.2s. Estimated remaining: 4m 23s. Rate: 155.3 symbols/min [2025-10-13T22:40:56.335956] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:56.491481] [DEBUG] [LOCAL ] MCO: Loaded 39381 existing records from primary storage. [2025-10-13T22:40:56.495185] [INFO ] [MAIN ] MCO: Loaded 39381 primary data records. [2025-10-13T22:40:56.565410] [DEBUG] [LOCAL ] MCR: Loaded 8867 existing records from primary storage. [2025-10-13T22:40:56.601169] [INFO ] [MAIN ] MCR: Loaded 8867 primary data records. [2025-10-13T22:40:57.184078] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:57.186293] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8171 primary records. [2025-10-13T22:40:57.187042] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-13T22:40:57.206760] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-13T22:40:57.208411] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-13T22:40:57.212294] [INFO ] [MAIN ] Derivative Progress: 1129/1810 symbols completed. MCN took 1.1s. Estimated remaining: 4m 23s. Rate: 155.1 symbols/min [2025-10-13T22:40:57.214177] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:57.229231] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:57.230175] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39381 primary records. [2025-10-13T22:40:57.230539] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-13T22:40:57.247170] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-13T22:40:57.247458] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-13T22:40:57.249948] [INFO ] [MAIN ] Derivative Progress: 1130/1810 symbols completed. MCO took 1.1s. Estimated remaining: 4m 23s. Rate: 155.3 symbols/min [2025-10-13T22:40:57.250270] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:57.275900] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:57.276819] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8867 primary records. [2025-10-13T22:40:57.276920] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-13T22:40:57.304755] [DEBUG] [LOCAL ] MCS: Loaded 20981 existing records from primary storage. [2025-10-13T22:40:57.306870] [INFO ] [MAIN ] MCS: Loaded 20981 primary data records. [2025-10-13T22:40:57.307845] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-13T22:40:57.338787] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-13T22:40:57.347863] [INFO ] [MAIN ] Derivative Progress: 1131/1810 symbols completed. MCR took 1.0s. Estimated remaining: 4m 22s. Rate: 155.4 symbols/min [2025-10-13T22:40:57.354858] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:57.402763] [DEBUG] [LOCAL ] MCY: Loaded 23898 existing records from primary storage. [2025-10-13T22:40:57.425293] [INFO ] [MAIN ] MCY: Loaded 23898 primary data records. [2025-10-13T22:40:57.785568] [DEBUG] [LOCAL ] MD: Loaded 38560 existing records from primary storage. [2025-10-13T22:40:57.796148] [INFO ] [MAIN ] MD: Loaded 38560 primary data records. [2025-10-13T22:40:58.339675] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:58.341182] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20981 primary records. [2025-10-13T22:40:58.341474] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-13T22:40:58.364158] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-13T22:40:58.364462] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-13T22:40:58.367568] [INFO ] [MAIN ] Derivative Progress: 1132/1810 symbols completed. MCS took 1.2s. Estimated remaining: 4m 22s. Rate: 155.1 symbols/min [2025-10-13T22:40:58.368106] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:58.385238] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:58.386316] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 23898 primary records. [2025-10-13T22:40:58.386587] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-13T22:40:58.402196] [DEBUG] [LOCAL ] MDST: Loaded 5880 existing records from primary storage. [2025-10-13T22:40:58.410413] [INFO ] [MAIN ] MDST: Loaded 5880 primary data records. [2025-10-13T22:40:58.477377] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:58.495292] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38560 primary records. [2025-10-13T22:40:58.505963] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-13T22:40:58.512002] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-13T22:40:58.525776] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-13T22:40:58.529179] [INFO ] [MAIN ] Derivative Progress: 1133/1810 symbols completed. MCY took 1.3s. Estimated remaining: 4m 22s. Rate: 155.2 symbols/min [2025-10-13T22:40:58.534542] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:58.656393] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-13T22:40:58.823386] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-13T22:40:58.843208] [INFO ] [MAIN ] Derivative Progress: 1134/1810 symbols completed. MD took 1.5s. Estimated remaining: 4m 21s. Rate: 155.2 symbols/min [2025-10-13T22:40:58.843755] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:58.887794] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-13T22:40:58.888385] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-13T22:40:59.018951] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:40:59.036566] [INFO ] [MAIN ] MDST: Generated 1793 derivative records from 5880 primary records. [2025-10-13T22:40:59.068762] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-13T22:40:59.257373] [DEBUG] [LOCAL ] MDU: Loaded 48090 existing records from primary storage. [2025-10-13T22:40:59.261957] [INFO ] [MAIN ] MDU: Loaded 48090 primary data records. [2025-10-13T22:40:59.262844] [DEBUG] [LOCAL ] MDST: Derivative data saved (1793 records). [2025-10-13T22:40:59.263182] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-13T22:40:59.265683] [INFO ] [MAIN ] Derivative Progress: 1135/1810 symbols completed. MDST took 0.9s. Estimated remaining: 4m 21s. Rate: 155.2 symbols/min [2025-10-13T22:40:59.278351] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:59.432579] [DEBUG] [LOCAL ] MDV: Loaded 8497 existing records from primary storage. [2025-10-13T22:40:59.462603] [INFO ] [MAIN ] MDV: Loaded 8497 primary data records. [2025-10-13T22:40:59.724348] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:59.764638] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-13T22:40:59.801292] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-13T22:40:59.954680] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-13T22:40:59.955002] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-13T22:40:59.958323] [INFO ] [MAIN ] Derivative Progress: 1136/1810 symbols completed. MDT took 1.4s. Estimated remaining: 4m 21s. Rate: 155.1 symbols/min [2025-10-13T22:40:59.959492] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:40:59.975953] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:40:59.977104] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48090 primary records. [2025-10-13T22:40:59.977446] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-13T22:40:59.998831] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-13T22:40:59.999275] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-13T22:41:00.001611] [INFO ] [MAIN ] Derivative Progress: 1137/1810 symbols completed. MDU took 1.2s. Estimated remaining: 4m 20s. Rate: 155.2 symbols/min [2025-10-13T22:41:00.001823] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:00.011933] [DEBUG] [LOCAL ] MEC: Loaded 16301 existing records from primary storage. [2025-10-13T22:41:00.012243] [INFO ] [MAIN ] MEC: Loaded 16301 primary data records. [2025-10-13T22:41:00.116980] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:00.142093] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8497 primary records. [2025-10-13T22:41:00.160616] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-13T22:41:00.190621] [DEBUG] [LOCAL ] MED: Loaded 21262 existing records from primary storage. [2025-10-13T22:41:00.231089] [INFO ] [MAIN ] MED: Loaded 21262 primary data records. [2025-10-13T22:41:00.457940] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-13T22:41:00.461402] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-13T22:41:00.463742] [INFO ] [MAIN ] Derivative Progress: 1138/1810 symbols completed. MDV took 1.2s. Estimated remaining: 4m 20s. Rate: 155.2 symbols/min [2025-10-13T22:41:00.674084] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:00.674921] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16301 primary records. [2025-10-13T22:41:00.675763] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-13T22:41:00.692391] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-13T22:41:00.692477] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-13T22:41:00.694947] [INFO ] [MAIN ] Derivative Progress: 1139/1810 symbols completed. MEC took 0.7s. Estimated remaining: 4m 19s. Rate: 155.3 symbols/min [2025-10-13T22:41:00.709767] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:00.710272] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21262 primary records. [2025-10-13T22:41:00.710328] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-13T22:41:00.725333] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-13T22:41:00.725388] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-13T22:41:00.728132] [INFO ] [MAIN ] Derivative Progress: 1140/1810 symbols completed. MED took 0.7s. Estimated remaining: 4m 19s. Rate: 155.4 symbols/min [2025-10-13T22:41:00.728509] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:00.728671] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:00.728988] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:00.763358] [DEBUG] [LOCAL ] MEGI: Loaded 19820 existing records from primary storage. [2025-10-13T22:41:00.763569] [INFO ] [MAIN ] MEGI: Loaded 19820 primary data records. [2025-10-13T22:41:00.842314] [DEBUG] [LOCAL ] MEG: Loaded 31520 existing records from primary storage. [2025-10-13T22:41:00.862494] [INFO ] [MAIN ] MEG: Loaded 31520 primary data records. [2025-10-13T22:41:00.923982] [DEBUG] [LOCAL ] MEI: Loaded 31737 existing records from primary storage. [2025-10-13T22:41:00.939521] [INFO ] [MAIN ] MEI: Loaded 31737 primary data records. [2025-10-13T22:41:01.741705] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:01.749860] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:01.750569] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31520 primary records. [2025-10-13T22:41:01.748950] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19820 primary records. [2025-10-13T22:41:01.750862] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-13T22:41:01.750795] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-13T22:41:01.781130] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:01.789432] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31737 primary records. [2025-10-13T22:41:01.798070] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-13T22:41:01.799149] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-13T22:41:01.799267] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-13T22:41:01.802269] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-13T22:41:01.802730] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-13T22:41:01.802189] [INFO ] [MAIN ] Derivative Progress: 1141/1810 symbols completed. MEGI took 1.1s. Estimated remaining: 4m 19s. Rate: 155.1 symbols/min [2025-10-13T22:41:01.814484] [INFO ] [MAIN ] Derivative Progress: 1142/1810 symbols completed. MEG took 1.1s. Estimated remaining: 4m 18s. Rate: 155.3 symbols/min [2025-10-13T22:41:01.814376] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:01.819562] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:01.825209] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-13T22:41:01.825327] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-13T22:41:01.828266] [INFO ] [MAIN ] Derivative Progress: 1143/1810 symbols completed. MEI took 1.1s. Estimated remaining: 4m 18s. Rate: 155.4 symbols/min [2025-10-13T22:41:01.828547] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:01.841575] [DEBUG] [LOCAL ] MFAN: Loaded 4383 existing records from primary storage. [2025-10-13T22:41:01.841855] [INFO ] [MAIN ] MFAN: Loaded 4383 primary data records. [2025-10-13T22:41:02.177710] [DEBUG] [LOCAL ] MET: Loaded 53320 existing records from primary storage. [2025-10-13T22:41:02.186889] [INFO ] [MAIN ] MET: Loaded 53320 primary data records. [2025-10-13T22:41:02.164940] [DEBUG] [LOCAL ] MFA: Loaded 45781 existing records from primary storage. [2025-10-13T22:41:02.187058] [INFO ] [MAIN ] MFA: Loaded 45781 primary data records. [2025-10-13T22:41:02.878880] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7826 incomplete bins [2025-10-13T22:41:02.880287] [INFO ] [MAIN ] MFAN: Generated 1788 derivative records from 4383 primary records. [2025-10-13T22:41:02.880413] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-13T22:41:02.898254] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1788 records). [2025-10-13T22:41:02.898561] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-13T22:41:02.901905] [INFO ] [MAIN ] Derivative Progress: 1144/1810 symbols completed. MFAN took 1.1s. Estimated remaining: 4m 18s. Rate: 155.2 symbols/min [2025-10-13T22:41:02.902160] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:02.909703] [DEBUG] [LOCAL ] MFAO: Loaded 3981 existing records from primary storage. [2025-10-13T22:41:02.909932] [INFO ] [MAIN ] MFAO: Loaded 3981 primary data records. [2025-10-13T22:41:03.069257] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:03.080757] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45781 primary records. [2025-10-13T22:41:03.095457] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-13T22:41:03.104534] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:03.135694] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53320 primary records. [2025-10-13T22:41:03.135860] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-13T22:41:03.279544] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-13T22:41:03.288079] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-13T22:41:03.288343] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-13T22:41:03.288639] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-13T22:41:03.291262] [INFO ] [MAIN ] Derivative Progress: 1145/1810 symbols completed. MFA took 1.5s. Estimated remaining: 4m 17s. Rate: 155.2 symbols/min [2025-10-13T22:41:03.293449] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:03.293897] [INFO ] [MAIN ] Derivative Progress: 1146/1810 symbols completed. MET took 1.5s. Estimated remaining: 4m 17s. Rate: 155.3 symbols/min [2025-10-13T22:41:03.294901] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:03.317441] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:41:03.318195] [INFO ] [MAIN ] MFAO: Generated 1790 derivative records from 3981 primary records. [2025-10-13T22:41:03.318303] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-13T22:41:03.332489] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1790 records). [2025-10-13T22:41:03.332881] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-13T22:41:03.349972] [INFO ] [MAIN ] Derivative Progress: 1147/1810 symbols completed. MFAO took 0.4s. Estimated remaining: 4m 16s. Rate: 155.4 symbols/min [2025-10-13T22:41:03.359246] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:03.382069] [DEBUG] [LOCAL ] MFC: Loaded 51104 existing records from primary storage. [2025-10-13T22:41:03.394853] [INFO ] [MAIN ] MFC: Loaded 51104 primary data records. [2025-10-13T22:41:03.436776] [DEBUG] [LOCAL ] MFM: Loaded 14711 existing records from primary storage. [2025-10-13T22:41:03.476966] [INFO ] [MAIN ] MFM: Loaded 14711 primary data records. [2025-10-13T22:41:03.482876] [DEBUG] [LOCAL ] MFG: Loaded 49426 existing records from primary storage. [2025-10-13T22:41:03.515374] [INFO ] [MAIN ] MFG: Loaded 49426 primary data records. [2025-10-13T22:41:04.322224] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:04.323374] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51104 primary records. [2025-10-13T22:41:04.323698] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-13T22:41:04.342977] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-13T22:41:04.343257] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-13T22:41:04.345424] [INFO ] [MAIN ] Derivative Progress: 1148/1810 symbols completed. MFC took 1.1s. Estimated remaining: 4m 16s. Rate: 155.2 symbols/min [2025-10-13T22:41:04.345725] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:04.363890] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:04.364931] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49426 primary records. [2025-10-13T22:41:04.365116] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-13T22:41:04.381245] [DEBUG] [LOCAL ] MFSG: Loaded 5685 existing records from primary storage. [2025-10-13T22:41:04.382706] [INFO ] [MAIN ] MFSG: Loaded 5685 primary data records. [2025-10-13T22:41:04.382596] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:04.422358] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14711 primary records. [2025-10-13T22:41:04.427725] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-13T22:41:04.453904] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-13T22:41:04.462855] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-13T22:41:04.487975] [INFO ] [MAIN ] Derivative Progress: 1149/1810 symbols completed. MFG took 1.2s. Estimated remaining: 4m 15s. Rate: 155.3 symbols/min [2025-10-13T22:41:04.500265] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:04.519679] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-13T22:41:04.520104] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-13T22:41:04.528120] [INFO ] [MAIN ] Derivative Progress: 1150/1810 symbols completed. MFM took 1.2s. Estimated remaining: 4m 15s. Rate: 155.4 symbols/min [2025-10-13T22:41:04.533532] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:04.609902] [DEBUG] [LOCAL ] MFSI: Loaded 11946 existing records from primary storage. [2025-10-13T22:41:04.748727] [INFO ] [MAIN ] MFSI: Loaded 11946 primary data records. [2025-10-13T22:41:04.751165] [DEBUG] [LOCAL ] MFSV: Loaded 2758 existing records from primary storage. [2025-10-13T22:41:04.762718] [INFO ] [MAIN ] MFSV: Loaded 2758 primary data records. [2025-10-13T22:41:05.389793] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:05.391693] [INFO ] [MAIN ] MFSG: Generated 1794 derivative records from 5685 primary records. [2025-10-13T22:41:05.392930] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-13T22:41:05.409566] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1794 records). [2025-10-13T22:41:05.409708] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-13T22:41:05.412229] [INFO ] [MAIN ] Derivative Progress: 1151/1810 symbols completed. MFSG took 1.1s. Estimated remaining: 4m 15s. Rate: 155.2 symbols/min [2025-10-13T22:41:05.412634] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:05.450006] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:05.456061] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 11946 primary records. [2025-10-13T22:41:05.461998] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-13T22:41:05.456496] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:41:05.463568] [INFO ] [MAIN ] MFSV: Generated 1791 derivative records from 2758 primary records. [2025-10-13T22:41:05.463743] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-13T22:41:05.475617] [DEBUG] [LOCAL ] MG: Loaded 15987 existing records from primary storage. [2025-10-13T22:41:05.482857] [INFO ] [MAIN ] MG: Loaded 15987 primary data records. [2025-10-13T22:41:05.502731] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1791 records). [2025-10-13T22:41:05.512121] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-13T22:41:05.525833] [INFO ] [MAIN ] Derivative Progress: 1152/1810 symbols completed. MFSV took 1.0s. Estimated remaining: 4m 14s. Rate: 155.3 symbols/min [2025-10-13T22:41:05.559851] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-13T22:41:05.565165] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:05.565237] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-13T22:41:05.568389] [INFO ] [MAIN ] Derivative Progress: 1153/1810 symbols completed. MFSI took 1.1s. Estimated remaining: 4m 14s. Rate: 155.5 symbols/min [2025-10-13T22:41:05.841733] [DEBUG] [LOCAL ] MGA: Loaded 50634 existing records from primary storage. [2025-10-13T22:41:05.846415] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:05.847182] [INFO ] [MAIN ] MGA: Loaded 50634 primary data records. [2025-10-13T22:41:05.847123] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 15987 primary records. [2025-10-13T22:41:05.847371] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-13T22:41:05.967709] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-13T22:41:05.967853] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-13T22:41:05.975751] [INFO ] [MAIN ] Derivative Progress: 1154/1810 symbols completed. MG took 0.6s. Estimated remaining: 4m 13s. Rate: 155.4 symbols/min [2025-10-13T22:41:06.181132] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:06.181831] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50634 primary records. [2025-10-13T22:41:06.181893] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-13T22:41:06.196604] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-13T22:41:06.196687] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-13T22:41:06.198892] [INFO ] [MAIN ] Derivative Progress: 1155/1810 symbols completed. MGA took 0.6s. Estimated remaining: 4m 13s. Rate: 155.5 symbols/min [2025-10-13T22:41:06.199737] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:06.199490] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:06.199600] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:06.207813] [DEBUG] [LOCAL ] MGF: Loaded 4272 existing records from primary storage. [2025-10-13T22:41:06.210677] [DEBUG] [LOCAL ] MGR: Loaded 5648 existing records from primary storage. [2025-10-13T22:41:06.210788] [INFO ] [MAIN ] MGF: Loaded 4272 primary data records. [2025-10-13T22:41:06.231499] [INFO ] [MAIN ] MGR: Loaded 5648 primary data records. [2025-10-13T22:41:06.860951] [DEBUG] [LOCAL ] MGM: Loaded 53606 existing records from primary storage. [2025-10-13T22:41:06.861396] [INFO ] [MAIN ] MGM: Loaded 53606 primary data records. [2025-10-13T22:41:07.205750] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:41:07.219236] [INFO ] [MAIN ] MGF: Generated 1792 derivative records from 4272 primary records. [2025-10-13T22:41:07.219549] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:07.219879] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-13T22:41:07.220473] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5648 primary records. [2025-10-13T22:41:07.221383] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-13T22:41:07.237244] [DEBUG] [LOCAL ] MGF: Derivative data saved (1792 records). [2025-10-13T22:41:07.244018] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-13T22:41:07.247255] [INFO ] [MAIN ] Derivative Progress: 1156/1810 symbols completed. MGF took 1.0s. Estimated remaining: 4m 13s. Rate: 155.3 symbols/min [2025-10-13T22:41:07.247569] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:07.255409] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-13T22:41:07.256687] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-13T22:41:07.259383] [INFO ] [MAIN ] Derivative Progress: 1157/1810 symbols completed. MGR took 1.1s. Estimated remaining: 4m 12s. Rate: 155.4 symbols/min [2025-10-13T22:41:07.260011] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:07.262931] [DEBUG] [LOCAL ] MGRB: Loaded 4045 existing records from primary storage. [2025-10-13T22:41:07.263144] [INFO ] [MAIN ] MGRB: Loaded 4045 primary data records. [2025-10-13T22:41:07.383159] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:07.385537] [DEBUG] [LOCAL ] MGRD: Loaded 2220 existing records from primary storage. [2025-10-13T22:41:07.386282] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53606 primary records. [2025-10-13T22:41:07.397174] [INFO ] [MAIN ] MGRD: Loaded 2220 primary data records. [2025-10-13T22:41:07.397093] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-13T22:41:07.755147] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-13T22:41:07.886872] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-13T22:41:07.890289] [INFO ] [MAIN ] Derivative Progress: 1158/1810 symbols completed. MGM took 1.7s. Estimated remaining: 4m 12s. Rate: 155.3 symbols/min [2025-10-13T22:41:07.890704] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:07.904798] [DEBUG] [LOCAL ] MGRE: Loaded 6672 existing records from primary storage. [2025-10-13T22:41:07.905687] [INFO ] [MAIN ] MGRE: Loaded 6672 primary data records. [2025-10-13T22:41:08.068158] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:08.107222] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4045 primary records. [2025-10-13T22:41:08.222280] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-13T22:41:08.242587] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:08.248434] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2220 primary records. [2025-10-13T22:41:08.248636] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-13T22:41:08.252136] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-13T22:41:08.252707] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-13T22:41:08.255802] [INFO ] [MAIN ] Derivative Progress: 1159/1810 symbols completed. MGRB took 1.0s. Estimated remaining: 4m 11s. Rate: 155.3 symbols/min [2025-10-13T22:41:08.256190] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:08.271695] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-13T22:41:08.272394] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-13T22:41:08.274901] [INFO ] [MAIN ] Derivative Progress: 1160/1810 symbols completed. MGRD took 1.0s. Estimated remaining: 4m 11s. Rate: 155.5 symbols/min [2025-10-13T22:41:08.275523] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:08.291053] [DEBUG] [LOCAL ] MHD: Loaded 12370 existing records from primary storage. [2025-10-13T22:41:08.291375] [INFO ] [MAIN ] MHD: Loaded 12370 primary data records. [2025-10-13T22:41:08.436356] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:08.458098] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6672 primary records. [2025-10-13T22:41:08.480279] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-13T22:41:08.692046] [DEBUG] [LOCAL ] MGY: Loaded 52411 existing records from primary storage. [2025-10-13T22:41:08.696001] [INFO ] [MAIN ] MGY: Loaded 52411 primary data records. [2025-10-13T22:41:08.773418] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-13T22:41:08.780151] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-13T22:41:08.782863] [INFO ] [MAIN ] Derivative Progress: 1161/1810 symbols completed. MGRE took 0.9s. Estimated remaining: 4m 11s. Rate: 155.4 symbols/min [2025-10-13T22:41:08.788773] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:08.998989] [DEBUG] [LOCAL ] MHF: Loaded 8824 existing records from primary storage. [2025-10-13T22:41:09.012510] [INFO ] [MAIN ] MHF: Loaded 8824 primary data records. [2025-10-13T22:41:09.373037] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:09.375426] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12370 primary records. [2025-10-13T22:41:09.375950] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-13T22:41:09.397818] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-13T22:41:09.398284] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-13T22:41:09.401405] [INFO ] [MAIN ] Derivative Progress: 1162/1810 symbols completed. MHD took 1.1s. Estimated remaining: 4m 10s. Rate: 155.3 symbols/min [2025-10-13T22:41:09.402993] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:09.419469] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:09.420266] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52411 primary records. [2025-10-13T22:41:09.420517] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-13T22:41:09.440844] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-13T22:41:09.441008] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-13T22:41:09.443311] [INFO ] [MAIN ] Derivative Progress: 1163/1810 symbols completed. MGY took 1.2s. Estimated remaining: 4m 10s. Rate: 155.4 symbols/min [2025-10-13T22:41:09.443631] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:09.465070] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:09.468861] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8824 primary records. [2025-10-13T22:41:09.469023] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-13T22:41:09.481754] [DEBUG] [LOCAL ] MHN: Loaded 7534 existing records from primary storage. [2025-10-13T22:41:09.497453] [INFO ] [MAIN ] MHN: Loaded 7534 primary data records. [2025-10-13T22:41:09.556547] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-13T22:41:09.596407] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-13T22:41:09.614828] [DEBUG] [LOCAL ] MHK: Loaded 42155 existing records from primary storage. [2025-10-13T22:41:09.620144] [INFO ] [MAIN ] MHK: Loaded 42155 primary data records. [2025-10-13T22:41:09.613053] [INFO ] [MAIN ] Derivative Progress: 1164/1810 symbols completed. MHF took 0.8s. Estimated remaining: 4m 9s. Rate: 155.5 symbols/min [2025-10-13T22:41:09.638741] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:10.177093] [DEBUG] [LOCAL ] MHO: Loaded 23748 existing records from primary storage. [2025-10-13T22:41:10.177516] [INFO ] [MAIN ] MHO: Loaded 23748 primary data records. [2025-10-13T22:41:10.570412] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:10.583313] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7534 primary records. [2025-10-13T22:41:10.583444] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-13T22:41:10.585030] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:10.592278] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42155 primary records. [2025-10-13T22:41:10.596407] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-13T22:41:10.614061] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-13T22:41:10.614803] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-13T22:41:10.617196] [INFO ] [MAIN ] Derivative Progress: 1165/1810 symbols completed. MHN took 1.2s. Estimated remaining: 4m 9s. Rate: 155.3 symbols/min [2025-10-13T22:41:10.621562] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-13T22:41:10.621718] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:10.621963] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-13T22:41:10.625086] [INFO ] [MAIN ] Derivative Progress: 1166/1810 symbols completed. MHK took 1.2s. Estimated remaining: 4m 9s. Rate: 155.4 symbols/min [2025-10-13T22:41:10.625232] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:10.653856] [DEBUG] [LOCAL ] MIN: Loaded 13831 existing records from primary storage. [2025-10-13T22:41:10.654275] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:10.655111] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23748 primary records. [2025-10-13T22:41:10.654362] [INFO ] [MAIN ] MIN: Loaded 13831 primary data records. [2025-10-13T22:41:10.655291] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-13T22:41:10.770800] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-13T22:41:10.785431] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-13T22:41:10.793301] [INFO ] [MAIN ] Derivative Progress: 1167/1810 symbols completed. MHO took 1.2s. Estimated remaining: 4m 8s. Rate: 155.5 symbols/min [2025-10-13T22:41:10.808989] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:10.993719] [DEBUG] [LOCAL ] MIR: Loaded 51221 existing records from primary storage. [2025-10-13T22:41:10.995955] [DEBUG] [LOCAL ] MITP: Loaded 2330 existing records from primary storage. [2025-10-13T22:41:10.996369] [INFO ] [MAIN ] MIR: Loaded 51221 primary data records. [2025-10-13T22:41:10.996561] [INFO ] [MAIN ] MITP: Loaded 2330 primary data records. [2025-10-13T22:41:11.597069] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:11.597990] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13831 primary records. [2025-10-13T22:41:11.598384] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-13T22:41:11.614079] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-13T22:41:11.614182] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-13T22:41:11.616587] [INFO ] [MAIN ] Derivative Progress: 1168/1810 symbols completed. MIN took 1.0s. Estimated remaining: 4m 8s. Rate: 155.4 symbols/min [2025-10-13T22:41:11.645841] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:11.645584] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:11.646548] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51221 primary records. [2025-10-13T22:41:11.647102] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2330 primary records. [2025-10-13T22:41:11.647204] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-13T22:41:11.647254] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-13T22:41:11.673739] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-10-13T22:41:11.674785] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-13T22:41:11.678229] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-13T22:41:11.678165] [INFO ] [MAIN ] Derivative Progress: 1169/1810 symbols completed. MITP took 0.9s. Estimated remaining: 4m 7s. Rate: 155.5 symbols/min [2025-10-13T22:41:11.678498] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-13T22:41:11.681149] [INFO ] [MAIN ] Derivative Progress: 1170/1810 symbols completed. MIR took 1.1s. Estimated remaining: 4m 7s. Rate: 155.6 symbols/min [2025-10-13T22:41:11.681594] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:11.681665] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:11.681986] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:11.690738] [DEBUG] [LOCAL ] MIY: Loaded 6239 existing records from primary storage. [2025-10-13T22:41:11.690909] [INFO ] [MAIN ] MIY: Loaded 6239 primary data records. [2025-10-13T22:41:11.862019] [DEBUG] [LOCAL ] MITT: Loaded 22766 existing records from primary storage. [2025-10-13T22:41:12.007158] [INFO ] [MAIN ] MITT: Loaded 22766 primary data records. [2025-10-13T22:41:12.149074] [DEBUG] [LOCAL ] MKC: Loaded 52521 existing records from primary storage. [2025-10-13T22:41:12.154417] [INFO ] [MAIN ] MKC: Loaded 52521 primary data records. [2025-10-13T22:41:12.681121] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:12.683030] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6239 primary records. [2025-10-13T22:41:12.683132] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-13T22:41:12.705200] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-13T22:41:12.705360] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-13T22:41:12.707912] [INFO ] [MAIN ] Derivative Progress: 1171/1810 symbols completed. MIY took 1.0s. Estimated remaining: 4m 7s. Rate: 155.4 symbols/min [2025-10-13T22:41:12.709229] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:12.725846] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:12.727031] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22766 primary records. [2025-10-13T22:41:12.727190] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-13T22:41:12.745859] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-13T22:41:12.758970] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-13T22:41:12.758873] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:12.761528] [INFO ] [MAIN ] Derivative Progress: 1172/1810 symbols completed. MITT took 1.1s. Estimated remaining: 4m 6s. Rate: 155.5 symbols/min [2025-10-13T22:41:12.762620] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52521 primary records. [2025-10-13T22:41:12.761757] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:12.771920] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-13T22:41:12.788414] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-13T22:41:12.797148] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-13T22:41:12.801025] [INFO ] [MAIN ] Derivative Progress: 1173/1810 symbols completed. MKC took 1.1s. Estimated remaining: 4m 6s. Rate: 155.6 symbols/min [2025-10-13T22:41:12.801310] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:12.802452] [DEBUG] [LOCAL ] MKL: Loaded 34005 existing records from primary storage. [2025-10-13T22:41:12.802743] [INFO ] [MAIN ] MKL: Loaded 34005 primary data records. [2025-10-13T22:41:13.154107] [DEBUG] [LOCAL ] MLI: Loaded 43523 existing records from primary storage. [2025-10-13T22:41:13.163808] [INFO ] [MAIN ] MLI: Loaded 43523 primary data records. [2025-10-13T22:41:13.201928] [DEBUG] [LOCAL ] MLM: Loaded 29307 existing records from primary storage. [2025-10-13T22:41:13.231200] [INFO ] [MAIN ] MLM: Loaded 29307 primary data records. [2025-10-13T22:41:13.789197] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:13.790794] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34005 primary records. [2025-10-13T22:41:13.791011] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-13T22:41:13.811351] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-13T22:41:13.811858] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-13T22:41:13.814754] [INFO ] [MAIN ] Derivative Progress: 1174/1810 symbols completed. MKL took 1.1s. Estimated remaining: 4m 6s. Rate: 155.4 symbols/min [2025-10-13T22:41:13.814973] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:13.834318] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:13.847306] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43523 primary records. [2025-10-13T22:41:13.848244] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-13T22:41:13.848179] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:13.849569] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29307 primary records. [2025-10-13T22:41:13.849740] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-13T22:41:13.883679] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-13T22:41:13.884790] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-13T22:41:13.888188] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-13T22:41:13.890769] [INFO ] [MAIN ] Derivative Progress: 1175/1810 symbols completed. MLM took 1.1s. Estimated remaining: 4m 5s. Rate: 155.5 symbols/min [2025-10-13T22:41:13.890907] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-13T22:41:13.891117] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:13.893978] [INFO ] [MAIN ] Derivative Progress: 1176/1810 symbols completed. MLI took 1.1s. Estimated remaining: 4m 4s. Rate: 155.6 symbols/min [2025-10-13T22:41:13.894324] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:13.898814] [DEBUG] [LOCAL ] MLP: Loaded 3050 existing records from primary storage. [2025-10-13T22:41:13.906602] [INFO ] [MAIN ] MLP: Loaded 3050 primary data records. [2025-10-13T22:41:13.927884] [DEBUG] [LOCAL ] MLNK: Loaded 26227 existing records from primary storage. [2025-10-13T22:41:13.946418] [INFO ] [MAIN ] MLNK: Loaded 26227 primary data records. [2025-10-13T22:41:14.098835] [DEBUG] [LOCAL ] MLR: Loaded 12481 existing records from primary storage. [2025-10-13T22:41:14.110967] [INFO ] [MAIN ] MLR: Loaded 12481 primary data records. [2025-10-13T22:41:14.888832] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7827 incomplete bins [2025-10-13T22:41:14.895120] [INFO ] [MAIN ] MLP: Generated 1787 derivative records from 3050 primary records. [2025-10-13T22:41:14.896226] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-13T22:41:14.896137] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:14.897892] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 26227 primary records. [2025-10-13T22:41:14.898230] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-13T22:41:14.926631] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-13T22:41:14.927474] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-13T22:41:14.930715] [INFO ] [MAIN ] Derivative Progress: 1177/1810 symbols completed. MLNK took 1.1s. Estimated remaining: 4m 4s. Rate: 155.4 symbols/min [2025-10-13T22:41:14.931158] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:14.949075] [DEBUG] [LOCAL ] MLP: Derivative data saved (1787 records). [2025-10-13T22:41:14.949694] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-13T22:41:14.952236] [INFO ] [MAIN ] Derivative Progress: 1178/1810 symbols completed. MLP took 1.1s. Estimated remaining: 4m 4s. Rate: 155.5 symbols/min [2025-10-13T22:41:14.952418] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:14.949568] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:14.953714] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12481 primary records. [2025-10-13T22:41:14.953914] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-13T22:41:14.973530] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-13T22:41:14.973793] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-13T22:41:14.976367] [INFO ] [MAIN ] Derivative Progress: 1179/1810 symbols completed. MLR took 1.1s. Estimated remaining: 4m 3s. Rate: 155.7 symbols/min [2025-10-13T22:41:14.976608] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:14.982713] [DEBUG] [LOCAL ] MMD: Loaded 10880 existing records from primary storage. [2025-10-13T22:41:14.982934] [INFO ] [MAIN ] MMD: Loaded 10880 primary data records. [2025-10-13T22:41:15.107096] [DEBUG] [LOCAL ] MMI: Loaded 15401 existing records from primary storage. [2025-10-13T22:41:15.129162] [INFO ] [MAIN ] MMI: Loaded 15401 primary data records. [2025-10-13T22:41:15.376198] [DEBUG] [LOCAL ] MMC: Loaded 51918 existing records from primary storage. [2025-10-13T22:41:15.388536] [INFO ] [MAIN ] MMC: Loaded 51918 primary data records. [2025-10-13T22:41:15.971791] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:15.972851] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 10880 primary records. [2025-10-13T22:41:15.973022] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-13T22:41:15.992783] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-13T22:41:15.993921] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-13T22:41:15.996781] [INFO ] [MAIN ] Derivative Progress: 1180/1810 symbols completed. MMD took 1.0s. Estimated remaining: 4m 3s. Rate: 155.5 symbols/min [2025-10-13T22:41:15.997834] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:16.012660] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:16.013568] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15401 primary records. [2025-10-13T22:41:16.014795] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-13T22:41:16.032806] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-13T22:41:16.045279] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-13T22:41:16.048629] [INFO ] [MAIN ] Derivative Progress: 1181/1810 symbols completed. MMI took 1.1s. Estimated remaining: 4m 3s. Rate: 155.6 symbols/min [2025-10-13T22:41:16.049343] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:16.049017] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:16.050253] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51918 primary records. [2025-10-13T22:41:16.050354] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-13T22:41:16.081966] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-13T22:41:16.082102] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-13T22:41:16.084867] [INFO ] [MAIN ] Derivative Progress: 1182/1810 symbols completed. MMC took 1.2s. Estimated remaining: 4m 2s. Rate: 155.7 symbols/min [2025-10-13T22:41:16.085059] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:16.106101] [DEBUG] [LOCAL ] MMT: Loaded 10402 existing records from primary storage. [2025-10-13T22:41:16.106281] [INFO ] [MAIN ] MMT: Loaded 10402 primary data records. [2025-10-13T22:41:16.177950] [DEBUG] [LOCAL ] MMM: Loaded 53123 existing records from primary storage. [2025-10-13T22:41:16.201734] [INFO ] [MAIN ] MMM: Loaded 53123 primary data records. [2025-10-13T22:41:16.219201] [DEBUG] [LOCAL ] MMS: Loaded 33729 existing records from primary storage. [2025-10-13T22:41:16.272168] [INFO ] [MAIN ] MMS: Loaded 33729 primary data records. [2025-10-13T22:41:17.090852] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:17.091827] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10402 primary records. [2025-10-13T22:41:17.092249] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-13T22:41:17.135466] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:17.137692] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-13T22:41:17.137941] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-13T22:41:17.138581] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53123 primary records. [2025-10-13T22:41:17.141374] [INFO ] [MAIN ] Derivative Progress: 1183/1810 symbols completed. MMT took 1.1s. Estimated remaining: 4m 2s. Rate: 155.5 symbols/min [2025-10-13T22:41:17.138952] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:17.142333] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-13T22:41:17.142473] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33729 primary records. [2025-10-13T22:41:17.142591] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-13T22:41:17.172556] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-13T22:41:17.172909] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-13T22:41:17.176421] [INFO ] [MAIN ] Derivative Progress: 1184/1810 symbols completed. MMS took 1.1s. Estimated remaining: 4m 1s. Rate: 155.6 symbols/min [2025-10-13T22:41:17.179170] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-13T22:41:17.179368] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-13T22:41:17.183554] [INFO ] [MAIN ] Derivative Progress: 1185/1810 symbols completed. MMM took 1.2s. Estimated remaining: 4m 1s. Rate: 155.7 symbols/min [2025-10-13T22:41:17.184178] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:17.184291] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:17.184368] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:17.212154] [DEBUG] [LOCAL ] MMU: Loaded 16653 existing records from primary storage. [2025-10-13T22:41:17.212349] [INFO ] [MAIN ] MMU: Loaded 16653 primary data records. [2025-10-13T22:41:17.314345] [DEBUG] [LOCAL ] MNR: Loaded 24761 existing records from primary storage. [2025-10-13T22:41:17.336011] [INFO ] [MAIN ] MNR: Loaded 24761 primary data records. [2025-10-13T22:41:17.509753] [DEBUG] [LOCAL ] MNSO: Loaded 44187 existing records from primary storage. [2025-10-13T22:41:17.535123] [INFO ] [MAIN ] MNSO: Loaded 44187 primary data records. [2025-10-13T22:41:18.271971] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:18.275604] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16653 primary records. [2025-10-13T22:41:18.275850] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-13T22:41:18.299534] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:18.306960] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-13T22:41:18.306107] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24761 primary records. [2025-10-13T22:41:18.307499] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-13T22:41:18.307428] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-13T22:41:18.311159] [INFO ] [MAIN ] Derivative Progress: 1186/1810 symbols completed. MMU took 1.1s. Estimated remaining: 4m 1s. Rate: 155.5 symbols/min [2025-10-13T22:41:18.311439] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:18.329112] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-13T22:41:18.330625] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-13T22:41:18.333999] [INFO ] [MAIN ] Derivative Progress: 1187/1810 symbols completed. MNR took 1.1s. Estimated remaining: 4m 0s. Rate: 155.6 symbols/min [2025-10-13T22:41:18.335603] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:18.352579] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:18.353606] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44187 primary records. [2025-10-13T22:41:18.353777] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-13T22:41:18.383784] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-13T22:41:18.384071] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-13T22:41:18.391588] [INFO ] [MAIN ] Derivative Progress: 1188/1810 symbols completed. MNSO took 1.2s. Estimated remaining: 3m 60s. Rate: 155.7 symbols/min [2025-10-13T22:41:18.391857] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:18.422092] [DEBUG] [LOCAL ] MOD: Loaded 44860 existing records from primary storage. [2025-10-13T22:41:18.422264] [INFO ] [MAIN ] MOD: Loaded 44860 primary data records. [2025-10-13T22:41:18.558149] [DEBUG] [LOCAL ] MODG: Loaded 51582 existing records from primary storage. [2025-10-13T22:41:18.570393] [INFO ] [MAIN ] MODG: Loaded 51582 primary data records. [2025-10-13T22:41:18.771607] [DEBUG] [LOCAL ] MOH: Loaded 42417 existing records from primary storage. [2025-10-13T22:41:18.909214] [INFO ] [MAIN ] MOH: Loaded 42417 primary data records. [2025-10-13T22:41:19.428520] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:19.429757] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44860 primary records. [2025-10-13T22:41:19.430112] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-13T22:41:19.443878] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:19.451964] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51582 primary records. [2025-10-13T22:41:19.460384] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-13T22:41:19.460489] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-13T22:41:19.461316] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-13T22:41:19.472527] [INFO ] [MAIN ] Derivative Progress: 1189/1810 symbols completed. MOD took 1.2s. Estimated remaining: 3m 60s. Rate: 155.5 symbols/min [2025-10-13T22:41:19.475435] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:19.481794] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-13T22:41:19.482133] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-13T22:41:19.484952] [INFO ] [MAIN ] Derivative Progress: 1190/1810 symbols completed. MODG took 1.1s. Estimated remaining: 3m 59s. Rate: 155.6 symbols/min [2025-10-13T22:41:19.485376] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:19.505194] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:19.506044] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 42417 primary records. [2025-10-13T22:41:19.506309] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-13T22:41:19.510028] [DEBUG] [LOCAL ] MPA: Loaded 5337 existing records from primary storage. [2025-10-13T22:41:19.510283] [INFO ] [MAIN ] MPA: Loaded 5337 primary data records. [2025-10-13T22:41:19.603930] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-13T22:41:19.638408] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-13T22:41:19.656998] [INFO ] [MAIN ] Derivative Progress: 1191/1810 symbols completed. MOH took 1.3s. Estimated remaining: 3m 59s. Rate: 155.6 symbols/min [2025-10-13T22:41:19.667503] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:19.851788] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-10-13T22:41:19.852934] [INFO ] [MAIN ] MOS: Loaded 53504 primary data records. [2025-10-13T22:41:20.179422] [DEBUG] [LOCAL ] MPC: Loaded 52061 existing records from primary storage. [2025-10-13T22:41:20.180808] [INFO ] [MAIN ] MPC: Loaded 52061 primary data records. [2025-10-13T22:41:20.252858] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:20.273626] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5337 primary records. [2025-10-13T22:41:20.284033] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-13T22:41:20.327683] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-13T22:41:20.333198] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-13T22:41:20.341209] [INFO ] [MAIN ] Derivative Progress: 1192/1810 symbols completed. MPA took 0.9s. Estimated remaining: 3m 58s. Rate: 155.5 symbols/min [2025-10-13T22:41:20.346637] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:20.565474] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:20.567091] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53504 primary records. [2025-10-13T22:41:20.567761] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-13T22:41:20.584807] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-13T22:41:20.585205] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-13T22:41:20.588042] [INFO ] [MAIN ] Derivative Progress: 1193/1810 symbols completed. MOS took 1.1s. Estimated remaining: 3m 58s. Rate: 155.6 symbols/min [2025-10-13T22:41:20.588542] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:20.596519] [DEBUG] [LOCAL ] MPV: Loaded 4856 existing records from primary storage. [2025-10-13T22:41:20.596737] [INFO ] [MAIN ] MPV: Loaded 4856 primary data records. [2025-10-13T22:41:20.805230] [DEBUG] [LOCAL ] MPLX: Loaded 50742 existing records from primary storage. [2025-10-13T22:41:20.944232] [INFO ] [MAIN ] MPLX: Loaded 50742 primary data records. [2025-10-13T22:41:20.944973] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:20.957066] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52061 primary records. [2025-10-13T22:41:20.966380] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-13T22:41:21.140311] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-13T22:41:21.140498] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-13T22:41:21.143389] [INFO ] [MAIN ] Derivative Progress: 1194/1810 symbols completed. MPC took 1.5s. Estimated remaining: 3m 58s. Rate: 155.5 symbols/min [2025-10-13T22:41:21.143760] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:21.280622] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:21.282084] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4856 primary records. [2025-10-13T22:41:21.282249] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-13T22:41:21.301215] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-13T22:41:21.301583] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-13T22:41:21.304095] [INFO ] [MAIN ] Derivative Progress: 1195/1810 symbols completed. MPV took 0.7s. Estimated remaining: 3m 57s. Rate: 155.6 symbols/min [2025-10-13T22:41:21.304385] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:21.324955] [DEBUG] [LOCAL ] MPX: Loaded 4063 existing records from primary storage. [2025-10-13T22:41:21.326501] [INFO ] [MAIN ] MPX: Loaded 4063 primary data records. [2025-10-13T22:41:21.439589] [DEBUG] [LOCAL ] MPW: Loaded 53499 existing records from primary storage. [2025-10-13T22:41:21.420757] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:21.444901] [INFO ] [MAIN ] MPW: Loaded 53499 primary data records. [2025-10-13T22:41:21.495071] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50742 primary records. [2025-10-13T22:41:21.507258] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-13T22:41:21.796255] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-13T22:41:21.822890] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-13T22:41:21.850119] [INFO ] [MAIN ] Derivative Progress: 1196/1810 symbols completed. MPLX took 1.5s. Estimated remaining: 3m 57s. Rate: 155.6 symbols/min [2025-10-13T22:41:21.851709] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:21.982217] [DEBUG] [LOCAL ] MQT: Loaded 8340 existing records from primary storage. [2025-10-13T22:41:21.982775] [INFO ] [MAIN ] MQT: Loaded 8340 primary data records. [2025-10-13T22:41:22.359238] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:22.360434] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4063 primary records. [2025-10-13T22:41:22.360727] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-13T22:41:22.381910] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-13T22:41:22.382961] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-13T22:41:22.386389] [INFO ] [MAIN ] Derivative Progress: 1197/1810 symbols completed. MPX took 1.1s. Estimated remaining: 3m 57s. Rate: 155.5 symbols/min [2025-10-13T22:41:22.400425] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:22.402356] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:22.403249] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53499 primary records. [2025-10-13T22:41:22.403533] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-13T22:41:22.428549] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-13T22:41:22.428897] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-13T22:41:22.424683] [DEBUG] [LOCAL ] MSB: Loaded 7768 existing records from primary storage. [2025-10-13T22:41:22.429034] [INFO ] [MAIN ] MSB: Loaded 7768 primary data records. [2025-10-13T22:41:22.431760] [INFO ] [MAIN ] Derivative Progress: 1198/1810 symbols completed. MPW took 1.3s. Estimated remaining: 3m 56s. Rate: 155.6 symbols/min [2025-10-13T22:41:22.606114] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:22.614587] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8340 primary records. [2025-10-13T22:41:22.615975] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-13T22:41:22.777819] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-13T22:41:22.778407] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-13T22:41:22.781257] [INFO ] [MAIN ] Derivative Progress: 1199/1810 symbols completed. MQT took 0.9s. Estimated remaining: 3m 56s. Rate: 155.6 symbols/min [2025-10-13T22:41:22.805104] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:22.805801] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7768 primary records. [2025-10-13T22:41:22.805866] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-13T22:41:22.821084] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-13T22:41:22.821151] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-13T22:41:22.823632] [INFO ] [MAIN ] Derivative Progress: 1200/1810 symbols completed. MSB took 0.4s. Estimated remaining: 3m 55s. Rate: 155.8 symbols/min [2025-10-13T22:41:22.824161] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:22.824244] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:22.824802] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:22.851074] [DEBUG] [LOCAL ] MSD: Loaded 16426 existing records from primary storage. [2025-10-13T22:41:22.856602] [INFO ] [MAIN ] MSD: Loaded 16426 primary data records. [2025-10-13T22:41:22.862341] [DEBUG] [LOCAL ] MUA: Loaded 11599 existing records from primary storage. [2025-10-13T22:41:22.885507] [INFO ] [MAIN ] MUA: Loaded 11599 primary data records. [2025-10-13T22:41:22.896442] [DEBUG] [LOCAL ] MTD: Loaded 15417 existing records from primary storage. [2025-10-13T22:41:22.932311] [INFO ] [MAIN ] MTD: Loaded 15417 primary data records. [2025-10-13T22:41:23.874292] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:23.875312] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16426 primary records. [2025-10-13T22:41:23.875520] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:23.877583] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11599 primary records. [2025-10-13T22:41:23.878573] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-13T22:41:23.878506] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-13T22:41:23.920566] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-13T22:41:23.925310] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-13T22:41:23.925415] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-13T22:41:23.927946] [INFO ] [MAIN ] Derivative Progress: 1201/1810 symbols completed. MSD took 1.1s. Estimated remaining: 3m 55s. Rate: 155.5 symbols/min [2025-10-13T22:41:23.921537] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-13T22:41:23.931115] [INFO ] [MAIN ] Derivative Progress: 1202/1810 symbols completed. MUA took 1.1s. Estimated remaining: 3m 54s. Rate: 155.6 symbols/min [2025-10-13T22:41:23.921441] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:23.928168] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:23.932557] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15417 primary records. [2025-10-13T22:41:23.931621] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:23.933362] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-13T22:41:23.956223] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-10-13T22:41:23.960365] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-13T22:41:23.965333] [INFO ] [MAIN ] Derivative Progress: 1203/1810 symbols completed. MTD took 1.1s. Estimated remaining: 3m 54s. Rate: 155.8 symbols/min [2025-10-13T22:41:23.971016] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:23.971944] [DEBUG] [LOCAL ] MUE: Loaded 11803 existing records from primary storage. [2025-10-13T22:41:23.972312] [INFO ] [MAIN ] MUE: Loaded 11803 primary data records. [2025-10-13T22:41:24.039495] [DEBUG] [LOCAL ] MVF: Loaded 12853 existing records from primary storage. [2025-10-13T22:41:24.061404] [INFO ] [MAIN ] MVF: Loaded 12853 primary data records. [2025-10-13T22:41:24.082779] [DEBUG] [LOCAL ] MVO: Loaded 8739 existing records from primary storage. [2025-10-13T22:41:24.116183] [INFO ] [MAIN ] MVO: Loaded 8739 primary data records. [2025-10-13T22:41:25.011123] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:25.012634] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11803 primary records. [2025-10-13T22:41:25.013770] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-13T22:41:25.042412] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-13T22:41:25.047874] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-13T22:41:25.051461] [INFO ] [MAIN ] Derivative Progress: 1204/1810 symbols completed. MUE took 1.1s. Estimated remaining: 3m 54s. Rate: 155.5 symbols/min [2025-10-13T22:41:25.048413] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:25.052089] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:25.054402] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12853 primary records. [2025-10-13T22:41:25.056482] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-13T22:41:25.087398] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-13T22:41:25.090199] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:25.090355] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-13T22:41:25.091260] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8739 primary records. [2025-10-13T22:41:25.091352] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-13T22:41:25.112768] [DEBUG] [LOCAL ] MVT: Loaded 10048 existing records from primary storage. [2025-10-13T22:41:25.116910] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-10-13T22:41:25.115888] [INFO ] [MAIN ] MVT: Loaded 10048 primary data records. [2025-10-13T22:41:25.108013] [INFO ] [MAIN ] Derivative Progress: 1205/1810 symbols completed. MVF took 1.2s. Estimated remaining: 3m 53s. Rate: 155.6 symbols/min [2025-10-13T22:41:25.138719] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-13T22:41:25.195925] [INFO ] [MAIN ] Derivative Progress: 1206/1810 symbols completed. MVO took 1.2s. Estimated remaining: 3m 53s. Rate: 155.7 symbols/min [2025-10-13T22:41:25.195804] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:25.212979] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:25.331950] [DEBUG] [LOCAL ] MXF: Loaded 5650 existing records from primary storage. [2025-10-13T22:41:25.471120] [INFO ] [MAIN ] MXF: Loaded 5650 primary data records. [2025-10-13T22:41:25.511758] [DEBUG] [LOCAL ] MX: Loaded 22418 existing records from primary storage. [2025-10-13T22:41:25.547694] [INFO ] [MAIN ] MX: Loaded 22418 primary data records. [2025-10-13T22:41:26.300726] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:26.302299] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10048 primary records. [2025-10-13T22:41:26.302520] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-13T22:41:26.322422] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-13T22:41:26.323426] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-13T22:41:26.326013] [INFO ] [MAIN ] Derivative Progress: 1207/1810 symbols completed. MVT took 1.3s. Estimated remaining: 3m 53s. Rate: 155.5 symbols/min [2025-10-13T22:41:26.326321] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:26.345882] [DEBUG] [LOCAL ] MYN: Loaded 9831 existing records from primary storage. [2025-10-13T22:41:26.346594] [INFO ] [MAIN ] MYN: Loaded 9831 primary data records. [2025-10-13T22:41:26.371002] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:26.411423] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5650 primary records. [2025-10-13T22:41:26.420210] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-13T22:41:26.497974] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-13T22:41:26.508848] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-13T22:41:26.503537] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:26.511504] [INFO ] [MAIN ] Derivative Progress: 1208/1810 symbols completed. MXF took 1.3s. Estimated remaining: 3m 52s. Rate: 155.5 symbols/min [2025-10-13T22:41:26.517517] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22418 primary records. [2025-10-13T22:41:26.517750] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:26.517670] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-13T22:41:26.598198] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-13T22:41:26.755893] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-13T22:41:26.759345] [INFO ] [MAIN ] Derivative Progress: 1209/1810 symbols completed. MX took 1.6s. Estimated remaining: 3m 52s. Rate: 155.6 symbols/min [2025-10-13T22:41:26.759798] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:26.770209] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-13T22:41:26.770705] [INFO ] [MAIN ] NAZ: Loaded 2646 primary data records. [2025-10-13T22:41:27.108917] [DEBUG] [LOCAL ] NAT: Loaded 49203 existing records from primary storage. [2025-10-13T22:41:27.109416] [INFO ] [MAIN ] NAT: Loaded 49203 primary data records. [2025-10-13T22:41:27.265845] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:27.302809] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9831 primary records. [2025-10-13T22:41:27.314013] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-13T22:41:27.484601] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-13T22:41:27.485766] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-13T22:41:27.489043] [INFO ] [MAIN ] Derivative Progress: 1210/1810 symbols completed. MYN took 1.2s. Estimated remaining: 3m 52s. Rate: 155.5 symbols/min [2025-10-13T22:41:27.489690] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:27.508746] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:27.513143] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2646 primary records. [2025-10-13T22:41:27.513580] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-13T22:41:27.534614] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-13T22:41:27.530720] [DEBUG] [LOCAL ] NBB: Loaded 9057 existing records from primary storage. [2025-10-13T22:41:27.535038] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-13T22:41:27.538411] [INFO ] [MAIN ] Derivative Progress: 1211/1810 symbols completed. NAZ took 0.8s. Estimated remaining: 3m 51s. Rate: 155.6 symbols/min [2025-10-13T22:41:27.538717] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:27.535154] [INFO ] [MAIN ] NBB: Loaded 9057 primary data records. [2025-10-13T22:41:27.583664] [DEBUG] [LOCAL ] NC: Loaded 1951 existing records from primary storage. [2025-10-13T22:41:27.632517] [INFO ] [MAIN ] NC: Loaded 1951 primary data records. [2025-10-13T22:41:28.194716] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:28.197144] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49203 primary records. [2025-10-13T22:41:28.197736] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-13T22:41:28.219920] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-13T22:41:28.221626] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-13T22:41:28.226112] [INFO ] [MAIN ] Derivative Progress: 1212/1810 symbols completed. NAT took 1.7s. Estimated remaining: 3m 51s. Rate: 155.5 symbols/min [2025-10-13T22:41:28.226870] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:28.245553] [DEBUG] [LOCAL ] NCA: Loaded 9998 existing records from primary storage. [2025-10-13T22:41:28.247014] [INFO ] [MAIN ] NCA: Loaded 9998 primary data records. [2025-10-13T22:41:28.301923] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:28.323442] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9057 primary records. [2025-10-13T22:41:28.359250] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-13T22:41:28.390043] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:41:28.401700] [INFO ] [MAIN ] NC: Generated 1791 derivative records from 1951 primary records. [2025-10-13T22:41:28.431605] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-13T22:41:28.702022] [DEBUG] [LOCAL ] NC: Derivative data saved (1791 records). [2025-10-13T22:41:28.702865] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-13T22:41:28.706626] [INFO ] [MAIN ] Derivative Progress: 1213/1810 symbols completed. NC took 1.2s. Estimated remaining: 3m 50s. Rate: 155.5 symbols/min [2025-10-13T22:41:28.708740] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-13T22:41:28.709511] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-13T22:41:28.712618] [INFO ] [MAIN ] Derivative Progress: 1214/1810 symbols completed. NBB took 1.2s. Estimated remaining: 3m 50s. Rate: 155.6 symbols/min [2025-10-13T22:41:28.735874] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:28.736569] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9998 primary records. [2025-10-13T22:41:28.736702] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-13T22:41:28.751079] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-13T22:41:28.751139] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-13T22:41:28.755166] [INFO ] [MAIN ] Derivative Progress: 1215/1810 symbols completed. NCA took 0.5s. Estimated remaining: 3m 49s. Rate: 155.7 symbols/min [2025-10-13T22:41:28.755715] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:28.755770] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:28.755675] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:28.764733] [DEBUG] [LOCAL ] NEXA: Loaded 4997 existing records from primary storage. [2025-10-13T22:41:28.765026] [INFO ] [MAIN ] NEXA: Loaded 4997 primary data records. [2025-10-13T22:41:28.890638] [DEBUG] [LOCAL ] NCZ: Loaded 12406 existing records from primary storage. [2025-10-13T22:41:28.891420] [DEBUG] [LOCAL ] NCV: Loaded 14007 existing records from primary storage. [2025-10-13T22:41:28.897154] [INFO ] [MAIN ] NCV: Loaded 14007 primary data records. [2025-10-13T22:41:28.891830] [INFO ] [MAIN ] NCZ: Loaded 12406 primary data records. [2025-10-13T22:41:29.789328] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:29.790896] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4997 primary records. [2025-10-13T22:41:29.791269] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-13T22:41:29.810677] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-10-13T22:41:29.810995] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-13T22:41:29.813815] [INFO ] [MAIN ] Derivative Progress: 1216/1810 symbols completed. NEXA took 1.1s. Estimated remaining: 3m 49s. Rate: 155.5 symbols/min [2025-10-13T22:41:29.814096] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:29.830343] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:29.832181] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12406 primary records. [2025-10-13T22:41:29.832356] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-13T22:41:29.858409] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:29.859820] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 14007 primary records. [2025-10-13T22:41:29.860167] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-13T22:41:29.885464] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-13T22:41:29.886148] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-13T22:41:29.890216] [INFO ] [MAIN ] Derivative Progress: 1217/1810 symbols completed. NCZ took 1.1s. Estimated remaining: 3m 49s. Rate: 155.6 symbols/min [2025-10-13T22:41:29.891098] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:29.902239] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-13T22:41:29.903535] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-13T22:41:29.907783] [INFO ] [MAIN ] Derivative Progress: 1218/1810 symbols completed. NCV took 1.2s. Estimated remaining: 3m 48s. Rate: 155.7 symbols/min [2025-10-13T22:41:29.908276] [DEBUG] [LOCAL ] NGL: Loaded 29979 existing records from primary storage. [2025-10-13T22:41:29.908738] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:29.908918] [INFO ] [MAIN ] NGL: Loaded 29979 primary data records. [2025-10-13T22:41:30.021774] [DEBUG] [LOCAL ] NGS: Loaded 11252 existing records from primary storage. [2025-10-13T22:41:30.025530] [INFO ] [MAIN ] NGS: Loaded 11252 primary data records. [2025-10-13T22:41:30.107743] [DEBUG] [LOCAL ] NIE: Loaded 12028 existing records from primary storage. [2025-10-13T22:41:30.181048] [INFO ] [MAIN ] NIE: Loaded 12028 primary data records. [2025-10-13T22:41:31.003812] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:31.006501] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 29979 primary records. [2025-10-13T22:41:31.007063] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-13T22:41:31.027548] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-13T22:41:31.027958] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-13T22:41:31.030592] [INFO ] [MAIN ] Derivative Progress: 1219/1810 symbols completed. NGL took 1.2s. Estimated remaining: 3m 48s. Rate: 155.5 symbols/min [2025-10-13T22:41:31.030909] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:31.045568] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:31.048530] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11252 primary records. [2025-10-13T22:41:31.049363] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-13T22:41:31.077119] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:31.078695] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 12028 primary records. [2025-10-13T22:41:31.079443] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-13T22:41:31.089724] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-10-13T22:41:31.096956] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-13T22:41:31.104558] [INFO ] [MAIN ] Derivative Progress: 1220/1810 symbols completed. NGS took 1.2s. Estimated remaining: 3m 48s. Rate: 155.6 symbols/min [2025-10-13T22:41:31.106295] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:31.120960] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-13T22:41:31.122689] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-13T22:41:31.126800] [INFO ] [MAIN ] Derivative Progress: 1221/1810 symbols completed. NIE took 1.2s. Estimated remaining: 3m 47s. Rate: 155.7 symbols/min [2025-10-13T22:41:31.127985] [DEBUG] [LOCAL ] NINE: Loaded 28123 existing records from primary storage. [2025-10-13T22:41:31.128415] [INFO ] [MAIN ] NINE: Loaded 28123 primary data records. [2025-10-13T22:41:31.128529] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:31.352395] [DEBUG] [LOCAL ] NKX: Loaded 13621 existing records from primary storage. [2025-10-13T22:41:31.367633] [INFO ] [MAIN ] NKX: Loaded 13621 primary data records. [2025-10-13T22:41:31.490503] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-13T22:41:31.510796] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-13T22:41:32.143328] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:32.144902] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28123 primary records. [2025-10-13T22:41:32.145192] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-13T22:41:32.163976] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-13T22:41:32.164405] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-13T22:41:32.169361] [INFO ] [MAIN ] Derivative Progress: 1222/1810 symbols completed. NINE took 1.1s. Estimated remaining: 3m 47s. Rate: 155.5 symbols/min [2025-10-13T22:41:32.171060] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:32.186117] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:32.187129] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13621 primary records. [2025-10-13T22:41:32.200124] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-13T22:41:32.199967] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:32.200830] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-13T22:41:32.201459] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-13T22:41:32.229110] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-13T22:41:32.232702] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-13T22:41:32.243831] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-13T22:41:32.244297] [DEBUG] [LOCAL ] NMAI: Loaded 12919 existing records from primary storage. [2025-10-13T22:41:32.243406] [INFO ] [MAIN ] Derivative Progress: 1223/1810 symbols completed. NKX took 1.1s. Estimated remaining: 3m 46s. Rate: 155.6 symbols/min [2025-10-13T22:41:32.244355] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-13T22:41:32.247321] [INFO ] [MAIN ] Derivative Progress: 1224/1810 symbols completed. NIO took 1.1s. Estimated remaining: 3m 46s. Rate: 155.7 symbols/min [2025-10-13T22:41:32.244548] [INFO ] [MAIN ] NMAI: Loaded 12919 primary data records. [2025-10-13T22:41:32.247245] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:32.247688] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:32.335063] [DEBUG] [LOCAL ] NMI: Loaded 4062 existing records from primary storage. [2025-10-13T22:41:32.345877] [INFO ] [MAIN ] NMI: Loaded 4062 primary data records. [2025-10-13T22:41:32.438577] [DEBUG] [LOCAL ] NMG: Loaded 9936 existing records from primary storage. [2025-10-13T22:41:32.444692] [INFO ] [MAIN ] NMG: Loaded 9936 primary data records. [2025-10-13T22:41:33.223971] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:33.224837] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12919 primary records. [2025-10-13T22:41:33.225027] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-13T22:41:33.241373] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-13T22:41:33.245202] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-13T22:41:33.249244] [INFO ] [MAIN ] Derivative Progress: 1225/1810 symbols completed. NMAI took 1.1s. Estimated remaining: 3m 46s. Rate: 155.5 symbols/min [2025-10-13T22:41:33.262263] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:33.262883] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:33.264042] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4062 primary records. [2025-10-13T22:41:33.271639] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-13T22:41:33.277900] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:33.279058] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 9936 primary records. [2025-10-13T22:41:33.285125] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-13T22:41:33.305067] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-13T22:41:33.305500] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-13T22:41:33.308621] [INFO ] [MAIN ] Derivative Progress: 1226/1810 symbols completed. NMI took 1.1s. Estimated remaining: 3m 45s. Rate: 155.6 symbols/min [2025-10-13T22:41:33.309812] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:33.323210] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-13T22:41:33.323461] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-13T22:41:33.326612] [INFO ] [MAIN ] Derivative Progress: 1227/1810 symbols completed. NMG took 1.1s. Estimated remaining: 3m 45s. Rate: 155.7 symbols/min [2025-10-13T22:41:33.330214] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:33.330095] [DEBUG] [LOCAL ] NMS: Loaded 2931 existing records from primary storage. [2025-10-13T22:41:33.330471] [INFO ] [MAIN ] NMS: Loaded 2931 primary data records. [2025-10-13T22:41:33.434518] [DEBUG] [LOCAL ] NMR: Loaded 35423 existing records from primary storage. [2025-10-13T22:41:33.439799] [INFO ] [MAIN ] NMR: Loaded 35423 primary data records. [2025-10-13T22:41:33.424778] [DEBUG] [LOCAL ] NMT: Loaded 2835 existing records from primary storage. [2025-10-13T22:41:33.470491] [INFO ] [MAIN ] NMT: Loaded 2835 primary data records. [2025-10-13T22:41:34.340767] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:34.341764] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2931 primary records. [2025-10-13T22:41:34.341941] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-13T22:41:34.375197] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:34.377292] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2835 primary records. [2025-10-13T22:41:34.377680] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-13T22:41:34.390757] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-13T22:41:34.397393] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-13T22:41:34.397286] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:34.399907] [INFO ] [MAIN ] Derivative Progress: 1228/1810 symbols completed. NMS took 1.1s. Estimated remaining: 3m 45s. Rate: 155.5 symbols/min [2025-10-13T22:41:34.404370] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35423 primary records. [2025-10-13T22:41:34.407788] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-13T22:41:34.408215] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-10-13T22:41:34.408942] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-13T22:41:34.411878] [INFO ] [MAIN ] Derivative Progress: 1229/1810 symbols completed. NMT took 1.1s. Estimated remaining: 3m 44s. Rate: 155.6 symbols/min [2025-10-13T22:41:34.426224] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-13T22:41:34.426285] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-13T22:41:34.429709] [INFO ] [MAIN ] Derivative Progress: 1230/1810 symbols completed. NMR took 1.2s. Estimated remaining: 3m 43s. Rate: 155.7 symbols/min [2025-10-13T22:41:34.431344] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:34.431232] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:34.431594] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:34.441030] [DEBUG] [LOCAL ] NNY: Loaded 5632 existing records from primary storage. [2025-10-13T22:41:34.441245] [INFO ] [MAIN ] NNY: Loaded 5632 primary data records. [2025-10-13T22:41:34.518587] [DEBUG] [LOCAL ] NNI: Loaded 10413 existing records from primary storage. [2025-10-13T22:41:34.546209] [INFO ] [MAIN ] NNI: Loaded 10413 primary data records. [2025-10-13T22:41:35.106457] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-13T22:41:35.122305] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-13T22:41:35.458571] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:35.460442] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5632 primary records. [2025-10-13T22:41:35.461153] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-13T22:41:35.483285] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-13T22:41:35.496914] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-13T22:41:35.497211] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:35.498139] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10413 primary records. [2025-10-13T22:41:35.501227] [INFO ] [MAIN ] Derivative Progress: 1231/1810 symbols completed. NNY took 1.1s. Estimated remaining: 3m 43s. Rate: 155.5 symbols/min [2025-10-13T22:41:35.501577] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:35.501970] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-13T22:41:35.537819] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:35.538685] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53622 primary records. [2025-10-13T22:41:35.537320] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-13T22:41:35.538865] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-13T22:41:35.538959] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-13T22:41:35.542725] [INFO ] [MAIN ] Derivative Progress: 1232/1810 symbols completed. NNI took 1.1s. Estimated remaining: 3m 43s. Rate: 155.6 symbols/min [2025-10-13T22:41:35.543560] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:35.569023] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-13T22:41:35.569168] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-13T22:41:35.574036] [INFO ] [MAIN ] Derivative Progress: 1233/1810 symbols completed. NOK took 1.1s. Estimated remaining: 3m 42s. Rate: 155.7 symbols/min [2025-10-13T22:41:35.574443] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:35.592603] [DEBUG] [LOCAL ] NOTE: Loaded 40651 existing records from primary storage. [2025-10-13T22:41:35.595228] [INFO ] [MAIN ] NOTE: Loaded 40651 primary data records. [2025-10-13T22:41:35.620916] [DEBUG] [LOCAL ] NPFD: Loaded 9968 existing records from primary storage. [2025-10-13T22:41:35.649197] [INFO ] [MAIN ] NPFD: Loaded 9968 primary data records. [2025-10-13T22:41:35.672890] [DEBUG] [LOCAL ] NPK: Loaded 8253 existing records from primary storage. [2025-10-13T22:41:35.771750] [INFO ] [MAIN ] NPK: Loaded 8253 primary data records. [2025-10-13T22:41:36.629122] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:36.630067] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 40651 primary records. [2025-10-13T22:41:36.630268] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-13T22:41:36.650723] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:36.660043] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9968 primary records. [2025-10-13T22:41:36.660148] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-13T22:41:36.660729] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-10-13T22:41:36.660859] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-13T22:41:36.663579] [INFO ] [MAIN ] Derivative Progress: 1234/1810 symbols completed. NOTE took 1.2s. Estimated remaining: 3m 42s. Rate: 155.5 symbols/min [2025-10-13T22:41:36.663781] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:36.689558] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:36.692975] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8253 primary records. [2025-10-13T22:41:36.693286] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-13T22:41:36.709073] [DEBUG] [LOCAL ] NPV: Loaded 5318 existing records from primary storage. [2025-10-13T22:41:36.709710] [INFO ] [MAIN ] NPV: Loaded 5318 primary data records. [2025-10-13T22:41:36.724861] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-13T22:41:36.734548] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-13T22:41:36.747418] [INFO ] [MAIN ] Derivative Progress: 1235/1810 symbols completed. NPK took 1.2s. Estimated remaining: 3m 42s. Rate: 155.6 symbols/min [2025-10-13T22:41:36.771816] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-10-13T22:41:36.785759] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-13T22:41:36.805630] [INFO ] [MAIN ] Derivative Progress: 1236/1810 symbols completed. NPFD took 1.3s. Estimated remaining: 3m 41s. Rate: 155.7 symbols/min [2025-10-13T22:41:36.792123] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:36.811378] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:37.020937] [DEBUG] [LOCAL ] NQP: Loaded 9236 existing records from primary storage. [2025-10-13T22:41:37.021196] [INFO ] [MAIN ] NQP: Loaded 9236 primary data records. [2025-10-13T22:41:37.178926] [DEBUG] [LOCAL ] NRDY: Loaded 32701 existing records from primary storage. [2025-10-13T22:41:37.190057] [INFO ] [MAIN ] NRDY: Loaded 32701 primary data records. [2025-10-13T22:41:37.681495] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:37.682342] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5318 primary records. [2025-10-13T22:41:37.682584] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-13T22:41:37.700132] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-13T22:41:37.700703] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-13T22:41:37.703617] [INFO ] [MAIN ] Derivative Progress: 1237/1810 symbols completed. NPV took 1.0s. Estimated remaining: 3m 41s. Rate: 155.5 symbols/min [2025-10-13T22:41:37.704177] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:37.727494] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:37.732130] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9236 primary records. [2025-10-13T22:41:37.732427] [DEBUG] [LOCAL ] NREF: Loaded 8010 existing records from primary storage. [2025-10-13T22:41:37.732581] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-13T22:41:37.733399] [INFO ] [MAIN ] NREF: Loaded 8010 primary data records. [2025-10-13T22:41:37.806425] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-13T22:41:37.807344] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-13T22:41:37.836539] [INFO ] [MAIN ] Derivative Progress: 1238/1810 symbols completed. NQP took 1.0s. Estimated remaining: 3m 41s. Rate: 155.6 symbols/min [2025-10-13T22:41:37.867998] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:37.878290] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:37.900639] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32701 primary records. [2025-10-13T22:41:37.900905] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-13T22:41:38.107501] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-13T22:41:38.108349] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-13T22:41:38.114426] [INFO ] [MAIN ] Derivative Progress: 1239/1810 symbols completed. NRDY took 1.3s. Estimated remaining: 3m 40s. Rate: 155.7 symbols/min [2025-10-13T22:41:38.114701] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:38.139610] [DEBUG] [LOCAL ] NRGV: Loaded 43608 existing records from primary storage. [2025-10-13T22:41:38.138715] [DEBUG] [LOCAL ] NRP: Loaded 4115 existing records from primary storage. [2025-10-13T22:41:38.140049] [INFO ] [MAIN ] NRP: Loaded 4115 primary data records. [2025-10-13T22:41:38.140371] [INFO ] [MAIN ] NRGV: Loaded 43608 primary data records. [2025-10-13T22:41:38.407060] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:38.442491] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 8010 primary records. [2025-10-13T22:41:38.492830] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-13T22:41:38.925772] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-13T22:41:38.927441] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-13T22:41:38.930400] [INFO ] [MAIN ] Derivative Progress: 1240/1810 symbols completed. NREF took 1.2s. Estimated remaining: 3m 40s. Rate: 155.5 symbols/min [2025-10-13T22:41:38.931174] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:38.942919] [DEBUG] [LOCAL ] NRT: Loaded 4894 existing records from primary storage. [2025-10-13T22:41:38.943942] [INFO ] [MAIN ] NRT: Loaded 4894 primary data records. [2025-10-13T22:41:39.130944] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:39.160888] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43608 primary records. [2025-10-13T22:41:39.164435] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-13T22:41:39.299400] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:39.312965] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4115 primary records. [2025-10-13T22:41:39.316461] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-13T22:41:39.318038] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-13T22:41:39.320279] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-13T22:41:39.323619] [INFO ] [MAIN ] Derivative Progress: 1241/1810 symbols completed. NRGV took 1.5s. Estimated remaining: 3m 40s. Rate: 155.5 symbols/min [2025-10-13T22:41:39.324201] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:39.341835] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-10-13T22:41:39.342202] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-13T22:41:39.345312] [INFO ] [MAIN ] Derivative Progress: 1242/1810 symbols completed. NRP took 1.2s. Estimated remaining: 3m 39s. Rate: 155.6 symbols/min [2025-10-13T22:41:39.345992] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:39.385121] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:39.386539] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4894 primary records. [2025-10-13T22:41:39.385528] [DEBUG] [LOCAL ] NUV: Loaded 23505 existing records from primary storage. [2025-10-13T22:41:39.386711] [INFO ] [MAIN ] NUV: Loaded 23505 primary data records. [2025-10-13T22:41:39.386796] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-13T22:41:39.496263] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-13T22:41:39.554152] [DEBUG] [LOCAL ] NUVB: Loaded 51503 existing records from primary storage. [2025-10-13T22:41:39.518358] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-13T22:41:39.580563] [INFO ] [MAIN ] NUVB: Loaded 51503 primary data records. [2025-10-13T22:41:39.585850] [INFO ] [MAIN ] Derivative Progress: 1243/1810 symbols completed. NRT took 0.7s. Estimated remaining: 3m 39s. Rate: 155.7 symbols/min [2025-10-13T22:41:40.047403] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:40.048320] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23505 primary records. [2025-10-13T22:41:40.048630] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-13T22:41:40.065162] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-13T22:41:40.065418] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-13T22:41:40.069774] [INFO ] [MAIN ] Derivative Progress: 1244/1810 symbols completed. NUV took 0.7s. Estimated remaining: 3m 38s. Rate: 155.7 symbols/min [2025-10-13T22:41:40.083614] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:40.084359] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51503 primary records. [2025-10-13T22:41:40.084422] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-13T22:41:40.100044] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-10-13T22:41:40.100133] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-13T22:41:40.103303] [INFO ] [MAIN ] Derivative Progress: 1245/1810 symbols completed. NUVB took 0.8s. Estimated remaining: 3m 38s. Rate: 155.8 symbols/min [2025-10-13T22:41:40.103873] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:40.103781] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:40.104511] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:40.115001] [DEBUG] [LOCAL ] NXC: Loaded 4109 existing records from primary storage. [2025-10-13T22:41:40.115232] [INFO ] [MAIN ] NXC: Loaded 4109 primary data records. [2025-10-13T22:41:40.131741] [DEBUG] [LOCAL ] NUW: Loaded 6833 existing records from primary storage. [2025-10-13T22:41:40.153627] [INFO ] [MAIN ] NUW: Loaded 6833 primary data records. [2025-10-13T22:41:40.406352] [DEBUG] [LOCAL ] NVR: Loaded 18521 existing records from primary storage. [2025-10-13T22:41:40.419678] [INFO ] [MAIN ] NVR: Loaded 18521 primary data records. [2025-10-13T22:41:41.143358] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:41.145132] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4109 primary records. [2025-10-13T22:41:41.145328] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-13T22:41:41.177405] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-13T22:41:41.177903] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:41.178014] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-13T22:41:41.180542] [INFO ] [MAIN ] Derivative Progress: 1246/1810 symbols completed. NXC took 1.1s. Estimated remaining: 3m 38s. Rate: 155.5 symbols/min [2025-10-13T22:41:41.180817] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:41.181762] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 6833 primary records. [2025-10-13T22:41:41.182518] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-13T22:41:41.205830] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-13T22:41:41.206154] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-13T22:41:41.209290] [INFO ] [MAIN ] Derivative Progress: 1247/1810 symbols completed. NUW took 1.1s. Estimated remaining: 3m 37s. Rate: 155.7 symbols/min [2025-10-13T22:41:41.221724] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:41.222766] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:41.228364] [DEBUG] [LOCAL ] NXDT: Loaded 15006 existing records from primary storage. [2025-10-13T22:41:41.228553] [INFO ] [MAIN ] NXDT: Loaded 15006 primary data records. [2025-10-13T22:41:41.229263] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 18521 primary records. [2025-10-13T22:41:41.265915] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-13T22:41:41.362580] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-10-13T22:41:41.378341] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-13T22:41:41.386413] [INFO ] [MAIN ] Derivative Progress: 1248/1810 symbols completed. NVR took 1.3s. Estimated remaining: 3m 37s. Rate: 155.7 symbols/min [2025-10-13T22:41:41.413085] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:41.598880] [DEBUG] [LOCAL ] NXG: Loaded 10468 existing records from primary storage. [2025-10-13T22:41:41.600559] [INFO ] [MAIN ] NXG: Loaded 10468 primary data records. [2025-10-13T22:41:41.600473] [DEBUG] [LOCAL ] NXE: Loaded 53013 existing records from primary storage. [2025-10-13T22:41:41.600819] [INFO ] [MAIN ] NXE: Loaded 53013 primary data records. [2025-10-13T22:41:42.241185] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:42.242878] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 15006 primary records. [2025-10-13T22:41:42.243204] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-13T22:41:42.263039] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-10-13T22:41:42.263373] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-13T22:41:42.266629] [INFO ] [MAIN ] Derivative Progress: 1249/1810 symbols completed. NXDT took 1.1s. Estimated remaining: 3m 36s. Rate: 155.6 symbols/min [2025-10-13T22:41:42.267038] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:42.274410] [DEBUG] [LOCAL ] NXN: Loaded 2241 existing records from primary storage. [2025-10-13T22:41:42.274746] [INFO ] [MAIN ] NXN: Loaded 2241 primary data records. [2025-10-13T22:41:42.439296] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:42.480168] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53013 primary records. [2025-10-13T22:41:42.645276] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-13T22:41:42.668938] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:42.678239] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10468 primary records. [2025-10-13T22:41:42.682529] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-13T22:41:42.702540] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-10-13T22:41:42.702929] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-13T22:41:42.703706] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-13T22:41:42.704072] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-13T22:41:42.707093] [INFO ] [MAIN ] Derivative Progress: 1250/1810 symbols completed. NXG took 1.3s. Estimated remaining: 3m 36s. Rate: 155.6 symbols/min [2025-10-13T22:41:42.710543] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:42.710670] [INFO ] [MAIN ] Derivative Progress: 1251/1810 symbols completed. NXE took 1.5s. Estimated remaining: 3m 35s. Rate: 155.7 symbols/min [2025-10-13T22:41:42.711257] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:42.726440] [DEBUG] [LOCAL ] OCFT: Loaded 7465 existing records from primary storage. [2025-10-13T22:41:42.726934] [INFO ] [MAIN ] OCFT: Loaded 7465 primary data records. [2025-10-13T22:41:42.789449] [DEBUG] [LOCAL ] NXP: Loaded 12302 existing records from primary storage. [2025-10-13T22:41:42.816997] [INFO ] [MAIN ] NXP: Loaded 12302 primary data records. [2025-10-13T22:41:42.950564] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:42.979691] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2241 primary records. [2025-10-13T22:41:42.979821] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-13T22:41:43.185447] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-13T22:41:43.196569] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-13T22:41:43.204711] [INFO ] [MAIN ] Derivative Progress: 1252/1810 symbols completed. NXN took 0.9s. Estimated remaining: 3m 35s. Rate: 155.6 symbols/min [2025-10-13T22:41:43.215684] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:43.403364] [DEBUG] [LOCAL ] ODC: Loaded 8484 existing records from primary storage. [2025-10-13T22:41:43.403973] [INFO ] [MAIN ] ODC: Loaded 8484 primary data records. [2025-10-13T22:41:43.727346] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:43.731037] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7465 primary records. [2025-10-13T22:41:43.732875] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-13T22:41:43.760454] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:43.763173] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12302 primary records. [2025-10-13T22:41:43.763574] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-13T22:41:43.776772] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-13T22:41:43.781756] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-13T22:41:43.784546] [INFO ] [MAIN ] Derivative Progress: 1253/1810 symbols completed. OCFT took 1.1s. Estimated remaining: 3m 35s. Rate: 155.6 symbols/min [2025-10-13T22:41:43.785345] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:43.789119] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-13T22:41:43.789302] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-13T22:41:43.792360] [INFO ] [MAIN ] Derivative Progress: 1254/1810 symbols completed. NXP took 1.1s. Estimated remaining: 3m 34s. Rate: 155.7 symbols/min [2025-10-13T22:41:43.792556] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:43.811251] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:43.816477] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8484 primary records. [2025-10-13T22:41:43.816796] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-13T22:41:43.842727] [DEBUG] [LOCAL ] OIA: Loaded 13178 existing records from primary storage. [2025-10-13T22:41:43.845342] [INFO ] [MAIN ] OIA: Loaded 13178 primary data records. [2025-10-13T22:41:43.845447] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-13T22:41:43.875785] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-13T22:41:43.918994] [INFO ] [MAIN ] Derivative Progress: 1255/1810 symbols completed. ODC took 0.7s. Estimated remaining: 3m 34s. Rate: 155.8 symbols/min [2025-10-13T22:41:43.948586] [DEBUG] [LOCAL ] ODV: Loaded 28490 existing records from primary storage. [2025-10-13T22:41:43.942673] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:43.960999] [INFO ] [MAIN ] ODV: Loaded 28490 primary data records. [2025-10-13T22:41:44.475520] [DEBUG] [LOCAL ] OIS: Loaded 40057 existing records from primary storage. [2025-10-13T22:41:44.485920] [INFO ] [MAIN ] OIS: Loaded 40057 primary data records. [2025-10-13T22:41:44.859387] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:44.861127] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13178 primary records. [2025-10-13T22:41:44.861839] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-13T22:41:44.880542] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-13T22:41:44.880883] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-13T22:41:44.883586] [INFO ] [MAIN ] Derivative Progress: 1256/1810 symbols completed. OIA took 1.1s. Estimated remaining: 3m 34s. Rate: 155.6 symbols/min [2025-10-13T22:41:44.897239] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:44.897758] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:44.899220] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 28490 primary records. [2025-10-13T22:41:44.899489] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-13T22:41:44.923579] [DEBUG] [LOCAL ] OLP: Loaded 10049 existing records from primary storage. [2025-10-13T22:41:44.924833] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-13T22:41:44.927011] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-13T22:41:44.926941] [INFO ] [MAIN ] OLP: Loaded 10049 primary data records. [2025-10-13T22:41:44.951553] [INFO ] [MAIN ] Derivative Progress: 1257/1810 symbols completed. ODV took 1.2s. Estimated remaining: 3m 33s. Rate: 155.7 symbols/min [2025-10-13T22:41:44.989226] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:45.038980] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:45.050885] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40057 primary records. [2025-10-13T22:41:45.051153] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-13T22:41:45.147858] [DEBUG] [LOCAL ] ONIT: Loaded 7639 existing records from primary storage. [2025-10-13T22:41:45.254513] [INFO ] [MAIN ] ONIT: Loaded 7639 primary data records. [2025-10-13T22:41:45.296960] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-13T22:41:45.297200] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-13T22:41:45.305683] [INFO ] [MAIN ] Derivative Progress: 1258/1810 symbols completed. OIS took 1.4s. Estimated remaining: 3m 33s. Rate: 155.7 symbols/min [2025-10-13T22:41:45.594382] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:45.595422] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 10049 primary records. [2025-10-13T22:41:45.596038] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-13T22:41:45.613924] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-10-13T22:41:45.614133] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-13T22:41:45.616786] [INFO ] [MAIN ] Derivative Progress: 1259/1810 symbols completed. OLP took 0.7s. Estimated remaining: 3m 32s. Rate: 155.7 symbols/min [2025-10-13T22:41:45.633941] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:41:45.634720] [INFO ] [MAIN ] ONIT: Generated 1790 derivative records from 7639 primary records. [2025-10-13T22:41:45.634831] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-13T22:41:45.649958] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1790 records). [2025-10-13T22:41:45.650117] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-13T22:41:45.653278] [INFO ] [MAIN ] Derivative Progress: 1260/1810 symbols completed. ONIT took 0.7s. Estimated remaining: 3m 32s. Rate: 155.8 symbols/min [2025-10-13T22:41:45.653852] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:45.654318] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:45.653968] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:45.690324] [DEBUG] [LOCAL ] ONTF: Loaded 22596 existing records from primary storage. [2025-10-13T22:41:45.690626] [INFO ] [MAIN ] ONTF: Loaded 22596 primary data records. [2025-10-13T22:41:45.777756] [DEBUG] [LOCAL ] OPAD: Loaded 24462 existing records from primary storage. [2025-10-13T22:41:45.796625] [INFO ] [MAIN ] OPAD: Loaded 24462 primary data records. [2025-10-13T22:41:45.819970] [DEBUG] [LOCAL ] ONL: Loaded 29682 existing records from primary storage. [2025-10-13T22:41:45.832509] [INFO ] [MAIN ] ONL: Loaded 29682 primary data records. [2025-10-13T22:41:46.723520] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:46.724304] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22596 primary records. [2025-10-13T22:41:46.724775] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-13T22:41:46.745310] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-13T22:41:46.759335] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-13T22:41:46.762339] [INFO ] [MAIN ] Derivative Progress: 1261/1810 symbols completed. ONTF took 1.1s. Estimated remaining: 3m 32s. Rate: 155.6 symbols/min [2025-10-13T22:41:46.762755] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:41:46.763628] [INFO ] [MAIN ] OPAD: Generated 1792 derivative records from 24462 primary records. [2025-10-13T22:41:46.778171] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-13T22:41:46.772618] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:46.787552] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:46.793597] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 29682 primary records. [2025-10-13T22:41:46.797835] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-13T22:41:46.819148] [DEBUG] [LOCAL ] OPP: Loaded 12202 existing records from primary storage. [2025-10-13T22:41:46.820845] [INFO ] [MAIN ] OPP: Loaded 12202 primary data records. [2025-10-13T22:41:46.823206] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1792 records). [2025-10-13T22:41:46.829098] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-13T22:41:46.838071] [INFO ] [MAIN ] Derivative Progress: 1262/1810 symbols completed. OPAD took 1.2s. Estimated remaining: 3m 31s. Rate: 155.7 symbols/min [2025-10-13T22:41:46.882577] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:46.932115] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-13T22:41:46.935597] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-13T22:41:46.939043] [INFO ] [MAIN ] Derivative Progress: 1263/1810 symbols completed. ONL took 1.3s. Estimated remaining: 3m 31s. Rate: 155.8 symbols/min [2025-10-13T22:41:46.945150] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:47.187149] [DEBUG] [LOCAL ] ORN: Loaded 30834 existing records from primary storage. [2025-10-13T22:41:47.188682] [INFO ] [MAIN ] ORN: Loaded 30834 primary data records. [2025-10-13T22:41:47.201170] [DEBUG] [LOCAL ] ORC: Loaded 52499 existing records from primary storage. [2025-10-13T22:41:47.244226] [INFO ] [MAIN ] ORC: Loaded 52499 primary data records. [2025-10-13T22:41:47.493262] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:47.564564] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 12202 primary records. [2025-10-13T22:41:47.671341] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-13T22:41:47.811313] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-13T22:41:47.812337] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-13T22:41:47.815219] [INFO ] [MAIN ] Derivative Progress: 1264/1810 symbols completed. OPP took 1.0s. Estimated remaining: 3m 30s. Rate: 155.6 symbols/min [2025-10-13T22:41:47.815560] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:47.830406] [DEBUG] [LOCAL ] OWLT: Loaded 9242 existing records from primary storage. [2025-10-13T22:41:47.831573] [INFO ] [MAIN ] OWLT: Loaded 9242 primary data records. [2025-10-13T22:41:47.913610] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:47.933136] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30834 primary records. [2025-10-13T22:41:47.951126] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-13T22:41:47.973263] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:47.987925] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52499 primary records. [2025-10-13T22:41:47.993138] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-13T22:41:48.162637] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-13T22:41:48.187152] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-13T22:41:48.193316] [INFO ] [MAIN ] Derivative Progress: 1265/1810 symbols completed. ORN took 1.2s. Estimated remaining: 3m 30s. Rate: 155.6 symbols/min [2025-10-13T22:41:48.194020] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-13T22:41:48.194151] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:48.194229] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-13T22:41:48.198133] [INFO ] [MAIN ] Derivative Progress: 1266/1810 symbols completed. ORC took 1.3s. Estimated remaining: 3m 30s. Rate: 155.8 symbols/min [2025-10-13T22:41:48.198568] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:48.214195] [DEBUG] [LOCAL ] PAC: Loaded 11639 existing records from primary storage. [2025-10-13T22:41:48.214628] [INFO ] [MAIN ] PAC: Loaded 11639 primary data records. [2025-10-13T22:41:48.336544] [DEBUG] [LOCAL ] PACK: Loaded 31890 existing records from primary storage. [2025-10-13T22:41:48.344928] [INFO ] [MAIN ] PACK: Loaded 31890 primary data records. [2025-10-13T22:41:48.392022] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:48.421031] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 9242 primary records. [2025-10-13T22:41:48.469266] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-13T22:41:48.759697] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-10-13T22:41:48.897390] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-13T22:41:48.902988] [INFO ] [MAIN ] Derivative Progress: 1267/1810 symbols completed. OWLT took 1.1s. Estimated remaining: 3m 29s. Rate: 155.7 symbols/min [2025-10-13T22:41:48.903253] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:48.912689] [DEBUG] [LOCAL ] PAI: Loaded 2704 existing records from primary storage. [2025-10-13T22:41:48.913483] [INFO ] [MAIN ] PAI: Loaded 2704 primary data records. [2025-10-13T22:41:49.225235] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:49.232073] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11639 primary records. [2025-10-13T22:41:49.241794] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-13T22:41:49.274454] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:49.276991] [INFO ] [MAIN ] PACK: Generated 1793 derivative records from 31890 primary records. [2025-10-13T22:41:49.277506] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-13T22:41:49.279786] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-13T22:41:49.279932] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-13T22:41:49.282545] [INFO ] [MAIN ] Derivative Progress: 1268/1810 symbols completed. PAC took 1.1s. Estimated remaining: 3m 29s. Rate: 155.7 symbols/min [2025-10-13T22:41:49.295976] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:49.302035] [DEBUG] [LOCAL ] PACK: Derivative data saved (1793 records). [2025-10-13T22:41:49.304935] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-13T22:41:49.308346] [INFO ] [MAIN ] Derivative Progress: 1269/1810 symbols completed. PACK took 1.1s. Estimated remaining: 3m 28s. Rate: 155.8 symbols/min [2025-10-13T22:41:49.308636] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:49.314156] [DEBUG] [LOCAL ] PCF: Loaded 9089 existing records from primary storage. [2025-10-13T22:41:49.314474] [INFO ] [MAIN ] PCF: Loaded 9089 primary data records. [2025-10-13T22:41:49.415019] [DEBUG] [LOCAL ] PCM: Loaded 6785 existing records from primary storage. [2025-10-13T22:41:49.423778] [INFO ] [MAIN ] PCM: Loaded 6785 primary data records. [2025-10-13T22:41:49.457956] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:49.480060] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2704 primary records. [2025-10-13T22:41:49.505998] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-13T22:41:49.832516] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-13T22:41:49.832919] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-13T22:41:49.835512] [INFO ] [MAIN ] Derivative Progress: 1270/1810 symbols completed. PAI took 0.9s. Estimated remaining: 3m 28s. Rate: 155.7 symbols/min [2025-10-13T22:41:49.948154] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:49.965412] [DEBUG] [LOCAL ] PCQ: Loaded 12156 existing records from primary storage. [2025-10-13T22:41:49.966010] [INFO ] [MAIN ] PCQ: Loaded 12156 primary data records. [2025-10-13T22:41:50.102030] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:50.126480] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 9089 primary records. [2025-10-13T22:41:50.159547] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-13T22:41:50.292193] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:50.304544] [INFO ] [MAIN ] PCM: Generated 1793 derivative records from 6785 primary records. [2025-10-13T22:41:50.306378] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-13T22:41:50.310688] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-13T22:41:50.311162] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-13T22:41:50.313515] [INFO ] [MAIN ] Derivative Progress: 1271/1810 symbols completed. PCF took 1.0s. Estimated remaining: 3m 28s. Rate: 155.7 symbols/min [2025-10-13T22:41:50.314426] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:50.330045] [DEBUG] [LOCAL ] PCM: Derivative data saved (1793 records). [2025-10-13T22:41:50.330892] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-13T22:41:50.333483] [INFO ] [MAIN ] Derivative Progress: 1272/1810 symbols completed. PCM took 1.0s. Estimated remaining: 3m 27s. Rate: 155.8 symbols/min [2025-10-13T22:41:50.333719] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:50.353996] [DEBUG] [LOCAL ] PDS: Loaded 17330 existing records from primary storage. [2025-10-13T22:41:50.354269] [INFO ] [MAIN ] PDS: Loaded 17330 primary data records. [2025-10-13T22:41:50.462457] [DEBUG] [LOCAL ] PDT: Loaded 17559 existing records from primary storage. [2025-10-13T22:41:50.478623] [INFO ] [MAIN ] PDT: Loaded 17559 primary data records. [2025-10-13T22:41:50.571905] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:50.616477] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12156 primary records. [2025-10-13T22:41:50.636979] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-13T22:41:50.928630] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-13T22:41:51.055451] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-13T22:41:51.059436] [INFO ] [MAIN ] Derivative Progress: 1273/1810 symbols completed. PCQ took 1.1s. Estimated remaining: 3m 27s. Rate: 155.7 symbols/min [2025-10-13T22:41:51.082798] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:51.083916] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17330 primary records. [2025-10-13T22:41:51.084094] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-13T22:41:51.102066] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-13T22:41:51.102152] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-13T22:41:51.105812] [INFO ] [MAIN ] Derivative Progress: 1274/1810 symbols completed. PDS took 0.8s. Estimated remaining: 3m 26s. Rate: 155.8 symbols/min [2025-10-13T22:41:51.119890] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:51.120545] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17559 primary records. [2025-10-13T22:41:51.120605] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-13T22:41:51.135903] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-13T22:41:51.135989] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-13T22:41:51.138620] [INFO ] [MAIN ] Derivative Progress: 1275/1810 symbols completed. PDT took 0.8s. Estimated remaining: 3m 26s. Rate: 155.9 symbols/min [2025-10-13T22:41:51.139316] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:51.139429] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:51.139574] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:51.147745] [DEBUG] [LOCAL ] PFD: Loaded 5416 existing records from primary storage. [2025-10-13T22:41:51.147969] [INFO ] [MAIN ] PFD: Loaded 5416 primary data records. [2025-10-13T22:41:51.267017] [DEBUG] [LOCAL ] PEO: Loaded 11174 existing records from primary storage. [2025-10-13T22:41:51.266887] [DEBUG] [LOCAL ] PERF: Loaded 14341 existing records from primary storage. [2025-10-13T22:41:51.267525] [INFO ] [MAIN ] PEO: Loaded 11174 primary data records. [2025-10-13T22:41:51.308540] [INFO ] [MAIN ] PERF: Loaded 14341 primary data records. [2025-10-13T22:41:52.130160] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:52.131115] [INFO ] [MAIN ] PFD: Generated 1793 derivative records from 5416 primary records. [2025-10-13T22:41:52.131402] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-13T22:41:52.149109] [DEBUG] [LOCAL ] PFD: Derivative data saved (1793 records). [2025-10-13T22:41:52.150510] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-13T22:41:52.153198] [INFO ] [MAIN ] Derivative Progress: 1276/1810 symbols completed. PFD took 1.0s. Estimated remaining: 3m 26s. Rate: 155.7 symbols/min [2025-10-13T22:41:52.166439] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:52.165802] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:52.167212] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11174 primary records. [2025-10-13T22:41:52.167566] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-13T22:41:52.192537] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:52.195616] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14341 primary records. [2025-10-13T22:41:52.195942] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-13T22:41:52.201234] [DEBUG] [LOCAL ] PFH: Loaded 6756 existing records from primary storage. [2025-10-13T22:41:52.208431] [INFO ] [MAIN ] PFH: Loaded 6756 primary data records. [2025-10-13T22:41:52.236935] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-13T22:41:52.237292] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-13T22:41:52.255344] [INFO ] [MAIN ] Derivative Progress: 1277/1810 symbols completed. PERF took 1.1s. Estimated remaining: 3m 25s. Rate: 155.8 symbols/min [2025-10-13T22:41:52.255795] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:52.291059] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-13T22:41:52.296859] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-13T22:41:52.315769] [INFO ] [MAIN ] Derivative Progress: 1278/1810 symbols completed. PEO took 1.2s. Estimated remaining: 3m 25s. Rate: 155.9 symbols/min [2025-10-13T22:41:52.330069] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:52.399126] [DEBUG] [LOCAL ] PFL: Loaded 14271 existing records from primary storage. [2025-10-13T22:41:52.428786] [INFO ] [MAIN ] PFL: Loaded 14271 primary data records. [2025-10-13T22:41:52.662682] [DEBUG] [LOCAL ] PFN: Loaded 22306 existing records from primary storage. [2025-10-13T22:41:52.678010] [INFO ] [MAIN ] PFN: Loaded 22306 primary data records. [2025-10-13T22:41:53.257820] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:53.259053] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6756 primary records. [2025-10-13T22:41:53.259324] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-13T22:41:53.282731] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-13T22:41:53.290925] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-13T22:41:53.300969] [INFO ] [MAIN ] Derivative Progress: 1279/1810 symbols completed. PFH took 1.1s. Estimated remaining: 3m 25s. Rate: 155.7 symbols/min [2025-10-13T22:41:53.301242] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:53.301945] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:53.303755] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 14271 primary records. [2025-10-13T22:41:53.316382] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-13T22:41:53.316885] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:53.318879] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22306 primary records. [2025-10-13T22:41:53.318987] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-13T22:41:53.350767] [DEBUG] [LOCAL ] PFO: Loaded 6093 existing records from primary storage. [2025-10-13T22:41:53.354424] [INFO ] [MAIN ] PFO: Loaded 6093 primary data records. [2025-10-13T22:41:53.354059] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-13T22:41:53.366342] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-13T22:41:53.369177] [INFO ] [MAIN ] Derivative Progress: 1280/1810 symbols completed. PFL took 1.1s. Estimated remaining: 3m 24s. Rate: 155.8 symbols/min [2025-10-13T22:41:53.369833] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:53.413246] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-13T22:41:53.434564] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-13T22:41:53.443053] [INFO ] [MAIN ] Derivative Progress: 1281/1810 symbols completed. PFN took 1.1s. Estimated remaining: 3m 24s. Rate: 155.9 symbols/min [2025-10-13T22:41:53.443337] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:53.478962] [DEBUG] [LOCAL ] PGP: Loaded 5713 existing records from primary storage. [2025-10-13T22:41:53.479188] [INFO ] [MAIN ] PGP: Loaded 5713 primary data records. [2025-10-13T22:41:54.003575] [DEBUG] [LOCAL ] PGRE: Loaded 46921 existing records from primary storage. [2025-10-13T22:41:54.004373] [INFO ] [MAIN ] PGRE: Loaded 46921 primary data records. [2025-10-13T22:41:54.173272] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:54.202369] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6093 primary records. [2025-10-13T22:41:54.202529] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-13T22:41:54.387581] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-13T22:41:54.388469] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-13T22:41:54.391403] [INFO ] [MAIN ] Derivative Progress: 1282/1810 symbols completed. PFO took 1.1s. Estimated remaining: 3m 23s. Rate: 155.8 symbols/min [2025-10-13T22:41:54.403767] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:54.405412] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:54.406905] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5713 primary records. [2025-10-13T22:41:54.407147] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-13T22:41:54.426887] [DEBUG] [LOCAL ] PGZ: Loaded 5497 existing records from primary storage. [2025-10-13T22:41:54.427900] [INFO ] [MAIN ] PGZ: Loaded 5497 primary data records. [2025-10-13T22:41:54.440337] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-13T22:41:54.450868] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-13T22:41:54.464868] [INFO ] [MAIN ] Derivative Progress: 1283/1810 symbols completed. PGP took 1.1s. Estimated remaining: 3m 23s. Rate: 155.9 symbols/min [2025-10-13T22:41:54.470260] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:54.577670] [DEBUG] [LOCAL ] PHI: Loaded 15150 existing records from primary storage. [2025-10-13T22:41:54.602427] [INFO ] [MAIN ] PHI: Loaded 15150 primary data records. [2025-10-13T22:41:54.626292] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:54.666997] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46921 primary records. [2025-10-13T22:41:54.682148] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-13T22:41:54.961094] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-13T22:41:55.084269] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-13T22:41:55.087910] [INFO ] [MAIN ] Derivative Progress: 1284/1810 symbols completed. PGRE took 1.6s. Estimated remaining: 3m 23s. Rate: 155.8 symbols/min [2025-10-13T22:41:55.089351] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:55.122436] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:55.123429] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5497 primary records. [2025-10-13T22:41:55.123821] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-13T22:41:55.147219] [DEBUG] [LOCAL ] PHK: Loaded 26688 existing records from primary storage. [2025-10-13T22:41:55.151248] [INFO ] [MAIN ] PHK: Loaded 26688 primary data records. [2025-10-13T22:41:55.151143] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-13T22:41:55.157377] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-13T22:41:55.192325] [INFO ] [MAIN ] Derivative Progress: 1285/1810 symbols completed. PGZ took 0.8s. Estimated remaining: 3m 22s. Rate: 155.9 symbols/min [2025-10-13T22:41:55.199824] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:55.244982] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:55.270262] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15150 primary records. [2025-10-13T22:41:55.273639] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-13T22:41:55.277532] [DEBUG] [LOCAL ] PIM: Loaded 4811 existing records from primary storage. [2025-10-13T22:41:55.293191] [INFO ] [MAIN ] PIM: Loaded 4811 primary data records. [2025-10-13T22:41:55.622108] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-10-13T22:41:55.817900] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-13T22:41:55.821883] [INFO ] [MAIN ] Derivative Progress: 1286/1810 symbols completed. PHI took 1.4s. Estimated remaining: 3m 22s. Rate: 155.8 symbols/min [2025-10-13T22:41:55.822204] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:55.849303] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:55.855348] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26688 primary records. [2025-10-13T22:41:55.854693] [DEBUG] [LOCAL ] PINE: Loaded 14333 existing records from primary storage. [2025-10-13T22:41:55.855834] [INFO ] [MAIN ] PINE: Loaded 14333 primary data records. [2025-10-13T22:41:55.867393] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-13T22:41:55.982030] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-13T22:41:56.005961] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-13T22:41:56.018634] [INFO ] [MAIN ] Derivative Progress: 1287/1810 symbols completed. PHK took 0.9s. Estimated remaining: 3m 21s. Rate: 155.9 symbols/min [2025-10-13T22:41:56.019351] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:56.019223] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:56.038613] [INFO ] [MAIN ] PIM: Generated 1793 derivative records from 4811 primary records. [2025-10-13T22:41:56.054997] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-13T22:41:56.224791] [DEBUG] [LOCAL ] PKE: Loaded 13869 existing records from primary storage. [2025-10-13T22:41:56.228326] [DEBUG] [LOCAL ] PIM: Derivative data saved (1793 records). [2025-10-13T22:41:56.227072] [INFO ] [MAIN ] PKE: Loaded 13869 primary data records. [2025-10-13T22:41:56.228580] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-13T22:41:56.242922] [INFO ] [MAIN ] Derivative Progress: 1288/1810 symbols completed. PIM took 1.0s. Estimated remaining: 3m 21s. Rate: 155.9 symbols/min [2025-10-13T22:41:56.607992] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:56.609099] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14333 primary records. [2025-10-13T22:41:56.609202] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-13T22:41:56.629073] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-13T22:41:56.629329] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-13T22:41:56.632210] [INFO ] [MAIN ] Derivative Progress: 1289/1810 symbols completed. PINE took 0.8s. Estimated remaining: 3m 21s. Rate: 155.9 symbols/min [2025-10-13T22:41:56.648048] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:56.648680] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 13869 primary records. [2025-10-13T22:41:56.648742] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-13T22:41:56.664075] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-13T22:41:56.664133] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-13T22:41:56.666866] [INFO ] [MAIN ] Derivative Progress: 1290/1810 symbols completed. PKE took 0.6s. Estimated remaining: 3m 20s. Rate: 156.0 symbols/min [2025-10-13T22:41:56.667310] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:56.667396] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:56.668140] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:56.687034] [DEBUG] [LOCAL ] PMO: Loaded 9938 existing records from primary storage. [2025-10-13T22:41:56.687217] [INFO ] [MAIN ] PMO: Loaded 9938 primary data records. [2025-10-13T22:41:56.712140] [DEBUG] [LOCAL ] PMM: Loaded 10253 existing records from primary storage. [2025-10-13T22:41:56.763008] [DEBUG] [LOCAL ] PML: Loaded 21647 existing records from primary storage. [2025-10-13T22:41:56.735778] [INFO ] [MAIN ] PMM: Loaded 10253 primary data records. [2025-10-13T22:41:56.763290] [INFO ] [MAIN ] PML: Loaded 21647 primary data records. [2025-10-13T22:41:57.681743] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:57.682535] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 9938 primary records. [2025-10-13T22:41:57.682790] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-13T22:41:57.699672] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-13T22:41:57.700621] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-13T22:41:57.705004] [INFO ] [MAIN ] Derivative Progress: 1291/1810 symbols completed. PMO took 1.0s. Estimated remaining: 3m 20s. Rate: 155.8 symbols/min [2025-10-13T22:41:57.706361] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:57.719907] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:57.722001] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21647 primary records. [2025-10-13T22:41:57.724157] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-13T22:41:57.753302] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:57.758287] [DEBUG] [LOCAL ] PNI: Loaded 6765 existing records from primary storage. [2025-10-13T22:41:57.759367] [INFO ] [MAIN ] PNI: Loaded 6765 primary data records. [2025-10-13T22:41:57.760608] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10253 primary records. [2025-10-13T22:41:57.767095] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-13T22:41:57.821715] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-13T22:41:57.849010] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-13T22:41:57.878987] [INFO ] [MAIN ] Derivative Progress: 1292/1810 symbols completed. PML took 1.2s. Estimated remaining: 3m 19s. Rate: 155.9 symbols/min [2025-10-13T22:41:57.900852] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:57.914789] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-13T22:41:57.925621] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-13T22:41:57.983106] [INFO ] [MAIN ] Derivative Progress: 1293/1810 symbols completed. PMM took 1.3s. Estimated remaining: 3m 19s. Rate: 156.0 symbols/min [2025-10-13T22:41:57.989434] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:58.143731] [DEBUG] [LOCAL ] PPT: Loaded 19957 existing records from primary storage. [2025-10-13T22:41:58.144363] [DEBUG] [LOCAL ] PNNT: Loaded 33433 existing records from primary storage. [2025-10-13T22:41:58.145016] [INFO ] [MAIN ] PPT: Loaded 19957 primary data records. [2025-10-13T22:41:58.144951] [INFO ] [MAIN ] PNNT: Loaded 33433 primary data records. [2025-10-13T22:41:58.566538] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:58.656347] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6765 primary records. [2025-10-13T22:41:58.673870] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-13T22:41:58.875263] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-13T22:41:58.875719] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-13T22:41:58.878764] [INFO ] [MAIN ] Derivative Progress: 1294/1810 symbols completed. PNI took 1.2s. Estimated remaining: 3m 19s. Rate: 155.8 symbols/min [2025-10-13T22:41:58.879089] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:58.887796] [DEBUG] [LOCAL ] PRCS: Loaded 2774 existing records from primary storage. [2025-10-13T22:41:58.888235] [INFO ] [MAIN ] PRCS: Loaded 2774 primary data records. [2025-10-13T22:41:59.215912] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:59.217340] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33433 primary records. [2025-10-13T22:41:59.217625] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-13T22:41:59.251022] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:41:59.253083] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19957 primary records. [2025-10-13T22:41:59.254303] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-13T22:41:59.273338] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-13T22:41:59.274505] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-13T22:41:59.274364] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-13T22:41:59.277570] [INFO ] [MAIN ] Derivative Progress: 1295/1810 symbols completed. PPT took 1.3s. Estimated remaining: 3m 18s. Rate: 155.8 symbols/min [2025-10-13T22:41:59.277781] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-13T22:41:59.281938] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:59.282041] [INFO ] [MAIN ] Derivative Progress: 1296/1810 symbols completed. PNNT took 1.4s. Estimated remaining: 3m 18s. Rate: 155.9 symbols/min [2025-10-13T22:41:59.283012] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:59.294495] [DEBUG] [LOCAL ] PRH: Loaded 4777 existing records from primary storage. [2025-10-13T22:41:59.302671] [INFO ] [MAIN ] PRH: Loaded 4777 primary data records. [2025-10-13T22:41:59.339547] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:41:59.348845] [DEBUG] [LOCAL ] PRT: Loaded 5172 existing records from primary storage. [2025-10-13T22:41:59.349821] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2774 primary records. [2025-10-13T22:41:59.383506] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-13T22:41:59.383634] [INFO ] [MAIN ] PRT: Loaded 5172 primary data records. [2025-10-13T22:41:59.444088] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-13T22:41:59.473177] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-13T22:41:59.493877] [INFO ] [MAIN ] Derivative Progress: 1297/1810 symbols completed. PRCS took 0.6s. Estimated remaining: 3m 17s. Rate: 156.0 symbols/min [2025-10-13T22:41:59.504483] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:41:59.761154] [DEBUG] [LOCAL ] PSBD: Loaded 7776 existing records from primary storage. [2025-10-13T22:41:59.761344] [INFO ] [MAIN ] PSBD: Loaded 7776 primary data records. [2025-10-13T22:42:00.334730] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:00.335887] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4777 primary records. [2025-10-13T22:42:00.336410] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-13T22:42:00.367896] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-13T22:42:00.368170] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-13T22:42:00.367417] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:00.372310] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5172 primary records. [2025-10-13T22:42:00.371192] [INFO ] [MAIN ] Derivative Progress: 1298/1810 symbols completed. PRH took 1.1s. Estimated remaining: 3m 17s. Rate: 155.8 symbols/min [2025-10-13T22:42:00.372692] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-13T22:42:00.372624] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:00.394566] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-13T22:42:00.394877] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-13T22:42:00.397754] [INFO ] [MAIN ] Derivative Progress: 1299/1810 symbols completed. PRT took 1.1s. Estimated remaining: 3m 17s. Rate: 155.9 symbols/min [2025-10-13T22:42:00.397990] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:00.409979] [DEBUG] [LOCAL ] PSF: Loaded 6960 existing records from primary storage. [2025-10-13T22:42:00.414969] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:00.415864] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 7776 primary records. [2025-10-13T22:42:00.416026] [INFO ] [MAIN ] PSF: Loaded 6960 primary data records. [2025-10-13T22:42:00.416215] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-13T22:42:00.538797] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-10-13T22:42:00.553319] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-13T22:42:00.571907] [INFO ] [MAIN ] Derivative Progress: 1300/1810 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 16s. Rate: 156.0 symbols/min [2025-10-13T22:42:00.590456] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:00.752421] [DEBUG] [LOCAL ] PSQH: Loaded 35345 existing records from primary storage. [2025-10-13T22:42:00.754145] [INFO ] [MAIN ] PSQH: Loaded 35345 primary data records. [2025-10-13T22:42:00.840537] [DEBUG] [LOCAL ] PVL: Loaded 4696 existing records from primary storage. [2025-10-13T22:42:00.851462] [INFO ] [MAIN ] PVL: Loaded 4696 primary data records. [2025-10-13T22:42:01.398491] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:01.399729] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6960 primary records. [2025-10-13T22:42:01.399843] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-13T22:42:01.424823] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-13T22:42:01.439733] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-13T22:42:01.443151] [INFO ] [MAIN ] Derivative Progress: 1301/1810 symbols completed. PSF took 1.1s. Estimated remaining: 3m 16s. Rate: 155.8 symbols/min [2025-10-13T22:42:01.440400] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:01.443554] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:01.444413] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 35345 primary records. [2025-10-13T22:42:01.445306] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-13T22:42:01.480255] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:01.479898] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-13T22:42:01.481124] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4696 primary records. [2025-10-13T22:42:01.489878] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-13T22:42:01.493378] [INFO ] [MAIN ] Derivative Progress: 1302/1810 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 15s. Rate: 155.9 symbols/min [2025-10-13T22:42:01.489694] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-13T22:42:01.494778] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:01.526622] [DEBUG] [LOCAL ] QD: Loaded 27616 existing records from primary storage. [2025-10-13T22:42:01.527872] [INFO ] [MAIN ] QD: Loaded 27616 primary data records. [2025-10-13T22:42:01.528076] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-13T22:42:01.546034] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-13T22:42:01.575430] [INFO ] [MAIN ] Derivative Progress: 1303/1810 symbols completed. PVL took 1.0s. Estimated remaining: 3m 15s. Rate: 156.0 symbols/min [2025-10-13T22:42:01.675847] [DEBUG] [LOCAL ] QUAD: Loaded 23402 existing records from primary storage. [2025-10-13T22:42:01.687103] [INFO ] [MAIN ] QUAD: Loaded 23402 primary data records. [2025-10-13T22:42:02.217147] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:02.218323] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27616 primary records. [2025-10-13T22:42:02.218545] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-13T22:42:02.250164] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:02.251867] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23402 primary records. [2025-10-13T22:42:02.252217] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-13T22:42:02.253080] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-13T22:42:02.254035] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-13T22:42:02.264757] [INFO ] [MAIN ] Derivative Progress: 1304/1810 symbols completed. QD took 0.8s. Estimated remaining: 3m 15s. Rate: 155.9 symbols/min [2025-10-13T22:42:02.273469] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-13T22:42:02.273548] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-13T22:42:02.276574] [INFO ] [MAIN ] Derivative Progress: 1305/1810 symbols completed. QUAD took 0.8s. Estimated remaining: 3m 14s. Rate: 156.1 symbols/min [2025-10-13T22:42:02.277415] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:02.277569] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:02.277287] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:02.289394] [DEBUG] [LOCAL ] QVCD: Loaded 4711 existing records from primary storage. [2025-10-13T22:42:02.293722] [INFO ] [MAIN ] QVCD: Loaded 4711 primary data records. [2025-10-13T22:42:02.293465] [DEBUG] [LOCAL ] RBOT: Loaded 5922 existing records from primary storage. [2025-10-13T22:42:02.334904] [INFO ] [MAIN ] RBOT: Loaded 5922 primary data records. [2025-10-13T22:42:02.873162] [DEBUG] [LOCAL ] RC: Loaded 48895 existing records from primary storage. [2025-10-13T22:42:02.994052] [INFO ] [MAIN ] RC: Loaded 48895 primary data records. [2025-10-13T22:42:03.331223] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:03.333303] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4711 primary records. [2025-10-13T22:42:03.346218] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-13T22:42:03.347080] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:03.349669] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5922 primary records. [2025-10-13T22:42:03.350122] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-13T22:42:03.379575] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-13T22:42:03.380156] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-13T22:42:03.382832] [INFO ] [MAIN ] Derivative Progress: 1306/1810 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 14s. Rate: 155.8 symbols/min [2025-10-13T22:42:03.386427] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:03.388715] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-10-13T22:42:03.389119] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-13T22:42:03.393667] [INFO ] [MAIN ] Derivative Progress: 1307/1810 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 14s. Rate: 156.0 symbols/min [2025-10-13T22:42:03.394987] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:03.417860] [DEBUG] [LOCAL ] RCS: Loaded 12146 existing records from primary storage. [2025-10-13T22:42:03.423823] [INFO ] [MAIN ] RCS: Loaded 12146 primary data records. [2025-10-13T22:42:03.436372] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:03.462930] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48895 primary records. [2025-10-13T22:42:03.481397] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-13T22:42:03.636262] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-13T22:42:03.636413] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-13T22:42:03.650325] [INFO ] [MAIN ] Derivative Progress: 1308/1810 symbols completed. RC took 1.4s. Estimated remaining: 3m 13s. Rate: 156.0 symbols/min [2025-10-13T22:42:03.651777] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:03.769502] [DEBUG] [LOCAL ] RERE: Loaded 41410 existing records from primary storage. [2025-10-13T22:42:03.769758] [INFO ] [MAIN ] RERE: Loaded 41410 primary data records. [2025-10-13T22:42:04.127282] [DEBUG] [LOCAL ] RES: Loaded 46986 existing records from primary storage. [2025-10-13T22:42:04.128731] [INFO ] [MAIN ] RES: Loaded 46986 primary data records. [2025-10-13T22:42:04.264027] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:04.287025] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12146 primary records. [2025-10-13T22:42:04.305260] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-13T22:42:04.534261] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-13T22:42:04.535978] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-13T22:42:04.539263] [INFO ] [MAIN ] Derivative Progress: 1309/1810 symbols completed. RCS took 1.2s. Estimated remaining: 3m 13s. Rate: 155.8 symbols/min [2025-10-13T22:42:04.539749] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:04.553388] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:04.554326] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41410 primary records. [2025-10-13T22:42:04.554508] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-13T22:42:04.574602] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-13T22:42:04.574721] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-13T22:42:04.577483] [INFO ] [MAIN ] Derivative Progress: 1310/1810 symbols completed. RERE took 1.2s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-13T22:42:04.577838] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:04.584017] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-10-13T22:42:04.584129] [INFO ] [MAIN ] RFI: Loaded 10454 primary data records. [2025-10-13T22:42:04.697575] [DEBUG] [LOCAL ] RFL: Loaded 11381 existing records from primary storage. [2025-10-13T22:42:04.697988] [INFO ] [MAIN ] RFL: Loaded 11381 primary data records. [2025-10-13T22:42:04.821682] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:04.856615] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 46986 primary records. [2025-10-13T22:42:04.873599] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-13T22:42:05.102362] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-13T22:42:05.214201] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-13T22:42:05.217506] [INFO ] [MAIN ] Derivative Progress: 1311/1810 symbols completed. RES took 1.6s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-13T22:42:05.217791] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:05.228438] [DEBUG] [LOCAL ] RFM: Loaded 4122 existing records from primary storage. [2025-10-13T22:42:05.229288] [INFO ] [MAIN ] RFM: Loaded 4122 primary data records. [2025-10-13T22:42:05.369810] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:05.431371] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10454 primary records. [2025-10-13T22:42:05.437960] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-13T22:42:05.583859] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:05.584956] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11381 primary records. [2025-10-13T22:42:05.585708] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-13T22:42:05.602586] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-13T22:42:05.606570] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-10-13T22:42:05.606878] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-13T22:42:05.606957] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-13T22:42:05.609809] [INFO ] [MAIN ] Derivative Progress: 1312/1810 symbols completed. RFL took 1.0s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-13T22:42:05.613001] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:05.613081] [INFO ] [MAIN ] Derivative Progress: 1313/1810 symbols completed. RFI took 1.1s. Estimated remaining: 3m 11s. Rate: 156.0 symbols/min [2025-10-13T22:42:05.613451] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:05.619472] [DEBUG] [LOCAL ] RGT: Loaded 2702 existing records from primary storage. [2025-10-13T22:42:05.622121] [INFO ] [MAIN ] RGT: Loaded 2702 primary data records. [2025-10-13T22:42:05.676142] [DEBUG] [LOCAL ] RFMZ: Loaded 8651 existing records from primary storage. [2025-10-13T22:42:05.677156] [INFO ] [MAIN ] RFMZ: Loaded 8651 primary data records. [2025-10-13T22:42:05.833741] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:05.849812] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4122 primary records. [2025-10-13T22:42:05.849954] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-13T22:42:06.300568] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-13T22:42:06.309568] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-13T22:42:06.312734] [INFO ] [MAIN ] Derivative Progress: 1314/1810 symbols completed. RFM took 1.1s. Estimated remaining: 3m 11s. Rate: 155.9 symbols/min [2025-10-13T22:42:06.312892] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:06.344794] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:06.367546] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2702 primary records. [2025-10-13T22:42:06.372901] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-13T22:42:06.372830] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:06.374385] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8651 primary records. [2025-10-13T22:42:06.374809] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-13T22:42:06.417279] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-13T22:42:06.418990] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-10-13T22:42:06.419815] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-13T22:42:06.420031] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-13T22:42:06.419951] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-13T22:42:06.422982] [INFO ] [MAIN ] Derivative Progress: 1315/1810 symbols completed. RGT took 0.8s. Estimated remaining: 3m 10s. Rate: 156.0 symbols/min [2025-10-13T22:42:06.423105] [INFO ] [MAIN ] RIG: Loaded 53673 primary data records. [2025-10-13T22:42:06.426606] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:06.426807] [INFO ] [MAIN ] Derivative Progress: 1316/1810 symbols completed. RFMZ took 0.8s. Estimated remaining: 3m 10s. Rate: 156.1 symbols/min [2025-10-13T22:42:06.427038] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:06.579801] [DEBUG] [LOCAL ] RLTY: Loaded 11147 existing records from primary storage. [2025-10-13T22:42:06.598727] [INFO ] [MAIN ] RLTY: Loaded 11147 primary data records. [2025-10-13T22:42:06.867391] [DEBUG] [LOCAL ] RLX: Loaded 48124 existing records from primary storage. [2025-10-13T22:42:06.883086] [INFO ] [MAIN ] RLX: Loaded 48124 primary data records. [2025-10-13T22:42:07.385874] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:07.386713] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53673 primary records. [2025-10-13T22:42:07.386917] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-13T22:42:07.406960] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-13T22:42:07.408107] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-13T22:42:07.411090] [INFO ] [MAIN ] Derivative Progress: 1317/1810 symbols completed. RIG took 1.1s. Estimated remaining: 3m 10s. Rate: 155.9 symbols/min [2025-10-13T22:42:07.411250] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:07.433197] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:07.434737] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11147 primary records. [2025-10-13T22:42:07.438818] [DEBUG] [LOCAL ] RM: Loaded 7540 existing records from primary storage. [2025-10-13T22:42:07.438992] [INFO ] [MAIN ] RM: Loaded 7540 primary data records. [2025-10-13T22:42:07.450393] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-13T22:42:07.546062] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-13T22:42:07.546963] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-13T22:42:07.549919] [INFO ] [MAIN ] Derivative Progress: 1318/1810 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 9s. Rate: 156.0 symbols/min [2025-10-13T22:42:07.608483] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:07.628066] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48124 primary records. [2025-10-13T22:42:07.631444] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-13T22:42:07.802733] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-13T22:42:07.802876] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-13T22:42:07.805558] [INFO ] [MAIN ] Derivative Progress: 1319/1810 symbols completed. RLX took 1.4s. Estimated remaining: 3m 9s. Rate: 156.0 symbols/min [2025-10-13T22:42:07.829613] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:07.830228] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7540 primary records. [2025-10-13T22:42:07.830287] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-13T22:42:07.845272] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-13T22:42:07.845329] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-13T22:42:07.849563] [INFO ] [MAIN ] Derivative Progress: 1320/1810 symbols completed. RM took 0.4s. Estimated remaining: 3m 8s. Rate: 156.1 symbols/min [2025-10-13T22:42:07.850415] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:07.850286] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:07.850538] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:07.869236] [DEBUG] [LOCAL ] RMMZ: Loaded 4799 existing records from primary storage. [2025-10-13T22:42:07.869473] [INFO ] [MAIN ] RMMZ: Loaded 4799 primary data records. [2025-10-13T22:42:07.937547] [DEBUG] [LOCAL ] RMT: Loaded 17360 existing records from primary storage. [2025-10-13T22:42:07.952959] [DEBUG] [LOCAL ] RNP: Loaded 16180 existing records from primary storage. [2025-10-13T22:42:07.970457] [INFO ] [MAIN ] RNP: Loaded 16180 primary data records. [2025-10-13T22:42:07.965230] [INFO ] [MAIN ] RMT: Loaded 17360 primary data records. [2025-10-13T22:42:08.909021] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:42:08.910959] [INFO ] [MAIN ] RMMZ: Generated 1792 derivative records from 4799 primary records. [2025-10-13T22:42:08.911720] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-13T22:42:08.928087] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:08.931677] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16180 primary records. [2025-10-13T22:42:08.931934] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-13T22:42:08.968243] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1792 records). [2025-10-13T22:42:08.969986] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:08.970403] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-13T22:42:08.971384] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17360 primary records. [2025-10-13T22:42:08.978484] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-13T22:42:08.977866] [INFO ] [MAIN ] Derivative Progress: 1321/1810 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 8s. Rate: 155.9 symbols/min [2025-10-13T22:42:08.983684] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-13T22:42:08.984249] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-13T22:42:08.984430] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:08.987448] [INFO ] [MAIN ] Derivative Progress: 1322/1810 symbols completed. RNP took 1.1s. Estimated remaining: 3m 8s. Rate: 156.0 symbols/min [2025-10-13T22:42:08.988600] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:09.011565] [DEBUG] [LOCAL ] RSF: Loaded 4321 existing records from primary storage. [2025-10-13T22:42:09.019125] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-13T22:42:09.019221] [INFO ] [MAIN ] RSF: Loaded 4321 primary data records. [2025-10-13T22:42:09.019454] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-13T22:42:09.059347] [INFO ] [MAIN ] Derivative Progress: 1323/1810 symbols completed. RMT took 1.2s. Estimated remaining: 3m 7s. Rate: 156.1 symbols/min [2025-10-13T22:42:09.072773] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:09.106317] [DEBUG] [LOCAL ] RPT: Loaded 19122 existing records from primary storage. [2025-10-13T22:42:09.112089] [INFO ] [MAIN ] RPT: Loaded 19122 primary data records. [2025-10-13T22:42:09.517437] [DEBUG] [LOCAL ] RSKD: Loaded 33455 existing records from primary storage. [2025-10-13T22:42:09.657470] [INFO ] [MAIN ] RSKD: Loaded 33455 primary data records. [2025-10-13T22:42:09.986294] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:09.987326] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4321 primary records. [2025-10-13T22:42:09.988167] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-13T22:42:10.008348] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-13T22:42:10.008524] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-13T22:42:10.011504] [INFO ] [MAIN ] Derivative Progress: 1324/1810 symbols completed. RSF took 1.0s. Estimated remaining: 3m 7s. Rate: 155.9 symbols/min [2025-10-13T22:42:10.012880] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:10.032930] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:10.034121] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19122 primary records. [2025-10-13T22:42:10.034312] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-13T22:42:10.068905] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-13T22:42:10.069546] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:10.070501] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-13T22:42:10.070422] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33455 primary records. [2025-10-13T22:42:10.070606] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-13T22:42:10.074030] [INFO ] [MAIN ] Derivative Progress: 1325/1810 symbols completed. RPT took 1.1s. Estimated remaining: 3m 7s. Rate: 156.0 symbols/min [2025-10-13T22:42:10.074218] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:10.100918] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-13T22:42:10.101052] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-13T22:42:10.103818] [INFO ] [MAIN ] Derivative Progress: 1326/1810 symbols completed. RSKD took 1.0s. Estimated remaining: 3m 6s. Rate: 156.1 symbols/min [2025-10-13T22:42:10.104567] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:10.125799] [DEBUG] [LOCAL ] RWT: Loaded 40818 existing records from primary storage. [2025-10-13T22:42:10.126051] [INFO ] [MAIN ] RWT: Loaded 40818 primary data records. [2025-10-13T22:42:10.237115] [DEBUG] [LOCAL ] RYI: Loaded 21711 existing records from primary storage. [2025-10-13T22:42:10.258349] [INFO ] [MAIN ] RYI: Loaded 21711 primary data records. [2025-10-13T22:42:10.624825] [DEBUG] [LOCAL ] RYN: Loaded 45397 existing records from primary storage. [2025-10-13T22:42:10.636150] [INFO ] [MAIN ] RYN: Loaded 45397 primary data records. [2025-10-13T22:42:11.134089] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:11.136889] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40818 primary records. [2025-10-13T22:42:11.137064] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-13T22:42:11.163249] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:11.164147] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21711 primary records. [2025-10-13T22:42:11.164355] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-13T22:42:11.182147] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-13T22:42:11.182759] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-13T22:42:11.185822] [INFO ] [MAIN ] Derivative Progress: 1327/1810 symbols completed. RWT took 1.2s. Estimated remaining: 3m 6s. Rate: 155.9 symbols/min [2025-10-13T22:42:11.186884] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:11.190189] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-13T22:42:11.191779] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-13T22:42:11.194595] [INFO ] [MAIN ] Derivative Progress: 1328/1810 symbols completed. RYI took 1.1s. Estimated remaining: 3m 5s. Rate: 156.0 symbols/min [2025-10-13T22:42:11.196307] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:11.209902] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:11.212771] [DEBUG] [LOCAL ] RZB: Loaded 6002 existing records from primary storage. [2025-10-13T22:42:11.212864] [INFO ] [MAIN ] RZB: Loaded 6002 primary data records. [2025-10-13T22:42:11.213487] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45397 primary records. [2025-10-13T22:42:11.213668] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-13T22:42:11.323524] [DEBUG] [LOCAL ] RZC: Loaded 6775 existing records from primary storage. [2025-10-13T22:42:11.332019] [INFO ] [MAIN ] RZC: Loaded 6775 primary data records. [2025-10-13T22:42:11.425092] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-13T22:42:11.456824] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-13T22:42:11.478773] [INFO ] [MAIN ] Derivative Progress: 1329/1810 symbols completed. RYN took 1.4s. Estimated remaining: 3m 5s. Rate: 156.1 symbols/min [2025-10-13T22:42:11.479049] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:11.878135] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:11.879184] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6002 primary records. [2025-10-13T22:42:11.879402] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-13T22:42:11.909096] [DEBUG] [LOCAL ] S: Loaded 53533 existing records from primary storage. [2025-10-13T22:42:11.911700] [INFO ] [MAIN ] S: Loaded 53533 primary data records. [2025-10-13T22:42:11.927303] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-13T22:42:11.938422] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-13T22:42:11.959915] [INFO ] [MAIN ] Derivative Progress: 1330/1810 symbols completed. RZB took 0.8s. Estimated remaining: 3m 5s. Rate: 156.0 symbols/min [2025-10-13T22:42:11.973830] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:12.025742] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:12.053093] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6775 primary records. [2025-10-13T22:42:12.053352] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-13T22:42:12.332291] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-13T22:42:12.333213] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-13T22:42:12.336237] [INFO ] [MAIN ] Derivative Progress: 1331/1810 symbols completed. RZC took 1.1s. Estimated remaining: 3m 4s. Rate: 156.0 symbols/min [2025-10-13T22:42:12.336722] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:12.364736] [DEBUG] [LOCAL ] SABA: Loaded 9326 existing records from primary storage. [2025-10-13T22:42:12.381295] [INFO ] [MAIN ] SABA: Loaded 9326 primary data records. [2025-10-13T22:42:12.394172] [DEBUG] [LOCAL ] SA: Loaded 44307 existing records from primary storage. [2025-10-13T22:42:12.405014] [INFO ] [MAIN ] SA: Loaded 44307 primary data records. [2025-10-13T22:42:12.678261] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:12.735776] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53533 primary records. [2025-10-13T22:42:12.757204] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-13T22:42:13.031433] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-13T22:42:13.032974] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-13T22:42:13.037045] [INFO ] [MAIN ] Derivative Progress: 1332/1810 symbols completed. S took 1.6s. Estimated remaining: 3m 4s. Rate: 155.9 symbols/min [2025-10-13T22:42:13.037707] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:13.089417] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:13.089158] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:42:13.091161] [INFO ] [MAIN ] SABA: Generated 1793 derivative records from 9326 primary records. [2025-10-13T22:42:13.090404] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 44307 primary records. [2025-10-13T22:42:13.091394] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-13T22:42:13.091449] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-13T22:42:13.128960] [DEBUG] [LOCAL ] SAFE: Loaded 30391 existing records from primary storage. [2025-10-13T22:42:13.131190] [INFO ] [MAIN ] SAFE: Loaded 30391 primary data records. [2025-10-13T22:42:13.155015] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-13T22:42:13.172175] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-13T22:42:13.172072] [DEBUG] [LOCAL ] SABA: Derivative data saved (1793 records). [2025-10-13T22:42:13.193792] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-13T22:42:13.186359] [INFO ] [MAIN ] Derivative Progress: 1333/1810 symbols completed. SA took 1.2s. Estimated remaining: 3m 3s. Rate: 156.0 symbols/min [2025-10-13T22:42:13.197297] [INFO ] [MAIN ] Derivative Progress: 1334/1810 symbols completed. SABA took 0.9s. Estimated remaining: 3m 3s. Rate: 156.1 symbols/min [2025-10-13T22:42:13.445490] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:13.446139] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30391 primary records. [2025-10-13T22:42:13.446201] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-13T22:42:13.461427] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-13T22:42:13.461496] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-13T22:42:13.464153] [INFO ] [MAIN ] Derivative Progress: 1335/1810 symbols completed. SAFE took 0.4s. Estimated remaining: 3m 2s. Rate: 156.2 symbols/min [2025-10-13T22:42:13.464856] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:13.464969] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:13.464800] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:13.499786] [DEBUG] [LOCAL ] SAH: Loaded 21515 existing records from primary storage. [2025-10-13T22:42:13.501127] [INFO ] [MAIN ] SAH: Loaded 21515 primary data records. [2025-10-13T22:42:13.565770] [DEBUG] [LOCAL ] SAM: Loaded 21459 existing records from primary storage. [2025-10-13T22:42:13.603025] [INFO ] [MAIN ] SAM: Loaded 21459 primary data records. [2025-10-13T22:42:13.824254] [DEBUG] [LOCAL ] SAN: Loaded 52978 existing records from primary storage. [2025-10-13T22:42:13.951202] [INFO ] [MAIN ] SAN: Loaded 52978 primary data records. [2025-10-13T22:42:14.546374] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:14.549443] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21515 primary records. [2025-10-13T22:42:14.549621] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-13T22:42:14.578403] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:14.581505] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21459 primary records. [2025-10-13T22:42:14.582083] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-13T22:42:14.583601] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-13T22:42:14.584055] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-13T22:42:14.597400] [INFO ] [MAIN ] Derivative Progress: 1336/1810 symbols completed. SAH took 1.1s. Estimated remaining: 3m 2s. Rate: 155.9 symbols/min [2025-10-13T22:42:14.598036] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:14.603953] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-13T22:42:14.604052] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-13T22:42:14.606938] [INFO ] [MAIN ] Derivative Progress: 1337/1810 symbols completed. SAM took 1.1s. Estimated remaining: 3m 2s. Rate: 156.1 symbols/min [2025-10-13T22:42:14.607361] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:14.624610] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:14.625465] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52978 primary records. [2025-10-13T22:42:14.625573] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-13T22:42:14.642327] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-13T22:42:14.642443] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-13T22:42:14.645248] [INFO ] [MAIN ] Derivative Progress: 1338/1810 symbols completed. SAN took 1.2s. Estimated remaining: 3m 1s. Rate: 156.2 symbols/min [2025-10-13T22:42:14.645542] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:14.700876] [DEBUG] [LOCAL ] SAR: Loaded 17161 existing records from primary storage. [2025-10-13T22:42:14.701747] [DEBUG] [LOCAL ] SAND: Loaded 51843 existing records from primary storage. [2025-10-13T22:42:14.702048] [INFO ] [MAIN ] SAR: Loaded 17161 primary data records. [2025-10-13T22:42:14.702126] [INFO ] [MAIN ] SAND: Loaded 51843 primary data records. [2025-10-13T22:42:14.871991] [DEBUG] [LOCAL ] SAP: Loaded 49885 existing records from primary storage. [2025-10-13T22:42:14.912102] [INFO ] [MAIN ] SAP: Loaded 49885 primary data records. [2025-10-13T22:42:15.679408] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:15.680375] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51843 primary records. [2025-10-13T22:42:15.689219] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-13T22:42:15.696706] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:15.709670] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 17161 primary records. [2025-10-13T22:42:15.709871] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-13T22:42:15.738851] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:15.739881] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49885 primary records. [2025-10-13T22:42:15.740222] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-13T22:42:15.740575] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-13T22:42:15.742695] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-13T22:42:15.747385] [INFO ] [MAIN ] Derivative Progress: 1339/1810 symbols completed. SAND took 1.1s. Estimated remaining: 3m 1s. Rate: 155.9 symbols/min [2025-10-13T22:42:15.749211] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-13T22:42:15.749485] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-13T22:42:15.749367] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:15.758973] [INFO ] [MAIN ] Derivative Progress: 1340/1810 symbols completed. SAR took 1.1s. Estimated remaining: 3m 1s. Rate: 156.1 symbols/min [2025-10-13T22:42:15.759139] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:15.770024] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-13T22:42:15.770179] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-13T22:42:15.773085] [INFO ] [MAIN ] Derivative Progress: 1341/1810 symbols completed. SAP took 1.2s. Estimated remaining: 3m 0s. Rate: 156.2 symbols/min [2025-10-13T22:42:15.773358] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:15.813921] [DEBUG] [LOCAL ] SB: Loaded 33010 existing records from primary storage. [2025-10-13T22:42:15.814275] [INFO ] [MAIN ] SB: Loaded 33010 primary data records. [2025-10-13T22:42:15.984537] [DEBUG] [LOCAL ] SBH: Loaded 49842 existing records from primary storage. [2025-10-13T22:42:15.990009] [INFO ] [MAIN ] SBH: Loaded 49842 primary data records. [2025-10-13T22:42:15.995865] [DEBUG] [LOCAL ] SARO: Loaded 48347 existing records from primary storage. [2025-10-13T22:42:16.011705] [INFO ] [MAIN ] SARO: Loaded 48347 primary data records. [2025-10-13T22:42:16.879774] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:16.880846] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33010 primary records. [2025-10-13T22:42:16.881072] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-13T22:42:16.900473] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-13T22:42:16.901700] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-13T22:42:16.904481] [INFO ] [MAIN ] Derivative Progress: 1342/1810 symbols completed. SB took 1.1s. Estimated remaining: 3m 0s. Rate: 155.9 symbols/min [2025-10-13T22:42:16.905577] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:16.920004] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:16.923137] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48347 primary records. [2025-10-13T22:42:16.924223] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-13T22:42:16.929867] [DEBUG] [LOCAL ] SBI: Loaded 7413 existing records from primary storage. [2025-10-13T22:42:16.930198] [INFO ] [MAIN ] SBI: Loaded 7413 primary data records. [2025-10-13T22:42:17.031493] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:17.033722] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49842 primary records. [2025-10-13T22:42:17.039306] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-13T22:42:17.038917] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-13T22:42:17.060709] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-13T22:42:17.063573] [INFO ] [MAIN ] Derivative Progress: 1343/1810 symbols completed. SARO took 1.3s. Estimated remaining: 2m 60s. Rate: 156.0 symbols/min [2025-10-13T22:42:17.064296] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:17.273694] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-13T22:42:17.277581] [DEBUG] [LOCAL ] SBR: Loaded 7759 existing records from primary storage. [2025-10-13T22:42:17.277825] [INFO ] [MAIN ] SBR: Loaded 7759 primary data records. [2025-10-13T22:42:17.277762] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-13T22:42:17.301918] [INFO ] [MAIN ] Derivative Progress: 1344/1810 symbols completed. SBH took 1.5s. Estimated remaining: 2m 59s. Rate: 156.1 symbols/min [2025-10-13T22:42:17.346072] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:17.636421] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:17.651808] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7413 primary records. [2025-10-13T22:42:17.652119] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-13T22:42:17.664467] [DEBUG] [LOCAL ] SBS: Loaded 49348 existing records from primary storage. [2025-10-13T22:42:17.669200] [INFO ] [MAIN ] SBS: Loaded 49348 primary data records. [2025-10-13T22:42:17.754165] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-13T22:42:17.817786] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-13T22:42:17.823603] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:17.836049] [INFO ] [MAIN ] Derivative Progress: 1345/1810 symbols completed. SBI took 0.9s. Estimated remaining: 2m 59s. Rate: 156.0 symbols/min [2025-10-13T22:42:17.841487] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:17.848015] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7759 primary records. [2025-10-13T22:42:17.858912] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-13T22:42:18.121752] [DEBUG] [LOCAL ] SBSI: Loaded 14868 existing records from primary storage. [2025-10-13T22:42:18.009756] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-13T22:42:18.164562] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-13T22:42:18.176121] [INFO ] [MAIN ] SBSI: Loaded 14868 primary data records. [2025-10-13T22:42:18.186513] [INFO ] [MAIN ] Derivative Progress: 1346/1810 symbols completed. SBR took 1.1s. Estimated remaining: 2m 58s. Rate: 156.0 symbols/min [2025-10-13T22:42:18.186877] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:18.720399] [DEBUG] [LOCAL ] SBSW: Loaded 53150 existing records from primary storage. [2025-10-13T22:42:18.722633] [INFO ] [MAIN ] SBSW: Loaded 53150 primary data records. [2025-10-13T22:42:18.764321] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:18.787154] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49348 primary records. [2025-10-13T22:42:18.820710] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-13T22:42:19.091626] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-13T22:42:19.092036] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-13T22:42:19.094125] [INFO ] [MAIN ] Derivative Progress: 1347/1810 symbols completed. SBS took 1.7s. Estimated remaining: 2m 58s. Rate: 155.9 symbols/min [2025-10-13T22:42:19.094442] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:19.114090] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:19.114998] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14868 primary records. [2025-10-13T22:42:19.115185] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-13T22:42:19.145346] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-13T22:42:19.145508] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-13T22:42:19.148373] [INFO ] [MAIN ] Derivative Progress: 1348/1810 symbols completed. SBSI took 1.3s. Estimated remaining: 2m 58s. Rate: 156.0 symbols/min [2025-10-13T22:42:19.163870] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:19.164476] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53150 primary records. [2025-10-13T22:42:19.164536] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-13T22:42:19.193597] [DEBUG] [LOCAL ] SCCO: Loaded 49604 existing records from primary storage. [2025-10-13T22:42:19.194984] [INFO ] [MAIN ] SCCO: Loaded 49604 primary data records. [2025-10-13T22:42:19.239100] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-13T22:42:19.260092] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-13T22:42:19.274398] [INFO ] [MAIN ] Derivative Progress: 1349/1810 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 57s. Rate: 156.0 symbols/min [2025-10-13T22:42:19.509403] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:19.510065] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49604 primary records. [2025-10-13T22:42:19.510127] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-13T22:42:19.525406] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-13T22:42:19.525465] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-13T22:42:19.527574] [INFO ] [MAIN ] Derivative Progress: 1350/1810 symbols completed. SCCO took 0.4s. Estimated remaining: 2m 57s. Rate: 156.1 symbols/min [2025-10-13T22:42:19.528105] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:19.528605] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:19.528557] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:19.544017] [DEBUG] [LOCAL ] SCD: Loaded 13134 existing records from primary storage. [2025-10-13T22:42:19.544146] [INFO ] [MAIN ] SCD: Loaded 13134 primary data records. [2025-10-13T22:42:19.884435] [DEBUG] [LOCAL ] SCI: Loaded 46560 existing records from primary storage. [2025-10-13T22:42:19.885206] [INFO ] [MAIN ] SCI: Loaded 46560 primary data records. [2025-10-13T22:42:19.971036] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-13T22:42:19.983693] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-13T22:42:20.576436] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:20.577978] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13134 primary records. [2025-10-13T22:42:20.578389] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-13T22:42:20.597170] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-13T22:42:20.597691] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-13T22:42:20.600352] [INFO ] [MAIN ] Derivative Progress: 1351/1810 symbols completed. SCD took 1.1s. Estimated remaining: 2m 57s. Rate: 155.9 symbols/min [2025-10-13T22:42:20.600547] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:20.619731] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:20.620863] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46560 primary records. [2025-10-13T22:42:20.621148] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-13T22:42:20.649200] [DEBUG] [LOCAL ] SCL: Loaded 14767 existing records from primary storage. [2025-10-13T22:42:20.665081] [INFO ] [MAIN ] SCL: Loaded 14767 primary data records. [2025-10-13T22:42:20.652276] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-13T22:42:20.677021] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-13T22:42:20.698411] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:20.725049] [INFO ] [MAIN ] Derivative Progress: 1352/1810 symbols completed. SCI took 1.2s. Estimated remaining: 2m 56s. Rate: 155.9 symbols/min [2025-10-13T22:42:20.751251] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:20.757896] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-13T22:42:20.758204] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-13T22:42:21.004275] [DEBUG] [LOCAL ] SCM: Loaded 20105 existing records from primary storage. [2025-10-13T22:42:21.006588] [INFO ] [MAIN ] SCM: Loaded 20105 primary data records. [2025-10-13T22:42:21.006436] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-13T22:42:21.006806] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-13T22:42:21.009912] [INFO ] [MAIN ] Derivative Progress: 1353/1810 symbols completed. SCHW took 1.5s. Estimated remaining: 2m 56s. Rate: 156.0 symbols/min [2025-10-13T22:42:21.010832] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:21.350296] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:21.363926] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14767 primary records. [2025-10-13T22:42:21.364205] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-13T22:42:21.366509] [DEBUG] [LOCAL ] SCS: Loaded 43552 existing records from primary storage. [2025-10-13T22:42:21.366854] [INFO ] [MAIN ] SCS: Loaded 43552 primary data records. [2025-10-13T22:42:21.506821] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-13T22:42:21.517739] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-13T22:42:21.567941] [INFO ] [MAIN ] Derivative Progress: 1354/1810 symbols completed. SCL took 1.0s. Estimated remaining: 2m 55s. Rate: 155.9 symbols/min [2025-10-13T22:42:21.574069] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:21.707897] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:21.709503] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20105 primary records. [2025-10-13T22:42:21.709767] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-13T22:42:21.736613] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-13T22:42:21.738097] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-13T22:42:21.740880] [INFO ] [MAIN ] Derivative Progress: 1355/1810 symbols completed. SCM took 1.0s. Estimated remaining: 2m 55s. Rate: 156.0 symbols/min [2025-10-13T22:42:21.741097] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:21.752001] [DEBUG] [LOCAL ] SD: Loaded 28755 existing records from primary storage. [2025-10-13T22:42:21.752270] [INFO ] [MAIN ] SD: Loaded 28755 primary data records. [2025-10-13T22:42:21.847862] [DEBUG] [LOCAL ] SDHC: Loaded 10329 existing records from primary storage. [2025-10-13T22:42:21.859768] [INFO ] [MAIN ] SDHC: Loaded 10329 primary data records. [2025-10-13T22:42:21.995382] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:22.060489] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43552 primary records. [2025-10-13T22:42:22.190379] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-13T22:42:22.419077] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-13T22:42:22.420132] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-13T22:42:22.422339] [INFO ] [MAIN ] Derivative Progress: 1356/1810 symbols completed. SCS took 1.4s. Estimated remaining: 2m 55s. Rate: 155.9 symbols/min [2025-10-13T22:42:22.423072] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:22.437741] [DEBUG] [LOCAL ] SDHY: Loaded 11002 existing records from primary storage. [2025-10-13T22:42:22.439696] [INFO ] [MAIN ] SDHY: Loaded 11002 primary data records. [2025-10-13T22:42:22.521387] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:22.558736] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28755 primary records. [2025-10-13T22:42:22.587286] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-13T22:42:22.603359] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:22.654843] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10329 primary records. [2025-10-13T22:42:22.784951] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-13T22:42:22.860239] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-13T22:42:22.860807] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-13T22:42:22.863735] [INFO ] [MAIN ] Derivative Progress: 1357/1810 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 54s. Rate: 155.9 symbols/min [2025-10-13T22:42:22.863889] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:22.865209] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-13T22:42:22.865346] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-13T22:42:22.868483] [INFO ] [MAIN ] Derivative Progress: 1358/1810 symbols completed. SD took 1.3s. Estimated remaining: 2m 54s. Rate: 156.0 symbols/min [2025-10-13T22:42:22.869030] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:22.904159] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:22.905237] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 11002 primary records. [2025-10-13T22:42:22.905415] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-13T22:42:22.935448] [DEBUG] [LOCAL ] SDRL: Loaded 41480 existing records from primary storage. [2025-10-13T22:42:22.948962] [INFO ] [MAIN ] SDRL: Loaded 41480 primary data records. [2025-10-13T22:42:22.948862] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-13T22:42:22.969962] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-13T22:42:22.982802] [INFO ] [MAIN ] Derivative Progress: 1359/1810 symbols completed. SDHY took 0.6s. Estimated remaining: 2m 53s. Rate: 156.1 symbols/min [2025-10-13T22:42:22.994931] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:23.073413] [DEBUG] [LOCAL ] SE: Loaded 53312 existing records from primary storage. [2025-10-13T22:42:23.089331] [INFO ] [MAIN ] SE: Loaded 53312 primary data records. [2025-10-13T22:42:23.593296] [DEBUG] [LOCAL ] SEE: Loaded 48210 existing records from primary storage. [2025-10-13T22:42:23.593577] [INFO ] [MAIN ] SEE: Loaded 48210 primary data records. [2025-10-13T22:42:23.923891] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:23.925748] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41480 primary records. [2025-10-13T22:42:23.926730] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-13T22:42:23.946015] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-13T22:42:23.946333] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-13T22:42:23.949806] [INFO ] [MAIN ] Derivative Progress: 1360/1810 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 53s. Rate: 155.9 symbols/min [2025-10-13T22:42:23.957941] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:23.963949] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:23.965225] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53312 primary records. [2025-10-13T22:42:23.965509] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-13T22:42:23.987133] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-13T22:42:23.987426] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-13T22:42:23.990002] [INFO ] [MAIN ] Derivative Progress: 1361/1810 symbols completed. SE took 1.1s. Estimated remaining: 2m 53s. Rate: 156.0 symbols/min [2025-10-13T22:42:23.990988] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:23.999280] [DEBUG] [LOCAL ] SEG: Loaded 13059 existing records from primary storage. [2025-10-13T22:42:24.012201] [INFO ] [MAIN ] SEG: Loaded 13059 primary data records. [2025-10-13T22:42:24.043906] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:24.083403] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48210 primary records. [2025-10-13T22:42:24.100100] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-13T22:42:24.172502] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-13T22:42:24.190494] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-13T22:42:24.208254] [INFO ] [MAIN ] Derivative Progress: 1362/1810 symbols completed. SEE took 1.2s. Estimated remaining: 2m 52s. Rate: 156.1 symbols/min [2025-10-13T22:42:24.212902] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:24.364839] [DEBUG] [LOCAL ] SEI: Loaded 49889 existing records from primary storage. [2025-10-13T22:42:24.365247] [INFO ] [MAIN ] SEI: Loaded 49889 primary data records. [2025-10-13T22:42:24.471006] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:24.511014] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13059 primary records. [2025-10-13T22:42:24.511177] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-13T22:42:24.512444] [DEBUG] [LOCAL ] SEM: Loaded 43110 existing records from primary storage. [2025-10-13T22:42:24.512959] [INFO ] [MAIN ] SEM: Loaded 43110 primary data records. [2025-10-13T22:42:24.647509] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-13T22:42:24.766168] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-13T22:42:24.850578] [INFO ] [MAIN ] Derivative Progress: 1363/1810 symbols completed. SEG took 0.9s. Estimated remaining: 2m 52s. Rate: 156.0 symbols/min [2025-10-13T22:42:25.094593] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:25.095830] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49889 primary records. [2025-10-13T22:42:25.096022] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-13T22:42:25.117069] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-13T22:42:25.117309] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-13T22:42:25.120042] [INFO ] [MAIN ] Derivative Progress: 1364/1810 symbols completed. SEI took 1.1s. Estimated remaining: 2m 52s. Rate: 156.0 symbols/min [2025-10-13T22:42:25.132767] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:25.133336] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43110 primary records. [2025-10-13T22:42:25.133394] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-13T22:42:25.148915] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-13T22:42:25.149036] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-13T22:42:25.151428] [INFO ] [MAIN ] Derivative Progress: 1365/1810 symbols completed. SEM took 0.9s. Estimated remaining: 2m 51s. Rate: 156.1 symbols/min [2025-10-13T22:42:25.152069] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:25.152275] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:25.152214] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:25.192257] [DEBUG] [LOCAL ] SEMR: Loaded 41958 existing records from primary storage. [2025-10-13T22:42:25.200946] [INFO ] [MAIN ] SEMR: Loaded 41958 primary data records. [2025-10-13T22:42:25.344858] [DEBUG] [LOCAL ] SF: Loaded 41716 existing records from primary storage. [2025-10-13T22:42:25.378227] [INFO ] [MAIN ] SF: Loaded 41716 primary data records. [2025-10-13T22:42:25.459692] [DEBUG] [LOCAL ] SES: Loaded 51577 existing records from primary storage. [2025-10-13T22:42:25.509733] [INFO ] [MAIN ] SES: Loaded 51577 primary data records. [2025-10-13T22:42:26.180571] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:26.182516] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41958 primary records. [2025-10-13T22:42:26.182767] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-13T22:42:26.199381] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-13T22:42:26.199492] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-13T22:42:26.202041] [INFO ] [MAIN ] Derivative Progress: 1366/1810 symbols completed. SEMR took 1.0s. Estimated remaining: 2m 51s. Rate: 155.9 symbols/min [2025-10-13T22:42:26.202434] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:26.222610] [DEBUG] [LOCAL ] SFB: Loaded 4134 existing records from primary storage. [2025-10-13T22:42:26.220063] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:26.224114] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41716 primary records. [2025-10-13T22:42:26.224982] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-13T22:42:26.224200] [INFO ] [MAIN ] SFB: Loaded 4134 primary data records. [2025-10-13T22:42:26.335233] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:26.355562] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51577 primary records. [2025-10-13T22:42:26.356510] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-13T22:42:26.373400] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-13T22:42:26.383714] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-13T22:42:26.399410] [INFO ] [MAIN ] Derivative Progress: 1367/1810 symbols completed. SF took 1.2s. Estimated remaining: 2m 50s. Rate: 156.0 symbols/min [2025-10-13T22:42:26.408075] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:26.607621] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-13T22:42:26.608030] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-13T22:42:26.610447] [INFO ] [MAIN ] Derivative Progress: 1368/1810 symbols completed. SES took 1.5s. Estimated remaining: 2m 50s. Rate: 156.0 symbols/min [2025-10-13T22:42:26.610597] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:26.627800] [DEBUG] [LOCAL ] SFBS: Loaded 21145 existing records from primary storage. [2025-10-13T22:42:26.627955] [INFO ] [MAIN ] SFBS: Loaded 21145 primary data records. [2025-10-13T22:42:26.957325] [DEBUG] [LOCAL ] SFL: Loaded 45269 existing records from primary storage. [2025-10-13T22:42:26.958558] [INFO ] [MAIN ] SFL: Loaded 45269 primary data records. [2025-10-13T22:42:27.051167] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:27.063314] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4134 primary records. [2025-10-13T22:42:27.081977] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-13T22:42:27.298847] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-13T22:42:27.298991] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-13T22:42:27.301109] [INFO ] [MAIN ] Derivative Progress: 1369/1810 symbols completed. SFB took 1.1s. Estimated remaining: 2m 50s. Rate: 155.9 symbols/min [2025-10-13T22:42:27.301441] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:27.321135] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:27.322332] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21145 primary records. [2025-10-13T22:42:27.322454] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-13T22:42:27.341783] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-13T22:42:27.342049] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-13T22:42:27.345021] [INFO ] [MAIN ] Derivative Progress: 1370/1810 symbols completed. SFBS took 0.9s. Estimated remaining: 2m 49s. Rate: 156.0 symbols/min [2025-10-13T22:42:27.345253] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:27.376685] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:27.377368] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45269 primary records. [2025-10-13T22:42:27.377455] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-13T22:42:27.409541] [DEBUG] [LOCAL ] SG: Loaded 53486 existing records from primary storage. [2025-10-13T22:42:27.410156] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-13T22:42:27.410290] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-13T22:42:27.410387] [INFO ] [MAIN ] SG: Loaded 53486 primary data records. [2025-10-13T22:42:27.413114] [INFO ] [MAIN ] Derivative Progress: 1371/1810 symbols completed. SFL took 0.8s. Estimated remaining: 2m 49s. Rate: 156.1 symbols/min [2025-10-13T22:42:27.413635] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:27.530193] [DEBUG] [LOCAL ] SGU: Loaded 6595 existing records from primary storage. [2025-10-13T22:42:27.543512] [INFO ] [MAIN ] SGU: Loaded 6595 primary data records. [2025-10-13T22:42:27.560365] [DEBUG] [LOCAL ] SGHC: Loaded 46842 existing records from primary storage. [2025-10-13T22:42:27.604741] [INFO ] [MAIN ] SGHC: Loaded 46842 primary data records. [2025-10-13T22:42:28.385019] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:28.393914] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53486 primary records. [2025-10-13T22:42:28.400535] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-13T22:42:28.402779] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:28.425033] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6595 primary records. [2025-10-13T22:42:28.425513] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-13T22:42:28.425364] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:28.432216] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 46842 primary records. [2025-10-13T22:42:28.432375] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-13T22:42:28.434787] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-13T22:42:28.443344] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-13T22:42:28.448248] [INFO ] [MAIN ] Derivative Progress: 1372/1810 symbols completed. SG took 1.1s. Estimated remaining: 2m 49s. Rate: 155.9 symbols/min [2025-10-13T22:42:28.452748] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:28.452573] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-13T22:42:28.463982] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-13T22:42:28.471111] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-13T22:42:28.471366] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-13T22:42:28.469235] [INFO ] [MAIN ] Derivative Progress: 1373/1810 symbols completed. SGU took 1.1s. Estimated remaining: 2m 48s. Rate: 156.0 symbols/min [2025-10-13T22:42:28.471504] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:28.474412] [INFO ] [MAIN ] Derivative Progress: 1374/1810 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 48s. Rate: 156.2 symbols/min [2025-10-13T22:42:28.474964] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:28.500761] [DEBUG] [LOCAL ] SHCO: Loaded 25352 existing records from primary storage. [2025-10-13T22:42:28.500977] [INFO ] [MAIN ] SHCO: Loaded 25352 primary data records. [2025-10-13T22:42:28.683351] [DEBUG] [LOCAL ] SHAK: Loaded 48873 existing records from primary storage. [2025-10-13T22:42:28.686790] [INFO ] [MAIN ] SHAK: Loaded 48873 primary data records. [2025-10-13T22:42:28.933228] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-13T22:42:28.981285] [INFO ] [MAIN ] SHEL: Loaded 53673 primary data records. [2025-10-13T22:42:29.506137] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:29.507288] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25352 primary records. [2025-10-13T22:42:29.507546] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-13T22:42:29.525760] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-13T22:42:29.525866] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-13T22:42:29.530059] [INFO ] [MAIN ] Derivative Progress: 1375/1810 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 47s. Rate: 156.0 symbols/min [2025-10-13T22:42:29.531436] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:29.546391] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:29.547296] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48873 primary records. [2025-10-13T22:42:29.547538] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-13T22:42:29.579068] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-13T22:42:29.579291] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:29.580148] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53673 primary records. [2025-10-13T22:42:29.580212] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-13T22:42:29.588396] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-13T22:42:29.590852] [INFO ] [MAIN ] Derivative Progress: 1376/1810 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 47s. Rate: 156.1 symbols/min [2025-10-13T22:42:29.599024] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:29.606744] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-13T22:42:29.615125] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-13T22:42:29.617977] [INFO ] [MAIN ] Derivative Progress: 1377/1810 symbols completed. SHEL took 1.1s. Estimated remaining: 2m 46s. Rate: 156.2 symbols/min [2025-10-13T22:42:29.618697] [DEBUG] [LOCAL ] SHG: Loaded 26434 existing records from primary storage. [2025-10-13T22:42:29.618816] [INFO ] [MAIN ] SHG: Loaded 26434 primary data records. [2025-10-13T22:42:29.618974] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:29.696767] [DEBUG] [LOCAL ] SHOC: Loaded 3343 existing records from primary storage. [2025-10-13T22:42:29.722732] [INFO ] [MAIN ] SHOC: Loaded 3343 primary data records. [2025-10-13T22:42:30.045165] [DEBUG] [LOCAL ] SHO: Loaded 49497 existing records from primary storage. [2025-10-13T22:42:30.063664] [INFO ] [MAIN ] SHO: Loaded 49497 primary data records. [2025-10-13T22:42:30.606236] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:30.608354] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26434 primary records. [2025-10-13T22:42:30.608501] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-13T22:42:30.634306] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:42:30.635384] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3343 primary records. [2025-10-13T22:42:30.635712] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-13T22:42:30.652405] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-13T22:42:30.652839] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-13T22:42:30.655689] [INFO ] [MAIN ] Derivative Progress: 1378/1810 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 46s. Rate: 156.0 symbols/min [2025-10-13T22:42:30.657911] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-13T22:42:30.657999] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-13T22:42:30.660489] [INFO ] [MAIN ] Derivative Progress: 1379/1810 symbols completed. SHG took 1.1s. Estimated remaining: 2m 46s. Rate: 156.1 symbols/min [2025-10-13T22:42:30.675393] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:30.676039] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49497 primary records. [2025-10-13T22:42:30.676100] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-13T22:42:30.691245] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-13T22:42:30.691303] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-13T22:42:30.694295] [INFO ] [MAIN ] Derivative Progress: 1380/1810 symbols completed. SHO took 1.1s. Estimated remaining: 2m 45s. Rate: 156.2 symbols/min [2025-10-13T22:42:30.694798] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:30.694964] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:30.694900] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:30.767526] [DEBUG] [LOCAL ] SIG: Loaded 45713 existing records from primary storage. [2025-10-13T22:42:30.769011] [INFO ] [MAIN ] SIG: Loaded 45713 primary data records. [2025-10-13T22:42:30.768872] [DEBUG] [LOCAL ] SID: Loaded 42599 existing records from primary storage. [2025-10-13T22:42:30.769245] [INFO ] [MAIN ] SID: Loaded 42599 primary data records. [2025-10-13T22:42:30.934168] [DEBUG] [LOCAL ] SHW: Loaded 50346 existing records from primary storage. [2025-10-13T22:42:30.961741] [INFO ] [MAIN ] SHW: Loaded 50346 primary data records. [2025-10-13T22:42:31.720820] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:31.735147] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45713 primary records. [2025-10-13T22:42:31.735808] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-13T22:42:31.736156] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:31.738169] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42599 primary records. [2025-10-13T22:42:31.750052] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-13T22:42:31.755391] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-13T22:42:31.756466] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-13T22:42:31.767973] [INFO ] [MAIN ] Derivative Progress: 1381/1810 symbols completed. SIG took 1.1s. Estimated remaining: 2m 45s. Rate: 156.0 symbols/min [2025-10-13T22:42:31.771921] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:31.787101] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:31.788479] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50346 primary records. [2025-10-13T22:42:31.788910] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-13T22:42:31.803440] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-13T22:42:31.804312] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-13T22:42:31.806604] [INFO ] [MAIN ] Derivative Progress: 1382/1810 symbols completed. SID took 1.1s. Estimated remaining: 2m 45s. Rate: 156.1 symbols/min [2025-10-13T22:42:31.807679] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:31.824969] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-13T22:42:31.826180] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-13T22:42:31.829087] [INFO ] [MAIN ] Derivative Progress: 1383/1810 symbols completed. SHW took 1.1s. Estimated remaining: 2m 44s. Rate: 156.2 symbols/min [2025-10-13T22:42:31.826679] [DEBUG] [LOCAL ] SII: Loaded 23960 existing records from primary storage. [2025-10-13T22:42:31.829450] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:31.829336] [INFO ] [MAIN ] SII: Loaded 23960 primary data records. [2025-10-13T22:42:31.954455] [DEBUG] [LOCAL ] SILA: Loaded 30545 existing records from primary storage. [2025-10-13T22:42:31.970354] [INFO ] [MAIN ] SILA: Loaded 30545 primary data records. [2025-10-13T22:42:32.296073] [DEBUG] [LOCAL ] SITC: Loaded 41665 existing records from primary storage. [2025-10-13T22:42:32.317917] [INFO ] [MAIN ] SITC: Loaded 41665 primary data records. [2025-10-13T22:42:32.906434] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:32.911925] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:32.913965] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30545 primary records. [2025-10-13T22:42:32.913004] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23960 primary records. [2025-10-13T22:42:32.915451] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-13T22:42:32.916264] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-13T22:42:32.943752] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-13T22:42:32.947402] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-13T22:42:32.951068] [INFO ] [MAIN ] Derivative Progress: 1384/1810 symbols completed. SII took 1.2s. Estimated remaining: 2m 44s. Rate: 156.0 symbols/min [2025-10-13T22:42:32.952057] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:32.954301] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-13T22:42:32.954696] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-13T22:42:32.957681] [INFO ] [MAIN ] Derivative Progress: 1385/1810 symbols completed. SILA took 1.1s. Estimated remaining: 2m 43s. Rate: 156.1 symbols/min [2025-10-13T22:42:32.957924] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:32.974786] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:32.975600] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41665 primary records. [2025-10-13T22:42:32.975767] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-13T22:42:32.992807] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-13T22:42:32.993257] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-13T22:42:32.995551] [INFO ] [MAIN ] Derivative Progress: 1386/1810 symbols completed. SITC took 1.2s. Estimated remaining: 2m 43s. Rate: 156.2 symbols/min [2025-10-13T22:42:32.995916] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:33.035308] [DEBUG] [LOCAL ] SITE: Loaded 35421 existing records from primary storage. [2025-10-13T22:42:33.035556] [INFO ] [MAIN ] SITE: Loaded 35421 primary data records. [2025-10-13T22:42:33.109255] [DEBUG] [LOCAL ] SJT: Loaded 22350 existing records from primary storage. [2025-10-13T22:42:33.163156] [INFO ] [MAIN ] SJT: Loaded 22350 primary data records. [2025-10-13T22:42:33.164153] [DEBUG] [LOCAL ] SJM: Loaded 50108 existing records from primary storage. [2025-10-13T22:42:33.164608] [INFO ] [MAIN ] SJM: Loaded 50108 primary data records. [2025-10-13T22:42:34.000431] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:34.005234] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35421 primary records. [2025-10-13T22:42:34.005424] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-13T22:42:34.046528] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:34.047689] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-13T22:42:34.047991] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:34.048907] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22350 primary records. [2025-10-13T22:42:34.048997] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-13T22:42:34.049184] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-13T22:42:34.051583] [INFO ] [MAIN ] Derivative Progress: 1387/1810 symbols completed. SITE took 1.1s. Estimated remaining: 2m 43s. Rate: 156.0 symbols/min [2025-10-13T22:42:34.053234] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:34.052317] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50108 primary records. [2025-10-13T22:42:34.053744] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-13T22:42:34.083562] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-13T22:42:34.083964] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-13T22:42:34.086938] [INFO ] [MAIN ] Derivative Progress: 1388/1810 symbols completed. SJM took 1.1s. Estimated remaining: 2m 42s. Rate: 156.1 symbols/min [2025-10-13T22:42:34.087540] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:34.089471] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-13T22:42:34.089546] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-13T22:42:34.091995] [INFO ] [MAIN ] Derivative Progress: 1389/1810 symbols completed. SJT took 1.1s. Estimated remaining: 2m 42s. Rate: 156.2 symbols/min [2025-10-13T22:42:34.092232] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:34.099639] [DEBUG] [LOCAL ] SKIL: Loaded 6538 existing records from primary storage. [2025-10-13T22:42:34.099886] [INFO ] [MAIN ] SKIL: Loaded 6538 primary data records. [2025-10-13T22:42:34.226277] [DEBUG] [LOCAL ] SKE: Loaded 36639 existing records from primary storage. [2025-10-13T22:42:34.232076] [INFO ] [MAIN ] SKE: Loaded 36639 primary data records. [2025-10-13T22:42:34.354102] [DEBUG] [LOCAL ] SKLZ: Loaded 11564 existing records from primary storage. [2025-10-13T22:42:34.376440] [INFO ] [MAIN ] SKLZ: Loaded 11564 primary data records. [2025-10-13T22:42:35.086711] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-13T22:42:35.087495] [INFO ] [MAIN ] SKIL: Generated 1790 derivative records from 6538 primary records. [2025-10-13T22:42:35.087981] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-13T22:42:35.106890] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1790 records). [2025-10-13T22:42:35.119991] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-13T22:42:35.122380] [INFO ] [MAIN ] Derivative Progress: 1390/1810 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 42s. Rate: 156.0 symbols/min [2025-10-13T22:42:35.120330] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:35.122628] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:35.123587] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36639 primary records. [2025-10-13T22:42:35.124290] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-13T22:42:35.143015] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-13T22:42:35.143164] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-13T22:42:35.146071] [INFO ] [MAIN ] Derivative Progress: 1391/1810 symbols completed. SKE took 1.1s. Estimated remaining: 2m 41s. Rate: 156.1 symbols/min [2025-10-13T22:42:35.158602] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:35.159530] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:35.160486] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11564 primary records. [2025-10-13T22:42:35.163440] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-13T22:42:35.188172] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-13T22:42:35.188353] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-13T22:42:35.190560] [INFO ] [MAIN ] Derivative Progress: 1392/1810 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 41s. Rate: 156.2 symbols/min [2025-10-13T22:42:35.190733] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:35.212995] [DEBUG] [LOCAL ] SKM: Loaded 35143 existing records from primary storage. [2025-10-13T22:42:35.213212] [INFO ] [MAIN ] SKM: Loaded 35143 primary data records. [2025-10-13T22:42:35.338736] [DEBUG] [LOCAL ] SKT: Loaded 42491 existing records from primary storage. [2025-10-13T22:42:35.344933] [INFO ] [MAIN ] SKT: Loaded 42491 primary data records. [2025-10-13T22:42:35.444496] [DEBUG] [LOCAL ] SKY: Loaded 38298 existing records from primary storage. [2025-10-13T22:42:35.473698] [INFO ] [MAIN ] SKY: Loaded 38298 primary data records. [2025-10-13T22:42:36.228582] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:36.229551] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35143 primary records. [2025-10-13T22:42:36.229857] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-13T22:42:36.248254] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-13T22:42:36.248392] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-13T22:42:36.251042] [INFO ] [MAIN ] Derivative Progress: 1393/1810 symbols completed. SKM took 1.1s. Estimated remaining: 2m 40s. Rate: 156.0 symbols/min [2025-10-13T22:42:36.270021] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:36.270940] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38298 primary records. [2025-10-13T22:42:36.271028] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-13T22:42:36.290217] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-13T22:42:36.290463] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-13T22:42:36.293401] [INFO ] [MAIN ] Derivative Progress: 1394/1810 symbols completed. SKY took 1.1s. Estimated remaining: 2m 40s. Rate: 156.1 symbols/min [2025-10-13T22:42:36.306539] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:42:36.307166] [INFO ] [MAIN ] SKT: Generated 1793 derivative records from 42491 primary records. [2025-10-13T22:42:36.307229] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-13T22:42:36.322714] [DEBUG] [LOCAL ] SKT: Derivative data saved (1793 records). [2025-10-13T22:42:36.322815] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-13T22:42:36.325061] [INFO ] [MAIN ] Derivative Progress: 1395/1810 symbols completed. SKT took 1.2s. Estimated remaining: 2m 39s. Rate: 156.2 symbols/min [2025-10-13T22:42:36.325497] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:36.325603] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:36.325672] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:36.345445] [DEBUG] [LOCAL ] SKYH: Loaded 16380 existing records from primary storage. [2025-10-13T22:42:36.345612] [INFO ] [MAIN ] SKYH: Loaded 16380 primary data records. [2025-10-13T22:42:36.579455] [DEBUG] [LOCAL ] SLF: Loaded 38799 existing records from primary storage. [2025-10-13T22:42:36.594793] [INFO ] [MAIN ] SLF: Loaded 38799 primary data records. [2025-10-13T22:42:36.789841] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-13T22:42:36.806417] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-13T22:42:37.411695] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:37.413556] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16380 primary records. [2025-10-13T22:42:37.414007] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-13T22:42:37.433690] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-13T22:42:37.437060] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-13T22:42:37.441273] [INFO ] [MAIN ] Derivative Progress: 1396/1810 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 39s. Rate: 156.0 symbols/min [2025-10-13T22:42:37.443142] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:37.457360] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:37.461350] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-13T22:42:37.462232] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-13T22:42:37.476792] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:37.485583] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38799 primary records. [2025-10-13T22:42:37.494206] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-13T22:42:37.489977] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-13T22:42:37.494473] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-13T22:42:37.497794] [INFO ] [MAIN ] Derivative Progress: 1397/1810 symbols completed. SLB took 1.2s. Estimated remaining: 2m 39s. Rate: 156.1 symbols/min [2025-10-13T22:42:37.505238] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:37.521038] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-13T22:42:37.522169] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-13T22:42:37.525146] [INFO ] [MAIN ] Derivative Progress: 1398/1810 symbols completed. SLF took 1.2s. Estimated remaining: 2m 38s. Rate: 156.2 symbols/min [2025-10-13T22:42:37.525459] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:37.606087] [DEBUG] [LOCAL ] SLGN: Loaded 40749 existing records from primary storage. [2025-10-13T22:42:37.619233] [INFO ] [MAIN ] SLGN: Loaded 40749 primary data records. [2025-10-13T22:42:37.621937] [DEBUG] [LOCAL ] SLG: Loaded 45377 existing records from primary storage. [2025-10-13T22:42:37.622575] [INFO ] [MAIN ] SLG: Loaded 45377 primary data records. [2025-10-13T22:42:37.678198] [DEBUG] [LOCAL ] SLQT: Loaded 43529 existing records from primary storage. [2025-10-13T22:42:37.721187] [INFO ] [MAIN ] SLQT: Loaded 43529 primary data records. [2025-10-13T22:42:38.732206] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:38.734417] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45377 primary records. [2025-10-13T22:42:38.735588] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-13T22:42:38.776257] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:38.776743] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:38.779498] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43529 primary records. [2025-10-13T22:42:38.779631] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-13T22:42:38.781907] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40749 primary records. [2025-10-13T22:42:38.785809] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-13T22:42:38.787462] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-13T22:42:38.794503] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-13T22:42:38.805755] [INFO ] [MAIN ] Derivative Progress: 1399/1810 symbols completed. SLG took 1.4s. Estimated remaining: 2m 38s. Rate: 155.9 symbols/min [2025-10-13T22:42:38.813468] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:38.818513] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-13T22:42:38.822628] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-13T22:42:38.823262] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-13T22:42:38.823382] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-13T22:42:38.826434] [INFO ] [MAIN ] Derivative Progress: 1400/1810 symbols completed. SLGN took 1.3s. Estimated remaining: 2m 38s. Rate: 156.1 symbols/min [2025-10-13T22:42:38.830476] [INFO ] [MAIN ] Derivative Progress: 1401/1810 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 37s. Rate: 156.2 symbols/min [2025-10-13T22:42:38.830204] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:38.831233] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:38.842361] [DEBUG] [LOCAL ] SMBK: Loaded 8199 existing records from primary storage. [2025-10-13T22:42:38.842622] [INFO ] [MAIN ] SMBK: Loaded 8199 primary data records. [2025-10-13T22:42:38.957219] [DEBUG] [LOCAL ] SLVM: Loaded 27815 existing records from primary storage. [2025-10-13T22:42:38.969676] [INFO ] [MAIN ] SLVM: Loaded 27815 primary data records. [2025-10-13T22:42:39.349723] [DEBUG] [LOCAL ] SM: Loaded 52353 existing records from primary storage. [2025-10-13T22:42:39.360323] [INFO ] [MAIN ] SM: Loaded 52353 primary data records. [2025-10-13T22:42:39.966225] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:39.968556] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8199 primary records. [2025-10-13T22:42:39.970366] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-13T22:42:39.991054] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-13T22:42:39.992319] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-13T22:42:39.995151] [INFO ] [MAIN ] Derivative Progress: 1402/1810 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 37s. Rate: 155.9 symbols/min [2025-10-13T22:42:39.996765] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:40.014513] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:40.019845] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27815 primary records. [2025-10-13T22:42:40.020257] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-13T22:42:40.044010] [DEBUG] [LOCAL ] SMC: Loaded 11265 existing records from primary storage. [2025-10-13T22:42:40.047288] [INFO ] [MAIN ] SMC: Loaded 11265 primary data records. [2025-10-13T22:42:40.049039] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-13T22:42:40.056033] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-13T22:42:40.113018] [INFO ] [MAIN ] Derivative Progress: 1403/1810 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 37s. Rate: 156.0 symbols/min [2025-10-13T22:42:40.128607] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:40.139374] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:40.159126] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52353 primary records. [2025-10-13T22:42:40.178972] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-13T22:42:40.263721] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-13T22:42:40.281741] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-13T22:42:40.287847] [INFO ] [MAIN ] Derivative Progress: 1404/1810 symbols completed. SM took 1.5s. Estimated remaining: 2m 36s. Rate: 156.1 symbols/min [2025-10-13T22:42:40.288081] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:40.446348] [DEBUG] [LOCAL ] SMFG: Loaded 48271 existing records from primary storage. [2025-10-13T22:42:40.446909] [INFO ] [MAIN ] SMFG: Loaded 48271 primary data records. [2025-10-13T22:42:40.590607] [DEBUG] [LOCAL ] SMG: Loaded 43439 existing records from primary storage. [2025-10-13T22:42:40.601353] [INFO ] [MAIN ] SMG: Loaded 43439 primary data records. [2025-10-13T22:42:40.757693] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:40.886866] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11265 primary records. [2025-10-13T22:42:40.904838] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-13T22:42:41.161330] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-13T22:42:41.162449] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-13T22:42:41.164903] [INFO ] [MAIN ] Derivative Progress: 1405/1810 symbols completed. SMC took 1.2s. Estimated remaining: 2m 36s. Rate: 155.9 symbols/min [2025-10-13T22:42:41.165069] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:41.184405] [DEBUG] [LOCAL ] SMHI: Loaded 13126 existing records from primary storage. [2025-10-13T22:42:41.184769] [INFO ] [MAIN ] SMHI: Loaded 13126 primary data records. [2025-10-13T22:42:41.276605] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:41.303886] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48271 primary records. [2025-10-13T22:42:41.304136] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-13T22:42:41.526203] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:41.526406] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-13T22:42:41.526633] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-13T22:42:41.527476] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43439 primary records. [2025-10-13T22:42:41.528224] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-13T22:42:41.531669] [INFO ] [MAIN ] Derivative Progress: 1406/1810 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 35s. Rate: 155.9 symbols/min [2025-10-13T22:42:41.539728] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:41.549834] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-13T22:42:41.549972] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-13T22:42:41.555296] [INFO ] [MAIN ] Derivative Progress: 1407/1810 symbols completed. SMG took 1.3s. Estimated remaining: 2m 35s. Rate: 156.0 symbols/min [2025-10-13T22:42:41.555863] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:41.570416] [DEBUG] [LOCAL ] SMP: Loaded 18967 existing records from primary storage. [2025-10-13T22:42:41.571492] [INFO ] [MAIN ] SMP: Loaded 18967 primary data records. [2025-10-13T22:42:41.688795] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:41.705399] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13126 primary records. [2025-10-13T22:42:41.715921] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-13T22:42:41.913449] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-13T22:42:41.928934] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-13T22:42:41.931222] [INFO ] [MAIN ] Derivative Progress: 1408/1810 symbols completed. SMHI took 0.8s. Estimated remaining: 2m 35s. Rate: 156.0 symbols/min [2025-10-13T22:42:41.932737] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-13T22:42:41.932901] [INFO ] [MAIN ] SMR: Loaded 53799 primary data records. [2025-10-13T22:42:42.246011] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:42.246974] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18967 primary records. [2025-10-13T22:42:42.247056] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-13T22:42:42.264399] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-13T22:42:42.264531] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-13T22:42:42.266950] [INFO ] [MAIN ] Derivative Progress: 1409/1810 symbols completed. SMP took 0.7s. Estimated remaining: 2m 34s. Rate: 156.1 symbols/min [2025-10-13T22:42:42.284528] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:42.285146] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53799 primary records. [2025-10-13T22:42:42.285206] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-13T22:42:42.301540] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-13T22:42:42.301636] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-13T22:42:42.304175] [INFO ] [MAIN ] Derivative Progress: 1410/1810 symbols completed. SMR took 0.7s. Estimated remaining: 2m 34s. Rate: 156.2 symbols/min [2025-10-13T22:42:42.304638] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:42.304592] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:42.305071] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:42.372194] [DEBUG] [LOCAL ] SMRT: Loaded 43964 existing records from primary storage. [2025-10-13T22:42:42.372470] [INFO ] [MAIN ] SMRT: Loaded 43964 primary data records. [2025-10-13T22:42:42.373074] [DEBUG] [LOCAL ] SMWB: Loaded 32262 existing records from primary storage. [2025-10-13T22:42:42.384379] [INFO ] [MAIN ] SMWB: Loaded 32262 primary data records. [2025-10-13T22:42:42.558029] [DEBUG] [LOCAL ] SN: Loaded 50003 existing records from primary storage. [2025-10-13T22:42:42.584215] [INFO ] [MAIN ] SN: Loaded 50003 primary data records. [2025-10-13T22:42:43.356815] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:43.358809] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43964 primary records. [2025-10-13T22:42:43.359918] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-13T22:42:43.390146] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-13T22:42:43.390619] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-13T22:42:43.390463] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:43.391755] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32262 primary records. [2025-10-13T22:42:43.393855] [INFO ] [MAIN ] Derivative Progress: 1411/1810 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 34s. Rate: 156.0 symbols/min [2025-10-13T22:42:43.394149] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-13T22:42:43.395154] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:43.413860] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-13T22:42:43.426502] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-13T22:42:43.426941] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:43.430694] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 50003 primary records. [2025-10-13T22:42:43.429845] [INFO ] [MAIN ] Derivative Progress: 1412/1810 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 33s. Rate: 156.1 symbols/min [2025-10-13T22:42:43.430911] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-13T22:42:43.431135] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:43.455278] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-13T22:42:43.455460] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-13T22:42:43.457903] [INFO ] [MAIN ] Derivative Progress: 1413/1810 symbols completed. SN took 1.2s. Estimated remaining: 2m 33s. Rate: 156.2 symbols/min [2025-10-13T22:42:43.458151] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:43.470098] [DEBUG] [LOCAL ] SNA: Loaded 25749 existing records from primary storage. [2025-10-13T22:42:43.470337] [INFO ] [MAIN ] SNA: Loaded 25749 primary data records. [2025-10-13T22:42:43.473292] [DEBUG] [LOCAL ] SNDA: Loaded 4448 existing records from primary storage. [2025-10-13T22:42:43.494824] [INFO ] [MAIN ] SNDA: Loaded 4448 primary data records. [2025-10-13T22:42:43.813442] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-13T22:42:43.953018] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-13T22:42:44.443284] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:44.445031] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25749 primary records. [2025-10-13T22:42:44.445263] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-13T22:42:44.463440] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-13T22:42:44.463767] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-13T22:42:44.466684] [INFO ] [MAIN ] Derivative Progress: 1414/1810 symbols completed. SNA took 1.1s. Estimated remaining: 2m 32s. Rate: 156.0 symbols/min [2025-10-13T22:42:44.467762] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:44.481483] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7829 incomplete bins [2025-10-13T22:42:44.482232] [INFO ] [MAIN ] SNDA: Generated 1785 derivative records from 4448 primary records. [2025-10-13T22:42:44.485536] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-13T22:42:44.517312] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:44.519321] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1785 records). [2025-10-13T22:42:44.520224] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-13T22:42:44.520570] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-13T22:42:44.520430] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-13T22:42:44.523439] [INFO ] [MAIN ] Derivative Progress: 1415/1810 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 32s. Rate: 156.1 symbols/min [2025-10-13T22:42:44.533975] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:44.550047] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-13T22:42:44.550226] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-13T22:42:44.552673] [INFO ] [MAIN ] Derivative Progress: 1416/1810 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 31s. Rate: 156.2 symbols/min [2025-10-13T22:42:44.552971] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:44.566370] [DEBUG] [LOCAL ] SNDR: Loaded 41435 existing records from primary storage. [2025-10-13T22:42:44.566578] [INFO ] [MAIN ] SNDR: Loaded 41435 primary data records. [2025-10-13T22:42:44.906820] [DEBUG] [LOCAL ] SNN: Loaded 44305 existing records from primary storage. [2025-10-13T22:42:44.921350] [INFO ] [MAIN ] SNN: Loaded 44305 primary data records. [2025-10-13T22:42:45.042293] [DEBUG] [LOCAL ] SNOW: Loaded 53594 existing records from primary storage. [2025-10-13T22:42:45.048499] [INFO ] [MAIN ] SNOW: Loaded 53594 primary data records. [2025-10-13T22:42:45.558051] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:45.559816] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41435 primary records. [2025-10-13T22:42:45.560063] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-13T22:42:45.578076] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-13T22:42:45.578774] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-13T22:42:45.580790] [INFO ] [MAIN ] Derivative Progress: 1417/1810 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 31s. Rate: 156.0 symbols/min [2025-10-13T22:42:45.581253] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:45.600335] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:45.601981] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44305 primary records. [2025-10-13T22:42:45.602086] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-13T22:42:45.633371] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:45.634810] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53594 primary records. [2025-10-13T22:42:45.635156] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-13T22:42:45.645344] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-13T22:42:45.652155] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-13T22:42:45.653445] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-13T22:42:45.653550] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-13T22:42:45.655974] [INFO ] [MAIN ] Derivative Progress: 1418/1810 symbols completed. SNN took 1.1s. Estimated remaining: 2m 31s. Rate: 156.1 symbols/min [2025-10-13T22:42:45.671025] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:45.671103] [INFO ] [MAIN ] Derivative Progress: 1419/1810 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 30s. Rate: 156.2 symbols/min [2025-10-13T22:42:45.671373] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:45.692523] [DEBUG] [LOCAL ] SNV: Loaded 48968 existing records from primary storage. [2025-10-13T22:42:45.692906] [INFO ] [MAIN ] SNV: Loaded 48968 primary data records. [2025-10-13T22:42:45.930312] [DEBUG] [LOCAL ] SNX: Loaded 39704 existing records from primary storage. [2025-10-13T22:42:46.042472] [INFO ] [MAIN ] SNX: Loaded 39704 primary data records. [2025-10-13T22:42:46.042310] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-13T22:42:46.042604] [INFO ] [MAIN ] SO: Loaded 53614 primary data records. [2025-10-13T22:42:46.715551] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:46.716472] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48968 primary records. [2025-10-13T22:42:46.717677] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-13T22:42:46.739790] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-13T22:42:46.739876] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-13T22:42:46.743436] [INFO ] [MAIN ] Derivative Progress: 1420/1810 symbols completed. SNV took 1.2s. Estimated remaining: 2m 30s. Rate: 156.0 symbols/min [2025-10-13T22:42:46.746225] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:46.762518] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:46.763177] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53614 primary records. [2025-10-13T22:42:46.763362] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-13T22:42:46.781888] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-13T22:42:46.794285] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-13T22:42:46.797636] [INFO ] [MAIN ] Derivative Progress: 1421/1810 symbols completed. SO took 1.1s. Estimated remaining: 2m 30s. Rate: 156.1 symbols/min [2025-10-13T22:42:46.797798] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:46.798324] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:46.799431] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39704 primary records. [2025-10-13T22:42:46.799726] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-13T22:42:46.828619] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-13T22:42:46.839426] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-13T22:42:46.843521] [INFO ] [MAIN ] Derivative Progress: 1422/1810 symbols completed. SNX took 1.2s. Estimated remaining: 2m 29s. Rate: 156.2 symbols/min [2025-10-13T22:42:46.843870] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:46.845222] [DEBUG] [LOCAL ] SOBO: Loaded 39413 existing records from primary storage. [2025-10-13T22:42:46.845489] [INFO ] [MAIN ] SOBO: Loaded 39413 primary data records. [2025-10-13T22:42:46.948953] [DEBUG] [LOCAL ] SOJC: Loaded 4926 existing records from primary storage. [2025-10-13T22:42:46.966495] [INFO ] [MAIN ] SOJC: Loaded 4926 primary data records. [2025-10-13T22:42:47.159442] [DEBUG] [LOCAL ] SOC: Loaded 50790 existing records from primary storage. [2025-10-13T22:42:47.265842] [INFO ] [MAIN ] SOC: Loaded 50790 primary data records. [2025-10-13T22:42:47.813892] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:47.814340] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:47.815849] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4926 primary records. [2025-10-13T22:42:47.815117] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39413 primary records. [2025-10-13T22:42:47.815961] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-13T22:42:47.816996] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-13T22:42:47.844460] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-13T22:42:47.845045] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-13T22:42:47.847212] [INFO ] [MAIN ] Derivative Progress: 1423/1810 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 29s. Rate: 156.0 symbols/min [2025-10-13T22:42:47.850587] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-13T22:42:47.850783] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-13T22:42:47.854043] [INFO ] [MAIN ] Derivative Progress: 1424/1810 symbols completed. SOJC took 1.0s. Estimated remaining: 2m 28s. Rate: 156.1 symbols/min [2025-10-13T22:42:47.868299] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:47.868994] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50790 primary records. [2025-10-13T22:42:47.869057] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-13T22:42:47.884335] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-13T22:42:47.884403] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-13T22:42:47.886895] [INFO ] [MAIN ] Derivative Progress: 1425/1810 symbols completed. SOC took 1.1s. Estimated remaining: 2m 28s. Rate: 156.2 symbols/min [2025-10-13T22:42:47.887364] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:47.887480] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:47.887309] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:47.906669] [DEBUG] [LOCAL ] SOJE: Loaded 8970 existing records from primary storage. [2025-10-13T22:42:47.916475] [DEBUG] [LOCAL ] SOJD: Loaded 12992 existing records from primary storage. [2025-10-13T22:42:47.916743] [INFO ] [MAIN ] SOJD: Loaded 12992 primary data records. [2025-10-13T22:42:47.916610] [INFO ] [MAIN ] SOJE: Loaded 8970 primary data records. [2025-10-13T22:42:47.917175] [DEBUG] [LOCAL ] SOL: Loaded 13166 existing records from primary storage. [2025-10-13T22:42:47.983598] [INFO ] [MAIN ] SOL: Loaded 13166 primary data records. [2025-10-13T22:42:48.904090] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:48.919016] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 8970 primary records. [2025-10-13T22:42:48.919441] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:48.919583] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-13T22:42:48.920309] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12992 primary records. [2025-10-13T22:42:48.920453] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-13T22:42:48.933280] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:48.934061] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13166 primary records. [2025-10-13T22:42:48.934507] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-13T22:42:48.976948] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-13T22:42:48.978338] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-13T22:42:48.981388] [INFO ] [MAIN ] Derivative Progress: 1426/1810 symbols completed. SOL took 1.1s. Estimated remaining: 2m 28s. Rate: 156.0 symbols/min [2025-10-13T22:42:48.982743] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-13T22:42:48.983331] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-13T22:42:48.986479] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-13T22:42:48.986604] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:48.986724] [INFO ] [MAIN ] Derivative Progress: 1427/1810 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 27s. Rate: 156.1 symbols/min [2025-10-13T22:42:48.986812] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-13T22:42:48.986965] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:48.989626] [INFO ] [MAIN ] Derivative Progress: 1428/1810 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 27s. Rate: 156.2 symbols/min [2025-10-13T22:42:48.990127] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:49.064164] [DEBUG] [LOCAL ] SOLV: Loaded 43863 existing records from primary storage. [2025-10-13T22:42:49.064913] [INFO ] [MAIN ] SOLV: Loaded 43863 primary data records. [2025-10-13T22:42:49.065631] [DEBUG] [LOCAL ] SON: Loaded 43217 existing records from primary storage. [2025-10-13T22:42:49.079833] [INFO ] [MAIN ] SON: Loaded 43217 primary data records. [2025-10-13T22:42:49.101242] [DEBUG] [LOCAL ] SONY: Loaded 53374 existing records from primary storage. [2025-10-13T22:42:49.186920] [INFO ] [MAIN ] SONY: Loaded 53374 primary data records. [2025-10-13T22:42:50.048626] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:50.055352] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43217 primary records. [2025-10-13T22:42:50.055940] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:50.057467] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-13T22:42:50.059040] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43863 primary records. [2025-10-13T22:42:50.059173] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-13T22:42:50.095690] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-13T22:42:50.095832] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-13T22:42:50.101676] [INFO ] [MAIN ] Derivative Progress: 1429/1810 symbols completed. SON took 1.1s. Estimated remaining: 2m 27s. Rate: 156.0 symbols/min [2025-10-13T22:42:50.102084] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:50.102899] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53374 primary records. [2025-10-13T22:42:50.102993] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-13T22:42:50.104275] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:50.129069] [DEBUG] [LOCAL ] SOR: Loaded 2898 existing records from primary storage. [2025-10-13T22:42:50.129249] [INFO ] [MAIN ] SOR: Loaded 2898 primary data records. [2025-10-13T22:42:50.126678] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-13T22:42:50.150191] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-13T22:42:50.168168] [INFO ] [MAIN ] Derivative Progress: 1430/1810 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 26s. Rate: 156.1 symbols/min [2025-10-13T22:42:50.187135] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:50.218059] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-13T22:42:50.231724] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-13T22:42:50.237271] [INFO ] [MAIN ] Derivative Progress: 1431/1810 symbols completed. SONY took 1.2s. Estimated remaining: 2m 26s. Rate: 156.2 symbols/min [2025-10-13T22:42:50.240840] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:50.285152] [DEBUG] [LOCAL ] SOS: Loaded 9365 existing records from primary storage. [2025-10-13T22:42:50.322127] [INFO ] [MAIN ] SOS: Loaded 9365 primary data records. [2025-10-13T22:42:50.736909] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-10-13T22:42:50.794945] [INFO ] [MAIN ] SPB: Loaded 34211 primary data records. [2025-10-13T22:42:51.004890] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:51.106834] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2898 primary records. [2025-10-13T22:42:51.107000] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-13T22:42:51.123227] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-13T22:42:51.123735] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-13T22:42:51.126066] [INFO ] [MAIN ] Derivative Progress: 1432/1810 symbols completed. SOR took 1.0s. Estimated remaining: 2m 25s. Rate: 156.1 symbols/min [2025-10-13T22:42:51.126579] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:51.146382] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:42:51.147382] [INFO ] [MAIN ] SOS: Generated 1791 derivative records from 9365 primary records. [2025-10-13T22:42:51.147758] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-13T22:42:51.163997] [DEBUG] [LOCAL ] SOS: Derivative data saved (1791 records). [2025-10-13T22:42:51.164326] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-13T22:42:51.166797] [INFO ] [MAIN ] Derivative Progress: 1433/1810 symbols completed. SOS took 1.0s. Estimated remaining: 2m 25s. Rate: 156.2 symbols/min [2025-10-13T22:42:51.167243] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:51.199962] [DEBUG] [LOCAL ] SPE: Loaded 6299 existing records from primary storage. [2025-10-13T22:42:51.200207] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:51.201171] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34211 primary records. [2025-10-13T22:42:51.201320] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-13T22:42:51.200402] [INFO ] [MAIN ] SPE: Loaded 6299 primary data records. [2025-10-13T22:42:51.334343] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-13T22:42:51.335536] [DEBUG] [LOCAL ] SPCE: Loaded 49958 existing records from primary storage. [2025-10-13T22:42:51.346480] [INFO ] [MAIN ] SPCE: Loaded 49958 primary data records. [2025-10-13T22:42:51.357027] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-13T22:42:51.418409] [INFO ] [MAIN ] Derivative Progress: 1434/1810 symbols completed. SPB took 1.2s. Estimated remaining: 2m 24s. Rate: 156.2 symbols/min [2025-10-13T22:42:51.637846] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:51.861267] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:51.862409] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6299 primary records. [2025-10-13T22:42:51.862771] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-13T22:42:51.891358] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-13T22:42:51.891569] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-13T22:42:51.894046] [INFO ] [MAIN ] Derivative Progress: 1435/1810 symbols completed. SPE took 0.7s. Estimated remaining: 2m 24s. Rate: 156.2 symbols/min [2025-10-13T22:42:51.895773] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:51.923753] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:51.924543] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49958 primary records. [2025-10-13T22:42:51.924752] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-13T22:42:51.926021] [DEBUG] [LOCAL ] SPG: Loaded 50214 existing records from primary storage. [2025-10-13T22:42:51.926157] [INFO ] [MAIN ] SPG: Loaded 50214 primary data records. [2025-10-13T22:42:52.003898] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-13T22:42:52.010254] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-13T22:42:52.023615] [INFO ] [MAIN ] Derivative Progress: 1436/1810 symbols completed. SPCE took 0.9s. Estimated remaining: 2m 24s. Rate: 156.2 symbols/min [2025-10-13T22:42:52.044718] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:52.265531] [DEBUG] [LOCAL ] SPGI: Loaded 45858 existing records from primary storage. [2025-10-13T22:42:52.272217] [INFO ] [MAIN ] SPGI: Loaded 45858 primary data records. [2025-10-13T22:42:52.272717] [DEBUG] [LOCAL ] SPH: Loaded 16823 existing records from primary storage. [2025-10-13T22:42:52.273323] [INFO ] [MAIN ] SPH: Loaded 16823 primary data records. [2025-10-13T22:42:52.938865] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:52.939990] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50214 primary records. [2025-10-13T22:42:52.940406] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-13T22:42:52.960449] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-13T22:42:52.960894] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-13T22:42:52.963437] [INFO ] [MAIN ] Derivative Progress: 1437/1810 symbols completed. SPG took 1.3s. Estimated remaining: 2m 23s. Rate: 156.1 symbols/min [2025-10-13T22:42:52.963849] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:52.993742] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:52.999269] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45858 primary records. [2025-10-13T22:42:52.999439] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:52.999562] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-13T22:42:53.000133] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16823 primary records. [2025-10-13T22:42:53.001015] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-13T22:42:53.041255] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-13T22:42:53.042037] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-13T22:42:53.044941] [INFO ] [MAIN ] Derivative Progress: 1438/1810 symbols completed. SPH took 1.0s. Estimated remaining: 2m 23s. Rate: 156.2 symbols/min [2025-10-13T22:42:53.057813] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-13T22:42:53.057931] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-13T22:42:53.060101] [INFO ] [MAIN ] Derivative Progress: 1439/1810 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 22s. Rate: 156.3 symbols/min [2025-10-13T22:42:53.061173] [DEBUG] [LOCAL ] SPHR: Loaded 40430 existing records from primary storage. [2025-10-13T22:42:53.061293] [INFO ] [MAIN ] SPHR: Loaded 40430 primary data records. [2025-10-13T22:42:53.387639] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:53.388409] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40430 primary records. [2025-10-13T22:42:53.388471] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-13T22:42:53.403922] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-13T22:42:53.403997] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-13T22:42:53.406269] [INFO ] [MAIN ] Derivative Progress: 1440/1810 symbols completed. SPHR took 0.4s. Estimated remaining: 2m 22s. Rate: 156.3 symbols/min [2025-10-13T22:42:53.407011] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:53.406910] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:53.407460] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:53.416412] [DEBUG] [LOCAL ] SPMC: Loaded 5287 existing records from primary storage. [2025-10-13T22:42:53.416722] [INFO ] [MAIN ] SPMC: Loaded 5287 primary data records. [2025-10-13T22:42:53.635550] [DEBUG] [LOCAL ] SPIR: Loaded 37521 existing records from primary storage. [2025-10-13T22:42:53.734086] [DEBUG] [LOCAL ] SPNT: Loaded 34731 existing records from primary storage. [2025-10-13T22:42:53.747717] [INFO ] [MAIN ] SPNT: Loaded 34731 primary data records. [2025-10-13T22:42:53.747813] [INFO ] [MAIN ] SPIR: Loaded 37521 primary data records. [2025-10-13T22:42:54.380887] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:54.383098] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5287 primary records. [2025-10-13T22:42:54.383433] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-13T22:42:54.401866] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-13T22:42:54.402326] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-13T22:42:54.404696] [INFO ] [MAIN ] Derivative Progress: 1441/1810 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 22s. Rate: 156.1 symbols/min [2025-10-13T22:42:54.405088] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:54.425565] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:54.439012] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34731 primary records. [2025-10-13T22:42:54.439354] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-13T22:42:54.439717] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:54.441501] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37521 primary records. [2025-10-13T22:42:54.449968] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-13T22:42:54.470951] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-13T22:42:54.473063] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-13T22:42:54.486335] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-13T22:42:54.486017] [INFO ] [MAIN ] Derivative Progress: 1442/1810 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 21s. Rate: 156.2 symbols/min [2025-10-13T22:42:54.486525] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-13T22:42:54.489634] [INFO ] [MAIN ] Derivative Progress: 1443/1810 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 21s. Rate: 156.3 symbols/min [2025-10-13T22:42:54.489457] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:54.489886] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:54.510928] [DEBUG] [LOCAL ] SPOT: Loaded 50402 existing records from primary storage. [2025-10-13T22:42:54.515355] [DEBUG] [LOCAL ] SPRU: Loaded 9703 existing records from primary storage. [2025-10-13T22:42:54.515597] [INFO ] [MAIN ] SPOT: Loaded 50402 primary data records. [2025-10-13T22:42:54.515846] [INFO ] [MAIN ] SPRU: Loaded 9703 primary data records. [2025-10-13T22:42:54.836063] [DEBUG] [LOCAL ] SPR: Loaded 41105 existing records from primary storage. [2025-10-13T22:42:54.914689] [INFO ] [MAIN ] SPR: Loaded 41105 primary data records. [2025-10-13T22:42:55.510453] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:55.511509] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9703 primary records. [2025-10-13T22:42:55.513359] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-13T22:42:55.543274] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-13T22:42:55.543499] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-13T22:42:55.546095] [INFO ] [MAIN ] Derivative Progress: 1444/1810 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 21s. Rate: 156.1 symbols/min [2025-10-13T22:42:55.546364] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:55.546805] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:55.548275] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50402 primary records. [2025-10-13T22:42:55.548410] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-13T22:42:55.565899] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-13T22:42:55.567670] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-13T22:42:55.569664] [INFO ] [MAIN ] Derivative Progress: 1445/1810 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 20s. Rate: 156.2 symbols/min [2025-10-13T22:42:55.571063] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:55.590867] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:55.591538] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41105 primary records. [2025-10-13T22:42:55.591681] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-13T22:42:55.616768] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-13T22:42:55.616905] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-13T22:42:55.619524] [INFO ] [MAIN ] Derivative Progress: 1446/1810 symbols completed. SPR took 1.1s. Estimated remaining: 2m 20s. Rate: 156.3 symbols/min [2025-10-13T22:42:55.620580] [DEBUG] [LOCAL ] SPXC: Loaded 23394 existing records from primary storage. [2025-10-13T22:42:55.624700] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:55.625418] [DEBUG] [LOCAL ] SPXX: Loaded 9471 existing records from primary storage. [2025-10-13T22:42:55.625798] [INFO ] [MAIN ] SPXC: Loaded 23394 primary data records. [2025-10-13T22:42:55.626050] [INFO ] [MAIN ] SPXX: Loaded 9471 primary data records. [2025-10-13T22:42:56.291502] [DEBUG] [LOCAL ] SQM: Loaded 48733 existing records from primary storage. [2025-10-13T22:42:56.292964] [INFO ] [MAIN ] SQM: Loaded 48733 primary data records. [2025-10-13T22:42:56.656148] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:56.657901] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9471 primary records. [2025-10-13T22:42:56.658968] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-13T22:42:56.680148] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-13T22:42:56.680835] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-13T22:42:56.683299] [INFO ] [MAIN ] Derivative Progress: 1447/1810 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 20s. Rate: 156.1 symbols/min [2025-10-13T22:42:56.683624] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:56.698564] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:56.699717] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23394 primary records. [2025-10-13T22:42:56.699945] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-13T22:42:56.729127] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-13T22:42:56.737049] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-13T22:42:56.742297] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:56.744876] [INFO ] [MAIN ] Derivative Progress: 1448/1810 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 19s. Rate: 156.2 symbols/min [2025-10-13T22:42:56.745230] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:56.754495] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48733 primary records. [2025-10-13T22:42:56.754623] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-13T22:42:56.757173] [DEBUG] [LOCAL ] SQNS: Loaded 27343 existing records from primary storage. [2025-10-13T22:42:56.764855] [INFO ] [MAIN ] SQNS: Loaded 27343 primary data records. [2025-10-13T22:42:56.778103] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-13T22:42:56.793904] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-13T22:42:56.796604] [INFO ] [MAIN ] Derivative Progress: 1449/1810 symbols completed. SQM took 1.2s. Estimated remaining: 2m 19s. Rate: 156.3 symbols/min [2025-10-13T22:42:56.806762] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:57.095098] [DEBUG] [LOCAL ] SR: Loaded 32486 existing records from primary storage. [2025-10-13T22:42:57.096030] [INFO ] [MAIN ] SR: Loaded 32486 primary data records. [2025-10-13T22:42:57.285544] [DEBUG] [LOCAL ] SRE: Loaded 53415 existing records from primary storage. [2025-10-13T22:42:57.317200] [INFO ] [MAIN ] SRE: Loaded 53415 primary data records. [2025-10-13T22:42:57.756784] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:57.758202] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 27343 primary records. [2025-10-13T22:42:57.758728] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-13T22:42:57.776772] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-13T22:42:57.778176] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-13T22:42:57.780901] [INFO ] [MAIN ] Derivative Progress: 1450/1810 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 18s. Rate: 156.1 symbols/min [2025-10-13T22:42:57.781232] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:57.799631] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:57.800508] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32486 primary records. [2025-10-13T22:42:57.800899] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-13T22:42:57.821809] [DEBUG] [LOCAL ] SREA: Loaded 10147 existing records from primary storage. [2025-10-13T22:42:57.824898] [INFO ] [MAIN ] SREA: Loaded 10147 primary data records. [2025-10-13T22:42:57.864259] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-13T22:42:57.883930] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-13T22:42:57.916684] [INFO ] [MAIN ] Derivative Progress: 1451/1810 symbols completed. SR took 1.2s. Estimated remaining: 2m 18s. Rate: 156.2 symbols/min [2025-10-13T22:42:57.934800] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:57.961336] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:42:57.970993] [INFO ] [MAIN ] SRE: Generated 1793 derivative records from 53415 primary records. [2025-10-13T22:42:57.974545] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-13T22:42:58.194235] [DEBUG] [LOCAL ] SRE: Derivative data saved (1793 records). [2025-10-13T22:42:58.194393] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-13T22:42:58.196777] [INFO ] [MAIN ] Derivative Progress: 1452/1810 symbols completed. SRE took 1.4s. Estimated remaining: 2m 17s. Rate: 156.2 symbols/min [2025-10-13T22:42:58.197718] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:58.212977] [DEBUG] [LOCAL ] SRFM: Loaded 38550 existing records from primary storage. [2025-10-13T22:42:58.213488] [INFO ] [MAIN ] SRFM: Loaded 38550 primary data records. [2025-10-13T22:42:58.339833] [DEBUG] [LOCAL ] SRG: Loaded 15360 existing records from primary storage. [2025-10-13T22:42:58.340856] [INFO ] [MAIN ] SRG: Loaded 15360 primary data records. [2025-10-13T22:42:58.923873] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:58.925682] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10147 primary records. [2025-10-13T22:42:58.925853] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-13T22:42:58.947226] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-13T22:42:58.947508] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-13T22:42:58.950020] [INFO ] [MAIN ] Derivative Progress: 1453/1810 symbols completed. SREA took 1.2s. Estimated remaining: 2m 17s. Rate: 156.1 symbols/min [2025-10-13T22:42:58.968872] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:58.969714] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 38550 primary records. [2025-10-13T22:42:58.970218] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-13T22:42:59.000600] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-13T22:42:59.000827] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-13T22:42:59.002964] [INFO ] [MAIN ] Derivative Progress: 1454/1810 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 17s. Rate: 156.2 symbols/min [2025-10-13T22:42:59.003329] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:59.004061] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15360 primary records. [2025-10-13T22:42:59.004122] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-13T22:42:59.018365] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-13T22:42:59.018423] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-13T22:42:59.021046] [INFO ] [MAIN ] Derivative Progress: 1455/1810 symbols completed. SRG took 0.8s. Estimated remaining: 2m 16s. Rate: 156.3 symbols/min [2025-10-13T22:42:59.021457] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:59.021383] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:59.021956] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:42:59.032888] [DEBUG] [LOCAL ] SRV: Loaded 7381 existing records from primary storage. [2025-10-13T22:42:59.033068] [INFO ] [MAIN ] SRV: Loaded 7381 primary data records. [2025-10-13T22:42:59.126623] [DEBUG] [LOCAL ] SRI: Loaded 26555 existing records from primary storage. [2025-10-13T22:42:59.137554] [INFO ] [MAIN ] SRI: Loaded 26555 primary data records. [2025-10-13T22:42:59.518282] [DEBUG] [LOCAL ] SSB: Loaded 42741 existing records from primary storage. [2025-10-13T22:42:59.534431] [INFO ] [MAIN ] SSB: Loaded 42741 primary data records. [2025-10-13T22:42:59.980011] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:42:59.982157] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7381 primary records. [2025-10-13T22:42:59.984276] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-13T22:43:00.010119] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:00.014012] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-13T22:43:00.014812] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26555 primary records. [2025-10-13T22:43:00.014126] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-13T22:43:00.017248] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-13T22:43:00.017142] [INFO ] [MAIN ] Derivative Progress: 1456/1810 symbols completed. SRV took 1.0s. Estimated remaining: 2m 16s. Rate: 156.1 symbols/min [2025-10-13T22:43:00.018316] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:00.034471] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-13T22:43:00.034741] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-13T22:43:00.037314] [INFO ] [MAIN ] Derivative Progress: 1457/1810 symbols completed. SRI took 1.0s. Estimated remaining: 2m 16s. Rate: 156.3 symbols/min [2025-10-13T22:43:00.037566] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:00.054363] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:00.055148] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42741 primary records. [2025-10-13T22:43:00.055240] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-13T22:43:00.086421] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-13T22:43:00.086557] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-13T22:43:00.085723] [DEBUG] [LOCAL ] SSD: Loaded 22581 existing records from primary storage. [2025-10-13T22:43:00.086788] [INFO ] [MAIN ] SSD: Loaded 22581 primary data records. [2025-10-13T22:43:00.089258] [INFO ] [MAIN ] Derivative Progress: 1458/1810 symbols completed. SSB took 1.1s. Estimated remaining: 2m 15s. Rate: 156.3 symbols/min [2025-10-13T22:43:00.110081] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:00.259187] [DEBUG] [LOCAL ] SSL: Loaded 41409 existing records from primary storage. [2025-10-13T22:43:00.308949] [DEBUG] [LOCAL ] SST: Loaded 11615 existing records from primary storage. [2025-10-13T22:43:00.293688] [INFO ] [MAIN ] SSL: Loaded 41409 primary data records. [2025-10-13T22:43:00.310971] [INFO ] [MAIN ] SST: Loaded 11615 primary data records. [2025-10-13T22:43:01.097042] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:01.099033] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22581 primary records. [2025-10-13T22:43:01.099391] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-13T22:43:01.119939] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-13T22:43:01.120357] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-13T22:43:01.122807] [INFO ] [MAIN ] Derivative Progress: 1459/1810 symbols completed. SSD took 1.1s. Estimated remaining: 2m 15s. Rate: 156.2 symbols/min [2025-10-13T22:43:01.123338] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:01.137478] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:01.140967] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11615 primary records. [2025-10-13T22:43:01.141225] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-13T22:43:01.165440] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:01.169997] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41409 primary records. [2025-10-13T22:43:01.170555] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-13T22:43:01.170434] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-13T22:43:01.170814] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-13T22:43:01.181183] [INFO ] [MAIN ] Derivative Progress: 1460/1810 symbols completed. SST took 1.1s. Estimated remaining: 2m 14s. Rate: 156.3 symbols/min [2025-10-13T22:43:01.189677] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:01.206109] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-13T22:43:01.206237] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-13T22:43:01.204825] [DEBUG] [LOCAL ] SSTK: Loaded 25366 existing records from primary storage. [2025-10-13T22:43:01.209218] [INFO ] [MAIN ] Derivative Progress: 1461/1810 symbols completed. SSL took 1.2s. Estimated remaining: 2m 14s. Rate: 156.4 symbols/min [2025-10-13T22:43:01.209380] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:01.209483] [INFO ] [MAIN ] SSTK: Loaded 25366 primary data records. [2025-10-13T22:43:01.549984] [DEBUG] [LOCAL ] ST: Loaded 49924 existing records from primary storage. [2025-10-13T22:43:01.550979] [INFO ] [MAIN ] ST: Loaded 49924 primary data records. [2025-10-13T22:43:01.675198] [DEBUG] [LOCAL ] STAG: Loaded 50096 existing records from primary storage. [2025-10-13T22:43:01.692782] [INFO ] [MAIN ] STAG: Loaded 50096 primary data records. [2025-10-13T22:43:02.051320] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:02.070690] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25366 primary records. [2025-10-13T22:43:02.091911] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-13T22:43:02.228192] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-13T22:43:02.228895] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-13T22:43:02.231744] [INFO ] [MAIN ] Derivative Progress: 1462/1810 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 14s. Rate: 156.2 symbols/min [2025-10-13T22:43:02.232457] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:02.268966] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:02.269764] [DEBUG] [LOCAL ] STC: Loaded 17355 existing records from primary storage. [2025-10-13T22:43:02.270893] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49924 primary records. [2025-10-13T22:43:02.271547] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-13T22:43:02.271639] [INFO ] [MAIN ] STC: Loaded 17355 primary data records. [2025-10-13T22:43:02.395225] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:02.394810] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-13T22:43:02.401472] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50096 primary records. [2025-10-13T22:43:02.400729] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-13T22:43:02.418393] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-13T22:43:02.421309] [INFO ] [MAIN ] Derivative Progress: 1463/1810 symbols completed. ST took 1.2s. Estimated remaining: 2m 13s. Rate: 156.2 symbols/min [2025-10-13T22:43:02.422778] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:02.485918] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-13T22:43:02.494974] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-13T22:43:02.497568] [INFO ] [MAIN ] Derivative Progress: 1464/1810 symbols completed. STAG took 1.3s. Estimated remaining: 2m 13s. Rate: 156.3 symbols/min [2025-10-13T22:43:02.498931] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:02.690987] [DEBUG] [LOCAL ] STEL: Loaded 22778 existing records from primary storage. [2025-10-13T22:43:02.691222] [INFO ] [MAIN ] STEL: Loaded 22778 primary data records. [2025-10-13T22:43:02.803712] [DEBUG] [LOCAL ] STE: Loaded 35419 existing records from primary storage. [2025-10-13T22:43:02.807341] [INFO ] [MAIN ] STE: Loaded 35419 primary data records. [2025-10-13T22:43:03.103098] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:03.110020] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17355 primary records. [2025-10-13T22:43:03.124891] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-13T22:43:03.340380] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-13T22:43:03.340627] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-13T22:43:03.343184] [INFO ] [MAIN ] Derivative Progress: 1465/1810 symbols completed. STC took 1.1s. Estimated remaining: 2m 13s. Rate: 156.2 symbols/min [2025-10-13T22:43:03.343514] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:03.371389] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:03.381996] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22778 primary records. [2025-10-13T22:43:03.382252] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-13T22:43:03.410670] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:03.421953] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35419 primary records. [2025-10-13T22:43:03.422060] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-13T22:43:03.424118] [DEBUG] [LOCAL ] STEM: Loaded 38838 existing records from primary storage. [2025-10-13T22:43:03.432761] [INFO ] [MAIN ] STEM: Loaded 38838 primary data records. [2025-10-13T22:43:03.502684] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-13T22:43:03.508524] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-13T22:43:03.517038] [INFO ] [MAIN ] Derivative Progress: 1466/1810 symbols completed. STEL took 1.0s. Estimated remaining: 2m 12s. Rate: 156.2 symbols/min [2025-10-13T22:43:03.518577] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-13T22:43:03.517203] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:03.523889] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-13T22:43:03.537630] [INFO ] [MAIN ] Derivative Progress: 1467/1810 symbols completed. STE took 1.1s. Estimated remaining: 2m 12s. Rate: 156.3 symbols/min [2025-10-13T22:43:03.548911] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:03.771924] [DEBUG] [LOCAL ] STK: Loaded 9696 existing records from primary storage. [2025-10-13T22:43:03.773581] [INFO ] [MAIN ] STK: Loaded 9696 primary data records. [2025-10-13T22:43:03.773031] [DEBUG] [LOCAL ] STEW: Loaded 15943 existing records from primary storage. [2025-10-13T22:43:03.810906] [INFO ] [MAIN ] STEW: Loaded 15943 primary data records. [2025-10-13T22:43:04.460074] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:04.461878] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 38838 primary records. [2025-10-13T22:43:04.461983] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-13T22:43:04.480129] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-13T22:43:04.480487] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-13T22:43:04.482777] [INFO ] [MAIN ] Derivative Progress: 1468/1810 symbols completed. STEM took 1.1s. Estimated remaining: 2m 11s. Rate: 156.2 symbols/min [2025-10-13T22:43:04.504286] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:04.505049] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9696 primary records. [2025-10-13T22:43:04.505167] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-13T22:43:04.517323] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:04.518457] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 15943 primary records. [2025-10-13T22:43:04.518701] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-13T22:43:04.545082] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-13T22:43:04.548300] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-13T22:43:04.551725] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-13T22:43:04.551859] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-13T22:43:04.551604] [INFO ] [MAIN ] Derivative Progress: 1469/1810 symbols completed. STK took 1.0s. Estimated remaining: 2m 11s. Rate: 156.3 symbols/min [2025-10-13T22:43:04.554548] [INFO ] [MAIN ] Derivative Progress: 1470/1810 symbols completed. STEW took 1.0s. Estimated remaining: 2m 10s. Rate: 156.4 symbols/min [2025-10-13T22:43:04.555134] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:04.555080] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:04.555029] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:04.580472] [DEBUG] [LOCAL ] STN: Loaded 22817 existing records from primary storage. [2025-10-13T22:43:04.580626] [INFO ] [MAIN ] STN: Loaded 22817 primary data records. [2025-10-13T22:43:04.838025] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-13T22:43:04.883862] [INFO ] [MAIN ] STLA: Loaded 53555 primary data records. [2025-10-13T22:43:05.028787] [DEBUG] [LOCAL ] STM: Loaded 53574 existing records from primary storage. [2025-10-13T22:43:05.047794] [INFO ] [MAIN ] STM: Loaded 53574 primary data records. [2025-10-13T22:43:05.575373] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:05.577018] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22817 primary records. [2025-10-13T22:43:05.577343] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-13T22:43:05.597978] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-13T22:43:05.598342] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-13T22:43:05.600769] [INFO ] [MAIN ] Derivative Progress: 1471/1810 symbols completed. STN took 1.0s. Estimated remaining: 2m 10s. Rate: 156.2 symbols/min [2025-10-13T22:43:05.601129] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:05.620941] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:05.622036] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53555 primary records. [2025-10-13T22:43:05.622325] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-13T22:43:05.642498] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-13T22:43:05.651471] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-13T22:43:05.653549] [INFO ] [MAIN ] Derivative Progress: 1472/1810 symbols completed. STLA took 1.1s. Estimated remaining: 2m 10s. Rate: 156.3 symbols/min [2025-10-13T22:43:05.659202] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:05.659690] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:05.661091] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53574 primary records. [2025-10-13T22:43:05.661267] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-13T22:43:05.694058] [DEBUG] [LOCAL ] STRV: Loaded 11250 existing records from primary storage. [2025-10-13T22:43:05.695347] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-13T22:43:05.694767] [INFO ] [MAIN ] STRV: Loaded 11250 primary data records. [2025-10-13T22:43:05.695490] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-13T22:43:05.703365] [INFO ] [MAIN ] Derivative Progress: 1473/1810 symbols completed. STM took 1.1s. Estimated remaining: 2m 9s. Rate: 156.4 symbols/min [2025-10-13T22:43:05.754222] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:05.789590] [DEBUG] [LOCAL ] STNG: Loaded 43721 existing records from primary storage. [2025-10-13T22:43:05.806412] [INFO ] [MAIN ] STNG: Loaded 43721 primary data records. [2025-10-13T22:43:06.375180] [DEBUG] [LOCAL ] STT: Loaded 51043 existing records from primary storage. [2025-10-13T22:43:06.377542] [INFO ] [MAIN ] STT: Loaded 51043 primary data records. [2025-10-13T22:43:06.619323] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:43:06.629266] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11250 primary records. [2025-10-13T22:43:06.629368] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-13T22:43:06.765672] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:06.766748] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-13T22:43:06.767007] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-13T22:43:06.769150] [INFO ] [MAIN ] Derivative Progress: 1474/1810 symbols completed. STRV took 1.1s. Estimated remaining: 2m 9s. Rate: 156.2 symbols/min [2025-10-13T22:43:06.771285] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:06.770435] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43721 primary records. [2025-10-13T22:43:06.772112] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-13T22:43:06.789022] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-13T22:43:06.789210] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-13T22:43:06.791752] [INFO ] [MAIN ] Derivative Progress: 1475/1810 symbols completed. STNG took 1.2s. Estimated remaining: 2m 9s. Rate: 156.3 symbols/min [2025-10-13T22:43:06.792028] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:06.817809] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:06.818770] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51043 primary records. [2025-10-13T22:43:06.818881] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-13T22:43:06.835526] [DEBUG] [LOCAL ] STVN: Loaded 26679 existing records from primary storage. [2025-10-13T22:43:06.839171] [INFO ] [MAIN ] STVN: Loaded 26679 primary data records. [2025-10-13T22:43:06.843329] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-13T22:43:06.855119] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-13T22:43:06.867103] [INFO ] [MAIN ] Derivative Progress: 1476/1810 symbols completed. STT took 1.1s. Estimated remaining: 2m 8s. Rate: 156.4 symbols/min [2025-10-13T22:43:06.877351] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:06.951789] [DEBUG] [LOCAL ] STXD: Loaded 1210 existing records from primary storage. [2025-10-13T22:43:06.966922] [INFO ] [MAIN ] STXD: Loaded 1210 primary data records. [2025-10-13T22:43:07.298954] [DEBUG] [LOCAL ] STWD: Loaded 51981 existing records from primary storage. [2025-10-13T22:43:07.326804] [INFO ] [MAIN ] STWD: Loaded 51981 primary data records. [2025-10-13T22:43:07.796942] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:07.811751] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26679 primary records. [2025-10-13T22:43:07.812109] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-13T22:43:07.812055] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:07.813331] [INFO ] [MAIN ] STXD: Generated 1794 derivative records from 1210 primary records. [2025-10-13T22:43:07.813489] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-13T22:43:07.838681] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-13T22:43:07.840721] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-13T22:43:07.842878] [INFO ] [MAIN ] Derivative Progress: 1477/1810 symbols completed. STVN took 1.1s. Estimated remaining: 2m 8s. Rate: 156.2 symbols/min [2025-10-13T22:43:07.844126] [DEBUG] [LOCAL ] STXD: Derivative data saved (1794 records). [2025-10-13T22:43:07.844350] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:07.845102] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-13T22:43:07.847444] [INFO ] [MAIN ] Derivative Progress: 1478/1810 symbols completed. STXD took 1.0s. Estimated remaining: 2m 7s. Rate: 156.3 symbols/min [2025-10-13T22:43:07.847890] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:07.866991] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:07.866704] [DEBUG] [LOCAL ] STXE: Loaded 2080 existing records from primary storage. [2025-10-13T22:43:07.867171] [INFO ] [MAIN ] STXE: Loaded 2080 primary data records. [2025-10-13T22:43:07.868592] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51981 primary records. [2025-10-13T22:43:07.874040] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-13T22:43:07.883291] [DEBUG] [LOCAL ] STXG: Loaded 2438 existing records from primary storage. [2025-10-13T22:43:07.894411] [INFO ] [MAIN ] STXG: Loaded 2438 primary data records. [2025-10-13T22:43:08.067402] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-13T22:43:08.077848] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-13T22:43:08.109517] [INFO ] [MAIN ] Derivative Progress: 1479/1810 symbols completed. STWD took 1.3s. Estimated remaining: 2m 7s. Rate: 156.4 symbols/min [2025-10-13T22:43:08.123400] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:08.476160] [DEBUG] [LOCAL ] STXK: Loaded 1524 existing records from primary storage. [2025-10-13T22:43:08.518672] [INFO ] [MAIN ] STXK: Loaded 1524 primary data records. [2025-10-13T22:43:08.843788] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-13T22:43:08.845402] [INFO ] [MAIN ] STXE: Generated 1791 derivative records from 2080 primary records. [2025-10-13T22:43:08.845609] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-13T22:43:08.878006] [DEBUG] [LOCAL ] STXE: Derivative data saved (1791 records). [2025-10-13T22:43:08.877821] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:43:08.878236] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-13T22:43:08.880662] [INFO ] [MAIN ] Derivative Progress: 1480/1810 symbols completed. STXE took 1.0s. Estimated remaining: 2m 7s. Rate: 156.2 symbols/min [2025-10-13T22:43:08.880863] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:08.881735] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2438 primary records. [2025-10-13T22:43:08.882083] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-13T22:43:08.902063] [DEBUG] [LOCAL ] STXT: Loaded 2489 existing records from primary storage. [2025-10-13T22:43:08.903457] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-13T22:43:08.903606] [INFO ] [MAIN ] STXT: Loaded 2489 primary data records. [2025-10-13T22:43:08.903719] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-13T22:43:08.930234] [INFO ] [MAIN ] Derivative Progress: 1481/1810 symbols completed. STXG took 1.1s. Estimated remaining: 2m 6s. Rate: 156.3 symbols/min [2025-10-13T22:43:08.937704] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:08.975196] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:43:08.990122] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1524 primary records. [2025-10-13T22:43:09.002708] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-13T22:43:09.068980] [DEBUG] [LOCAL ] STXV: Loaded 1532 existing records from primary storage. [2025-10-13T22:43:09.117581] [INFO ] [MAIN ] STXV: Loaded 1532 primary data records. [2025-10-13T22:43:09.271130] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-13T22:43:09.303911] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-13T22:43:09.335373] [INFO ] [MAIN ] Derivative Progress: 1482/1810 symbols completed. STXK took 1.2s. Estimated remaining: 2m 6s. Rate: 156.3 symbols/min [2025-10-13T22:43:09.347273] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:09.568447] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:43:09.569217] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2489 primary records. [2025-10-13T22:43:09.569439] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-13T22:43:09.598052] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-10-13T22:43:09.598256] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-13T22:43:09.601330] [INFO ] [MAIN ] Derivative Progress: 1483/1810 symbols completed. STXT took 0.7s. Estimated remaining: 2m 5s. Rate: 156.4 symbols/min [2025-10-13T22:43:09.618836] [DEBUG] [LOCAL ] STZ: Loaded 52386 existing records from primary storage. [2025-10-13T22:43:09.631277] [INFO ] [MAIN ] STZ: Loaded 52386 primary data records. [2025-10-13T22:43:09.631210] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:09.632089] [INFO ] [MAIN ] STXV: Generated 1794 derivative records from 1532 primary records. [2025-10-13T22:43:09.675318] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-13T22:43:09.752707] [DEBUG] [LOCAL ] STXV: Derivative data saved (1794 records). [2025-10-13T22:43:09.757913] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-13T22:43:09.770589] [INFO ] [MAIN ] Derivative Progress: 1484/1810 symbols completed. STXV took 0.8s. Estimated remaining: 2m 5s. Rate: 156.4 symbols/min [2025-10-13T22:43:09.957674] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:09.958343] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52386 primary records. [2025-10-13T22:43:09.958405] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-13T22:43:09.974179] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-13T22:43:09.974246] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-13T22:43:09.976502] [INFO ] [MAIN ] Derivative Progress: 1485/1810 symbols completed. STZ took 0.6s. Estimated remaining: 2m 5s. Rate: 156.5 symbols/min [2025-10-13T22:43:09.977051] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:09.977144] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:09.977251] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:10.035284] [DEBUG] [LOCAL ] SUN: Loaded 38142 existing records from primary storage. [2025-10-13T22:43:10.035560] [INFO ] [MAIN ] SUN: Loaded 38142 primary data records. [2025-10-13T22:43:10.164182] [DEBUG] [LOCAL ] SUI: Loaded 41951 existing records from primary storage. [2025-10-13T22:43:10.185709] [DEBUG] [LOCAL ] SU: Loaded 53428 existing records from primary storage. [2025-10-13T22:43:10.184994] [INFO ] [MAIN ] SUI: Loaded 41951 primary data records. [2025-10-13T22:43:10.190931] [INFO ] [MAIN ] SU: Loaded 53428 primary data records. [2025-10-13T22:43:11.060364] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:11.061229] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:11.062339] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41951 primary records. [2025-10-13T22:43:11.063188] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 38142 primary records. [2025-10-13T22:43:11.063479] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-13T22:43:11.063417] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-13T22:43:11.116584] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-13T22:43:11.117824] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-13T22:43:11.114323] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:11.116971] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-13T22:43:11.119930] [INFO ] [MAIN ] Derivative Progress: 1486/1810 symbols completed. SUN took 1.1s. Estimated remaining: 2m 4s. Rate: 156.3 symbols/min [2025-10-13T22:43:11.121372] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:11.121539] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-13T22:43:11.121246] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53428 primary records. [2025-10-13T22:43:11.122101] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-13T22:43:11.124699] [INFO ] [MAIN ] Derivative Progress: 1487/1810 symbols completed. SUI took 1.1s. Estimated remaining: 2m 4s. Rate: 156.4 symbols/min [2025-10-13T22:43:11.126569] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:11.142377] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-13T22:43:11.142827] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-13T22:43:11.145571] [INFO ] [MAIN ] Derivative Progress: 1488/1810 symbols completed. SU took 1.2s. Estimated remaining: 2m 3s. Rate: 156.5 symbols/min [2025-10-13T22:43:11.145777] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:11.252226] [DEBUG] [LOCAL ] SUZ: Loaded 45687 existing records from primary storage. [2025-10-13T22:43:11.252596] [INFO ] [MAIN ] SUZ: Loaded 45687 primary data records. [2025-10-13T22:43:11.253634] [DEBUG] [LOCAL ] SUPV: Loaded 47691 existing records from primary storage. [2025-10-13T22:43:11.259890] [DEBUG] [LOCAL ] SVV: Loaded 40109 existing records from primary storage. [2025-10-13T22:43:11.268284] [INFO ] [MAIN ] SUPV: Loaded 47691 primary data records. [2025-10-13T22:43:11.268179] [INFO ] [MAIN ] SVV: Loaded 40109 primary data records. [2025-10-13T22:43:12.500923] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:12.500670] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:12.501714] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45687 primary records. [2025-10-13T22:43:12.502315] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47691 primary records. [2025-10-13T22:43:12.502411] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-13T22:43:12.502543] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-13T22:43:12.502817] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:12.503458] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 40109 primary records. [2025-10-13T22:43:12.504660] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-13T22:43:12.528184] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-13T22:43:12.537813] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-13T22:43:12.540116] [INFO ] [MAIN ] Derivative Progress: 1489/1810 symbols completed. SUZ took 1.4s. Estimated remaining: 2m 3s. Rate: 156.2 symbols/min [2025-10-13T22:43:12.541083] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:12.552348] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-13T22:43:12.552605] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-13T22:43:12.552800] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-13T22:43:12.552723] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-13T22:43:12.555111] [INFO ] [MAIN ] Derivative Progress: 1490/1810 symbols completed. SVV took 1.4s. Estimated remaining: 2m 3s. Rate: 156.3 symbols/min [2025-10-13T22:43:12.557810] [INFO ] [MAIN ] Derivative Progress: 1491/1810 symbols completed. SUPV took 1.4s. Estimated remaining: 2m 2s. Rate: 156.4 symbols/min [2025-10-13T22:43:12.557714] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:12.558304] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:12.601290] [DEBUG] [LOCAL ] SWX: Loaded 31094 existing records from primary storage. [2025-10-13T22:43:12.613579] [INFO ] [MAIN ] SWX: Loaded 31094 primary data records. [2025-10-13T22:43:12.732389] [DEBUG] [LOCAL ] SW: Loaded 53184 existing records from primary storage. [2025-10-13T22:43:12.747762] [INFO ] [MAIN ] SW: Loaded 53184 primary data records. [2025-10-13T22:43:12.817114] [DEBUG] [LOCAL ] SWK: Loaded 52484 existing records from primary storage. [2025-10-13T22:43:12.867869] [INFO ] [MAIN ] SWK: Loaded 52484 primary data records. [2025-10-13T22:43:13.585766] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:13.586749] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31094 primary records. [2025-10-13T22:43:13.587236] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-13T22:43:13.617698] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-13T22:43:13.622474] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-13T22:43:13.625403] [INFO ] [MAIN ] Derivative Progress: 1492/1810 symbols completed. SWX took 1.1s. Estimated remaining: 2m 2s. Rate: 156.2 symbols/min [2025-10-13T22:43:13.625632] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:13.626213] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:13.627780] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53184 primary records. [2025-10-13T22:43:13.628352] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-13T22:43:13.653930] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:13.657281] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52484 primary records. [2025-10-13T22:43:13.661740] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-13T22:43:13.673966] [DEBUG] [LOCAL ] SWZ: Loaded 6072 existing records from primary storage. [2025-10-13T22:43:13.663549] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-13T22:43:13.675260] [INFO ] [MAIN ] SWZ: Loaded 6072 primary data records. [2025-10-13T22:43:13.681964] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-13T22:43:13.681872] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-13T22:43:13.702310] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-13T22:43:13.714481] [INFO ] [MAIN ] Derivative Progress: 1493/1810 symbols completed. SW took 1.2s. Estimated remaining: 2m 2s. Rate: 156.3 symbols/min [2025-10-13T22:43:13.755168] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:13.760399] [INFO ] [MAIN ] Derivative Progress: 1494/1810 symbols completed. SWK took 1.2s. Estimated remaining: 2m 1s. Rate: 156.4 symbols/min [2025-10-13T22:43:13.766388] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:13.997134] [DEBUG] [LOCAL ] SXI: Loaded 11865 existing records from primary storage. [2025-10-13T22:43:13.997748] [INFO ] [MAIN ] SXI: Loaded 11865 primary data records. [2025-10-13T22:43:14.106872] [DEBUG] [LOCAL ] SXC: Loaded 41622 existing records from primary storage. [2025-10-13T22:43:14.124732] [INFO ] [MAIN ] SXC: Loaded 41622 primary data records. [2025-10-13T22:43:14.678856] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:14.679983] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6072 primary records. [2025-10-13T22:43:14.680152] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-13T22:43:14.695137] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-13T22:43:14.695509] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-13T22:43:14.697589] [INFO ] [MAIN ] Derivative Progress: 1495/1810 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 1s. Rate: 156.2 symbols/min [2025-10-13T22:43:14.697937] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:14.716230] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:14.717003] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11865 primary records. [2025-10-13T22:43:14.717274] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-13T22:43:14.767230] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-13T22:43:14.765993] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:14.767470] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-13T22:43:14.769819] [INFO ] [MAIN ] Derivative Progress: 1496/1810 symbols completed. SXI took 1.0s. Estimated remaining: 2m 1s. Rate: 156.3 symbols/min [2025-10-13T22:43:14.770623] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41622 primary records. [2025-10-13T22:43:14.770839] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:14.771527] [DEBUG] [LOCAL ] SXT: Loaded 29919 existing records from primary storage. [2025-10-13T22:43:14.771602] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-13T22:43:14.771866] [INFO ] [MAIN ] SXT: Loaded 29919 primary data records. [2025-10-13T22:43:14.856290] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-13T22:43:14.885889] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-13T22:43:14.900037] [INFO ] [MAIN ] Derivative Progress: 1497/1810 symbols completed. SXC took 1.1s. Estimated remaining: 2m 0s. Rate: 156.4 symbols/min [2025-10-13T22:43:14.916493] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:15.144175] [DEBUG] [LOCAL ] SYF: Loaded 53453 existing records from primary storage. [2025-10-13T22:43:15.144816] [INFO ] [MAIN ] SYF: Loaded 53453 primary data records. [2025-10-13T22:43:15.327620] [DEBUG] [LOCAL ] SYK: Loaded 46939 existing records from primary storage. [2025-10-13T22:43:15.357303] [INFO ] [MAIN ] SYK: Loaded 46939 primary data records. [2025-10-13T22:43:15.496533] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:15.524805] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29919 primary records. [2025-10-13T22:43:15.545144] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-13T22:43:15.687188] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-13T22:43:15.802326] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-13T22:43:15.805302] [INFO ] [MAIN ] Derivative Progress: 1498/1810 symbols completed. SXT took 1.1s. Estimated remaining: 1m 60s. Rate: 156.2 symbols/min [2025-10-13T22:43:15.824839] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:15.825594] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53453 primary records. [2025-10-13T22:43:15.825933] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-13T22:43:15.843433] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-13T22:43:15.843752] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-13T22:43:15.845997] [INFO ] [MAIN ] Derivative Progress: 1499/1810 symbols completed. SYF took 1.1s. Estimated remaining: 1m 59s. Rate: 156.3 symbols/min [2025-10-13T22:43:15.863269] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:15.863986] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46939 primary records. [2025-10-13T22:43:15.864048] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-13T22:43:15.879051] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-13T22:43:15.879114] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-13T22:43:15.881394] [INFO ] [MAIN ] Derivative Progress: 1500/1810 symbols completed. SYK took 1.0s. Estimated remaining: 1m 59s. Rate: 156.4 symbols/min [2025-10-13T22:43:15.881816] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:15.881909] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:15.882213] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:15.961056] [DEBUG] [LOCAL ] TAC: Loaded 42894 existing records from primary storage. [2025-10-13T22:43:15.962839] [INFO ] [MAIN ] TAC: Loaded 42894 primary data records. [2025-10-13T22:43:15.963895] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-13T22:43:15.985072] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-13T22:43:16.127155] [DEBUG] [LOCAL ] SYY: Loaded 53240 existing records from primary storage. [2025-10-13T22:43:16.155084] [INFO ] [MAIN ] SYY: Loaded 53240 primary data records. [2025-10-13T22:43:16.924771] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:16.939686] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42894 primary records. [2025-10-13T22:43:16.940207] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:16.940383] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-13T22:43:16.941306] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-13T22:43:16.941497] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-13T22:43:16.955554] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:16.976098] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53240 primary records. [2025-10-13T22:43:16.977266] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-13T22:43:17.006202] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-13T22:43:17.006586] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-13T22:43:17.009355] [INFO ] [MAIN ] Derivative Progress: 1501/1810 symbols completed. SYY took 1.1s. Estimated remaining: 1m 59s. Rate: 156.2 symbols/min [2025-10-13T22:43:17.005188] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-13T22:43:17.010397] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-13T22:43:17.010310] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:17.012858] [INFO ] [MAIN ] Derivative Progress: 1502/1810 symbols completed. TAC took 1.1s. Estimated remaining: 1m 58s. Rate: 156.3 symbols/min [2025-10-13T22:43:17.013607] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:17.015848] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-13T22:43:17.015967] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-13T22:43:17.018946] [INFO ] [MAIN ] Derivative Progress: 1503/1810 symbols completed. T took 1.1s. Estimated remaining: 1m 58s. Rate: 156.4 symbols/min [2025-10-13T22:43:17.019233] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:17.093132] [DEBUG] [LOCAL ] TAK: Loaded 50073 existing records from primary storage. [2025-10-13T22:43:17.093433] [INFO ] [MAIN ] TAK: Loaded 50073 primary data records. [2025-10-13T22:43:17.217093] [DEBUG] [LOCAL ] TALO: Loaded 50947 existing records from primary storage. [2025-10-13T22:43:17.225743] [INFO ] [MAIN ] TALO: Loaded 50947 primary data records. [2025-10-13T22:43:17.240689] [DEBUG] [LOCAL ] TAL: Loaded 51801 existing records from primary storage. [2025-10-13T22:43:17.319601] [INFO ] [MAIN ] TAL: Loaded 51801 primary data records. [2025-10-13T22:43:18.066753] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:18.068165] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50073 primary records. [2025-10-13T22:43:18.068400] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-13T22:43:18.089311] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-13T22:43:18.102685] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-13T22:43:18.105337] [INFO ] [MAIN ] Derivative Progress: 1504/1810 symbols completed. TAK took 1.1s. Estimated remaining: 1m 58s. Rate: 156.2 symbols/min [2025-10-13T22:43:18.103529] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:18.106516] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50947 primary records. [2025-10-13T22:43:18.105726] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:18.107282] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-13T22:43:18.138030] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:18.139732] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51801 primary records. [2025-10-13T22:43:18.140757] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-13T22:43:18.151862] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-13T22:43:18.152120] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-13T22:43:18.162449] [INFO ] [MAIN ] Derivative Progress: 1505/1810 symbols completed. TALO took 1.1s. Estimated remaining: 1m 57s. Rate: 156.3 symbols/min [2025-10-13T22:43:18.163903] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-13T22:43:18.164375] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:18.164710] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-13T22:43:18.167777] [INFO ] [MAIN ] Derivative Progress: 1506/1810 symbols completed. TAL took 1.2s. Estimated remaining: 1m 57s. Rate: 156.4 symbols/min [2025-10-13T22:43:18.168115] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:18.196005] [DEBUG] [LOCAL ] TBB: Loaded 11602 existing records from primary storage. [2025-10-13T22:43:18.196285] [INFO ] [MAIN ] TBB: Loaded 11602 primary data records. [2025-10-13T22:43:18.358136] [DEBUG] [LOCAL ] TAP: Loaded 52947 existing records from primary storage. [2025-10-13T22:43:18.398427] [INFO ] [MAIN ] TAP: Loaded 52947 primary data records. [2025-10-13T22:43:18.374844] [DEBUG] [LOCAL ] TBBB: Loaded 35826 existing records from primary storage. [2025-10-13T22:43:18.427030] [INFO ] [MAIN ] TBBB: Loaded 35826 primary data records. [2025-10-13T22:43:19.263495] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:19.265450] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11602 primary records. [2025-10-13T22:43:19.265784] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-13T22:43:19.287872] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-13T22:43:19.291191] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-13T22:43:19.294955] [INFO ] [MAIN ] Derivative Progress: 1507/1810 symbols completed. TBB took 1.1s. Estimated remaining: 1m 56s. Rate: 156.2 symbols/min [2025-10-13T22:43:19.295390] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:19.311219] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:19.312113] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52947 primary records. [2025-10-13T22:43:19.312212] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-13T22:43:19.331384] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-13T22:43:19.339485] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-13T22:43:19.343259] [INFO ] [MAIN ] Derivative Progress: 1508/1810 symbols completed. TAP took 1.2s. Estimated remaining: 1m 56s. Rate: 156.3 symbols/min [2025-10-13T22:43:19.343773] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:19.358693] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:19.359727] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35826 primary records. [2025-10-13T22:43:19.359926] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-13T22:43:19.386962] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-13T22:43:19.385381] [DEBUG] [LOCAL ] TBI: Loaded 22509 existing records from primary storage. [2025-10-13T22:43:19.387196] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-13T22:43:19.391091] [INFO ] [MAIN ] TBI: Loaded 22509 primary data records. [2025-10-13T22:43:19.394421] [INFO ] [MAIN ] Derivative Progress: 1509/1810 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 55s. Rate: 156.4 symbols/min [2025-10-13T22:43:19.395061] [DEBUG] [LOCAL ] TBN: Loaded 3906 existing records from primary storage. [2025-10-13T22:43:19.394803] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:19.402283] [INFO ] [MAIN ] TBN: Loaded 3906 primary data records. [2025-10-13T22:43:19.632466] [DEBUG] [LOCAL ] TCBX: Loaded 10156 existing records from primary storage. [2025-10-13T22:43:19.632806] [INFO ] [MAIN ] TCBX: Loaded 10156 primary data records. [2025-10-13T22:43:20.433697] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:20.451802] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 3906 primary records. [2025-10-13T22:43:20.450831] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:20.453060] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22509 primary records. [2025-10-13T22:43:20.453265] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-13T22:43:20.461619] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-13T22:43:20.470236] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:20.472071] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10156 primary records. [2025-10-13T22:43:20.477839] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-13T22:43:20.495010] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-10-13T22:43:20.498712] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-13T22:43:20.501944] [INFO ] [MAIN ] Derivative Progress: 1510/1810 symbols completed. TBN took 1.2s. Estimated remaining: 1m 55s. Rate: 156.2 symbols/min [2025-10-13T22:43:20.503130] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:20.524234] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-13T22:43:20.526488] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-13T22:43:20.526746] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-13T22:43:20.526578] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-13T22:43:20.529335] [INFO ] [MAIN ] Derivative Progress: 1511/1810 symbols completed. TCBX took 1.1s. Estimated remaining: 1m 55s. Rate: 156.3 symbols/min [2025-10-13T22:43:20.532374] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:20.532625] [INFO ] [MAIN ] Derivative Progress: 1512/1810 symbols completed. TBI took 1.2s. Estimated remaining: 1m 54s. Rate: 156.4 symbols/min [2025-10-13T22:43:20.533150] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:20.543037] [DEBUG] [LOCAL ] TDF: Loaded 6364 existing records from primary storage. [2025-10-13T22:43:20.543401] [INFO ] [MAIN ] TDF: Loaded 6364 primary data records. [2025-10-13T22:43:20.978679] [DEBUG] [LOCAL ] TD: Loaded 52324 existing records from primary storage. [2025-10-13T22:43:20.979000] [INFO ] [MAIN ] TD: Loaded 52324 primary data records. [2025-10-13T22:43:20.994189] [DEBUG] [LOCAL ] TDC: Loaded 46559 existing records from primary storage. [2025-10-13T22:43:21.022683] [INFO ] [MAIN ] TDC: Loaded 46559 primary data records. [2025-10-13T22:43:21.647045] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:21.649238] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6364 primary records. [2025-10-13T22:43:21.650246] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-13T22:43:21.668833] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-13T22:43:21.669265] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-13T22:43:21.672754] [INFO ] [MAIN ] Derivative Progress: 1513/1810 symbols completed. TDF took 1.1s. Estimated remaining: 1m 54s. Rate: 156.2 symbols/min [2025-10-13T22:43:21.690562] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:21.691975] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52324 primary records. [2025-10-13T22:43:21.692159] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-13T22:43:21.715503] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:21.719065] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46559 primary records. [2025-10-13T22:43:21.721870] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-13T22:43:21.723899] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-13T22:43:21.724149] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-13T22:43:21.733685] [INFO ] [MAIN ] Derivative Progress: 1514/1810 symbols completed. TD took 1.2s. Estimated remaining: 1m 54s. Rate: 156.3 symbols/min [2025-10-13T22:43:21.743320] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-13T22:43:21.743520] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-13T22:43:21.746934] [INFO ] [MAIN ] Derivative Progress: 1515/1810 symbols completed. TDC took 1.2s. Estimated remaining: 1m 53s. Rate: 156.4 symbols/min [2025-10-13T22:43:21.747520] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:21.747430] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:21.747904] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:21.791165] [DEBUG] [LOCAL ] TDG: Loaded 22020 existing records from primary storage. [2025-10-13T22:43:21.807940] [INFO ] [MAIN ] TDG: Loaded 22020 primary data records. [2025-10-13T22:43:21.962585] [DEBUG] [LOCAL ] TDS: Loaded 42515 existing records from primary storage. [2025-10-13T22:43:21.979872] [DEBUG] [LOCAL ] TDOC: Loaded 53359 existing records from primary storage. [2025-10-13T22:43:21.994372] [INFO ] [MAIN ] TDS: Loaded 42515 primary data records. [2025-10-13T22:43:21.994825] [INFO ] [MAIN ] TDOC: Loaded 53359 primary data records. [2025-10-13T22:43:22.916485] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:22.919100] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22020 primary records. [2025-10-13T22:43:22.919510] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-13T22:43:22.941469] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-13T22:43:22.942136] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-13T22:43:22.944312] [INFO ] [MAIN ] Derivative Progress: 1516/1810 symbols completed. TDG took 1.2s. Estimated remaining: 1m 53s. Rate: 156.2 symbols/min [2025-10-13T22:43:22.944787] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:22.960449] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:22.961561] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53359 primary records. [2025-10-13T22:43:22.961786] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-13T22:43:22.983013] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-13T22:43:22.983437] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-13T22:43:22.986691] [INFO ] [MAIN ] Derivative Progress: 1517/1810 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 52s. Rate: 156.3 symbols/min [2025-10-13T22:43:23.000369] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:23.003589] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:23.005596] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42515 primary records. [2025-10-13T22:43:23.005959] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-13T22:43:23.041006] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-13T22:43:23.041337] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-13T22:43:23.045153] [INFO ] [MAIN ] Derivative Progress: 1518/1810 symbols completed. TDS took 1.3s. Estimated remaining: 1m 52s. Rate: 156.4 symbols/min [2025-10-13T22:43:23.057748] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:23.060331] [DEBUG] [LOCAL ] TDW: Loaded 45054 existing records from primary storage. [2025-10-13T22:43:23.067536] [INFO ] [MAIN ] TDW: Loaded 45054 primary data records. [2025-10-13T22:43:23.081068] [DEBUG] [LOCAL ] TDY: Loaded 22351 existing records from primary storage. [2025-10-13T22:43:23.094014] [INFO ] [MAIN ] TDY: Loaded 22351 primary data records. [2025-10-13T22:43:23.227192] [DEBUG] [LOCAL ] TEAF: Loaded 7378 existing records from primary storage. [2025-10-13T22:43:23.255586] [INFO ] [MAIN ] TEAF: Loaded 7378 primary data records. [2025-10-13T22:43:24.131841] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:24.134016] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45054 primary records. [2025-10-13T22:43:24.134593] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-13T22:43:24.156891] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:24.164416] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22351 primary records. [2025-10-13T22:43:24.169304] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-13T22:43:24.169200] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-13T22:43:24.170743] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-13T22:43:24.185968] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:24.185569] [INFO ] [MAIN ] Derivative Progress: 1519/1810 symbols completed. TDW took 1.2s. Estimated remaining: 1m 52s. Rate: 156.2 symbols/min [2025-10-13T22:43:24.193597] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:24.196469] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7378 primary records. [2025-10-13T22:43:24.204054] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-13T22:43:24.203814] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-13T22:43:24.204625] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-13T22:43:24.208086] [INFO ] [MAIN ] Derivative Progress: 1520/1810 symbols completed. TDY took 1.2s. Estimated remaining: 1m 51s. Rate: 156.3 symbols/min [2025-10-13T22:43:24.208968] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:24.225390] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-13T22:43:24.225753] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-13T22:43:24.228277] [INFO ] [MAIN ] Derivative Progress: 1521/1810 symbols completed. TEAF took 1.2s. Estimated remaining: 1m 51s. Rate: 156.4 symbols/min [2025-10-13T22:43:24.228551] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:24.259555] [DEBUG] [LOCAL ] TEI: Loaded 21428 existing records from primary storage. [2025-10-13T22:43:24.259733] [INFO ] [MAIN ] TEI: Loaded 21428 primary data records. [2025-10-13T22:43:24.450091] [DEBUG] [LOCAL ] TEF: Loaded 37026 existing records from primary storage. [2025-10-13T22:43:24.443724] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-10-13T22:43:24.496269] [INFO ] [MAIN ] TECK: Loaded 53437 primary data records. [2025-10-13T22:43:24.496452] [INFO ] [MAIN ] TEF: Loaded 37026 primary data records. [2025-10-13T22:43:25.359188] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:25.360898] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21428 primary records. [2025-10-13T22:43:25.361410] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-13T22:43:25.380704] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-13T22:43:25.381177] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-13T22:43:25.383634] [INFO ] [MAIN ] Derivative Progress: 1522/1810 symbols completed. TEI took 1.2s. Estimated remaining: 1m 51s. Rate: 156.1 symbols/min [2025-10-13T22:43:25.384064] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:25.405769] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:25.407520] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53437 primary records. [2025-10-13T22:43:25.407769] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-13T22:43:25.429382] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:25.434355] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37026 primary records. [2025-10-13T22:43:25.435541] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-13T22:43:25.450127] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-13T22:43:25.458001] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-13T22:43:25.462433] [INFO ] [MAIN ] Derivative Progress: 1523/1810 symbols completed. TECK took 1.3s. Estimated remaining: 1m 50s. Rate: 156.2 symbols/min [2025-10-13T22:43:25.459556] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-13T22:43:25.462835] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-13T22:43:25.466876] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:25.466970] [INFO ] [MAIN ] Derivative Progress: 1524/1810 symbols completed. TEF took 1.3s. Estimated remaining: 1m 50s. Rate: 156.3 symbols/min [2025-10-13T22:43:25.468105] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:25.528936] [DEBUG] [LOCAL ] TEL: Loaded 51074 existing records from primary storage. [2025-10-13T22:43:25.529271] [INFO ] [MAIN ] TEL: Loaded 51074 primary data records. [2025-10-13T22:43:25.646923] [DEBUG] [LOCAL ] TEN: Loaded 30551 existing records from primary storage. [2025-10-13T22:43:25.646332] [DEBUG] [LOCAL ] TEO: Loaded 22429 existing records from primary storage. [2025-10-13T22:43:25.650612] [INFO ] [MAIN ] TEN: Loaded 30551 primary data records. [2025-10-13T22:43:25.650694] [INFO ] [MAIN ] TEO: Loaded 22429 primary data records. [2025-10-13T22:43:26.503973] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:26.505368] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51074 primary records. [2025-10-13T22:43:26.505818] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-13T22:43:26.522917] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-13T22:43:26.523491] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-13T22:43:26.525513] [INFO ] [MAIN ] Derivative Progress: 1525/1810 symbols completed. TEL took 1.1s. Estimated remaining: 1m 50s. Rate: 156.1 symbols/min [2025-10-13T22:43:26.526295] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:26.546799] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:26.547800] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22429 primary records. [2025-10-13T22:43:26.547886] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-13T22:43:26.568804] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:26.577771] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30551 primary records. [2025-10-13T22:43:26.577859] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-13T22:43:26.576875] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-13T22:43:26.578381] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-13T22:43:26.581668] [INFO ] [MAIN ] Derivative Progress: 1526/1810 symbols completed. TEO took 1.1s. Estimated remaining: 1m 49s. Rate: 156.2 symbols/min [2025-10-13T22:43:26.590300] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:26.597976] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-13T22:43:26.598168] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-13T22:43:26.600868] [INFO ] [MAIN ] Derivative Progress: 1527/1810 symbols completed. TEN took 1.1s. Estimated remaining: 1m 49s. Rate: 156.3 symbols/min [2025-10-13T22:43:26.601250] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:26.642798] [DEBUG] [LOCAL ] TEVA: Loaded 53628 existing records from primary storage. [2025-10-13T22:43:26.643137] [INFO ] [MAIN ] TEVA: Loaded 53628 primary data records. [2025-10-13T22:43:26.835347] [DEBUG] [LOCAL ] TEX: Loaded 43940 existing records from primary storage. [2025-10-13T22:43:26.842743] [INFO ] [MAIN ] TEX: Loaded 43940 primary data records. [2025-10-13T22:43:27.060253] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-13T22:43:27.076759] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-13T22:43:27.717966] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:27.719913] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53628 primary records. [2025-10-13T22:43:27.720598] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-13T22:43:27.742950] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-13T22:43:27.743385] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-13T22:43:27.746204] [INFO ] [MAIN ] Derivative Progress: 1528/1810 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 48s. Rate: 156.1 symbols/min [2025-10-13T22:43:27.766744] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:27.768213] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43940 primary records. [2025-10-13T22:43:27.768329] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-13T22:43:27.791352] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-13T22:43:27.804750] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-13T22:43:27.807295] [INFO ] [MAIN ] Derivative Progress: 1529/1810 symbols completed. TEX took 1.2s. Estimated remaining: 1m 48s. Rate: 156.2 symbols/min [2025-10-13T22:43:27.805120] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:27.809078] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-13T22:43:27.809192] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-13T22:43:27.825867] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-13T22:43:27.826039] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-13T22:43:27.829946] [INFO ] [MAIN ] Derivative Progress: 1530/1810 symbols completed. TFC took 1.2s. Estimated remaining: 1m 47s. Rate: 156.3 symbols/min [2025-10-13T22:43:27.831168] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:27.831048] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:27.831904] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:27.867520] [DEBUG] [LOCAL ] TFIN: Loaded 23484 existing records from primary storage. [2025-10-13T22:43:27.887683] [INFO ] [MAIN ] TFIN: Loaded 23484 primary data records. [2025-10-13T22:43:27.902163] [DEBUG] [LOCAL ] TFII: Loaded 33185 existing records from primary storage. [2025-10-13T22:43:27.936177] [INFO ] [MAIN ] TFII: Loaded 33185 primary data records. [2025-10-13T22:43:28.019441] [DEBUG] [LOCAL ] TFPM: Loaded 39066 existing records from primary storage. [2025-10-13T22:43:28.062025] [INFO ] [MAIN ] TFPM: Loaded 39066 primary data records. [2025-10-13T22:43:28.960339] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:28.963959] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23484 primary records. [2025-10-13T22:43:28.964950] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-13T22:43:29.003278] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-13T22:43:29.004227] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:29.005825] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33185 primary records. [2025-10-13T22:43:29.004751] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-13T22:43:29.008629] [INFO ] [MAIN ] Derivative Progress: 1531/1810 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 47s. Rate: 156.1 symbols/min [2025-10-13T22:43:29.009132] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-13T22:43:29.009028] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:29.026101] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:29.034402] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 39066 primary records. [2025-10-13T22:43:29.034605] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-13T22:43:29.052789] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-13T22:43:29.058595] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-13T22:43:29.061585] [INFO ] [MAIN ] Derivative Progress: 1532/1810 symbols completed. TFII took 1.2s. Estimated remaining: 1m 47s. Rate: 156.2 symbols/min [2025-10-13T22:43:29.061856] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:29.068706] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-13T22:43:29.069025] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-13T22:43:29.072693] [INFO ] [MAIN ] Derivative Progress: 1533/1810 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 46s. Rate: 156.3 symbols/min [2025-10-13T22:43:29.073058] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:29.084636] [DEBUG] [LOCAL ] TG: Loaded 10393 existing records from primary storage. [2025-10-13T22:43:29.084924] [INFO ] [MAIN ] TG: Loaded 10393 primary data records. [2025-10-13T22:43:29.237195] [DEBUG] [LOCAL ] TFX: Loaded 36470 existing records from primary storage. [2025-10-13T22:43:29.237556] [INFO ] [MAIN ] TFX: Loaded 36470 primary data records. [2025-10-13T22:43:29.599127] [DEBUG] [LOCAL ] TGLS: Loaded 27631 existing records from primary storage. [2025-10-13T22:43:29.624020] [INFO ] [MAIN ] TGLS: Loaded 27631 primary data records. [2025-10-13T22:43:30.153277] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:30.154467] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10393 primary records. [2025-10-13T22:43:30.154706] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-13T22:43:30.174515] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-13T22:43:30.174840] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-13T22:43:30.184858] [INFO ] [MAIN ] Derivative Progress: 1534/1810 symbols completed. TG took 1.1s. Estimated remaining: 1m 46s. Rate: 156.1 symbols/min [2025-10-13T22:43:30.190245] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:30.190761] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:30.193179] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36470 primary records. [2025-10-13T22:43:30.193361] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-13T22:43:30.218300] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:30.224289] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27631 primary records. [2025-10-13T22:43:30.226345] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-13T22:43:30.226214] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-13T22:43:30.227280] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-13T22:43:30.230266] [INFO ] [MAIN ] Derivative Progress: 1535/1810 symbols completed. TFX took 1.2s. Estimated remaining: 1m 46s. Rate: 156.2 symbols/min [2025-10-13T22:43:30.230505] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:30.247929] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-13T22:43:30.248006] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-13T22:43:30.250500] [INFO ] [MAIN ] Derivative Progress: 1536/1810 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 45s. Rate: 156.3 symbols/min [2025-10-13T22:43:30.250737] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:30.294681] [DEBUG] [LOCAL ] TGNA: Loaded 48635 existing records from primary storage. [2025-10-13T22:43:30.294957] [INFO ] [MAIN ] TGNA: Loaded 48635 primary data records. [2025-10-13T22:43:30.461510] [DEBUG] [LOCAL ] TGS: Loaded 33260 existing records from primary storage. [2025-10-13T22:43:30.495054] [INFO ] [MAIN ] TGS: Loaded 33260 primary data records. [2025-10-13T22:43:30.706058] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-13T22:43:30.729122] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-13T22:43:31.390966] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:31.392461] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48635 primary records. [2025-10-13T22:43:31.392568] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-13T22:43:31.410419] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-13T22:43:31.410896] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-13T22:43:31.414181] [INFO ] [MAIN ] Derivative Progress: 1537/1810 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 45s. Rate: 156.1 symbols/min [2025-10-13T22:43:31.414390] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:31.436001] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:31.437500] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 33260 primary records. [2025-10-13T22:43:31.438141] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-13T22:43:31.459467] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-13T22:43:31.459847] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-13T22:43:31.470860] [INFO ] [MAIN ] Derivative Progress: 1538/1810 symbols completed. TGS took 1.2s. Estimated remaining: 1m 45s. Rate: 156.2 symbols/min [2025-10-13T22:43:31.471164] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:31.477075] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:31.491741] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-13T22:43:31.492064] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-13T22:43:31.508029] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-13T22:43:31.508224] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-13T22:43:31.511164] [INFO ] [MAIN ] Derivative Progress: 1539/1810 symbols completed. TGT took 1.3s. Estimated remaining: 1m 44s. Rate: 156.3 symbols/min [2025-10-13T22:43:31.511378] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:31.521196] [DEBUG] [LOCAL ] THIR: Loaded 2351 existing records from primary storage. [2025-10-13T22:43:31.521563] [INFO ] [MAIN ] THIR: Loaded 2351 primary data records. [2025-10-13T22:43:31.605102] [DEBUG] [LOCAL ] THC: Loaded 47182 existing records from primary storage. [2025-10-13T22:43:31.646470] [INFO ] [MAIN ] THC: Loaded 47182 primary data records. [2025-10-13T22:43:31.647177] [DEBUG] [LOCAL ] THG: Loaded 21621 existing records from primary storage. [2025-10-13T22:43:31.667907] [INFO ] [MAIN ] THG: Loaded 21621 primary data records. [2025-10-13T22:43:32.536349] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7828 incomplete bins [2025-10-13T22:43:32.537199] [INFO ] [MAIN ] THIR: Generated 1786 derivative records from 2351 primary records. [2025-10-13T22:43:32.537526] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-13T22:43:32.556461] [DEBUG] [LOCAL ] THIR: Derivative data saved (1786 records). [2025-10-13T22:43:32.557031] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-13T22:43:32.571818] [INFO ] [MAIN ] Derivative Progress: 1540/1810 symbols completed. THIR took 1.1s. Estimated remaining: 1m 44s. Rate: 156.1 symbols/min [2025-10-13T22:43:32.572254] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:32.573336] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47182 primary records. [2025-10-13T22:43:32.573432] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-13T22:43:32.572417] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:32.592303] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-13T22:43:32.593329] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-13T22:43:32.596145] [INFO ] [MAIN ] Derivative Progress: 1541/1810 symbols completed. THC took 1.2s. Estimated remaining: 1m 43s. Rate: 156.2 symbols/min [2025-10-13T22:43:32.596313] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:32.598862] [DEBUG] [LOCAL ] THLV: Loaded 1518 existing records from primary storage. [2025-10-13T22:43:32.598992] [INFO ] [MAIN ] THLV: Loaded 1518 primary data records. [2025-10-13T22:43:32.654256] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:32.680492] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21621 primary records. [2025-10-13T22:43:32.686827] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-13T22:43:32.933480] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-13T22:43:32.933753] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-13T22:43:32.936695] [INFO ] [MAIN ] Derivative Progress: 1542/1810 symbols completed. THG took 1.5s. Estimated remaining: 1m 43s. Rate: 156.2 symbols/min [2025-10-13T22:43:32.937187] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:32.954994] [DEBUG] [LOCAL ] THO: Loaded 41659 existing records from primary storage. [2025-10-13T22:43:32.955174] [INFO ] [MAIN ] THO: Loaded 41659 primary data records. [2025-10-13T22:43:33.174559] [DEBUG] [LOCAL ] THQ: Loaded 25308 existing records from primary storage. [2025-10-13T22:43:33.175128] [INFO ] [MAIN ] THQ: Loaded 25308 primary data records. [2025-10-13T22:43:33.312717] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-13T22:43:33.355018] [INFO ] [MAIN ] THLV: Generated 1792 derivative records from 1518 primary records. [2025-10-13T22:43:33.376927] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-13T22:43:33.523667] [DEBUG] [LOCAL ] THLV: Derivative data saved (1792 records). [2025-10-13T22:43:33.534606] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-13T22:43:33.559101] [INFO ] [MAIN ] Derivative Progress: 1543/1810 symbols completed. THLV took 1.0s. Estimated remaining: 1m 43s. Rate: 156.1 symbols/min [2025-10-13T22:43:33.732013] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:33.732955] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41659 primary records. [2025-10-13T22:43:33.733166] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-13T22:43:33.749420] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-13T22:43:33.749734] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-13T22:43:33.752600] [INFO ] [MAIN ] Derivative Progress: 1544/1810 symbols completed. THO took 1.2s. Estimated remaining: 1m 42s. Rate: 156.2 symbols/min [2025-10-13T22:43:33.768486] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:33.769158] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25308 primary records. [2025-10-13T22:43:33.769218] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-13T22:43:33.784401] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-13T22:43:33.784459] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-13T22:43:33.787136] [INFO ] [MAIN ] Derivative Progress: 1545/1810 symbols completed. THQ took 0.8s. Estimated remaining: 1m 42s. Rate: 156.3 symbols/min [2025-10-13T22:43:33.787814] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:33.787990] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:33.788443] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:33.813567] [DEBUG] [LOCAL ] THR: Loaded 19704 existing records from primary storage. [2025-10-13T22:43:33.813751] [INFO ] [MAIN ] THR: Loaded 19704 primary data records. [2025-10-13T22:43:33.899686] [DEBUG] [LOCAL ] THW: Loaded 19722 existing records from primary storage. [2025-10-13T22:43:33.910672] [INFO ] [MAIN ] THW: Loaded 19722 primary data records. [2025-10-13T22:43:34.099846] [DEBUG] [LOCAL ] THS: Loaded 38578 existing records from primary storage. [2025-10-13T22:43:34.126516] [INFO ] [MAIN ] THS: Loaded 38578 primary data records. [2025-10-13T22:43:34.799136] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:34.801242] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19704 primary records. [2025-10-13T22:43:34.801424] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-13T22:43:34.821243] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-13T22:43:34.821473] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-13T22:43:34.823979] [INFO ] [MAIN ] Derivative Progress: 1546/1810 symbols completed. THR took 1.0s. Estimated remaining: 1m 41s. Rate: 156.1 symbols/min [2025-10-13T22:43:34.824292] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:34.837858] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:34.838766] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19722 primary records. [2025-10-13T22:43:34.838948] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-13T22:43:34.872430] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-13T22:43:34.873719] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-13T22:43:34.876783] [INFO ] [MAIN ] Derivative Progress: 1547/1810 symbols completed. THW took 1.1s. Estimated remaining: 1m 41s. Rate: 156.2 symbols/min [2025-10-13T22:43:34.873606] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:34.877679] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38578 primary records. [2025-10-13T22:43:34.877902] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:34.878149] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-13T22:43:34.904934] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-13T22:43:34.905078] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-13T22:43:34.908124] [INFO ] [MAIN ] Derivative Progress: 1548/1810 symbols completed. THS took 1.1s. Estimated remaining: 1m 41s. Rate: 156.3 symbols/min [2025-10-13T22:43:34.910966] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:34.911278] [DEBUG] [LOCAL ] TISI: Loaded 3349 existing records from primary storage. [2025-10-13T22:43:34.922754] [INFO ] [MAIN ] TISI: Loaded 3349 primary data records. [2025-10-13T22:43:34.934798] [DEBUG] [LOCAL ] TIMB: Loaded 35399 existing records from primary storage. [2025-10-13T22:43:34.960145] [INFO ] [MAIN ] TIMB: Loaded 35399 primary data records. [2025-10-13T22:43:35.176911] [DEBUG] [LOCAL ] TIXT: Loaded 32346 existing records from primary storage. [2025-10-13T22:43:35.187893] [INFO ] [MAIN ] TIXT: Loaded 32346 primary data records. [2025-10-13T22:43:35.951770] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:35.952123] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:35.953435] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35399 primary records. [2025-10-13T22:43:35.954201] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3349 primary records. [2025-10-13T22:43:35.954371] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-13T22:43:35.954462] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-13T22:43:35.986699] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-13T22:43:35.984037] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-13T22:43:35.987755] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-13T22:43:35.987618] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-13T22:43:35.990987] [INFO ] [MAIN ] Derivative Progress: 1549/1810 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 40s. Rate: 156.1 symbols/min [2025-10-13T22:43:36.006700] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:36.006901] [INFO ] [MAIN ] Derivative Progress: 1550/1810 symbols completed. TISI took 1.1s. Estimated remaining: 1m 40s. Rate: 156.2 symbols/min [2025-10-13T22:43:36.008073] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:36.008193] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:36.009342] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 32346 primary records. [2025-10-13T22:43:36.010019] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-13T22:43:36.026350] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-13T22:43:36.026524] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-13T22:43:36.029234] [INFO ] [MAIN ] Derivative Progress: 1551/1810 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 39s. Rate: 156.3 symbols/min [2025-10-13T22:43:36.029532] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:36.084684] [DEBUG] [LOCAL ] TK: Loaded 39201 existing records from primary storage. [2025-10-13T22:43:36.084913] [INFO ] [MAIN ] TK: Loaded 39201 primary data records. [2025-10-13T22:43:36.139679] [DEBUG] [LOCAL ] TKC: Loaded 39245 existing records from primary storage. [2025-10-13T22:43:36.174148] [INFO ] [MAIN ] TKC: Loaded 39245 primary data records. [2025-10-13T22:43:36.224149] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-13T22:43:36.249466] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-13T22:43:37.028464] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:37.029207] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39201 primary records. [2025-10-13T22:43:37.029411] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-13T22:43:37.047903] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-13T22:43:37.048465] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-13T22:43:37.050544] [INFO ] [MAIN ] Derivative Progress: 1552/1810 symbols completed. TK took 1.0s. Estimated remaining: 1m 39s. Rate: 156.1 symbols/min [2025-10-13T22:43:37.053788] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:37.070611] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:37.071626] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39245 primary records. [2025-10-13T22:43:37.071835] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-13T22:43:37.085693] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:37.093225] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-13T22:43:37.094625] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-13T22:43:37.102023] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-13T22:43:37.102406] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-13T22:43:37.112588] [INFO ] [MAIN ] Derivative Progress: 1553/1810 symbols completed. TKC took 1.1s. Estimated remaining: 1m 39s. Rate: 156.2 symbols/min [2025-10-13T22:43:37.114119] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:37.122215] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-13T22:43:37.132439] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-13T22:43:37.135295] [INFO ] [MAIN ] Derivative Progress: 1554/1810 symbols completed. TJX took 1.1s. Estimated remaining: 1m 38s. Rate: 156.3 symbols/min [2025-10-13T22:43:37.135524] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:37.158534] [DEBUG] [LOCAL ] TKO: Loaded 43845 existing records from primary storage. [2025-10-13T22:43:37.168373] [INFO ] [MAIN ] TKO: Loaded 43845 primary data records. [2025-10-13T22:43:37.301823] [DEBUG] [LOCAL ] TKR: Loaded 39889 existing records from primary storage. [2025-10-13T22:43:37.317893] [INFO ] [MAIN ] TKR: Loaded 39889 primary data records. [2025-10-13T22:43:37.328960] [DEBUG] [LOCAL ] TLK: Loaded 38623 existing records from primary storage. [2025-10-13T22:43:37.342048] [INFO ] [MAIN ] TLK: Loaded 38623 primary data records. [2025-10-13T22:43:38.152970] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:38.153994] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43845 primary records. [2025-10-13T22:43:38.154810] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-13T22:43:38.176538] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-13T22:43:38.185811] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-13T22:43:38.187784] [INFO ] [MAIN ] Derivative Progress: 1555/1810 symbols completed. TKO took 1.1s. Estimated remaining: 1m 38s. Rate: 156.1 symbols/min [2025-10-13T22:43:38.196454] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:38.197389] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:38.211239] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39889 primary records. [2025-10-13T22:43:38.211961] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-13T22:43:38.211883] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:38.214084] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38623 primary records. [2025-10-13T22:43:38.214328] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-13T22:43:38.244491] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-13T22:43:38.246303] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-13T22:43:38.252020] [INFO ] [MAIN ] Derivative Progress: 1556/1810 symbols completed. TKR took 1.1s. Estimated remaining: 1m 38s. Rate: 156.2 symbols/min [2025-10-13T22:43:38.252698] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:38.257776] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-13T22:43:38.263621] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-13T22:43:38.264011] [DEBUG] [LOCAL ] TLYS: Loaded 16571 existing records from primary storage. [2025-10-13T22:43:38.267007] [INFO ] [MAIN ] TLYS: Loaded 16571 primary data records. [2025-10-13T22:43:38.266840] [INFO ] [MAIN ] Derivative Progress: 1557/1810 symbols completed. TLK took 1.1s. Estimated remaining: 1m 37s. Rate: 156.3 symbols/min [2025-10-13T22:43:38.278437] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:38.583552] [DEBUG] [LOCAL ] TM: Loaded 36628 existing records from primary storage. [2025-10-13T22:43:38.584237] [INFO ] [MAIN ] TM: Loaded 36628 primary data records. [2025-10-13T22:43:38.769017] [DEBUG] [LOCAL ] TME: Loaded 53188 existing records from primary storage. [2025-10-13T22:43:38.924012] [INFO ] [MAIN ] TME: Loaded 53188 primary data records. [2025-10-13T22:43:39.046235] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:39.063942] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16571 primary records. [2025-10-13T22:43:39.069448] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-13T22:43:39.306118] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-13T22:43:39.307751] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-13T22:43:39.310621] [INFO ] [MAIN ] Derivative Progress: 1558/1810 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 37s. Rate: 156.1 symbols/min [2025-10-13T22:43:39.325746] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:39.326522] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36628 primary records. [2025-10-13T22:43:39.326892] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-13T22:43:39.343781] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-13T22:43:39.343991] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-13T22:43:39.346549] [INFO ] [MAIN ] Derivative Progress: 1559/1810 symbols completed. TM took 1.1s. Estimated remaining: 1m 36s. Rate: 156.2 symbols/min [2025-10-13T22:43:39.363104] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:39.363624] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53188 primary records. [2025-10-13T22:43:39.363707] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-13T22:43:39.379252] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-13T22:43:39.379311] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-13T22:43:39.382267] [INFO ] [MAIN ] Derivative Progress: 1560/1810 symbols completed. TME took 1.1s. Estimated remaining: 1m 36s. Rate: 156.3 symbols/min [2025-10-13T22:43:39.382635] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:39.383071] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:39.383036] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:39.399107] [DEBUG] [LOCAL ] TNC: Loaded 14489 existing records from primary storage. [2025-10-13T22:43:39.399581] [INFO ] [MAIN ] TNC: Loaded 14489 primary data records. [2025-10-13T22:43:39.719118] [DEBUG] [LOCAL ] TMHC: Loaded 45406 existing records from primary storage. [2025-10-13T22:43:39.746921] [INFO ] [MAIN ] TMHC: Loaded 45406 primary data records. [2025-10-13T22:43:39.779150] [DEBUG] [LOCAL ] TMO: Loaded 52450 existing records from primary storage. [2025-10-13T22:43:39.792116] [INFO ] [MAIN ] TMO: Loaded 52450 primary data records. [2025-10-13T22:43:40.379808] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:40.381209] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14489 primary records. [2025-10-13T22:43:40.381913] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-13T22:43:40.399020] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-13T22:43:40.400032] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-13T22:43:40.404767] [INFO ] [MAIN ] Derivative Progress: 1561/1810 symbols completed. TNC took 1.0s. Estimated remaining: 1m 36s. Rate: 156.1 symbols/min [2025-10-13T22:43:40.406488] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:40.421733] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:40.422632] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45406 primary records. [2025-10-13T22:43:40.422995] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-13T22:43:40.439207] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-13T22:43:40.439585] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-13T22:43:40.441699] [INFO ] [MAIN ] Derivative Progress: 1562/1810 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 35s. Rate: 156.2 symbols/min [2025-10-13T22:43:40.441898] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:40.458067] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:40.466487] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52450 primary records. [2025-10-13T22:43:40.466728] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-13T22:43:40.482211] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-13T22:43:40.490950] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-13T22:43:40.493798] [INFO ] [MAIN ] Derivative Progress: 1563/1810 symbols completed. TMO took 1.1s. Estimated remaining: 1m 35s. Rate: 156.3 symbols/min [2025-10-13T22:43:40.494386] [DEBUG] [LOCAL ] TNET: Loaded 28317 existing records from primary storage. [2025-10-13T22:43:40.494579] [INFO ] [MAIN ] TNET: Loaded 28317 primary data records. [2025-10-13T22:43:40.494713] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:40.639462] [DEBUG] [LOCAL ] TNK: Loaded 35356 existing records from primary storage. [2025-10-13T22:43:40.666530] [INFO ] [MAIN ] TNK: Loaded 35356 primary data records. [2025-10-13T22:43:40.984168] [DEBUG] [LOCAL ] TNL: Loaded 41758 existing records from primary storage. [2025-10-13T22:43:41.016725] [INFO ] [MAIN ] TNL: Loaded 41758 primary data records. [2025-10-13T22:43:41.496636] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:41.530575] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28317 primary records. [2025-10-13T22:43:41.530964] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-13T22:43:41.551826] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-13T22:43:41.552841] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-13T22:43:41.555429] [INFO ] [MAIN ] Derivative Progress: 1564/1810 symbols completed. TNET took 1.1s. Estimated remaining: 1m 35s. Rate: 156.1 symbols/min [2025-10-13T22:43:41.556363] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:41.583491] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:41.584869] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35356 primary records. [2025-10-13T22:43:41.585074] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-13T22:43:41.627845] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-13T22:43:41.628377] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:41.628447] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-13T22:43:41.629186] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41758 primary records. [2025-10-13T22:43:41.632842] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-13T22:43:41.632606] [INFO ] [MAIN ] Derivative Progress: 1565/1810 symbols completed. TNK took 1.2s. Estimated remaining: 1m 34s. Rate: 156.2 symbols/min [2025-10-13T22:43:41.633761] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:41.664380] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-13T22:43:41.664570] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-13T22:43:41.667823] [INFO ] [MAIN ] Derivative Progress: 1566/1810 symbols completed. TNL took 1.2s. Estimated remaining: 1m 34s. Rate: 156.3 symbols/min [2025-10-13T22:43:41.668115] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:41.686462] [DEBUG] [LOCAL ] TOL: Loaded 50684 existing records from primary storage. [2025-10-13T22:43:41.686741] [INFO ] [MAIN ] TOL: Loaded 50684 primary data records. [2025-10-13T22:43:41.869773] [DEBUG] [LOCAL ] TPB: Loaded 25891 existing records from primary storage. [2025-10-13T22:43:41.875766] [INFO ] [MAIN ] TPB: Loaded 25891 primary data records. [2025-10-13T22:43:42.098943] [DEBUG] [LOCAL ] TOST: Loaded 53685 existing records from primary storage. [2025-10-13T22:43:42.115600] [INFO ] [MAIN ] TOST: Loaded 53685 primary data records. [2025-10-13T22:43:42.634373] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:42.635369] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50684 primary records. [2025-10-13T22:43:42.636105] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-13T22:43:42.653155] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-13T22:43:42.653346] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-13T22:43:42.656124] [INFO ] [MAIN ] Derivative Progress: 1567/1810 symbols completed. TOL took 1.1s. Estimated remaining: 1m 33s. Rate: 156.2 symbols/min [2025-10-13T22:43:42.656565] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:42.674017] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:42.674857] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25891 primary records. [2025-10-13T22:43:42.675079] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-13T22:43:42.702093] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-13T22:43:42.707351] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-13T22:43:42.718771] [INFO ] [MAIN ] Derivative Progress: 1568/1810 symbols completed. TPB took 1.1s. Estimated remaining: 1m 33s. Rate: 156.2 symbols/min [2025-10-13T22:43:42.719254] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:42.719513] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:42.720734] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53685 primary records. [2025-10-13T22:43:42.720872] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-13T22:43:42.749044] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-13T22:43:42.749334] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-13T22:43:42.752158] [INFO ] [MAIN ] Derivative Progress: 1569/1810 symbols completed. TOST took 1.1s. Estimated remaining: 1m 32s. Rate: 156.3 symbols/min [2025-10-13T22:43:42.752387] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:42.753569] [DEBUG] [LOCAL ] TPC: Loaded 39010 existing records from primary storage. [2025-10-13T22:43:42.753908] [INFO ] [MAIN ] TPC: Loaded 39010 primary data records. [2025-10-13T22:43:42.894911] [DEBUG] [LOCAL ] TPL: Loaded 12304 existing records from primary storage. [2025-10-13T22:43:42.945014] [INFO ] [MAIN ] TPL: Loaded 12304 primary data records. [2025-10-13T22:43:43.198281] [DEBUG] [LOCAL ] TPH: Loaded 44898 existing records from primary storage. [2025-10-13T22:43:43.210695] [INFO ] [MAIN ] TPH: Loaded 44898 primary data records. [2025-10-13T22:43:43.763554] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:43.764781] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 39010 primary records. [2025-10-13T22:43:43.765046] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-13T22:43:43.784253] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-13T22:43:43.784673] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-13T22:43:43.787043] [INFO ] [MAIN ] Derivative Progress: 1570/1810 symbols completed. TPC took 1.1s. Estimated remaining: 1m 32s. Rate: 156.2 symbols/min [2025-10-13T22:43:43.794970] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:43.801037] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:43.801720] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12304 primary records. [2025-10-13T22:43:43.801882] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-13T22:43:43.818178] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-13T22:43:43.819081] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-13T22:43:43.822678] [INFO ] [MAIN ] Derivative Progress: 1571/1810 symbols completed. TPL took 1.1s. Estimated remaining: 1m 32s. Rate: 156.2 symbols/min [2025-10-13T22:43:43.823699] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:43.837257] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:43.838297] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44898 primary records. [2025-10-13T22:43:43.838489] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-13T22:43:43.854585] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-13T22:43:43.854735] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-13T22:43:43.857361] [INFO ] [MAIN ] Derivative Progress: 1572/1810 symbols completed. TPH took 1.1s. Estimated remaining: 1m 31s. Rate: 156.3 symbols/min [2025-10-13T22:43:43.857627] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:43.885931] [DEBUG] [LOCAL ] TPYP: Loaded 7942 existing records from primary storage. [2025-10-13T22:43:43.886067] [INFO ] [MAIN ] TPYP: Loaded 7942 primary data records. [2025-10-13T22:43:43.993315] [DEBUG] [LOCAL ] TPVG: Loaded 27290 existing records from primary storage. [2025-10-13T22:43:44.015317] [INFO ] [MAIN ] TPVG: Loaded 27290 primary data records. [2025-10-13T22:43:44.015174] [DEBUG] [LOCAL ] TPR: Loaded 53446 existing records from primary storage. [2025-10-13T22:43:44.015538] [INFO ] [MAIN ] TPR: Loaded 53446 primary data records. [2025-10-13T22:43:44.843717] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:44.845342] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7942 primary records. [2025-10-13T22:43:44.845410] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-13T22:43:44.866587] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-13T22:43:44.868601] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-13T22:43:44.884720] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:44.884212] [INFO ] [MAIN ] Derivative Progress: 1573/1810 symbols completed. TPYP took 1.0s. Estimated remaining: 1m 31s. Rate: 156.2 symbols/min [2025-10-13T22:43:44.893426] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27290 primary records. [2025-10-13T22:43:44.898870] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-13T22:43:44.898785] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:44.899765] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53446 primary records. [2025-10-13T22:43:44.900194] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-13T22:43:44.927580] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-13T22:43:44.928007] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-13T22:43:44.931183] [INFO ] [MAIN ] Derivative Progress: 1574/1810 symbols completed. TPR took 1.1s. Estimated remaining: 1m 31s. Rate: 156.3 symbols/min [2025-10-13T22:43:44.933832] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-13T22:43:44.933897] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-13T22:43:44.937074] [INFO ] [MAIN ] Derivative Progress: 1575/1810 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 30s. Rate: 156.4 symbols/min [2025-10-13T22:43:44.937407] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:44.937531] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:44.937461] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:44.944911] [DEBUG] [LOCAL ] TPZ: Loaded 4764 existing records from primary storage. [2025-10-13T22:43:44.945167] [INFO ] [MAIN ] TPZ: Loaded 4764 primary data records. [2025-10-13T22:43:45.060534] [DEBUG] [LOCAL ] TRAK: Loaded 9616 existing records from primary storage. [2025-10-13T22:43:45.069962] [INFO ] [MAIN ] TRAK: Loaded 9616 primary data records. [2025-10-13T22:43:45.076453] [DEBUG] [LOCAL ] TR: Loaded 18914 existing records from primary storage. [2025-10-13T22:43:45.098360] [INFO ] [MAIN ] TR: Loaded 18914 primary data records. [2025-10-13T22:43:45.935630] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:43:45.936887] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4764 primary records. [2025-10-13T22:43:45.937082] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-13T22:43:45.955258] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-10-13T22:43:45.955421] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-13T22:43:45.970073] [INFO ] [MAIN ] Derivative Progress: 1576/1810 symbols completed. TPZ took 1.0s. Estimated remaining: 1m 30s. Rate: 156.2 symbols/min [2025-10-13T22:43:45.970402] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:45.970864] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:45.972107] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9616 primary records. [2025-10-13T22:43:45.972734] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-13T22:43:46.003271] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:46.004201] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18914 primary records. [2025-10-13T22:43:46.009551] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-13T22:43:46.009854] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-13T22:43:46.009780] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-13T22:43:46.013238] [INFO ] [MAIN ] Derivative Progress: 1577/1810 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 29s. Rate: 156.3 symbols/min [2025-10-13T22:43:46.013911] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:46.034988] [DEBUG] [LOCAL ] TRC: Loaded 15628 existing records from primary storage. [2025-10-13T22:43:46.035057] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-13T22:43:46.035403] [INFO ] [MAIN ] TRC: Loaded 15628 primary data records. [2025-10-13T22:43:46.035486] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-13T22:43:46.038761] [INFO ] [MAIN ] Derivative Progress: 1578/1810 symbols completed. TR took 1.1s. Estimated remaining: 1m 29s. Rate: 156.4 symbols/min [2025-10-13T22:43:46.039034] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:46.391860] [DEBUG] [LOCAL ] TREX: Loaded 49851 existing records from primary storage. [2025-10-13T22:43:46.392516] [INFO ] [MAIN ] TREX: Loaded 49851 primary data records. [2025-10-13T22:43:46.511733] [DEBUG] [LOCAL ] TRGP: Loaded 50843 existing records from primary storage. [2025-10-13T22:43:46.523046] [INFO ] [MAIN ] TRGP: Loaded 50843 primary data records. [2025-10-13T22:43:46.935931] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:47.055535] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15628 primary records. [2025-10-13T22:43:47.056438] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-13T22:43:47.075312] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-13T22:43:47.076824] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-13T22:43:47.081334] [INFO ] [MAIN ] Derivative Progress: 1579/1810 symbols completed. TRC took 1.1s. Estimated remaining: 1m 29s. Rate: 156.2 symbols/min [2025-10-13T22:43:47.081677] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:47.107534] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:47.110560] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49851 primary records. [2025-10-13T22:43:47.118905] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-13T22:43:47.135082] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:47.148988] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50843 primary records. [2025-10-13T22:43:47.149685] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-13T22:43:47.177421] [DEBUG] [LOCAL ] TRN: Loaded 36838 existing records from primary storage. [2025-10-13T22:43:47.178157] [INFO ] [MAIN ] TRN: Loaded 36838 primary data records. [2025-10-13T22:43:47.203903] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-13T22:43:47.204778] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-13T22:43:47.230446] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-13T22:43:47.250945] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-13T22:43:47.230319] [INFO ] [MAIN ] Derivative Progress: 1580/1810 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 28s. Rate: 156.3 symbols/min [2025-10-13T22:43:47.288174] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:47.290724] [INFO ] [MAIN ] Derivative Progress: 1581/1810 symbols completed. TREX took 1.3s. Estimated remaining: 1m 28s. Rate: 156.3 symbols/min [2025-10-13T22:43:47.291267] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:47.549328] [DEBUG] [LOCAL ] TRNO: Loaded 43857 existing records from primary storage. [2025-10-13T22:43:47.549699] [INFO ] [MAIN ] TRNO: Loaded 43857 primary data records. [2025-10-13T22:43:47.607177] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:47.646953] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36838 primary records. [2025-10-13T22:43:47.648141] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-13T22:43:47.679684] [DEBUG] [LOCAL ] TROX: Loaded 52089 existing records from primary storage. [2025-10-13T22:43:47.690241] [INFO ] [MAIN ] TROX: Loaded 52089 primary data records. [2025-10-13T22:43:47.760491] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-13T22:43:47.773424] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-13T22:43:47.807273] [INFO ] [MAIN ] Derivative Progress: 1582/1810 symbols completed. TRN took 0.7s. Estimated remaining: 1m 28s. Rate: 156.3 symbols/min [2025-10-13T22:43:47.839800] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:48.249979] [DEBUG] [LOCAL ] TRP: Loaded 52141 existing records from primary storage. [2025-10-13T22:43:48.250532] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:48.251435] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43857 primary records. [2025-10-13T22:43:48.250269] [INFO ] [MAIN ] TRP: Loaded 52141 primary data records. [2025-10-13T22:43:48.251747] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-13T22:43:48.371909] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-13T22:43:48.393393] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-13T22:43:48.453716] [INFO ] [MAIN ] Derivative Progress: 1583/1810 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 27s. Rate: 156.2 symbols/min [2025-10-13T22:43:48.454808] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:48.581859] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:48.582671] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 52089 primary records. [2025-10-13T22:43:48.582782] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-13T22:43:48.601711] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-13T22:43:48.601797] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-13T22:43:48.603928] [INFO ] [MAIN ] Derivative Progress: 1584/1810 symbols completed. TROX took 1.3s. Estimated remaining: 1m 27s. Rate: 156.3 symbols/min [2025-10-13T22:43:48.604417] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:48.633611] [DEBUG] [LOCAL ] TRTX: Loaded 37391 existing records from primary storage. [2025-10-13T22:43:48.634622] [INFO ] [MAIN ] TRTX: Loaded 37391 primary data records. [2025-10-13T22:43:48.702010] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:48.716970] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52141 primary records. [2025-10-13T22:43:48.717048] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-13T22:43:48.987138] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-13T22:43:48.986208] [DEBUG] [LOCAL ] TRU: Loaded 51424 existing records from primary storage. [2025-10-13T22:43:48.987418] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-13T22:43:48.987500] [INFO ] [MAIN ] TRU: Loaded 51424 primary data records. [2025-10-13T22:43:48.989674] [INFO ] [MAIN ] Derivative Progress: 1585/1810 symbols completed. TRP took 1.1s. Estimated remaining: 1m 26s. Rate: 156.3 symbols/min [2025-10-13T22:43:48.989892] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:49.362915] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:49.364064] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37391 primary records. [2025-10-13T22:43:49.377678] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-13T22:43:49.390958] [DEBUG] [LOCAL ] TRV: Loaded 47472 existing records from primary storage. [2025-10-13T22:43:49.392120] [INFO ] [MAIN ] TRV: Loaded 47472 primary data records. [2025-10-13T22:43:49.477671] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-13T22:43:49.500065] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-13T22:43:49.503037] [INFO ] [MAIN ] Derivative Progress: 1586/1810 symbols completed. TRTX took 1.0s. Estimated remaining: 1m 26s. Rate: 156.3 symbols/min [2025-10-13T22:43:49.524250] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:49.716437] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:49.718145] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51424 primary records. [2025-10-13T22:43:49.718303] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-13T22:43:49.737247] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-13T22:43:49.737396] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-13T22:43:49.739674] [INFO ] [MAIN ] Derivative Progress: 1587/1810 symbols completed. TRU took 1.1s. Estimated remaining: 1m 26s. Rate: 156.3 symbols/min [2025-10-13T22:43:49.740226] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:49.774409] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:49.775177] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47472 primary records. [2025-10-13T22:43:49.775285] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-13T22:43:49.822695] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-13T22:43:49.823546] [DEBUG] [LOCAL ] TS: Loaded 51672 existing records from primary storage. [2025-10-13T22:43:49.824016] [INFO ] [MAIN ] TS: Loaded 51672 primary data records. [2025-10-13T22:43:49.823918] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-13T22:43:49.838412] [INFO ] [MAIN ] Derivative Progress: 1588/1810 symbols completed. TRV took 0.8s. Estimated remaining: 1m 25s. Rate: 156.4 symbols/min [2025-10-13T22:43:49.824762] [DEBUG] [LOCAL ] TSE: Loaded 27793 existing records from primary storage. [2025-10-13T22:43:49.869996] [INFO ] [MAIN ] TSE: Loaded 27793 primary data records. [2025-10-13T22:43:50.482422] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:50.482767] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:50.484287] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51672 primary records. [2025-10-13T22:43:50.483615] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27793 primary records. [2025-10-13T22:43:50.484420] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-13T22:43:50.484488] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-13T22:43:50.512025] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-13T22:43:50.512364] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-13T22:43:50.514507] [INFO ] [MAIN ] Derivative Progress: 1589/1810 symbols completed. TS took 1.0s. Estimated remaining: 1m 25s. Rate: 156.3 symbols/min [2025-10-13T22:43:50.521261] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-13T22:43:50.521497] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-13T22:43:50.524434] [INFO ] [MAIN ] Derivative Progress: 1590/1810 symbols completed. TSE took 0.8s. Estimated remaining: 1m 24s. Rate: 156.4 symbols/min [2025-10-13T22:43:50.525127] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:50.525016] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:50.525272] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:50.537207] [DEBUG] [LOCAL ] TSI: Loaded 7889 existing records from primary storage. [2025-10-13T22:43:50.537439] [INFO ] [MAIN ] TSI: Loaded 7889 primary data records. [2025-10-13T22:43:50.865218] [DEBUG] [LOCAL ] TSLX: Loaded 35780 existing records from primary storage. [2025-10-13T22:43:50.879798] [INFO ] [MAIN ] TSLX: Loaded 35780 primary data records. [2025-10-13T22:43:50.995442] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-13T22:43:50.998853] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-13T22:43:51.558313] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:51.560133] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7889 primary records. [2025-10-13T22:43:51.560792] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-13T22:43:51.579707] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-13T22:43:51.579794] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-13T22:43:51.582394] [INFO ] [MAIN ] Derivative Progress: 1591/1810 symbols completed. TSI took 1.1s. Estimated remaining: 1m 24s. Rate: 156.2 symbols/min [2025-10-13T22:43:51.582687] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:51.598904] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:51.599597] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35780 primary records. [2025-10-13T22:43:51.599731] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-13T22:43:51.628743] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:51.633069] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-13T22:43:51.633254] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-13T22:43:51.636184] [INFO ] [MAIN ] Derivative Progress: 1592/1810 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 24s. Rate: 156.3 symbols/min [2025-10-13T22:43:51.634000] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-13T22:43:51.636688] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-13T22:43:51.636489] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:51.654614] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-13T22:43:51.658069] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-13T22:43:51.660786] [INFO ] [MAIN ] Derivative Progress: 1593/1810 symbols completed. TSM took 1.1s. Estimated remaining: 1m 23s. Rate: 156.4 symbols/min [2025-10-13T22:43:51.661081] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:51.679788] [DEBUG] [LOCAL ] TSQ: Loaded 11703 existing records from primary storage. [2025-10-13T22:43:51.679883] [INFO ] [MAIN ] TSQ: Loaded 11703 primary data records. [2025-10-13T22:43:51.799769] [DEBUG] [LOCAL ] TSN: Loaded 53006 existing records from primary storage. [2025-10-13T22:43:51.810931] [INFO ] [MAIN ] TSN: Loaded 53006 primary data records. [2025-10-13T22:43:52.149927] [DEBUG] [LOCAL ] TT: Loaded 47416 existing records from primary storage. [2025-10-13T22:43:52.175354] [INFO ] [MAIN ] TT: Loaded 47416 primary data records. [2025-10-13T22:43:52.643340] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:52.645568] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11703 primary records. [2025-10-13T22:43:52.645740] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-13T22:43:52.677036] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-13T22:43:52.677688] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-13T22:43:52.677520] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:52.678487] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 53006 primary records. [2025-10-13T22:43:52.681207] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-13T22:43:52.680980] [INFO ] [MAIN ] Derivative Progress: 1594/1810 symbols completed. TSQ took 1.0s. Estimated remaining: 1m 23s. Rate: 156.2 symbols/min [2025-10-13T22:43:52.682039] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:52.714993] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-13T22:43:52.715097] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-13T22:43:52.717832] [INFO ] [MAIN ] Derivative Progress: 1595/1810 symbols completed. TSN took 1.1s. Estimated remaining: 1m 23s. Rate: 156.3 symbols/min [2025-10-13T22:43:52.715490] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:52.719128] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47416 primary records. [2025-10-13T22:43:52.719234] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-13T22:43:52.718094] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:52.745593] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-13T22:43:52.745826] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-13T22:43:52.749359] [INFO ] [MAIN ] Derivative Progress: 1596/1810 symbols completed. TT took 1.1s. Estimated remaining: 1m 22s. Rate: 156.4 symbols/min [2025-10-13T22:43:52.749616] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:52.766074] [DEBUG] [LOCAL ] TTC: Loaded 42016 existing records from primary storage. [2025-10-13T22:43:52.766250] [INFO ] [MAIN ] TTC: Loaded 42016 primary data records. [2025-10-13T22:43:52.916049] [DEBUG] [LOCAL ] TTE: Loaded 51576 existing records from primary storage. [2025-10-13T22:43:52.927169] [INFO ] [MAIN ] TTE: Loaded 51576 primary data records. [2025-10-13T22:43:53.223619] [DEBUG] [LOCAL ] TTI: Loaded 46249 existing records from primary storage. [2025-10-13T22:43:53.223863] [INFO ] [MAIN ] TTI: Loaded 46249 primary data records. [2025-10-13T22:43:53.869799] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:53.871050] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42016 primary records. [2025-10-13T22:43:53.871931] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-13T22:43:53.896168] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-13T22:43:53.897796] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-13T22:43:53.900807] [INFO ] [MAIN ] Derivative Progress: 1597/1810 symbols completed. TTC took 1.2s. Estimated remaining: 1m 22s. Rate: 156.2 symbols/min [2025-10-13T22:43:53.901156] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:53.916061] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:53.917361] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51576 primary records. [2025-10-13T22:43:53.917826] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-13T22:43:53.953340] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:53.955377] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 46249 primary records. [2025-10-13T22:43:53.958504] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-13T22:43:53.958903] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-13T22:43:53.960180] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-13T22:43:53.962669] [INFO ] [MAIN ] Derivative Progress: 1598/1810 symbols completed. TTE took 1.2s. Estimated remaining: 1m 21s. Rate: 156.3 symbols/min [2025-10-13T22:43:53.963153] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:53.994237] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-13T22:43:53.994540] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-13T22:43:53.999103] [INFO ] [MAIN ] Derivative Progress: 1599/1810 symbols completed. TTI took 1.2s. Estimated remaining: 1m 21s. Rate: 156.4 symbols/min [2025-10-13T22:43:53.999444] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:54.020326] [DEBUG] [LOCAL ] TU: Loaded 49821 existing records from primary storage. [2025-10-13T22:43:54.033591] [INFO ] [MAIN ] TU: Loaded 49821 primary data records. [2025-10-13T22:43:54.177065] [DEBUG] [LOCAL ] TUYA: Loaded 45957 existing records from primary storage. [2025-10-13T22:43:54.188617] [INFO ] [MAIN ] TUYA: Loaded 45957 primary data records. [2025-10-13T22:43:54.469586] [DEBUG] [LOCAL ] TV: Loaded 41852 existing records from primary storage. [2025-10-13T22:43:54.500419] [INFO ] [MAIN ] TV: Loaded 41852 primary data records. [2025-10-13T22:43:55.034936] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:55.036298] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49821 primary records. [2025-10-13T22:43:55.036732] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-13T22:43:55.074394] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-13T22:43:55.075168] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-13T22:43:55.077800] [INFO ] [MAIN ] Derivative Progress: 1600/1810 symbols completed. TU took 1.2s. Estimated remaining: 1m 21s. Rate: 156.2 symbols/min [2025-10-13T22:43:55.075034] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:55.078212] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:55.079930] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45957 primary records. [2025-10-13T22:43:55.080335] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-13T22:43:55.103011] [DEBUG] [LOCAL ] TVC: Loaded 3252 existing records from primary storage. [2025-10-13T22:43:55.114137] [INFO ] [MAIN ] TVC: Loaded 3252 primary data records. [2025-10-13T22:43:55.118880] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-13T22:43:55.163021] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-13T22:43:55.162852] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:55.179606] [INFO ] [MAIN ] Derivative Progress: 1601/1810 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 20s. Rate: 156.3 symbols/min [2025-10-13T22:43:55.190032] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:55.189838] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 41852 primary records. [2025-10-13T22:43:55.220572] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-13T22:43:55.250667] [DEBUG] [LOCAL ] TVE: Loaded 2700 existing records from primary storage. [2025-10-13T22:43:55.262722] [INFO ] [MAIN ] TVE: Loaded 2700 primary data records. [2025-10-13T22:43:55.638952] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-13T22:43:55.639839] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-13T22:43:55.648082] [INFO ] [MAIN ] Derivative Progress: 1602/1810 symbols completed. TV took 1.6s. Estimated remaining: 1m 20s. Rate: 156.3 symbols/min [2025-10-13T22:43:55.648273] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:55.873550] [DEBUG] [LOCAL ] TWI: Loaded 33932 existing records from primary storage. [2025-10-13T22:43:55.873776] [INFO ] [MAIN ] TWI: Loaded 33932 primary data records. [2025-10-13T22:43:55.991573] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:55.996490] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3252 primary records. [2025-10-13T22:43:55.996622] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-13T22:43:56.035195] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-10-13T22:43:56.035713] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-13T22:43:56.061039] [INFO ] [MAIN ] Derivative Progress: 1603/1810 symbols completed. TVC took 1.0s. Estimated remaining: 1m 19s. Rate: 156.3 symbols/min [2025-10-13T22:43:56.235590] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:56.236578] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2700 primary records. [2025-10-13T22:43:56.236671] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-13T22:43:56.257745] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-13T22:43:56.257882] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-13T22:43:56.263436] [INFO ] [MAIN ] Derivative Progress: 1604/1810 symbols completed. TVE took 1.1s. Estimated remaining: 1m 19s. Rate: 156.3 symbols/min [2025-10-13T22:43:56.286590] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:56.287462] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 33932 primary records. [2025-10-13T22:43:56.287526] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-13T22:43:56.303613] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-13T22:43:56.303711] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-13T22:43:56.306938] [INFO ] [MAIN ] Derivative Progress: 1605/1810 symbols completed. TWI took 0.7s. Estimated remaining: 1m 19s. Rate: 156.4 symbols/min [2025-10-13T22:43:56.307746] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:56.307589] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:56.307475] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:56.317810] [DEBUG] [LOCAL ] TWN: Loaded 3230 existing records from primary storage. [2025-10-13T22:43:56.317988] [INFO ] [MAIN ] TWN: Loaded 3230 primary data records. [2025-10-13T22:43:56.441870] [DEBUG] [LOCAL ] TX: Loaded 23267 existing records from primary storage. [2025-10-13T22:43:56.481248] [INFO ] [MAIN ] TX: Loaded 23267 primary data records. [2025-10-13T22:43:56.790847] [DEBUG] [LOCAL ] TWO: Loaded 48593 existing records from primary storage. [2025-10-13T22:43:56.809224] [INFO ] [MAIN ] TWO: Loaded 48593 primary data records. [2025-10-13T22:43:57.336711] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:57.338111] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3230 primary records. [2025-10-13T22:43:57.338546] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-13T22:43:57.355382] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-13T22:43:57.356448] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-13T22:43:57.359582] [INFO ] [MAIN ] Derivative Progress: 1606/1810 symbols completed. TWN took 1.1s. Estimated remaining: 1m 18s. Rate: 156.2 symbols/min [2025-10-13T22:43:57.360007] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:57.374164] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:57.374939] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23267 primary records. [2025-10-13T22:43:57.375137] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-13T22:43:57.393677] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-13T22:43:57.393992] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-13T22:43:57.396429] [INFO ] [MAIN ] Derivative Progress: 1607/1810 symbols completed. TX took 1.1s. Estimated remaining: 1m 18s. Rate: 156.3 symbols/min [2025-10-13T22:43:57.396667] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:57.409584] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:57.411719] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48593 primary records. [2025-10-13T22:43:57.411923] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-13T22:43:57.428130] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-13T22:43:57.428367] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-13T22:43:57.431240] [INFO ] [MAIN ] Derivative Progress: 1608/1810 symbols completed. TWO took 1.1s. Estimated remaining: 1m 17s. Rate: 156.4 symbols/min [2025-10-13T22:43:57.441271] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:57.469036] [DEBUG] [LOCAL ] TXO: Loaded 19640 existing records from primary storage. [2025-10-13T22:43:57.469751] [DEBUG] [LOCAL ] TXNM: Loaded 43470 existing records from primary storage. [2025-10-13T22:43:57.470015] [INFO ] [MAIN ] TXO: Loaded 19640 primary data records. [2025-10-13T22:43:57.470094] [INFO ] [MAIN ] TXNM: Loaded 43470 primary data records. [2025-10-13T22:43:57.975126] [DEBUG] [LOCAL ] TXT: Loaded 49685 existing records from primary storage. [2025-10-13T22:43:58.007300] [INFO ] [MAIN ] TXT: Loaded 49685 primary data records. [2025-10-13T22:43:58.454698] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:58.457407] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43470 primary records. [2025-10-13T22:43:58.458591] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-13T22:43:58.488177] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-13T22:43:58.488742] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-13T22:43:58.491417] [INFO ] [MAIN ] Derivative Progress: 1609/1810 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 17s. Rate: 156.2 symbols/min [2025-10-13T22:43:58.489056] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:58.491583] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:58.492837] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19640 primary records. [2025-10-13T22:43:58.493062] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-13T22:43:58.513321] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-13T22:43:58.513440] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-13T22:43:58.515886] [INFO ] [MAIN ] Derivative Progress: 1610/1810 symbols completed. TXO took 1.1s. Estimated remaining: 1m 17s. Rate: 156.3 symbols/min [2025-10-13T22:43:58.516287] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:58.523262] [DEBUG] [LOCAL ] TY: Loaded 7576 existing records from primary storage. [2025-10-13T22:43:58.523528] [INFO ] [MAIN ] TY: Loaded 7576 primary data records. [2025-10-13T22:43:58.639152] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:58.643324] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49685 primary records. [2025-10-13T22:43:58.643426] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-13T22:43:58.710288] [DEBUG] [LOCAL ] TYG: Loaded 13870 existing records from primary storage. [2025-10-13T22:43:58.722769] [INFO ] [MAIN ] TYG: Loaded 13870 primary data records. [2025-10-13T22:43:58.722666] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-13T22:43:58.777576] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-13T22:43:58.804996] [INFO ] [MAIN ] Derivative Progress: 1611/1810 symbols completed. TXT took 1.4s. Estimated remaining: 1m 16s. Rate: 156.3 symbols/min [2025-10-13T22:43:58.918928] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:59.192325] [DEBUG] [LOCAL ] TYL: Loaded 22457 existing records from primary storage. [2025-10-13T22:43:59.193382] [INFO ] [MAIN ] TYL: Loaded 22457 primary data records. [2025-10-13T22:43:59.328155] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:59.339590] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7576 primary records. [2025-10-13T22:43:59.357942] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-13T22:43:59.577087] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-13T22:43:59.578380] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-13T22:43:59.581028] [INFO ] [MAIN ] Derivative Progress: 1612/1810 symbols completed. TY took 1.1s. Estimated remaining: 1m 16s. Rate: 156.2 symbols/min [2025-10-13T22:43:59.582466] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:59.596995] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:59.598404] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13870 primary records. [2025-10-13T22:43:59.599417] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-13T22:43:59.616428] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-13T22:43:59.616548] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-13T22:43:59.619139] [INFO ] [MAIN ] Derivative Progress: 1613/1810 symbols completed. TYG took 1.1s. Estimated remaining: 1m 16s. Rate: 156.3 symbols/min [2025-10-13T22:43:59.619393] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:59.637116] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:43:59.637927] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22457 primary records. [2025-10-13T22:43:59.638041] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-13T22:43:59.668618] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-13T22:43:59.668739] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-13T22:43:59.671430] [INFO ] [MAIN ] Derivative Progress: 1614/1810 symbols completed. TYL took 0.8s. Estimated remaining: 1m 15s. Rate: 156.4 symbols/min [2025-10-13T22:43:59.671693] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:43:59.703712] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-13T22:43:59.703924] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-13T22:43:59.824312] [DEBUG] [LOCAL ] UA: Loaded 50465 existing records from primary storage. [2025-10-13T22:43:59.859596] [INFO ] [MAIN ] UA: Loaded 50465 primary data records. [2025-10-13T22:44:00.131493] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-10-13T22:44:00.145381] [INFO ] [MAIN ] UAA: Loaded 53507 primary data records. [2025-10-13T22:44:00.666275] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:00.667314] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-13T22:44:00.668360] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-13T22:44:00.687711] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-13T22:44:00.687789] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-13T22:44:00.690056] [INFO ] [MAIN ] Derivative Progress: 1615/1810 symbols completed. U took 1.1s. Estimated remaining: 1m 15s. Rate: 156.3 symbols/min [2025-10-13T22:44:00.690428] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:00.704098] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:00.705264] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50465 primary records. [2025-10-13T22:44:00.705672] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-13T22:44:00.723025] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-13T22:44:00.723178] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-13T22:44:00.729792] [DEBUG] [LOCAL ] UAN: Loaded 5433 existing records from primary storage. [2025-10-13T22:44:00.725804] [INFO ] [MAIN ] Derivative Progress: 1616/1810 symbols completed. UA took 1.1s. Estimated remaining: 1m 14s. Rate: 156.3 symbols/min [2025-10-13T22:44:00.731820] [INFO ] [MAIN ] UAN: Loaded 5433 primary data records. [2025-10-13T22:44:00.730777] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:00.780927] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:00.809401] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53507 primary records. [2025-10-13T22:44:00.821030] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-13T22:44:00.922369] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-13T22:44:00.937237] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-13T22:44:01.057273] [INFO ] [MAIN ] Derivative Progress: 1617/1810 symbols completed. UAA took 1.4s. Estimated remaining: 1m 14s. Rate: 156.4 symbols/min [2025-10-13T22:44:01.071748] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:01.094073] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-13T22:44:01.094465] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-13T22:44:01.482146] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:44:01.483804] [INFO ] [MAIN ] UAN: Generated 1793 derivative records from 5433 primary records. [2025-10-13T22:44:01.484147] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-13T22:44:01.489546] [DEBUG] [LOCAL ] UBS: Loaded 52320 existing records from primary storage. [2025-10-13T22:44:01.490447] [INFO ] [MAIN ] UBS: Loaded 52320 primary data records. [2025-10-13T22:44:01.560174] [DEBUG] [LOCAL ] UAN: Derivative data saved (1793 records). [2025-10-13T22:44:01.574313] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-13T22:44:01.587490] [INFO ] [MAIN ] Derivative Progress: 1618/1810 symbols completed. UAN took 0.9s. Estimated remaining: 1m 14s. Rate: 156.3 symbols/min [2025-10-13T22:44:01.843033] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:01.844355] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-13T22:44:01.844748] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-13T22:44:01.864988] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-13T22:44:01.865424] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-13T22:44:01.869162] [INFO ] [MAIN ] Derivative Progress: 1619/1810 symbols completed. UBER took 1.1s. Estimated remaining: 1m 13s. Rate: 156.3 symbols/min [2025-10-13T22:44:01.887320] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:01.888126] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52320 primary records. [2025-10-13T22:44:01.888189] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-13T22:44:01.903762] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-13T22:44:01.903850] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-13T22:44:01.906636] [INFO ] [MAIN ] Derivative Progress: 1620/1810 symbols completed. UBS took 0.8s. Estimated remaining: 1m 13s. Rate: 156.4 symbols/min [2025-10-13T22:44:01.907398] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:01.907297] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:01.908546] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:01.977032] [DEBUG] [LOCAL ] UE: Loaded 42613 existing records from primary storage. [2025-10-13T22:44:01.977309] [INFO ] [MAIN ] UE: Loaded 42613 primary data records. [2025-10-13T22:44:02.111322] [DEBUG] [LOCAL ] UCB: Loaded 37769 existing records from primary storage. [2025-10-13T22:44:02.112484] [INFO ] [MAIN ] UCB: Loaded 37769 primary data records. [2025-10-13T22:44:02.112332] [DEBUG] [LOCAL ] UDR: Loaded 52006 existing records from primary storage. [2025-10-13T22:44:02.113059] [INFO ] [MAIN ] UDR: Loaded 52006 primary data records. [2025-10-13T22:44:03.063414] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:03.065508] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42613 primary records. [2025-10-13T22:44:03.065728] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-13T22:44:03.092825] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-13T22:44:03.093506] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-13T22:44:03.109350] [INFO ] [MAIN ] Derivative Progress: 1621/1810 symbols completed. UE took 1.2s. Estimated remaining: 1m 13s. Rate: 156.2 symbols/min [2025-10-13T22:44:03.109783] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:03.110122] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:03.125880] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 52006 primary records. [2025-10-13T22:44:03.127190] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-13T22:44:03.126846] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:03.129696] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37769 primary records. [2025-10-13T22:44:03.149141] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-13T22:44:03.153945] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-13T22:44:03.154208] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-13T22:44:03.159618] [INFO ] [MAIN ] Derivative Progress: 1622/1810 symbols completed. UDR took 1.3s. Estimated remaining: 1m 12s. Rate: 156.3 symbols/min [2025-10-13T22:44:03.164402] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:03.174594] [DEBUG] [LOCAL ] UFI: Loaded 8136 existing records from primary storage. [2025-10-13T22:44:03.182233] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-13T22:44:03.182406] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-13T22:44:03.186261] [INFO ] [MAIN ] Derivative Progress: 1623/1810 symbols completed. UCB took 1.3s. Estimated remaining: 1m 12s. Rate: 156.4 symbols/min [2025-10-13T22:44:03.186667] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:03.179504] [INFO ] [MAIN ] UFI: Loaded 8136 primary data records. [2025-10-13T22:44:03.689865] [DEBUG] [LOCAL ] UGP: Loaded 42912 existing records from primary storage. [2025-10-13T22:44:03.694445] [DEBUG] [LOCAL ] UGI: Loaded 50599 existing records from primary storage. [2025-10-13T22:44:03.695682] [INFO ] [MAIN ] UGI: Loaded 50599 primary data records. [2025-10-13T22:44:03.695286] [INFO ] [MAIN ] UGP: Loaded 42912 primary data records. [2025-10-13T22:44:04.475924] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:04.583210] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8136 primary records. [2025-10-13T22:44:04.597396] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-13T22:44:04.620259] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-13T22:44:04.622247] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-13T22:44:04.625866] [INFO ] [MAIN ] Derivative Progress: 1624/1810 symbols completed. UFI took 1.5s. Estimated remaining: 1m 11s. Rate: 156.1 symbols/min [2025-10-13T22:44:04.627034] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:04.658626] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:04.665753] [DEBUG] [LOCAL ] UHAL: Loaded 16852 existing records from primary storage. [2025-10-13T22:44:04.668199] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50599 primary records. [2025-10-13T22:44:04.666163] [INFO ] [MAIN ] UHAL: Loaded 16852 primary data records. [2025-10-13T22:44:04.670338] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-13T22:44:04.773007] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:04.798290] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42912 primary records. [2025-10-13T22:44:04.798846] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-13T22:44:04.810516] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-13T22:44:04.811100] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-13T22:44:04.824319] [INFO ] [MAIN ] Derivative Progress: 1625/1810 symbols completed. UGI took 1.7s. Estimated remaining: 1m 11s. Rate: 156.2 symbols/min [2025-10-13T22:44:04.846033] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:04.889544] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-13T22:44:04.889816] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-13T22:44:04.893478] [INFO ] [MAIN ] Derivative Progress: 1626/1810 symbols completed. UGP took 1.7s. Estimated remaining: 1m 11s. Rate: 156.3 symbols/min [2025-10-13T22:44:04.915561] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:05.041088] [DEBUG] [LOCAL ] UHT: Loaded 10071 existing records from primary storage. [2025-10-13T22:44:05.041235] [INFO ] [MAIN ] UHT: Loaded 10071 primary data records. [2025-10-13T22:44:05.208446] [DEBUG] [LOCAL ] UHS: Loaded 40384 existing records from primary storage. [2025-10-13T22:44:05.249026] [INFO ] [MAIN ] UHS: Loaded 40384 primary data records. [2025-10-13T22:44:05.512604] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:05.566026] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16852 primary records. [2025-10-13T22:44:05.684474] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-13T22:44:05.708905] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-13T22:44:05.709611] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-13T22:44:05.711661] [INFO ] [MAIN ] Derivative Progress: 1627/1810 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 10s. Rate: 156.2 symbols/min [2025-10-13T22:44:05.711904] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:05.735987] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:05.736816] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10071 primary records. [2025-10-13T22:44:05.737178] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-13T22:44:05.743340] [DEBUG] [LOCAL ] UI: Loaded 13686 existing records from primary storage. [2025-10-13T22:44:05.750375] [INFO ] [MAIN ] UI: Loaded 13686 primary data records. [2025-10-13T22:44:05.796055] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-13T22:44:05.823226] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-13T22:44:05.830876] [INFO ] [MAIN ] Derivative Progress: 1628/1810 symbols completed. UHT took 0.9s. Estimated remaining: 1m 10s. Rate: 156.2 symbols/min [2025-10-13T22:44:05.840008] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:05.893114] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:05.893957] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40384 primary records. [2025-10-13T22:44:05.904298] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-13T22:44:06.140541] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-13T22:44:06.140710] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-13T22:44:06.143239] [INFO ] [MAIN ] Derivative Progress: 1629/1810 symbols completed. UHS took 1.3s. Estimated remaining: 1m 10s. Rate: 156.2 symbols/min [2025-10-13T22:44:06.143634] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:06.162320] [DEBUG] [LOCAL ] UIS: Loaded 36900 existing records from primary storage. [2025-10-13T22:44:06.162579] [INFO ] [MAIN ] UIS: Loaded 36900 primary data records. [2025-10-13T22:44:06.497826] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:06.499603] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13686 primary records. [2025-10-13T22:44:06.499720] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-13T22:44:06.523700] [DEBUG] [LOCAL ] UL: Loaded 53079 existing records from primary storage. [2025-10-13T22:44:06.528545] [INFO ] [MAIN ] UL: Loaded 53079 primary data records. [2025-10-13T22:44:06.616400] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-13T22:44:06.635671] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-13T22:44:06.641572] [INFO ] [MAIN ] Derivative Progress: 1630/1810 symbols completed. UI took 0.9s. Estimated remaining: 1m 9s. Rate: 156.2 symbols/min [2025-10-13T22:44:06.657899] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:06.854095] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:06.855417] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36900 primary records. [2025-10-13T22:44:06.855796] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-13T22:44:06.895475] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-13T22:44:06.895733] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-13T22:44:06.898215] [INFO ] [MAIN ] Derivative Progress: 1631/1810 symbols completed. UIS took 1.1s. Estimated remaining: 1m 9s. Rate: 156.2 symbols/min [2025-10-13T22:44:06.898586] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:06.899765] [DEBUG] [LOCAL ] ULS: Loaded 39048 existing records from primary storage. [2025-10-13T22:44:06.900276] [INFO ] [MAIN ] ULS: Loaded 39048 primary data records. [2025-10-13T22:44:07.022943] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:07.024205] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53079 primary records. [2025-10-13T22:44:07.024317] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-13T22:44:07.255618] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-13T22:44:07.255849] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-13T22:44:07.257975] [INFO ] [MAIN ] Derivative Progress: 1632/1810 symbols completed. UL took 1.1s. Estimated remaining: 1m 8s. Rate: 156.2 symbols/min [2025-10-13T22:44:07.258865] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:07.282024] [DEBUG] [LOCAL ] UMC: Loaded 52680 existing records from primary storage. [2025-10-13T22:44:07.282426] [INFO ] [MAIN ] UMC: Loaded 52680 primary data records. [2025-10-13T22:44:07.632420] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:07.635092] [DEBUG] [LOCAL ] UMH: Loaded 33956 existing records from primary storage. [2025-10-13T22:44:07.633869] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39048 primary records. [2025-10-13T22:44:07.635291] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-13T22:44:07.636018] [INFO ] [MAIN ] UMH: Loaded 33956 primary data records. [2025-10-13T22:44:07.740161] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-13T22:44:07.757563] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-13T22:44:07.765745] [INFO ] [MAIN ] Derivative Progress: 1633/1810 symbols completed. ULS took 1.1s. Estimated remaining: 1m 8s. Rate: 156.2 symbols/min [2025-10-13T22:44:08.007181] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:08.008275] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52680 primary records. [2025-10-13T22:44:08.008526] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-13T22:44:08.027974] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-13T22:44:08.028447] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-13T22:44:08.031138] [INFO ] [MAIN ] Derivative Progress: 1634/1810 symbols completed. UMC took 1.1s. Estimated remaining: 1m 8s. Rate: 156.2 symbols/min [2025-10-13T22:44:08.048218] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:08.048910] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33956 primary records. [2025-10-13T22:44:08.048972] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-13T22:44:08.064385] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-13T22:44:08.064447] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-13T22:44:08.067133] [INFO ] [MAIN ] Derivative Progress: 1635/1810 symbols completed. UMH took 0.8s. Estimated remaining: 1m 7s. Rate: 156.3 symbols/min [2025-10-13T22:44:08.067670] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:08.067535] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:08.067768] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:08.084564] [DEBUG] [LOCAL ] UNF: Loaded 11761 existing records from primary storage. [2025-10-13T22:44:08.084829] [INFO ] [MAIN ] UNF: Loaded 11761 primary data records. [2025-10-13T22:44:08.243296] [DEBUG] [LOCAL ] UNFI: Loaded 42529 existing records from primary storage. [2025-10-13T22:44:08.276869] [INFO ] [MAIN ] UNFI: Loaded 42529 primary data records. [2025-10-13T22:44:08.522032] [DEBUG] [LOCAL ] UNH: Loaded 53806 existing records from primary storage. [2025-10-13T22:44:08.530824] [INFO ] [MAIN ] UNH: Loaded 53806 primary data records. [2025-10-13T22:44:09.058224] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:09.060234] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11761 primary records. [2025-10-13T22:44:09.060750] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-13T22:44:09.083443] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-13T22:44:09.084597] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-13T22:44:09.088260] [INFO ] [MAIN ] Derivative Progress: 1636/1810 symbols completed. UNF took 1.0s. Estimated remaining: 1m 7s. Rate: 156.2 symbols/min [2025-10-13T22:44:09.089575] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:09.103528] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:09.104422] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42529 primary records. [2025-10-13T22:44:09.104878] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-13T22:44:09.124724] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-13T22:44:09.125082] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-13T22:44:09.127089] [INFO ] [MAIN ] Derivative Progress: 1637/1810 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 6s. Rate: 156.3 symbols/min [2025-10-13T22:44:09.135056] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:09.140760] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:09.142053] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53806 primary records. [2025-10-13T22:44:09.142213] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-13T22:44:09.162460] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-13T22:44:09.162383] [DEBUG] [LOCAL ] UNMA: Loaded 3545 existing records from primary storage. [2025-10-13T22:44:09.162727] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-13T22:44:09.165417] [INFO ] [MAIN ] Derivative Progress: 1638/1810 symbols completed. UNH took 1.1s. Estimated remaining: 1m 6s. Rate: 156.3 symbols/min [2025-10-13T22:44:09.165563] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:09.165891] [INFO ] [MAIN ] UNMA: Loaded 3545 primary data records. [2025-10-13T22:44:09.339976] [DEBUG] [LOCAL ] UNM: Loaded 48201 existing records from primary storage. [2025-10-13T22:44:09.358462] [INFO ] [MAIN ] UNM: Loaded 48201 primary data records. [2025-10-13T22:44:09.674531] [DEBUG] [LOCAL ] UNP: Loaded 53333 existing records from primary storage. [2025-10-13T22:44:09.693195] [INFO ] [MAIN ] UNP: Loaded 53333 primary data records. [2025-10-13T22:44:10.217614] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:10.219101] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3545 primary records. [2025-10-13T22:44:10.219577] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-13T22:44:10.254042] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-10-13T22:44:10.254733] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-13T22:44:10.256840] [INFO ] [MAIN ] Derivative Progress: 1639/1810 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 6s. Rate: 156.2 symbols/min [2025-10-13T22:44:10.254389] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:10.258036] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48201 primary records. [2025-10-13T22:44:10.258502] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:10.258736] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-13T22:44:10.294439] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-13T22:44:10.294941] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-13T22:44:10.294854] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:10.298110] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53333 primary records. [2025-10-13T22:44:10.298196] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-13T22:44:10.297229] [INFO ] [MAIN ] Derivative Progress: 1640/1810 symbols completed. UNM took 1.2s. Estimated remaining: 1m 5s. Rate: 156.3 symbols/min [2025-10-13T22:44:10.299258] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:10.315144] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-13T22:44:10.315240] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-13T22:44:10.317687] [INFO ] [MAIN ] Derivative Progress: 1641/1810 symbols completed. UNP took 1.2s. Estimated remaining: 1m 5s. Rate: 156.3 symbols/min [2025-10-13T22:44:10.317924] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:10.348325] [DEBUG] [LOCAL ] UP: Loaded 43941 existing records from primary storage. [2025-10-13T22:44:10.348557] [INFO ] [MAIN ] UP: Loaded 43941 primary data records. [2025-10-13T22:44:10.506957] [DEBUG] [LOCAL ] URI: Loaded 34885 existing records from primary storage. [2025-10-13T22:44:10.544720] [INFO ] [MAIN ] URI: Loaded 34885 primary data records. [2025-10-13T22:44:10.772706] [DEBUG] [LOCAL ] UPS: Loaded 53718 existing records from primary storage. [2025-10-13T22:44:10.799073] [INFO ] [MAIN ] UPS: Loaded 53718 primary data records. [2025-10-13T22:44:11.314905] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:11.316674] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43941 primary records. [2025-10-13T22:44:11.316992] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-13T22:44:11.346115] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:11.347861] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 34885 primary records. [2025-10-13T22:44:11.348129] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-13T22:44:11.364194] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-13T22:44:11.365685] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-13T22:44:11.370852] [INFO ] [MAIN ] Derivative Progress: 1642/1810 symbols completed. UP took 1.1s. Estimated remaining: 1m 5s. Rate: 156.2 symbols/min [2025-10-13T22:44:11.371624] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:11.372680] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-13T22:44:11.375167] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-13T22:44:11.377572] [INFO ] [MAIN ] Derivative Progress: 1643/1810 symbols completed. URI took 1.1s. Estimated remaining: 1m 4s. Rate: 156.3 symbols/min [2025-10-13T22:44:11.378187] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:11.392274] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:44:11.393273] [INFO ] [MAIN ] UPS: Generated 1793 derivative records from 53718 primary records. [2025-10-13T22:44:11.393398] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-13T22:44:11.426194] [DEBUG] [LOCAL ] UPS: Derivative data saved (1793 records). [2025-10-13T22:44:11.441774] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-13T22:44:11.444461] [INFO ] [MAIN ] Derivative Progress: 1644/1810 symbols completed. UPS took 1.1s. Estimated remaining: 1m 4s. Rate: 156.3 symbols/min [2025-10-13T22:44:11.445162] [DEBUG] [LOCAL ] USAC: Loaded 21651 existing records from primary storage. [2025-10-13T22:44:11.445362] [INFO ] [MAIN ] USAC: Loaded 21651 primary data records. [2025-10-13T22:44:11.457180] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:11.543155] [DEBUG] [LOCAL ] USA: Loaded 36209 existing records from primary storage. [2025-10-13T22:44:11.564976] [INFO ] [MAIN ] USA: Loaded 36209 primary data records. [2025-10-13T22:44:12.132201] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-13T22:44:12.134423] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-13T22:44:12.447569] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:12.449093] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21651 primary records. [2025-10-13T22:44:12.449282] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-13T22:44:12.468803] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-13T22:44:12.469764] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-13T22:44:12.471911] [INFO ] [MAIN ] Derivative Progress: 1645/1810 symbols completed. USAC took 1.1s. Estimated remaining: 1m 3s. Rate: 156.2 symbols/min [2025-10-13T22:44:12.472262] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:12.486385] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:12.487254] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36209 primary records. [2025-10-13T22:44:12.487847] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-13T22:44:12.507495] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-13T22:44:12.509697] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-13T22:44:12.513006] [INFO ] [MAIN ] Derivative Progress: 1646/1810 symbols completed. USA took 1.1s. Estimated remaining: 1m 3s. Rate: 156.3 symbols/min [2025-10-13T22:44:12.513712] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:12.533491] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:12.534816] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-13T22:44:12.535142] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-13T22:44:12.569480] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-13T22:44:12.573859] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-13T22:44:12.576417] [INFO ] [MAIN ] Derivative Progress: 1647/1810 symbols completed. USB took 1.1s. Estimated remaining: 1m 3s. Rate: 156.4 symbols/min [2025-10-13T22:44:12.576768] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:12.586375] [DEBUG] [LOCAL ] USNA: Loaded 17862 existing records from primary storage. [2025-10-13T22:44:12.600732] [INFO ] [MAIN ] USNA: Loaded 17862 primary data records. [2025-10-13T22:44:12.601908] [DEBUG] [LOCAL ] USFD: Loaded 51157 existing records from primary storage. [2025-10-13T22:44:12.616889] [INFO ] [MAIN ] USFD: Loaded 51157 primary data records. [2025-10-13T22:44:12.749338] [DEBUG] [LOCAL ] USPH: Loaded 17123 existing records from primary storage. [2025-10-13T22:44:12.777351] [INFO ] [MAIN ] USPH: Loaded 17123 primary data records. [2025-10-13T22:44:13.549982] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:13.563383] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51157 primary records. [2025-10-13T22:44:13.563756] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:13.565051] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17862 primary records. [2025-10-13T22:44:13.564034] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-13T22:44:13.565190] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-13T22:44:13.596434] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-13T22:44:13.598414] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-13T22:44:13.615036] [INFO ] [MAIN ] Derivative Progress: 1648/1810 symbols completed. USNA took 1.1s. Estimated remaining: 1m 2s. Rate: 156.2 symbols/min [2025-10-13T22:44:13.617329] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:13.618595] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17123 primary records. [2025-10-13T22:44:13.617754] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-13T22:44:13.618771] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-13T22:44:13.620777] [INFO ] [MAIN ] Derivative Progress: 1649/1810 symbols completed. USFD took 1.1s. Estimated remaining: 1m 2s. Rate: 156.3 symbols/min [2025-10-13T22:44:13.621046] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-13T22:44:13.637019] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-13T22:44:13.637167] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-13T22:44:13.639818] [INFO ] [MAIN ] Derivative Progress: 1650/1810 symbols completed. USPH took 1.1s. Estimated remaining: 1m 1s. Rate: 156.4 symbols/min [2025-10-13T22:44:13.640487] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:13.640426] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:13.640329] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:13.654675] [DEBUG] [LOCAL ] UTL: Loaded 11753 existing records from primary storage. [2025-10-13T22:44:13.655288] [INFO ] [MAIN ] UTL: Loaded 11753 primary data records. [2025-10-13T22:44:13.795494] [DEBUG] [LOCAL ] UTF: Loaded 30678 existing records from primary storage. [2025-10-13T22:44:13.812618] [INFO ] [MAIN ] UTF: Loaded 30678 primary data records. [2025-10-13T22:44:13.796897] [DEBUG] [LOCAL ] UTI: Loaded 40604 existing records from primary storage. [2025-10-13T22:44:13.856148] [INFO ] [MAIN ] UTI: Loaded 40604 primary data records. [2025-10-13T22:44:14.639351] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:14.640218] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11753 primary records. [2025-10-13T22:44:14.640390] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-13T22:44:14.657764] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-13T22:44:14.658851] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-13T22:44:14.661691] [INFO ] [MAIN ] Derivative Progress: 1651/1810 symbols completed. UTL took 1.0s. Estimated remaining: 1m 1s. Rate: 156.2 symbols/min [2025-10-13T22:44:14.662632] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:14.679325] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:14.680293] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 30678 primary records. [2025-10-13T22:44:14.680450] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-13T22:44:14.694608] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:14.711172] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-13T22:44:14.711949] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40604 primary records. [2025-10-13T22:44:14.712114] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-13T22:44:14.712291] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-13T22:44:14.714863] [INFO ] [MAIN ] Derivative Progress: 1652/1810 symbols completed. UTF took 1.1s. Estimated remaining: 1m 1s. Rate: 156.3 symbols/min [2025-10-13T22:44:14.715535] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:14.732097] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-13T22:44:14.732241] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-13T22:44:14.734811] [INFO ] [MAIN ] Derivative Progress: 1653/1810 symbols completed. UTI took 1.1s. Estimated remaining: 1m 0s. Rate: 156.4 symbols/min [2025-10-13T22:44:14.744340] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:14.759465] [DEBUG] [LOCAL ] UVE: Loaded 21929 existing records from primary storage. [2025-10-13T22:44:14.760512] [INFO ] [MAIN ] UVE: Loaded 21929 primary data records. [2025-10-13T22:44:14.827067] [DEBUG] [LOCAL ] UTZ: Loaded 44608 existing records from primary storage. [2025-10-13T22:44:14.839341] [INFO ] [MAIN ] UTZ: Loaded 44608 primary data records. [2025-10-13T22:44:14.958489] [DEBUG] [LOCAL ] UVV: Loaded 22811 existing records from primary storage. [2025-10-13T22:44:14.993296] [INFO ] [MAIN ] UVV: Loaded 22811 primary data records. [2025-10-13T22:44:15.768304] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:15.768037] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:15.769174] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21929 primary records. [2025-10-13T22:44:15.769277] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-13T22:44:15.770334] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44608 primary records. [2025-10-13T22:44:15.770734] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-13T22:44:15.801489] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-13T22:44:15.801696] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-13T22:44:15.805076] [INFO ] [MAIN ] Derivative Progress: 1654/1810 symbols completed. UTZ took 1.1s. Estimated remaining: 59.9s. Rate: 156.2 symbols/min [2025-10-13T22:44:15.802994] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-13T22:44:15.806995] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-13T22:44:15.806727] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:15.809555] [INFO ] [MAIN ] Derivative Progress: 1655/1810 symbols completed. UVE took 1.1s. Estimated remaining: 59.5s. Rate: 156.3 symbols/min [2025-10-13T22:44:15.817805] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:15.823171] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:15.823889] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22811 primary records. [2025-10-13T22:44:15.824084] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-13T22:44:15.841954] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-13T22:44:15.842164] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-13T22:44:15.844919] [INFO ] [MAIN ] Derivative Progress: 1656/1810 symbols completed. UVV took 1.1s. Estimated remaining: 59.1s. Rate: 156.4 symbols/min [2025-10-13T22:44:15.845121] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:15.849959] [DEBUG] [LOCAL ] UZD: Loaded 6333 existing records from primary storage. [2025-10-13T22:44:15.850176] [INFO ] [MAIN ] UZD: Loaded 6333 primary data records. [2025-10-13T22:44:15.970102] [DEBUG] [LOCAL ] UZE: Loaded 7446 existing records from primary storage. [2025-10-13T22:44:15.991003] [INFO ] [MAIN ] UZE: Loaded 7446 primary data records. [2025-10-13T22:44:16.262355] [DEBUG] [LOCAL ] UWMC: Loaded 52914 existing records from primary storage. [2025-10-13T22:44:16.274173] [INFO ] [MAIN ] UWMC: Loaded 52914 primary data records. [2025-10-13T22:44:16.790699] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:16.791987] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6333 primary records. [2025-10-13T22:44:16.792360] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-13T22:44:16.814145] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-13T22:44:16.814824] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-13T22:44:16.825006] [INFO ] [MAIN ] Derivative Progress: 1657/1810 symbols completed. UZD took 1.0s. Estimated remaining: 58.8s. Rate: 156.3 symbols/min [2025-10-13T22:44:16.830511] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:16.830895] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:16.832265] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7446 primary records. [2025-10-13T22:44:16.832601] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-13T22:44:16.850677] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-13T22:44:16.851553] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-13T22:44:16.853953] [INFO ] [MAIN ] Derivative Progress: 1658/1810 symbols completed. UZE took 1.0s. Estimated remaining: 58.3s. Rate: 156.3 symbols/min [2025-10-13T22:44:16.857956] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:16.858700] [DEBUG] [LOCAL ] UZF: Loaded 6210 existing records from primary storage. [2025-10-13T22:44:16.858880] [INFO ] [MAIN ] UZF: Loaded 6210 primary data records. [2025-10-13T22:44:16.935213] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:16.963441] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52914 primary records. [2025-10-13T22:44:16.974005] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-13T22:44:17.192984] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-13T22:44:17.193150] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-13T22:44:17.195970] [INFO ] [MAIN ] Derivative Progress: 1659/1810 symbols completed. UWMC took 1.4s. Estimated remaining: 57.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:17.196972] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:17.236202] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-13T22:44:17.236509] [INFO ] [MAIN ] V: Loaded 53753 primary data records. [2025-10-13T22:44:17.401755] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:17.439312] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6210 primary records. [2025-10-13T22:44:17.585093] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-13T22:44:17.589373] [DEBUG] [LOCAL ] VAC: Loaded 34246 existing records from primary storage. [2025-10-13T22:44:17.598138] [INFO ] [MAIN ] VAC: Loaded 34246 primary data records. [2025-10-13T22:44:17.610525] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-13T22:44:17.627302] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-13T22:44:17.653485] [INFO ] [MAIN ] Derivative Progress: 1660/1810 symbols completed. UZF took 0.8s. Estimated remaining: 57.6s. Rate: 156.3 symbols/min [2025-10-13T22:44:17.677842] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:17.983396] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:17.984455] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53753 primary records. [2025-10-13T22:44:17.984537] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-13T22:44:18.002774] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-13T22:44:18.002927] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-13T22:44:18.005674] [INFO ] [MAIN ] Derivative Progress: 1661/1810 symbols completed. V took 1.1s. Estimated remaining: 57.2s. Rate: 156.3 symbols/min [2025-10-13T22:44:18.006038] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:18.024335] [DEBUG] [LOCAL ] VAL: Loaded 50170 existing records from primary storage. [2025-10-13T22:44:18.024679] [INFO ] [MAIN ] VAL: Loaded 50170 primary data records. [2025-10-13T22:44:18.170273] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:18.197898] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34246 primary records. [2025-10-13T22:44:18.203761] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-13T22:44:18.368917] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-13T22:44:18.369761] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-13T22:44:18.372246] [INFO ] [MAIN ] Derivative Progress: 1662/1810 symbols completed. VAC took 1.2s. Estimated remaining: 56.8s. Rate: 156.3 symbols/min [2025-10-13T22:44:18.372503] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:18.391925] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-13T22:44:18.392507] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-13T22:44:18.416182] [DEBUG] [LOCAL ] VATE: Loaded 5225 existing records from primary storage. [2025-10-13T22:44:18.438171] [INFO ] [MAIN ] VATE: Loaded 5225 primary data records. [2025-10-13T22:44:18.996961] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:18.998790] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50170 primary records. [2025-10-13T22:44:18.998896] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-13T22:44:19.017135] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-13T22:44:19.017452] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-13T22:44:19.020048] [INFO ] [MAIN ] Derivative Progress: 1663/1810 symbols completed. VAL took 1.3s. Estimated remaining: 56.4s. Rate: 156.3 symbols/min [2025-10-13T22:44:19.042117] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:19.043130] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-13T22:44:19.043396] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-13T22:44:19.071826] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:19.073381] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5225 primary records. [2025-10-13T22:44:19.073724] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-13T22:44:19.090380] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-13T22:44:19.091255] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-13T22:44:19.094008] [INFO ] [MAIN ] Derivative Progress: 1664/1810 symbols completed. VATE took 0.7s. Estimated remaining: 56.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:19.091178] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-13T22:44:19.094282] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-13T22:44:19.096334] [INFO ] [MAIN ] Derivative Progress: 1665/1810 symbols completed. VALE took 1.1s. Estimated remaining: 55.6s. Rate: 156.4 symbols/min [2025-10-13T22:44:19.096829] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:19.096710] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:19.096774] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:19.106093] [DEBUG] [LOCAL ] VBF: Loaded 7121 existing records from primary storage. [2025-10-13T22:44:19.109612] [INFO ] [MAIN ] VBF: Loaded 7121 primary data records. [2025-10-13T22:44:19.190125] [DEBUG] [LOCAL ] VCV: Loaded 13590 existing records from primary storage. [2025-10-13T22:44:19.217136] [INFO ] [MAIN ] VCV: Loaded 13590 primary data records. [2025-10-13T22:44:19.560229] [DEBUG] [LOCAL ] VEEV: Loaded 47238 existing records from primary storage. [2025-10-13T22:44:19.578687] [INFO ] [MAIN ] VEEV: Loaded 47238 primary data records. [2025-10-13T22:44:20.106352] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:20.116081] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7121 primary records. [2025-10-13T22:44:20.121925] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-13T22:44:20.123140] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:20.124276] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13590 primary records. [2025-10-13T22:44:20.133697] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-13T22:44:20.140732] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-13T22:44:20.141160] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-13T22:44:20.144273] [INFO ] [MAIN ] Derivative Progress: 1666/1810 symbols completed. VBF took 1.0s. Estimated remaining: 55.3s. Rate: 156.3 symbols/min [2025-10-13T22:44:20.144896] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:20.162489] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-13T22:44:20.163101] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-13T22:44:20.169310] [INFO ] [MAIN ] Derivative Progress: 1667/1810 symbols completed. VCV took 1.1s. Estimated remaining: 54.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:20.169614] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:20.189295] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:20.190510] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47238 primary records. [2025-10-13T22:44:20.190757] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-13T22:44:20.189763] [DEBUG] [LOCAL ] VEL: Loaded 12240 existing records from primary storage. [2025-10-13T22:44:20.191477] [INFO ] [MAIN ] VEL: Loaded 12240 primary data records. [2025-10-13T22:44:20.324831] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-13T22:44:20.335325] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-13T22:44:20.390029] [INFO ] [MAIN ] Derivative Progress: 1668/1810 symbols completed. VEEV took 1.3s. Estimated remaining: 54.5s. Rate: 156.4 symbols/min [2025-10-13T22:44:20.510496] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:20.517919] [DEBUG] [LOCAL ] VET: Loaded 44077 existing records from primary storage. [2025-10-13T22:44:20.527117] [INFO ] [MAIN ] VET: Loaded 44077 primary data records. [2025-10-13T22:44:20.858885] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:20.874077] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12240 primary records. [2025-10-13T22:44:20.874214] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-13T22:44:20.875962] [DEBUG] [LOCAL ] VFC: Loaded 53606 existing records from primary storage. [2025-10-13T22:44:20.876162] [INFO ] [MAIN ] VFC: Loaded 53606 primary data records. [2025-10-13T22:44:20.997900] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-13T22:44:21.021387] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:21.015743] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-13T22:44:21.027383] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44077 primary records. [2025-10-13T22:44:21.040217] [INFO ] [MAIN ] Derivative Progress: 1669/1810 symbols completed. VEL took 0.9s. Estimated remaining: 54.1s. Rate: 156.3 symbols/min [2025-10-13T22:44:21.062492] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-13T22:44:21.053938] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:21.222864] [DEBUG] [LOCAL ] VGI: Loaded 5217 existing records from primary storage. [2025-10-13T22:44:21.222977] [INFO ] [MAIN ] VGI: Loaded 5217 primary data records. [2025-10-13T22:44:21.219940] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-13T22:44:21.223131] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-13T22:44:21.236628] [INFO ] [MAIN ] Derivative Progress: 1670/1810 symbols completed. VET took 1.1s. Estimated remaining: 53.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:21.256433] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:21.420386] [DEBUG] [LOCAL ] VGM: Loaded 18509 existing records from primary storage. [2025-10-13T22:44:21.420679] [INFO ] [MAIN ] VGM: Loaded 18509 primary data records. [2025-10-13T22:44:21.881564] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:21.882512] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53606 primary records. [2025-10-13T22:44:21.882595] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-13T22:44:21.902243] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-13T22:44:21.902609] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-13T22:44:21.905012] [INFO ] [MAIN ] Derivative Progress: 1671/1810 symbols completed. VFC took 1.4s. Estimated remaining: 53.4s. Rate: 156.3 symbols/min [2025-10-13T22:44:21.906327] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:21.911998] [DEBUG] [LOCAL ] VHI: Loaded 2756 existing records from primary storage. [2025-10-13T22:44:21.912409] [INFO ] [MAIN ] VHI: Loaded 2756 primary data records. [2025-10-13T22:44:22.031544] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:22.037858] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5217 primary records. [2025-10-13T22:44:22.043872] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-13T22:44:22.123678] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-13T22:44:22.247367] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-13T22:44:22.250191] [INFO ] [MAIN ] Derivative Progress: 1672/1810 symbols completed. VGI took 1.2s. Estimated remaining: 53.0s. Rate: 156.3 symbols/min [2025-10-13T22:44:22.250329] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:22.247911] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:22.252298] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18509 primary records. [2025-10-13T22:44:22.252501] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-13T22:44:22.270183] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-13T22:44:22.270464] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-13T22:44:22.272972] [INFO ] [MAIN ] Derivative Progress: 1673/1810 symbols completed. VGM took 1.0s. Estimated remaining: 52.5s. Rate: 156.4 symbols/min [2025-10-13T22:44:22.273578] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:22.295050] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:22.296271] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2756 primary records. [2025-10-13T22:44:22.296391] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-13T22:44:22.324385] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-13T22:44:22.324572] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-13T22:44:22.327020] [INFO ] [MAIN ] Derivative Progress: 1674/1810 symbols completed. VHI took 0.4s. Estimated remaining: 52.1s. Rate: 156.5 symbols/min [2025-10-13T22:44:22.339241] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:22.356593] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-13T22:44:22.356816] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-13T22:44:22.475158] [DEBUG] [LOCAL ] VIK: Loaded 52445 existing records from primary storage. [2025-10-13T22:44:22.491092] [INFO ] [MAIN ] VIK: Loaded 52445 primary data records. [2025-10-13T22:44:22.793822] [DEBUG] [LOCAL ] VIPS: Loaded 51246 existing records from primary storage. [2025-10-13T22:44:22.805194] [INFO ] [MAIN ] VIPS: Loaded 51246 primary data records. [2025-10-13T22:44:23.349292] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:23.350162] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53653 primary records. [2025-10-13T22:44:23.350428] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-13T22:44:23.370708] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-13T22:44:23.370916] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-13T22:44:23.373167] [INFO ] [MAIN ] Derivative Progress: 1675/1810 symbols completed. VICI took 1.1s. Estimated remaining: 51.8s. Rate: 156.3 symbols/min [2025-10-13T22:44:23.373451] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:23.390252] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:23.391076] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52445 primary records. [2025-10-13T22:44:23.391240] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-13T22:44:23.410519] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-13T22:44:23.410862] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-13T22:44:23.413240] [INFO ] [MAIN ] Derivative Progress: 1676/1810 symbols completed. VIK took 1.1s. Estimated remaining: 51.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:23.413628] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:23.426869] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:23.427827] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51246 primary records. [2025-10-13T22:44:23.427994] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-13T22:44:23.455934] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-13T22:44:23.456082] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-13T22:44:23.459691] [INFO ] [MAIN ] Derivative Progress: 1677/1810 symbols completed. VIPS took 1.1s. Estimated remaining: 51.0s. Rate: 156.5 symbols/min [2025-10-13T22:44:23.460021] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:23.478084] [DEBUG] [LOCAL ] VIRT: Loaded 46744 existing records from primary storage. [2025-10-13T22:44:23.487405] [INFO ] [MAIN ] VIRT: Loaded 46744 primary data records. [2025-10-13T22:44:23.622583] [DEBUG] [LOCAL ] VIST: Loaded 46429 existing records from primary storage. [2025-10-13T22:44:23.633479] [INFO ] [MAIN ] VIST: Loaded 46429 primary data records. [2025-10-13T22:44:23.827405] [DEBUG] [LOCAL ] VIV: Loaded 44909 existing records from primary storage. [2025-10-13T22:44:23.959709] [INFO ] [MAIN ] VIV: Loaded 44909 primary data records. [2025-10-13T22:44:24.484389] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:24.487980] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46744 primary records. [2025-10-13T22:44:24.488333] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-13T22:44:24.511845] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:24.515875] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46429 primary records. [2025-10-13T22:44:24.516069] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-13T22:44:24.530898] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-13T22:44:24.533602] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-13T22:44:24.539323] [INFO ] [MAIN ] Derivative Progress: 1678/1810 symbols completed. VIRT took 1.2s. Estimated remaining: 50.7s. Rate: 156.3 symbols/min [2025-10-13T22:44:24.542099] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-13T22:44:24.542682] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-13T22:44:24.545031] [INFO ] [MAIN ] Derivative Progress: 1679/1810 symbols completed. VIST took 1.1s. Estimated remaining: 50.2s. Rate: 156.4 symbols/min [2025-10-13T22:44:24.559424] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:24.560079] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44909 primary records. [2025-10-13T22:44:24.560141] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-13T22:44:24.575402] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-13T22:44:24.575466] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-13T22:44:24.577912] [INFO ] [MAIN ] Derivative Progress: 1680/1810 symbols completed. VIV took 1.1s. Estimated remaining: 49.8s. Rate: 156.5 symbols/min [2025-10-13T22:44:24.578354] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:24.578274] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:24.578516] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:24.606827] [DEBUG] [LOCAL ] VKQ: Loaded 17504 existing records from primary storage. [2025-10-13T22:44:24.607007] [INFO ] [MAIN ] VKQ: Loaded 17504 primary data records. [2025-10-13T22:44:24.724976] [DEBUG] [LOCAL ] VLN: Loaded 30394 existing records from primary storage. [2025-10-13T22:44:24.761111] [INFO ] [MAIN ] VLN: Loaded 30394 primary data records. [2025-10-13T22:44:24.941787] [DEBUG] [LOCAL ] VLO: Loaded 53046 existing records from primary storage. [2025-10-13T22:44:25.110501] [INFO ] [MAIN ] VLO: Loaded 53046 primary data records. [2025-10-13T22:44:25.700747] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:25.702102] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17504 primary records. [2025-10-13T22:44:25.702923] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-13T22:44:25.728549] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-13T22:44:25.728970] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-13T22:44:25.739675] [INFO ] [MAIN ] Derivative Progress: 1681/1810 symbols completed. VKQ took 1.2s. Estimated remaining: 49.5s. Rate: 156.3 symbols/min [2025-10-13T22:44:25.745166] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:25.745932] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:25.747115] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 30394 primary records. [2025-10-13T22:44:25.747313] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-13T22:44:25.765095] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-13T22:44:25.765527] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-13T22:44:25.768229] [INFO ] [MAIN ] Derivative Progress: 1682/1810 symbols completed. VLN took 1.2s. Estimated remaining: 49.1s. Rate: 156.4 symbols/min [2025-10-13T22:44:25.768800] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:25.791855] [DEBUG] [LOCAL ] VLT: Loaded 4440 existing records from primary storage. [2025-10-13T22:44:25.792186] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:25.792459] [INFO ] [MAIN ] VLT: Loaded 4440 primary data records. [2025-10-13T22:44:25.827242] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53046 primary records. [2025-10-13T22:44:25.846161] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-13T22:44:25.955521] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-13T22:44:25.956821] [DEBUG] [LOCAL ] VLRS: Loaded 39975 existing records from primary storage. [2025-10-13T22:44:25.973021] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-13T22:44:25.975873] [INFO ] [MAIN ] Derivative Progress: 1683/1810 symbols completed. VLO took 1.4s. Estimated remaining: 48.7s. Rate: 156.5 symbols/min [2025-10-13T22:44:25.973122] [INFO ] [MAIN ] VLRS: Loaded 39975 primary data records. [2025-10-13T22:44:26.004744] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:26.506261] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:26.507054] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4440 primary records. [2025-10-13T22:44:26.508700] [DEBUG] [LOCAL ] VLTO: Loaded 46167 existing records from primary storage. [2025-10-13T22:44:26.508996] [INFO ] [MAIN ] VLTO: Loaded 46167 primary data records. [2025-10-13T22:44:26.508915] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-13T22:44:26.598702] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-13T22:44:26.628727] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-13T22:44:26.635233] [INFO ] [MAIN ] Derivative Progress: 1684/1810 symbols completed. VLT took 0.9s. Estimated remaining: 48.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:26.651818] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:26.844503] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:26.845471] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 39975 primary records. [2025-10-13T22:44:26.845669] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-13T22:44:26.864923] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-13T22:44:26.865587] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-13T22:44:26.868730] [INFO ] [MAIN ] Derivative Progress: 1685/1810 symbols completed. VLRS took 1.1s. Estimated remaining: 47.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:26.869347] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:26.900253] [DEBUG] [LOCAL ] VMI: Loaded 15102 existing records from primary storage. [2025-10-13T22:44:26.900540] [INFO ] [MAIN ] VMI: Loaded 15102 primary data records. [2025-10-13T22:44:26.954227] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:26.993985] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46167 primary records. [2025-10-13T22:44:27.033131] [DEBUG] [LOCAL ] VMC: Loaded 42665 existing records from primary storage. [2025-10-13T22:44:27.032217] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-13T22:44:27.033546] [INFO ] [MAIN ] VMC: Loaded 42665 primary data records. [2025-10-13T22:44:27.322987] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-13T22:44:27.337492] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-13T22:44:27.347732] [INFO ] [MAIN ] Derivative Progress: 1686/1810 symbols completed. VLTO took 1.3s. Estimated remaining: 47.6s. Rate: 156.4 symbols/min [2025-10-13T22:44:27.358915] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:27.626896] [DEBUG] [LOCAL ] VMO: Loaded 20797 existing records from primary storage. [2025-10-13T22:44:27.627407] [INFO ] [MAIN ] VMO: Loaded 20797 primary data records. [2025-10-13T22:44:27.951135] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:27.952323] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15102 primary records. [2025-10-13T22:44:27.953765] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-13T22:44:27.987995] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:27.988824] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42665 primary records. [2025-10-13T22:44:27.987473] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-13T22:44:27.989075] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-13T22:44:27.989006] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-13T22:44:27.992778] [INFO ] [MAIN ] Derivative Progress: 1687/1810 symbols completed. VMI took 1.1s. Estimated remaining: 47.2s. Rate: 156.3 symbols/min [2025-10-13T22:44:27.994085] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:28.011093] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-13T22:44:28.011406] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-13T22:44:28.014033] [INFO ] [MAIN ] Derivative Progress: 1688/1810 symbols completed. VMC took 1.4s. Estimated remaining: 46.8s. Rate: 156.4 symbols/min [2025-10-13T22:44:28.014348] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:28.026198] [DEBUG] [LOCAL ] VNCE: Loaded 8785 existing records from primary storage. [2025-10-13T22:44:28.028020] [INFO ] [MAIN ] VNCE: Loaded 8785 primary data records. [2025-10-13T22:44:28.100708] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:28.117105] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20797 primary records. [2025-10-13T22:44:28.131861] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-13T22:44:28.235663] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-13T22:44:28.265729] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-13T22:44:28.280559] [INFO ] [MAIN ] Derivative Progress: 1689/1810 symbols completed. VMO took 0.9s. Estimated remaining: 46.4s. Rate: 156.5 symbols/min [2025-10-13T22:44:28.304085] [DEBUG] [LOCAL ] VNO: Loaded 48943 existing records from primary storage. [2025-10-13T22:44:28.302606] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:28.383912] [INFO ] [MAIN ] VNO: Loaded 48943 primary data records. [2025-10-13T22:44:28.762180] [DEBUG] [LOCAL ] VNT: Loaded 43883 existing records from primary storage. [2025-10-13T22:44:28.763277] [INFO ] [MAIN ] VNT: Loaded 43883 primary data records. [2025-10-13T22:44:28.762896] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:28.785040] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8785 primary records. [2025-10-13T22:44:28.827937] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-13T22:44:28.911438] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-13T22:44:28.924461] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-13T22:44:28.959875] [INFO ] [MAIN ] Derivative Progress: 1690/1810 symbols completed. VNCE took 1.0s. Estimated remaining: 46.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:29.077161] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:29.095823] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:29.099520] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48943 primary records. [2025-10-13T22:44:29.100082] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-13T22:44:29.116852] [DEBUG] [LOCAL ] VOC: Loaded 9019 existing records from primary storage. [2025-10-13T22:44:29.118269] [INFO ] [MAIN ] VOC: Loaded 9019 primary data records. [2025-10-13T22:44:29.225943] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-13T22:44:29.241984] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-13T22:44:29.244784] [INFO ] [MAIN ] Derivative Progress: 1691/1810 symbols completed. VNO took 1.2s. Estimated remaining: 45.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:29.250883] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:29.474838] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:29.476310] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43883 primary records. [2025-10-13T22:44:29.476434] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-13T22:44:29.494318] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-13T22:44:29.495330] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-13T22:44:29.497775] [INFO ] [MAIN ] Derivative Progress: 1692/1810 symbols completed. VNT took 1.2s. Estimated remaining: 45.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:29.498234] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:29.550079] [DEBUG] [LOCAL ] VOYA: Loaded 42227 existing records from primary storage. [2025-10-13T22:44:29.550461] [INFO ] [MAIN ] VOYA: Loaded 42227 primary data records. [2025-10-13T22:44:29.556309] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:29.557758] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9019 primary records. [2025-10-13T22:44:29.578388] [DEBUG] [LOCAL ] VPG: Loaded 17099 existing records from primary storage. [2025-10-13T22:44:29.578074] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-13T22:44:29.588441] [INFO ] [MAIN ] VPG: Loaded 17099 primary data records. [2025-10-13T22:44:29.799758] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-13T22:44:29.828013] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-13T22:44:29.837200] [INFO ] [MAIN ] Derivative Progress: 1693/1810 symbols completed. VOC took 0.8s. Estimated remaining: 44.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:30.211777] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:30.213884] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42227 primary records. [2025-10-13T22:44:30.214042] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-13T22:44:30.235175] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-13T22:44:30.235535] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-13T22:44:30.250552] [INFO ] [MAIN ] Derivative Progress: 1694/1810 symbols completed. VOYA took 1.0s. Estimated remaining: 44.5s. Rate: 156.4 symbols/min [2025-10-13T22:44:30.251002] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:30.252636] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17099 primary records. [2025-10-13T22:44:30.252777] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-13T22:44:30.268906] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-13T22:44:30.268998] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-13T22:44:30.271840] [INFO ] [MAIN ] Derivative Progress: 1695/1810 symbols completed. VPG took 0.8s. Estimated remaining: 44.1s. Rate: 156.5 symbols/min [2025-10-13T22:44:30.272557] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:30.272505] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:30.272425] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:30.283699] [DEBUG] [LOCAL ] VPV: Loaded 5439 existing records from primary storage. [2025-10-13T22:44:30.283993] [INFO ] [MAIN ] VPV: Loaded 5439 primary data records. [2025-10-13T22:44:30.499202] [DEBUG] [LOCAL ] VRE: Loaded 35162 existing records from primary storage. [2025-10-13T22:44:30.517263] [INFO ] [MAIN ] VRE: Loaded 35162 primary data records. [2025-10-13T22:44:30.527242] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-13T22:44:30.684749] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-13T22:44:31.272627] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:31.273838] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5439 primary records. [2025-10-13T22:44:31.274023] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-13T22:44:31.291831] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-13T22:44:31.292098] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-13T22:44:31.294968] [INFO ] [MAIN ] Derivative Progress: 1696/1810 symbols completed. VPV took 1.0s. Estimated remaining: 43.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:31.295294] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:31.328402] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:31.333711] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:31.340893] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-13T22:44:31.340056] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35162 primary records. [2025-10-13T22:44:31.341342] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-13T22:44:31.341239] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-13T22:44:31.341050] [DEBUG] [LOCAL ] VRTS: Loaded 9348 existing records from primary storage. [2025-10-13T22:44:31.342931] [INFO ] [MAIN ] VRTS: Loaded 9348 primary data records. [2025-10-13T22:44:31.367629] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-13T22:44:31.393066] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-13T22:44:31.412810] [INFO ] [MAIN ] Derivative Progress: 1697/1810 symbols completed. VRE took 1.1s. Estimated remaining: 43.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:31.433782] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:31.500691] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-13T22:44:31.530224] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-13T22:44:31.573368] [INFO ] [MAIN ] Derivative Progress: 1698/1810 symbols completed. VRT took 1.3s. Estimated remaining: 42.9s. Rate: 156.5 symbols/min [2025-10-13T22:44:31.573725] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:31.783884] [DEBUG] [LOCAL ] VSCO: Loaded 52734 existing records from primary storage. [2025-10-13T22:44:31.784456] [INFO ] [MAIN ] VSCO: Loaded 52734 primary data records. [2025-10-13T22:44:31.947326] [DEBUG] [LOCAL ] VSH: Loaded 48189 existing records from primary storage. [2025-10-13T22:44:31.963670] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:32.008897] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9348 primary records. [2025-10-13T22:44:32.041785] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-13T22:44:31.963956] [INFO ] [MAIN ] VSH: Loaded 48189 primary data records. [2025-10-13T22:44:32.228323] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-13T22:44:32.234028] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-13T22:44:32.255862] [INFO ] [MAIN ] Derivative Progress: 1699/1810 symbols completed. VRTS took 1.0s. Estimated remaining: 42.6s. Rate: 156.4 symbols/min [2025-10-13T22:44:32.259997] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:32.477293] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:32.478337] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52734 primary records. [2025-10-13T22:44:32.478505] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-13T22:44:32.496639] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-13T22:44:32.496906] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-13T22:44:32.513358] [INFO ] [MAIN ] Derivative Progress: 1700/1810 symbols completed. VSCO took 1.1s. Estimated remaining: 42.2s. Rate: 156.5 symbols/min [2025-10-13T22:44:32.513914] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:32.533791] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:32.534634] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48189 primary records. [2025-10-13T22:44:32.534777] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-13T22:44:32.555961] [DEBUG] [LOCAL ] VST: Loaded 53712 existing records from primary storage. [2025-10-13T22:44:32.567513] [INFO ] [MAIN ] VST: Loaded 53712 primary data records. [2025-10-13T22:44:32.717678] [DEBUG] [LOCAL ] VTEX: Loaded 43014 existing records from primary storage. [2025-10-13T22:44:32.710599] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-13T22:44:32.733550] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-13T22:44:32.738939] [INFO ] [MAIN ] VTEX: Loaded 43014 primary data records. [2025-10-13T22:44:32.741354] [INFO ] [MAIN ] Derivative Progress: 1701/1810 symbols completed. VSH took 1.2s. Estimated remaining: 41.8s. Rate: 156.5 symbols/min [2025-10-13T22:44:32.741599] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:33.274162] [DEBUG] [LOCAL ] VTLE: Loaded 48154 existing records from primary storage. [2025-10-13T22:44:33.274608] [INFO ] [MAIN ] VTLE: Loaded 48154 primary data records. [2025-10-13T22:44:33.450968] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:33.477823] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53712 primary records. [2025-10-13T22:44:33.627072] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-13T22:44:33.659307] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-13T22:44:33.659754] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-13T22:44:33.662340] [INFO ] [MAIN ] Derivative Progress: 1702/1810 symbols completed. VST took 1.4s. Estimated remaining: 41.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:33.662515] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:33.682309] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:33.683317] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43014 primary records. [2025-10-13T22:44:33.683415] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-13T22:44:33.711676] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-13T22:44:33.711823] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-13T22:44:33.715702] [INFO ] [MAIN ] Derivative Progress: 1703/1810 symbols completed. VTEX took 1.2s. Estimated remaining: 41.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:33.716276] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:33.716771] [DEBUG] [LOCAL ] VTMX: Loaded 17610 existing records from primary storage. [2025-10-13T22:44:33.717774] [INFO ] [MAIN ] VTMX: Loaded 17610 primary data records. [2025-10-13T22:44:33.849570] [DEBUG] [LOCAL ] VTN: Loaded 6997 existing records from primary storage. [2025-10-13T22:44:33.854913] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:33.855196] [INFO ] [MAIN ] VTN: Loaded 6997 primary data records. [2025-10-13T22:44:33.867332] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48154 primary records. [2025-10-13T22:44:33.868286] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-13T22:44:34.271928] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-13T22:44:34.276854] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-13T22:44:34.391517] [INFO ] [MAIN ] Derivative Progress: 1704/1810 symbols completed. VTLE took 1.6s. Estimated remaining: 40.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:34.393122] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:34.416947] [DEBUG] [LOCAL ] VTOL: Loaded 19518 existing records from primary storage. [2025-10-13T22:44:34.417390] [INFO ] [MAIN ] VTOL: Loaded 19518 primary data records. [2025-10-13T22:44:34.430464] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:34.431968] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17610 primary records. [2025-10-13T22:44:34.467564] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-13T22:44:34.574446] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-13T22:44:34.607090] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-13T22:44:34.610127] [INFO ] [MAIN ] Derivative Progress: 1705/1810 symbols completed. VTMX took 0.9s. Estimated remaining: 40.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:34.603775] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:34.650352] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 6997 primary records. [2025-10-13T22:44:34.623860] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:34.699707] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-13T22:44:34.775138] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-13T22:44:34.776217] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-13T22:44:34.779387] [INFO ] [MAIN ] Derivative Progress: 1706/1810 symbols completed. VTN took 1.1s. Estimated remaining: 39.9s. Rate: 156.5 symbols/min [2025-10-13T22:44:34.779862] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:34.824037] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:34.824806] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19518 primary records. [2025-10-13T22:44:34.824977] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-13T22:44:34.861411] [DEBUG] [LOCAL ] VTS: Loaded 30006 existing records from primary storage. [2025-10-13T22:44:34.864682] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-13T22:44:34.863174] [INFO ] [MAIN ] VTS: Loaded 30006 primary data records. [2025-10-13T22:44:34.865613] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-13T22:44:34.865442] [DEBUG] [LOCAL ] VTR: Loaded 52772 existing records from primary storage. [2025-10-13T22:44:34.888832] [INFO ] [MAIN ] Derivative Progress: 1707/1810 symbols completed. VTOL took 0.5s. Estimated remaining: 39.5s. Rate: 156.5 symbols/min [2025-10-13T22:44:34.904549] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:34.899293] [INFO ] [MAIN ] VTR: Loaded 52772 primary data records. [2025-10-13T22:44:35.554703] [DEBUG] [LOCAL ] VVR: Loaded 31230 existing records from primary storage. [2025-10-13T22:44:35.555460] [INFO ] [MAIN ] VVR: Loaded 31230 primary data records. [2025-10-13T22:44:35.912974] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:35.913996] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:35.915020] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52772 primary records. [2025-10-13T22:44:35.915742] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30006 primary records. [2025-10-13T22:44:35.915848] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-13T22:44:35.916886] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-13T22:44:35.948675] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-13T22:44:35.948768] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-13T22:44:35.949164] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-13T22:44:35.949278] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-13T22:44:35.951961] [INFO ] [MAIN ] Derivative Progress: 1708/1810 symbols completed. VTR took 1.3s. Estimated remaining: 39.1s. Rate: 156.4 symbols/min [2025-10-13T22:44:35.954375] [INFO ] [MAIN ] Derivative Progress: 1709/1810 symbols completed. VTS took 1.2s. Estimated remaining: 38.7s. Rate: 156.5 symbols/min [2025-10-13T22:44:35.971959] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:35.972476] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31230 primary records. [2025-10-13T22:44:35.972532] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-13T22:44:35.987989] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-13T22:44:35.988048] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-13T22:44:35.990419] [INFO ] [MAIN ] Derivative Progress: 1710/1810 symbols completed. VVR took 1.1s. Estimated remaining: 38.3s. Rate: 156.5 symbols/min [2025-10-13T22:44:35.990899] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:35.990830] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:35.991067] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:36.013465] [DEBUG] [LOCAL ] VVX: Loaded 22933 existing records from primary storage. [2025-10-13T22:44:36.013593] [INFO ] [MAIN ] VVX: Loaded 22933 primary data records. [2025-10-13T22:44:36.242394] [DEBUG] [LOCAL ] VYX: Loaded 48548 existing records from primary storage. [2025-10-13T22:44:36.249773] [INFO ] [MAIN ] VYX: Loaded 48548 primary data records. [2025-10-13T22:44:36.406186] [DEBUG] [LOCAL ] VVV: Loaded 50305 existing records from primary storage. [2025-10-13T22:44:36.416018] [INFO ] [MAIN ] VVV: Loaded 50305 primary data records. [2025-10-13T22:44:37.004210] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:37.006259] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 22933 primary records. [2025-10-13T22:44:37.006562] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-13T22:44:37.023689] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-13T22:44:37.023984] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-13T22:44:37.026474] [INFO ] [MAIN ] Derivative Progress: 1711/1810 symbols completed. VVX took 1.0s. Estimated remaining: 38.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:37.026909] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:37.044576] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:37.047319] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50305 primary records. [2025-10-13T22:44:37.048160] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-13T22:44:37.075304] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:37.076624] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48548 primary records. [2025-10-13T22:44:37.077068] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-13T22:44:37.096353] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-13T22:44:37.092261] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-13T22:44:37.096532] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-13T22:44:37.098742] [INFO ] [MAIN ] Derivative Progress: 1712/1810 symbols completed. VYX took 1.1s. Estimated remaining: 37.6s. Rate: 156.5 symbols/min [2025-10-13T22:44:37.099077] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-13T22:44:37.101825] [INFO ] [MAIN ] Derivative Progress: 1713/1810 symbols completed. VVV took 1.1s. Estimated remaining: 37.2s. Rate: 156.5 symbols/min [2025-10-13T22:44:37.098971] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:37.102047] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:37.139778] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-13T22:44:37.139987] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-13T22:44:37.302250] [DEBUG] [LOCAL ] WAB: Loaded 44045 existing records from primary storage. [2025-10-13T22:44:37.337006] [INFO ] [MAIN ] WAB: Loaded 44045 primary data records. [2025-10-13T22:44:37.592764] [DEBUG] [LOCAL ] W: Loaded 53438 existing records from primary storage. [2025-10-13T22:44:37.604912] [INFO ] [MAIN ] W: Loaded 53438 primary data records. [2025-10-13T22:44:38.226526] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:38.227893] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-13T22:44:38.228000] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-13T22:44:38.249966] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-13T22:44:38.250846] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-13T22:44:38.254737] [INFO ] [MAIN ] Derivative Progress: 1714/1810 symbols completed. VZ took 1.2s. Estimated remaining: 36.8s. Rate: 156.4 symbols/min [2025-10-13T22:44:38.256202] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:38.271071] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:38.280433] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44045 primary records. [2025-10-13T22:44:38.285872] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-13T22:44:38.285947] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:38.287991] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53438 primary records. [2025-10-13T22:44:38.288492] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-13T22:44:38.318116] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-13T22:44:38.318967] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-13T22:44:38.321851] [INFO ] [MAIN ] Derivative Progress: 1715/1810 symbols completed. W took 1.2s. Estimated remaining: 36.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:38.322438] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:38.340750] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-13T22:44:38.341207] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-13T22:44:38.345226] [INFO ] [MAIN ] Derivative Progress: 1716/1810 symbols completed. WAB took 1.2s. Estimated remaining: 36.0s. Rate: 156.5 symbols/min [2025-10-13T22:44:38.345697] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:38.372105] [DEBUG] [LOCAL ] WAL: Loaded 45391 existing records from primary storage. [2025-10-13T22:44:38.372462] [INFO ] [MAIN ] WAL: Loaded 45391 primary data records. [2025-10-13T22:44:38.494296] [DEBUG] [LOCAL ] WAT: Loaded 35698 existing records from primary storage. [2025-10-13T22:44:38.510529] [INFO ] [MAIN ] WAT: Loaded 35698 primary data records. [2025-10-13T22:44:38.841915] [DEBUG] [LOCAL ] WBS: Loaded 48737 existing records from primary storage. [2025-10-13T22:44:38.858186] [INFO ] [MAIN ] WBS: Loaded 48737 primary data records. [2025-10-13T22:44:39.393629] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:39.395737] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45391 primary records. [2025-10-13T22:44:39.395914] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-13T22:44:39.412973] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-13T22:44:39.413963] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-13T22:44:39.417465] [INFO ] [MAIN ] Derivative Progress: 1717/1810 symbols completed. WAL took 1.2s. Estimated remaining: 35.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:39.417688] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:39.439894] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:39.441086] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35698 primary records. [2025-10-13T22:44:39.441435] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-13T22:44:39.458359] [DEBUG] [LOCAL ] WBX: Loaded 10656 existing records from primary storage. [2025-10-13T22:44:39.459199] [INFO ] [MAIN ] WBX: Loaded 10656 primary data records. [2025-10-13T22:44:39.505043] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-13T22:44:39.513188] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-13T22:44:39.522507] [INFO ] [MAIN ] Derivative Progress: 1718/1810 symbols completed. WAT took 1.2s. Estimated remaining: 35.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:39.522756] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:39.810075] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:39.873484] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48737 primary records. [2025-10-13T22:44:39.873677] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-13T22:44:39.892930] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-13T22:44:39.906221] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-13T22:44:39.909031] [INFO ] [MAIN ] Derivative Progress: 1719/1810 symbols completed. WBS took 1.6s. Estimated remaining: 34.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:39.909679] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:39.929103] [DEBUG] [LOCAL ] WCC: Loaded 39131 existing records from primary storage. [2025-10-13T22:44:39.929826] [INFO ] [MAIN ] WCC: Loaded 39131 primary data records. [2025-10-13T22:44:40.097292] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:40.142492] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 10656 primary records. [2025-10-13T22:44:40.163962] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-13T22:44:40.165837] [DEBUG] [LOCAL ] WCN: Loaded 47938 existing records from primary storage. [2025-10-13T22:44:40.167825] [INFO ] [MAIN ] WCN: Loaded 47938 primary data records. [2025-10-13T22:44:40.373116] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-13T22:44:40.380631] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-13T22:44:40.388808] [INFO ] [MAIN ] Derivative Progress: 1720/1810 symbols completed. WBX took 1.0s. Estimated remaining: 34.5s. Rate: 156.4 symbols/min [2025-10-13T22:44:40.389192] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:40.633975] [DEBUG] [LOCAL ] WD: Loaded 23185 existing records from primary storage. [2025-10-13T22:44:40.634818] [INFO ] [MAIN ] WD: Loaded 23185 primary data records. [2025-10-13T22:44:40.682936] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:40.689113] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39131 primary records. [2025-10-13T22:44:40.726343] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-13T22:44:40.973458] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-13T22:44:40.973902] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-13T22:44:40.977306] [INFO ] [MAIN ] Derivative Progress: 1721/1810 symbols completed. WCC took 1.5s. Estimated remaining: 34.2s. Rate: 156.4 symbols/min [2025-10-13T22:44:40.978360] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:40.998311] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:40.999180] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47938 primary records. [2025-10-13T22:44:40.999350] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-13T22:44:41.023775] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-13T22:44:41.029120] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-13T22:44:41.031536] [INFO ] [MAIN ] Derivative Progress: 1722/1810 symbols completed. WCN took 1.1s. Estimated remaining: 33.8s. Rate: 156.4 symbols/min [2025-10-13T22:44:41.032791] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:41.033215] [DEBUG] [LOCAL ] WDH: Loaded 18004 existing records from primary storage. [2025-10-13T22:44:41.034281] [INFO ] [MAIN ] WDH: Loaded 18004 primary data records. [2025-10-13T22:44:41.184328] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:41.212586] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23185 primary records. [2025-10-13T22:44:41.220827] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-13T22:44:41.218905] [DEBUG] [LOCAL ] WDI: Loaded 21111 existing records from primary storage. [2025-10-13T22:44:41.245686] [INFO ] [MAIN ] WDI: Loaded 21111 primary data records. [2025-10-13T22:44:41.484046] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-13T22:44:41.500206] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-13T22:44:41.508133] [INFO ] [MAIN ] Derivative Progress: 1723/1810 symbols completed. WD took 1.1s. Estimated remaining: 33.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:41.739501] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:41.740334] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 18004 primary records. [2025-10-13T22:44:41.740807] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-13T22:44:41.758197] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-13T22:44:41.758332] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-13T22:44:41.760478] [INFO ] [MAIN ] Derivative Progress: 1724/1810 symbols completed. WDH took 0.8s. Estimated remaining: 33.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:41.778600] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:41.779546] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21111 primary records. [2025-10-13T22:44:41.779611] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-13T22:44:41.795863] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-13T22:44:41.795981] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-13T22:44:41.799272] [INFO ] [MAIN ] Derivative Progress: 1725/1810 symbols completed. WDI took 0.8s. Estimated remaining: 32.6s. Rate: 156.5 symbols/min [2025-10-13T22:44:41.799998] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:41.800239] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:41.800149] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:41.811818] [DEBUG] [LOCAL ] WEA: Loaded 7656 existing records from primary storage. [2025-10-13T22:44:41.812123] [INFO ] [MAIN ] WEA: Loaded 7656 primary data records. [2025-10-13T22:44:42.140022] [DEBUG] [LOCAL ] WEAV: Loaded 42194 existing records from primary storage. [2025-10-13T22:44:42.155978] [INFO ] [MAIN ] WEAV: Loaded 42194 primary data records. [2025-10-13T22:44:42.156807] [DEBUG] [LOCAL ] WEC: Loaded 52165 existing records from primary storage. [2025-10-13T22:44:42.177460] [INFO ] [MAIN ] WEC: Loaded 52165 primary data records. [2025-10-13T22:44:42.783994] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:42.785498] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7656 primary records. [2025-10-13T22:44:42.786099] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-13T22:44:42.809585] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-13T22:44:42.810027] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-13T22:44:42.812747] [INFO ] [MAIN ] Derivative Progress: 1726/1810 symbols completed. WEA took 1.0s. Estimated remaining: 32.2s. Rate: 156.4 symbols/min [2025-10-13T22:44:42.812904] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:42.832370] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:42.833299] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42194 primary records. [2025-10-13T22:44:42.845576] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-13T22:44:42.847024] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:42.859440] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52165 primary records. [2025-10-13T22:44:42.860608] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-13T22:44:42.877814] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-13T22:44:42.880613] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-13T22:44:42.880785] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-13T22:44:42.883353] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-13T22:44:42.883237] [INFO ] [MAIN ] Derivative Progress: 1727/1810 symbols completed. WEC took 1.1s. Estimated remaining: 31.8s. Rate: 156.4 symbols/min [2025-10-13T22:44:42.883635] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:42.886038] [INFO ] [MAIN ] Derivative Progress: 1728/1810 symbols completed. WEAV took 1.1s. Estimated remaining: 31.4s. Rate: 156.5 symbols/min [2025-10-13T22:44:42.886409] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:42.937239] [DEBUG] [LOCAL ] WELL: Loaded 52331 existing records from primary storage. [2025-10-13T22:44:42.937467] [INFO ] [MAIN ] WELL: Loaded 52331 primary data records. [2025-10-13T22:44:43.022824] [DEBUG] [LOCAL ] WEX: Loaded 33233 existing records from primary storage. [2025-10-13T22:44:43.041754] [INFO ] [MAIN ] WEX: Loaded 33233 primary data records. [2025-10-13T22:44:43.143929] [DEBUG] [LOCAL ] WES: Loaded 48437 existing records from primary storage. [2025-10-13T22:44:43.163043] [INFO ] [MAIN ] WES: Loaded 48437 primary data records. [2025-10-13T22:44:43.979165] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:43.978571] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:43.980512] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52331 primary records. [2025-10-13T22:44:43.979964] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 33233 primary records. [2025-10-13T22:44:43.980681] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-13T22:44:43.981147] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-13T22:44:44.012448] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-13T22:44:44.012816] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-13T22:44:44.023722] [INFO ] [MAIN ] Derivative Progress: 1729/1810 symbols completed. WEX took 1.1s. Estimated remaining: 31.1s. Rate: 156.4 symbols/min [2025-10-13T22:44:44.029310] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:44.030047] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:44.032148] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48437 primary records. [2025-10-13T22:44:44.032236] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-13T22:44:44.034173] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-13T22:44:44.041300] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-13T22:44:44.043374] [INFO ] [MAIN ] Derivative Progress: 1730/1810 symbols completed. WELL took 1.2s. Estimated remaining: 30.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:44.047464] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:44.059557] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-13T22:44:44.059924] [DEBUG] [LOCAL ] WF: Loaded 10850 existing records from primary storage. [2025-10-13T22:44:44.060186] [INFO ] [MAIN ] WF: Loaded 10850 primary data records. [2025-10-13T22:44:44.060280] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-13T22:44:44.083202] [INFO ] [MAIN ] Derivative Progress: 1731/1810 symbols completed. WES took 1.2s. Estimated remaining: 30.3s. Rate: 156.5 symbols/min [2025-10-13T22:44:44.099105] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:44.383883] [DEBUG] [LOCAL ] WFG: Loaded 24768 existing records from primary storage. [2025-10-13T22:44:44.385540] [INFO ] [MAIN ] WFG: Loaded 24768 primary data records. [2025-10-13T22:44:44.505944] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-13T22:44:44.522198] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-13T22:44:45.065576] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:45.067629] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10850 primary records. [2025-10-13T22:44:45.068156] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-13T22:44:45.089088] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-13T22:44:45.089202] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-13T22:44:45.092409] [INFO ] [MAIN ] Derivative Progress: 1732/1810 symbols completed. WF took 1.1s. Estimated remaining: 29.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:45.092554] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:45.110131] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:45.110975] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24768 primary records. [2025-10-13T22:44:45.111314] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-13T22:44:45.129927] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-13T22:44:45.130117] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-13T22:44:45.133120] [INFO ] [MAIN ] Derivative Progress: 1733/1810 symbols completed. WFG took 1.0s. Estimated remaining: 29.5s. Rate: 156.5 symbols/min [2025-10-13T22:44:45.133291] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:45.158286] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:45.159134] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-13T22:44:45.159335] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-13T22:44:45.186596] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-13T22:44:45.186819] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-13T22:44:45.187956] [DEBUG] [LOCAL ] WGO: Loaded 38304 existing records from primary storage. [2025-10-13T22:44:45.190894] [INFO ] [MAIN ] WGO: Loaded 38304 primary data records. [2025-10-13T22:44:45.190794] [INFO ] [MAIN ] Derivative Progress: 1734/1810 symbols completed. WFC took 1.1s. Estimated remaining: 29.1s. Rate: 156.5 symbols/min [2025-10-13T22:44:45.191114] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:45.403289] [DEBUG] [LOCAL ] WH: Loaded 45237 existing records from primary storage. [2025-10-13T22:44:45.525455] [INFO ] [MAIN ] WH: Loaded 45237 primary data records. [2025-10-13T22:44:45.629004] [DEBUG] [LOCAL ] WHD: Loaded 40114 existing records from primary storage. [2025-10-13T22:44:45.651272] [INFO ] [MAIN ] WHD: Loaded 40114 primary data records. [2025-10-13T22:44:46.228881] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:46.230950] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38304 primary records. [2025-10-13T22:44:46.231184] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-13T22:44:46.252746] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-13T22:44:46.254091] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-13T22:44:46.256489] [INFO ] [MAIN ] Derivative Progress: 1735/1810 symbols completed. WGO took 1.2s. Estimated remaining: 28.8s. Rate: 156.4 symbols/min [2025-10-13T22:44:46.256960] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:46.276668] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:46.277852] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45237 primary records. [2025-10-13T22:44:46.280865] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-13T22:44:46.280791] [DEBUG] [LOCAL ] WHG: Loaded 3175 existing records from primary storage. [2025-10-13T22:44:46.280967] [INFO ] [MAIN ] WHG: Loaded 3175 primary data records. [2025-10-13T22:44:46.416359] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:46.434408] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-13T22:44:46.461592] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40114 primary records. [2025-10-13T22:44:46.481619] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-13T22:44:46.478713] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-13T22:44:46.501991] [INFO ] [MAIN ] Derivative Progress: 1736/1810 symbols completed. WH took 1.4s. Estimated remaining: 28.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:46.609986] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:46.642831] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-13T22:44:46.643046] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-13T22:44:46.645611] [INFO ] [MAIN ] Derivative Progress: 1737/1810 symbols completed. WHD took 1.5s. Estimated remaining: 28.0s. Rate: 156.5 symbols/min [2025-10-13T22:44:46.646433] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:46.655637] [DEBUG] [LOCAL ] WIA: Loaded 4999 existing records from primary storage. [2025-10-13T22:44:46.656158] [INFO ] [MAIN ] WIA: Loaded 4999 primary data records. [2025-10-13T22:44:46.976069] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:47.012106] [DEBUG] [LOCAL ] WHR: Loaded 48678 existing records from primary storage. [2025-10-13T22:44:47.013119] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3175 primary records. [2025-10-13T22:44:47.013312] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-13T22:44:47.013426] [INFO ] [MAIN ] WHR: Loaded 48678 primary data records. [2025-10-13T22:44:47.175191] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-13T22:44:47.209031] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-13T22:44:47.333848] [INFO ] [MAIN ] Derivative Progress: 1738/1810 symbols completed. WHG took 1.1s. Estimated remaining: 27.6s. Rate: 156.4 symbols/min [2025-10-13T22:44:47.353990] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:47.354990] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4999 primary records. [2025-10-13T22:44:47.355071] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-13T22:44:47.372093] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-13T22:44:47.372198] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-13T22:44:47.374836] [INFO ] [MAIN ] Derivative Progress: 1739/1810 symbols completed. WIA took 0.7s. Estimated remaining: 27.2s. Rate: 156.5 symbols/min [2025-10-13T22:44:47.390384] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:47.390968] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48678 primary records. [2025-10-13T22:44:47.391028] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-13T22:44:47.406572] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-13T22:44:47.406705] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-13T22:44:47.409205] [INFO ] [MAIN ] Derivative Progress: 1740/1810 symbols completed. WHR took 0.8s. Estimated remaining: 26.8s. Rate: 156.6 symbols/min [2025-10-13T22:44:47.409849] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:47.409790] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:47.410017] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:47.432358] [DEBUG] [LOCAL ] WINN: Loaded 11583 existing records from primary storage. [2025-10-13T22:44:47.432619] [INFO ] [MAIN ] WINN: Loaded 11583 primary data records. [2025-10-13T22:44:47.533026] [DEBUG] [LOCAL ] WIW: Loaded 20314 existing records from primary storage. [2025-10-13T22:44:47.556543] [INFO ] [MAIN ] WIW: Loaded 20314 primary data records. [2025-10-13T22:44:47.909795] [DEBUG] [LOCAL ] WIT: Loaded 52420 existing records from primary storage. [2025-10-13T22:44:47.915858] [INFO ] [MAIN ] WIT: Loaded 52420 primary data records. [2025-10-13T22:44:48.432047] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:44:48.433071] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11583 primary records. [2025-10-13T22:44:48.434243] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-13T22:44:48.452426] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-13T22:44:48.452980] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-13T22:44:48.455260] [INFO ] [MAIN ] Derivative Progress: 1741/1810 symbols completed. WINN took 1.0s. Estimated remaining: 26.5s. Rate: 156.4 symbols/min [2025-10-13T22:44:48.455558] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:48.469373] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:48.470195] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20314 primary records. [2025-10-13T22:44:48.470495] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-13T22:44:48.490352] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-13T22:44:48.490618] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-13T22:44:48.493371] [INFO ] [MAIN ] Derivative Progress: 1742/1810 symbols completed. WIW took 1.1s. Estimated remaining: 26.1s. Rate: 156.5 symbols/min [2025-10-13T22:44:48.506542] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:48.507562] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:48.508768] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52420 primary records. [2025-10-13T22:44:48.508983] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-13T22:44:48.537825] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-13T22:44:48.537990] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-13T22:44:48.540765] [INFO ] [MAIN ] Derivative Progress: 1743/1810 symbols completed. WIT took 1.1s. Estimated remaining: 25.7s. Rate: 156.6 symbols/min [2025-10-13T22:44:48.548181] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:48.562262] [DEBUG] [LOCAL ] WK: Loaded 37386 existing records from primary storage. [2025-10-13T22:44:48.562566] [INFO ] [MAIN ] WK: Loaded 37386 primary data records. [2025-10-13T22:44:48.656923] [DEBUG] [LOCAL ] WKC: Loaded 34639 existing records from primary storage. [2025-10-13T22:44:48.679259] [INFO ] [MAIN ] WKC: Loaded 34639 primary data records. [2025-10-13T22:44:49.202788] [DEBUG] [LOCAL ] WLK: Loaded 45653 existing records from primary storage. [2025-10-13T22:44:49.219486] [INFO ] [MAIN ] WLK: Loaded 45653 primary data records. [2025-10-13T22:44:49.547114] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:49.548906] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37386 primary records. [2025-10-13T22:44:49.549362] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-13T22:44:49.568862] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-13T22:44:49.569295] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-13T22:44:49.572078] [INFO ] [MAIN ] Derivative Progress: 1744/1810 symbols completed. WK took 1.1s. Estimated remaining: 25.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:49.572293] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:49.586441] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:49.587380] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34639 primary records. [2025-10-13T22:44:49.587774] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-13T22:44:49.606844] [DEBUG] [LOCAL ] WLKP: Loaded 6971 existing records from primary storage. [2025-10-13T22:44:49.608220] [INFO ] [MAIN ] WLKP: Loaded 6971 primary data records. [2025-10-13T22:44:49.695224] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-13T22:44:49.710761] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:49.711560] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-13T22:44:49.714460] [INFO ] [MAIN ] Derivative Progress: 1745/1810 symbols completed. WKC took 1.2s. Estimated remaining: 24.9s. Rate: 156.5 symbols/min [2025-10-13T22:44:49.711492] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45653 primary records. [2025-10-13T22:44:49.720031] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:49.727692] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-13T22:44:49.833259] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-13T22:44:49.986694] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-13T22:44:49.996670] [INFO ] [MAIN ] Derivative Progress: 1746/1810 symbols completed. WLK took 1.4s. Estimated remaining: 24.5s. Rate: 156.5 symbols/min [2025-10-13T22:44:49.996954] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:50.010126] [DEBUG] [LOCAL ] WLY: Loaded 29735 existing records from primary storage. [2025-10-13T22:44:50.010739] [INFO ] [MAIN ] WLY: Loaded 29735 primary data records. [2025-10-13T22:44:50.368554] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:50.371559] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6971 primary records. [2025-10-13T22:44:50.371875] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-13T22:44:50.374771] [DEBUG] [LOCAL ] WM: Loaded 50991 existing records from primary storage. [2025-10-13T22:44:50.382693] [INFO ] [MAIN ] WM: Loaded 50991 primary data records. [2025-10-13T22:44:50.461884] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-13T22:44:50.462297] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-13T22:44:50.494084] [INFO ] [MAIN ] Derivative Progress: 1747/1810 symbols completed. WLKP took 0.9s. Estimated remaining: 24.2s. Rate: 156.5 symbols/min [2025-10-13T22:44:50.497955] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:50.708255] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:50.709054] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29735 primary records. [2025-10-13T22:44:50.709230] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-13T22:44:50.730300] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-13T22:44:50.730554] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-13T22:44:50.733391] [INFO ] [MAIN ] Derivative Progress: 1748/1810 symbols completed. WLY took 1.0s. Estimated remaining: 23.8s. Rate: 156.5 symbols/min [2025-10-13T22:44:50.734898] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:50.779100] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:50.780033] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50991 primary records. [2025-10-13T22:44:50.794633] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-13T22:44:50.798532] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-13T22:44:50.799003] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-13T22:44:50.854181] [DEBUG] [LOCAL ] WMK: Loaded 14665 existing records from primary storage. [2025-10-13T22:44:50.870868] [INFO ] [MAIN ] WMK: Loaded 14665 primary data records. [2025-10-13T22:44:51.016206] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-13T22:44:51.041380] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-13T22:44:51.059340] [INFO ] [MAIN ] Derivative Progress: 1749/1810 symbols completed. WM took 1.1s. Estimated remaining: 23.4s. Rate: 156.5 symbols/min [2025-10-13T22:44:51.080532] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:51.503097] [DEBUG] [LOCAL ] WMS: Loaded 39678 existing records from primary storage. [2025-10-13T22:44:51.504239] [INFO ] [MAIN ] WMS: Loaded 39678 primary data records. [2025-10-13T22:44:51.892301] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:51.894088] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14665 primary records. [2025-10-13T22:44:51.894283] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-13T22:44:51.893055] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:51.895688] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-13T22:44:51.909690] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-13T22:44:51.926882] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-13T22:44:51.928738] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-13T22:44:51.932856] [INFO ] [MAIN ] Derivative Progress: 1750/1810 symbols completed. WMK took 1.2s. Estimated remaining: 23.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:51.934831] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:51.937138] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-13T22:44:51.937248] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-13T22:44:51.939687] [INFO ] [MAIN ] Derivative Progress: 1751/1810 symbols completed. WMB took 1.4s. Estimated remaining: 22.6s. Rate: 156.5 symbols/min [2025-10-13T22:44:51.940025] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:51.959309] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:51.960563] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39678 primary records. [2025-10-13T22:44:51.960737] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-13T22:44:51.977915] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-13T22:44:51.978103] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-13T22:44:51.980797] [INFO ] [MAIN ] Derivative Progress: 1752/1810 symbols completed. WMS took 0.9s. Estimated remaining: 22.2s. Rate: 156.6 symbols/min [2025-10-13T22:44:51.989812] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:52.017817] [DEBUG] [LOCAL ] WNC: Loaded 38638 existing records from primary storage. [2025-10-13T22:44:52.018040] [INFO ] [MAIN ] WNC: Loaded 38638 primary data records. [2025-10-13T22:44:52.146325] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-13T22:44:52.152116] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-13T22:44:52.272188] [DEBUG] [LOCAL ] WNS: Loaded 40018 existing records from primary storage. [2025-10-13T22:44:52.429512] [INFO ] [MAIN ] WNS: Loaded 40018 primary data records. [2025-10-13T22:44:53.006271] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:53.009166] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38638 primary records. [2025-10-13T22:44:53.009692] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-13T22:44:53.032011] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-13T22:44:53.040400] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-13T22:44:53.048593] [INFO ] [MAIN ] Derivative Progress: 1753/1810 symbols completed. WNC took 1.1s. Estimated remaining: 21.9s. Rate: 156.4 symbols/min [2025-10-13T22:44:53.049547] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:53.050984] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-13T22:44:53.051271] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-13T22:44:53.081038] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:53.082246] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40018 primary records. [2025-10-13T22:44:53.081531] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-13T22:44:53.082368] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-13T22:44:53.085245] [INFO ] [MAIN ] Derivative Progress: 1754/1810 symbols completed. WMT took 1.2s. Estimated remaining: 21.5s. Rate: 156.5 symbols/min [2025-10-13T22:44:53.085339] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-13T22:44:53.101037] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-13T22:44:53.101098] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-13T22:44:53.103477] [INFO ] [MAIN ] Derivative Progress: 1755/1810 symbols completed. WNS took 1.1s. Estimated remaining: 21.1s. Rate: 156.6 symbols/min [2025-10-13T22:44:53.103859] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:53.103930] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:53.104107] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:53.128850] [DEBUG] [LOCAL ] WOR: Loaded 24262 existing records from primary storage. [2025-10-13T22:44:53.140250] [INFO ] [MAIN ] WOR: Loaded 24262 primary data records. [2025-10-13T22:44:53.270801] [DEBUG] [LOCAL ] WOW: Loaded 30751 existing records from primary storage. [2025-10-13T22:44:53.282178] [INFO ] [MAIN ] WOW: Loaded 30751 primary data records. [2025-10-13T22:44:53.394011] [DEBUG] [LOCAL ] WOLF: Loaded 53171 existing records from primary storage. [2025-10-13T22:44:53.450965] [INFO ] [MAIN ] WOLF: Loaded 53171 primary data records. [2025-10-13T22:44:54.201403] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:54.202353] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24262 primary records. [2025-10-13T22:44:54.202562] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-13T22:44:54.228747] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-13T22:44:54.233579] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-13T22:44:54.233900] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:54.236664] [INFO ] [MAIN ] Derivative Progress: 1756/1810 symbols completed. WOR took 1.1s. Estimated remaining: 20.7s. Rate: 156.4 symbols/min [2025-10-13T22:44:54.236854] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:54.234600] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30751 primary records. [2025-10-13T22:44:54.237126] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-13T22:44:54.269500] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-13T22:44:54.268893] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:54.269606] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-13T22:44:54.272678] [INFO ] [MAIN ] Derivative Progress: 1757/1810 symbols completed. WOW took 1.2s. Estimated remaining: 20.3s. Rate: 156.5 symbols/min [2025-10-13T22:44:54.272936] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:54.274318] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53171 primary records. [2025-10-13T22:44:54.275144] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-13T22:44:54.293248] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-13T22:44:54.293357] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-13T22:44:54.296912] [INFO ] [MAIN ] Derivative Progress: 1758/1810 symbols completed. WOLF took 1.2s. Estimated remaining: 19.9s. Rate: 156.6 symbols/min [2025-10-13T22:44:54.297223] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:54.334138] [DEBUG] [LOCAL ] WPC: Loaded 48198 existing records from primary storage. [2025-10-13T22:44:54.334526] [INFO ] [MAIN ] WPC: Loaded 48198 primary data records. [2025-10-13T22:44:54.546205] [DEBUG] [LOCAL ] WPM: Loaded 52763 existing records from primary storage. [2025-10-13T22:44:54.565015] [DEBUG] [LOCAL ] WPP: Loaded 34374 existing records from primary storage. [2025-10-13T22:44:54.683022] [INFO ] [MAIN ] WPP: Loaded 34374 primary data records. [2025-10-13T22:44:54.682891] [INFO ] [MAIN ] WPM: Loaded 52763 primary data records. [2025-10-13T22:44:55.368450] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:55.370326] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48198 primary records. [2025-10-13T22:44:55.370617] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-13T22:44:55.388622] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-13T22:44:55.390485] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-13T22:44:55.392691] [INFO ] [MAIN ] Derivative Progress: 1759/1810 symbols completed. WPC took 1.2s. Estimated remaining: 19.6s. Rate: 156.4 symbols/min [2025-10-13T22:44:55.392972] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:55.414842] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:55.415873] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34374 primary records. [2025-10-13T22:44:55.416039] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-13T22:44:55.429296] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:55.430151] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52763 primary records. [2025-10-13T22:44:55.430241] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-13T22:44:55.466949] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-13T22:44:55.468167] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-13T22:44:55.468318] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-13T22:44:55.468112] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-13T22:44:55.471143] [INFO ] [MAIN ] Derivative Progress: 1760/1810 symbols completed. WPP took 1.2s. Estimated remaining: 19.2s. Rate: 156.5 symbols/min [2025-10-13T22:44:55.473731] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:55.473867] [INFO ] [MAIN ] Derivative Progress: 1761/1810 symbols completed. WPM took 1.2s. Estimated remaining: 18.8s. Rate: 156.6 symbols/min [2025-10-13T22:44:55.474362] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:55.514603] [DEBUG] [LOCAL ] WRB: Loaded 50777 existing records from primary storage. [2025-10-13T22:44:55.514881] [INFO ] [MAIN ] WRB: Loaded 50777 primary data records. [2025-10-13T22:44:55.605030] [DEBUG] [LOCAL ] WS: Loaded 23444 existing records from primary storage. [2025-10-13T22:44:55.634969] [INFO ] [MAIN ] WS: Loaded 23444 primary data records. [2025-10-13T22:44:55.944936] [DEBUG] [LOCAL ] WRBY: Loaded 50695 existing records from primary storage. [2025-10-13T22:44:55.961712] [INFO ] [MAIN ] WRBY: Loaded 50695 primary data records. [2025-10-13T22:44:56.492505] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:56.495364] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50777 primary records. [2025-10-13T22:44:56.495496] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-13T22:44:56.514497] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-13T22:44:56.522974] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-13T22:44:56.525382] [INFO ] [MAIN ] Derivative Progress: 1762/1810 symbols completed. WRB took 1.1s. Estimated remaining: 18.4s. Rate: 156.4 symbols/min [2025-10-13T22:44:56.531224] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:56.531737] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:56.533396] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23444 primary records. [2025-10-13T22:44:56.533821] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-13T22:44:56.554488] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-13T22:44:56.554884] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-13T22:44:56.558991] [INFO ] [MAIN ] Derivative Progress: 1763/1810 symbols completed. WS took 1.1s. Estimated remaining: 18.0s. Rate: 156.5 symbols/min [2025-10-13T22:44:56.571803] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:56.572491] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:56.573899] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50695 primary records. [2025-10-13T22:44:56.574063] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-13T22:44:56.592826] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-13T22:44:56.593114] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-13T22:44:56.595573] [INFO ] [MAIN ] Derivative Progress: 1764/1810 symbols completed. WRBY took 1.1s. Estimated remaining: 17.6s. Rate: 156.6 symbols/min [2025-10-13T22:44:56.595848] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:56.627370] [DEBUG] [LOCAL ] WSO: Loaded 25486 existing records from primary storage. [2025-10-13T22:44:56.634206] [INFO ] [MAIN ] WSO: Loaded 25486 primary data records. [2025-10-13T22:44:56.705118] [DEBUG] [LOCAL ] WSR: Loaded 22987 existing records from primary storage. [2025-10-13T22:44:56.723478] [INFO ] [MAIN ] WSR: Loaded 22987 primary data records. [2025-10-13T22:44:56.786998] [DEBUG] [LOCAL ] WSM: Loaded 49208 existing records from primary storage. [2025-10-13T22:44:56.834816] [INFO ] [MAIN ] WSM: Loaded 49208 primary data records. [2025-10-13T22:44:57.650498] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:57.652304] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22987 primary records. [2025-10-13T22:44:57.652608] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-13T22:44:57.651130] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:57.654777] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25486 primary records. [2025-10-13T22:44:57.654870] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-13T22:44:57.684090] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-13T22:44:57.686943] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-13T22:44:57.690542] [INFO ] [MAIN ] Derivative Progress: 1765/1810 symbols completed. WSR took 1.1s. Estimated remaining: 17.3s. Rate: 156.4 symbols/min [2025-10-13T22:44:57.692151] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:57.711591] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-13T22:44:57.712156] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-13T22:44:57.714576] [INFO ] [MAIN ] Derivative Progress: 1766/1810 symbols completed. WSO took 1.1s. Estimated remaining: 16.9s. Rate: 156.5 symbols/min [2025-10-13T22:44:57.715209] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:57.714971] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:57.716678] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49208 primary records. [2025-10-13T22:44:57.716915] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-13T22:44:57.738176] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-13T22:44:57.738398] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-13T22:44:57.742738] [INFO ] [MAIN ] Derivative Progress: 1767/1810 symbols completed. WSM took 1.2s. Estimated remaining: 16.5s. Rate: 156.6 symbols/min [2025-10-13T22:44:57.743085] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:57.775385] [DEBUG] [LOCAL ] WST: Loaded 36798 existing records from primary storage. [2025-10-13T22:44:57.775717] [INFO ] [MAIN ] WST: Loaded 36798 primary data records. [2025-10-13T22:44:57.922363] [DEBUG] [LOCAL ] WT: Loaded 47986 existing records from primary storage. [2025-10-13T22:44:57.922795] [INFO ] [MAIN ] WT: Loaded 47986 primary data records. [2025-10-13T22:44:58.018439] [DEBUG] [LOCAL ] WTI: Loaded 44466 existing records from primary storage. [2025-10-13T22:44:58.079228] [INFO ] [MAIN ] WTI: Loaded 44466 primary data records. [2025-10-13T22:44:58.787787] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:58.790620] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36798 primary records. [2025-10-13T22:44:58.790755] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-13T22:44:58.820434] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-13T22:44:58.820672] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-13T22:44:58.823043] [INFO ] [MAIN ] Derivative Progress: 1768/1810 symbols completed. WST took 1.1s. Estimated remaining: 16.1s. Rate: 156.4 symbols/min [2025-10-13T22:44:58.823377] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:58.824209] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47986 primary records. [2025-10-13T22:44:58.824456] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-13T22:44:58.840433] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-13T22:44:58.841921] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-13T22:44:58.844770] [INFO ] [MAIN ] Derivative Progress: 1769/1810 symbols completed. WT took 1.1s. Estimated remaining: 15.7s. Rate: 156.5 symbols/min [2025-10-13T22:44:58.858104] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:58.858732] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44466 primary records. [2025-10-13T22:44:58.858792] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-13T22:44:58.873871] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-13T22:44:58.873927] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-13T22:44:58.876547] [INFO ] [MAIN ] Derivative Progress: 1770/1810 symbols completed. WTI took 1.1s. Estimated remaining: 15.3s. Rate: 156.6 symbols/min [2025-10-13T22:44:58.876977] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:58.877070] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:58.877199] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:58.896993] [DEBUG] [LOCAL ] WTS: Loaded 17552 existing records from primary storage. [2025-10-13T22:44:58.897164] [INFO ] [MAIN ] WTS: Loaded 17552 primary data records. [2025-10-13T22:44:59.251366] [DEBUG] [LOCAL ] WTTR: Loaded 44571 existing records from primary storage. [2025-10-13T22:44:59.251590] [INFO ] [MAIN ] WTTR: Loaded 44571 primary data records. [2025-10-13T22:44:59.252225] [DEBUG] [LOCAL ] WTRG: Loaded 51008 existing records from primary storage. [2025-10-13T22:44:59.252415] [INFO ] [MAIN ] WTRG: Loaded 51008 primary data records. [2025-10-13T22:44:59.906102] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:59.907042] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17552 primary records. [2025-10-13T22:44:59.907244] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-13T22:44:59.925881] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-13T22:44:59.925989] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-13T22:44:59.929114] [INFO ] [MAIN ] Derivative Progress: 1771/1810 symbols completed. WTS took 1.1s. Estimated remaining: 15.0s. Rate: 156.4 symbols/min [2025-10-13T22:44:59.929384] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:59.949367] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:59.950284] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 51008 primary records. [2025-10-13T22:44:59.950632] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-13T22:44:59.967308] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-13T22:44:59.967622] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-13T22:44:59.969836] [INFO ] [MAIN ] Derivative Progress: 1772/1810 symbols completed. WTRG took 1.1s. Estimated remaining: 14.6s. Rate: 156.5 symbols/min [2025-10-13T22:44:59.971266] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:44:59.988267] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:44:59.989319] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44571 primary records. [2025-10-13T22:44:59.989592] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-13T22:45:00.025227] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-13T22:45:00.026977] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-13T22:45:00.029863] [INFO ] [MAIN ] Derivative Progress: 1773/1810 symbols completed. WTTR took 1.2s. Estimated remaining: 14.2s. Rate: 156.6 symbols/min [2025-10-13T22:45:00.031054] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:00.051744] [DEBUG] [LOCAL ] WU: Loaded 53470 existing records from primary storage. [2025-10-13T22:45:00.065703] [INFO ] [MAIN ] WU: Loaded 53470 primary data records. [2025-10-13T22:45:00.236292] [DEBUG] [LOCAL ] WWW: Loaded 49251 existing records from primary storage. [2025-10-13T22:45:00.245619] [INFO ] [MAIN ] WWW: Loaded 49251 primary data records. [2025-10-13T22:45:00.540496] [DEBUG] [LOCAL ] WY: Loaded 53192 existing records from primary storage. [2025-10-13T22:45:00.594317] [INFO ] [MAIN ] WY: Loaded 53192 primary data records. [2025-10-13T22:45:00.977624] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:01.102964] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53470 primary records. [2025-10-13T22:45:01.103343] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-13T22:45:01.122917] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-13T22:45:01.123980] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-13T22:45:01.126562] [INFO ] [MAIN ] Derivative Progress: 1774/1810 symbols completed. WU took 1.2s. Estimated remaining: 13.8s. Rate: 156.4 symbols/min [2025-10-13T22:45:01.127242] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:01.147077] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:01.148705] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49251 primary records. [2025-10-13T22:45:01.149172] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-13T22:45:01.175577] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-13T22:45:01.175785] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-13T22:45:01.179526] [INFO ] [MAIN ] Derivative Progress: 1775/1810 symbols completed. WWW took 1.2s. Estimated remaining: 13.4s. Rate: 156.5 symbols/min [2025-10-13T22:45:01.180008] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:01.207350] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:01.208944] [DEBUG] [LOCAL ] XFLT: Loaded 29895 existing records from primary storage. [2025-10-13T22:45:01.209892] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53192 primary records. [2025-10-13T22:45:01.210180] [INFO ] [MAIN ] XFLT: Loaded 29895 primary data records. [2025-10-13T22:45:01.210096] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-13T22:45:01.310426] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-13T22:45:01.329939] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-13T22:45:01.336266] [INFO ] [MAIN ] Derivative Progress: 1776/1810 symbols completed. WY took 1.3s. Estimated remaining: 13.0s. Rate: 156.5 symbols/min [2025-10-13T22:45:01.342366] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:01.560981] [DEBUG] [LOCAL ] XHR: Loaded 43633 existing records from primary storage. [2025-10-13T22:45:01.561261] [INFO ] [MAIN ] XHR: Loaded 43633 primary data records. [2025-10-13T22:45:01.958815] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-13T22:45:01.960110] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-13T22:45:02.154764] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:02.176232] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29895 primary records. [2025-10-13T22:45:02.290994] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-13T22:45:02.308353] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-13T22:45:02.308746] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-13T22:45:02.311304] [INFO ] [MAIN ] Derivative Progress: 1777/1810 symbols completed. XFLT took 1.2s. Estimated remaining: 12.7s. Rate: 156.4 symbols/min [2025-10-13T22:45:02.311708] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:02.338634] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:02.339832] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43633 primary records. [2025-10-13T22:45:02.340408] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-13T22:45:02.387783] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-13T22:45:02.396780] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:02.397834] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-13T22:45:02.402198] [INFO ] [MAIN ] Derivative Progress: 1778/1810 symbols completed. XHR took 1.2s. Estimated remaining: 12.3s. Rate: 156.5 symbols/min [2025-10-13T22:45:02.402404] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:02.398694] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-13T22:45:02.404000] [DEBUG] [LOCAL ] XPER: Loaded 30245 existing records from primary storage. [2025-10-13T22:45:02.404199] [INFO ] [MAIN ] XPER: Loaded 30245 primary data records. [2025-10-13T22:45:02.404862] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-13T22:45:02.604486] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-13T22:45:02.699689] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-13T22:45:02.740277] [INFO ] [MAIN ] Derivative Progress: 1779/1810 symbols completed. XOM took 1.4s. Estimated remaining: 11.9s. Rate: 156.5 symbols/min [2025-10-13T22:45:02.740608] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:02.761230] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-13T22:45:02.762860] [INFO ] [MAIN ] XPEV: Loaded 53634 primary data records. [2025-10-13T22:45:03.110638] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:03.127025] [DEBUG] [LOCAL ] XPO: Loaded 47760 existing records from primary storage. [2025-10-13T22:45:03.128231] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30245 primary records. [2025-10-13T22:45:03.128449] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-13T22:45:03.128556] [INFO ] [MAIN ] XPO: Loaded 47760 primary data records. [2025-10-13T22:45:03.256189] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-13T22:45:03.257167] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-13T22:45:03.280517] [INFO ] [MAIN ] Derivative Progress: 1780/1810 symbols completed. XPER took 1.0s. Estimated remaining: 11.5s. Rate: 156.4 symbols/min [2025-10-13T22:45:03.286198] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:03.494204] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:03.495324] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53634 primary records. [2025-10-13T22:45:03.496988] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-13T22:45:03.528314] [DEBUG] [LOCAL ] XPOF: Loaded 37558 existing records from primary storage. [2025-10-13T22:45:03.529748] [INFO ] [MAIN ] XPOF: Loaded 37558 primary data records. [2025-10-13T22:45:03.548412] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-13T22:45:03.548601] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-13T22:45:03.573084] [INFO ] [MAIN ] Derivative Progress: 1781/1810 symbols completed. XPEV took 1.2s. Estimated remaining: 11.1s. Rate: 156.5 symbols/min [2025-10-13T22:45:03.595400] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:03.686986] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:03.743430] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47760 primary records. [2025-10-13T22:45:03.855924] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-13T22:45:03.875395] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-13T22:45:03.887685] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-13T22:45:03.890875] [INFO ] [MAIN ] Derivative Progress: 1782/1810 symbols completed. XPO took 1.2s. Estimated remaining: 10.7s. Rate: 156.5 symbols/min [2025-10-13T22:45:03.891706] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:03.912845] [DEBUG] [LOCAL ] XPRO: Loaded 45959 existing records from primary storage. [2025-10-13T22:45:03.913382] [INFO ] [MAIN ] XPRO: Loaded 45959 primary data records. [2025-10-13T22:45:04.070115] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:04.069685] [DEBUG] [LOCAL ] XYF: Loaded 28103 existing records from primary storage. [2025-10-13T22:45:04.110964] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37558 primary records. [2025-10-13T22:45:04.120098] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-13T22:45:04.111147] [INFO ] [MAIN ] XYF: Loaded 28103 primary data records. [2025-10-13T22:45:04.422118] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-13T22:45:04.434465] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-13T22:45:04.450638] [INFO ] [MAIN ] Derivative Progress: 1783/1810 symbols completed. XPOF took 1.2s. Estimated remaining: 10.4s. Rate: 156.4 symbols/min [2025-10-13T22:45:04.691184] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:04.693857] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45959 primary records. [2025-10-13T22:45:04.693949] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-13T22:45:04.717794] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-13T22:45:04.717992] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-13T22:45:04.720517] [INFO ] [MAIN ] Derivative Progress: 1784/1810 symbols completed. XPRO took 1.1s. Estimated remaining: 10.0s. Rate: 156.5 symbols/min [2025-10-13T22:45:04.738608] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:04.739492] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28103 primary records. [2025-10-13T22:45:04.739564] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-13T22:45:04.755865] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-13T22:45:04.755942] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-13T22:45:04.759507] [INFO ] [MAIN ] Derivative Progress: 1785/1810 symbols completed. XYF took 0.9s. Estimated remaining: 9.6s. Rate: 156.5 symbols/min [2025-10-13T22:45:04.760396] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:04.760149] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:04.760291] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:04.816049] [DEBUG] [LOCAL ] YALA: Loaded 36962 existing records from primary storage. [2025-10-13T22:45:04.816256] [INFO ] [MAIN ] YALA: Loaded 36962 primary data records. [2025-10-13T22:45:04.929116] [DEBUG] [LOCAL ] YELP: Loaded 45436 existing records from primary storage. [2025-10-13T22:45:04.953286] [INFO ] [MAIN ] YELP: Loaded 45436 primary data records. [2025-10-13T22:45:04.977223] [DEBUG] [LOCAL ] XYL: Loaded 47852 existing records from primary storage. [2025-10-13T22:45:05.048747] [INFO ] [MAIN ] XYL: Loaded 47852 primary data records. [2025-10-13T22:45:05.817896] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:05.818993] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 36962 primary records. [2025-10-13T22:45:05.819211] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-13T22:45:05.850691] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-13T22:45:05.855682] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-13T22:45:05.858792] [INFO ] [MAIN ] Derivative Progress: 1786/1810 symbols completed. YALA took 1.1s. Estimated remaining: 9.2s. Rate: 156.4 symbols/min [2025-10-13T22:45:05.859198] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:05.856715] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:05.872158] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45436 primary records. [2025-10-13T22:45:05.877904] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-13T22:45:05.877808] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:05.879674] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47852 primary records. [2025-10-13T22:45:05.879832] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-13T22:45:05.896457] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-13T22:45:05.896813] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-13T22:45:05.899769] [INFO ] [MAIN ] Derivative Progress: 1787/1810 symbols completed. YELP took 1.1s. Estimated remaining: 8.8s. Rate: 156.4 symbols/min [2025-10-13T22:45:05.900030] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:05.916186] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-13T22:45:05.916382] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-13T22:45:05.919392] [INFO ] [MAIN ] Derivative Progress: 1788/1810 symbols completed. XYL took 1.2s. Estimated remaining: 8.4s. Rate: 156.5 symbols/min [2025-10-13T22:45:05.919728] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:05.987115] [DEBUG] [LOCAL ] YETI: Loaded 52473 existing records from primary storage. [2025-10-13T22:45:05.999200] [INFO ] [MAIN ] YETI: Loaded 52473 primary data records. [2025-10-13T22:45:05.999967] [DEBUG] [LOCAL ] YEXT: Loaded 43108 existing records from primary storage. [2025-10-13T22:45:06.031634] [INFO ] [MAIN ] YEXT: Loaded 43108 primary data records. [2025-10-13T22:45:06.197177] [DEBUG] [LOCAL ] YMM: Loaded 52604 existing records from primary storage. [2025-10-13T22:45:06.248631] [INFO ] [MAIN ] YMM: Loaded 52604 primary data records. [2025-10-13T22:45:07.008734] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:07.009905] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52473 primary records. [2025-10-13T22:45:07.010326] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-13T22:45:07.059931] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:07.065206] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:07.066048] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43108 primary records. [2025-10-13T22:45:07.066178] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-13T22:45:07.067182] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-13T22:45:07.067309] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-13T22:45:07.070078] [INFO ] [MAIN ] Derivative Progress: 1789/1810 symbols completed. YETI took 1.2s. Estimated remaining: 8.1s. Rate: 156.4 symbols/min [2025-10-13T22:45:07.070244] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:07.070818] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52604 primary records. [2025-10-13T22:45:07.082290] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-13T22:45:07.086540] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-13T22:45:07.086799] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-13T22:45:07.089897] [INFO ] [MAIN ] Derivative Progress: 1790/1810 symbols completed. YEXT took 1.2s. Estimated remaining: 7.7s. Rate: 156.4 symbols/min [2025-10-13T22:45:07.091169] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:07.108949] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-13T22:45:07.109286] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-13T22:45:07.112257] [INFO ] [MAIN ] Derivative Progress: 1791/1810 symbols completed. YMM took 1.2s. Estimated remaining: 7.3s. Rate: 156.5 symbols/min [2025-10-13T22:45:07.112526] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:07.128860] [DEBUG] [LOCAL ] YRD: Loaded 11833 existing records from primary storage. [2025-10-13T22:45:07.129033] [INFO ] [MAIN ] YRD: Loaded 11833 primary data records. [2025-10-13T22:45:07.475286] [DEBUG] [LOCAL ] YOU: Loaded 49667 existing records from primary storage. [2025-10-13T22:45:07.476003] [INFO ] [MAIN ] YOU: Loaded 49667 primary data records. [2025-10-13T22:45:07.488634] [DEBUG] [LOCAL ] YPF: Loaded 50614 existing records from primary storage. [2025-10-13T22:45:07.509599] [INFO ] [MAIN ] YPF: Loaded 50614 primary data records. [2025-10-13T22:45:08.184110] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:08.185684] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11833 primary records. [2025-10-13T22:45:08.185877] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-13T22:45:08.204361] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-13T22:45:08.204762] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-13T22:45:08.207296] [INFO ] [MAIN ] Derivative Progress: 1792/1810 symbols completed. YRD took 1.1s. Estimated remaining: 6.9s. Rate: 156.4 symbols/min [2025-10-13T22:45:08.208323] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:08.227557] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:08.228957] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49667 primary records. [2025-10-13T22:45:08.229143] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-13T22:45:08.261720] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:08.265095] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50614 primary records. [2025-10-13T22:45:08.265195] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-13T22:45:08.264223] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-13T22:45:08.265475] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-13T22:45:08.268330] [INFO ] [MAIN ] Derivative Progress: 1793/1810 symbols completed. YOU took 1.2s. Estimated remaining: 6.5s. Rate: 156.4 symbols/min [2025-10-13T22:45:08.268607] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:08.299678] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-13T22:45:08.299923] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-13T22:45:08.302905] [INFO ] [MAIN ] Derivative Progress: 1794/1810 symbols completed. YPF took 1.2s. Estimated remaining: 6.1s. Rate: 156.5 symbols/min [2025-10-13T22:45:08.303277] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:08.326713] [DEBUG] [LOCAL ] YUM: Loaded 51165 existing records from primary storage. [2025-10-13T22:45:08.327093] [INFO ] [MAIN ] YUM: Loaded 51165 primary data records. [2025-10-13T22:45:08.733464] [DEBUG] [LOCAL ] ZBH: Loaded 50790 existing records from primary storage. [2025-10-13T22:45:08.733797] [INFO ] [MAIN ] ZBH: Loaded 50790 primary data records. [2025-10-13T22:45:08.734775] [DEBUG] [LOCAL ] YUMC: Loaded 52596 existing records from primary storage. [2025-10-13T22:45:08.767891] [INFO ] [MAIN ] YUMC: Loaded 52596 primary data records. [2025-10-13T22:45:09.387392] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:09.389067] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51165 primary records. [2025-10-13T22:45:09.389267] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-13T22:45:09.406817] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-13T22:45:09.407047] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-13T22:45:09.411164] [INFO ] [MAIN ] Derivative Progress: 1795/1810 symbols completed. YUM took 1.2s. Estimated remaining: 5.8s. Rate: 156.3 symbols/min [2025-10-13T22:45:09.411925] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:09.432072] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:09.438106] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50790 primary records. [2025-10-13T22:45:09.439362] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-13T22:45:09.479048] [DEBUG] [LOCAL ] ZEPP: Loaded 18824 existing records from primary storage. [2025-10-13T22:45:09.480238] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:09.483807] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-13T22:45:09.484981] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52596 primary records. [2025-10-13T22:45:09.485075] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-13T22:45:09.481139] [INFO ] [MAIN ] ZEPP: Loaded 18824 primary data records. [2025-10-13T22:45:09.485244] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-13T22:45:09.489128] [INFO ] [MAIN ] Derivative Progress: 1796/1810 symbols completed. ZBH took 1.2s. Estimated remaining: 5.4s. Rate: 156.4 symbols/min [2025-10-13T22:45:09.500813] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:09.560173] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-13T22:45:09.569184] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-13T22:45:09.571910] [INFO ] [MAIN ] Derivative Progress: 1797/1810 symbols completed. YUMC took 1.3s. Estimated remaining: 5.0s. Rate: 156.5 symbols/min [2025-10-13T22:45:09.572133] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:09.852230] [DEBUG] [LOCAL ] ZGN: Loaded 40908 existing records from primary storage. [2025-10-13T22:45:09.866859] [INFO ] [MAIN ] ZGN: Loaded 40908 primary data records. [2025-10-13T22:45:09.901874] [DEBUG] [LOCAL ] ZETA: Loaded 53611 existing records from primary storage. [2025-10-13T22:45:09.907841] [INFO ] [MAIN ] ZETA: Loaded 53611 primary data records. [2025-10-13T22:45:10.159238] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:10.256836] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 18824 primary records. [2025-10-13T22:45:10.394049] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-13T22:45:10.602198] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-10-13T22:45:10.602541] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-13T22:45:10.607666] [INFO ] [MAIN ] Derivative Progress: 1798/1810 symbols completed. ZEPP took 1.2s. Estimated remaining: 4.6s. Rate: 156.3 symbols/min [2025-10-13T22:45:10.645014] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:10.646449] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53611 primary records. [2025-10-13T22:45:10.646545] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-13T22:45:10.645591] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:10.648226] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40908 primary records. [2025-10-13T22:45:10.648382] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-13T22:45:10.664826] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-13T22:45:10.665172] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-13T22:45:10.675713] [INFO ] [MAIN ] Derivative Progress: 1799/1810 symbols completed. ZETA took 1.2s. Estimated remaining: 4.2s. Rate: 156.4 symbols/min [2025-10-13T22:45:10.684252] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-13T22:45:10.684325] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-13T22:45:10.687031] [INFO ] [MAIN ] Derivative Progress: 1800/1810 symbols completed. ZGN took 1.1s. Estimated remaining: 3.8s. Rate: 156.5 symbols/min [2025-10-13T22:45:10.687484] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:10.687661] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:10.687611] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:10.730167] [DEBUG] [LOCAL ] ZH: Loaded 25584 existing records from primary storage. [2025-10-13T22:45:10.730516] [INFO ] [MAIN ] ZH: Loaded 25584 primary data records. [2025-10-13T22:45:10.873360] [DEBUG] [LOCAL ] ZIP: Loaded 43740 existing records from primary storage. [2025-10-13T22:45:10.879030] [INFO ] [MAIN ] ZIP: Loaded 43740 primary data records. [2025-10-13T22:45:11.030197] [DEBUG] [LOCAL ] ZIM: Loaded 53499 existing records from primary storage. [2025-10-13T22:45:11.057415] [INFO ] [MAIN ] ZIM: Loaded 53499 primary data records. [2025-10-13T22:45:11.773368] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:11.774327] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 25584 primary records. [2025-10-13T22:45:11.776935] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-13T22:45:11.808534] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:11.808177] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-13T22:45:11.809681] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-13T22:45:11.809529] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43740 primary records. [2025-10-13T22:45:11.809872] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-13T22:45:11.812897] [INFO ] [MAIN ] Derivative Progress: 1801/1810 symbols completed. ZH took 1.1s. Estimated remaining: 3.5s. Rate: 156.3 symbols/min [2025-10-13T22:45:11.813519] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:11.833592] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-13T22:45:11.839717] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-13T22:45:11.843930] [INFO ] [MAIN ] Derivative Progress: 1802/1810 symbols completed. ZIP took 1.2s. Estimated remaining: 3.1s. Rate: 156.4 symbols/min [2025-10-13T22:45:11.854460] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:11.855082] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:11.856593] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53499 primary records. [2025-10-13T22:45:11.856976] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-13T22:45:11.880418] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-13T22:45:11.880749] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-13T22:45:11.884537] [INFO ] [MAIN ] Derivative Progress: 1803/1810 symbols completed. ZIM took 1.2s. Estimated remaining: 2.7s. Rate: 156.5 symbols/min [2025-10-13T22:45:11.889863] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:11.889733] [DEBUG] [LOCAL ] ZKH: Loaded 7571 existing records from primary storage. [2025-10-13T22:45:11.890142] [INFO ] [MAIN ] ZKH: Loaded 7571 primary data records. [2025-10-13T22:45:12.087100] [DEBUG] [LOCAL ] ZK: Loaded 39149 existing records from primary storage. [2025-10-13T22:45:12.119981] [INFO ] [MAIN ] ZK: Loaded 39149 primary data records. [2025-10-13T22:45:12.386148] [DEBUG] [LOCAL ] ZTO: Loaded 49519 existing records from primary storage. [2025-10-13T22:45:12.393547] [INFO ] [MAIN ] ZTO: Loaded 49519 primary data records. [2025-10-13T22:45:13.081394] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-13T22:45:13.094867] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7571 primary records. [2025-10-13T22:45:13.095498] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-13T22:45:13.125209] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-10-13T22:45:13.125842] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-13T22:45:13.130133] [INFO ] [MAIN ] Derivative Progress: 1804/1810 symbols completed. ZKH took 1.3s. Estimated remaining: 2.3s. Rate: 156.3 symbols/min [2025-10-13T22:45:13.131137] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:13.153496] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:13.154441] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39149 primary records. [2025-10-13T22:45:13.154533] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-13T22:45:13.183514] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-13T22:45:13.185515] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-13T22:45:13.198197] [INFO ] [MAIN ] Derivative Progress: 1805/1810 symbols completed. ZK took 1.4s. Estimated remaining: 1.9s. Rate: 156.4 symbols/min [2025-10-13T22:45:13.199574] [DEBUG] [LOCAL ] ZTR: Loaded 16829 existing records from primary storage. [2025-10-13T22:45:13.199985] [INFO ] [MAIN ] ZTR: Loaded 16829 primary data records. [2025-10-13T22:45:13.210848] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:13.241488] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:13.281753] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49519 primary records. [2025-10-13T22:45:13.303357] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-13T22:45:13.399435] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-13T22:45:13.417469] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-13T22:45:13.463767] [INFO ] [MAIN ] Derivative Progress: 1806/1810 symbols completed. ZTO took 1.6s. Estimated remaining: 1.5s. Rate: 156.4 symbols/min [2025-10-13T22:45:13.601316] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:13.645171] [DEBUG] [LOCAL ] ZTS: Loaded 53112 existing records from primary storage. [2025-10-13T22:45:13.645837] [INFO ] [MAIN ] ZTS: Loaded 53112 primary data records. [2025-10-13T22:45:13.829553] [DEBUG] [LOCAL ] ZVIA: Loaded 35625 existing records from primary storage. [2025-10-13T22:45:13.919953] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:13.881716] [INFO ] [MAIN ] ZVIA: Loaded 35625 primary data records. [2025-10-13T22:45:14.003882] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16829 primary records. [2025-10-13T22:45:14.014245] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-13T22:45:14.126434] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-13T22:45:14.132112] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-13T22:45:14.134743] [INFO ] [MAIN ] Derivative Progress: 1807/1810 symbols completed. ZTR took 1.0s. Estimated remaining: 1.2s. Rate: 156.3 symbols/min [2025-10-13T22:45:14.150143] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-13T22:45:14.377905] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:14.378867] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53112 primary records. [2025-10-13T22:45:14.378997] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-13T22:45:14.407564] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-13T22:45:14.408165] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-13T22:45:14.410744] [INFO ] [MAIN ] Derivative Progress: 1808/1810 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 156.3 symbols/min [2025-10-13T22:45:14.438384] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:14.439171] [DEBUG] [LOCAL ] ZWS: Loaded 42321 existing records from primary storage. [2025-10-13T22:45:14.439944] [INFO ] [MAIN ] ZWS: Loaded 42321 primary data records. [2025-10-13T22:45:14.439878] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35625 primary records. [2025-10-13T22:45:14.440109] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-13T22:45:14.610507] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-13T22:45:14.629221] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-13T22:45:14.768387] [INFO ] [MAIN ] Derivative Progress: 1809/1810 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.4s. Rate: 156.3 symbols/min [2025-10-13T22:45:14.806388] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-13T22:45:14.807009] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42321 primary records. [2025-10-13T22:45:14.807070] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-13T22:45:14.821937] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-13T22:45:14.821999] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-13T22:45:14.824226] [INFO ] [MAIN ] Derivative Progress: 1810/1810 symbols completed. ZWS took 0.7s. Estimated remaining: 0.0s. Rate: 156.4 symbols/min [2025-10-13T22:45:14.825001] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 34s [2025-10-13T22:45:14.825124] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1810/1810 symbols) [2025-10-13T22:45:15.361369] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1810/1810 @ 100.00%)' [2025-10-13T22:45:15.361854] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-13T22:45:15.363148] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-13T22:45:15.363387] [INFO ] [STATE ] Last completion updated: 2025-10-13T22:45:15.363226